2024-03-30T13:21:23.558 INFO:root:teuthology version: 0.0.1.dev262+ge691533 2024-03-30T13:21:23.558 DEBUG:teuthology.run:Teuthology command: teuthology --archive /home/teuthworker/archive/teuthology-2024-03-29_21:08:02-orch-squid-distro-default-smithi/7630107 --name teuthology-2024-03-29_21:08:02-orch-squid-distro-default-smithi --description orch/cephadm/upgrade/{1-start-distro/1-start-centos_9.stream 2-repo_digest/repo_digest 3-upgrade/staggered 4-wait 5-upgrade-ls agent/on mon_election/classic} --verbose --owner scheduled_teuthology@teuthology -- /home/teuthworker/archive/teuthology-2024-03-29_21:08:02-orch-squid-distro-default-smithi/7630107/orig.config.yaml 2024-03-30T13:21:23.605 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-30T13:21:23.699 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/teuthology-2024-03-29_21:08:02-orch-squid-distro-default-smithi/7630107 branch: squid description: orch/cephadm/upgrade/{1-start-distro/1-start-centos_9.stream 2-repo_digest/repo_digest 3-upgrade/staggered 4-wait 5-upgrade-ls agent/on mon_election/classic} email: ceph-qa@ceph.com first_in_suite: false job_id: '7630107' kernel: kdb: true sha1: distro last_in_suite: false machine_type: smithi name: teuthology-2024-03-29_21:08:02-orch-squid-distro-default-smithi no_nested_subset: false nuke-on-error: true os_type: centos os_version: 9.stream overrides: admin_socket: branch: squid ceph: conf: global: mon election default strategy: 1 mgr: debug mgr: 20 debug ms: 1 mgr/cephadm/use_agent: true mon: debug mon: 20 debug ms: 1 debug paxos: 20 osd: debug ms: 1 debug osd: 20 flavor: default log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) sha1: 4e50bbcdd1630c7760b708f3a5b4d38a121e66cb ceph-deploy: conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} install: ceph: flavor: default sha1: 4e50bbcdd1630c7760b708f3a5b4d38a121e66cb workunit: branch: squid sha1: 5af0400050a123dc31f105425174f106e057276a owner: scheduled_teuthology@teuthology priority: 100 repo: https://git.ceph.com/ceph.git roles: - - mon.a - mon.c - mgr.y - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - node-exporter.a - alertmanager.a - - mon.b - mgr.x - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - prometheus.a - grafana.a - node-exporter.b seed: 8777 sha1: 4e50bbcdd1630c7760b708f3a5b4d38a121e66cb sleep_before_teardown: 0 subset: 43/64 suite: orch suite_branch: squid suite_path: /home/teuthworker/src/git.ceph.com_ceph_5af0400050a123dc31f105425174f106e057276a/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph.git suite_sha1: 5af0400050a123dc31f105425174f106e057276a targets: smithi099.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBGMSyZlWQkKzFwF6TDPK9IJwRhWHLdLXz/3MOGu9qXM+iiLL9Zsol3h+ZFzTh/gRwERND6NY9esE6gILIl0JOMI= smithi181.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBO6bbbhPuXSp7u5lkGVG9HPoFR2G95teBYWhOajCENkSpjvOr6/NIsbRfitGH5h/Pdx7ia8UDfz5Y5ByWbwjGqE= tasks: - cephadm: cephadm_branch: v17.2.0 cephadm_git_url: https://github.com/ceph/ceph image: quay.io/ceph/ceph:v17.2.0 - cephadm.shell: mon.a: - ceph config set mgr mgr/cephadm/use_repo_digest false --force - cephadm.shell: env: - sha1 mon.a: - radosgw-admin realm create --rgw-realm=r --default - radosgw-admin zonegroup create --rgw-zonegroup=default --master --default - radosgw-admin zone create --rgw-zonegroup=default --rgw-zone=z --master --default - radosgw-admin period update --rgw-realm=r --commit - ceph orch apply rgw foo --realm r --zone z --placement=2 --port=8000 - ceph osd pool create foo - rbd pool init foo - ceph orch apply iscsi foo u p - sleep 180 - ceph config set mon mon_warn_on_insecure_global_id_reclaim false --force - ceph config set mon mon_warn_on_insecure_global_id_reclaim_allowed false --force - ceph config set global log_to_journald false --force - ceph orch ps - ceph versions - ceph -s - ceph orch ls - ceph orch daemon redeploy "mgr.$(ceph mgr dump -f json | jq .standbys | jq .[] | jq -r .name)" --image quay.ceph.io/ceph-ci/ceph:$sha1 - ceph orch ps --refresh - sleep 180 - ceph orch ps - ceph versions - ceph -s - ceph health detail - ceph versions | jq -e '.mgr | length == 2' - ceph mgr fail - sleep 180 - ceph orch daemon redeploy "mgr.$(ceph mgr dump -f json | jq .standbys | jq .[] | jq -r .name)" --image quay.ceph.io/ceph-ci/ceph:$sha1 - ceph orch ps --refresh - sleep 180 - ceph orch ps - ceph versions - ceph health detail - ceph -s - ceph mgr fail - sleep 180 - ceph orch ps - ceph versions - ceph -s - ceph health detail - ceph versions | jq -e '.mgr | length == 1' - ceph mgr fail - sleep 180 - ceph orch ps - ceph orch ls - ceph versions - ceph orch upgrade start --image quay.ceph.io/ceph-ci/ceph:$sha1 --daemon-types mgr - while ceph orch upgrade status | jq '.in_progress' | grep true && ! ceph orch upgrade status | jq '.message' | grep Error ; do ceph orch ps ; ceph versions ; ceph orch upgrade status ; sleep 30 ; done - ceph versions | jq -e '.mgr | length == 1' - ceph versions | jq -e '.mgr | keys' | grep $sha1 - ceph versions | jq -e '.overall | length == 2' - ceph orch upgrade check quay.ceph.io/ceph-ci/ceph:$sha1 | jq -e '.up_to_date | length == 2' - ceph orch upgrade status - ceph health detail - ceph orch upgrade start --image quay.ceph.io/ceph-ci/ceph:$sha1 --daemon-types mon --hosts $(ceph orch ps | grep mgr.x | awk '{print $2}') - while ceph orch upgrade status | jq '.in_progress' | grep true && ! ceph orch upgrade status | jq '.message' | grep Error ; do ceph orch ps ; ceph versions ; ceph orch upgrade status ; sleep 30 ; done - ceph orch ps - ceph versions | jq -e '.mon | length == 2' - ceph orch upgrade status - ceph health detail - ceph orch upgrade start --image quay.ceph.io/ceph-ci/ceph:$sha1 --daemon-types mon --hosts $(ceph orch ps | grep mgr.y | awk '{print $2}') - while ceph orch upgrade status | jq '.in_progress' | grep true && ! ceph orch upgrade status | jq '.message' | grep Error ; do ceph orch ps ; ceph versions ; ceph orch upgrade status ; sleep 30 ; done - ceph orch ps - ceph versions | jq -e '.mon | length == 1' - ceph versions | jq -e '.mon | keys' | grep $sha1 - ceph orch upgrade check quay.ceph.io/ceph-ci/ceph:$sha1 | jq -e '.up_to_date | length == 5' - ceph orch upgrade status - ceph health detail - ceph orch upgrade start --image quay.ceph.io/ceph-ci/ceph:$sha1 --daemon-types osd --limit 2 - while ceph orch upgrade status | jq '.in_progress' | grep true && ! ceph orch upgrade status | jq '.message' | grep Error ; do ceph orch ps ; ceph versions ; ceph orch upgrade status ; sleep 30 ; done - ceph orch ps - ceph versions | jq -e '.osd | length == 2' - ceph orch upgrade check quay.ceph.io/ceph-ci/ceph:$sha1 | jq -e '.up_to_date | length == 7' - ceph orch upgrade status - ceph health detail - ceph orch upgrade start --image quay.ceph.io/ceph-ci/ceph:$sha1 --daemon-types crash,osd --limit 1 - while ceph orch upgrade status | jq '.in_progress' | grep true && ! ceph orch upgrade status | jq '.message' | grep Error ; do ceph orch ps ; ceph versions ; ceph orch upgrade status ; sleep 30 ; done - ceph orch ps - ceph versions | jq -e '.osd | length == 2' - ceph orch upgrade check quay.ceph.io/ceph-ci/ceph:$sha1 | jq -e '.up_to_date | length == 8' - ceph orch upgrade status - ceph health detail - ceph orch upgrade start --image quay.ceph.io/ceph-ci/ceph:$sha1 --daemon-types crash,osd - while ceph orch upgrade status | jq '.in_progress' | grep true && ! ceph orch upgrade status | jq '.message' | grep Error ; do ceph orch ps ; ceph versions ; ceph orch upgrade status ; sleep 30 ; done - ceph orch ps - ceph versions | jq -e '.osd | length == 1' - ceph versions | jq -e '.osd | keys' | grep $sha1 - ceph orch upgrade status - ceph health detail - ceph orch upgrade start --image quay.ceph.io/ceph-ci/ceph:$sha1 --services rgw.foo - while ceph orch upgrade status | jq '.in_progress' | grep true && ! ceph orch upgrade status | jq '.message' | grep Error ; do ceph orch ps ; ceph versions ; ceph orch upgrade status ; sleep 30 ; done - ceph orch ps - ceph versions | jq -e '.rgw | length == 1' - ceph versions | jq -e '.rgw | keys' | grep $sha1 - ceph orch upgrade status - ceph health detail - ceph orch upgrade start --image quay.ceph.io/ceph-ci/ceph:$sha1 - cephadm.shell: env: - sha1 mon.a: - while ceph orch upgrade status | jq '.in_progress' | grep true && ! ceph orch upgrade status | jq '.message' | grep Error ; do ceph orch ps ; ceph versions ; ceph orch upgrade status ; ceph health detail ; sleep 30 ; done - ceph orch ps - ceph versions - echo "wait for servicemap items w/ changing names to refresh" - sleep 60 - ceph orch ps - ceph versions - ceph orch upgrade status - ceph health detail - ceph versions | jq -e '.overall | length == 1' - ceph versions | jq -e '.overall | keys' | grep $sha1 - ceph orch ls | grep '^osd ' - cephadm.shell: mon.a: - ceph orch upgrade ls - ceph orch upgrade ls --image quay.io/ceph/ceph --show-all-versions | grep 16.2.0 - ceph orch upgrade ls --image quay.io/ceph/ceph --tags | grep v16.2.2 teuthology: fragments_dropped: [] meta: {} postmerge: [] teuthology_branch: main teuthology_sha1: e691533f9cbb33d85b2187bba20d7102f098636d timestamp: 2024-03-29_21:08:02 tube: smithi user: teuthology verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885 2024-03-30T13:21:23.699 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph_5af0400050a123dc31f105425174f106e057276a/qa; will attempt to use it 2024-03-30T13:21:23.701 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph_5af0400050a123dc31f105425174f106e057276a/qa/tasks 2024-03-30T13:21:23.701 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-03-30T13:21:23.703 INFO:teuthology.task.internal:Checking packages... 2024-03-30T13:21:23.726 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash '4e50bbcdd1630c7760b708f3a5b4d38a121e66cb' 2024-03-30T13:21:23.727 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-03-30T13:21:23.727 INFO:teuthology.packaging:ref: None 2024-03-30T13:21:23.727 INFO:teuthology.packaging:tag: None 2024-03-30T13:21:23.727 INFO:teuthology.packaging:branch: squid 2024-03-30T13:21:23.727 INFO:teuthology.packaging:sha1: 4e50bbcdd1630c7760b708f3a5b4d38a121e66cb 2024-03-30T13:21:23.727 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=squid 2024-03-30T13:21:23.889 INFO:teuthology.task.internal:Found packages for ceph version 19.0.0-1973.g5af04000 2024-03-30T13:21:23.891 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-03-30T13:21:23.896 INFO:teuthology.task.internal:no buildpackages task found 2024-03-30T13:21:23.897 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-03-30T13:21:23.915 INFO:teuthology.task.internal:Saving configuration 2024-03-30T13:21:23.934 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-03-30T13:21:23.944 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-03-30T13:21:23.970 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi099.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-03-29_21:08:02-orch-squid-distro-default-smithi/7630107', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-03-30 13:15:57.098925', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBGMSyZlWQkKzFwF6TDPK9IJwRhWHLdLXz/3MOGu9qXM+iiLL9Zsol3h+ZFzTh/gRwERND6NY9esE6gILIl0JOMI='} 2024-03-30T13:21:23.990 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi181.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-03-29_21:08:02-orch-squid-distro-default-smithi/7630107', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-03-30 13:15:57.097327', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBO6bbbhPuXSp7u5lkGVG9HPoFR2G95teBYWhOajCENkSpjvOr6/NIsbRfitGH5h/Pdx7ia8UDfz5Y5ByWbwjGqE='} 2024-03-30T13:21:23.990 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-03-30T13:21:23.996 INFO:teuthology.task.internal:roles: ubuntu@smithi099.front.sepia.ceph.com - ['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'node-exporter.a', 'alertmanager.a'] 2024-03-30T13:21:23.996 INFO:teuthology.task.internal:roles: ubuntu@smithi181.front.sepia.ceph.com - ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'prometheus.a', 'grafana.a', 'node-exporter.b'] 2024-03-30T13:21:23.996 INFO:teuthology.run_tasks:Running task console_log... 2024-03-30T13:21:24.065 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f061d7450d0>, signals=[15]) 2024-03-30T13:21:24.065 INFO:teuthology.run_tasks:Running task internal.connect... 2024-03-30T13:21:24.070 INFO:teuthology.task.internal:Opening connections... 2024-03-30T13:21:24.070 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi099.front.sepia.ceph.com 2024-03-30T13:21:24.072 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi099.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-30T13:21:24.163 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi181.front.sepia.ceph.com 2024-03-30T13:21:24.164 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi181.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-30T13:21:24.254 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-03-30T13:21:24.260 DEBUG:teuthology.orchestra.run.smithi099:> uname -m 2024-03-30T13:21:24.278 INFO:teuthology.orchestra.run.smithi099.stdout:x86_64 2024-03-30T13:21:24.279 DEBUG:teuthology.orchestra.run.smithi099:> cat /etc/os-release 2024-03-30T13:21:24.335 INFO:teuthology.orchestra.run.smithi099.stdout:NAME="CentOS Stream" 2024-03-30T13:21:24.335 INFO:teuthology.orchestra.run.smithi099.stdout:VERSION="9" 2024-03-30T13:21:24.335 INFO:teuthology.orchestra.run.smithi099.stdout:ID="centos" 2024-03-30T13:21:24.335 INFO:teuthology.orchestra.run.smithi099.stdout:ID_LIKE="rhel fedora" 2024-03-30T13:21:24.336 INFO:teuthology.orchestra.run.smithi099.stdout:VERSION_ID="9" 2024-03-30T13:21:24.336 INFO:teuthology.orchestra.run.smithi099.stdout:PLATFORM_ID="platform:el9" 2024-03-30T13:21:24.336 INFO:teuthology.orchestra.run.smithi099.stdout:PRETTY_NAME="CentOS Stream 9" 2024-03-30T13:21:24.336 INFO:teuthology.orchestra.run.smithi099.stdout:ANSI_COLOR="0;31" 2024-03-30T13:21:24.336 INFO:teuthology.orchestra.run.smithi099.stdout:LOGO="fedora-logo-icon" 2024-03-30T13:21:24.336 INFO:teuthology.orchestra.run.smithi099.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-03-30T13:21:24.336 INFO:teuthology.orchestra.run.smithi099.stdout:HOME_URL="https://centos.org/" 2024-03-30T13:21:24.336 INFO:teuthology.orchestra.run.smithi099.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-03-30T13:21:24.336 INFO:teuthology.orchestra.run.smithi099.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-03-30T13:21:24.336 INFO:teuthology.orchestra.run.smithi099.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-03-30T13:21:24.337 INFO:teuthology.lock.ops:Updating smithi099.front.sepia.ceph.com on lock server 2024-03-30T13:21:24.363 DEBUG:teuthology.orchestra.run.smithi181:> uname -m 2024-03-30T13:21:24.380 INFO:teuthology.orchestra.run.smithi181.stdout:x86_64 2024-03-30T13:21:24.381 DEBUG:teuthology.orchestra.run.smithi181:> cat /etc/os-release 2024-03-30T13:21:24.438 INFO:teuthology.orchestra.run.smithi181.stdout:NAME="CentOS Stream" 2024-03-30T13:21:24.438 INFO:teuthology.orchestra.run.smithi181.stdout:VERSION="9" 2024-03-30T13:21:24.438 INFO:teuthology.orchestra.run.smithi181.stdout:ID="centos" 2024-03-30T13:21:24.438 INFO:teuthology.orchestra.run.smithi181.stdout:ID_LIKE="rhel fedora" 2024-03-30T13:21:24.438 INFO:teuthology.orchestra.run.smithi181.stdout:VERSION_ID="9" 2024-03-30T13:21:24.438 INFO:teuthology.orchestra.run.smithi181.stdout:PLATFORM_ID="platform:el9" 2024-03-30T13:21:24.438 INFO:teuthology.orchestra.run.smithi181.stdout:PRETTY_NAME="CentOS Stream 9" 2024-03-30T13:21:24.439 INFO:teuthology.orchestra.run.smithi181.stdout:ANSI_COLOR="0;31" 2024-03-30T13:21:24.439 INFO:teuthology.orchestra.run.smithi181.stdout:LOGO="fedora-logo-icon" 2024-03-30T13:21:24.439 INFO:teuthology.orchestra.run.smithi181.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-03-30T13:21:24.439 INFO:teuthology.orchestra.run.smithi181.stdout:HOME_URL="https://centos.org/" 2024-03-30T13:21:24.439 INFO:teuthology.orchestra.run.smithi181.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-03-30T13:21:24.439 INFO:teuthology.orchestra.run.smithi181.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-03-30T13:21:24.439 INFO:teuthology.orchestra.run.smithi181.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-03-30T13:21:24.439 INFO:teuthology.lock.ops:Updating smithi181.front.sepia.ceph.com on lock server 2024-03-30T13:21:24.462 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-03-30T13:21:24.471 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-03-30T13:21:24.476 INFO:teuthology.task.internal:Checking for old test directory... 2024-03-30T13:21:24.477 DEBUG:teuthology.orchestra.run.smithi099:> test '!' -e /home/ubuntu/cephtest 2024-03-30T13:21:24.479 DEBUG:teuthology.orchestra.run.smithi181:> test '!' -e /home/ubuntu/cephtest 2024-03-30T13:21:24.495 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-03-30T13:21:24.500 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-03-30T13:21:24.501 DEBUG:teuthology.orchestra.run.smithi099:> test -z $(ls -A /var/lib/ceph) 2024-03-30T13:21:24.536 DEBUG:teuthology.orchestra.run.smithi181:> test -z $(ls -A /var/lib/ceph) 2024-03-30T13:21:24.638 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-03-30T13:21:24.698 INFO:teuthology.run_tasks:Running task kernel... 2024-03-30T13:21:24.714 INFO:teuthology.task.kernel:normalize config orig: {'kdb': True, 'sha1': 'distro'} 2024-03-30T13:21:24.714 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': True, 'sha1': 'distro'}, 'mon.b': {'kdb': True, 'sha1': 'distro'}}, timeout 300 2024-03-30T13:21:24.714 DEBUG:teuthology.orchestra.run.smithi099:> test -f /run/.containerenv -o -f /.dockerenv 2024-03-30T13:21:24.715 DEBUG:teuthology.orchestra.run.smithi181:> test -f /run/.containerenv -o -f /.dockerenv 2024-03-30T13:21:24.733 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-30T13:21:24.733 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-30T13:21:24.734 DEBUG:teuthology.orchestra.run.smithi181:> uname -r 2024-03-30T13:21:24.734 DEBUG:teuthology.orchestra.run.smithi099:> uname -r 2024-03-30T13:21:24.790 INFO:teuthology.orchestra.run.smithi099.stdout:5.14.0-361.el9.x86_64 2024-03-30T13:21:24.791 INFO:teuthology.task.kernel:Running kernel on smithi099: 5.14.0-361.el9.x86_64 2024-03-30T13:21:24.791 DEBUG:teuthology.orchestra.run.smithi099:> sudo yum install -y kernel 2024-03-30T13:21:24.792 INFO:teuthology.orchestra.run.smithi181.stdout:5.14.0-361.el9.x86_64 2024-03-30T13:21:24.792 INFO:teuthology.task.kernel:Running kernel on smithi181: 5.14.0-361.el9.x86_64 2024-03-30T13:21:24.792 DEBUG:teuthology.orchestra.run.smithi181:> sudo yum install -y kernel 2024-03-30T13:21:27.431 INFO:teuthology.orchestra.run.smithi099.stdout:CentOS-9 - AppStream 7.2 MB/s | 6.7 MB 00:00 2024-03-30T13:21:27.573 INFO:teuthology.orchestra.run.smithi181.stdout:CentOS-9 - AppStream 5.7 MB/s | 6.7 MB 00:01 2024-03-30T13:21:29.131 INFO:teuthology.orchestra.run.smithi099.stdout:CentOS-9 - BaseOS 3.3 MB/s | 2.0 MB 00:00 2024-03-30T13:21:29.506 INFO:teuthology.orchestra.run.smithi181.stdout:CentOS-9 - BaseOS 2.2 MB/s | 2.0 MB 00:00 2024-03-30T13:21:30.113 INFO:teuthology.orchestra.run.smithi099.stdout:CentOS Stream 9 - BaseOS 12 MB/s | 8.0 MB 00:00 2024-03-30T13:21:30.355 INFO:teuthology.orchestra.run.smithi181.stdout:CentOS Stream 9 - BaseOS 15 MB/s | 8.0 MB 00:00 2024-03-30T13:21:35.039 INFO:teuthology.orchestra.run.smithi181.stdout:CentOS Stream 9 - AppStream 5.1 MB/s | 19 MB 00:03 2024-03-30T13:21:39.915 INFO:teuthology.orchestra.run.smithi181.stdout:CentOS Stream 9 - CRB 4.6 MB/s | 6.1 MB 00:01 2024-03-30T13:21:41.515 INFO:teuthology.orchestra.run.smithi181.stdout:CentOS Stream 9 - Extras packages 34 kB/s | 16 kB 00:00 2024-03-30T13:21:43.119 INFO:teuthology.orchestra.run.smithi181.stdout:Extra Packages for Enterprise Linux 14 MB/s | 21 MB 00:01 2024-03-30T13:21:48.283 INFO:teuthology.orchestra.run.smithi181.stdout:lab-extras 8.9 kB/s | 1.7 kB 00:00 2024-03-30T13:21:50.573 INFO:teuthology.orchestra.run.smithi181.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-03-30T13:21:50.573 INFO:teuthology.orchestra.run.smithi181.stdout:Package kernel-5.14.0-361.el9.x86_64 is already installed. 2024-03-30T13:21:50.662 INFO:teuthology.orchestra.run.smithi181.stdout:Dependencies resolved. 2024-03-30T13:21:50.667 INFO:teuthology.orchestra.run.smithi181.stdout:================================================================================ 2024-03-30T13:21:50.667 INFO:teuthology.orchestra.run.smithi181.stdout: Package Arch Version Repository Size 2024-03-30T13:21:50.667 INFO:teuthology.orchestra.run.smithi181.stdout:================================================================================ 2024-03-30T13:21:50.667 INFO:teuthology.orchestra.run.smithi181.stdout:Installing: 2024-03-30T13:21:50.667 INFO:teuthology.orchestra.run.smithi181.stdout: kernel x86_64 5.14.0-434.el9 CentOS-BaseOS 192 k 2024-03-30T13:21:50.667 INFO:teuthology.orchestra.run.smithi181.stdout:Installing dependencies: 2024-03-30T13:21:50.667 INFO:teuthology.orchestra.run.smithi181.stdout: kernel-core x86_64 5.14.0-434.el9 CentOS-BaseOS 15 M 2024-03-30T13:21:50.667 INFO:teuthology.orchestra.run.smithi181.stdout: kernel-modules x86_64 5.14.0-434.el9 CentOS-BaseOS 34 M 2024-03-30T13:21:50.667 INFO:teuthology.orchestra.run.smithi181.stdout: kernel-modules-core x86_64 5.14.0-434.el9 CentOS-BaseOS 28 M 2024-03-30T13:21:50.667 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-03-30T13:21:50.668 INFO:teuthology.orchestra.run.smithi181.stdout:Transaction Summary 2024-03-30T13:21:50.668 INFO:teuthology.orchestra.run.smithi181.stdout:================================================================================ 2024-03-30T13:21:50.668 INFO:teuthology.orchestra.run.smithi181.stdout:Install 4 Packages 2024-03-30T13:21:50.668 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-03-30T13:21:50.668 INFO:teuthology.orchestra.run.smithi181.stdout:Total download size: 76 M 2024-03-30T13:21:50.668 INFO:teuthology.orchestra.run.smithi181.stdout:Installed size: 123 M 2024-03-30T13:21:50.668 INFO:teuthology.orchestra.run.smithi181.stdout:Downloading Packages: 2024-03-30T13:21:50.825 INFO:teuthology.orchestra.run.smithi181.stdout:(1/4): kernel-5.14.0-434.el9.x86_64.rpm 1.2 MB/s | 192 kB 00:00 2024-03-30T13:21:52.276 INFO:teuthology.orchestra.run.smithi181.stdout:(2/4): kernel-core-5.14.0-434.el9.x86_64.rpm 9.4 MB/s | 15 MB 00:01 2024-03-30T13:21:53.484 INFO:teuthology.orchestra.run.smithi181.stdout:(3/4): kernel-modules-5.14.0-434.el9.x86_64.rpm 12 MB/s | 34 MB 00:02 2024-03-30T13:21:54.442 INFO:teuthology.orchestra.run.smithi181.stdout:(4/4): kernel-modules-core-5.14.0-434.el9.x86_6 7.6 MB/s | 28 MB 00:03 2024-03-30T13:21:54.446 INFO:teuthology.orchestra.run.smithi181.stdout:-------------------------------------------------------------------------------- 2024-03-30T13:21:54.446 INFO:teuthology.orchestra.run.smithi181.stdout:Total 20 MB/s | 76 MB 00:03 2024-03-30T13:21:54.446 INFO:teuthology.orchestra.run.smithi181.stdout:Running transaction check 2024-03-30T13:21:54.817 INFO:teuthology.orchestra.run.smithi181.stdout:Transaction check succeeded. 2024-03-30T13:21:54.818 INFO:teuthology.orchestra.run.smithi181.stdout:Running transaction test 2024-03-30T13:21:55.652 INFO:teuthology.orchestra.run.smithi181.stdout:Transaction test succeeded. 2024-03-30T13:21:55.653 INFO:teuthology.orchestra.run.smithi181.stdout:Running transaction 2024-03-30T13:21:57.938 INFO:teuthology.orchestra.run.smithi181.stdout: Preparing : 1/1 2024-03-30T13:21:58.545 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : kernel-modules-core-5.14.0-434.el9.x86_64 1/4 2024-03-30T13:21:58.592 INFO:teuthology.orchestra.run.smithi099.stdout:CentOS Stream 9 - AppStream 706 kB/s | 19 MB 00:27 2024-03-30T13:21:58.626 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : kernel-core-5.14.0-434.el9.x86_64 2/4 2024-03-30T13:22:01.378 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: kernel-core-5.14.0-434.el9.x86_64 2/4 2024-03-30T13:22:01.504 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : kernel-modules-5.14.0-434.el9.x86_64 3/4 2024-03-30T13:22:02.951 INFO:teuthology.orchestra.run.smithi099.stdout:CentOS Stream 9 - CRB 8.1 MB/s | 6.1 MB 00:00 2024-03-30T13:22:04.626 INFO:teuthology.orchestra.run.smithi099.stdout:CentOS Stream 9 - Extras packages 30 kB/s | 16 kB 00:00 2024-03-30T13:22:06.194 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: kernel-modules-5.14.0-434.el9.x86_64 3/4 2024-03-30T13:22:06.302 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : kernel-5.14.0-434.el9.x86_64 4/4 2024-03-30T13:22:07.111 INFO:teuthology.orchestra.run.smithi099.stdout:Extra Packages for Enterprise Linux 8.8 MB/s | 21 MB 00:02 2024-03-30T13:22:11.019 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: kernel-modules-core-5.14.0-434.el9.x86_64 4/4 2024-03-30T13:22:12.110 INFO:teuthology.orchestra.run.smithi099.stdout:lab-extras 13 kB/s | 1.7 kB 00:00 2024-03-30T13:22:14.401 INFO:teuthology.orchestra.run.smithi099.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-03-30T13:22:14.401 INFO:teuthology.orchestra.run.smithi099.stdout:Package kernel-5.14.0-361.el9.x86_64 is already installed. 2024-03-30T13:22:14.491 INFO:teuthology.orchestra.run.smithi099.stdout:Dependencies resolved. 2024-03-30T13:22:14.499 INFO:teuthology.orchestra.run.smithi099.stdout:================================================================================ 2024-03-30T13:22:14.499 INFO:teuthology.orchestra.run.smithi099.stdout: Package Arch Version Repository Size 2024-03-30T13:22:14.499 INFO:teuthology.orchestra.run.smithi099.stdout:================================================================================ 2024-03-30T13:22:14.499 INFO:teuthology.orchestra.run.smithi099.stdout:Installing: 2024-03-30T13:22:14.499 INFO:teuthology.orchestra.run.smithi099.stdout: kernel x86_64 5.14.0-434.el9 CentOS-BaseOS 192 k 2024-03-30T13:22:14.499 INFO:teuthology.orchestra.run.smithi099.stdout:Installing dependencies: 2024-03-30T13:22:14.499 INFO:teuthology.orchestra.run.smithi099.stdout: kernel-core x86_64 5.14.0-434.el9 CentOS-BaseOS 15 M 2024-03-30T13:22:14.499 INFO:teuthology.orchestra.run.smithi099.stdout: kernel-modules x86_64 5.14.0-434.el9 CentOS-BaseOS 34 M 2024-03-30T13:22:14.499 INFO:teuthology.orchestra.run.smithi099.stdout: kernel-modules-core x86_64 5.14.0-434.el9 CentOS-BaseOS 28 M 2024-03-30T13:22:14.499 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-03-30T13:22:14.499 INFO:teuthology.orchestra.run.smithi099.stdout:Transaction Summary 2024-03-30T13:22:14.499 INFO:teuthology.orchestra.run.smithi099.stdout:================================================================================ 2024-03-30T13:22:14.499 INFO:teuthology.orchestra.run.smithi099.stdout:Install 4 Packages 2024-03-30T13:22:14.500 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-03-30T13:22:14.500 INFO:teuthology.orchestra.run.smithi099.stdout:Total download size: 76 M 2024-03-30T13:22:14.500 INFO:teuthology.orchestra.run.smithi099.stdout:Installed size: 123 M 2024-03-30T13:22:14.500 INFO:teuthology.orchestra.run.smithi099.stdout:Downloading Packages: 2024-03-30T13:22:14.678 INFO:teuthology.orchestra.run.smithi099.stdout:(1/4): kernel-5.14.0-434.el9.x86_64.rpm 1.1 MB/s | 192 kB 00:00 2024-03-30T13:22:15.412 INFO:teuthology.orchestra.run.smithi099.stdout:(2/4): kernel-core-5.14.0-434.el9.x86_64.rpm 17 MB/s | 15 MB 00:00 2024-03-30T13:22:16.537 INFO:teuthology.orchestra.run.smithi099.stdout:(3/4): kernel-modules-5.14.0-434.el9.x86_64.rpm 16 MB/s | 34 MB 00:02 2024-03-30T13:22:21.361 INFO:teuthology.orchestra.run.smithi099.stdout:(4/4): kernel-modules-core-5.14.0-434.el9.x86_6 4.1 MB/s | 28 MB 00:06 2024-03-30T13:22:21.364 INFO:teuthology.orchestra.run.smithi099.stdout:-------------------------------------------------------------------------------- 2024-03-30T13:22:21.365 INFO:teuthology.orchestra.run.smithi099.stdout:Total 11 MB/s | 76 MB 00:06 2024-03-30T13:22:21.365 INFO:teuthology.orchestra.run.smithi099.stdout:Running transaction check 2024-03-30T13:22:21.735 INFO:teuthology.orchestra.run.smithi099.stdout:Transaction check succeeded. 2024-03-30T13:22:21.736 INFO:teuthology.orchestra.run.smithi099.stdout:Running transaction test 2024-03-30T13:22:22.576 INFO:teuthology.orchestra.run.smithi099.stdout:Transaction test succeeded. 2024-03-30T13:22:22.576 INFO:teuthology.orchestra.run.smithi099.stdout:Running transaction 2024-03-30T13:22:24.891 INFO:teuthology.orchestra.run.smithi099.stdout: Preparing : 1/1 2024-03-30T13:22:25.486 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : kernel-modules-core-5.14.0-434.el9.x86_64 1/4 2024-03-30T13:22:25.579 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : kernel-core-5.14.0-434.el9.x86_64 2/4 2024-03-30T13:22:28.328 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: kernel-core-5.14.0-434.el9.x86_64 2/4 2024-03-30T13:22:28.459 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : kernel-modules-5.14.0-434.el9.x86_64 3/4 2024-03-30T13:22:33.169 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: kernel-modules-5.14.0-434.el9.x86_64 3/4 2024-03-30T13:22:33.291 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : kernel-5.14.0-434.el9.x86_64 4/4 2024-03-30T13:22:38.019 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: kernel-modules-core-5.14.0-434.el9.x86_64 4/4 2024-03-30T13:22:40.264 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: kernel-core-5.14.0-434.el9.x86_64 4/4 2024-03-30T13:22:40.265 INFO:teuthology.orchestra.run.smithi181.stdout:dracut: Disabling early microcode, because kernel does not support it. CONFIG_MICROCODE_[AMD|INTEL]!=y 2024-03-30T13:22:40.265 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-03-30T13:22:40.307 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: kernel-modules-5.14.0-434.el9.x86_64 4/4 2024-03-30T13:22:40.706 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: kernel-5.14.0-434.el9.x86_64 4/4 2024-03-30T13:22:40.706 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : kernel-5.14.0-434.el9.x86_64 1/4 2024-03-30T13:22:40.706 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : kernel-core-5.14.0-434.el9.x86_64 2/4 2024-03-30T13:22:40.706 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : kernel-modules-5.14.0-434.el9.x86_64 3/4 2024-03-30T13:22:41.137 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : kernel-modules-core-5.14.0-434.el9.x86_64 4/4 2024-03-30T13:22:41.137 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-03-30T13:22:41.137 INFO:teuthology.orchestra.run.smithi181.stdout:Installed: 2024-03-30T13:22:41.137 INFO:teuthology.orchestra.run.smithi181.stdout: kernel-5.14.0-434.el9.x86_64 2024-03-30T13:22:41.137 INFO:teuthology.orchestra.run.smithi181.stdout: kernel-core-5.14.0-434.el9.x86_64 2024-03-30T13:22:41.137 INFO:teuthology.orchestra.run.smithi181.stdout: kernel-modules-5.14.0-434.el9.x86_64 2024-03-30T13:22:41.137 INFO:teuthology.orchestra.run.smithi181.stdout: kernel-modules-core-5.14.0-434.el9.x86_64 2024-03-30T13:22:41.138 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-03-30T13:22:41.138 INFO:teuthology.orchestra.run.smithi181.stdout:Complete! 2024-03-30T13:22:41.481 DEBUG:teuthology.orchestra.run.smithi181:> rpm -q kernel | sort -rV | head -n 1 2024-03-30T13:22:41.584 INFO:teuthology.orchestra.run.smithi181.stdout:kernel-5.14.0-434.el9.x86_64 2024-03-30T13:22:41.584 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-434.el9.x86_64 2024-03-30T13:22:41.584 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-361.el9.x86_64 Expected: 5.14.0-434.el9.x86_64 2024-03-30T13:22:41.584 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-03-30T13:22:41.584 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-03-30T13:22:41.584 INFO:teuthology.task.kernel:Installing distro kernel on mon.b... 2024-03-30T13:22:41.584 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi181.front.sepia.ceph.com, path=None, version=distro) 2024-03-30T13:22:41.585 DEBUG:teuthology.orchestra.run.smithi181:> rpm -q kernel | sort -rV | head -n 1 2024-03-30T13:22:41.664 INFO:teuthology.orchestra.run.smithi181.stdout:kernel-5.14.0-434.el9.x86_64 2024-03-30T13:22:41.664 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-434.el9.x86_64 2024-03-30T13:22:41.665 DEBUG:teuthology.orchestra.run.smithi181:> sudo rpm -qi grub2-tools 2024-03-30T13:22:41.702 INFO:teuthology.orchestra.run.smithi181.stdout:Name : grub2-tools 2024-03-30T13:22:41.703 INFO:teuthology.orchestra.run.smithi181.stdout:Epoch : 1 2024-03-30T13:22:41.703 INFO:teuthology.orchestra.run.smithi181.stdout:Version : 2.06 2024-03-30T13:22:41.703 INFO:teuthology.orchestra.run.smithi181.stdout:Release : 68.el9 2024-03-30T13:22:41.703 INFO:teuthology.orchestra.run.smithi181.stdout:Architecture: x86_64 2024-03-30T13:22:41.703 INFO:teuthology.orchestra.run.smithi181.stdout:Install Date: Fri 01 Sep 2023 09:14:30 PM UTC 2024-03-30T13:22:41.703 INFO:teuthology.orchestra.run.smithi181.stdout:Group : Unspecified 2024-03-30T13:22:41.703 INFO:teuthology.orchestra.run.smithi181.stdout:Size : 8264254 2024-03-30T13:22:41.703 INFO:teuthology.orchestra.run.smithi181.stdout:License : GPLv3+ 2024-03-30T13:22:41.703 INFO:teuthology.orchestra.run.smithi181.stdout:Signature : RSA/SHA256, Mon 07 Aug 2023 01:57:16 PM UTC, Key ID 05b555b38483c65d 2024-03-30T13:22:41.703 INFO:teuthology.orchestra.run.smithi181.stdout:Source RPM : grub2-2.06-68.el9.src.rpm 2024-03-30T13:22:41.703 INFO:teuthology.orchestra.run.smithi181.stdout:Build Date : Wed 02 Aug 2023 03:15:48 PM UTC 2024-03-30T13:22:41.703 INFO:teuthology.orchestra.run.smithi181.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-03-30T13:22:41.703 INFO:teuthology.orchestra.run.smithi181.stdout:Packager : builder@centos.org 2024-03-30T13:22:41.704 INFO:teuthology.orchestra.run.smithi181.stdout:Vendor : CentOS 2024-03-30T13:22:41.704 INFO:teuthology.orchestra.run.smithi181.stdout:URL : http://www.gnu.org/software/grub/ 2024-03-30T13:22:41.704 INFO:teuthology.orchestra.run.smithi181.stdout:Summary : Support tools for GRUB. 2024-03-30T13:22:41.704 INFO:teuthology.orchestra.run.smithi181.stdout:Description : 2024-03-30T13:22:41.704 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-03-30T13:22:41.704 INFO:teuthology.orchestra.run.smithi181.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-03-30T13:22:41.704 INFO:teuthology.orchestra.run.smithi181.stdout:customizable bootloader with modular architecture. It supports a rich 2024-03-30T13:22:41.704 INFO:teuthology.orchestra.run.smithi181.stdout:variety of kernel formats, file systems, computer architectures and 2024-03-30T13:22:41.704 INFO:teuthology.orchestra.run.smithi181.stdout:hardware devices. 2024-03-30T13:22:41.704 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-03-30T13:22:41.704 INFO:teuthology.orchestra.run.smithi181.stdout:This subpackage provides tools for support of all platforms. 2024-03-30T13:22:41.705 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-03-30T13:22:41.705 INFO:teuthology.task.kernel:Updating grub on smithi181 to boot 5.14.0-434.el9.x86_64 2024-03-30T13:22:41.705 DEBUG:teuthology.orchestra.run.smithi181:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-03-30T13:22:42.330 INFO:teuthology.orchestra.run.smithi181.stderr:Generating grub configuration file ... 2024-03-30T13:22:43.756 INFO:teuthology.orchestra.run.smithi181.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-03-30T13:22:43.793 INFO:teuthology.orchestra.run.smithi181.stderr:done 2024-03-30T13:22:43.796 DEBUG:teuthology.orchestra.run.smithi181:> mktemp 2024-03-30T13:22:43.812 INFO:teuthology.orchestra.run.smithi181.stdout:/tmp/tmp.f1N52fgdQw 2024-03-30T13:22:43.812 DEBUG:teuthology.orchestra.run.smithi181:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.f1N52fgdQw 2024-03-30T13:22:43.880 DEBUG:teuthology.orchestra.run.smithi181:> sudo chmod 0666 /tmp/tmp.f1N52fgdQw 2024-03-30T13:22:44.016 DEBUG:teuthology.orchestra.remote:smithi181:/tmp/tmp.f1N52fgdQw is 6KB 2024-03-30T13:22:44.064 DEBUG:teuthology.orchestra.run.smithi181:> rm -fr /tmp/tmp.f1N52fgdQw 2024-03-30T13:22:44.079 DEBUG:teuthology.orchestra.run.smithi181:> sudo /bin/ls /boot/loader/entries || true 2024-03-30T13:22:44.143 INFO:teuthology.orchestra.run.smithi181.stdout:15949e3c88704300882482eddfd7baae-0-rescue.conf 2024-03-30T13:22:44.143 INFO:teuthology.orchestra.run.smithi181.stdout:15949e3c88704300882482eddfd7baae-5.14.0-239.el9.x86_64.conf 2024-03-30T13:22:44.143 INFO:teuthology.orchestra.run.smithi181.stdout:15949e3c88704300882482eddfd7baae-5.14.0-361.el9.x86_64.conf 2024-03-30T13:22:44.143 INFO:teuthology.orchestra.run.smithi181.stdout:15949e3c88704300882482eddfd7baae-5.14.0-434.el9.x86_64.conf 2024-03-30T13:22:44.145 DEBUG:teuthology.orchestra.run.smithi181:> sudo grub2-set-default 15949e3c88704300882482eddfd7baae-5.14.0-434.el9.x86_64 2024-03-30T13:22:44.284 DEBUG:teuthology.orchestra.run.smithi181:> sudo shutdown -r now 2024-03-30T13:23:07.482 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: kernel-core-5.14.0-434.el9.x86_64 4/4 2024-03-30T13:23:07.482 INFO:teuthology.orchestra.run.smithi099.stdout:dracut: Disabling early microcode, because kernel does not support it. CONFIG_MICROCODE_[AMD|INTEL]!=y 2024-03-30T13:23:07.482 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-03-30T13:23:07.525 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: kernel-modules-5.14.0-434.el9.x86_64 4/4 2024-03-30T13:23:07.863 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: kernel-5.14.0-434.el9.x86_64 4/4 2024-03-30T13:23:07.863 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : kernel-5.14.0-434.el9.x86_64 1/4 2024-03-30T13:23:07.863 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : kernel-core-5.14.0-434.el9.x86_64 2/4 2024-03-30T13:23:07.863 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : kernel-modules-5.14.0-434.el9.x86_64 3/4 2024-03-30T13:23:08.299 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : kernel-modules-core-5.14.0-434.el9.x86_64 4/4 2024-03-30T13:23:08.299 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-03-30T13:23:08.299 INFO:teuthology.orchestra.run.smithi099.stdout:Installed: 2024-03-30T13:23:08.299 INFO:teuthology.orchestra.run.smithi099.stdout: kernel-5.14.0-434.el9.x86_64 2024-03-30T13:23:08.299 INFO:teuthology.orchestra.run.smithi099.stdout: kernel-core-5.14.0-434.el9.x86_64 2024-03-30T13:23:08.299 INFO:teuthology.orchestra.run.smithi099.stdout: kernel-modules-5.14.0-434.el9.x86_64 2024-03-30T13:23:08.299 INFO:teuthology.orchestra.run.smithi099.stdout: kernel-modules-core-5.14.0-434.el9.x86_64 2024-03-30T13:23:08.299 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-03-30T13:23:08.299 INFO:teuthology.orchestra.run.smithi099.stdout:Complete! 2024-03-30T13:23:08.622 DEBUG:teuthology.orchestra.run.smithi099:> rpm -q kernel | sort -rV | head -n 1 2024-03-30T13:23:08.715 INFO:teuthology.orchestra.run.smithi099.stdout:kernel-5.14.0-434.el9.x86_64 2024-03-30T13:23:08.715 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-434.el9.x86_64 2024-03-30T13:23:08.715 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-361.el9.x86_64 Expected: 5.14.0-434.el9.x86_64 2024-03-30T13:23:08.715 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-03-30T13:23:08.715 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-03-30T13:23:08.715 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2024-03-30T13:23:08.715 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi099.front.sepia.ceph.com, path=None, version=distro) 2024-03-30T13:23:08.716 DEBUG:teuthology.orchestra.run.smithi099:> rpm -q kernel | sort -rV | head -n 1 2024-03-30T13:23:08.795 INFO:teuthology.orchestra.run.smithi099.stdout:kernel-5.14.0-434.el9.x86_64 2024-03-30T13:23:08.795 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-434.el9.x86_64 2024-03-30T13:23:08.795 DEBUG:teuthology.orchestra.run.smithi099:> sudo rpm -qi grub2-tools 2024-03-30T13:23:08.829 INFO:teuthology.orchestra.run.smithi099.stdout:Name : grub2-tools 2024-03-30T13:23:08.829 INFO:teuthology.orchestra.run.smithi099.stdout:Epoch : 1 2024-03-30T13:23:08.829 INFO:teuthology.orchestra.run.smithi099.stdout:Version : 2.06 2024-03-30T13:23:08.829 INFO:teuthology.orchestra.run.smithi099.stdout:Release : 68.el9 2024-03-30T13:23:08.829 INFO:teuthology.orchestra.run.smithi099.stdout:Architecture: x86_64 2024-03-30T13:23:08.829 INFO:teuthology.orchestra.run.smithi099.stdout:Install Date: Fri 01 Sep 2023 09:14:30 PM UTC 2024-03-30T13:23:08.829 INFO:teuthology.orchestra.run.smithi099.stdout:Group : Unspecified 2024-03-30T13:23:08.829 INFO:teuthology.orchestra.run.smithi099.stdout:Size : 8264254 2024-03-30T13:23:08.830 INFO:teuthology.orchestra.run.smithi099.stdout:License : GPLv3+ 2024-03-30T13:23:08.830 INFO:teuthology.orchestra.run.smithi099.stdout:Signature : RSA/SHA256, Mon 07 Aug 2023 01:57:16 PM UTC, Key ID 05b555b38483c65d 2024-03-30T13:23:08.830 INFO:teuthology.orchestra.run.smithi099.stdout:Source RPM : grub2-2.06-68.el9.src.rpm 2024-03-30T13:23:08.830 INFO:teuthology.orchestra.run.smithi099.stdout:Build Date : Wed 02 Aug 2023 03:15:48 PM UTC 2024-03-30T13:23:08.830 INFO:teuthology.orchestra.run.smithi099.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-03-30T13:23:08.830 INFO:teuthology.orchestra.run.smithi099.stdout:Packager : builder@centos.org 2024-03-30T13:23:08.830 INFO:teuthology.orchestra.run.smithi099.stdout:Vendor : CentOS 2024-03-30T13:23:08.830 INFO:teuthology.orchestra.run.smithi099.stdout:URL : http://www.gnu.org/software/grub/ 2024-03-30T13:23:08.830 INFO:teuthology.orchestra.run.smithi099.stdout:Summary : Support tools for GRUB. 2024-03-30T13:23:08.830 INFO:teuthology.orchestra.run.smithi099.stdout:Description : 2024-03-30T13:23:08.830 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-03-30T13:23:08.830 INFO:teuthology.orchestra.run.smithi099.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-03-30T13:23:08.830 INFO:teuthology.orchestra.run.smithi099.stdout:customizable bootloader with modular architecture. It supports a rich 2024-03-30T13:23:08.831 INFO:teuthology.orchestra.run.smithi099.stdout:variety of kernel formats, file systems, computer architectures and 2024-03-30T13:23:08.831 INFO:teuthology.orchestra.run.smithi099.stdout:hardware devices. 2024-03-30T13:23:08.831 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-03-30T13:23:08.831 INFO:teuthology.orchestra.run.smithi099.stdout:This subpackage provides tools for support of all platforms. 2024-03-30T13:23:08.832 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-03-30T13:23:08.832 INFO:teuthology.task.kernel:Updating grub on smithi099 to boot 5.14.0-434.el9.x86_64 2024-03-30T13:23:08.832 DEBUG:teuthology.orchestra.run.smithi099:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-03-30T13:23:09.449 INFO:teuthology.orchestra.run.smithi099.stderr:Generating grub configuration file ... 2024-03-30T13:23:10.839 INFO:teuthology.orchestra.run.smithi099.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-03-30T13:23:10.879 INFO:teuthology.orchestra.run.smithi099.stderr:done 2024-03-30T13:23:10.882 DEBUG:teuthology.orchestra.run.smithi099:> mktemp 2024-03-30T13:23:10.898 INFO:teuthology.orchestra.run.smithi099.stdout:/tmp/tmp.5CWZF6aYlW 2024-03-30T13:23:10.898 DEBUG:teuthology.orchestra.run.smithi099:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.5CWZF6aYlW 2024-03-30T13:23:10.967 DEBUG:teuthology.orchestra.run.smithi099:> sudo chmod 0666 /tmp/tmp.5CWZF6aYlW 2024-03-30T13:23:11.111 DEBUG:teuthology.orchestra.remote:smithi099:/tmp/tmp.5CWZF6aYlW is 6KB 2024-03-30T13:23:11.159 DEBUG:teuthology.orchestra.run.smithi099:> rm -fr /tmp/tmp.5CWZF6aYlW 2024-03-30T13:23:11.173 DEBUG:teuthology.orchestra.run.smithi099:> sudo /bin/ls /boot/loader/entries || true 2024-03-30T13:23:11.238 INFO:teuthology.orchestra.run.smithi099.stdout:15949e3c88704300882482eddfd7baae-0-rescue.conf 2024-03-30T13:23:11.238 INFO:teuthology.orchestra.run.smithi099.stdout:15949e3c88704300882482eddfd7baae-5.14.0-239.el9.x86_64.conf 2024-03-30T13:23:11.238 INFO:teuthology.orchestra.run.smithi099.stdout:15949e3c88704300882482eddfd7baae-5.14.0-361.el9.x86_64.conf 2024-03-30T13:23:11.238 INFO:teuthology.orchestra.run.smithi099.stdout:15949e3c88704300882482eddfd7baae-5.14.0-434.el9.x86_64.conf 2024-03-30T13:23:11.239 DEBUG:teuthology.orchestra.run.smithi099:> sudo grub2-set-default 15949e3c88704300882482eddfd7baae-5.14.0-434.el9.x86_64 2024-03-30T13:23:11.414 DEBUG:teuthology.orchestra.run.smithi099:> sudo shutdown -r now 2024-03-30T13:23:14.288 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2024-03-30T13:23:14.288 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi181.front.sepia.ceph.com' 2024-03-30T13:23:14.289 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi181.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-30T13:23:32.770 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.181 2024-03-30T13:23:41.425 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-03-30T13:23:41.425 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi099.front.sepia.ceph.com' 2024-03-30T13:23:41.426 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi099.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-30T13:23:41.772 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi181.front.sepia.ceph.com' 2024-03-30T13:23:41.773 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi181.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-30T13:23:44.830 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.181 2024-03-30T13:23:56.842 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi181.front.sepia.ceph.com' 2024-03-30T13:23:56.843 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi181.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-30T13:23:59.902 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.99 2024-03-30T13:24:08.907 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi099.front.sepia.ceph.com' 2024-03-30T13:24:08.908 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi099.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-30T13:24:28.737 DEBUG:teuthology.orchestra.run.smithi181:> true 2024-03-30T13:24:29.110 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi181.front.sepia.ceph.com' 2024-03-30T13:24:29.110 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "5.14.0-434.el9.x86_64"... 2024-03-30T13:24:29.110 DEBUG:teuthology.orchestra.run.smithi181:> uname -r 2024-03-30T13:24:29.124 INFO:teuthology.orchestra.run.smithi181.stdout:5.14.0-434.el9.x86_64 2024-03-30T13:24:29.124 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-434.el9.x86_64 vs 5.14.0-434.el9.x86_64 2024-03-30T13:24:29.124 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-03-30T13:24:29.124 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-03-30T13:24:30.125 INFO:teuthology.task.kernel:Enabling kdb on mon.b... 2024-03-30T13:24:30.125 DEBUG:teuthology.orchestra.run.smithi181:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-03-30T13:24:30.190 INFO:teuthology.orchestra.run.smithi181.stdout:ttyS1 2024-03-30T13:24:30.236 DEBUG:teuthology.parallel:result is None 2024-03-30T13:25:08.911 DEBUG:teuthology.orchestra.remote:timed out 2024-03-30T13:25:20.912 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi099.front.sepia.ceph.com' 2024-03-30T13:25:20.914 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi099.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-30T13:25:21.209 DEBUG:teuthology.orchestra.run.smithi099:> true 2024-03-30T13:25:21.554 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi099.front.sepia.ceph.com' 2024-03-30T13:25:21.554 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.14.0-434.el9.x86_64"... 2024-03-30T13:25:21.554 DEBUG:teuthology.orchestra.run.smithi099:> uname -r 2024-03-30T13:25:21.608 INFO:teuthology.orchestra.run.smithi099.stdout:5.14.0-434.el9.x86_64 2024-03-30T13:25:21.609 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-434.el9.x86_64 vs 5.14.0-434.el9.x86_64 2024-03-30T13:25:21.609 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-03-30T13:25:21.609 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-03-30T13:25:22.610 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2024-03-30T13:25:22.610 DEBUG:teuthology.orchestra.run.smithi099:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-03-30T13:25:22.953 INFO:teuthology.orchestra.run.smithi099.stdout:ttyS1 2024-03-30T13:25:22.996 DEBUG:teuthology.parallel:result is None 2024-03-30T13:25:22.997 INFO:teuthology.run_tasks:Running task internal.base... 2024-03-30T13:25:23.004 INFO:teuthology.task.internal:Creating test directory... 2024-03-30T13:25:23.005 DEBUG:teuthology.orchestra.run.smithi099:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-03-30T13:25:23.007 DEBUG:teuthology.orchestra.run.smithi181:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-03-30T13:25:23.025 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-03-30T13:25:23.032 INFO:teuthology.run_tasks:Running task internal.archive... 2024-03-30T13:25:23.040 INFO:teuthology.task.internal:Creating archive directory... 2024-03-30T13:25:23.040 DEBUG:teuthology.orchestra.run.smithi099:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-03-30T13:25:23.065 DEBUG:teuthology.orchestra.run.smithi181:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-03-30T13:25:23.095 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-03-30T13:25:23.101 INFO:teuthology.task.internal:Enabling coredump saving... 2024-03-30T13:25:23.101 DEBUG:teuthology.orchestra.run.smithi099:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-03-30T13:25:23.133 DEBUG:teuthology.orchestra.run.smithi181:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-03-30T13:25:23.172 INFO:teuthology.orchestra.run.smithi181.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-03-30T13:25:23.173 INFO:teuthology.orchestra.run.smithi099.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-03-30T13:25:23.186 INFO:teuthology.orchestra.run.smithi181.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-03-30T13:25:23.187 INFO:teuthology.orchestra.run.smithi099.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-03-30T13:25:23.189 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-03-30T13:25:23.196 INFO:teuthology.task.internal:Configuring sudo... 2024-03-30T13:25:23.196 DEBUG:teuthology.orchestra.run.smithi099:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-03-30T13:25:23.231 DEBUG:teuthology.orchestra.run.smithi181:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-03-30T13:25:23.262 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-03-30T13:25:23.271 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-03-30T13:25:23.271 DEBUG:teuthology.orchestra.run.smithi099:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-03-30T13:25:23.302 DEBUG:teuthology.orchestra.run.smithi181:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-03-30T13:25:23.317 DEBUG:teuthology.orchestra.run.smithi099:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-03-30T13:25:23.401 DEBUG:teuthology.orchestra.run.smithi099:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-03-30T13:25:23.497 DEBUG:teuthology.orchestra.run.smithi099:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-03-30T13:25:23.540 DEBUG:teuthology.orchestra.run.smithi099:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-03-30T13:25:23.583 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2024-03-30T13:25:23.583 DEBUG:teuthology.orchestra.run.smithi099:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-03-30T13:25:23.650 DEBUG:teuthology.orchestra.run.smithi181:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-03-30T13:25:23.695 DEBUG:teuthology.orchestra.run.smithi181:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-03-30T13:25:23.744 DEBUG:teuthology.orchestra.run.smithi181:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-03-30T13:25:23.828 DEBUG:teuthology.orchestra.run.smithi181:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-03-30T13:25:23.871 DEBUG:teuthology.orchestra.run.smithi181:> set -ex 2024-03-30T13:25:23.871 DEBUG:teuthology.orchestra.run.smithi181:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-03-30T13:25:23.939 DEBUG:teuthology.orchestra.run.smithi099:> sudo service rsyslog restart 2024-03-30T13:25:23.941 DEBUG:teuthology.orchestra.run.smithi181:> sudo service rsyslog restart 2024-03-30T13:25:23.986 INFO:teuthology.orchestra.run.smithi099.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-03-30T13:25:24.023 INFO:teuthology.orchestra.run.smithi181.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-03-30T13:25:24.368 INFO:teuthology.run_tasks:Running task internal.timer... 2024-03-30T13:25:24.376 INFO:teuthology.task.internal:Starting timer... 2024-03-30T13:25:24.376 INFO:teuthology.run_tasks:Running task pcp... 2024-03-30T13:25:24.386 INFO:teuthology.run_tasks:Running task selinux... 2024-03-30T13:25:24.395 DEBUG:teuthology.orchestra.run.smithi099:> sudo service auditd rotate 2024-03-30T13:25:24.454 INFO:teuthology.orchestra.run.smithi099.stdout:Rotating logs: 2024-03-30T13:25:24.456 DEBUG:teuthology.orchestra.run.smithi181:> sudo service auditd rotate 2024-03-30T13:25:24.508 INFO:teuthology.orchestra.run.smithi181.stdout:Rotating logs: 2024-03-30T13:25:24.510 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-03-30T13:25:24.510 DEBUG:teuthology.orchestra.run.smithi099:> /usr/sbin/getenforce 2024-03-30T13:25:24.539 INFO:teuthology.orchestra.run.smithi099.stdout:Permissive 2024-03-30T13:25:24.540 DEBUG:teuthology.orchestra.run.smithi181:> /usr/sbin/getenforce 2024-03-30T13:25:24.558 INFO:teuthology.orchestra.run.smithi181.stdout:Permissive 2024-03-30T13:25:24.559 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi099.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi181.front.sepia.ceph.com': 'permissive'} 2024-03-30T13:25:24.559 DEBUG:teuthology.orchestra.run.smithi099:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2024-03-30T13:25:24.608 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-30T13:25:24.608 DEBUG:teuthology.orchestra.run.smithi181:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2024-03-30T13:25:24.635 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-30T13:25:24.636 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-03-30T13:25:24.636 DEBUG:teuthology.orchestra.run.smithi099:> sudo /usr/sbin/setenforce permissive 2024-03-30T13:25:24.683 DEBUG:teuthology.orchestra.run.smithi181:> sudo /usr/sbin/setenforce permissive 2024-03-30T13:25:24.727 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-03-30T13:25:24.737 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-03-30T13:25:24.753 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-03-30T13:25:24.755 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi099.front.sepia.ceph.com,smithi181.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-03-30T13:29:55.140 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi099.front.sepia.ceph.com'), Remote(name='ubuntu@smithi181.front.sepia.ceph.com')] 2024-03-30T13:29:55.142 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi099.front.sepia.ceph.com' 2024-03-30T13:29:55.143 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi099.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-30T13:29:55.236 DEBUG:teuthology.orchestra.run.smithi099:> true 2024-03-30T13:29:55.313 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi099.front.sepia.ceph.com' 2024-03-30T13:29:55.314 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi181.front.sepia.ceph.com' 2024-03-30T13:29:55.314 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi181.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-30T13:29:55.404 DEBUG:teuthology.orchestra.run.smithi181:> true 2024-03-30T13:29:55.482 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi181.front.sepia.ceph.com' 2024-03-30T13:29:55.482 INFO:teuthology.run_tasks:Running task clock... 2024-03-30T13:29:55.494 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-03-30T13:29:55.494 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-03-30T13:29:55.495 DEBUG:teuthology.orchestra.run.smithi099:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-03-30T13:29:55.497 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-03-30T13:29:55.497 DEBUG:teuthology.orchestra.run.smithi181:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-03-30T13:29:55.526 INFO:teuthology.orchestra.run.smithi099.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-03-30T13:29:55.543 INFO:teuthology.orchestra.run.smithi099.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-03-30T13:29:55.554 INFO:teuthology.orchestra.run.smithi181.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-03-30T13:29:55.571 INFO:teuthology.orchestra.run.smithi181.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-03-30T13:29:55.572 INFO:teuthology.orchestra.run.smithi099.stderr:sudo: ntpd: command not found 2024-03-30T13:29:55.585 INFO:teuthology.orchestra.run.smithi099.stdout:506 Cannot talk to daemon 2024-03-30T13:29:55.601 INFO:teuthology.orchestra.run.smithi099.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-03-30T13:29:55.602 INFO:teuthology.orchestra.run.smithi181.stderr:sudo: ntpd: command not found 2024-03-30T13:29:55.615 INFO:teuthology.orchestra.run.smithi181.stdout:506 Cannot talk to daemon 2024-03-30T13:29:55.618 INFO:teuthology.orchestra.run.smithi099.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-03-30T13:29:55.632 INFO:teuthology.orchestra.run.smithi181.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-03-30T13:29:55.649 INFO:teuthology.orchestra.run.smithi181.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-03-30T13:29:55.671 INFO:teuthology.orchestra.run.smithi099.stderr:bash: line 1: ntpq: command not found 2024-03-30T13:29:55.675 INFO:teuthology.orchestra.run.smithi099.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-03-30T13:29:55.675 INFO:teuthology.orchestra.run.smithi099.stdout:=============================================================================== 2024-03-30T13:29:55.675 INFO:teuthology.orchestra.run.smithi099.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-03-30T13:29:55.675 INFO:teuthology.orchestra.run.smithi099.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-03-30T13:29:55.675 INFO:teuthology.orchestra.run.smithi099.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-03-30T13:29:55.675 INFO:teuthology.orchestra.run.smithi099.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-03-30T13:29:55.702 INFO:teuthology.orchestra.run.smithi181.stderr:bash: line 1: ntpq: command not found 2024-03-30T13:29:55.705 INFO:teuthology.orchestra.run.smithi181.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-03-30T13:29:55.705 INFO:teuthology.orchestra.run.smithi181.stdout:=============================================================================== 2024-03-30T13:29:55.705 INFO:teuthology.orchestra.run.smithi181.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-03-30T13:29:55.705 INFO:teuthology.orchestra.run.smithi181.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-03-30T13:29:55.705 INFO:teuthology.orchestra.run.smithi181.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-03-30T13:29:55.705 INFO:teuthology.orchestra.run.smithi181.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-03-30T13:29:55.706 INFO:teuthology.run_tasks:Running task cephadm... 2024-03-30T13:29:55.804 INFO:tasks.cephadm:Config: {'cephadm_branch': 'v17.2.0', 'cephadm_git_url': 'https://github.com/ceph/ceph', 'image': 'quay.io/ceph/ceph:v17.2.0', 'conf': {'global': {'mon election default strategy': 1}, 'mgr': {'debug mgr': 20, 'debug ms': 1, 'mgr/cephadm/use_agent': True}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}, 'osd': {'debug ms': 1, 'debug osd': 20}}, 'flavor': 'default', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)'], 'sha1': '4e50bbcdd1630c7760b708f3a5b4d38a121e66cb'} 2024-03-30T13:29:55.804 INFO:tasks.cephadm:Cluster image is quay.io/ceph/ceph:v17.2.0 2024-03-30T13:29:55.805 INFO:tasks.cephadm:Cluster fsid is 98ebaeb8-ee99-11ee-b647-cb9ed24678a4 2024-03-30T13:29:55.805 INFO:tasks.cephadm:Choosing monitor IPs and ports... 2024-03-30T13:29:55.805 INFO:tasks.cephadm:Monitor IPs: {'mon.a': '172.21.15.99', 'mon.c': '[v2:172.21.15.99:3301,v1:172.21.15.99:6790]', 'mon.b': '172.21.15.181'} 2024-03-30T13:29:55.805 INFO:tasks.cephadm:First mon is mon.a on smithi099 2024-03-30T13:29:55.805 INFO:tasks.cephadm:First mgr is y 2024-03-30T13:29:55.806 INFO:tasks.cephadm:Normalizing hostnames... 2024-03-30T13:29:55.806 DEBUG:teuthology.orchestra.run.smithi099:> sudo hostname $(hostname -s) 2024-03-30T13:29:55.833 DEBUG:teuthology.orchestra.run.smithi181:> sudo hostname $(hostname -s) 2024-03-30T13:29:55.861 INFO:tasks.cephadm:Downloading cephadm (repo https://github.com/ceph/ceph ref v17.2.0)... 2024-03-30T13:29:55.861 DEBUG:teuthology.orchestra.run.smithi099:> curl --silent https://raw.githubusercontent.com/ceph/ceph/v17.2.0/src/cephadm/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-03-30T13:29:56.124 INFO:teuthology.orchestra.run.smithi099.stdout:-rw-r--r--. 1 ubuntu ubuntu 320521 Mar 30 13:29 /home/ubuntu/cephtest/cephadm 2024-03-30T13:29:56.125 DEBUG:teuthology.orchestra.run.smithi181:> curl --silent https://raw.githubusercontent.com/ceph/ceph/v17.2.0/src/cephadm/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-03-30T13:29:56.285 INFO:teuthology.orchestra.run.smithi181.stdout:-rw-r--r--. 1 ubuntu ubuntu 320521 Mar 30 13:29 /home/ubuntu/cephtest/cephadm 2024-03-30T13:29:56.285 DEBUG:teuthology.orchestra.run.smithi099:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-03-30T13:29:56.301 DEBUG:teuthology.orchestra.run.smithi181:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-03-30T13:29:56.326 INFO:tasks.cephadm:Pulling image quay.io/ceph/ceph:v17.2.0 on all hosts... 2024-03-30T13:29:56.326 DEBUG:teuthology.orchestra.run.smithi099:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 pull 2024-03-30T13:29:56.343 DEBUG:teuthology.orchestra.run.smithi181:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 pull 2024-03-30T13:29:57.141 INFO:teuthology.orchestra.run.smithi099.stderr:Pulling container image quay.io/ceph/ceph:v17.2.0... 2024-03-30T13:29:57.263 INFO:teuthology.orchestra.run.smithi181.stderr:Pulling container image quay.io/ceph/ceph:v17.2.0... 2024-03-30T13:30:27.070 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2024-03-30T13:30:27.070 INFO:teuthology.orchestra.run.smithi181.stdout: "ceph_version": "ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)", 2024-03-30T13:30:27.070 INFO:teuthology.orchestra.run.smithi181.stdout: "image_id": "e1d6a67b021eb077ee22bf650f1a9fb1980a2cf5c36bdb9cba9eac6de8f702d9", 2024-03-30T13:30:27.070 INFO:teuthology.orchestra.run.smithi181.stdout: "repo_digests": [ 2024-03-30T13:30:27.070 INFO:teuthology.orchestra.run.smithi181.stdout: "quay.io/ceph/ceph@sha256:12a0a4f43413fd97a14a3d47a3451b2d2df50020835bb93db666209f3f77617a", 2024-03-30T13:30:27.070 INFO:teuthology.orchestra.run.smithi181.stdout: "quay.io/ceph/ceph@sha256:cb4d698cb769b6aba05bf6ef04f41a7fe694160140347576e13bd9348514b667" 2024-03-30T13:30:27.071 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-03-30T13:30:27.071 INFO:teuthology.orchestra.run.smithi181.stdout:} 2024-03-30T13:30:27.739 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-03-30T13:30:27.739 INFO:teuthology.orchestra.run.smithi099.stdout: "ceph_version": "ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)", 2024-03-30T13:30:27.739 INFO:teuthology.orchestra.run.smithi099.stdout: "image_id": "e1d6a67b021eb077ee22bf650f1a9fb1980a2cf5c36bdb9cba9eac6de8f702d9", 2024-03-30T13:30:27.739 INFO:teuthology.orchestra.run.smithi099.stdout: "repo_digests": [ 2024-03-30T13:30:27.739 INFO:teuthology.orchestra.run.smithi099.stdout: "quay.io/ceph/ceph@sha256:12a0a4f43413fd97a14a3d47a3451b2d2df50020835bb93db666209f3f77617a", 2024-03-30T13:30:27.739 INFO:teuthology.orchestra.run.smithi099.stdout: "quay.io/ceph/ceph@sha256:cb4d698cb769b6aba05bf6ef04f41a7fe694160140347576e13bd9348514b667" 2024-03-30T13:30:27.739 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-03-30T13:30:27.739 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-03-30T13:30:27.757 DEBUG:teuthology.orchestra.run.smithi099:> sudo mkdir -p /etc/ceph 2024-03-30T13:30:27.802 DEBUG:teuthology.orchestra.run.smithi181:> sudo mkdir -p /etc/ceph 2024-03-30T13:30:27.834 DEBUG:teuthology.orchestra.run.smithi099:> sudo chmod 777 /etc/ceph 2024-03-30T13:30:27.861 DEBUG:teuthology.orchestra.run.smithi181:> sudo chmod 777 /etc/ceph 2024-03-30T13:30:27.902 INFO:tasks.cephadm:Writing seed config... 2024-03-30T13:30:27.903 INFO:tasks.cephadm: override: [global] mon election default strategy = 1 2024-03-30T13:30:27.903 INFO:tasks.cephadm: override: [mgr] debug mgr = 20 2024-03-30T13:30:27.903 INFO:tasks.cephadm: override: [mgr] debug ms = 1 2024-03-30T13:30:27.903 INFO:tasks.cephadm: override: [mgr] mgr/cephadm/use_agent = True 2024-03-30T13:30:27.903 INFO:tasks.cephadm: override: [mon] debug mon = 20 2024-03-30T13:30:27.903 INFO:tasks.cephadm: override: [mon] debug ms = 1 2024-03-30T13:30:27.903 INFO:tasks.cephadm: override: [mon] debug paxos = 20 2024-03-30T13:30:27.904 INFO:tasks.cephadm: override: [osd] debug ms = 1 2024-03-30T13:30:27.904 INFO:tasks.cephadm: override: [osd] debug osd = 20 2024-03-30T13:30:27.904 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2024-03-30T13:30:27.904 DEBUG:teuthology.orchestra.run.smithi099:> dd of=/home/ubuntu/cephtest/seed.ceph.conf 2024-03-30T13:30:27.919 DEBUG:tasks.cephadm:Final config: [global] # make logging friendly to teuthology log_to_file = true log_to_stderr = false log to journald = false mon cluster log to file = true mon cluster log file level = debug mon clock drift allowed = 1.000 # replicate across OSDs, not hosts osd crush chooseleaf type = 0 #osd pool default size = 2 osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd # enable some debugging auth debug = true ms die on old message = true ms die on bug = true debug asserts on shutdown = true # adjust warnings mon max pg per osd = 10000# >= luminous mon pg warn max object skew = 0 mon osd allow primary affinity = true mon osd allow pg remap = true mon warn on legacy crush tunables = false mon warn on crush straw calc version zero = false mon warn on no sortbitwise = false mon warn on osd down out interval zero = false mon warn on too few osds = false mon_warn_on_pool_pg_num_not_power_of_two = false # disable pg_autoscaler by default for new pools osd_pool_default_pg_autoscale_mode = off # tests delete pools mon allow pool delete = true fsid = 98ebaeb8-ee99-11ee-b647-cb9ed24678a4 mon election default strategy = 1 [osd] osd scrub load threshold = 5.0 osd scrub max interval = 600 osd mclock profile = high_recovery_ops osd recover clone overlap = true osd recovery max chunk = 1048576 osd deep scrub update digest min age = 30 osd map max advance = 10 osd memory target autotune = true # debugging osd debug shutdown = true osd debug op order = true osd debug verify stray on activate = true osd debug pg log writeout = true osd debug verify cached snaps = true osd debug verify missing on start = true osd debug misdirected ops = true osd op queue = debug_random osd op queue cut off = debug_random osd shutdown pgref assert = true bdev debug aio = true osd sloppy crc = true debug ms = 1 debug osd = 20 [mgr] mon reweight min pgs per osd = 4 mon reweight min bytes per osd = 10 mgr/telemetry/nag = false debug mgr = 20 debug ms = 1 mgr/cephadm/use_agent = True [mon] mon data avail warn = 5 mon mgr mkfs grace = 240 mon reweight min pgs per osd = 4 mon osd reporter subtree level = osd mon osd prime pg temp = true mon reweight min bytes per osd = 10 # rotate auth tickets quickly to exercise renewal paths auth mon ticket ttl = 660# 11m auth service ticket ttl = 240# 4m # don't complain about global id reclaim mon_warn_on_insecure_global_id_reclaim = false mon_warn_on_insecure_global_id_reclaim_allowed = false debug mon = 20 debug ms = 1 debug paxos = 20 [client.rgw] rgw cache enabled = true rgw enable ops log = true rgw enable usage log = true 2024-03-30T13:30:27.919 DEBUG:teuthology.orchestra.run.smithi099:mon.a> sudo journalctl -f -n 0 -u ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4@mon.a.service 2024-03-30T13:30:27.961 DEBUG:teuthology.orchestra.run.smithi099:mgr.y> sudo journalctl -f -n 0 -u ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4@mgr.y.service 2024-03-30T13:30:28.004 INFO:tasks.cephadm:Bootstrapping... 2024-03-30T13:30:28.004 DEBUG:teuthology.orchestra.run.smithi099:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 -v bootstrap --fsid 98ebaeb8-ee99-11ee-b647-cb9ed24678a4 --config /home/ubuntu/cephtest/seed.ceph.conf --output-config /etc/ceph/ceph.conf --output-keyring /etc/ceph/ceph.client.admin.keyring --output-pub-ssh-key /home/ubuntu/cephtest/ceph.pub --mon-id a --mgr-id y --orphan-initial-daemons --skip-monitoring-stack --mon-ip 172.21.15.99 --skip-admin-label && sudo chmod +r /etc/ceph/ceph.client.admin.keyring 2024-03-30T13:30:28.201 INFO:teuthology.orchestra.run.smithi099.stderr:-------------------------------------------------------------------------------- 2024-03-30T13:30:28.201 INFO:teuthology.orchestra.run.smithi099.stderr:cephadm ['--image', 'quay.io/ceph/ceph:v17.2.0', '-v', 'bootstrap', '--fsid', '98ebaeb8-ee99-11ee-b647-cb9ed24678a4', '--config', '/home/ubuntu/cephtest/seed.ceph.conf', '--output-config', '/etc/ceph/ceph.conf', '--output-keyring', '/etc/ceph/ceph.client.admin.keyring', '--output-pub-ssh-key', '/home/ubuntu/cephtest/ceph.pub', '--mon-id', 'a', '--mgr-id', 'y', '--orphan-initial-daemons', '--skip-monitoring-stack', '--mon-ip', '172.21.15.99', '--skip-admin-label'] 2024-03-30T13:30:28.223 INFO:teuthology.orchestra.run.smithi099.stderr:/bin/podman: 4.9.4-dev 2024-03-30T13:30:28.225 INFO:teuthology.orchestra.run.smithi099.stderr:Verifying podman|docker is present... 2024-03-30T13:30:28.245 INFO:teuthology.orchestra.run.smithi099.stderr:/bin/podman: 4.9.4-dev 2024-03-30T13:30:28.248 INFO:teuthology.orchestra.run.smithi099.stderr:Verifying lvm2 is present... 2024-03-30T13:30:28.248 INFO:teuthology.orchestra.run.smithi099.stderr:Verifying time synchronization is in place... 2024-03-30T13:30:28.254 INFO:teuthology.orchestra.run.smithi099.stderr:systemctl: Failed to get unit file state for chrony.service: No such file or directory 2024-03-30T13:30:28.260 INFO:teuthology.orchestra.run.smithi099.stderr:systemctl: inactive 2024-03-30T13:30:28.267 INFO:teuthology.orchestra.run.smithi099.stderr:systemctl: enabled 2024-03-30T13:30:28.273 INFO:teuthology.orchestra.run.smithi099.stderr:systemctl: active 2024-03-30T13:30:28.273 INFO:teuthology.orchestra.run.smithi099.stderr:Unit chronyd.service is enabled and running 2024-03-30T13:30:28.273 INFO:teuthology.orchestra.run.smithi099.stderr:Repeating the final host check... 2024-03-30T13:30:28.294 INFO:teuthology.orchestra.run.smithi099.stderr:/bin/podman: 4.9.4-dev 2024-03-30T13:30:28.296 INFO:teuthology.orchestra.run.smithi099.stderr:podman (/bin/podman) version 4.9.4 is present 2024-03-30T13:30:28.296 INFO:teuthology.orchestra.run.smithi099.stderr:systemctl is present 2024-03-30T13:30:28.296 INFO:teuthology.orchestra.run.smithi099.stderr:lvcreate is present 2024-03-30T13:30:28.302 INFO:teuthology.orchestra.run.smithi099.stderr:systemctl: Failed to get unit file state for chrony.service: No such file or directory 2024-03-30T13:30:28.308 INFO:teuthology.orchestra.run.smithi099.stderr:systemctl: inactive 2024-03-30T13:30:28.314 INFO:teuthology.orchestra.run.smithi099.stderr:systemctl: enabled 2024-03-30T13:30:28.320 INFO:teuthology.orchestra.run.smithi099.stderr:systemctl: active 2024-03-30T13:30:28.321 INFO:teuthology.orchestra.run.smithi099.stderr:Unit chronyd.service is enabled and running 2024-03-30T13:30:28.321 INFO:teuthology.orchestra.run.smithi099.stderr:Host looks OK 2024-03-30T13:30:28.321 INFO:teuthology.orchestra.run.smithi099.stderr:Cluster fsid: 98ebaeb8-ee99-11ee-b647-cb9ed24678a4 2024-03-30T13:30:28.321 INFO:teuthology.orchestra.run.smithi099.stderr:Acquiring lock 140077651906032 on /run/cephadm/98ebaeb8-ee99-11ee-b647-cb9ed24678a4.lock 2024-03-30T13:30:28.322 INFO:teuthology.orchestra.run.smithi099.stderr:Lock 140077651906032 acquired on /run/cephadm/98ebaeb8-ee99-11ee-b647-cb9ed24678a4.lock 2024-03-30T13:30:28.322 INFO:teuthology.orchestra.run.smithi099.stderr:Verifying IP 172.21.15.99 port 3300 ... 2024-03-30T13:30:28.322 INFO:teuthology.orchestra.run.smithi099.stderr:Verifying IP 172.21.15.99 port 6789 ... 2024-03-30T13:30:28.322 INFO:teuthology.orchestra.run.smithi099.stderr:Base mon IP is 172.21.15.99, final addrv is [v2:172.21.15.99:3300,v1:172.21.15.99:6789] 2024-03-30T13:30:28.324 INFO:teuthology.orchestra.run.smithi099.stderr:/sbin/ip: default via 172.21.15.254 dev enp3s0f1 proto dhcp src 172.21.15.99 metric 100 2024-03-30T13:30:28.324 INFO:teuthology.orchestra.run.smithi099.stderr:/sbin/ip: 172.21.0.0/20 dev enp3s0f1 proto kernel scope link src 172.21.15.99 metric 100 2024-03-30T13:30:28.327 INFO:teuthology.orchestra.run.smithi099.stderr:/sbin/ip: ::1 dev lo proto kernel metric 256 pref medium 2024-03-30T13:30:28.327 INFO:teuthology.orchestra.run.smithi099.stderr:/sbin/ip: fe80::/64 dev enp3s0f1 proto kernel metric 256 pref medium 2024-03-30T13:30:28.327 INFO:teuthology.orchestra.run.smithi099.stderr:/sbin/ip: default via fe80::327c:5e00:6487:71e0 dev enp3s0f1 proto ra metric 1024 expires 1791sec hoplimit 64 pref medium 2024-03-30T13:30:28.330 INFO:teuthology.orchestra.run.smithi099.stderr:/sbin/ip: 1: lo: mtu 65536 state UNKNOWN qlen 1000 2024-03-30T13:30:28.330 INFO:teuthology.orchestra.run.smithi099.stderr:/sbin/ip: inet6 ::1/128 scope host 2024-03-30T13:30:28.330 INFO:teuthology.orchestra.run.smithi099.stderr:/sbin/ip: valid_lft forever preferred_lft forever 2024-03-30T13:30:28.330 INFO:teuthology.orchestra.run.smithi099.stderr:/sbin/ip: 5: enp3s0f1: mtu 1500 state UP qlen 1000 2024-03-30T13:30:28.330 INFO:teuthology.orchestra.run.smithi099.stderr:/sbin/ip: inet6 fe80::ec4:7aff:fe8f:d803/64 scope link 2024-03-30T13:30:28.330 INFO:teuthology.orchestra.run.smithi099.stderr:/sbin/ip: valid_lft forever preferred_lft forever 2024-03-30T13:30:28.331 INFO:teuthology.orchestra.run.smithi099.stderr:Mon IP `172.21.15.99` is in CIDR network `172.21.0.0/20` 2024-03-30T13:30:28.331 INFO:teuthology.orchestra.run.smithi099.stderr:- internal network (--cluster-network) has not been provided, OSD replication will default to the public_network 2024-03-30T13:30:28.332 INFO:teuthology.orchestra.run.smithi099.stderr:Pulling container image quay.io/ceph/ceph:v17.2.0... 2024-03-30T13:30:28.430 INFO:teuthology.orchestra.run.smithi099.stderr:/bin/podman: Trying to pull quay.io/ceph/ceph:v17.2.0... 2024-03-30T13:30:29.039 INFO:teuthology.orchestra.run.smithi099.stderr:/bin/podman: Getting image source signatures 2024-03-30T13:30:29.039 INFO:teuthology.orchestra.run.smithi099.stderr:/bin/podman: Copying blob sha256:33ca8fff7868c4dc0c11e09bca97c720eb9cfbab7221216754367dd8de70388a 2024-03-30T13:30:29.039 INFO:teuthology.orchestra.run.smithi099.stderr:/bin/podman: Copying blob sha256:89b4a75bc2d8500f15463747507c9623df43886c134463e7f0527e70900e7a7b 2024-03-30T13:30:29.039 INFO:teuthology.orchestra.run.smithi099.stderr:/bin/podman: Copying blob sha256:c32ab78b488d0c72f64eded765c0cf6b5bf2c75dab66cb62a9d367fa6ec42513 2024-03-30T13:30:29.039 INFO:teuthology.orchestra.run.smithi099.stderr:/bin/podman: Copying blob sha256:a70843738bb77e1ab9c1f85969ebdfa55f178e746be081d1cb4f94011f69eb7c 2024-03-30T13:30:29.039 INFO:teuthology.orchestra.run.smithi099.stderr:/bin/podman: Copying blob sha256:599d07cb321ff0a3c82224e1138fc685793fa69b93ed5780415751a5f7e4b8c2 2024-03-30T13:30:29.039 INFO:teuthology.orchestra.run.smithi099.stderr:/bin/podman: Copying config sha256:e1d6a67b021eb077ee22bf650f1a9fb1980a2cf5c36bdb9cba9eac6de8f702d9 2024-03-30T13:30:29.185 INFO:teuthology.orchestra.run.smithi099.stderr:/bin/podman: Writing manifest to image destination 2024-03-30T13:30:29.346 INFO:teuthology.orchestra.run.smithi099.stderr:/bin/podman: e1d6a67b021eb077ee22bf650f1a9fb1980a2cf5c36bdb9cba9eac6de8f702d9 2024-03-30T13:30:29.722 INFO:teuthology.orchestra.run.smithi099.stderr:ceph: ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable) 2024-03-30T13:30:30.211 INFO:teuthology.orchestra.run.smithi099.stderr:Ceph version: ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable) 2024-03-30T13:30:30.211 INFO:teuthology.orchestra.run.smithi099.stderr:Extracting ceph user uid/gid from container image... 2024-03-30T13:30:30.620 INFO:teuthology.orchestra.run.smithi099.stderr:stat: 167 167 2024-03-30T13:30:31.224 INFO:teuthology.orchestra.run.smithi099.stderr:Creating initial keys... 2024-03-30T13:30:31.574 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph-authtool: AQD3EwhmHMqKHhAA+9CeuhX6ZQ8hSpJcHnlOPg== 2024-03-30T13:30:32.413 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph-authtool: AQD4EwhmlfgEFhAAOlwkNpQwIxGLbt6CYddqxQ== 2024-03-30T13:30:33.685 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph-authtool: AQD5Ewhmwv24IxAAtXGFMh0LzgvneupGlpbydg== 2024-03-30T13:30:34.151 INFO:teuthology.orchestra.run.smithi099.stderr:Creating initial monmap... 2024-03-30T13:30:34.532 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/monmaptool: /usr/bin/monmaptool: monmap file /tmp/monmap 2024-03-30T13:30:34.532 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/monmaptool: setting min_mon_release = octopus 2024-03-30T13:30:34.533 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/monmaptool: /usr/bin/monmaptool: set fsid to 98ebaeb8-ee99-11ee-b647-cb9ed24678a4 2024-03-30T13:30:34.533 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/monmaptool: /usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-03-30T13:30:35.710 INFO:teuthology.orchestra.run.smithi099.stderr:monmaptool for a [v2:172.21.15.99:3300,v1:172.21.15.99:6789] on /usr/bin/monmaptool: monmap file /tmp/monmap 2024-03-30T13:30:35.710 INFO:teuthology.orchestra.run.smithi099.stderr:setting min_mon_release = octopus 2024-03-30T13:30:35.710 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/monmaptool: set fsid to 98ebaeb8-ee99-11ee-b647-cb9ed24678a4 2024-03-30T13:30:35.710 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-03-30T13:30:35.710 INFO:teuthology.orchestra.run.smithi099.stderr: 2024-03-30T13:30:35.710 INFO:teuthology.orchestra.run.smithi099.stderr:Creating mon... 2024-03-30T13:30:45.252 INFO:teuthology.orchestra.run.smithi099.stderr:create mon.a on 2024-03-30T13:30:45.673 INFO:teuthology.orchestra.run.smithi099.stderr:systemctl: Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /etc/systemd/system/ceph.target. 2024-03-30T13:30:45.812 INFO:teuthology.orchestra.run.smithi099.stderr:systemctl: Created symlink /etc/systemd/system/multi-user.target.wants/ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4.target → /etc/systemd/system/ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4.target. 2024-03-30T13:30:45.812 INFO:teuthology.orchestra.run.smithi099.stderr:systemctl: Created symlink /etc/systemd/system/ceph.target.wants/ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4.target → /etc/systemd/system/ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4.target. 2024-03-30T13:30:46.104 INFO:teuthology.orchestra.run.smithi099.stderr:systemctl: Failed to reset failed state of unit ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4@mon.a.service: Unit ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4@mon.a.service not loaded. 2024-03-30T13:30:46.111 INFO:teuthology.orchestra.run.smithi099.stderr:systemctl: Created symlink /etc/systemd/system/ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4.target.wants/ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4@mon.a.service → /etc/systemd/system/ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4@.service. 2024-03-30T13:30:46.587 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:30:46 smithi099 podman[24534]: 2024-03-30 13:30:46.513993165 +0000 UTC m=+0.133427656 container create e110551c070ab901d824abcf0e58aa741b337a78e665bc442e654dfabb315fc1 (image=quay.io/ceph/ceph:v17.2.0, name=ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mon-a, CEPH_POINT_RELEASE=-17.2.0, release=754, io.buildah.version=1.19.8, description=CentOS Stream is a continuously delivered distro that tracks just ahead of Red Hat Enterprise Linux development. This image takes the Red Hat UBI and layers on content from CentOS Stream, vcs-type=git, RELEASE=HEAD, maintainer=Guillaume Abrioux , summary=Provides a CentOS Stream container based on the Red Hat Universal Base Image, architecture=x86_64, com.redhat.component=centos-stream-container, io.k8s.description=The Universal Base Image is designed and engineered to be the base layer for all of your containerized applications, middleware and utilities. This base image is freely redistributable, but Red Hat only supports Red Hat technologies through subscriptions for Red Hat products. This image is maintained by Red Hat and updated regularly., version=8, com.redhat.license_terms=https://centos.org/legal/licensing-policy/, GIT_REPO=https://github.com/ceph/ceph-container.git, distribution-scope=public, GIT_COMMIT=b613db0f44179c0940781c1c7fe04e1acb7093ac, vcs-ref=f1ee6e37554363ec55e0035aba1a693d3627fdeb, io.openshift.expose-services=, io.k8s.display-name=CentOS Stream 8, com.redhat.build-host=cpt-1002.osbs.prod.upshift.rdu2.redhat.com, build-date=2022-05-03T08:36:31.336870, name=centos-stream, url=https://access.redhat.com/containers/#/registry.access.redhat.com/ubi8/images/8.6-754, io.openshift.tags=base centos centos-stream, ceph=True, GIT_CLEAN=True, vendor=Red Hat, Inc., GIT_BRANCH=HEAD) 2024-03-30T13:30:46.812 INFO:teuthology.orchestra.run.smithi099.stderr:systemctl: disabled 2024-03-30T13:30:46.819 INFO:teuthology.orchestra.run.smithi099.stderr:systemctl: inactive 2024-03-30T13:30:46.819 INFO:teuthology.orchestra.run.smithi099.stderr:firewalld.service is not enabled 2024-03-30T13:30:46.819 INFO:teuthology.orchestra.run.smithi099.stderr:Not possible to enable service . firewalld.service is not available 2024-03-30T13:30:46.820 INFO:teuthology.orchestra.run.smithi099.stderr:Waiting for mon to start... 2024-03-30T13:30:46.820 INFO:teuthology.orchestra.run.smithi099.stderr:Waiting for mon... 2024-03-30T13:30:46.935 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:30:46 smithi099 podman[24534]: 2024-03-30 13:30:46.69971409 +0000 UTC m=+0.319148539 container init e110551c070ab901d824abcf0e58aa741b337a78e665bc442e654dfabb315fc1 (image=quay.io/ceph/ceph:v17.2.0, name=ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mon-a, version=8, vendor=Red Hat, Inc., com.redhat.component=centos-stream-container, RELEASE=HEAD, description=CentOS Stream is a continuously delivered distro that tracks just ahead of Red Hat Enterprise Linux development. This image takes the Red Hat UBI and layers on content from CentOS Stream, CEPH_POINT_RELEASE=-17.2.0, ceph=True, com.redhat.build-host=cpt-1002.osbs.prod.upshift.rdu2.redhat.com, GIT_CLEAN=True, summary=Provides a CentOS Stream container based on the Red Hat Universal Base Image, io.k8s.description=The Universal Base Image is designed and engineered to be the base layer for all of your containerized applications, middleware and utilities. This base image is freely redistributable, but Red Hat only supports Red Hat technologies through subscriptions for Red Hat products. This image is maintained by Red Hat and updated regularly., GIT_COMMIT=b613db0f44179c0940781c1c7fe04e1acb7093ac, vcs-type=git, vcs-ref=f1ee6e37554363ec55e0035aba1a693d3627fdeb, maintainer=Guillaume Abrioux , name=centos-stream, distribution-scope=public, release=754, io.buildah.version=1.19.8, url=https://access.redhat.com/containers/#/registry.access.redhat.com/ubi8/images/8.6-754, GIT_BRANCH=HEAD, io.k8s.display-name=CentOS Stream 8, architecture=x86_64, build-date=2022-05-03T08:36:31.336870, com.redhat.license_terms=https://centos.org/legal/licensing-policy/, io.openshift.tags=base centos centos-stream, GIT_REPO=https://github.com/ceph/ceph-container.git, io.openshift.expose-services=) 2024-03-30T13:30:46.935 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:30:46 smithi099 podman[24534]: 2024-03-30 13:30:46.702480166 +0000 UTC m=+0.321914612 container start e110551c070ab901d824abcf0e58aa741b337a78e665bc442e654dfabb315fc1 (image=quay.io/ceph/ceph:v17.2.0, name=ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mon-a, maintainer=Guillaume Abrioux , url=https://access.redhat.com/containers/#/registry.access.redhat.com/ubi8/images/8.6-754, GIT_BRANCH=HEAD, io.k8s.display-name=CentOS Stream 8, io.openshift.expose-services=, io.buildah.version=1.19.8, com.redhat.build-host=cpt-1002.osbs.prod.upshift.rdu2.redhat.com, description=CentOS Stream is a continuously delivered distro that tracks just ahead of Red Hat Enterprise Linux development. This image takes the Red Hat UBI and layers on content from CentOS Stream, version=8, RELEASE=HEAD, vendor=Red Hat, Inc., ceph=True, io.openshift.tags=base centos centos-stream, io.k8s.description=The Universal Base Image is designed and engineered to be the base layer for all of your containerized applications, middleware and utilities. This base image is freely redistributable, but Red Hat only supports Red Hat technologies through subscriptions for Red Hat products. This image is maintained by Red Hat and updated regularly., com.redhat.license_terms=https://centos.org/legal/licensing-policy/, GIT_COMMIT=b613db0f44179c0940781c1c7fe04e1acb7093ac, architecture=x86_64, distribution-scope=public, com.redhat.component=centos-stream-container, summary=Provides a CentOS Stream container based on the Red Hat Universal Base Image, GIT_REPO=https://github.com/ceph/ceph-container.git, vcs-ref=f1ee6e37554363ec55e0035aba1a693d3627fdeb, release=754, name=centos-stream, build-date=2022-05-03T08:36:31.336870, GIT_CLEAN=True, CEPH_POINT_RELEASE=-17.2.0, vcs-type=git) 2024-03-30T13:30:46.936 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:30:46 smithi099 ceph-mon[24553]: mkfs 98ebaeb8-ee99-11ee-b647-cb9ed24678a4 2024-03-30T13:30:46.936 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:30:46 smithi099 ceph-mon[24553]: mon.a is new leader, mons a in quorum (ranks 0) 2024-03-30T13:30:46.936 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:30:46 smithi099 bash[24534]: e110551c070ab901d824abcf0e58aa741b337a78e665bc442e654dfabb315fc1 2024-03-30T13:30:46.936 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:30:46 smithi099 systemd[1]: Started Ceph mon.a for 98ebaeb8-ee99-11ee-b647-cb9ed24678a4. 2024-03-30T13:30:47.300 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph: cluster: 2024-03-30T13:30:47.300 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph: id: 98ebaeb8-ee99-11ee-b647-cb9ed24678a4 2024-03-30T13:30:47.300 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph: health: HEALTH_OK 2024-03-30T13:30:47.300 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph: 2024-03-30T13:30:47.300 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph: services: 2024-03-30T13:30:47.300 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph: mon: 1 daemons, quorum a (age 0.558695s) 2024-03-30T13:30:47.300 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph: mgr: no daemons active 2024-03-30T13:30:47.300 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph: osd: 0 osds: 0 up, 0 in 2024-03-30T13:30:47.300 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph: 2024-03-30T13:30:47.301 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph: data: 2024-03-30T13:30:47.301 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph: pools: 0 pools, 0 pgs 2024-03-30T13:30:47.301 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph: objects: 0 objects, 0 B 2024-03-30T13:30:47.301 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph: usage: 0 B used, 0 B / 0 B avail 2024-03-30T13:30:47.301 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph: pgs: 2024-03-30T13:30:47.301 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph: 2024-03-30T13:30:47.826 INFO:teuthology.orchestra.run.smithi099.stderr:mon is available 2024-03-30T13:30:47.826 INFO:teuthology.orchestra.run.smithi099.stderr:Assimilating anything we can from ceph.conf... 2024-03-30T13:30:47.932 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:30:47 smithi099 ceph-mon[24553]: mon.a is new leader, mons a in quorum (ranks 0) 2024-03-30T13:30:47.932 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:30:47 smithi099 ceph-mon[24553]: monmap e1: 1 mons at {a=[v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0]} 2024-03-30T13:30:47.932 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:30:47 smithi099 ceph-mon[24553]: fsmap 2024-03-30T13:30:47.933 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:30:47 smithi099 ceph-mon[24553]: osdmap e1: 0 total, 0 up, 0 in 2024-03-30T13:30:47.933 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:30:47 smithi099 ceph-mon[24553]: mgrmap e1: no daemons active 2024-03-30T13:30:47.933 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:30:47 smithi099 ceph-mon[24553]: from='client.? 172.21.15.99:0/4152691164' entity='client.admin' cmd=[{"prefix": "status"}]: dispatch 2024-03-30T13:30:48.263 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph: 2024-03-30T13:30:48.264 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph: [global] 2024-03-30T13:30:48.264 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph: fsid = 98ebaeb8-ee99-11ee-b647-cb9ed24678a4 2024-03-30T13:30:48.264 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph: mon_host = [v2:172.21.15.99:3300,v1:172.21.15.99:6789] 2024-03-30T13:30:48.264 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph: mon_osd_allow_pg_remap = true 2024-03-30T13:30:48.264 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph: mon_osd_allow_primary_affinity = true 2024-03-30T13:30:48.264 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph: mon_warn_on_no_sortbitwise = false 2024-03-30T13:30:48.264 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph: osd_crush_chooseleaf_type = 0 2024-03-30T13:30:48.264 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph: 2024-03-30T13:30:48.264 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph: [mgr] 2024-03-30T13:30:48.264 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph: mgr/cephadm/use_agent = True 2024-03-30T13:30:48.264 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph: mgr/telemetry/nag = false 2024-03-30T13:30:48.264 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph: 2024-03-30T13:30:48.264 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph: [osd] 2024-03-30T13:30:48.264 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph: osd_map_max_advance = 10 2024-03-30T13:30:48.265 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph: osd_sloppy_crc = true 2024-03-30T13:30:48.837 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:30:48 smithi099 ceph-mon[24553]: from='client.? 172.21.15.99:0/4206733801' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2024-03-30T13:30:48.837 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:30:48 smithi099 ceph-mon[24553]: from='client.? 172.21.15.99:0/4206733801' entity='client.admin' cmd='[{"prefix": "config assimilate-conf"}]': finished 2024-03-30T13:30:48.840 INFO:teuthology.orchestra.run.smithi099.stderr:Generating new minimal ceph.conf... 2024-03-30T13:30:49.798 INFO:teuthology.orchestra.run.smithi099.stderr:Restarting the monitor... 2024-03-30T13:30:50.008 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:30:49 smithi099 ceph-mon[24553]: from='client.? 172.21.15.99:0/230896375' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:30:50.008 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:30:49 smithi099 systemd[1]: Stopping Ceph mon.a for 98ebaeb8-ee99-11ee-b647-cb9ed24678a4... 2024-03-30T13:30:50.008 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:30:49 smithi099 bash[24781]: Error: no container with name or ID "ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mon.a" found: no such container 2024-03-30T13:30:50.008 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:30:49 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mon-a[24549]: 2024-03-30T13:30:49.945+0000 7fba4fe3d700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-03-30T13:30:50.008 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:30:49 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mon-a[24549]: 2024-03-30T13:30:49.945+0000 7fba4fe3d700 -1 mon.a@0(leader) e1 *** Got Signal Terminated *** 2024-03-30T13:30:50.310 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:30:50 smithi099 podman[24794]: 2024-03-30 13:30:50.007052965 +0000 UTC m=+0.150127453 container died e110551c070ab901d824abcf0e58aa741b337a78e665bc442e654dfabb315fc1 (image=quay.io/ceph/ceph:v17.2.0, name=ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mon-a, maintainer=Guillaume Abrioux , io.buildah.version=1.19.8, com.redhat.component=centos-stream-container, release=754, io.k8s.description=The Universal Base Image is designed and engineered to be the base layer for all of your containerized applications, middleware and utilities. This base image is freely redistributable, but Red Hat only supports Red Hat technologies through subscriptions for Red Hat products. This image is maintained by Red Hat and updated regularly., distribution-scope=public, io.openshift.expose-services=, description=CentOS Stream is a continuously delivered distro that tracks just ahead of Red Hat Enterprise Linux development. This image takes the Red Hat UBI and layers on content from CentOS Stream, architecture=x86_64, CEPH_POINT_RELEASE=-17.2.0, vendor=Red Hat, Inc., GIT_COMMIT=b613db0f44179c0940781c1c7fe04e1acb7093ac, com.redhat.license_terms=https://centos.org/legal/licensing-policy/, name=centos-stream, version=8, summary=Provides a CentOS Stream container based on the Red Hat Universal Base Image, GIT_BRANCH=HEAD, url=https://access.redhat.com/containers/#/registry.access.redhat.com/ubi8/images/8.6-754, io.k8s.display-name=CentOS Stream 8, GIT_REPO=https://github.com/ceph/ceph-container.git, RELEASE=HEAD, build-date=2022-05-03T08:36:31.336870, GIT_CLEAN=True, vcs-ref=f1ee6e37554363ec55e0035aba1a693d3627fdeb, io.openshift.tags=base centos centos-stream, com.redhat.build-host=cpt-1002.osbs.prod.upshift.rdu2.redhat.com, ceph=True, vcs-type=git) 2024-03-30T13:30:50.562 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:30:50 smithi099 podman[24794]: 2024-03-30 13:30:50.345723238 +0000 UTC m=+0.488797731 container cleanup e110551c070ab901d824abcf0e58aa741b337a78e665bc442e654dfabb315fc1 (image=quay.io/ceph/ceph:v17.2.0, name=ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mon-a, GIT_REPO=https://github.com/ceph/ceph-container.git, GIT_BRANCH=HEAD, RELEASE=HEAD, io.buildah.version=1.19.8, com.redhat.component=centos-stream-container, build-date=2022-05-03T08:36:31.336870, ceph=True, CEPH_POINT_RELEASE=-17.2.0, version=8, GIT_CLEAN=True, architecture=x86_64, vcs-type=git, description=CentOS Stream is a continuously delivered distro that tracks just ahead of Red Hat Enterprise Linux development. This image takes the Red Hat UBI and layers on content from CentOS Stream, release=754, io.k8s.description=The Universal Base Image is designed and engineered to be the base layer for all of your containerized applications, middleware and utilities. This base image is freely redistributable, but Red Hat only supports Red Hat technologies through subscriptions for Red Hat products. This image is maintained by Red Hat and updated regularly., name=centos-stream, io.openshift.expose-services=, maintainer=Guillaume Abrioux , summary=Provides a CentOS Stream container based on the Red Hat Universal Base Image, vcs-ref=f1ee6e37554363ec55e0035aba1a693d3627fdeb, distribution-scope=public, GIT_COMMIT=b613db0f44179c0940781c1c7fe04e1acb7093ac, com.redhat.build-host=cpt-1002.osbs.prod.upshift.rdu2.redhat.com, com.redhat.license_terms=https://centos.org/legal/licensing-policy/, io.k8s.display-name=CentOS Stream 8, vendor=Red Hat, Inc., url=https://access.redhat.com/containers/#/registry.access.redhat.com/ubi8/images/8.6-754, io.openshift.tags=base centos centos-stream) 2024-03-30T13:30:50.562 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:30:50 smithi099 bash[24794]: ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mon-a 2024-03-30T13:30:50.562 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:30:50 smithi099 podman[24808]: 2024-03-30 13:30:50.513222121 +0000 UTC m=+0.510303496 container remove e110551c070ab901d824abcf0e58aa741b337a78e665bc442e654dfabb315fc1 (image=quay.io/ceph/ceph:v17.2.0, name=ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mon-a, io.openshift.expose-services=, url=https://access.redhat.com/containers/#/registry.access.redhat.com/ubi8/images/8.6-754, name=centos-stream, distribution-scope=public, CEPH_POINT_RELEASE=-17.2.0, maintainer=Guillaume Abrioux , com.redhat.license_terms=https://centos.org/legal/licensing-policy/, version=8, release=754, GIT_CLEAN=True, summary=Provides a CentOS Stream container based on the Red Hat Universal Base Image, ceph=True, description=CentOS Stream is a continuously delivered distro that tracks just ahead of Red Hat Enterprise Linux development. This image takes the Red Hat UBI and layers on content from CentOS Stream, io.k8s.description=The Universal Base Image is designed and engineered to be the base layer for all of your containerized applications, middleware and utilities. This base image is freely redistributable, but Red Hat only supports Red Hat technologies through subscriptions for Red Hat products. This image is maintained by Red Hat and updated regularly., GIT_REPO=https://github.com/ceph/ceph-container.git, vcs-type=git, com.redhat.build-host=cpt-1002.osbs.prod.upshift.rdu2.redhat.com, GIT_COMMIT=b613db0f44179c0940781c1c7fe04e1acb7093ac, io.k8s.display-name=CentOS Stream 8, RELEASE=HEAD, com.redhat.component=centos-stream-container, io.openshift.tags=base centos centos-stream, io.buildah.version=1.19.8, build-date=2022-05-03T08:36:31.336870, vendor=Red Hat, Inc., architecture=x86_64, vcs-ref=f1ee6e37554363ec55e0035aba1a693d3627fdeb, GIT_BRANCH=HEAD) 2024-03-30T13:30:50.562 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:30:50 smithi099 bash[24823]: Error: no container with name or ID "ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mon.a" found: no such container 2024-03-30T13:30:50.837 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:30:50 smithi099 systemd[1]: ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4@mon.a.service: Deactivated successfully. 2024-03-30T13:30:50.837 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:30:50 smithi099 systemd[1]: Stopped Ceph mon.a for 98ebaeb8-ee99-11ee-b647-cb9ed24678a4. 2024-03-30T13:30:50.837 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:30:50 smithi099 systemd[1]: Starting Ceph mon.a for 98ebaeb8-ee99-11ee-b647-cb9ed24678a4... 2024-03-30T13:30:50.837 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:30:50 smithi099 podman[24894]: 2024-03-30 13:30:50.680093707 +0000 UTC m=+0.018016547 image pull e1d6a67b021eb077ee22bf650f1a9fb1980a2cf5c36bdb9cba9eac6de8f702d9 quay.io/ceph/ceph:v17.2.0 2024-03-30T13:30:51.587 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:30:51 smithi099 podman[24894]: 2024-03-30 13:30:51.272254842 +0000 UTC m=+0.610177672 container create af06ebb19fd8580cc4e94089c0e786286e13dad706d7c07e98d7eff570805eb5 (image=quay.io/ceph/ceph:v17.2.0, name=ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mon-a, vendor=Red Hat, Inc., maintainer=Guillaume Abrioux , ceph=True, vcs-ref=f1ee6e37554363ec55e0035aba1a693d3627fdeb, io.k8s.display-name=CentOS Stream 8, distribution-scope=public, com.redhat.license_terms=https://centos.org/legal/licensing-policy/, com.redhat.build-host=cpt-1002.osbs.prod.upshift.rdu2.redhat.com, GIT_COMMIT=b613db0f44179c0940781c1c7fe04e1acb7093ac, io.openshift.tags=base centos centos-stream, RELEASE=HEAD, description=CentOS Stream is a continuously delivered distro that tracks just ahead of Red Hat Enterprise Linux development. This image takes the Red Hat UBI and layers on content from CentOS Stream, GIT_REPO=https://github.com/ceph/ceph-container.git, io.openshift.expose-services=, io.k8s.description=The Universal Base Image is designed and engineered to be the base layer for all of your containerized applications, middleware and utilities. This base image is freely redistributable, but Red Hat only supports Red Hat technologies through subscriptions for Red Hat products. This image is maintained by Red Hat and updated regularly., build-date=2022-05-03T08:36:31.336870, url=https://access.redhat.com/containers/#/registry.access.redhat.com/ubi8/images/8.6-754, vcs-type=git, summary=Provides a CentOS Stream container based on the Red Hat Universal Base Image, architecture=x86_64, version=8, CEPH_POINT_RELEASE=-17.2.0, GIT_BRANCH=HEAD, com.redhat.component=centos-stream-container, release=754, io.buildah.version=1.19.8, name=centos-stream, GIT_CLEAN=True) 2024-03-30T13:30:53.140 INFO:teuthology.orchestra.run.smithi099.stderr:Setting mon public_network to 172.21.0.0/20 2024-03-30T13:30:53.270 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:30:52 smithi099 podman[24894]: 2024-03-30 13:30:52.973017844 +0000 UTC m=+2.310940690 container init af06ebb19fd8580cc4e94089c0e786286e13dad706d7c07e98d7eff570805eb5 (image=quay.io/ceph/ceph:v17.2.0, name=ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mon-a, summary=Provides a CentOS Stream container based on the Red Hat Universal Base Image, GIT_COMMIT=b613db0f44179c0940781c1c7fe04e1acb7093ac, description=CentOS Stream is a continuously delivered distro that tracks just ahead of Red Hat Enterprise Linux development. This image takes the Red Hat UBI and layers on content from CentOS Stream, version=8, CEPH_POINT_RELEASE=-17.2.0, io.k8s.description=The Universal Base Image is designed and engineered to be the base layer for all of your containerized applications, middleware and utilities. This base image is freely redistributable, but Red Hat only supports Red Hat technologies through subscriptions for Red Hat products. This image is maintained by Red Hat and updated regularly., com.redhat.license_terms=https://centos.org/legal/licensing-policy/, RELEASE=HEAD, vcs-type=git, vendor=Red Hat, Inc., com.redhat.build-host=cpt-1002.osbs.prod.upshift.rdu2.redhat.com, ceph=True, architecture=x86_64, io.openshift.tags=base centos centos-stream, GIT_CLEAN=True, build-date=2022-05-03T08:36:31.336870, vcs-ref=f1ee6e37554363ec55e0035aba1a693d3627fdeb, release=754, GIT_BRANCH=HEAD, distribution-scope=public, io.openshift.expose-services=, maintainer=Guillaume Abrioux , io.buildah.version=1.19.8, name=centos-stream, com.redhat.component=centos-stream-container, io.k8s.display-name=CentOS Stream 8, GIT_REPO=https://github.com/ceph/ceph-container.git, url=https://access.redhat.com/containers/#/registry.access.redhat.com/ubi8/images/8.6-754) 2024-03-30T13:30:53.270 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:30:52 smithi099 podman[24894]: 2024-03-30 13:30:52.976761037 +0000 UTC m=+2.314683869 container start af06ebb19fd8580cc4e94089c0e786286e13dad706d7c07e98d7eff570805eb5 (image=quay.io/ceph/ceph:v17.2.0, name=ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mon-a, vcs-ref=f1ee6e37554363ec55e0035aba1a693d3627fdeb, url=https://access.redhat.com/containers/#/registry.access.redhat.com/ubi8/images/8.6-754, GIT_REPO=https://github.com/ceph/ceph-container.git, io.buildah.version=1.19.8, GIT_BRANCH=HEAD, ceph=True, release=754, maintainer=Guillaume Abrioux , build-date=2022-05-03T08:36:31.336870, io.k8s.description=The Universal Base Image is designed and engineered to be the base layer for all of your containerized applications, middleware and utilities. This base image is freely redistributable, but Red Hat only supports Red Hat technologies through subscriptions for Red Hat products. This image is maintained by Red Hat and updated regularly., GIT_COMMIT=b613db0f44179c0940781c1c7fe04e1acb7093ac, io.openshift.tags=base centos centos-stream, architecture=x86_64, name=centos-stream, io.k8s.display-name=CentOS Stream 8, io.openshift.expose-services=, GIT_CLEAN=True, CEPH_POINT_RELEASE=-17.2.0, distribution-scope=public, RELEASE=HEAD, summary=Provides a CentOS Stream container based on the Red Hat Universal Base Image, version=8, com.redhat.build-host=cpt-1002.osbs.prod.upshift.rdu2.redhat.com, com.redhat.license_terms=https://centos.org/legal/licensing-policy/, com.redhat.component=centos-stream-container, vcs-type=git, vendor=Red Hat, Inc., description=CentOS Stream is a continuously delivered distro that tracks just ahead of Red Hat Enterprise Linux development. This image takes the Red Hat UBI and layers on content from CentOS Stream) 2024-03-30T13:30:53.270 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:30:53 smithi099 ceph-mon[24912]: set uid:gid to 167:167 (ceph:ceph) 2024-03-30T13:30:53.271 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:30:53 smithi099 ceph-mon[24912]: ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable), process ceph-mon, pid 2 2024-03-30T13:30:53.271 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:30:53 smithi099 ceph-mon[24912]: pidfile_write: ignore empty --pid-file 2024-03-30T13:30:53.271 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:30:53 smithi099 ceph-mon[24912]: load: jerasure load: lrc 2024-03-30T13:30:53.271 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:30:53 smithi099 ceph-mon[24912]: rocksdb: RocksDB version: 6.15.5 2024-03-30T13:30:53.272 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:30:53 smithi099 ceph-mon[24912]: rocksdb: Git sha rocksdb_build_git_sha:@0@ 2024-03-30T13:30:53.272 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:30:53 smithi099 ceph-mon[24912]: rocksdb: Compile date Apr 18 2022 2024-03-30T13:30:53.272 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:30:53 smithi099 ceph-mon[24912]: rocksdb: DB SUMMARY 2024-03-30T13:30:53.272 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:30:53 smithi099 ceph-mon[24912]: rocksdb: DB Session ID: N3QHQXGGHQZOQFZION7Y 2024-03-30T13:30:53.272 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:30:53 smithi099 ceph-mon[24912]: rocksdb: CURRENT file: CURRENT 2024-03-30T13:30:53.272 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:30:53 smithi099 ceph-mon[24912]: rocksdb: IDENTITY file: IDENTITY 2024-03-30T13:30:53.272 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:30:53 smithi099 ceph-mon[24912]: rocksdb: MANIFEST file: MANIFEST-000009 size: 131 Bytes 2024-03-30T13:30:53.272 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:30:53 smithi099 ceph-mon[24912]: rocksdb: SST files in /var/lib/ceph/mon/ceph-a/store.db dir, Total Num: 1, files: 000008.sst 2024-03-30T13:30:53.272 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:30:53 smithi099 ceph-mon[24912]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-a/store.db: 000010.log size: 82633 ; 2024-03-30T13:30:53.272 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:30:53 smithi099 ceph-mon[24912]: rocksdb: Options.error_if_exists: 0 2024-03-30T13:30:53.272 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:30:53 smithi099 ceph-mon[24912]: rocksdb: Options.create_if_missing: 0 2024-03-30T13:30:53.272 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:30:53 smithi099 ceph-mon[24912]: rocksdb: Options.paranoid_checks: 1 2024-03-30T13:30:53.273 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:30:53 smithi099 ceph-mon[24912]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-03-30T13:30:53.273 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:30:53 smithi099 ceph-mon[24912]: rocksdb: Options.env: 0x56240e4c6860 2024-03-30T13:30:53.273 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:30:53 smithi099 ceph-mon[24912]: rocksdb: Options.fs: Posix File System 2024-03-30T13:30:53.273 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:30:53 smithi099 ceph-mon[24912]: rocksdb: Options.info_log: 0x5624105e5dc0 2024-03-30T13:30:53.273 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:30:53 smithi099 ceph-mon[24912]: rocksdb: Options.max_file_opening_threads: 16 2024-03-30T13:30:53.273 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:30:53 smithi099 ceph-mon[24912]: rocksdb: Options.statistics: (nil) 2024-03-30T13:30:53.273 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:30:53 smithi099 ceph-mon[24912]: rocksdb: Options.use_fsync: 0 2024-03-30T13:30:53.273 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:30:53 smithi099 ceph-mon[24912]: rocksdb: Options.max_log_file_size: 0 2024-03-30T13:30:53.273 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:30:53 smithi099 ceph-mon[24912]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-03-30T13:30:53.273 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:30:53 smithi099 ceph-mon[24912]: rocksdb: Options.log_file_time_to_roll: 0 2024-03-30T13:30:53.273 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:30:53 smithi099 ceph-mon[24912]: rocksdb: Options.keep_log_file_num: 1000 2024-03-30T13:30:53.273 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:30:53 smithi099 ceph-mon[24912]: rocksdb: Options.recycle_log_file_num: 0 2024-03-30T13:30:53.273 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:30:53 smithi099 ceph-mon[24912]: rocksdb: Options.allow_fallocate: 1 2024-03-30T13:30:53.273 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:30:53 smithi099 ceph-mon[24912]: rocksdb: Options.allow_mmap_reads: 0 2024-03-30T13:30:53.273 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:30:53 smithi099 ceph-mon[24912]: rocksdb: Options.allow_mmap_writes: 0 2024-03-30T13:30:53.273 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:30:53 smithi099 ceph-mon[24912]: rocksdb: Options.use_direct_reads: 0 2024-03-30T13:30:53.274 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:30:53 smithi099 ceph-mon[24912]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-03-30T13:30:53.274 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:30:53 smithi099 ceph-mon[24912]: rocksdb: Options.create_missing_column_families: 0 2024-03-30T13:30:53.274 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:30:53 smithi099 ceph-mon[24912]: rocksdb: Options.db_log_dir: 2024-03-30T13:30:53.274 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:30:53 smithi099 ceph-mon[24912]: rocksdb: Options.wal_dir: /var/lib/ceph/mon/ceph-a/store.db 2024-03-30T13:30:53.274 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:30:53 smithi099 ceph-mon[24912]: rocksdb: Options.table_cache_numshardbits: 6 2024-03-30T13:30:53.274 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:30:53 smithi099 ceph-mon[24912]: rocksdb: Options.WAL_ttl_seconds: 0 2024-03-30T13:30:53.274 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:30:53 smithi099 ceph-mon[24912]: rocksdb: Options.WAL_size_limit_MB: 0 2024-03-30T13:30:53.274 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:30:53 smithi099 ceph-mon[24912]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-03-30T13:30:53.274 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:30:53 smithi099 ceph-mon[24912]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-03-30T13:30:53.274 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:30:53 smithi099 ceph-mon[24912]: rocksdb: Options.is_fd_close_on_exec: 1 2024-03-30T13:30:53.274 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:30:53 smithi099 ceph-mon[24912]: rocksdb: Options.advise_random_on_open: 1 2024-03-30T13:30:53.274 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:30:53 smithi099 ceph-mon[24912]: rocksdb: Options.db_write_buffer_size: 0 2024-03-30T13:30:53.274 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:30:53 smithi099 ceph-mon[24912]: rocksdb: Options.write_buffer_manager: 0x5624106d62a0 2024-03-30T13:30:53.274 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:30:53 smithi099 ceph-mon[24912]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-03-30T13:30:53.274 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:30:53 smithi099 ceph-mon[24912]: rocksdb: Options.new_table_reader_for_compaction_inputs: 0 2024-03-30T13:30:53.274 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:30:53 smithi099 ceph-mon[24912]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-03-30T13:30:53.275 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:30:53 smithi099 ceph-mon[24912]: rocksdb: Options.use_adaptive_mutex: 0 2024-03-30T13:30:53.275 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:30:53 smithi099 ceph-mon[24912]: rocksdb: Options.rate_limiter: (nil) 2024-03-30T13:30:53.275 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:30:53 smithi099 ceph-mon[24912]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-03-30T13:30:53.275 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:30:53 smithi099 ceph-mon[24912]: rocksdb: Options.wal_recovery_mode: 2 2024-03-30T13:30:53.275 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:30:53 smithi099 ceph-mon[24912]: rocksdb: Options.enable_thread_tracking: 0 2024-03-30T13:30:53.275 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:30:53 smithi099 ceph-mon[24912]: rocksdb: Options.enable_pipelined_write: 0 2024-03-30T13:30:53.275 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:30:53 smithi099 ceph-mon[24912]: rocksdb: Options.unordered_write: 0 2024-03-30T13:30:53.275 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:30:53 smithi099 ceph-mon[24912]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-03-30T13:30:53.275 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:30:53 smithi099 ceph-mon[24912]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-03-30T13:30:53.275 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:30:53 smithi099 ceph-mon[24912]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-03-30T13:30:53.275 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:30:53 smithi099 ceph-mon[24912]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-03-30T13:30:53.275 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:30:53 smithi099 ceph-mon[24912]: rocksdb: Options.row_cache: None 2024-03-30T13:30:53.275 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:30:53 smithi099 ceph-mon[24912]: rocksdb: Options.wal_filter: None 2024-03-30T13:30:53.275 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:30:53 smithi099 ceph-mon[24912]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-03-30T13:30:53.275 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:30:53 smithi099 ceph-mon[24912]: rocksdb: Options.allow_ingest_behind: 0 2024-03-30T13:30:53.276 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:30:53 smithi099 ceph-mon[24912]: rocksdb: Options.preserve_deletes: 0 2024-03-30T13:30:53.276 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:30:53 smithi099 ceph-mon[24912]: rocksdb: Options.two_write_queues: 0 2024-03-30T13:30:53.276 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:30:53 smithi099 ceph-mon[24912]: rocksdb: Options.manual_wal_flush: 0 2024-03-30T13:30:53.276 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:30:53 smithi099 ceph-mon[24912]: rocksdb: Options.atomic_flush: 0 2024-03-30T13:30:53.276 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:30:53 smithi099 ceph-mon[24912]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-03-30T13:30:53.276 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:30:53 smithi099 ceph-mon[24912]: rocksdb: Options.persist_stats_to_disk: 0 2024-03-30T13:30:53.276 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:30:53 smithi099 ceph-mon[24912]: rocksdb: Options.write_dbid_to_manifest: 0 2024-03-30T13:30:53.276 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:30:53 smithi099 ceph-mon[24912]: rocksdb: Options.log_readahead_size: 0 2024-03-30T13:30:53.276 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:30:53 smithi099 ceph-mon[24912]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-03-30T13:30:53.276 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:30:53 smithi099 ceph-mon[24912]: rocksdb: Options.best_efforts_recovery: 0 2024-03-30T13:30:53.276 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:30:53 smithi099 ceph-mon[24912]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-03-30T13:30:53.276 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:30:53 smithi099 ceph-mon[24912]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-03-30T13:30:53.276 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:30:53 smithi099 ceph-mon[24912]: rocksdb: Options.allow_data_in_errors: 0 2024-03-30T13:30:53.276 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:30:53 smithi099 ceph-mon[24912]: rocksdb: Options.db_host_id: __hostname__ 2024-03-30T13:30:53.276 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:30:53 smithi099 ceph-mon[24912]: rocksdb: Options.max_background_jobs: 2 2024-03-30T13:30:53.276 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:30:53 smithi099 ceph-mon[24912]: rocksdb: Options.max_background_compactions: -1 2024-03-30T13:30:53.277 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:30:53 smithi099 ceph-mon[24912]: rocksdb: Options.max_subcompactions: 1 2024-03-30T13:30:53.277 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:30:53 smithi099 ceph-mon[24912]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-03-30T13:30:53.277 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:30:53 smithi099 ceph-mon[24912]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-03-30T13:30:53.277 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:30:53 smithi099 ceph-mon[24912]: rocksdb: Options.delayed_write_rate : 16777216 2024-03-30T13:30:53.277 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:30:53 smithi099 ceph-mon[24912]: rocksdb: Options.max_total_wal_size: 0 2024-03-30T13:30:53.277 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:30:53 smithi099 ceph-mon[24912]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-03-30T13:30:53.277 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:30:53 smithi099 ceph-mon[24912]: rocksdb: Options.stats_dump_period_sec: 600 2024-03-30T13:30:53.277 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:30:53 smithi099 ceph-mon[24912]: rocksdb: Options.stats_persist_period_sec: 600 2024-03-30T13:30:53.277 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:30:53 smithi099 ceph-mon[24912]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-03-30T13:30:53.277 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:30:53 smithi099 ceph-mon[24912]: rocksdb: Options.max_open_files: -1 2024-03-30T13:30:53.277 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:30:53 smithi099 ceph-mon[24912]: rocksdb: Options.bytes_per_sync: 0 2024-03-30T13:30:53.277 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:30:53 smithi099 ceph-mon[24912]: rocksdb: Options.wal_bytes_per_sync: 0 2024-03-30T13:30:53.277 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:30:53 smithi099 ceph-mon[24912]: rocksdb: Options.strict_bytes_per_sync: 0 2024-03-30T13:30:53.278 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:30:53 smithi099 ceph-mon[24912]: rocksdb: Options.compaction_readahead_size: 0 2024-03-30T13:30:53.278 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:30:53 smithi099 ceph-mon[24912]: rocksdb: Options.max_background_flushes: -1 2024-03-30T13:30:53.278 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:30:53 smithi099 ceph-mon[24912]: rocksdb: Compression algorithms supported: 2024-03-30T13:30:53.278 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:30:53 smithi099 ceph-mon[24912]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-03-30T13:30:53.278 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:30:53 smithi099 ceph-mon[24912]: rocksdb: kZSTD supported: 0 2024-03-30T13:30:53.278 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:30:53 smithi099 ceph-mon[24912]: rocksdb: kXpressCompression supported: 0 2024-03-30T13:30:53.278 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:30:53 smithi099 ceph-mon[24912]: rocksdb: kLZ4HCCompression supported: 1 2024-03-30T13:30:53.278 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:30:53 smithi099 ceph-mon[24912]: rocksdb: kLZ4Compression supported: 1 2024-03-30T13:30:53.278 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:30:53 smithi099 ceph-mon[24912]: rocksdb: kBZip2Compression supported: 0 2024-03-30T13:30:53.278 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:30:53 smithi099 ceph-mon[24912]: rocksdb: kZlibCompression supported: 1 2024-03-30T13:30:53.278 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:30:53 smithi099 ceph-mon[24912]: rocksdb: kSnappyCompression supported: 1 2024-03-30T13:30:53.278 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:30:53 smithi099 ceph-mon[24912]: rocksdb: Fast CRC32 supported: Supported on x86 2024-03-30T13:30:53.278 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:30:53 smithi099 ceph-mon[24912]: rocksdb: [db/version_set.cc:4725] Recovering from manifest file: /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000009 2024-03-30T13:30:53.278 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:30:53 smithi099 ceph-mon[24912]: rocksdb: [db/column_family.cc:597] --------------- Options for column family [default]: 2024-03-30T13:30:53.278 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:30:53 smithi099 ceph-mon[24912]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-03-30T13:30:53.279 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:30:53 smithi099 ceph-mon[24912]: rocksdb: Options.merge_operator: 2024-03-30T13:30:53.279 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:30:53 smithi099 ceph-mon[24912]: rocksdb: Options.compaction_filter: None 2024-03-30T13:30:53.279 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:30:53 smithi099 ceph-mon[24912]: rocksdb: Options.compaction_filter_factory: None 2024-03-30T13:30:53.279 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:30:53 smithi099 ceph-mon[24912]: rocksdb: Options.sst_partitioner_factory: None 2024-03-30T13:30:53.279 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:30:53 smithi099 ceph-mon[24912]: rocksdb: Options.memtable_factory: SkipListFactory 2024-03-30T13:30:53.279 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:30:53 smithi099 ceph-mon[24912]: rocksdb: Options.table_factory: BlockBasedTable 2024-03-30T13:30:53.279 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:30:53 smithi099 ceph-mon[24912]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x5624105b1d00) 2024-03-30T13:30:53.279 INFO:journalctl@ceph.mon.a.smithi099.stdout: cache_index_and_filter_blocks: 1 2024-03-30T13:30:53.279 INFO:journalctl@ceph.mon.a.smithi099.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-03-30T13:30:53.279 INFO:journalctl@ceph.mon.a.smithi099.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-03-30T13:30:53.279 INFO:journalctl@ceph.mon.a.smithi099.stdout: pin_top_level_index_and_filter: 1 2024-03-30T13:30:53.279 INFO:journalctl@ceph.mon.a.smithi099.stdout: index_type: 0 2024-03-30T13:30:53.279 INFO:journalctl@ceph.mon.a.smithi099.stdout: data_block_index_type: 0 2024-03-30T13:30:53.279 INFO:journalctl@ceph.mon.a.smithi099.stdout: index_shortening: 1 2024-03-30T13:30:53.279 INFO:journalctl@ceph.mon.a.smithi099.stdout: data_block_hash_table_util_ratio: 0.750000 2024-03-30T13:30:53.279 INFO:journalctl@ceph.mon.a.smithi099.stdout: hash_index_allow_collision: 1 2024-03-30T13:30:53.280 INFO:journalctl@ceph.mon.a.smithi099.stdout: checksum: 1 2024-03-30T13:30:53.280 INFO:journalctl@ceph.mon.a.smithi099.stdout: no_block_cache: 0 2024-03-30T13:30:53.280 INFO:journalctl@ceph.mon.a.smithi099.stdout: block_cache: 0x56241061c170 2024-03-30T13:30:53.280 INFO:journalctl@ceph.mon.a.smithi099.stdout: block_cache_name: BinnedLRUCache 2024-03-30T13:30:53.280 INFO:journalctl@ceph.mon.a.smithi099.stdout: block_cache_options: 2024-03-30T13:30:53.280 INFO:journalctl@ceph.mon.a.smithi099.stdout: capacity : 536870912 2024-03-30T13:30:53.280 INFO:journalctl@ceph.mon.a.smithi099.stdout: num_shard_bits : 4 2024-03-30T13:30:53.280 INFO:journalctl@ceph.mon.a.smithi099.stdout: strict_capacity_limit : 0 2024-03-30T13:30:53.280 INFO:journalctl@ceph.mon.a.smithi099.stdout: high_pri_pool_ratio: 0.000 2024-03-30T13:30:53.280 INFO:journalctl@ceph.mon.a.smithi099.stdout: block_cache_compressed: (nil) 2024-03-30T13:30:53.280 INFO:journalctl@ceph.mon.a.smithi099.stdout: persistent_cache: (nil) 2024-03-30T13:30:53.280 INFO:journalctl@ceph.mon.a.smithi099.stdout: block_size: 4096 2024-03-30T13:30:53.280 INFO:journalctl@ceph.mon.a.smithi099.stdout: block_size_deviation: 10 2024-03-30T13:30:53.280 INFO:journalctl@ceph.mon.a.smithi099.stdout: block_restart_interval: 16 2024-03-30T13:30:53.280 INFO:journalctl@ceph.mon.a.smithi099.stdout: index_block_restart_interval: 1 2024-03-30T13:30:53.280 INFO:journalctl@ceph.mon.a.smithi099.stdout: metadata_block_size: 4096 2024-03-30T13:30:53.281 INFO:journalctl@ceph.mon.a.smithi099.stdout: partition_filters: 0 2024-03-30T13:30:53.281 INFO:journalctl@ceph.mon.a.smithi099.stdout: use_delta_encoding: 1 2024-03-30T13:30:53.281 INFO:journalctl@ceph.mon.a.smithi099.stdout: filter_policy: rocksdb.BuiltinBloomFilter 2024-03-30T13:30:53.281 INFO:journalctl@ceph.mon.a.smithi099.stdout: whole_key_filtering: 1 2024-03-30T13:30:53.281 INFO:journalctl@ceph.mon.a.smithi099.stdout: verify_compression: 0 2024-03-30T13:30:53.281 INFO:journalctl@ceph.mon.a.smithi099.stdout: read_amp_bytes_per_bit: 0 2024-03-30T13:30:53.281 INFO:journalctl@ceph.mon.a.smithi099.stdout: format_version: 4 2024-03-30T13:30:53.281 INFO:journalctl@ceph.mon.a.smithi099.stdout: enable_index_compression: 1 2024-03-30T13:30:53.281 INFO:journalctl@ceph.mon.a.smithi099.stdout: block_align: 0 2024-03-30T13:30:53.281 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:30:53 smithi099 ceph-mon[24912]: rocksdb: Options.write_buffer_size: 33554432 2024-03-30T13:30:53.281 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:30:53 smithi099 ceph-mon[24912]: rocksdb: Options.max_write_buffer_number: 2 2024-03-30T13:30:53.281 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:30:53 smithi099 ceph-mon[24912]: rocksdb: Options.compression: NoCompression 2024-03-30T13:30:53.281 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:30:53 smithi099 ceph-mon[24912]: rocksdb: Options.bottommost_compression: Disabled 2024-03-30T13:30:53.282 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:30:53 smithi099 ceph-mon[24912]: rocksdb: Options.prefix_extractor: nullptr 2024-03-30T13:30:53.282 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:30:53 smithi099 ceph-mon[24912]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-03-30T13:30:53.282 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:30:53 smithi099 ceph-mon[24912]: rocksdb: Options.num_levels: 7 2024-03-30T13:30:53.282 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:30:53 smithi099 ceph-mon[24912]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-03-30T13:30:53.282 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:30:53 smithi099 ceph-mon[24912]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-03-30T13:30:53.282 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:30:53 smithi099 ceph-mon[24912]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-03-30T13:30:53.282 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:30:53 smithi099 ceph-mon[24912]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-03-30T13:30:53.282 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:30:53 smithi099 ceph-mon[24912]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-03-30T13:30:53.282 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:30:53 smithi099 ceph-mon[24912]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-03-30T13:30:53.282 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:30:53 smithi099 ceph-mon[24912]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-03-30T13:30:53.282 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:30:53 smithi099 ceph-mon[24912]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-03-30T13:30:53.282 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:30:53 smithi099 ceph-mon[24912]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-03-30T13:30:53.282 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:30:53 smithi099 ceph-mon[24912]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-03-30T13:30:53.282 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:30:53 smithi099 ceph-mon[24912]: rocksdb: Options.compression_opts.window_bits: -14 2024-03-30T13:30:53.283 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:30:53 smithi099 ceph-mon[24912]: rocksdb: Options.compression_opts.level: 32767 2024-03-30T13:30:53.283 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:30:53 smithi099 ceph-mon[24912]: rocksdb: Options.compression_opts.strategy: 0 2024-03-30T13:30:53.283 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:30:53 smithi099 ceph-mon[24912]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-03-30T13:30:53.283 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:30:53 smithi099 ceph-mon[24912]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-03-30T13:30:53.283 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:30:53 smithi099 ceph-mon[24912]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-03-30T13:30:53.283 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:30:53 smithi099 ceph-mon[24912]: rocksdb: Options.compression_opts.enabled: false 2024-03-30T13:30:53.283 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:30:53 smithi099 ceph-mon[24912]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-03-30T13:30:53.284 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:30:53 smithi099 ceph-mon[24912]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-03-30T13:30:53.284 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:30:53 smithi099 ceph-mon[24912]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-03-30T13:30:53.284 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:30:53 smithi099 ceph-mon[24912]: rocksdb: Options.target_file_size_base: 67108864 2024-03-30T13:30:53.284 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:30:53 smithi099 ceph-mon[24912]: rocksdb: Options.target_file_size_multiplier: 1 2024-03-30T13:30:53.284 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:30:53 smithi099 ceph-mon[24912]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-03-30T13:30:53.284 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:30:53 smithi099 ceph-mon[24912]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-03-30T13:30:53.284 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:30:53 smithi099 ceph-mon[24912]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-03-30T13:30:53.284 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:30:53 smithi099 ceph-mon[24912]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-03-30T13:30:53.284 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:30:53 smithi099 ceph-mon[24912]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-03-30T13:30:53.284 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:30:53 smithi099 ceph-mon[24912]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-03-30T13:30:53.284 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:30:53 smithi099 ceph-mon[24912]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-03-30T13:30:53.284 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:30:53 smithi099 ceph-mon[24912]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-03-30T13:30:53.285 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:30:53 smithi099 ceph-mon[24912]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-03-30T13:30:53.285 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:30:53 smithi099 ceph-mon[24912]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-03-30T13:30:53.285 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:30:53 smithi099 ceph-mon[24912]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-03-30T13:30:53.285 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:30:53 smithi099 ceph-mon[24912]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-03-30T13:30:53.285 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:30:53 smithi099 ceph-mon[24912]: rocksdb: Options.arena_block_size: 4194304 2024-03-30T13:30:53.285 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:30:53 smithi099 ceph-mon[24912]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-03-30T13:30:53.285 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:30:53 smithi099 ceph-mon[24912]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-03-30T13:30:53.285 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:30:53 smithi099 ceph-mon[24912]: rocksdb: Options.rate_limit_delay_max_milliseconds: 100 2024-03-30T13:30:53.285 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:30:53 smithi099 ceph-mon[24912]: rocksdb: Options.disable_auto_compactions: 0 2024-03-30T13:30:53.285 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:30:53 smithi099 ceph-mon[24912]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-03-30T13:30:53.286 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:30:53 smithi099 ceph-mon[24912]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-03-30T13:30:53.286 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:30:53 smithi099 ceph-mon[24912]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-03-30T13:30:53.286 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:30:53 smithi099 ceph-mon[24912]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-03-30T13:30:53.286 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:30:53 smithi099 ceph-mon[24912]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-03-30T13:30:53.286 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:30:53 smithi099 ceph-mon[24912]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-03-30T13:30:53.286 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:30:53 smithi099 ceph-mon[24912]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-03-30T13:30:53.286 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:30:53 smithi099 ceph-mon[24912]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-03-30T13:30:53.286 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:30:53 smithi099 ceph-mon[24912]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-03-30T13:30:53.286 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:30:53 smithi099 ceph-mon[24912]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-03-30T13:30:53.286 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:30:53 smithi099 ceph-mon[24912]: rocksdb: Options.table_properties_collectors: 2024-03-30T13:30:53.286 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:30:53 smithi099 ceph-mon[24912]: rocksdb: Options.inplace_update_support: 0 2024-03-30T13:30:53.286 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:30:53 smithi099 ceph-mon[24912]: rocksdb: Options.inplace_update_num_locks: 10000 2024-03-30T13:30:53.286 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:30:53 smithi099 ceph-mon[24912]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-03-30T13:30:53.286 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:30:53 smithi099 ceph-mon[24912]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-03-30T13:30:53.286 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:30:53 smithi099 ceph-mon[24912]: rocksdb: Options.memtable_huge_page_size: 0 2024-03-30T13:30:53.287 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:30:53 smithi099 ceph-mon[24912]: rocksdb: Options.bloom_locality: 0 2024-03-30T13:30:53.287 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:30:53 smithi099 ceph-mon[24912]: rocksdb: Options.max_successive_merges: 0 2024-03-30T13:30:53.287 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:30:53 smithi099 ceph-mon[24912]: rocksdb: Options.optimize_filters_for_hits: 0 2024-03-30T13:30:53.287 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:30:53 smithi099 ceph-mon[24912]: rocksdb: Options.paranoid_file_checks: 0 2024-03-30T13:30:53.287 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:30:53 smithi099 ceph-mon[24912]: rocksdb: Options.force_consistency_checks: 1 2024-03-30T13:30:53.287 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:30:53 smithi099 ceph-mon[24912]: rocksdb: Options.report_bg_io_stats: 0 2024-03-30T13:30:53.287 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:30:53 smithi099 ceph-mon[24912]: rocksdb: Options.ttl: 2592000 2024-03-30T13:30:53.287 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:30:53 smithi099 ceph-mon[24912]: rocksdb: Options.periodic_compaction_seconds: 0 2024-03-30T13:30:53.287 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:30:53 smithi099 ceph-mon[24912]: rocksdb: Options.enable_blob_files: false 2024-03-30T13:30:53.287 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:30:53 smithi099 ceph-mon[24912]: rocksdb: Options.min_blob_size: 0 2024-03-30T13:30:53.287 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:30:53 smithi099 ceph-mon[24912]: rocksdb: Options.blob_file_size: 268435456 2024-03-30T13:30:53.287 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:30:53 smithi099 ceph-mon[24912]: rocksdb: Options.blob_compression_type: NoCompression 2024-03-30T13:30:53.287 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:30:53 smithi099 ceph-mon[24912]: rocksdb: Options.enable_blob_garbage_collection: false 2024-03-30T13:30:53.288 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:30:53 smithi099 ceph-mon[24912]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-03-30T13:30:53.288 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:30:53 smithi099 ceph-mon[24912]: rocksdb: [db/version_set.cc:4773] Recovered from manifest file:/var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000009 succeeded,manifest_file_number is 9, next_file_number is 11, last_sequence is 5, log_number is 5,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2024-03-30T13:30:53.288 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:30:53 smithi099 ceph-mon[24912]: rocksdb: [db/version_set.cc:4782] Column family [default] (ID 0), log number is 5 2024-03-30T13:30:53.288 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:30:53 smithi099 ceph-mon[24912]: rocksdb: [db/version_set.cc:4083] Creating manifest 13 2024-03-30T13:30:53.288 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:30:53 smithi099 ceph-mon[24912]: rocksdb: EVENT_LOG_v1 {"time_micros": 1711805453006547, "job": 1, "event": "recovery_started", "wal_files": [10]} 2024-03-30T13:30:53.288 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:30:53 smithi099 ceph-mon[24912]: rocksdb: [db/db_impl/db_impl_open.cc:847] Recovering log #10 mode 2 2024-03-30T13:30:53.288 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:30:53 smithi099 ceph-mon[24912]: rocksdb: [table/block_based/filter_policy.cc:996] Using legacy Bloom filter with high (20) bits/key. Dramatic filter space and/or accuracy improvement is available with format_version>=5. 2024-03-30T13:30:53.288 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:30:53 smithi099 ceph-mon[24912]: rocksdb: EVENT_LOG_v1 {"time_micros": 1711805453007362, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 14, "file_size": 79183, "file_checksum": "", "file_checksum_func_name": "Unknown", "table_properties": {"data_size": 77446, "index_size": 225, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 581, "raw_key_size": 10027, "raw_average_key_size": 47, "raw_value_size": 71755, "raw_average_value_size": 340, "num_data_blocks": 10, "num_entries": 211, "num_deletions": 3, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "rocksdb.BuiltinBloomFilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; ", "creation_time": 1711805453, "oldest_key_time": 0, "file_creation_time": 0, "db_id": "53488779-88f1-4b5b-98f2-7b717f8062ca", "db_session_id": "N3QHQXGGHQZOQFZION7Y"}} 2024-03-30T13:30:53.288 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:30:53 smithi099 ceph-mon[24912]: rocksdb: [db/version_set.cc:4083] Creating manifest 15 2024-03-30T13:30:53.288 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:30:53 smithi099 ceph-mon[24912]: rocksdb: EVENT_LOG_v1 {"time_micros": 1711805453007780, "job": 1, "event": "recovery_finished"} 2024-03-30T13:30:53.288 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:30:53 smithi099 ceph-mon[24912]: rocksdb: [file/delete_scheduler.cc:73] Deleted file /var/lib/ceph/mon/ceph-a/store.db/000010.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-03-30T13:30:53.288 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:30:53 smithi099 ceph-mon[24912]: rocksdb: [db/db_impl/db_impl_open.cc:1701] SstFileManager instance 0x562410602a80 2024-03-30T13:30:53.288 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:30:53 smithi099 ceph-mon[24912]: rocksdb: DB pointer 0x562410612000 2024-03-30T13:30:53.288 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:30:53 smithi099 ceph-mon[24912]: rocksdb: [db/db_impl/db_impl.cc:902] ------- DUMPING STATS ------- 2024-03-30T13:30:53.288 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:30:53 smithi099 ceph-mon[24912]: rocksdb: [db/db_impl/db_impl.cc:903] 2024-03-30T13:30:53.289 INFO:journalctl@ceph.mon.a.smithi099.stdout: ** DB Stats ** 2024-03-30T13:30:53.289 INFO:journalctl@ceph.mon.a.smithi099.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-03-30T13:30:53.289 INFO:journalctl@ceph.mon.a.smithi099.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-03-30T13:30:53.289 INFO:journalctl@ceph.mon.a.smithi099.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-03-30T13:30:53.289 INFO:journalctl@ceph.mon.a.smithi099.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-03-30T13:30:53.289 INFO:journalctl@ceph.mon.a.smithi099.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-03-30T13:30:53.289 INFO:journalctl@ceph.mon.a.smithi099.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 MB, 0.00 MB/s 2024-03-30T13:30:53.289 INFO:journalctl@ceph.mon.a.smithi099.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-03-30T13:30:53.289 INFO:journalctl@ceph.mon.a.smithi099.stdout: 2024-03-30T13:30:53.289 INFO:journalctl@ceph.mon.a.smithi099.stdout: ** Compaction Stats [default] ** 2024-03-30T13:30:53.289 INFO:journalctl@ceph.mon.a.smithi099.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2024-03-30T13:30:53.289 INFO:journalctl@ceph.mon.a.smithi099.stdout: ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-03-30T13:30:53.289 INFO:journalctl@ceph.mon.a.smithi099.stdout: L0 2/0 79.09 KB 0.5 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 132.7 0.00 0.00 1 0.001 0 0 2024-03-30T13:30:53.289 INFO:journalctl@ceph.mon.a.smithi099.stdout: Sum 2/0 79.09 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 132.7 0.00 0.00 1 0.001 0 0 2024-03-30T13:30:53.289 INFO:journalctl@ceph.mon.a.smithi099.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 132.7 0.00 0.00 1 0.001 0 0 2024-03-30T13:30:53.289 INFO:journalctl@ceph.mon.a.smithi099.stdout: 2024-03-30T13:30:53.290 INFO:journalctl@ceph.mon.a.smithi099.stdout: ** Compaction Stats [default] ** 2024-03-30T13:30:53.290 INFO:journalctl@ceph.mon.a.smithi099.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2024-03-30T13:30:53.290 INFO:journalctl@ceph.mon.a.smithi099.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-03-30T13:30:53.290 INFO:journalctl@ceph.mon.a.smithi099.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 132.7 0.00 0.00 1 0.001 0 0 2024-03-30T13:30:53.290 INFO:journalctl@ceph.mon.a.smithi099.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-03-30T13:30:53.290 INFO:journalctl@ceph.mon.a.smithi099.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-03-30T13:30:53.290 INFO:journalctl@ceph.mon.a.smithi099.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-03-30T13:30:53.290 INFO:journalctl@ceph.mon.a.smithi099.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-03-30T13:30:53.290 INFO:journalctl@ceph.mon.a.smithi099.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-03-30T13:30:53.290 INFO:journalctl@ceph.mon.a.smithi099.stdout: AddFile(Keys): cumulative 0, interval 0 2024-03-30T13:30:53.290 INFO:journalctl@ceph.mon.a.smithi099.stdout: Cumulative compaction: 0.00 GB write, 22.35 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-03-30T13:30:53.290 INFO:journalctl@ceph.mon.a.smithi099.stdout: Interval compaction: 0.00 GB write, 22.35 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-03-30T13:30:53.290 INFO:journalctl@ceph.mon.a.smithi099.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-03-30T13:30:53.290 INFO:journalctl@ceph.mon.a.smithi099.stdout: 2024-03-30T13:30:53.291 INFO:journalctl@ceph.mon.a.smithi099.stdout: ** File Read Latency Histogram By Level [default] ** 2024-03-30T13:30:53.291 INFO:journalctl@ceph.mon.a.smithi099.stdout: 2024-03-30T13:30:53.291 INFO:journalctl@ceph.mon.a.smithi099.stdout: ** Compaction Stats [default] ** 2024-03-30T13:30:53.291 INFO:journalctl@ceph.mon.a.smithi099.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2024-03-30T13:30:53.291 INFO:journalctl@ceph.mon.a.smithi099.stdout: ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-03-30T13:30:53.291 INFO:journalctl@ceph.mon.a.smithi099.stdout: L0 2/0 79.09 KB 0.5 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 132.7 0.00 0.00 1 0.001 0 0 2024-03-30T13:30:53.291 INFO:journalctl@ceph.mon.a.smithi099.stdout: Sum 2/0 79.09 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 132.7 0.00 0.00 1 0.001 0 0 2024-03-30T13:30:53.291 INFO:journalctl@ceph.mon.a.smithi099.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 2024-03-30T13:30:53.291 INFO:journalctl@ceph.mon.a.smithi099.stdout: 2024-03-30T13:30:53.292 INFO:journalctl@ceph.mon.a.smithi099.stdout: ** Compaction Stats [default] ** 2024-03-30T13:30:53.292 INFO:journalctl@ceph.mon.a.smithi099.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2024-03-30T13:30:53.292 INFO:journalctl@ceph.mon.a.smithi099.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-03-30T13:30:53.292 INFO:journalctl@ceph.mon.a.smithi099.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 132.7 0.00 0.00 1 0.001 0 0 2024-03-30T13:30:53.292 INFO:journalctl@ceph.mon.a.smithi099.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-03-30T13:30:53.292 INFO:journalctl@ceph.mon.a.smithi099.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-03-30T13:30:53.292 INFO:journalctl@ceph.mon.a.smithi099.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-03-30T13:30:53.292 INFO:journalctl@ceph.mon.a.smithi099.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-03-30T13:30:53.292 INFO:journalctl@ceph.mon.a.smithi099.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-03-30T13:30:53.292 INFO:journalctl@ceph.mon.a.smithi099.stdout: AddFile(Keys): cumulative 0, interval 0 2024-03-30T13:30:53.292 INFO:journalctl@ceph.mon.a.smithi099.stdout: Cumulative compaction: 0.00 GB write, 22.11 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-03-30T13:30:53.292 INFO:journalctl@ceph.mon.a.smithi099.stdout: Interval compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-03-30T13:30:53.292 INFO:journalctl@ceph.mon.a.smithi099.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-03-30T13:30:53.292 INFO:journalctl@ceph.mon.a.smithi099.stdout: 2024-03-30T13:30:53.292 INFO:journalctl@ceph.mon.a.smithi099.stdout: ** File Read Latency Histogram By Level [default] ** 2024-03-30T13:30:53.293 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:30:53 smithi099 ceph-mon[24912]: starting mon.a rank 0 at public addrs [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] at bind addrs [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] mon_data /var/lib/ceph/mon/ceph-a fsid 98ebaeb8-ee99-11ee-b647-cb9ed24678a4 2024-03-30T13:30:53.293 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:30:53 smithi099 ceph-mon[24912]: mon.a@-1(???) e1 preinit fsid 98ebaeb8-ee99-11ee-b647-cb9ed24678a4 2024-03-30T13:30:53.293 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:30:53 smithi099 ceph-mon[24912]: mon.a@-1(???).mds e1 new map 2024-03-30T13:30:53.293 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:30:53 smithi099 ceph-mon[24912]: mon.a@-1(???).mds e1 print_map 2024-03-30T13:30:53.293 INFO:journalctl@ceph.mon.a.smithi099.stdout: e1 2024-03-30T13:30:53.293 INFO:journalctl@ceph.mon.a.smithi099.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-03-30T13:30:53.293 INFO:journalctl@ceph.mon.a.smithi099.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-03-30T13:30:53.293 INFO:journalctl@ceph.mon.a.smithi099.stdout: legacy client fscid: -1 2024-03-30T13:30:53.293 INFO:journalctl@ceph.mon.a.smithi099.stdout: 2024-03-30T13:30:53.293 INFO:journalctl@ceph.mon.a.smithi099.stdout: No filesystems configured 2024-03-30T13:30:53.293 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:30:53 smithi099 ceph-mon[24912]: mon.a@-1(???).osd e1 crush map has features 3314932999778484224, adjusting msgr requires 2024-03-30T13:30:53.293 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:30:53 smithi099 ceph-mon[24912]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-03-30T13:30:53.293 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:30:53 smithi099 ceph-mon[24912]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-03-30T13:30:53.293 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:30:53 smithi099 ceph-mon[24912]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-03-30T13:30:53.293 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:30:53 smithi099 ceph-mon[24912]: mon.a@-1(???).paxosservice(auth 1..2) refresh upgraded, format 0 -> 3 2024-03-30T13:30:53.293 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:30:53 smithi099 ceph-mon[24912]: expand_channel_meta expand map: {default=false} 2024-03-30T13:30:53.294 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:30:53 smithi099 ceph-mon[24912]: expand_channel_meta from 'false' to 'false' 2024-03-30T13:30:53.294 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:30:53 smithi099 ceph-mon[24912]: expand_channel_meta expanded map: {default=false} 2024-03-30T13:30:53.294 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:30:53 smithi099 ceph-mon[24912]: expand_channel_meta expand map: {default=info} 2024-03-30T13:30:53.294 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:30:53 smithi099 ceph-mon[24912]: expand_channel_meta from 'info' to 'info' 2024-03-30T13:30:53.294 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:30:53 smithi099 ceph-mon[24912]: expand_channel_meta expanded map: {default=info} 2024-03-30T13:30:53.294 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:30:53 smithi099 ceph-mon[24912]: expand_channel_meta expand map: {default=daemon} 2024-03-30T13:30:53.294 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:30:53 smithi099 ceph-mon[24912]: expand_channel_meta from 'daemon' to 'daemon' 2024-03-30T13:30:53.294 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:30:53 smithi099 ceph-mon[24912]: expand_channel_meta expanded map: {default=daemon} 2024-03-30T13:30:53.294 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:30:53 smithi099 ceph-mon[24912]: expand_channel_meta expand map: {default=debug} 2024-03-30T13:30:53.294 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:30:53 smithi099 ceph-mon[24912]: expand_channel_meta from 'debug' to 'debug' 2024-03-30T13:30:53.294 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:30:53 smithi099 ceph-mon[24912]: expand_channel_meta expanded map: {default=debug} 2024-03-30T13:30:53.294 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:30:53 smithi099 ceph-mon[24912]: mon.a is new leader, mons a in quorum (ranks 0) 2024-03-30T13:30:53.294 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:30:53 smithi099 ceph-mon[24912]: monmap e1: 1 mons at {a=[v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0]} 2024-03-30T13:30:53.294 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:30:53 smithi099 ceph-mon[24912]: fsmap 2024-03-30T13:30:53.294 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:30:53 smithi099 ceph-mon[24912]: osdmap e1: 0 total, 0 up, 0 in 2024-03-30T13:30:53.294 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:30:53 smithi099 ceph-mon[24912]: mgrmap e1: no daemons active 2024-03-30T13:30:53.295 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:30:53 smithi099 bash[24894]: af06ebb19fd8580cc4e94089c0e786286e13dad706d7c07e98d7eff570805eb5 2024-03-30T13:30:53.295 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:30:53 smithi099 systemd[1]: Started Ceph mon.a for 98ebaeb8-ee99-11ee-b647-cb9ed24678a4. 2024-03-30T13:30:54.398 INFO:teuthology.orchestra.run.smithi099.stderr:Wrote config to /etc/ceph/ceph.conf 2024-03-30T13:30:54.398 INFO:teuthology.orchestra.run.smithi099.stderr:Wrote keyring to /etc/ceph/ceph.client.admin.keyring 2024-03-30T13:30:54.398 INFO:teuthology.orchestra.run.smithi099.stderr:Creating mgr... 2024-03-30T13:30:54.398 INFO:teuthology.orchestra.run.smithi099.stderr:Verifying port 9283 ... 2024-03-30T13:30:54.568 INFO:teuthology.orchestra.run.smithi099.stderr:systemctl: Failed to reset failed state of unit ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4@mgr.y.service: Unit ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4@mgr.y.service not loaded. 2024-03-30T13:30:54.575 INFO:teuthology.orchestra.run.smithi099.stderr:systemctl: Created symlink /etc/systemd/system/ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4.target.wants/ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4@mgr.y.service → /etc/systemd/system/ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4@.service. 2024-03-30T13:30:54.837 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:30:54 smithi099 ceph-mon[24912]: from='client.? 172.21.15.99:0/485998611' entity='client.admin' 2024-03-30T13:30:54.837 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:30:54 smithi099 systemd[1]: Starting Ceph mgr.y for 98ebaeb8-ee99-11ee-b647-cb9ed24678a4... 2024-03-30T13:30:55.214 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:30:54 smithi099 podman[25126]: 2024-03-30 13:30:54.858509275 +0000 UTC m=+0.017965942 image pull e1d6a67b021eb077ee22bf650f1a9fb1980a2cf5c36bdb9cba9eac6de8f702d9 quay.io/ceph/ceph:v17.2.0 2024-03-30T13:30:55.214 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:30:54 smithi099 podman[25126]: 2024-03-30 13:30:54.961674619 +0000 UTC m=+0.121131268 container create db3430cee99a5316ae23cc6551d4ffb50ec041ee6faceb22d2923d97b8f45824 (image=quay.io/ceph/ceph:v17.2.0, name=ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y, io.k8s.description=The Universal Base Image is designed and engineered to be the base layer for all of your containerized applications, middleware and utilities. This base image is freely redistributable, but Red Hat only supports Red Hat technologies through subscriptions for Red Hat products. This image is maintained by Red Hat and updated regularly., architecture=x86_64, version=8, RELEASE=HEAD, GIT_BRANCH=HEAD, GIT_COMMIT=b613db0f44179c0940781c1c7fe04e1acb7093ac, io.buildah.version=1.19.8, name=centos-stream, release=754, io.openshift.tags=base centos centos-stream, vcs-ref=f1ee6e37554363ec55e0035aba1a693d3627fdeb, io.openshift.expose-services=, description=CentOS Stream is a continuously delivered distro that tracks just ahead of Red Hat Enterprise Linux development. This image takes the Red Hat UBI and layers on content from CentOS Stream, maintainer=Guillaume Abrioux , build-date=2022-05-03T08:36:31.336870, ceph=True, io.k8s.display-name=CentOS Stream 8, GIT_REPO=https://github.com/ceph/ceph-container.git, url=https://access.redhat.com/containers/#/registry.access.redhat.com/ubi8/images/8.6-754, com.redhat.component=centos-stream-container, vcs-type=git, CEPH_POINT_RELEASE=-17.2.0, GIT_CLEAN=True, com.redhat.license_terms=https://centos.org/legal/licensing-policy/, distribution-scope=public, com.redhat.build-host=cpt-1002.osbs.prod.upshift.rdu2.redhat.com, vendor=Red Hat, Inc., summary=Provides a CentOS Stream container based on the Red Hat Universal Base Image) 2024-03-30T13:30:55.215 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:30:55 smithi099 podman[25126]: 2024-03-30 13:30:55.130308046 +0000 UTC m=+0.289764695 container init db3430cee99a5316ae23cc6551d4ffb50ec041ee6faceb22d2923d97b8f45824 (image=quay.io/ceph/ceph:v17.2.0, name=ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y, io.openshift.expose-services=, version=8, io.buildah.version=1.19.8, vcs-type=git, GIT_BRANCH=HEAD, ceph=True, url=https://access.redhat.com/containers/#/registry.access.redhat.com/ubi8/images/8.6-754, io.openshift.tags=base centos centos-stream, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=-17.2.0, vendor=Red Hat, Inc., architecture=x86_64, build-date=2022-05-03T08:36:31.336870, com.redhat.license_terms=https://centos.org/legal/licensing-policy/, GIT_COMMIT=b613db0f44179c0940781c1c7fe04e1acb7093ac, description=CentOS Stream is a continuously delivered distro that tracks just ahead of Red Hat Enterprise Linux development. This image takes the Red Hat UBI and layers on content from CentOS Stream, GIT_REPO=https://github.com/ceph/ceph-container.git, summary=Provides a CentOS Stream container based on the Red Hat Universal Base Image, name=centos-stream, distribution-scope=public, GIT_CLEAN=True, RELEASE=HEAD, com.redhat.build-host=cpt-1002.osbs.prod.upshift.rdu2.redhat.com, io.k8s.description=The Universal Base Image is designed and engineered to be the base layer for all of your containerized applications, middleware and utilities. This base image is freely redistributable, but Red Hat only supports Red Hat technologies through subscriptions for Red Hat products. This image is maintained by Red Hat and updated regularly., release=754, io.k8s.display-name=CentOS Stream 8, vcs-ref=f1ee6e37554363ec55e0035aba1a693d3627fdeb, com.redhat.component=centos-stream-container) 2024-03-30T13:30:55.215 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:30:55 smithi099 podman[25126]: 2024-03-30 13:30:55.132747531 +0000 UTC m=+0.292204172 container start db3430cee99a5316ae23cc6551d4ffb50ec041ee6faceb22d2923d97b8f45824 (image=quay.io/ceph/ceph:v17.2.0, name=ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y, io.k8s.display-name=CentOS Stream 8, io.buildah.version=1.19.8, vcs-type=git, CEPH_POINT_RELEASE=-17.2.0, com.redhat.build-host=cpt-1002.osbs.prod.upshift.rdu2.redhat.com, io.k8s.description=The Universal Base Image is designed and engineered to be the base layer for all of your containerized applications, middleware and utilities. This base image is freely redistributable, but Red Hat only supports Red Hat technologies through subscriptions for Red Hat products. This image is maintained by Red Hat and updated regularly., vendor=Red Hat, Inc., vcs-ref=f1ee6e37554363ec55e0035aba1a693d3627fdeb, maintainer=Guillaume Abrioux , GIT_REPO=https://github.com/ceph/ceph-container.git, com.redhat.component=centos-stream-container, name=centos-stream, ceph=True, url=https://access.redhat.com/containers/#/registry.access.redhat.com/ubi8/images/8.6-754, release=754, com.redhat.license_terms=https://centos.org/legal/licensing-policy/, GIT_COMMIT=b613db0f44179c0940781c1c7fe04e1acb7093ac, build-date=2022-05-03T08:36:31.336870, RELEASE=HEAD, io.openshift.tags=base centos centos-stream, architecture=x86_64, distribution-scope=public, GIT_BRANCH=HEAD, summary=Provides a CentOS Stream container based on the Red Hat Universal Base Image, io.openshift.expose-services=, version=8, description=CentOS Stream is a continuously delivered distro that tracks just ahead of Red Hat Enterprise Linux development. This image takes the Red Hat UBI and layers on content from CentOS Stream, GIT_CLEAN=True) 2024-03-30T13:30:55.215 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:30:55 smithi099 bash[25126]: db3430cee99a5316ae23cc6551d4ffb50ec041ee6faceb22d2923d97b8f45824 2024-03-30T13:30:55.227 INFO:teuthology.orchestra.run.smithi099.stderr:systemctl: disabled 2024-03-30T13:30:55.234 INFO:teuthology.orchestra.run.smithi099.stderr:systemctl: inactive 2024-03-30T13:30:55.234 INFO:teuthology.orchestra.run.smithi099.stderr:firewalld.service is not enabled 2024-03-30T13:30:55.234 INFO:teuthology.orchestra.run.smithi099.stderr:Not possible to enable service . firewalld.service is not available 2024-03-30T13:30:55.242 INFO:teuthology.orchestra.run.smithi099.stderr:systemctl: disabled 2024-03-30T13:30:55.249 INFO:teuthology.orchestra.run.smithi099.stderr:systemctl: inactive 2024-03-30T13:30:55.250 INFO:teuthology.orchestra.run.smithi099.stderr:firewalld.service is not enabled 2024-03-30T13:30:55.250 INFO:teuthology.orchestra.run.smithi099.stderr:Not possible to open ports <[9283]>. firewalld.service is not available 2024-03-30T13:30:55.250 INFO:teuthology.orchestra.run.smithi099.stderr:Waiting for mgr to start... 2024-03-30T13:30:55.250 INFO:teuthology.orchestra.run.smithi099.stderr:Waiting for mgr... 2024-03-30T13:30:55.542 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:30:55 smithi099 systemd[1]: Started Ceph mgr.y for 98ebaeb8-ee99-11ee-b647-cb9ed24678a4. 2024-03-30T13:30:55.725 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph: 2024-03-30T13:30:55.726 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph: { 2024-03-30T13:30:55.726 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph: "fsid": "98ebaeb8-ee99-11ee-b647-cb9ed24678a4", 2024-03-30T13:30:55.726 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph: "health": { 2024-03-30T13:30:55.726 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph: "status": "HEALTH_OK", 2024-03-30T13:30:55.726 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph: "checks": {}, 2024-03-30T13:30:55.726 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph: "mutes": [] 2024-03-30T13:30:55.726 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph: }, 2024-03-30T13:30:55.726 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph: "election_epoch": 5, 2024-03-30T13:30:55.726 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph: "quorum": [ 2024-03-30T13:30:55.726 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph: 0 2024-03-30T13:30:55.726 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph: ], 2024-03-30T13:30:55.726 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph: "quorum_names": [ 2024-03-30T13:30:55.726 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph: "a" 2024-03-30T13:30:55.727 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph: ], 2024-03-30T13:30:55.727 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph: "quorum_age": 2, 2024-03-30T13:30:55.727 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph: "monmap": { 2024-03-30T13:30:55.727 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph: "epoch": 1, 2024-03-30T13:30:55.727 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph: "min_mon_release_name": "quincy", 2024-03-30T13:30:55.727 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph: "num_mons": 1 2024-03-30T13:30:55.727 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph: }, 2024-03-30T13:30:55.727 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph: "osdmap": { 2024-03-30T13:30:55.727 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph: "epoch": 1, 2024-03-30T13:30:55.727 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph: "num_osds": 0, 2024-03-30T13:30:55.727 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph: "num_up_osds": 0, 2024-03-30T13:30:55.727 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph: "osd_up_since": 0, 2024-03-30T13:30:55.727 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph: "num_in_osds": 0, 2024-03-30T13:30:55.727 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph: "osd_in_since": 0, 2024-03-30T13:30:55.727 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph: "num_remapped_pgs": 0 2024-03-30T13:30:55.727 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph: }, 2024-03-30T13:30:55.728 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph: "pgmap": { 2024-03-30T13:30:55.728 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph: "pgs_by_state": [], 2024-03-30T13:30:55.728 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph: "num_pgs": 0, 2024-03-30T13:30:55.728 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph: "num_pools": 0, 2024-03-30T13:30:55.728 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph: "num_objects": 0, 2024-03-30T13:30:55.728 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph: "data_bytes": 0, 2024-03-30T13:30:55.728 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph: "bytes_used": 0, 2024-03-30T13:30:55.728 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph: "bytes_avail": 0, 2024-03-30T13:30:55.728 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph: "bytes_total": 0 2024-03-30T13:30:55.728 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph: }, 2024-03-30T13:30:55.728 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph: "fsmap": { 2024-03-30T13:30:55.728 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph: "epoch": 1, 2024-03-30T13:30:55.728 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph: "by_rank": [], 2024-03-30T13:30:55.728 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph: "up:standby": 0 2024-03-30T13:30:55.729 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph: }, 2024-03-30T13:30:55.729 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph: "mgrmap": { 2024-03-30T13:30:55.729 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph: "available": false, 2024-03-30T13:30:55.729 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph: "num_standbys": 0, 2024-03-30T13:30:55.729 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph: "modules": [ 2024-03-30T13:30:55.729 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph: "iostat", 2024-03-30T13:30:55.729 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph: "nfs", 2024-03-30T13:30:55.729 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph: "restful" 2024-03-30T13:30:55.729 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph: ], 2024-03-30T13:30:55.729 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph: "services": {} 2024-03-30T13:30:55.729 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph: }, 2024-03-30T13:30:55.729 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph: "servicemap": { 2024-03-30T13:30:55.729 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph: "epoch": 1, 2024-03-30T13:30:55.729 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph: "modified": "2024-03-30T13:30:46.740477+0000", 2024-03-30T13:30:55.729 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph: "services": {} 2024-03-30T13:30:55.730 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph: }, 2024-03-30T13:30:55.730 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph: "progress_events": {} 2024-03-30T13:30:55.730 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph: } 2024-03-30T13:30:55.837 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:30:55 smithi099 ceph-mon[24912]: from='client.? 172.21.15.99:0/3340709638' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-03-30T13:30:55.837 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:30:55 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[25141]: 2024-03-30T13:30:55.623+0000 7f9f88902000 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-03-30T13:30:55.837 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:30:55 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[25141]: 2024-03-30T13:30:55.715+0000 7f9f88902000 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-03-30T13:30:56.446 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:30:56 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[25141]: 2024-03-30T13:30:56.307+0000 7f9f88902000 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-03-30T13:30:56.446 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:30:56 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[25141]: 2024-03-30T13:30:56.393+0000 7f9f88902000 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-03-30T13:30:56.449 INFO:teuthology.orchestra.run.smithi099.stderr:mgr not available, waiting (1/15)... 2024-03-30T13:30:56.698 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:30:56 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[25141]: 2024-03-30T13:30:56.475+0000 7f9f88902000 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-03-30T13:30:56.698 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:30:56 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[25141]: 2024-03-30T13:30:56.619+0000 7f9f88902000 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-03-30T13:30:57.040 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:30:56 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[25141]: 2024-03-30T13:30:56.695+0000 7f9f88902000 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-03-30T13:30:57.041 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:30:56 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[25141]: 2024-03-30T13:30:56.800+0000 7f9f88902000 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-03-30T13:30:57.041 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:30:56 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[25141]: 2024-03-30T13:30:56.880+0000 7f9f88902000 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-03-30T13:30:57.041 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:30:57 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[25141]: 2024-03-30T13:30:57.038+0000 7f9f88902000 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-03-30T13:30:57.337 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:30:57 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[25141]: 2024-03-30T13:30:57.120+0000 7f9f88902000 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-03-30T13:30:58.429 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:30:58 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[25141]: 2024-03-30T13:30:58.121+0000 7f9f88902000 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-03-30T13:30:58.429 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:30:58 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[25141]: 2024-03-30T13:30:58.245+0000 7f9f88902000 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-03-30T13:30:58.429 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:30:58 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[25141]: 2024-03-30T13:30:58.426+0000 7f9f88902000 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-03-30T13:30:58.684 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:30:58 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[25141]: 2024-03-30T13:30:58.518+0000 7f9f88902000 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-03-30T13:30:58.684 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:30:58 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[25141]: 2024-03-30T13:30:58.651+0000 7f9f88902000 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-03-30T13:30:58.956 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph: 2024-03-30T13:30:58.956 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph: { 2024-03-30T13:30:58.956 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph: "fsid": "98ebaeb8-ee99-11ee-b647-cb9ed24678a4", 2024-03-30T13:30:58.956 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph: "health": { 2024-03-30T13:30:58.956 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph: "status": "HEALTH_OK", 2024-03-30T13:30:58.956 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph: "checks": {}, 2024-03-30T13:30:58.956 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph: "mutes": [] 2024-03-30T13:30:58.956 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph: }, 2024-03-30T13:30:58.956 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph: "election_epoch": 5, 2024-03-30T13:30:58.957 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph: "quorum": [ 2024-03-30T13:30:58.957 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph: 0 2024-03-30T13:30:58.957 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph: ], 2024-03-30T13:30:58.957 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph: "quorum_names": [ 2024-03-30T13:30:58.957 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph: "a" 2024-03-30T13:30:58.957 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph: ], 2024-03-30T13:30:58.957 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph: "quorum_age": 5, 2024-03-30T13:30:58.957 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph: "monmap": { 2024-03-30T13:30:58.957 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph: "epoch": 1, 2024-03-30T13:30:58.957 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph: "min_mon_release_name": "quincy", 2024-03-30T13:30:58.957 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph: "num_mons": 1 2024-03-30T13:30:58.957 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph: }, 2024-03-30T13:30:58.957 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph: "osdmap": { 2024-03-30T13:30:58.957 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph: "epoch": 1, 2024-03-30T13:30:58.957 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph: "num_osds": 0, 2024-03-30T13:30:58.958 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph: "num_up_osds": 0, 2024-03-30T13:30:58.958 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph: "osd_up_since": 0, 2024-03-30T13:30:58.961 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph: "num_in_osds": 0, 2024-03-30T13:30:58.961 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph: "osd_in_since": 0, 2024-03-30T13:30:58.961 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph: "num_remapped_pgs": 0 2024-03-30T13:30:58.961 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph: }, 2024-03-30T13:30:58.961 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph: "pgmap": { 2024-03-30T13:30:58.961 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph: "pgs_by_state": [], 2024-03-30T13:30:58.962 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph: "num_pgs": 0, 2024-03-30T13:30:58.963 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph: "num_pools": 0, 2024-03-30T13:30:58.963 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph: "num_objects": 0, 2024-03-30T13:30:58.963 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph: "data_bytes": 0, 2024-03-30T13:30:58.963 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph: "bytes_used": 0, 2024-03-30T13:30:58.963 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph: "bytes_avail": 0, 2024-03-30T13:30:58.963 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph: "bytes_total": 0 2024-03-30T13:30:58.963 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph: }, 2024-03-30T13:30:58.963 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph: "fsmap": { 2024-03-30T13:30:58.963 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph: "epoch": 1, 2024-03-30T13:30:58.963 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph: "by_rank": [], 2024-03-30T13:30:58.963 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph: "up:standby": 0 2024-03-30T13:30:58.963 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph: }, 2024-03-30T13:30:58.964 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph: "mgrmap": { 2024-03-30T13:30:58.964 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph: "available": false, 2024-03-30T13:30:58.964 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph: "num_standbys": 0, 2024-03-30T13:30:58.964 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph: "modules": [ 2024-03-30T13:30:58.964 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph: "iostat", 2024-03-30T13:30:58.964 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph: "nfs", 2024-03-30T13:30:58.964 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph: "restful" 2024-03-30T13:30:58.964 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph: ], 2024-03-30T13:30:58.964 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph: "services": {} 2024-03-30T13:30:58.964 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph: }, 2024-03-30T13:30:58.964 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph: "servicemap": { 2024-03-30T13:30:58.964 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph: "epoch": 1, 2024-03-30T13:30:58.964 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph: "modified": "2024-03-30T13:30:46.740477+0000", 2024-03-30T13:30:58.965 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph: "services": {} 2024-03-30T13:30:58.965 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph: }, 2024-03-30T13:30:58.965 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph: "progress_events": {} 2024-03-30T13:30:58.965 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph: } 2024-03-30T13:30:59.286 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:30:59 smithi099 ceph-mon[24912]: from='client.? 172.21.15.99:0/4046448618' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-03-30T13:30:59.286 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:30:58 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[25141]: 2024-03-30T13:30:58.979+0000 7f9f88902000 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-03-30T13:30:59.286 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:30:59 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[25141]: 2024-03-30T13:30:59.196+0000 7f9f88902000 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-03-30T13:30:59.286 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:30:59 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[25141]: 2024-03-30T13:30:59.283+0000 7f9f88902000 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-03-30T13:30:59.576 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:30:59 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[25141]: 2024-03-30T13:30:59.452+0000 7f9f88902000 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-03-30T13:30:59.579 INFO:teuthology.orchestra.run.smithi099.stderr:mgr not available, waiting (2/15)... 2024-03-30T13:31:00.586 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:31:00 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[25141]: 2024-03-30T13:31:00.351+0000 7f9f88902000 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-03-30T13:31:00.873 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:31:00 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[25141]: 2024-03-30T13:31:00.636+0000 7f9f88902000 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-03-30T13:31:00.873 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:31:00 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[25141]: 2024-03-30T13:31:00.727+0000 7f9f88902000 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-03-30T13:31:00.873 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:31:00 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[25141]: 2024-03-30T13:31:00.871+0000 7f9f88902000 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-03-30T13:31:01.337 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:31:00 smithi099 ceph-mon[24912]: Activating manager daemon y 2024-03-30T13:31:01.337 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:31:00 smithi099 ceph-mon[24912]: mgrmap e2: y(active, starting, since 0.0024997s) 2024-03-30T13:31:01.337 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:31:00 smithi099 ceph-mon[24912]: from='mgr.14100 172.21.15.99:0/1429427225' entity='mgr.y' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-03-30T13:31:01.337 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:31:00 smithi099 ceph-mon[24912]: from='mgr.14100 172.21.15.99:0/1429427225' entity='mgr.y' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-03-30T13:31:01.337 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:31:00 smithi099 ceph-mon[24912]: from='mgr.14100 172.21.15.99:0/1429427225' entity='mgr.y' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-03-30T13:31:01.337 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:31:00 smithi099 ceph-mon[24912]: from='mgr.14100 172.21.15.99:0/1429427225' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-03-30T13:31:01.337 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:31:00 smithi099 ceph-mon[24912]: from='mgr.14100 172.21.15.99:0/1429427225' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-03-30T13:31:01.338 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:31:00 smithi099 ceph-mon[24912]: Manager daemon y is now available 2024-03-30T13:31:01.338 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:31:00 smithi099 ceph-mon[24912]: from='mgr.14100 172.21.15.99:0/1429427225' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-03-30T13:31:01.338 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:31:00 smithi099 ceph-mon[24912]: from='mgr.14100 172.21.15.99:0/1429427225' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-03-30T13:31:01.338 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:31:00 smithi099 ceph-mon[24912]: from='mgr.14100 172.21.15.99:0/1429427225' entity='mgr.y' 2024-03-30T13:31:01.338 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:31:00 smithi099 ceph-mon[24912]: from='mgr.14100 172.21.15.99:0/1429427225' entity='mgr.y' 2024-03-30T13:31:01.338 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:31:00 smithi099 ceph-mon[24912]: from='mgr.14100 172.21.15.99:0/1429427225' entity='mgr.y' 2024-03-30T13:31:02.248 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph: 2024-03-30T13:31:02.248 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph: { 2024-03-30T13:31:02.248 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph: "fsid": "98ebaeb8-ee99-11ee-b647-cb9ed24678a4", 2024-03-30T13:31:02.248 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph: "health": { 2024-03-30T13:31:02.248 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph: "status": "HEALTH_OK", 2024-03-30T13:31:02.248 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph: "checks": {}, 2024-03-30T13:31:02.248 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph: "mutes": [] 2024-03-30T13:31:02.248 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph: }, 2024-03-30T13:31:02.248 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph: "election_epoch": 5, 2024-03-30T13:31:02.248 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph: "quorum": [ 2024-03-30T13:31:02.248 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph: 0 2024-03-30T13:31:02.248 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph: ], 2024-03-30T13:31:02.248 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph: "quorum_names": [ 2024-03-30T13:31:02.248 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph: "a" 2024-03-30T13:31:02.249 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph: ], 2024-03-30T13:31:02.249 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph: "quorum_age": 9, 2024-03-30T13:31:02.249 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph: "monmap": { 2024-03-30T13:31:02.249 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph: "epoch": 1, 2024-03-30T13:31:02.249 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph: "min_mon_release_name": "quincy", 2024-03-30T13:31:02.249 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph: "num_mons": 1 2024-03-30T13:31:02.249 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph: }, 2024-03-30T13:31:02.249 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph: "osdmap": { 2024-03-30T13:31:02.249 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph: "epoch": 1, 2024-03-30T13:31:02.249 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph: "num_osds": 0, 2024-03-30T13:31:02.249 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph: "num_up_osds": 0, 2024-03-30T13:31:02.249 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph: "osd_up_since": 0, 2024-03-30T13:31:02.249 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph: "num_in_osds": 0, 2024-03-30T13:31:02.249 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph: "osd_in_since": 0, 2024-03-30T13:31:02.250 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph: "num_remapped_pgs": 0 2024-03-30T13:31:02.250 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph: }, 2024-03-30T13:31:02.250 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph: "pgmap": { 2024-03-30T13:31:02.250 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph: "pgs_by_state": [], 2024-03-30T13:31:02.250 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph: "num_pgs": 0, 2024-03-30T13:31:02.250 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph: "num_pools": 0, 2024-03-30T13:31:02.250 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph: "num_objects": 0, 2024-03-30T13:31:02.250 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph: "data_bytes": 0, 2024-03-30T13:31:02.250 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph: "bytes_used": 0, 2024-03-30T13:31:02.250 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph: "bytes_avail": 0, 2024-03-30T13:31:02.251 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph: "bytes_total": 0 2024-03-30T13:31:02.251 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph: }, 2024-03-30T13:31:02.251 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph: "fsmap": { 2024-03-30T13:31:02.251 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph: "epoch": 1, 2024-03-30T13:31:02.251 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph: "by_rank": [], 2024-03-30T13:31:02.251 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph: "up:standby": 0 2024-03-30T13:31:02.251 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph: }, 2024-03-30T13:31:02.251 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph: "mgrmap": { 2024-03-30T13:31:02.251 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph: "available": true, 2024-03-30T13:31:02.251 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph: "num_standbys": 0, 2024-03-30T13:31:02.251 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph: "modules": [ 2024-03-30T13:31:02.251 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph: "iostat", 2024-03-30T13:31:02.251 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph: "nfs", 2024-03-30T13:31:02.251 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph: "restful" 2024-03-30T13:31:02.251 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph: ], 2024-03-30T13:31:02.252 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph: "services": {} 2024-03-30T13:31:02.252 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph: }, 2024-03-30T13:31:02.252 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph: "servicemap": { 2024-03-30T13:31:02.252 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph: "epoch": 1, 2024-03-30T13:31:02.252 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph: "modified": "2024-03-30T13:30:46.740477+0000", 2024-03-30T13:31:02.252 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph: "services": {} 2024-03-30T13:31:02.252 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph: }, 2024-03-30T13:31:02.252 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph: "progress_events": {} 2024-03-30T13:31:02.252 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph: } 2024-03-30T13:31:02.835 INFO:teuthology.orchestra.run.smithi099.stderr:mgr is available 2024-03-30T13:31:03.083 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:31:02 smithi099 ceph-mon[24912]: mgrmap e3: y(active, since 1.00605s) 2024-03-30T13:31:03.084 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:31:02 smithi099 ceph-mon[24912]: from='client.? 172.21.15.99:0/2016448738' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-03-30T13:31:03.446 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph: 2024-03-30T13:31:03.446 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph: [global] 2024-03-30T13:31:03.446 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph: fsid = 98ebaeb8-ee99-11ee-b647-cb9ed24678a4 2024-03-30T13:31:03.446 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph: mon_osd_allow_pg_remap = true 2024-03-30T13:31:03.446 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph: mon_osd_allow_primary_affinity = true 2024-03-30T13:31:03.446 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph: mon_warn_on_no_sortbitwise = false 2024-03-30T13:31:03.446 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph: osd_crush_chooseleaf_type = 0 2024-03-30T13:31:03.447 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph: 2024-03-30T13:31:03.447 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph: [mgr] 2024-03-30T13:31:03.447 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph: mgr/telemetry/nag = false 2024-03-30T13:31:03.447 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph: 2024-03-30T13:31:03.447 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph: [osd] 2024-03-30T13:31:03.447 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph: osd_map_max_advance = 10 2024-03-30T13:31:03.447 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph: osd_sloppy_crc = true 2024-03-30T13:31:04.033 INFO:teuthology.orchestra.run.smithi099.stderr:Enabling cephadm module... 2024-03-30T13:31:04.155 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:31:03 smithi099 ceph-mon[24912]: mgrmap e4: y(active, since 2s) 2024-03-30T13:31:04.155 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:31:03 smithi099 ceph-mon[24912]: from='client.? 172.21.15.99:0/3365667924' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2024-03-30T13:31:04.155 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:31:03 smithi099 ceph-mon[24912]: from='client.? 172.21.15.99:0/3365667924' entity='client.admin' cmd='[{"prefix": "config assimilate-conf"}]': finished 2024-03-30T13:31:05.186 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:31:04 smithi099 ceph-mon[24912]: from='client.? 172.21.15.99:0/2361790397' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "cephadm"}]: dispatch 2024-03-30T13:31:05.186 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:31:04 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[25141]: ignoring --setuser ceph since I am not root 2024-03-30T13:31:05.187 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:31:04 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[25141]: ignoring --setgroup ceph since I am not root 2024-03-30T13:31:05.467 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:31:05 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[25141]: 2024-03-30T13:31:05.377+0000 7f1448c00000 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-03-30T13:31:05.467 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:31:05 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[25141]: 2024-03-30T13:31:05.465+0000 7f1448c00000 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-03-30T13:31:06.073 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:31:05 smithi099 ceph-mon[24912]: from='client.? 172.21.15.99:0/2361790397' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "cephadm"}]': finished 2024-03-30T13:31:06.073 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:31:05 smithi099 ceph-mon[24912]: mgrmap e5: y(active, since 4s) 2024-03-30T13:31:06.126 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph: { 2024-03-30T13:31:06.127 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph: "epoch": 5, 2024-03-30T13:31:06.127 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph: "available": true, 2024-03-30T13:31:06.127 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph: "active_name": "y", 2024-03-30T13:31:06.127 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph: "num_standby": 0 2024-03-30T13:31:06.127 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph: } 2024-03-30T13:31:06.337 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:31:06 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[25141]: 2024-03-30T13:31:06.072+0000 7f1448c00000 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-03-30T13:31:06.337 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:31:06 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[25141]: 2024-03-30T13:31:06.166+0000 7f1448c00000 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-03-30T13:31:06.337 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:31:06 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[25141]: 2024-03-30T13:31:06.248+0000 7f1448c00000 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-03-30T13:31:06.672 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:31:06 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[25141]: 2024-03-30T13:31:06.397+0000 7f1448c00000 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-03-30T13:31:06.672 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:31:06 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[25141]: 2024-03-30T13:31:06.478+0000 7f1448c00000 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-03-30T13:31:06.672 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:31:06 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[25141]: 2024-03-30T13:31:06.588+0000 7f1448c00000 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-03-30T13:31:06.672 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:31:06 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[25141]: 2024-03-30T13:31:06.670+0000 7f1448c00000 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-03-30T13:31:06.770 INFO:teuthology.orchestra.run.smithi099.stderr:Waiting for the mgr to restart... 2024-03-30T13:31:06.770 INFO:teuthology.orchestra.run.smithi099.stderr:Waiting for mgr epoch 5... 2024-03-30T13:31:06.930 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:31:06 smithi099 ceph-mon[24912]: from='client.? 172.21.15.99:0/835025213' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2024-03-30T13:31:06.931 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:31:06 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[25141]: 2024-03-30T13:31:06.842+0000 7f1448c00000 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-03-30T13:31:06.931 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:31:06 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[25141]: 2024-03-30T13:31:06.929+0000 7f1448c00000 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-03-30T13:31:08.255 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:31:07 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[25141]: 2024-03-30T13:31:07.944+0000 7f1448c00000 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-03-30T13:31:08.255 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:31:08 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[25141]: 2024-03-30T13:31:08.070+0000 7f1448c00000 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-03-30T13:31:08.256 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:31:08 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[25141]: 2024-03-30T13:31:08.254+0000 7f1448c00000 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-03-30T13:31:08.587 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:31:08 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[25141]: 2024-03-30T13:31:08.339+0000 7f1448c00000 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-03-30T13:31:08.587 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:31:08 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[25141]: 2024-03-30T13:31:08.470+0000 7f1448c00000 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-03-30T13:31:09.078 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:31:08 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[25141]: 2024-03-30T13:31:08.781+0000 7f1448c00000 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-03-30T13:31:09.078 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:31:08 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[25141]: 2024-03-30T13:31:08.995+0000 7f1448c00000 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-03-30T13:31:09.078 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:31:09 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[25141]: 2024-03-30T13:31:09.076+0000 7f1448c00000 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-03-30T13:31:09.336 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:31:09 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[25141]: 2024-03-30T13:31:09.242+0000 7f1448c00000 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-03-30T13:31:10.426 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:31:10 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[25141]: 2024-03-30T13:31:10.136+0000 7f1448c00000 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-03-30T13:31:10.426 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:31:10 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[25141]: 2024-03-30T13:31:10.424+0000 7f1448c00000 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-03-30T13:31:10.722 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:31:10 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[25141]: 2024-03-30T13:31:10.517+0000 7f1448c00000 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-03-30T13:31:10.722 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:31:10 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[25141]: 2024-03-30T13:31:10.665+0000 7f1448c00000 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-03-30T13:31:11.086 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:31:10 smithi099 ceph-mon[24912]: Active manager daemon y restarted 2024-03-30T13:31:11.087 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:31:10 smithi099 ceph-mon[24912]: Activating manager daemon y 2024-03-30T13:31:11.087 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:31:10 smithi099 ceph-mon[24912]: osdmap e2: 0 total, 0 up, 0 in 2024-03-30T13:31:11.735 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph: { 2024-03-30T13:31:11.735 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph: "mgrmap_epoch": 7, 2024-03-30T13:31:11.736 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph: "initialized": true 2024-03-30T13:31:11.736 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph: } 2024-03-30T13:31:11.972 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:31:11 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[25141]: [30/Mar/2024:13:31:11] ENGINE Bus STARTING 2024-03-30T13:31:11.972 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:31:11 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[25141]: [30/Mar/2024:13:31:11] ENGINE Serving on https://172.21.15.99:7150 2024-03-30T13:31:11.972 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:31:11 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[25141]: [30/Mar/2024:13:31:11] ENGINE Bus STARTED 2024-03-30T13:31:11.973 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:31:11 smithi099 ceph-mon[24912]: mgrmap e6: y(active, starting, since 0.0526025s) 2024-03-30T13:31:11.973 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:31:11 smithi099 ceph-mon[24912]: from='mgr.14118 172.21.15.99:0/1566581813' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-03-30T13:31:11.973 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:31:11 smithi099 ceph-mon[24912]: from='mgr.14118 172.21.15.99:0/1566581813' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-03-30T13:31:11.973 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:31:11 smithi099 ceph-mon[24912]: from='mgr.14118 172.21.15.99:0/1566581813' entity='mgr.y' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-03-30T13:31:11.973 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:31:11 smithi099 ceph-mon[24912]: from='mgr.14118 172.21.15.99:0/1566581813' entity='mgr.y' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-03-30T13:31:11.973 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:31:11 smithi099 ceph-mon[24912]: from='mgr.14118 172.21.15.99:0/1566581813' entity='mgr.y' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-03-30T13:31:11.973 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:31:11 smithi099 ceph-mon[24912]: Manager daemon y is now available 2024-03-30T13:31:11.973 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:31:11 smithi099 ceph-mon[24912]: from='mgr.14118 172.21.15.99:0/1566581813' entity='mgr.y' 2024-03-30T13:31:11.973 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:31:11 smithi099 ceph-mon[24912]: from='mgr.14118 172.21.15.99:0/1566581813' entity='mgr.y' 2024-03-30T13:31:11.973 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:31:11 smithi099 ceph-mon[24912]: from='mgr.14118 172.21.15.99:0/1566581813' entity='mgr.y' 2024-03-30T13:31:11.973 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:31:11 smithi099 ceph-mon[24912]: from='mgr.14118 172.21.15.99:0/1566581813' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:31:11.973 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:31:11 smithi099 ceph-mon[24912]: from='mgr.14118 172.21.15.99:0/1566581813' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:31:11.973 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:31:11 smithi099 ceph-mon[24912]: from='mgr.14118 172.21.15.99:0/1566581813' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:31:11.974 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:31:11 smithi099 ceph-mon[24912]: from='mgr.14118 172.21.15.99:0/1566581813' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-03-30T13:31:11.974 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:31:11 smithi099 ceph-mon[24912]: from='mgr.14118 172.21.15.99:0/1566581813' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-03-30T13:31:12.209 INFO:teuthology.orchestra.run.smithi099.stderr:mgr epoch 5 is available 2024-03-30T13:31:12.209 INFO:teuthology.orchestra.run.smithi099.stderr:Setting orchestrator backend to cephadm... 2024-03-30T13:31:12.836 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:31:12 smithi099 ceph-mon[24912]: [30/Mar/2024:13:31:11] ENGINE Bus STARTING 2024-03-30T13:31:12.837 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:31:12 smithi099 ceph-mon[24912]: from='client.14122 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2024-03-30T13:31:12.837 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:31:12 smithi099 ceph-mon[24912]: mgrmap e7: y(active, since 1.05997s) 2024-03-30T13:31:12.837 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:31:12 smithi099 ceph-mon[24912]: from='client.14122 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2024-03-30T13:31:12.837 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:31:12 smithi099 ceph-mon[24912]: [30/Mar/2024:13:31:11] ENGINE Serving on https://172.21.15.99:7150 2024-03-30T13:31:12.837 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:31:12 smithi099 ceph-mon[24912]: [30/Mar/2024:13:31:11] ENGINE Bus STARTED 2024-03-30T13:31:12.837 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:31:12 smithi099 ceph-mon[24912]: from='mgr.14118 172.21.15.99:0/1566581813' entity='mgr.y' 2024-03-30T13:31:12.837 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:31:12 smithi099 ceph-mon[24912]: from='mgr.14118 172.21.15.99:0/1566581813' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:31:14.008 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:31:13 smithi099 ceph-mon[24912]: from='client.14130 -' entity='client.admin' cmd=[{"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T13:31:14.008 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:31:13 smithi099 ceph-mon[24912]: from='mgr.14118 172.21.15.99:0/1566581813' entity='mgr.y' 2024-03-30T13:31:14.008 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:31:13 smithi099 ceph-mon[24912]: mgrmap e8: y(active, since 2s) 2024-03-30T13:31:14.008 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:31:13 smithi099 ceph-mon[24912]: from='mgr.14118 172.21.15.99:0/1566581813' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:31:14.008 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph: value unchanged 2024-03-30T13:31:14.587 INFO:teuthology.orchestra.run.smithi099.stderr:Generating ssh key... 2024-03-30T13:31:15.086 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:31:14 smithi099 ceph-mon[24912]: from='client.14132 -' entity='client.admin' cmd=[{"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T13:31:15.587 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:31:15 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[25141]: Generating public/private rsa key pair. 2024-03-30T13:31:15.587 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:31:15 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[25141]: Your identification has been saved in /tmp/tmp52kltznc/key. 2024-03-30T13:31:15.587 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:31:15 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[25141]: Your public key has been saved in /tmp/tmp52kltznc/key.pub. 2024-03-30T13:31:15.587 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:31:15 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[25141]: The key fingerprint is: 2024-03-30T13:31:15.587 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:31:15 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[25141]: SHA256:sKQNhE/NJ+av6k74i4CgOWzkq9QsvL91eYvNtos/Lmc ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4 2024-03-30T13:31:15.588 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:31:15 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[25141]: The key's randomart image is: 2024-03-30T13:31:15.588 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:31:15 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[25141]: +---[RSA 3072]----+ 2024-03-30T13:31:15.588 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:31:15 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[25141]: | ..o | 2024-03-30T13:31:15.588 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:31:15 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[25141]: | ... = . | 2024-03-30T13:31:15.588 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:31:15 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[25141]: | o.ooo | 2024-03-30T13:31:15.588 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:31:15 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[25141]: | .=.o | 2024-03-30T13:31:15.588 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:31:15 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[25141]: |.. . o.S | 2024-03-30T13:31:15.588 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:31:15 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[25141]: |O.o. o | 2024-03-30T13:31:15.588 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:31:15 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[25141]: |*B.o.. + . | 2024-03-30T13:31:15.588 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:31:15 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[25141]: |oo++. o.*E. | 2024-03-30T13:31:15.588 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:31:15 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[25141]: |ooo=Bo oBO+ | 2024-03-30T13:31:15.588 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:31:15 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[25141]: +----[SHA256]-----+ 2024-03-30T13:31:16.516 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:31:16 smithi099 ceph-mon[24912]: from='client.14134 -' entity='client.admin' cmd=[{"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T13:31:16.516 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:31:16 smithi099 ceph-mon[24912]: Generating ssh key... 2024-03-30T13:31:16.516 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:31:16 smithi099 ceph-mon[24912]: from='mgr.14118 172.21.15.99:0/1566581813' entity='mgr.y' 2024-03-30T13:31:16.516 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:31:16 smithi099 ceph-mon[24912]: from='mgr.14118 172.21.15.99:0/1566581813' entity='mgr.y' 2024-03-30T13:31:16.516 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCguvGFvBUWC6RLc0nLmF1KqYh38EscMJcuRUtXhidcIFWEPVsTl6w44iOroE0s3BBrUN847w+LNFleQs/8LqdVRUa4goh7Lw/Qt3/akkKV/sMVqjOsfsUgQ+M16OlREC8ckfxcegf6ldcXcPijCWnnj3LTsG0tCWCNELHRpw4SUcemNzO+IOigghGGkkf2gbSiniO0LkzEu4ZL2Nxm5mODNLRPtYtfAgRvYYyMMwVJUMTe6cPapp2MKg6bWYnQ08G5cl0CprUNMWOo0wCrpc0TRf4zGxINeeOCsihFqM7rjv00RQXeRv53HI+nwZ0iTxpOytN2g1Yuvgls5fz5iYLxuC7bFy8cN0ZXHikXO0eVVQMOQ2wsFVDpBYSMI/EV5ZQXIcmxeeOD30noDrnN5XpDTlfQydyELgc8/MVcqcJYJb7zmXwpGwzYqw1ZbSKTJwLT/xXNLYyOIADyW2nFyieoooeR0RhCOO+ve97+Qv93mJAUD5O0eMgXem2byNatj8c= ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4 2024-03-30T13:31:17.116 INFO:teuthology.orchestra.run.smithi099.stderr:Wrote public SSH key to /home/ubuntu/cephtest/ceph.pub 2024-03-30T13:31:17.116 INFO:teuthology.orchestra.run.smithi099.stderr:Adding key to root@localhost authorized_keys... 2024-03-30T13:31:17.117 INFO:teuthology.orchestra.run.smithi099.stderr:Adding host smithi099... 2024-03-30T13:31:17.416 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:31:17 smithi099 ceph-mon[24912]: from='client.14136 -' entity='client.admin' cmd=[{"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T13:31:18.704 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:31:18 smithi099 ceph-mon[24912]: from='client.14138 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi099", "addr": "172.21.15.99", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T13:31:18.757 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph: Added host 'smithi099' with addr '172.21.15.99' 2024-03-30T13:31:19.297 INFO:teuthology.orchestra.run.smithi099.stderr:Deploying unmanaged mon service... 2024-03-30T13:31:19.944 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:31:19 smithi099 ceph-mon[24912]: Deploying cephadm binary to smithi099 2024-03-30T13:31:19.945 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:31:19 smithi099 ceph-mon[24912]: from='mgr.14118 172.21.15.99:0/1566581813' entity='mgr.y' 2024-03-30T13:31:19.945 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:31:19 smithi099 ceph-mon[24912]: Added host smithi099 2024-03-30T13:31:19.945 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:31:19 smithi099 ceph-mon[24912]: from='mgr.14118 172.21.15.99:0/1566581813' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:31:19.945 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph: Scheduled mon update... 2024-03-30T13:31:20.629 INFO:teuthology.orchestra.run.smithi099.stderr:Deploying unmanaged mgr service... 2024-03-30T13:31:21.328 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:31:20 smithi099 ceph-mon[24912]: from='client.14140 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T13:31:21.328 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:31:20 smithi099 ceph-mon[24912]: Saving service mon spec with placement count:5 2024-03-30T13:31:21.328 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:31:20 smithi099 ceph-mon[24912]: from='mgr.14118 172.21.15.99:0/1566581813' entity='mgr.y' 2024-03-30T13:31:21.396 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph: Scheduled mgr update... 2024-03-30T13:31:22.583 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:31:22 smithi099 ceph-mon[24912]: from='client.14142 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T13:31:22.583 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:31:22 smithi099 ceph-mon[24912]: Saving service mgr spec with placement count:2 2024-03-30T13:31:22.583 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:31:22 smithi099 ceph-mon[24912]: from='mgr.14118 172.21.15.99:0/1566581813' entity='mgr.y' 2024-03-30T13:31:24.087 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:31:23 smithi099 ceph-mon[24912]: from='client.? 172.21.15.99:0/897090179' entity='client.admin' 2024-03-30T13:31:24.087 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:31:23 smithi099 ceph-mon[24912]: from='mgr.14118 172.21.15.99:0/1566581813' entity='mgr.y' 2024-03-30T13:31:24.087 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:31:23 smithi099 ceph-mon[24912]: from='mgr.14118 172.21.15.99:0/1566581813' entity='mgr.y' 2024-03-30T13:31:25.643 INFO:teuthology.orchestra.run.smithi099.stderr:Enabling the dashboard module... 2024-03-30T13:31:25.769 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:31:25 smithi099 ceph-mon[24912]: from='client.? 172.21.15.99:0/1872595229' entity='client.admin' 2024-03-30T13:31:25.769 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:31:25 smithi099 ceph-mon[24912]: from='mgr.14118 172.21.15.99:0/1566581813' entity='mgr.y' 2024-03-30T13:31:25.769 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:31:25 smithi099 ceph-mon[24912]: from='mgr.14118 172.21.15.99:0/1566581813' entity='mgr.y' 2024-03-30T13:31:25.769 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:31:25 smithi099 ceph-mon[24912]: from='mgr.14118 172.21.15.99:0/1566581813' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd/host:smithi099", "name": "osd_memory_target"}]: dispatch 2024-03-30T13:31:25.770 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:31:25 smithi099 ceph-mon[24912]: from='mgr.14118 172.21.15.99:0/1566581813' entity='mgr.y' 2024-03-30T13:31:25.770 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:31:25 smithi099 ceph-mon[24912]: from='mgr.14118 172.21.15.99:0/1566581813' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.agent.smithi099", "caps": []}]: dispatch 2024-03-30T13:31:25.770 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:31:25 smithi099 ceph-mon[24912]: from='mgr.14118 172.21.15.99:0/1566581813' entity='mgr.y' cmd='[{"prefix": "auth get-or-create", "entity": "client.agent.smithi099", "caps": []}]': finished 2024-03-30T13:31:26.822 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:31:26 smithi099 ceph-mon[24912]: Deploying daemon agent.smithi099 on smithi099 2024-03-30T13:31:26.822 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:31:26 smithi099 ceph-mon[24912]: from='client.? 172.21.15.99:0/1786495532' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "dashboard"}]: dispatch 2024-03-30T13:31:26.822 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:31:26 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[25141]: ignoring --setuser ceph since I am not root 2024-03-30T13:31:26.822 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:31:26 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[25141]: ignoring --setgroup ceph since I am not root 2024-03-30T13:31:27.086 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:31:27 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[25141]: 2024-03-30T13:31:27.004+0000 7f085a701000 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-03-30T13:31:27.384 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:31:27 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[25141]: 2024-03-30T13:31:27.094+0000 7f085a701000 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-03-30T13:31:27.704 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:31:27 smithi099 ceph-mon[24912]: from='client.? 172.21.15.99:0/1786495532' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "dashboard"}]': finished 2024-03-30T13:31:27.704 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:31:27 smithi099 ceph-mon[24912]: mgrmap e9: y(active, since 15s) 2024-03-30T13:31:27.815 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph: { 2024-03-30T13:31:27.815 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph: "epoch": 9, 2024-03-30T13:31:27.815 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph: "available": true, 2024-03-30T13:31:27.815 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph: "active_name": "y", 2024-03-30T13:31:27.815 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph: "num_standby": 0 2024-03-30T13:31:27.815 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph: } 2024-03-30T13:31:28.032 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:31:27 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[25141]: 2024-03-30T13:31:27.702+0000 7f085a701000 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-03-30T13:31:28.032 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:31:27 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[25141]: 2024-03-30T13:31:27.791+0000 7f085a701000 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-03-30T13:31:28.033 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:31:27 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[25141]: 2024-03-30T13:31:27.881+0000 7f085a701000 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-03-30T13:31:28.033 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:31:28 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[25141]: 2024-03-30T13:31:28.031+0000 7f085a701000 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-03-30T13:31:28.285 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:31:28 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[25141]: 2024-03-30T13:31:28.112+0000 7f085a701000 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-03-30T13:31:28.285 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:31:28 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[25141]: 2024-03-30T13:31:28.219+0000 7f085a701000 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-03-30T13:31:28.423 INFO:teuthology.orchestra.run.smithi099.stderr:Waiting for the mgr to restart... 2024-03-30T13:31:28.424 INFO:teuthology.orchestra.run.smithi099.stderr:Waiting for mgr epoch 9... 2024-03-30T13:31:28.546 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:31:28 smithi099 ceph-mon[24912]: from='client.? 172.21.15.99:0/2293298786' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2024-03-30T13:31:28.546 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:31:28 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[25141]: 2024-03-30T13:31:28.301+0000 7f085a701000 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-03-30T13:31:28.546 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:31:28 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[25141]: 2024-03-30T13:31:28.467+0000 7f085a701000 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-03-30T13:31:28.824 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:31:28 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[25141]: 2024-03-30T13:31:28.553+0000 7f085a701000 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-03-30T13:31:29.837 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:31:29 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[25141]: 2024-03-30T13:31:29.571+0000 7f085a701000 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-03-30T13:31:29.837 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:31:29 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[25141]: 2024-03-30T13:31:29.699+0000 7f085a701000 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-03-30T13:31:30.337 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:31:29 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[25141]: 2024-03-30T13:31:29.885+0000 7f085a701000 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-03-30T13:31:30.337 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:31:29 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[25141]: 2024-03-30T13:31:29.970+0000 7f085a701000 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-03-30T13:31:30.337 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:31:30 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[25141]: 2024-03-30T13:31:30.102+0000 7f085a701000 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-03-30T13:31:30.648 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:31:30 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[25141]: 2024-03-30T13:31:30.418+0000 7f085a701000 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-03-30T13:31:30.910 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:31:30 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[25141]: 2024-03-30T13:31:30.647+0000 7f085a701000 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-03-30T13:31:30.911 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:31:30 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[25141]: 2024-03-30T13:31:30.735+0000 7f085a701000 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-03-30T13:31:30.911 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:31:30 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[25141]: 2024-03-30T13:31:30.908+0000 7f085a701000 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-03-30T13:31:32.087 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:31:31 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[25141]: 2024-03-30T13:31:31.823+0000 7f085a701000 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-03-30T13:31:32.461 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:31:32 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[25141]: 2024-03-30T13:31:32.111+0000 7f085a701000 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-03-30T13:31:32.461 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:31:32 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[25141]: 2024-03-30T13:31:32.203+0000 7f085a701000 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-03-30T13:31:32.461 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:31:32 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[25141]: 2024-03-30T13:31:32.350+0000 7f085a701000 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-03-30T13:31:33.417 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:31:33 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[25141]: [30/Mar/2024:13:31:33] ENGINE Bus STARTING 2024-03-30T13:31:33.417 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:31:33 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[25141]: [30/Mar/2024:13:31:33] ENGINE Serving on https://172.21.15.99:7150 2024-03-30T13:31:33.417 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:31:33 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[25141]: [30/Mar/2024:13:31:33] ENGINE Bus STARTED 2024-03-30T13:31:33.418 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:31:33 smithi099 ceph-mon[24912]: Active manager daemon y restarted 2024-03-30T13:31:33.418 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:31:33 smithi099 ceph-mon[24912]: Activating manager daemon y 2024-03-30T13:31:33.418 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:31:33 smithi099 ceph-mon[24912]: osdmap e3: 0 total, 0 up, 0 in 2024-03-30T13:31:33.418 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:31:33 smithi099 ceph-mon[24912]: mgrmap e10: y(active, starting, since 0.0553193s) 2024-03-30T13:31:33.418 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:31:33 smithi099 ceph-mon[24912]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-03-30T13:31:33.418 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:31:33 smithi099 ceph-mon[24912]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-03-30T13:31:33.419 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:31:33 smithi099 ceph-mon[24912]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-03-30T13:31:33.419 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:31:33 smithi099 ceph-mon[24912]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-03-30T13:31:33.419 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:31:33 smithi099 ceph-mon[24912]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-03-30T13:31:33.419 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:31:33 smithi099 ceph-mon[24912]: Manager daemon y is now available 2024-03-30T13:31:33.419 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:31:33 smithi099 ceph-mon[24912]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' 2024-03-30T13:31:33.419 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:31:33 smithi099 ceph-mon[24912]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:31:33.419 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:31:33 smithi099 ceph-mon[24912]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:31:33.419 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:31:33 smithi099 ceph-mon[24912]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-03-30T13:31:33.419 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:31:33 smithi099 ceph-mon[24912]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-03-30T13:31:33.419 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:31:33 smithi099 ceph-mon[24912]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' 2024-03-30T13:31:33.420 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph: { 2024-03-30T13:31:33.420 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph: "mgrmap_epoch": 11, 2024-03-30T13:31:33.420 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph: "initialized": true 2024-03-30T13:31:33.420 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph: } 2024-03-30T13:31:34.284 INFO:teuthology.orchestra.run.smithi099.stderr:mgr epoch 9 is available 2024-03-30T13:31:34.284 INFO:teuthology.orchestra.run.smithi099.stderr:Generating a dashboard self-signed certificate... 2024-03-30T13:31:34.536 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:31:34 smithi099 ceph-mon[24912]: [30/Mar/2024:13:31:33] ENGINE Bus STARTING 2024-03-30T13:31:34.536 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:31:34 smithi099 ceph-mon[24912]: [30/Mar/2024:13:31:33] ENGINE Serving on https://172.21.15.99:7150 2024-03-30T13:31:34.537 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:31:34 smithi099 ceph-mon[24912]: [30/Mar/2024:13:31:33] ENGINE Bus STARTED 2024-03-30T13:31:34.537 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:31:34 smithi099 ceph-mon[24912]: from='client.14154 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2024-03-30T13:31:34.537 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:31:34 smithi099 ceph-mon[24912]: mgrmap e11: y(active, since 1.05764s) 2024-03-30T13:31:34.537 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:31:34 smithi099 ceph-mon[24912]: from='client.14154 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2024-03-30T13:31:34.537 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:31:34 smithi099 ceph-mon[24912]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' 2024-03-30T13:31:34.537 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:31:34 smithi099 ceph-mon[24912]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd/host:smithi099", "name": "osd_memory_target"}]: dispatch 2024-03-30T13:31:34.537 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:31:34 smithi099 ceph-mon[24912]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' 2024-03-30T13:31:34.537 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:31:34 smithi099 ceph-mon[24912]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.agent.smithi099", "caps": []}]: dispatch 2024-03-30T13:31:35.054 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph: Self-signed certificate created 2024-03-30T13:31:35.670 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:31:35 smithi099 ceph-mon[24912]: Deploying daemon agent.smithi099 on smithi099 2024-03-30T13:31:35.670 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:31:35 smithi099 ceph-mon[24912]: mgrmap e12: y(active, since 2s) 2024-03-30T13:31:35.671 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:31:35 smithi099 ceph-mon[24912]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' 2024-03-30T13:31:35.671 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:31:35 smithi099 ceph-mon[24912]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' 2024-03-30T13:31:35.673 INFO:teuthology.orchestra.run.smithi099.stderr:Creating initial admin user... 2024-03-30T13:31:36.541 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph: {"username": "admin", "password": "$2b$12$m4SuNTioSK.nTD/AkoP4R.CJfcDOsMh9pnO2lb2GPVDDE40hNun0S", "roles": ["administrator"], "name": null, "email": null, "lastUpdate": 1711805496, "enabled": true, "pwdExpirationDate": null, "pwdUpdateRequired": true} 2024-03-30T13:31:36.836 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:31:36 smithi099 ceph-mon[24912]: from='client.14162 -' entity='client.admin' cmd=[{"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T13:31:37.296 INFO:teuthology.orchestra.run.smithi099.stderr:Fetching dashboard port number... 2024-03-30T13:31:37.550 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:31:37 smithi099 ceph-mon[24912]: from='client.14164 -' entity='client.admin' cmd=[{"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T13:31:37.550 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:31:37 smithi099 ceph-mon[24912]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' 2024-03-30T13:31:37.936 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph: 8443 2024-03-30T13:31:38.562 INFO:teuthology.orchestra.run.smithi099.stderr:systemctl: disabled 2024-03-30T13:31:38.569 INFO:teuthology.orchestra.run.smithi099.stderr:systemctl: inactive 2024-03-30T13:31:38.569 INFO:teuthology.orchestra.run.smithi099.stderr:firewalld.service is not enabled 2024-03-30T13:31:38.569 INFO:teuthology.orchestra.run.smithi099.stderr:Not possible to open ports <[8443]>. firewalld.service is not available 2024-03-30T13:31:38.572 INFO:teuthology.orchestra.run.smithi099.stderr:Ceph Dashboard is now available at: 2024-03-30T13:31:38.572 INFO:teuthology.orchestra.run.smithi099.stderr: 2024-03-30T13:31:38.572 INFO:teuthology.orchestra.run.smithi099.stderr: URL: https://smithi099.front.sepia.ceph.com:8443/ 2024-03-30T13:31:38.572 INFO:teuthology.orchestra.run.smithi099.stderr: User: admin 2024-03-30T13:31:38.572 INFO:teuthology.orchestra.run.smithi099.stderr: Password: d79eki67gp 2024-03-30T13:31:38.572 INFO:teuthology.orchestra.run.smithi099.stderr: 2024-03-30T13:31:38.572 INFO:teuthology.orchestra.run.smithi099.stderr:Enabling autotune for osd_memory_target 2024-03-30T13:31:38.837 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:31:38 smithi099 ceph-mon[24912]: from='client.? 172.21.15.99:0/2124435664' entity='client.admin' cmd=[{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]: dispatch 2024-03-30T13:31:40.065 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:31:40 smithi099 ceph-mon[24912]: mgrmap e13: y(active, since 6s) 2024-03-30T13:31:40.583 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/ceph: set mgr/dashboard/cluster/status 2024-03-30T13:31:41.216 INFO:teuthology.orchestra.run.smithi099.stderr:You can access the Ceph CLI with: 2024-03-30T13:31:41.216 INFO:teuthology.orchestra.run.smithi099.stderr: 2024-03-30T13:31:41.216 INFO:teuthology.orchestra.run.smithi099.stderr: sudo /home/ubuntu/cephtest/cephadm shell --fsid 98ebaeb8-ee99-11ee-b647-cb9ed24678a4 -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring 2024-03-30T13:31:41.216 INFO:teuthology.orchestra.run.smithi099.stderr: 2024-03-30T13:31:41.216 INFO:teuthology.orchestra.run.smithi099.stderr:Please consider enabling telemetry to help improve Ceph: 2024-03-30T13:31:41.216 INFO:teuthology.orchestra.run.smithi099.stderr: 2024-03-30T13:31:41.216 INFO:teuthology.orchestra.run.smithi099.stderr: ceph telemetry on 2024-03-30T13:31:41.216 INFO:teuthology.orchestra.run.smithi099.stderr: 2024-03-30T13:31:41.216 INFO:teuthology.orchestra.run.smithi099.stderr:For more information see: 2024-03-30T13:31:41.216 INFO:teuthology.orchestra.run.smithi099.stderr: 2024-03-30T13:31:41.216 INFO:teuthology.orchestra.run.smithi099.stderr: https://docs.ceph.com/docs/master/mgr/telemetry/ 2024-03-30T13:31:41.217 INFO:teuthology.orchestra.run.smithi099.stderr: 2024-03-30T13:31:41.217 INFO:teuthology.orchestra.run.smithi099.stderr:Bootstrap complete. 2024-03-30T13:31:41.251 INFO:tasks.cephadm:Fetching config... 2024-03-30T13:31:41.252 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2024-03-30T13:31:41.252 DEBUG:teuthology.orchestra.run.smithi099:> dd if=/etc/ceph/ceph.conf of=/dev/stdout 2024-03-30T13:31:41.267 INFO:tasks.cephadm:Fetching client.admin keyring... 2024-03-30T13:31:41.267 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2024-03-30T13:31:41.267 DEBUG:teuthology.orchestra.run.smithi099:> dd if=/etc/ceph/ceph.client.admin.keyring of=/dev/stdout 2024-03-30T13:31:41.324 INFO:tasks.cephadm:Fetching mon keyring... 2024-03-30T13:31:41.324 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2024-03-30T13:31:41.324 DEBUG:teuthology.orchestra.run.smithi099:> sudo dd if=/var/lib/ceph/98ebaeb8-ee99-11ee-b647-cb9ed24678a4/mon.a/keyring of=/dev/stdout 2024-03-30T13:31:41.448 INFO:tasks.cephadm:Fetching pub ssh key... 2024-03-30T13:31:41.448 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2024-03-30T13:31:41.448 DEBUG:teuthology.orchestra.run.smithi099:> dd if=/home/ubuntu/cephtest/ceph.pub of=/dev/stdout 2024-03-30T13:31:41.505 INFO:tasks.cephadm:Installing pub ssh key for root users... 2024-03-30T13:31:41.505 DEBUG:teuthology.orchestra.run.smithi099:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCguvGFvBUWC6RLc0nLmF1KqYh38EscMJcuRUtXhidcIFWEPVsTl6w44iOroE0s3BBrUN847w+LNFleQs/8LqdVRUa4goh7Lw/Qt3/akkKV/sMVqjOsfsUgQ+M16OlREC8ckfxcegf6ldcXcPijCWnnj3LTsG0tCWCNELHRpw4SUcemNzO+IOigghGGkkf2gbSiniO0LkzEu4ZL2Nxm5mODNLRPtYtfAgRvYYyMMwVJUMTe6cPapp2MKg6bWYnQ08G5cl0CprUNMWOo0wCrpc0TRf4zGxINeeOCsihFqM7rjv00RQXeRv53HI+nwZ0iTxpOytN2g1Yuvgls5fz5iYLxuC7bFy8cN0ZXHikXO0eVVQMOQ2wsFVDpBYSMI/EV5ZQXIcmxeeOD30noDrnN5XpDTlfQydyELgc8/MVcqcJYJb7zmXwpGwzYqw1ZbSKTJwLT/xXNLYyOIADyW2nFyieoooeR0RhCOO+ve97+Qv93mJAUD5O0eMgXem2byNatj8c= ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-03-30T13:31:41.650 INFO:teuthology.orchestra.run.smithi099.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCguvGFvBUWC6RLc0nLmF1KqYh38EscMJcuRUtXhidcIFWEPVsTl6w44iOroE0s3BBrUN847w+LNFleQs/8LqdVRUa4goh7Lw/Qt3/akkKV/sMVqjOsfsUgQ+M16OlREC8ckfxcegf6ldcXcPijCWnnj3LTsG0tCWCNELHRpw4SUcemNzO+IOigghGGkkf2gbSiniO0LkzEu4ZL2Nxm5mODNLRPtYtfAgRvYYyMMwVJUMTe6cPapp2MKg6bWYnQ08G5cl0CprUNMWOo0wCrpc0TRf4zGxINeeOCsihFqM7rjv00RQXeRv53HI+nwZ0iTxpOytN2g1Yuvgls5fz5iYLxuC7bFy8cN0ZXHikXO0eVVQMOQ2wsFVDpBYSMI/EV5ZQXIcmxeeOD30noDrnN5XpDTlfQydyELgc8/MVcqcJYJb7zmXwpGwzYqw1ZbSKTJwLT/xXNLYyOIADyW2nFyieoooeR0RhCOO+ve97+Qv93mJAUD5O0eMgXem2byNatj8c= ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4 2024-03-30T13:31:41.665 DEBUG:teuthology.orchestra.run.smithi181:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCguvGFvBUWC6RLc0nLmF1KqYh38EscMJcuRUtXhidcIFWEPVsTl6w44iOroE0s3BBrUN847w+LNFleQs/8LqdVRUa4goh7Lw/Qt3/akkKV/sMVqjOsfsUgQ+M16OlREC8ckfxcegf6ldcXcPijCWnnj3LTsG0tCWCNELHRpw4SUcemNzO+IOigghGGkkf2gbSiniO0LkzEu4ZL2Nxm5mODNLRPtYtfAgRvYYyMMwVJUMTe6cPapp2MKg6bWYnQ08G5cl0CprUNMWOo0wCrpc0TRf4zGxINeeOCsihFqM7rjv00RQXeRv53HI+nwZ0iTxpOytN2g1Yuvgls5fz5iYLxuC7bFy8cN0ZXHikXO0eVVQMOQ2wsFVDpBYSMI/EV5ZQXIcmxeeOD30noDrnN5XpDTlfQydyELgc8/MVcqcJYJb7zmXwpGwzYqw1ZbSKTJwLT/xXNLYyOIADyW2nFyieoooeR0RhCOO+ve97+Qv93mJAUD5O0eMgXem2byNatj8c= ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-03-30T13:31:41.713 INFO:teuthology.orchestra.run.smithi181.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCguvGFvBUWC6RLc0nLmF1KqYh38EscMJcuRUtXhidcIFWEPVsTl6w44iOroE0s3BBrUN847w+LNFleQs/8LqdVRUa4goh7Lw/Qt3/akkKV/sMVqjOsfsUgQ+M16OlREC8ckfxcegf6ldcXcPijCWnnj3LTsG0tCWCNELHRpw4SUcemNzO+IOigghGGkkf2gbSiniO0LkzEu4ZL2Nxm5mODNLRPtYtfAgRvYYyMMwVJUMTe6cPapp2MKg6bWYnQ08G5cl0CprUNMWOo0wCrpc0TRf4zGxINeeOCsihFqM7rjv00RQXeRv53HI+nwZ0iTxpOytN2g1Yuvgls5fz5iYLxuC7bFy8cN0ZXHikXO0eVVQMOQ2wsFVDpBYSMI/EV5ZQXIcmxeeOD30noDrnN5XpDTlfQydyELgc8/MVcqcJYJb7zmXwpGwzYqw1ZbSKTJwLT/xXNLYyOIADyW2nFyieoooeR0RhCOO+ve97+Qv93mJAUD5O0eMgXem2byNatj8c= ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4 2024-03-30T13:31:41.728 DEBUG:teuthology.orchestra.run.smithi099:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 98ebaeb8-ee99-11ee-b647-cb9ed24678a4 -- ceph config set mgr mgr/cephadm/allow_ptrace true 2024-03-30T13:31:41.754 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:31:41 smithi099 ceph-mon[24912]: from='client.? 172.21.15.99:0/3435305167' entity='client.admin' 2024-03-30T13:31:42.542 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:31:42 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[25141]: 172.21.15.99 - - [30/Mar/2024:13:31:42] "POST /data HTTP/1.1" 200 46 "" "Python-urllib/3.9" 2024-03-30T13:31:43.255 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:31:43 smithi099 ceph-mon[24912]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' 2024-03-30T13:31:43.255 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:31:43 smithi099 ceph-mon[24912]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:31:43.255 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:31:43 smithi099 ceph-mon[24912]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' 2024-03-30T13:31:43.255 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:31:43 smithi099 ceph-mon[24912]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:31:43.255 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:31:43 smithi099 ceph-mon[24912]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' 2024-03-30T13:31:43.255 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:31:43 smithi099 ceph-mon[24912]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' 2024-03-30T13:31:43.255 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:31:43 smithi099 ceph-mon[24912]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' 2024-03-30T13:31:45.658 INFO:tasks.cephadm:Distributing conf and client.admin keyring to all hosts + 0755 2024-03-30T13:31:45.659 DEBUG:teuthology.orchestra.run.smithi099:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 98ebaeb8-ee99-11ee-b647-cb9ed24678a4 -- ceph orch client-keyring set client.admin '*' --mode 0755 2024-03-30T13:31:45.954 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:31:45 smithi099 ceph-mon[24912]: from='client.? 172.21.15.99:0/702682772' entity='client.admin' 2024-03-30T13:31:45.955 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:31:45 smithi099 ceph-mon[24912]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:31:45.955 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:31:45 smithi099 ceph-mon[24912]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' 2024-03-30T13:31:48.173 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:31:47 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[25141]: 172.21.15.99 - - [30/Mar/2024:13:31:47] "POST /data HTTP/1.1" 200 46 "" "Python-urllib/3.9" 2024-03-30T13:31:48.426 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:31:48 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[25141]: 172.21.15.99 - - [30/Mar/2024:13:31:48] "POST /data HTTP/1.1" 200 46 "" "Python-urllib/3.9" 2024-03-30T13:31:48.953 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi181 2024-03-30T13:31:48.954 DEBUG:teuthology.orchestra.run.smithi181:> set -ex 2024-03-30T13:31:48.954 DEBUG:teuthology.orchestra.run.smithi181:> dd of=/etc/ceph/ceph.conf 2024-03-30T13:31:48.972 DEBUG:teuthology.orchestra.run.smithi181:> set -ex 2024-03-30T13:31:48.972 DEBUG:teuthology.orchestra.run.smithi181:> dd of=/etc/ceph/ceph.client.admin.keyring 2024-03-30T13:31:49.029 INFO:tasks.cephadm:Adding host smithi181 to orchestrator... 2024-03-30T13:31:49.029 DEBUG:teuthology.orchestra.run.smithi099:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 98ebaeb8-ee99-11ee-b647-cb9ed24678a4 -- ceph orch host add smithi181 2024-03-30T13:31:49.333 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:31:48 smithi099 ceph-mon[24912]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' 2024-03-30T13:31:49.333 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:31:48 smithi099 ceph-mon[24912]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' 2024-03-30T13:31:49.333 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:31:48 smithi099 ceph-mon[24912]: from='client.14174 -' entity='client.admin' cmd=[{"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T13:31:49.333 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:31:48 smithi099 ceph-mon[24912]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' 2024-03-30T13:31:49.333 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:31:48 smithi099 ceph-mon[24912]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:31:49.333 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:31:48 smithi099 ceph-mon[24912]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:31:49.333 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:31:48 smithi099 ceph-mon[24912]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:31:49.333 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:31:48 smithi099 ceph-mon[24912]: Updating smithi099:/etc/ceph/ceph.conf 2024-03-30T13:31:49.333 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:31:48 smithi099 ceph-mon[24912]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' 2024-03-30T13:31:49.334 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:31:48 smithi099 ceph-mon[24912]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' 2024-03-30T13:31:49.334 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:31:48 smithi099 ceph-mon[24912]: Updating smithi099:/etc/ceph/ceph.client.admin.keyring 2024-03-30T13:31:49.334 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:31:48 smithi099 ceph-mon[24912]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' 2024-03-30T13:31:49.334 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:31:48 smithi099 ceph-mon[24912]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' 2024-03-30T13:31:51.838 INFO:teuthology.orchestra.run.smithi099.stdout:Added host 'smithi181' with addr '172.21.15.181' 2024-03-30T13:31:52.087 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:31:51 smithi099 ceph-mon[24912]: from='client.14176 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi181", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T13:31:52.087 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:31:51 smithi099 ceph-mon[24912]: Deploying cephadm binary to smithi181 2024-03-30T13:31:52.357 DEBUG:teuthology.orchestra.run.smithi099:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 98ebaeb8-ee99-11ee-b647-cb9ed24678a4 -- ceph orch host ls --format=json 2024-03-30T13:31:52.995 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:31:52 smithi099 ceph-mon[24912]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' 2024-03-30T13:31:52.995 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:31:52 smithi099 ceph-mon[24912]: Added host smithi181 2024-03-30T13:31:52.995 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:31:52 smithi099 ceph-mon[24912]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:31:52.995 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:31:52 smithi099 ceph-mon[24912]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:31:52.995 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:31:52 smithi099 ceph-mon[24912]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:31:52.995 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:31:52 smithi099 ceph-mon[24912]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' 2024-03-30T13:31:52.995 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:31:52 smithi099 ceph-mon[24912]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-30T13:31:52.995 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:31:52 smithi099 ceph-mon[24912]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' 2024-03-30T13:31:52.995 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:31:52 smithi099 ceph-mon[24912]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' 2024-03-30T13:31:52.995 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:31:52 smithi099 ceph-mon[24912]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd/host:smithi181", "name": "osd_memory_target"}]: dispatch 2024-03-30T13:31:52.995 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:31:52 smithi099 ceph-mon[24912]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' 2024-03-30T13:31:52.996 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:31:52 smithi099 ceph-mon[24912]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.agent.smithi181", "caps": []}]: dispatch 2024-03-30T13:31:52.996 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:31:52 smithi099 ceph-mon[24912]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd='[{"prefix": "auth get-or-create", "entity": "client.agent.smithi181", "caps": []}]': finished 2024-03-30T13:31:54.272 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-03-30T13:31:54.272 INFO:teuthology.orchestra.run.smithi099.stdout:[{"addr": "172.21.15.99", "hostname": "smithi099", "labels": [], "status": ""}, {"addr": "172.21.15.181", "hostname": "smithi181", "labels": [], "status": ""}] 2024-03-30T13:31:54.580 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:31:54 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[25141]: 172.21.15.181 - - [30/Mar/2024:13:31:54] "POST /data HTTP/1.1" 200 46 "" "Python-urllib/3.9" 2024-03-30T13:31:54.580 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:31:54 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[25141]: 172.21.15.181 - - [30/Mar/2024:13:31:54] "POST /data HTTP/1.1" 200 46 "" "Python-urllib/3.9" 2024-03-30T13:31:54.580 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:31:54 smithi099 ceph-mon[24912]: Deploying daemon agent.smithi181 on smithi181 2024-03-30T13:31:54.580 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:31:54 smithi099 ceph-mon[24912]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' 2024-03-30T13:31:54.580 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:31:54 smithi099 ceph-mon[24912]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:31:54.580 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:31:54 smithi099 ceph-mon[24912]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:31:54.580 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:31:54 smithi099 ceph-mon[24912]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:31:54.580 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:31:54 smithi099 ceph-mon[24912]: Updating smithi181:/etc/ceph/ceph.conf 2024-03-30T13:31:54.581 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:31:54 smithi099 ceph-mon[24912]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' 2024-03-30T13:31:54.581 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:31:54 smithi099 ceph-mon[24912]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' 2024-03-30T13:31:54.581 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:31:54 smithi099 ceph-mon[24912]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:31:54.581 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:31:54 smithi099 ceph-mon[24912]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:31:54.581 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:31:54 smithi099 ceph-mon[24912]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:31:54.581 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:31:54 smithi099 ceph-mon[24912]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' 2024-03-30T13:31:54.581 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:31:54 smithi099 ceph-mon[24912]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' 2024-03-30T13:31:54.581 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:31:54 smithi099 ceph-mon[24912]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' 2024-03-30T13:31:54.581 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:31:54 smithi099 ceph-mon[24912]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' 2024-03-30T13:31:54.911 INFO:tasks.cephadm:Setting crush tunables to default 2024-03-30T13:31:54.911 DEBUG:teuthology.orchestra.run.smithi099:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 98ebaeb8-ee99-11ee-b647-cb9ed24678a4 -- ceph osd crush tunables default 2024-03-30T13:31:55.482 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:31:55 smithi099 ceph-mon[24912]: Updating smithi181:/etc/ceph/ceph.client.admin.keyring 2024-03-30T13:31:55.482 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:31:55 smithi099 ceph-mon[24912]: from='client.14178 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-03-30T13:31:55.482 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:31:55 smithi099 ceph-mon[24912]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-30T13:31:56.587 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:31:56 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[25141]: 172.21.15.181 - - [30/Mar/2024:13:31:56] "POST /data HTTP/1.1" 200 46 "" "Python-urllib/3.9" 2024-03-30T13:31:57.280 INFO:teuthology.orchestra.run.smithi099.stderr:adjusted tunables profile to default 2024-03-30T13:31:57.575 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:31:57 smithi099 ceph-mon[24912]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' 2024-03-30T13:31:57.575 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:31:57 smithi099 ceph-mon[24912]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' 2024-03-30T13:31:57.575 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:31:57 smithi099 ceph-mon[24912]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-30T13:31:57.575 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:31:57 smithi099 ceph-mon[24912]: from='client.? 172.21.15.99:0/3981914668' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2024-03-30T13:31:57.837 INFO:tasks.cephadm:Adding mon.a on smithi099 2024-03-30T13:31:57.837 INFO:tasks.cephadm:Adding mon.c on smithi099 2024-03-30T13:31:57.837 INFO:tasks.cephadm:Adding mon.b on smithi181 2024-03-30T13:31:57.838 DEBUG:teuthology.orchestra.run.smithi181:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 98ebaeb8-ee99-11ee-b647-cb9ed24678a4 -- ceph orch apply mon '3;smithi099:172.21.15.99=a;smithi099:[v2:172.21.15.99:3301,v1:172.21.15.99:6790]=c;smithi181:172.21.15.181=b' 2024-03-30T13:31:58.587 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:31:58 smithi099 ceph-mon[24912]: from='client.? 172.21.15.99:0/3981914668' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-03-30T13:31:58.587 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:31:58 smithi099 ceph-mon[24912]: osdmap e4: 0 total, 0 up, 0 in 2024-03-30T13:31:58.587 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:31:58 smithi099 ceph-mon[24912]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' 2024-03-30T13:31:59.580 INFO:teuthology.orchestra.run.smithi181.stdout:Scheduled mon update... 2024-03-30T13:31:59.587 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:31:59 smithi099 ceph-mon[24912]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-30T13:32:00.050 DEBUG:teuthology.orchestra.run.smithi099:mon.c> sudo journalctl -f -n 0 -u ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4@mon.c.service 2024-03-30T13:32:00.052 DEBUG:teuthology.orchestra.run.smithi181:mon.b> sudo journalctl -f -n 0 -u ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4@mon.b.service 2024-03-30T13:32:00.055 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-03-30T13:32:00.055 DEBUG:teuthology.orchestra.run.smithi181:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 98ebaeb8-ee99-11ee-b647-cb9ed24678a4 -- ceph mon dump -f json 2024-03-30T13:32:00.837 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:32:00 smithi099 ceph-mon[24912]: from='client.14182 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi099:172.21.15.99=a;smithi099:[v2:172.21.15.99:3301,v1:172.21.15.99:6790]=c;smithi181:172.21.15.181=b", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T13:32:00.837 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:32:00 smithi099 ceph-mon[24912]: Saving service mon spec with placement smithi099:172.21.15.99=a;smithi099:[v2:172.21.15.99:3301,v1:172.21.15.99:6790]=c;smithi181:172.21.15.181=b;count:3 2024-03-30T13:32:00.837 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:32:00 smithi099 ceph-mon[24912]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' 2024-03-30T13:32:00.837 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:32:00 smithi099 ceph-mon[24912]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:32:00.837 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:32:00 smithi099 ceph-mon[24912]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:32:00.837 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:32:00 smithi099 ceph-mon[24912]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:32:00.838 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:32:00 smithi099 ceph-mon[24912]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' 2024-03-30T13:32:00.838 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:32:00 smithi099 ceph-mon[24912]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-03-30T13:32:00.838 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:32:00 smithi099 ceph-mon[24912]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:32:00.838 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:32:00 smithi099 ceph-mon[24912]: Deploying daemon mon.c on smithi099 2024-03-30T13:32:00.838 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:32:00 smithi099 ceph-mon[24912]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-30T13:32:01.691 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-03-30T13:32:01.691 INFO:teuthology.orchestra.run.smithi181.stdout:{"epoch":1,"fsid":"98ebaeb8-ee99-11ee-b647-cb9ed24678a4","modified":"2024-03-30T13:30:34.451427Z","created":"2024-03-30T13:30:34.451427Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:3300","nonce":0},{"type":"v1","addr":"172.21.15.99:6789","nonce":0}]},"addr":"172.21.15.99:6789/0","public_addr":"172.21.15.99:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-03-30T13:32:01.693 INFO:teuthology.orchestra.run.smithi181.stderr:dumped monmap epoch 1 2024-03-30T13:32:02.065 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:32:01 smithi099 ceph-mon[24912]: from='client.? 172.21.15.181:0/3757768558' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-03-30T13:32:02.587 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:32:02 smithi099 systemd[1]: Starting Ceph mon.c for 98ebaeb8-ee99-11ee-b647-cb9ed24678a4... 2024-03-30T13:32:02.888 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:32:02 smithi099 ceph-mon[24912]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-30T13:32:02.888 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:32:02 smithi099 podman[29672]: 2024-03-30 13:32:02.539782203 +0000 UTC m=+0.017866427 image pull e1d6a67b021eb077ee22bf650f1a9fb1980a2cf5c36bdb9cba9eac6de8f702d9 quay.io/ceph/ceph@sha256:12a0a4f43413fd97a14a3d47a3451b2d2df50020835bb93db666209f3f77617a 2024-03-30T13:32:02.888 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:32:02 smithi099 podman[29672]: 2024-03-30 13:32:02.673464258 +0000 UTC m=+0.151548521 container create 0f1e989177183faf5f42c21b944f909c3536dc17a980b457fe8169be9f7f6a98 (image=quay.io/ceph/ceph@sha256:12a0a4f43413fd97a14a3d47a3451b2d2df50020835bb93db666209f3f77617a, name=ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mon-c, build-date=2022-05-03T08:36:31.336870, url=https://access.redhat.com/containers/#/registry.access.redhat.com/ubi8/images/8.6-754, summary=Provides a CentOS Stream container based on the Red Hat Universal Base Image, maintainer=Guillaume Abrioux , com.redhat.license_terms=https://centos.org/legal/licensing-policy/, vcs-type=git, CEPH_POINT_RELEASE=-17.2.0, description=CentOS Stream is a continuously delivered distro that tracks just ahead of Red Hat Enterprise Linux development. This image takes the Red Hat UBI and layers on content from CentOS Stream, GIT_REPO=https://github.com/ceph/ceph-container.git, name=centos-stream, release=754, GIT_BRANCH=HEAD, GIT_CLEAN=True, vcs-ref=f1ee6e37554363ec55e0035aba1a693d3627fdeb, io.openshift.tags=base centos centos-stream, io.buildah.version=1.19.8, version=8, architecture=x86_64, io.k8s.display-name=CentOS Stream 8, RELEASE=HEAD, io.k8s.description=The Universal Base Image is designed and engineered to be the base layer for all of your containerized applications, middleware and utilities. This base image is freely redistributable, but Red Hat only supports Red Hat technologies through subscriptions for Red Hat products. This image is maintained by Red Hat and updated regularly., ceph=True, com.redhat.build-host=cpt-1002.osbs.prod.upshift.rdu2.redhat.com, distribution-scope=public, io.openshift.expose-services=, vendor=Red Hat, Inc., com.redhat.component=centos-stream-container, GIT_COMMIT=b613db0f44179c0940781c1c7fe04e1acb7093ac) 2024-03-30T13:32:02.888 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:32:02 smithi099 podman[29672]: 2024-03-30 13:32:02.884070362 +0000 UTC m=+0.362154582 container init 0f1e989177183faf5f42c21b944f909c3536dc17a980b457fe8169be9f7f6a98 (image=quay.io/ceph/ceph@sha256:12a0a4f43413fd97a14a3d47a3451b2d2df50020835bb93db666209f3f77617a, name=ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mon-c, maintainer=Guillaume Abrioux , com.redhat.build-host=cpt-1002.osbs.prod.upshift.rdu2.redhat.com, io.k8s.display-name=CentOS Stream 8, ceph=True, io.openshift.expose-services=, vcs-type=git, io.k8s.description=The Universal Base Image is designed and engineered to be the base layer for all of your containerized applications, middleware and utilities. This base image is freely redistributable, but Red Hat only supports Red Hat technologies through subscriptions for Red Hat products. This image is maintained by Red Hat and updated regularly., com.redhat.license_terms=https://centos.org/legal/licensing-policy/, version=8, com.redhat.component=centos-stream-container, build-date=2022-05-03T08:36:31.336870, GIT_BRANCH=HEAD, description=CentOS Stream is a continuously delivered distro that tracks just ahead of Red Hat Enterprise Linux development. This image takes the Red Hat UBI and layers on content from CentOS Stream, release=754, name=centos-stream, GIT_CLEAN=True, vcs-ref=f1ee6e37554363ec55e0035aba1a693d3627fdeb, RELEASE=HEAD, GIT_REPO=https://github.com/ceph/ceph-container.git, url=https://access.redhat.com/containers/#/registry.access.redhat.com/ubi8/images/8.6-754, io.buildah.version=1.19.8, GIT_COMMIT=b613db0f44179c0940781c1c7fe04e1acb7093ac, architecture=x86_64, CEPH_POINT_RELEASE=-17.2.0, summary=Provides a CentOS Stream container based on the Red Hat Universal Base Image, distribution-scope=public, io.openshift.tags=base centos centos-stream, vendor=Red Hat, Inc.) 2024-03-30T13:32:02.888 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:32:02 smithi099 podman[29672]: 2024-03-30 13:32:02.887376397 +0000 UTC m=+0.365460615 container start 0f1e989177183faf5f42c21b944f909c3536dc17a980b457fe8169be9f7f6a98 (image=quay.io/ceph/ceph@sha256:12a0a4f43413fd97a14a3d47a3451b2d2df50020835bb93db666209f3f77617a, name=ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mon-c, com.redhat.component=centos-stream-container, name=centos-stream, vcs-type=git, description=CentOS Stream is a continuously delivered distro that tracks just ahead of Red Hat Enterprise Linux development. This image takes the Red Hat UBI and layers on content from CentOS Stream, version=8, RELEASE=HEAD, io.openshift.tags=base centos centos-stream, summary=Provides a CentOS Stream container based on the Red Hat Universal Base Image, vcs-ref=f1ee6e37554363ec55e0035aba1a693d3627fdeb, io.openshift.expose-services=, url=https://access.redhat.com/containers/#/registry.access.redhat.com/ubi8/images/8.6-754, GIT_BRANCH=HEAD, GIT_COMMIT=b613db0f44179c0940781c1c7fe04e1acb7093ac, vendor=Red Hat, Inc., architecture=x86_64, GIT_CLEAN=True, release=754, io.k8s.description=The Universal Base Image is designed and engineered to be the base layer for all of your containerized applications, middleware and utilities. This base image is freely redistributable, but Red Hat only supports Red Hat technologies through subscriptions for Red Hat products. This image is maintained by Red Hat and updated regularly., ceph=True, maintainer=Guillaume Abrioux , com.redhat.build-host=cpt-1002.osbs.prod.upshift.rdu2.redhat.com, io.buildah.version=1.19.8, build-date=2022-05-03T08:36:31.336870, distribution-scope=public, io.k8s.display-name=CentOS Stream 8, CEPH_POINT_RELEASE=-17.2.0, GIT_REPO=https://github.com/ceph/ceph-container.git, com.redhat.license_terms=https://centos.org/legal/licensing-policy/) 2024-03-30T13:32:03.256 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-03-30T13:32:03.256 DEBUG:teuthology.orchestra.run.smithi181:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 98ebaeb8-ee99-11ee-b647-cb9ed24678a4 -- ceph mon dump -f json 2024-03-30T13:32:03.337 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:32:02 smithi099 ceph-mon[29691]: set uid:gid to 167:167 (ceph:ceph) 2024-03-30T13:32:03.337 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:32:02 smithi099 ceph-mon[29691]: ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable), process ceph-mon, pid 2 2024-03-30T13:32:03.337 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:32:02 smithi099 ceph-mon[29691]: pidfile_write: ignore empty --pid-file 2024-03-30T13:32:03.337 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:32:02 smithi099 ceph-mon[29691]: load: jerasure load: lrc 2024-03-30T13:32:03.338 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:32:02 smithi099 ceph-mon[29691]: rocksdb: RocksDB version: 6.15.5 2024-03-30T13:32:03.338 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:32:02 smithi099 ceph-mon[29691]: rocksdb: Git sha rocksdb_build_git_sha:@0@ 2024-03-30T13:32:03.338 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:32:02 smithi099 ceph-mon[29691]: rocksdb: Compile date Apr 18 2022 2024-03-30T13:32:03.338 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:32:02 smithi099 ceph-mon[29691]: rocksdb: DB SUMMARY 2024-03-30T13:32:03.338 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:32:02 smithi099 ceph-mon[29691]: rocksdb: DB Session ID: RNTXDY93J7BLAC4GO6FG 2024-03-30T13:32:03.338 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:32:02 smithi099 ceph-mon[29691]: rocksdb: CURRENT file: CURRENT 2024-03-30T13:32:03.338 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:32:02 smithi099 ceph-mon[29691]: rocksdb: IDENTITY file: IDENTITY 2024-03-30T13:32:03.338 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:32:02 smithi099 ceph-mon[29691]: rocksdb: MANIFEST file: MANIFEST-000003 size: 57 Bytes 2024-03-30T13:32:03.338 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:32:02 smithi099 ceph-mon[29691]: rocksdb: SST files in /var/lib/ceph/mon/ceph-c/store.db dir, Total Num: 0, files: 2024-03-30T13:32:03.338 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:32:02 smithi099 ceph-mon[29691]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-c/store.db: 000004.log size: 511 ; 2024-03-30T13:32:03.338 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:32:02 smithi099 ceph-mon[29691]: rocksdb: Options.error_if_exists: 0 2024-03-30T13:32:03.338 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:32:02 smithi099 ceph-mon[29691]: rocksdb: Options.create_if_missing: 0 2024-03-30T13:32:03.338 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:32:02 smithi099 ceph-mon[29691]: rocksdb: Options.paranoid_checks: 1 2024-03-30T13:32:03.339 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:32:02 smithi099 ceph-mon[29691]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-03-30T13:32:03.339 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:32:02 smithi099 ceph-mon[29691]: rocksdb: Options.env: 0x557d6c0c6860 2024-03-30T13:32:03.339 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:32:02 smithi099 ceph-mon[29691]: rocksdb: Options.fs: Posix File System 2024-03-30T13:32:03.339 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:32:02 smithi099 ceph-mon[29691]: rocksdb: Options.info_log: 0x557d6e101dc0 2024-03-30T13:32:03.339 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:32:02 smithi099 ceph-mon[29691]: rocksdb: Options.max_file_opening_threads: 16 2024-03-30T13:32:03.339 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:32:02 smithi099 ceph-mon[29691]: rocksdb: Options.statistics: (nil) 2024-03-30T13:32:03.339 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:32:02 smithi099 ceph-mon[29691]: rocksdb: Options.use_fsync: 0 2024-03-30T13:32:03.339 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:32:02 smithi099 ceph-mon[29691]: rocksdb: Options.max_log_file_size: 0 2024-03-30T13:32:03.339 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:32:02 smithi099 ceph-mon[29691]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-03-30T13:32:03.339 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:32:02 smithi099 ceph-mon[29691]: rocksdb: Options.log_file_time_to_roll: 0 2024-03-30T13:32:03.339 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:32:02 smithi099 ceph-mon[29691]: rocksdb: Options.keep_log_file_num: 1000 2024-03-30T13:32:03.339 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:32:02 smithi099 ceph-mon[29691]: rocksdb: Options.recycle_log_file_num: 0 2024-03-30T13:32:03.339 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:32:02 smithi099 ceph-mon[29691]: rocksdb: Options.allow_fallocate: 1 2024-03-30T13:32:03.339 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:32:02 smithi099 ceph-mon[29691]: rocksdb: Options.allow_mmap_reads: 0 2024-03-30T13:32:03.340 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:32:02 smithi099 ceph-mon[29691]: rocksdb: Options.allow_mmap_writes: 0 2024-03-30T13:32:03.340 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:32:02 smithi099 ceph-mon[29691]: rocksdb: Options.use_direct_reads: 0 2024-03-30T13:32:03.340 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:32:02 smithi099 ceph-mon[29691]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-03-30T13:32:03.340 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:32:02 smithi099 ceph-mon[29691]: rocksdb: Options.create_missing_column_families: 0 2024-03-30T13:32:03.340 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:32:02 smithi099 ceph-mon[29691]: rocksdb: Options.db_log_dir: 2024-03-30T13:32:03.340 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:32:02 smithi099 ceph-mon[29691]: rocksdb: Options.wal_dir: /var/lib/ceph/mon/ceph-c/store.db 2024-03-30T13:32:03.340 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:32:02 smithi099 ceph-mon[29691]: rocksdb: Options.table_cache_numshardbits: 6 2024-03-30T13:32:03.340 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:32:02 smithi099 ceph-mon[29691]: rocksdb: Options.WAL_ttl_seconds: 0 2024-03-30T13:32:03.340 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:32:02 smithi099 ceph-mon[29691]: rocksdb: Options.WAL_size_limit_MB: 0 2024-03-30T13:32:03.341 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:32:02 smithi099 ceph-mon[29691]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-03-30T13:32:03.341 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:32:02 smithi099 ceph-mon[29691]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-03-30T13:32:03.341 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:32:02 smithi099 ceph-mon[29691]: rocksdb: Options.is_fd_close_on_exec: 1 2024-03-30T13:32:03.342 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:32:02 smithi099 ceph-mon[29691]: rocksdb: Options.advise_random_on_open: 1 2024-03-30T13:32:03.342 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:32:02 smithi099 ceph-mon[29691]: rocksdb: Options.db_write_buffer_size: 0 2024-03-30T13:32:03.342 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:32:02 smithi099 ceph-mon[29691]: rocksdb: Options.write_buffer_manager: 0x557d6e1f22d0 2024-03-30T13:32:03.342 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:32:02 smithi099 ceph-mon[29691]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-03-30T13:32:03.342 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:32:02 smithi099 ceph-mon[29691]: rocksdb: Options.new_table_reader_for_compaction_inputs: 0 2024-03-30T13:32:03.342 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:32:02 smithi099 ceph-mon[29691]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-03-30T13:32:03.342 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:32:02 smithi099 ceph-mon[29691]: rocksdb: Options.use_adaptive_mutex: 0 2024-03-30T13:32:03.342 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:32:02 smithi099 ceph-mon[29691]: rocksdb: Options.rate_limiter: (nil) 2024-03-30T13:32:03.342 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:32:02 smithi099 ceph-mon[29691]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-03-30T13:32:03.342 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:32:02 smithi099 ceph-mon[29691]: rocksdb: Options.wal_recovery_mode: 2 2024-03-30T13:32:03.342 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:32:02 smithi099 ceph-mon[29691]: rocksdb: Options.enable_thread_tracking: 0 2024-03-30T13:32:03.342 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:32:02 smithi099 ceph-mon[29691]: rocksdb: Options.enable_pipelined_write: 0 2024-03-30T13:32:03.342 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:32:02 smithi099 ceph-mon[29691]: rocksdb: Options.unordered_write: 0 2024-03-30T13:32:03.343 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:32:02 smithi099 ceph-mon[29691]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-03-30T13:32:03.343 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:32:02 smithi099 ceph-mon[29691]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-03-30T13:32:03.343 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:32:02 smithi099 ceph-mon[29691]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-03-30T13:32:03.343 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:32:02 smithi099 ceph-mon[29691]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-03-30T13:32:03.343 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:32:02 smithi099 ceph-mon[29691]: rocksdb: Options.row_cache: None 2024-03-30T13:32:03.343 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:32:02 smithi099 ceph-mon[29691]: rocksdb: Options.wal_filter: None 2024-03-30T13:32:03.343 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:32:02 smithi099 ceph-mon[29691]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-03-30T13:32:03.343 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:32:02 smithi099 ceph-mon[29691]: rocksdb: Options.allow_ingest_behind: 0 2024-03-30T13:32:03.343 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:32:02 smithi099 ceph-mon[29691]: rocksdb: Options.preserve_deletes: 0 2024-03-30T13:32:03.343 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:32:02 smithi099 ceph-mon[29691]: rocksdb: Options.two_write_queues: 0 2024-03-30T13:32:03.343 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:32:02 smithi099 ceph-mon[29691]: rocksdb: Options.manual_wal_flush: 0 2024-03-30T13:32:03.343 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:32:02 smithi099 ceph-mon[29691]: rocksdb: Options.atomic_flush: 0 2024-03-30T13:32:03.343 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:32:02 smithi099 ceph-mon[29691]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-03-30T13:32:03.344 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:32:02 smithi099 ceph-mon[29691]: rocksdb: Options.persist_stats_to_disk: 0 2024-03-30T13:32:03.344 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:32:02 smithi099 ceph-mon[29691]: rocksdb: Options.write_dbid_to_manifest: 0 2024-03-30T13:32:03.344 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:32:02 smithi099 ceph-mon[29691]: rocksdb: Options.log_readahead_size: 0 2024-03-30T13:32:03.344 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:32:02 smithi099 ceph-mon[29691]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-03-30T13:32:03.344 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:32:02 smithi099 ceph-mon[29691]: rocksdb: Options.best_efforts_recovery: 0 2024-03-30T13:32:03.344 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:32:02 smithi099 ceph-mon[29691]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-03-30T13:32:03.344 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:32:02 smithi099 ceph-mon[29691]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-03-30T13:32:03.344 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:32:02 smithi099 ceph-mon[29691]: rocksdb: Options.allow_data_in_errors: 0 2024-03-30T13:32:03.344 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:32:02 smithi099 ceph-mon[29691]: rocksdb: Options.db_host_id: __hostname__ 2024-03-30T13:32:03.344 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:32:02 smithi099 ceph-mon[29691]: rocksdb: Options.max_background_jobs: 2 2024-03-30T13:32:03.344 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:32:02 smithi099 ceph-mon[29691]: rocksdb: Options.max_background_compactions: -1 2024-03-30T13:32:03.344 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:32:02 smithi099 ceph-mon[29691]: rocksdb: Options.max_subcompactions: 1 2024-03-30T13:32:03.344 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:32:02 smithi099 ceph-mon[29691]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-03-30T13:32:03.344 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:32:02 smithi099 ceph-mon[29691]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-03-30T13:32:03.344 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:32:02 smithi099 ceph-mon[29691]: rocksdb: Options.delayed_write_rate : 16777216 2024-03-30T13:32:03.344 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:32:02 smithi099 ceph-mon[29691]: rocksdb: Options.max_total_wal_size: 0 2024-03-30T13:32:03.345 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:32:02 smithi099 ceph-mon[29691]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-03-30T13:32:03.345 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:32:02 smithi099 ceph-mon[29691]: rocksdb: Options.stats_dump_period_sec: 600 2024-03-30T13:32:03.345 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:32:02 smithi099 ceph-mon[29691]: rocksdb: Options.stats_persist_period_sec: 600 2024-03-30T13:32:03.345 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:32:02 smithi099 ceph-mon[29691]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-03-30T13:32:03.345 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:32:02 smithi099 ceph-mon[29691]: rocksdb: Options.max_open_files: -1 2024-03-30T13:32:03.345 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:32:02 smithi099 ceph-mon[29691]: rocksdb: Options.bytes_per_sync: 0 2024-03-30T13:32:03.345 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:32:02 smithi099 ceph-mon[29691]: rocksdb: Options.wal_bytes_per_sync: 0 2024-03-30T13:32:03.345 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:32:02 smithi099 ceph-mon[29691]: rocksdb: Options.strict_bytes_per_sync: 0 2024-03-30T13:32:03.345 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:32:02 smithi099 ceph-mon[29691]: rocksdb: Options.compaction_readahead_size: 0 2024-03-30T13:32:03.345 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:32:02 smithi099 ceph-mon[29691]: rocksdb: Options.max_background_flushes: -1 2024-03-30T13:32:03.345 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:32:02 smithi099 ceph-mon[29691]: rocksdb: Compression algorithms supported: 2024-03-30T13:32:03.345 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:32:02 smithi099 ceph-mon[29691]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-03-30T13:32:03.345 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:32:02 smithi099 ceph-mon[29691]: rocksdb: kZSTD supported: 0 2024-03-30T13:32:03.345 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:32:02 smithi099 ceph-mon[29691]: rocksdb: kXpressCompression supported: 0 2024-03-30T13:32:03.346 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:32:02 smithi099 ceph-mon[29691]: rocksdb: kLZ4HCCompression supported: 1 2024-03-30T13:32:03.346 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:32:02 smithi099 ceph-mon[29691]: rocksdb: kLZ4Compression supported: 1 2024-03-30T13:32:03.346 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:32:02 smithi099 ceph-mon[29691]: rocksdb: kBZip2Compression supported: 0 2024-03-30T13:32:03.346 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:32:02 smithi099 ceph-mon[29691]: rocksdb: kZlibCompression supported: 1 2024-03-30T13:32:03.346 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:32:02 smithi099 ceph-mon[29691]: rocksdb: kSnappyCompression supported: 1 2024-03-30T13:32:03.346 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:32:02 smithi099 ceph-mon[29691]: rocksdb: Fast CRC32 supported: Supported on x86 2024-03-30T13:32:03.346 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:32:02 smithi099 ceph-mon[29691]: rocksdb: [db/version_set.cc:4725] Recovering from manifest file: /var/lib/ceph/mon/ceph-c/store.db/MANIFEST-000003 2024-03-30T13:32:03.346 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:32:02 smithi099 ceph-mon[29691]: rocksdb: [db/column_family.cc:597] --------------- Options for column family [default]: 2024-03-30T13:32:03.346 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:32:02 smithi099 ceph-mon[29691]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-03-30T13:32:03.346 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:32:02 smithi099 ceph-mon[29691]: rocksdb: Options.merge_operator: 2024-03-30T13:32:03.346 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:32:02 smithi099 ceph-mon[29691]: rocksdb: Options.compaction_filter: None 2024-03-30T13:32:03.346 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:32:02 smithi099 ceph-mon[29691]: rocksdb: Options.compaction_filter_factory: None 2024-03-30T13:32:03.346 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:32:02 smithi099 ceph-mon[29691]: rocksdb: Options.sst_partitioner_factory: None 2024-03-30T13:32:03.346 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:32:02 smithi099 ceph-mon[29691]: rocksdb: Options.memtable_factory: SkipListFactory 2024-03-30T13:32:03.347 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:32:02 smithi099 ceph-mon[29691]: rocksdb: Options.table_factory: BlockBasedTable 2024-03-30T13:32:03.347 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:32:02 smithi099 ceph-mon[29691]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x557d6e0cdd00) 2024-03-30T13:32:03.347 INFO:journalctl@ceph.mon.c.smithi099.stdout: cache_index_and_filter_blocks: 1 2024-03-30T13:32:03.347 INFO:journalctl@ceph.mon.c.smithi099.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-03-30T13:32:03.347 INFO:journalctl@ceph.mon.c.smithi099.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-03-30T13:32:03.347 INFO:journalctl@ceph.mon.c.smithi099.stdout: pin_top_level_index_and_filter: 1 2024-03-30T13:32:03.347 INFO:journalctl@ceph.mon.c.smithi099.stdout: index_type: 0 2024-03-30T13:32:03.347 INFO:journalctl@ceph.mon.c.smithi099.stdout: data_block_index_type: 0 2024-03-30T13:32:03.347 INFO:journalctl@ceph.mon.c.smithi099.stdout: index_shortening: 1 2024-03-30T13:32:03.347 INFO:journalctl@ceph.mon.c.smithi099.stdout: data_block_hash_table_util_ratio: 0.750000 2024-03-30T13:32:03.347 INFO:journalctl@ceph.mon.c.smithi099.stdout: hash_index_allow_collision: 1 2024-03-30T13:32:03.347 INFO:journalctl@ceph.mon.c.smithi099.stdout: checksum: 1 2024-03-30T13:32:03.347 INFO:journalctl@ceph.mon.c.smithi099.stdout: no_block_cache: 0 2024-03-30T13:32:03.347 INFO:journalctl@ceph.mon.c.smithi099.stdout: block_cache: 0x557d6e138170 2024-03-30T13:32:03.347 INFO:journalctl@ceph.mon.c.smithi099.stdout: block_cache_name: BinnedLRUCache 2024-03-30T13:32:03.348 INFO:journalctl@ceph.mon.c.smithi099.stdout: block_cache_options: 2024-03-30T13:32:03.348 INFO:journalctl@ceph.mon.c.smithi099.stdout: capacity : 536870912 2024-03-30T13:32:03.348 INFO:journalctl@ceph.mon.c.smithi099.stdout: num_shard_bits : 4 2024-03-30T13:32:03.348 INFO:journalctl@ceph.mon.c.smithi099.stdout: strict_capacity_limit : 0 2024-03-30T13:32:03.348 INFO:journalctl@ceph.mon.c.smithi099.stdout: high_pri_pool_ratio: 0.000 2024-03-30T13:32:03.348 INFO:journalctl@ceph.mon.c.smithi099.stdout: block_cache_compressed: (nil) 2024-03-30T13:32:03.348 INFO:journalctl@ceph.mon.c.smithi099.stdout: persistent_cache: (nil) 2024-03-30T13:32:03.348 INFO:journalctl@ceph.mon.c.smithi099.stdout: block_size: 4096 2024-03-30T13:32:03.348 INFO:journalctl@ceph.mon.c.smithi099.stdout: block_size_deviation: 10 2024-03-30T13:32:03.348 INFO:journalctl@ceph.mon.c.smithi099.stdout: block_restart_interval: 16 2024-03-30T13:32:03.348 INFO:journalctl@ceph.mon.c.smithi099.stdout: index_block_restart_interval: 1 2024-03-30T13:32:03.348 INFO:journalctl@ceph.mon.c.smithi099.stdout: metadata_block_size: 4096 2024-03-30T13:32:03.348 INFO:journalctl@ceph.mon.c.smithi099.stdout: partition_filters: 0 2024-03-30T13:32:03.348 INFO:journalctl@ceph.mon.c.smithi099.stdout: use_delta_encoding: 1 2024-03-30T13:32:03.348 INFO:journalctl@ceph.mon.c.smithi099.stdout: filter_policy: rocksdb.BuiltinBloomFilter 2024-03-30T13:32:03.348 INFO:journalctl@ceph.mon.c.smithi099.stdout: whole_key_filtering: 1 2024-03-30T13:32:03.349 INFO:journalctl@ceph.mon.c.smithi099.stdout: verify_compression: 0 2024-03-30T13:32:03.349 INFO:journalctl@ceph.mon.c.smithi099.stdout: read_amp_bytes_per_bit: 0 2024-03-30T13:32:03.349 INFO:journalctl@ceph.mon.c.smithi099.stdout: format_version: 4 2024-03-30T13:32:03.349 INFO:journalctl@ceph.mon.c.smithi099.stdout: enable_index_compression: 1 2024-03-30T13:32:03.349 INFO:journalctl@ceph.mon.c.smithi099.stdout: block_align: 0 2024-03-30T13:32:03.349 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:32:02 smithi099 ceph-mon[29691]: rocksdb: Options.write_buffer_size: 33554432 2024-03-30T13:32:03.349 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:32:02 smithi099 ceph-mon[29691]: rocksdb: Options.max_write_buffer_number: 2 2024-03-30T13:32:03.349 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:32:02 smithi099 ceph-mon[29691]: rocksdb: Options.compression: NoCompression 2024-03-30T13:32:03.349 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:32:02 smithi099 ceph-mon[29691]: rocksdb: Options.bottommost_compression: Disabled 2024-03-30T13:32:03.349 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:32:02 smithi099 ceph-mon[29691]: rocksdb: Options.prefix_extractor: nullptr 2024-03-30T13:32:03.349 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:32:02 smithi099 ceph-mon[29691]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-03-30T13:32:03.349 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:32:02 smithi099 ceph-mon[29691]: rocksdb: Options.num_levels: 7 2024-03-30T13:32:03.349 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:32:02 smithi099 ceph-mon[29691]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-03-30T13:32:03.349 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:32:02 smithi099 ceph-mon[29691]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-03-30T13:32:03.349 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:32:02 smithi099 ceph-mon[29691]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-03-30T13:32:03.350 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:32:02 smithi099 ceph-mon[29691]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-03-30T13:32:03.350 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:32:02 smithi099 ceph-mon[29691]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-03-30T13:32:03.350 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:32:02 smithi099 ceph-mon[29691]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-03-30T13:32:03.350 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:32:02 smithi099 ceph-mon[29691]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-03-30T13:32:03.350 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:32:02 smithi099 ceph-mon[29691]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-03-30T13:32:03.350 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:32:02 smithi099 ceph-mon[29691]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-03-30T13:32:03.350 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:32:02 smithi099 ceph-mon[29691]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-03-30T13:32:03.350 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:32:02 smithi099 ceph-mon[29691]: rocksdb: Options.compression_opts.window_bits: -14 2024-03-30T13:32:03.350 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:32:02 smithi099 ceph-mon[29691]: rocksdb: Options.compression_opts.level: 32767 2024-03-30T13:32:03.350 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:32:02 smithi099 ceph-mon[29691]: rocksdb: Options.compression_opts.strategy: 0 2024-03-30T13:32:03.350 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:32:02 smithi099 ceph-mon[29691]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-03-30T13:32:03.350 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:32:02 smithi099 ceph-mon[29691]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-03-30T13:32:03.350 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:32:02 smithi099 ceph-mon[29691]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-03-30T13:32:03.350 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:32:02 smithi099 ceph-mon[29691]: rocksdb: Options.compression_opts.enabled: false 2024-03-30T13:32:03.350 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:32:02 smithi099 ceph-mon[29691]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-03-30T13:32:03.351 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:32:02 smithi099 ceph-mon[29691]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-03-30T13:32:03.351 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:32:02 smithi099 ceph-mon[29691]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-03-30T13:32:03.351 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:32:02 smithi099 ceph-mon[29691]: rocksdb: Options.target_file_size_base: 67108864 2024-03-30T13:32:03.351 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:32:02 smithi099 ceph-mon[29691]: rocksdb: Options.target_file_size_multiplier: 1 2024-03-30T13:32:03.351 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:32:02 smithi099 ceph-mon[29691]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-03-30T13:32:03.351 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:32:02 smithi099 ceph-mon[29691]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-03-30T13:32:03.351 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:32:02 smithi099 ceph-mon[29691]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-03-30T13:32:03.351 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:32:02 smithi099 ceph-mon[29691]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-03-30T13:32:03.351 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:32:02 smithi099 ceph-mon[29691]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-03-30T13:32:03.351 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:32:02 smithi099 ceph-mon[29691]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-03-30T13:32:03.351 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:32:02 smithi099 ceph-mon[29691]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-03-30T13:32:03.351 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:32:02 smithi099 ceph-mon[29691]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-03-30T13:32:03.351 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:32:02 smithi099 ceph-mon[29691]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-03-30T13:32:03.351 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:32:02 smithi099 ceph-mon[29691]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-03-30T13:32:03.351 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:32:02 smithi099 ceph-mon[29691]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-03-30T13:32:03.352 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:32:02 smithi099 ceph-mon[29691]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-03-30T13:32:03.352 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:32:02 smithi099 ceph-mon[29691]: rocksdb: Options.arena_block_size: 4194304 2024-03-30T13:32:03.352 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:32:02 smithi099 ceph-mon[29691]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-03-30T13:32:03.352 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:32:02 smithi099 ceph-mon[29691]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-03-30T13:32:03.352 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:32:02 smithi099 ceph-mon[29691]: rocksdb: Options.rate_limit_delay_max_milliseconds: 100 2024-03-30T13:32:03.352 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:32:02 smithi099 ceph-mon[29691]: rocksdb: Options.disable_auto_compactions: 0 2024-03-30T13:32:03.352 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:32:02 smithi099 ceph-mon[29691]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-03-30T13:32:03.352 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:32:02 smithi099 ceph-mon[29691]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-03-30T13:32:03.352 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:32:02 smithi099 ceph-mon[29691]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-03-30T13:32:03.352 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:32:02 smithi099 ceph-mon[29691]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-03-30T13:32:03.352 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:32:02 smithi099 ceph-mon[29691]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-03-30T13:32:03.352 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:32:02 smithi099 ceph-mon[29691]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-03-30T13:32:03.352 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:32:02 smithi099 ceph-mon[29691]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-03-30T13:32:03.352 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:32:02 smithi099 ceph-mon[29691]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-03-30T13:32:03.352 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:32:02 smithi099 ceph-mon[29691]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-03-30T13:32:03.353 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:32:02 smithi099 ceph-mon[29691]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-03-30T13:32:03.353 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:32:02 smithi099 ceph-mon[29691]: rocksdb: Options.table_properties_collectors: 2024-03-30T13:32:03.353 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:32:02 smithi099 ceph-mon[29691]: rocksdb: Options.inplace_update_support: 0 2024-03-30T13:32:03.353 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:32:02 smithi099 ceph-mon[29691]: rocksdb: Options.inplace_update_num_locks: 10000 2024-03-30T13:32:03.353 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:32:02 smithi099 ceph-mon[29691]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-03-30T13:32:03.353 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:32:02 smithi099 ceph-mon[29691]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-03-30T13:32:03.353 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:32:02 smithi099 ceph-mon[29691]: rocksdb: Options.memtable_huge_page_size: 0 2024-03-30T13:32:03.353 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:32:02 smithi099 ceph-mon[29691]: rocksdb: Options.bloom_locality: 0 2024-03-30T13:32:03.353 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:32:02 smithi099 ceph-mon[29691]: rocksdb: Options.max_successive_merges: 0 2024-03-30T13:32:03.353 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:32:02 smithi099 ceph-mon[29691]: rocksdb: Options.optimize_filters_for_hits: 0 2024-03-30T13:32:03.353 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:32:02 smithi099 ceph-mon[29691]: rocksdb: Options.paranoid_file_checks: 0 2024-03-30T13:32:03.353 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:32:02 smithi099 ceph-mon[29691]: rocksdb: Options.force_consistency_checks: 1 2024-03-30T13:32:03.353 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:32:02 smithi099 ceph-mon[29691]: rocksdb: Options.report_bg_io_stats: 0 2024-03-30T13:32:03.353 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:32:02 smithi099 ceph-mon[29691]: rocksdb: Options.ttl: 2592000 2024-03-30T13:32:03.353 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:32:02 smithi099 ceph-mon[29691]: rocksdb: Options.periodic_compaction_seconds: 0 2024-03-30T13:32:03.354 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:32:02 smithi099 ceph-mon[29691]: rocksdb: Options.enable_blob_files: false 2024-03-30T13:32:03.354 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:32:02 smithi099 ceph-mon[29691]: rocksdb: Options.min_blob_size: 0 2024-03-30T13:32:03.354 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:32:02 smithi099 ceph-mon[29691]: rocksdb: Options.blob_file_size: 268435456 2024-03-30T13:32:03.354 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:32:02 smithi099 ceph-mon[29691]: rocksdb: Options.blob_compression_type: NoCompression 2024-03-30T13:32:03.354 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:32:02 smithi099 ceph-mon[29691]: rocksdb: Options.enable_blob_garbage_collection: false 2024-03-30T13:32:03.354 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:32:02 smithi099 ceph-mon[29691]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-03-30T13:32:03.354 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:32:02 smithi099 ceph-mon[29691]: rocksdb: [db/version_set.cc:4773] Recovered from manifest file:/var/lib/ceph/mon/ceph-c/store.db/MANIFEST-000003 succeeded,manifest_file_number is 3, next_file_number is 5, last_sequence is 0, log_number is 0,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2024-03-30T13:32:03.354 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:32:02 smithi099 ceph-mon[29691]: rocksdb: [db/version_set.cc:4782] Column family [default] (ID 0), log number is 0 2024-03-30T13:32:03.354 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:32:02 smithi099 ceph-mon[29691]: rocksdb: [db/version_set.cc:4083] Creating manifest 7 2024-03-30T13:32:03.354 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:32:02 smithi099 ceph-mon[29691]: rocksdb: EVENT_LOG_v1 {"time_micros": 1711805522919368, "job": 1, "event": "recovery_started", "wal_files": [4]} 2024-03-30T13:32:03.354 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:32:02 smithi099 ceph-mon[29691]: rocksdb: [db/db_impl/db_impl_open.cc:847] Recovering log #4 mode 2 2024-03-30T13:32:03.354 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:32:02 smithi099 ceph-mon[29691]: rocksdb: [table/block_based/filter_policy.cc:996] Using legacy Bloom filter with high (20) bits/key. Dramatic filter space and/or accuracy improvement is available with format_version>=5. 2024-03-30T13:32:03.354 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:32:02 smithi099 ceph-mon[29691]: rocksdb: EVENT_LOG_v1 {"time_micros": 1711805522919656, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 8, "file_size": 1545, "file_checksum": "", "file_checksum_func_name": "Unknown", "table_properties": {"data_size": 523, "index_size": 31, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 69, "raw_key_size": 115, "raw_average_key_size": 23, "raw_value_size": 401, "raw_average_value_size": 80, "num_data_blocks": 1, "num_entries": 5, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "rocksdb.BuiltinBloomFilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; ", "creation_time": 1711805522, "oldest_key_time": 0, "file_creation_time": 0, "db_id": "7956cc19-10bc-4706-9e02-f9cb6ca252d3", "db_session_id": "RNTXDY93J7BLAC4GO6FG"}} 2024-03-30T13:32:03.354 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:32:02 smithi099 ceph-mon[29691]: rocksdb: [db/version_set.cc:4083] Creating manifest 9 2024-03-30T13:32:03.354 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:32:02 smithi099 ceph-mon[29691]: rocksdb: EVENT_LOG_v1 {"time_micros": 1711805522919997, "job": 1, "event": "recovery_finished"} 2024-03-30T13:32:03.354 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:32:02 smithi099 ceph-mon[29691]: rocksdb: [file/delete_scheduler.cc:73] Deleted file /var/lib/ceph/mon/ceph-c/store.db/000004.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-03-30T13:32:03.355 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:32:02 smithi099 ceph-mon[29691]: rocksdb: [db/db_impl/db_impl_open.cc:1701] SstFileManager instance 0x557d6e11ea80 2024-03-30T13:32:03.355 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:32:02 smithi099 ceph-mon[29691]: rocksdb: DB pointer 0x557d6e12e000 2024-03-30T13:32:03.355 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:32:02 smithi099 ceph-mon[29691]: rocksdb: [db/db_impl/db_impl.cc:902] ------- DUMPING STATS ------- 2024-03-30T13:32:03.355 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:32:02 smithi099 ceph-mon[29691]: rocksdb: [db/db_impl/db_impl.cc:903] 2024-03-30T13:32:03.355 INFO:journalctl@ceph.mon.c.smithi099.stdout: ** DB Stats ** 2024-03-30T13:32:03.355 INFO:journalctl@ceph.mon.c.smithi099.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-03-30T13:32:03.355 INFO:journalctl@ceph.mon.c.smithi099.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-03-30T13:32:03.355 INFO:journalctl@ceph.mon.c.smithi099.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-03-30T13:32:03.355 INFO:journalctl@ceph.mon.c.smithi099.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-03-30T13:32:03.355 INFO:journalctl@ceph.mon.c.smithi099.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-03-30T13:32:03.355 INFO:journalctl@ceph.mon.c.smithi099.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 MB, 0.00 MB/s 2024-03-30T13:32:03.355 INFO:journalctl@ceph.mon.c.smithi099.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-03-30T13:32:03.355 INFO:journalctl@ceph.mon.c.smithi099.stdout: 2024-03-30T13:32:03.355 INFO:journalctl@ceph.mon.c.smithi099.stdout: ** Compaction Stats [default] ** 2024-03-30T13:32:03.355 INFO:journalctl@ceph.mon.c.smithi099.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2024-03-30T13:32:03.356 INFO:journalctl@ceph.mon.c.smithi099.stdout: ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-03-30T13:32:03.356 INFO:journalctl@ceph.mon.c.smithi099.stdout: L0 1/0 1.51 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 5.4 0.00 0.00 1 0.000 0 0 2024-03-30T13:32:03.356 INFO:journalctl@ceph.mon.c.smithi099.stdout: Sum 1/0 1.51 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 5.4 0.00 0.00 1 0.000 0 0 2024-03-30T13:32:03.356 INFO:journalctl@ceph.mon.c.smithi099.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 5.4 0.00 0.00 1 0.000 0 0 2024-03-30T13:32:03.356 INFO:journalctl@ceph.mon.c.smithi099.stdout: 2024-03-30T13:32:03.356 INFO:journalctl@ceph.mon.c.smithi099.stdout: ** Compaction Stats [default] ** 2024-03-30T13:32:03.356 INFO:journalctl@ceph.mon.c.smithi099.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2024-03-30T13:32:03.356 INFO:journalctl@ceph.mon.c.smithi099.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-03-30T13:32:03.356 INFO:journalctl@ceph.mon.c.smithi099.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 5.4 0.00 0.00 1 0.000 0 0 2024-03-30T13:32:03.356 INFO:journalctl@ceph.mon.c.smithi099.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-03-30T13:32:03.356 INFO:journalctl@ceph.mon.c.smithi099.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-03-30T13:32:03.356 INFO:journalctl@ceph.mon.c.smithi099.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-03-30T13:32:03.356 INFO:journalctl@ceph.mon.c.smithi099.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-03-30T13:32:03.356 INFO:journalctl@ceph.mon.c.smithi099.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-03-30T13:32:03.356 INFO:journalctl@ceph.mon.c.smithi099.stdout: AddFile(Keys): cumulative 0, interval 0 2024-03-30T13:32:03.357 INFO:journalctl@ceph.mon.c.smithi099.stdout: Cumulative compaction: 0.00 GB write, 0.59 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-03-30T13:32:03.357 INFO:journalctl@ceph.mon.c.smithi099.stdout: Interval compaction: 0.00 GB write, 0.59 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-03-30T13:32:03.357 INFO:journalctl@ceph.mon.c.smithi099.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-03-30T13:32:03.357 INFO:journalctl@ceph.mon.c.smithi099.stdout: 2024-03-30T13:32:03.357 INFO:journalctl@ceph.mon.c.smithi099.stdout: ** File Read Latency Histogram By Level [default] ** 2024-03-30T13:32:03.357 INFO:journalctl@ceph.mon.c.smithi099.stdout: 2024-03-30T13:32:03.357 INFO:journalctl@ceph.mon.c.smithi099.stdout: ** Compaction Stats [default] ** 2024-03-30T13:32:03.357 INFO:journalctl@ceph.mon.c.smithi099.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2024-03-30T13:32:03.357 INFO:journalctl@ceph.mon.c.smithi099.stdout: ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-03-30T13:32:03.357 INFO:journalctl@ceph.mon.c.smithi099.stdout: L0 1/0 1.51 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 5.4 0.00 0.00 1 0.000 0 0 2024-03-30T13:32:03.357 INFO:journalctl@ceph.mon.c.smithi099.stdout: Sum 1/0 1.51 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 5.4 0.00 0.00 1 0.000 0 0 2024-03-30T13:32:03.357 INFO:journalctl@ceph.mon.c.smithi099.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 2024-03-30T13:32:03.357 INFO:journalctl@ceph.mon.c.smithi099.stdout: 2024-03-30T13:32:03.357 INFO:journalctl@ceph.mon.c.smithi099.stdout: ** Compaction Stats [default] ** 2024-03-30T13:32:03.357 INFO:journalctl@ceph.mon.c.smithi099.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2024-03-30T13:32:03.357 INFO:journalctl@ceph.mon.c.smithi099.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-03-30T13:32:03.358 INFO:journalctl@ceph.mon.c.smithi099.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 5.4 0.00 0.00 1 0.000 0 0 2024-03-30T13:32:03.358 INFO:journalctl@ceph.mon.c.smithi099.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-03-30T13:32:03.358 INFO:journalctl@ceph.mon.c.smithi099.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-03-30T13:32:03.358 INFO:journalctl@ceph.mon.c.smithi099.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-03-30T13:32:03.358 INFO:journalctl@ceph.mon.c.smithi099.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-03-30T13:32:03.358 INFO:journalctl@ceph.mon.c.smithi099.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-03-30T13:32:03.358 INFO:journalctl@ceph.mon.c.smithi099.stdout: AddFile(Keys): cumulative 0, interval 0 2024-03-30T13:32:03.358 INFO:journalctl@ceph.mon.c.smithi099.stdout: Cumulative compaction: 0.00 GB write, 0.59 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-03-30T13:32:03.358 INFO:journalctl@ceph.mon.c.smithi099.stdout: Interval compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-03-30T13:32:03.358 INFO:journalctl@ceph.mon.c.smithi099.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-03-30T13:32:03.358 INFO:journalctl@ceph.mon.c.smithi099.stdout: 2024-03-30T13:32:03.358 INFO:journalctl@ceph.mon.c.smithi099.stdout: ** File Read Latency Histogram By Level [default] ** 2024-03-30T13:32:03.358 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:32:02 smithi099 ceph-mon[29691]: mon.c does not exist in monmap, will attempt to join an existing cluster 2024-03-30T13:32:03.358 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:32:02 smithi099 ceph-mon[29691]: using public_addrv [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] 2024-03-30T13:32:03.359 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:32:02 smithi099 ceph-mon[29691]: starting mon.c rank -1 at public addrs [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] at bind addrs [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] mon_data /var/lib/ceph/mon/ceph-c fsid 98ebaeb8-ee99-11ee-b647-cb9ed24678a4 2024-03-30T13:32:03.359 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:32:02 smithi099 ceph-mon[29691]: mon.c@-1(???) e0 preinit fsid 98ebaeb8-ee99-11ee-b647-cb9ed24678a4 2024-03-30T13:32:03.359 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:32:02 smithi099 ceph-mon[29691]: mon.c@-1(synchronizing).mds e1 new map 2024-03-30T13:32:03.359 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:32:02 smithi099 ceph-mon[29691]: mon.c@-1(synchronizing).mds e1 print_map 2024-03-30T13:32:03.359 INFO:journalctl@ceph.mon.c.smithi099.stdout: e1 2024-03-30T13:32:03.359 INFO:journalctl@ceph.mon.c.smithi099.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-03-30T13:32:03.359 INFO:journalctl@ceph.mon.c.smithi099.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-03-30T13:32:03.359 INFO:journalctl@ceph.mon.c.smithi099.stdout: legacy client fscid: -1 2024-03-30T13:32:03.359 INFO:journalctl@ceph.mon.c.smithi099.stdout: 2024-03-30T13:32:03.359 INFO:journalctl@ceph.mon.c.smithi099.stdout: No filesystems configured 2024-03-30T13:32:03.359 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:32:02 smithi099 ceph-mon[29691]: mon.c@-1(synchronizing).osd e0 _set_cache_ratios kv ratio 0.25 inc ratio 0.375 full ratio 0.375 2024-03-30T13:32:03.359 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:32:02 smithi099 ceph-mon[29691]: mon.c@-1(synchronizing).osd e0 register_cache_with_pcm pcm target: 2147483648 pcm max: 1020054732 pcm min: 134217728 inc_osd_cache size: 1 2024-03-30T13:32:03.359 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:32:02 smithi099 ceph-mon[29691]: mon.c@-1(synchronizing).osd e1 e1: 0 total, 0 up, 0 in 2024-03-30T13:32:03.360 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:32:02 smithi099 ceph-mon[29691]: mon.c@-1(synchronizing).osd e2 e2: 0 total, 0 up, 0 in 2024-03-30T13:32:03.360 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:32:02 smithi099 ceph-mon[29691]: mon.c@-1(synchronizing).osd e3 e3: 0 total, 0 up, 0 in 2024-03-30T13:32:03.360 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:32:02 smithi099 ceph-mon[29691]: mon.c@-1(synchronizing).osd e4 e4: 0 total, 0 up, 0 in 2024-03-30T13:32:03.360 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:32:02 smithi099 ceph-mon[29691]: mon.c@-1(synchronizing).osd e4 crush map has features 3314932999778484224, adjusting msgr requires 2024-03-30T13:32:03.360 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:32:02 smithi099 ceph-mon[29691]: mon.c@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-03-30T13:32:03.360 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:32:02 smithi099 ceph-mon[29691]: mon.c@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-03-30T13:32:03.360 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:32:02 smithi099 ceph-mon[29691]: mon.c@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-03-30T13:32:03.360 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:32:02 smithi099 ceph-mon[29691]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-30T13:32:03.360 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:32:02 smithi099 ceph-mon[29691]: mon.c@-1(synchronizing).paxosservice(auth 1..5) refresh upgraded, format 0 -> 3 2024-03-30T13:32:03.360 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:32:02 smithi099 ceph-mon[29691]: mon.c@-1(synchronizing) e1 handle_conf_change mon_allow_pool_delete,mon_cluster_log_to_file 2024-03-30T13:32:03.360 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:32:02 smithi099 bash[29672]: 0f1e989177183faf5f42c21b944f909c3536dc17a980b457fe8169be9f7f6a98 2024-03-30T13:32:03.360 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:32:02 smithi099 systemd[1]: Started Ceph mon.c for 98ebaeb8-ee99-11ee-b647-cb9ed24678a4. 2024-03-30T13:32:08.337 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:32:07 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[25141]: 172.21.15.99 - - [30/Mar/2024:13:32:07] "POST /data HTTP/1.1" 200 46 "" "Python-urllib/3.9" 2024-03-30T13:32:08.338 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:32:08 smithi099 ceph-mon[24912]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-03-30T13:32:08.338 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:32:08 smithi099 ceph-mon[24912]: mon.a calling monitor election 2024-03-30T13:32:08.338 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:32:08 smithi099 ceph-mon[24912]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-30T13:32:08.338 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:32:08 smithi099 ceph-mon[24912]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-30T13:32:08.338 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:32:08 smithi099 ceph-mon[24912]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-30T13:32:08.338 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:32:08 smithi099 ceph-mon[24912]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-30T13:32:08.338 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:32:08 smithi099 ceph-mon[24912]: mon.c calling monitor election 2024-03-30T13:32:08.338 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:32:08 smithi099 ceph-mon[24912]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-30T13:32:08.338 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:32:08 smithi099 ceph-mon[24912]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-30T13:32:08.338 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:32:08 smithi099 ceph-mon[24912]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-30T13:32:08.338 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:32:08 smithi099 ceph-mon[24912]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-30T13:32:08.339 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:32:08 smithi099 ceph-mon[24912]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-03-30T13:32:08.339 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:32:08 smithi099 ceph-mon[24912]: monmap e2: 2 mons at {a=[v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0],c=[v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0]} 2024-03-30T13:32:08.339 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:32:08 smithi099 ceph-mon[24912]: fsmap 2024-03-30T13:32:08.339 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:32:08 smithi099 ceph-mon[24912]: osdmap e4: 0 total, 0 up, 0 in 2024-03-30T13:32:08.339 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:32:08 smithi099 ceph-mon[24912]: mgrmap e13: y(active, since 35s) 2024-03-30T13:32:08.339 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:32:08 smithi099 ceph-mon[24912]: overall HEALTH_OK 2024-03-30T13:32:08.339 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:32:08 smithi099 ceph-mon[24912]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' 2024-03-30T13:32:08.339 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:32:08 smithi099 ceph-mon[24912]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' 2024-03-30T13:32:08.339 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:32:08 smithi099 ceph-mon[24912]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-03-30T13:32:08.339 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:32:08 smithi099 ceph-mon[24912]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:32:08.339 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:32:08 smithi099 ceph-mon[24912]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' 2024-03-30T13:32:08.340 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:32:08 smithi099 ceph-mon[29691]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-03-30T13:32:08.340 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:32:08 smithi099 ceph-mon[29691]: mon.a calling monitor election 2024-03-30T13:32:08.340 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:32:08 smithi099 ceph-mon[29691]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-30T13:32:08.340 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:32:08 smithi099 ceph-mon[29691]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-30T13:32:08.340 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:32:08 smithi099 ceph-mon[29691]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-30T13:32:08.340 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:32:08 smithi099 ceph-mon[29691]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-30T13:32:08.340 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:32:08 smithi099 ceph-mon[29691]: mon.c calling monitor election 2024-03-30T13:32:08.340 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:32:08 smithi099 ceph-mon[29691]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-30T13:32:08.340 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:32:08 smithi099 ceph-mon[29691]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-30T13:32:08.340 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:32:08 smithi099 ceph-mon[29691]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-30T13:32:08.340 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:32:08 smithi099 ceph-mon[29691]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-30T13:32:08.340 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:32:08 smithi099 ceph-mon[29691]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-03-30T13:32:08.340 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:32:08 smithi099 ceph-mon[29691]: monmap e2: 2 mons at {a=[v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0],c=[v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0]} 2024-03-30T13:32:08.340 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:32:08 smithi099 ceph-mon[29691]: fsmap 2024-03-30T13:32:08.340 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:32:08 smithi099 ceph-mon[29691]: osdmap e4: 0 total, 0 up, 0 in 2024-03-30T13:32:08.340 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:32:08 smithi099 ceph-mon[29691]: mgrmap e13: y(active, since 35s) 2024-03-30T13:32:08.341 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:32:08 smithi099 ceph-mon[29691]: overall HEALTH_OK 2024-03-30T13:32:08.341 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:32:08 smithi099 ceph-mon[29691]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' 2024-03-30T13:32:08.341 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:32:08 smithi099 ceph-mon[29691]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' 2024-03-30T13:32:08.341 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:32:08 smithi099 ceph-mon[29691]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-03-30T13:32:08.341 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:32:08 smithi099 ceph-mon[29691]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:32:08.341 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:32:08 smithi099 ceph-mon[29691]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' 2024-03-30T13:32:08.404 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-03-30T13:32:08.404 INFO:teuthology.orchestra.run.smithi181.stdout:{"epoch":2,"fsid":"98ebaeb8-ee99-11ee-b647-cb9ed24678a4","modified":"2024-03-30T13:32:02.938696Z","created":"2024-03-30T13:30:34.451427Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:3300","nonce":0},{"type":"v1","addr":"172.21.15.99:6789","nonce":0}]},"addr":"172.21.15.99:6789/0","public_addr":"172.21.15.99:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:3301","nonce":0},{"type":"v1","addr":"172.21.15.99:6790","nonce":0}]},"addr":"172.21.15.99:6790/0","public_addr":"172.21.15.99:6790/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2024-03-30T13:32:08.406 INFO:teuthology.orchestra.run.smithi181.stderr:dumped monmap epoch 2 2024-03-30T13:32:09.337 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:32:09 smithi099 ceph-mon[24912]: Deploying daemon mon.b on smithi181 2024-03-30T13:32:09.337 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:32:09 smithi099 ceph-mon[24912]: from='client.? 172.21.15.181:0/2949151252' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-03-30T13:32:09.337 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:32:09 smithi099 ceph-mon[24912]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-30T13:32:09.337 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:32:09 smithi099 ceph-mon[24912]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-30T13:32:09.337 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:32:09 smithi099 ceph-mon[29691]: Deploying daemon mon.b on smithi181 2024-03-30T13:32:09.337 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:32:09 smithi099 ceph-mon[29691]: from='client.? 172.21.15.181:0/2949151252' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-03-30T13:32:09.337 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:32:09 smithi099 ceph-mon[29691]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-30T13:32:09.337 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:32:09 smithi099 ceph-mon[29691]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-30T13:32:10.439 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-03-30T13:32:10.439 DEBUG:teuthology.orchestra.run.smithi181:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 98ebaeb8-ee99-11ee-b647-cb9ed24678a4 -- ceph mon dump -f json 2024-03-30T13:32:11.587 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:32:11 smithi099 ceph-mon[24912]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-30T13:32:11.587 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:32:11 smithi099 ceph-mon[29691]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-30T13:32:12.440 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:32:12 smithi181 podman[25734]: 2024-03-30 13:32:12.327462942 +0000 UTC m=+0.026053051 image pull e1d6a67b021eb077ee22bf650f1a9fb1980a2cf5c36bdb9cba9eac6de8f702d9 quay.io/ceph/ceph@sha256:12a0a4f43413fd97a14a3d47a3451b2d2df50020835bb93db666209f3f77617a 2024-03-30T13:32:12.441 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:32:12 smithi181 podman[25734]: 2024-03-30 13:32:12.438803849 +0000 UTC m=+0.137393952 container create e678a2a25c90c7b3e7081be401dd2b98c91678d6a0f1cb5cc0bcc6c809c921fb (image=quay.io/ceph/ceph@sha256:12a0a4f43413fd97a14a3d47a3451b2d2df50020835bb93db666209f3f77617a, name=ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mon-b, com.redhat.component=centos-stream-container, io.openshift.tags=base centos centos-stream, ceph=True, io.k8s.description=The Universal Base Image is designed and engineered to be the base layer for all of your containerized applications, middleware and utilities. This base image is freely redistributable, but Red Hat only supports Red Hat technologies through subscriptions for Red Hat products. This image is maintained by Red Hat and updated regularly., GIT_REPO=https://github.com/ceph/ceph-container.git, distribution-scope=public, name=centos-stream, architecture=x86_64, com.redhat.build-host=cpt-1002.osbs.prod.upshift.rdu2.redhat.com, vcs-type=git, version=8, vendor=Red Hat, Inc., io.buildah.version=1.19.8, GIT_BRANCH=HEAD, summary=Provides a CentOS Stream container based on the Red Hat Universal Base Image, build-date=2022-05-03T08:36:31.336870, CEPH_POINT_RELEASE=-17.2.0, vcs-ref=f1ee6e37554363ec55e0035aba1a693d3627fdeb, GIT_COMMIT=b613db0f44179c0940781c1c7fe04e1acb7093ac, url=https://access.redhat.com/containers/#/registry.access.redhat.com/ubi8/images/8.6-754, GIT_CLEAN=True, RELEASE=HEAD, release=754, io.k8s.display-name=CentOS Stream 8, com.redhat.license_terms=https://centos.org/legal/licensing-policy/, maintainer=Guillaume Abrioux , io.openshift.expose-services=, description=CentOS Stream is a continuously delivered distro that tracks just ahead of Red Hat Enterprise Linux development. This image takes the Red Hat UBI and layers on content from CentOS Stream) 2024-03-30T13:32:12.589 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-03-30T13:32:12.589 INFO:teuthology.orchestra.run.smithi181.stdout:{"epoch":2,"fsid":"98ebaeb8-ee99-11ee-b647-cb9ed24678a4","modified":"2024-03-30T13:32:02.938696Z","created":"2024-03-30T13:30:34.451427Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:3300","nonce":0},{"type":"v1","addr":"172.21.15.99:6789","nonce":0}]},"addr":"172.21.15.99:6789/0","public_addr":"172.21.15.99:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:3301","nonce":0},{"type":"v1","addr":"172.21.15.99:6790","nonce":0}]},"addr":"172.21.15.99:6790/0","public_addr":"172.21.15.99:6790/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2024-03-30T13:32:12.594 INFO:teuthology.orchestra.run.smithi181.stderr:dumped monmap epoch 2 2024-03-30T13:32:12.756 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:32:12 smithi181 podman[25734]: 2024-03-30 13:32:12.599787857 +0000 UTC m=+0.298377959 container init e678a2a25c90c7b3e7081be401dd2b98c91678d6a0f1cb5cc0bcc6c809c921fb (image=quay.io/ceph/ceph@sha256:12a0a4f43413fd97a14a3d47a3451b2d2df50020835bb93db666209f3f77617a, name=ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mon-b, com.redhat.build-host=cpt-1002.osbs.prod.upshift.rdu2.redhat.com, vcs-type=git, url=https://access.redhat.com/containers/#/registry.access.redhat.com/ubi8/images/8.6-754, build-date=2022-05-03T08:36:31.336870, version=8, com.redhat.license_terms=https://centos.org/legal/licensing-policy/, io.openshift.tags=base centos centos-stream, io.k8s.description=The Universal Base Image is designed and engineered to be the base layer for all of your containerized applications, middleware and utilities. This base image is freely redistributable, but Red Hat only supports Red Hat technologies through subscriptions for Red Hat products. This image is maintained by Red Hat and updated regularly., GIT_REPO=https://github.com/ceph/ceph-container.git, maintainer=Guillaume Abrioux , summary=Provides a CentOS Stream container based on the Red Hat Universal Base Image, vcs-ref=f1ee6e37554363ec55e0035aba1a693d3627fdeb, io.openshift.expose-services=, ceph=True, description=CentOS Stream is a continuously delivered distro that tracks just ahead of Red Hat Enterprise Linux development. This image takes the Red Hat UBI and layers on content from CentOS Stream, io.k8s.display-name=CentOS Stream 8, distribution-scope=public, com.redhat.component=centos-stream-container, io.buildah.version=1.19.8, CEPH_POINT_RELEASE=-17.2.0, release=754, RELEASE=HEAD, architecture=x86_64, GIT_BRANCH=HEAD, GIT_COMMIT=b613db0f44179c0940781c1c7fe04e1acb7093ac, name=centos-stream, GIT_CLEAN=True, vendor=Red Hat, Inc.) 2024-03-30T13:32:12.756 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:32:12 smithi181 podman[25734]: 2024-03-30 13:32:12.60337472 +0000 UTC m=+0.301964824 container start e678a2a25c90c7b3e7081be401dd2b98c91678d6a0f1cb5cc0bcc6c809c921fb (image=quay.io/ceph/ceph@sha256:12a0a4f43413fd97a14a3d47a3451b2d2df50020835bb93db666209f3f77617a, name=ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mon-b, RELEASE=HEAD, io.k8s.description=The Universal Base Image is designed and engineered to be the base layer for all of your containerized applications, middleware and utilities. This base image is freely redistributable, but Red Hat only supports Red Hat technologies through subscriptions for Red Hat products. This image is maintained by Red Hat and updated regularly., GIT_COMMIT=b613db0f44179c0940781c1c7fe04e1acb7093ac, summary=Provides a CentOS Stream container based on the Red Hat Universal Base Image, name=centos-stream, version=8, io.buildah.version=1.19.8, GIT_REPO=https://github.com/ceph/ceph-container.git, GIT_BRANCH=HEAD, architecture=x86_64, vendor=Red Hat, Inc., io.k8s.display-name=CentOS Stream 8, io.openshift.expose-services=, description=CentOS Stream is a continuously delivered distro that tracks just ahead of Red Hat Enterprise Linux development. This image takes the Red Hat UBI and layers on content from CentOS Stream, com.redhat.component=centos-stream-container, distribution-scope=public, release=754, vcs-ref=f1ee6e37554363ec55e0035aba1a693d3627fdeb, com.redhat.build-host=cpt-1002.osbs.prod.upshift.rdu2.redhat.com, url=https://access.redhat.com/containers/#/registry.access.redhat.com/ubi8/images/8.6-754, maintainer=Guillaume Abrioux , io.openshift.tags=base centos centos-stream, GIT_CLEAN=True, build-date=2022-05-03T08:36:31.336870, CEPH_POINT_RELEASE=-17.2.0, ceph=True, com.redhat.license_terms=https://centos.org/legal/licensing-policy/, vcs-type=git) 2024-03-30T13:32:12.756 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:32:12 smithi181 ceph-mon[25762]: set uid:gid to 167:167 (ceph:ceph) 2024-03-30T13:32:12.757 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:32:12 smithi181 ceph-mon[25762]: ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable), process ceph-mon, pid 2 2024-03-30T13:32:12.757 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:32:12 smithi181 ceph-mon[25762]: pidfile_write: ignore empty --pid-file 2024-03-30T13:32:12.757 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:32:12 smithi181 ceph-mon[25762]: load: jerasure load: lrc 2024-03-30T13:32:12.757 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:32:12 smithi181 ceph-mon[25762]: rocksdb: RocksDB version: 6.15.5 2024-03-30T13:32:12.757 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:32:12 smithi181 ceph-mon[25762]: rocksdb: Git sha rocksdb_build_git_sha:@0@ 2024-03-30T13:32:12.757 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:32:12 smithi181 ceph-mon[25762]: rocksdb: Compile date Apr 18 2022 2024-03-30T13:32:12.757 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:32:12 smithi181 ceph-mon[25762]: rocksdb: DB SUMMARY 2024-03-30T13:32:12.757 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:32:12 smithi181 ceph-mon[25762]: rocksdb: DB Session ID: EXOJJJ10MHCYWNCEZZHB 2024-03-30T13:32:12.757 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:32:12 smithi181 ceph-mon[25762]: rocksdb: CURRENT file: CURRENT 2024-03-30T13:32:12.757 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:32:12 smithi181 ceph-mon[25762]: rocksdb: IDENTITY file: IDENTITY 2024-03-30T13:32:12.757 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:32:12 smithi181 ceph-mon[25762]: rocksdb: MANIFEST file: MANIFEST-000003 size: 57 Bytes 2024-03-30T13:32:12.757 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:32:12 smithi181 ceph-mon[25762]: rocksdb: SST files in /var/lib/ceph/mon/ceph-b/store.db dir, Total Num: 0, files: 2024-03-30T13:32:12.757 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:32:12 smithi181 ceph-mon[25762]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-b/store.db: 000004.log size: 636 ; 2024-03-30T13:32:12.757 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:32:12 smithi181 ceph-mon[25762]: rocksdb: Options.error_if_exists: 0 2024-03-30T13:32:12.757 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:32:12 smithi181 ceph-mon[25762]: rocksdb: Options.create_if_missing: 0 2024-03-30T13:32:12.757 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:32:12 smithi181 ceph-mon[25762]: rocksdb: Options.paranoid_checks: 1 2024-03-30T13:32:12.758 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:32:12 smithi181 ceph-mon[25762]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-03-30T13:32:12.758 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:32:12 smithi181 ceph-mon[25762]: rocksdb: Options.env: 0x5603012c6860 2024-03-30T13:32:12.758 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:32:12 smithi181 ceph-mon[25762]: rocksdb: Options.fs: Posix File System 2024-03-30T13:32:12.758 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:32:12 smithi181 ceph-mon[25762]: rocksdb: Options.info_log: 0x560303459dc0 2024-03-30T13:32:12.758 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:32:12 smithi181 ceph-mon[25762]: rocksdb: Options.max_file_opening_threads: 16 2024-03-30T13:32:12.758 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:32:12 smithi181 ceph-mon[25762]: rocksdb: Options.statistics: (nil) 2024-03-30T13:32:12.758 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:32:12 smithi181 ceph-mon[25762]: rocksdb: Options.use_fsync: 0 2024-03-30T13:32:12.758 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:32:12 smithi181 ceph-mon[25762]: rocksdb: Options.max_log_file_size: 0 2024-03-30T13:32:12.758 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:32:12 smithi181 ceph-mon[25762]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-03-30T13:32:12.758 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:32:12 smithi181 ceph-mon[25762]: rocksdb: Options.log_file_time_to_roll: 0 2024-03-30T13:32:12.758 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:32:12 smithi181 ceph-mon[25762]: rocksdb: Options.keep_log_file_num: 1000 2024-03-30T13:32:12.758 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:32:12 smithi181 ceph-mon[25762]: rocksdb: Options.recycle_log_file_num: 0 2024-03-30T13:32:12.758 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:32:12 smithi181 ceph-mon[25762]: rocksdb: Options.allow_fallocate: 1 2024-03-30T13:32:12.758 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:32:12 smithi181 ceph-mon[25762]: rocksdb: Options.allow_mmap_reads: 0 2024-03-30T13:32:12.759 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:32:12 smithi181 ceph-mon[25762]: rocksdb: Options.allow_mmap_writes: 0 2024-03-30T13:32:12.759 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:32:12 smithi181 ceph-mon[25762]: rocksdb: Options.use_direct_reads: 0 2024-03-30T13:32:12.759 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:32:12 smithi181 ceph-mon[25762]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-03-30T13:32:12.759 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:32:12 smithi181 ceph-mon[25762]: rocksdb: Options.create_missing_column_families: 0 2024-03-30T13:32:12.759 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:32:12 smithi181 ceph-mon[25762]: rocksdb: Options.db_log_dir: 2024-03-30T13:32:12.759 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:32:12 smithi181 ceph-mon[25762]: rocksdb: Options.wal_dir: /var/lib/ceph/mon/ceph-b/store.db 2024-03-30T13:32:12.759 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:32:12 smithi181 ceph-mon[25762]: rocksdb: Options.table_cache_numshardbits: 6 2024-03-30T13:32:12.759 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:32:12 smithi181 ceph-mon[25762]: rocksdb: Options.WAL_ttl_seconds: 0 2024-03-30T13:32:12.759 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:32:12 smithi181 ceph-mon[25762]: rocksdb: Options.WAL_size_limit_MB: 0 2024-03-30T13:32:12.759 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:32:12 smithi181 ceph-mon[25762]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-03-30T13:32:12.759 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:32:12 smithi181 ceph-mon[25762]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-03-30T13:32:12.759 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:32:12 smithi181 ceph-mon[25762]: rocksdb: Options.is_fd_close_on_exec: 1 2024-03-30T13:32:12.761 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:32:12 smithi181 ceph-mon[25762]: rocksdb: Options.advise_random_on_open: 1 2024-03-30T13:32:12.761 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:32:12 smithi181 ceph-mon[25762]: rocksdb: Options.db_write_buffer_size: 0 2024-03-30T13:32:12.761 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:32:12 smithi181 ceph-mon[25762]: rocksdb: Options.write_buffer_manager: 0x56030354a240 2024-03-30T13:32:12.761 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:32:12 smithi181 ceph-mon[25762]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-03-30T13:32:12.761 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:32:12 smithi181 ceph-mon[25762]: rocksdb: Options.new_table_reader_for_compaction_inputs: 0 2024-03-30T13:32:12.761 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:32:12 smithi181 ceph-mon[25762]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-03-30T13:32:12.761 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:32:12 smithi181 ceph-mon[25762]: rocksdb: Options.use_adaptive_mutex: 0 2024-03-30T13:32:12.761 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:32:12 smithi181 ceph-mon[25762]: rocksdb: Options.rate_limiter: (nil) 2024-03-30T13:32:12.761 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:32:12 smithi181 ceph-mon[25762]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-03-30T13:32:12.761 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:32:12 smithi181 ceph-mon[25762]: rocksdb: Options.wal_recovery_mode: 2 2024-03-30T13:32:12.762 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:32:12 smithi181 ceph-mon[25762]: rocksdb: Options.enable_thread_tracking: 0 2024-03-30T13:32:12.762 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:32:12 smithi181 ceph-mon[25762]: rocksdb: Options.enable_pipelined_write: 0 2024-03-30T13:32:12.762 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:32:12 smithi181 ceph-mon[25762]: rocksdb: Options.unordered_write: 0 2024-03-30T13:32:12.762 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:32:12 smithi181 ceph-mon[25762]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-03-30T13:32:12.762 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:32:12 smithi181 ceph-mon[25762]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-03-30T13:32:12.762 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:32:12 smithi181 ceph-mon[25762]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-03-30T13:32:12.762 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:32:12 smithi181 ceph-mon[25762]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-03-30T13:32:12.762 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:32:12 smithi181 ceph-mon[25762]: rocksdb: Options.row_cache: None 2024-03-30T13:32:12.762 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:32:12 smithi181 ceph-mon[25762]: rocksdb: Options.wal_filter: None 2024-03-30T13:32:12.762 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:32:12 smithi181 ceph-mon[25762]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-03-30T13:32:12.762 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:32:12 smithi181 ceph-mon[25762]: rocksdb: Options.allow_ingest_behind: 0 2024-03-30T13:32:12.762 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:32:12 smithi181 ceph-mon[25762]: rocksdb: Options.preserve_deletes: 0 2024-03-30T13:32:12.762 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:32:12 smithi181 ceph-mon[25762]: rocksdb: Options.two_write_queues: 0 2024-03-30T13:32:12.762 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:32:12 smithi181 ceph-mon[25762]: rocksdb: Options.manual_wal_flush: 0 2024-03-30T13:32:12.763 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:32:12 smithi181 ceph-mon[25762]: rocksdb: Options.atomic_flush: 0 2024-03-30T13:32:12.763 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:32:12 smithi181 ceph-mon[25762]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-03-30T13:32:12.763 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:32:12 smithi181 ceph-mon[25762]: rocksdb: Options.persist_stats_to_disk: 0 2024-03-30T13:32:12.763 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:32:12 smithi181 ceph-mon[25762]: rocksdb: Options.write_dbid_to_manifest: 0 2024-03-30T13:32:12.763 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:32:12 smithi181 ceph-mon[25762]: rocksdb: Options.log_readahead_size: 0 2024-03-30T13:32:12.763 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:32:12 smithi181 ceph-mon[25762]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-03-30T13:32:12.763 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:32:12 smithi181 ceph-mon[25762]: rocksdb: Options.best_efforts_recovery: 0 2024-03-30T13:32:12.763 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:32:12 smithi181 ceph-mon[25762]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-03-30T13:32:12.763 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:32:12 smithi181 ceph-mon[25762]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-03-30T13:32:12.763 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:32:12 smithi181 ceph-mon[25762]: rocksdb: Options.allow_data_in_errors: 0 2024-03-30T13:32:12.763 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:32:12 smithi181 ceph-mon[25762]: rocksdb: Options.db_host_id: __hostname__ 2024-03-30T13:32:12.763 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:32:12 smithi181 ceph-mon[25762]: rocksdb: Options.max_background_jobs: 2 2024-03-30T13:32:12.763 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:32:12 smithi181 ceph-mon[25762]: rocksdb: Options.max_background_compactions: -1 2024-03-30T13:32:12.763 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:32:12 smithi181 ceph-mon[25762]: rocksdb: Options.max_subcompactions: 1 2024-03-30T13:32:12.764 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:32:12 smithi181 ceph-mon[25762]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-03-30T13:32:12.764 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:32:12 smithi181 ceph-mon[25762]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-03-30T13:32:12.764 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:32:12 smithi181 ceph-mon[25762]: rocksdb: Options.delayed_write_rate : 16777216 2024-03-30T13:32:12.764 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:32:12 smithi181 ceph-mon[25762]: rocksdb: Options.max_total_wal_size: 0 2024-03-30T13:32:12.764 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:32:12 smithi181 ceph-mon[25762]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-03-30T13:32:12.764 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:32:12 smithi181 ceph-mon[25762]: rocksdb: Options.stats_dump_period_sec: 600 2024-03-30T13:32:12.764 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:32:12 smithi181 ceph-mon[25762]: rocksdb: Options.stats_persist_period_sec: 600 2024-03-30T13:32:12.764 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:32:12 smithi181 ceph-mon[25762]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-03-30T13:32:12.764 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:32:12 smithi181 ceph-mon[25762]: rocksdb: Options.max_open_files: -1 2024-03-30T13:32:12.764 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:32:12 smithi181 ceph-mon[25762]: rocksdb: Options.bytes_per_sync: 0 2024-03-30T13:32:12.764 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:32:12 smithi181 ceph-mon[25762]: rocksdb: Options.wal_bytes_per_sync: 0 2024-03-30T13:32:12.764 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:32:12 smithi181 ceph-mon[25762]: rocksdb: Options.strict_bytes_per_sync: 0 2024-03-30T13:32:12.764 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:32:12 smithi181 ceph-mon[25762]: rocksdb: Options.compaction_readahead_size: 0 2024-03-30T13:32:12.764 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:32:12 smithi181 ceph-mon[25762]: rocksdb: Options.max_background_flushes: -1 2024-03-30T13:32:12.764 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:32:12 smithi181 ceph-mon[25762]: rocksdb: Compression algorithms supported: 2024-03-30T13:32:12.765 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:32:12 smithi181 ceph-mon[25762]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-03-30T13:32:12.765 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:32:12 smithi181 ceph-mon[25762]: rocksdb: kZSTD supported: 0 2024-03-30T13:32:12.765 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:32:12 smithi181 ceph-mon[25762]: rocksdb: kXpressCompression supported: 0 2024-03-30T13:32:12.765 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:32:12 smithi181 ceph-mon[25762]: rocksdb: kLZ4HCCompression supported: 1 2024-03-30T13:32:12.765 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:32:12 smithi181 ceph-mon[25762]: rocksdb: kLZ4Compression supported: 1 2024-03-30T13:32:12.765 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:32:12 smithi181 ceph-mon[25762]: rocksdb: kBZip2Compression supported: 0 2024-03-30T13:32:12.765 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:32:12 smithi181 ceph-mon[25762]: rocksdb: kZlibCompression supported: 1 2024-03-30T13:32:12.765 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:32:12 smithi181 ceph-mon[25762]: rocksdb: kSnappyCompression supported: 1 2024-03-30T13:32:12.765 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:32:12 smithi181 ceph-mon[25762]: rocksdb: Fast CRC32 supported: Supported on x86 2024-03-30T13:32:12.765 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:32:12 smithi181 ceph-mon[25762]: rocksdb: [db/version_set.cc:4725] Recovering from manifest file: /var/lib/ceph/mon/ceph-b/store.db/MANIFEST-000003 2024-03-30T13:32:12.765 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:32:12 smithi181 ceph-mon[25762]: rocksdb: [db/column_family.cc:597] --------------- Options for column family [default]: 2024-03-30T13:32:12.765 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:32:12 smithi181 ceph-mon[25762]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-03-30T13:32:12.766 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:32:12 smithi181 ceph-mon[25762]: rocksdb: Options.merge_operator: 2024-03-30T13:32:12.766 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:32:12 smithi181 ceph-mon[25762]: rocksdb: Options.compaction_filter: None 2024-03-30T13:32:12.766 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:32:12 smithi181 ceph-mon[25762]: rocksdb: Options.compaction_filter_factory: None 2024-03-30T13:32:12.766 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:32:12 smithi181 ceph-mon[25762]: rocksdb: Options.sst_partitioner_factory: None 2024-03-30T13:32:12.766 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:32:12 smithi181 ceph-mon[25762]: rocksdb: Options.memtable_factory: SkipListFactory 2024-03-30T13:32:12.766 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:32:12 smithi181 ceph-mon[25762]: rocksdb: Options.table_factory: BlockBasedTable 2024-03-30T13:32:12.766 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:32:12 smithi181 ceph-mon[25762]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x560303425d00) 2024-03-30T13:32:12.766 INFO:journalctl@ceph.mon.b.smithi181.stdout: cache_index_and_filter_blocks: 1 2024-03-30T13:32:12.766 INFO:journalctl@ceph.mon.b.smithi181.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-03-30T13:32:12.766 INFO:journalctl@ceph.mon.b.smithi181.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-03-30T13:32:12.766 INFO:journalctl@ceph.mon.b.smithi181.stdout: pin_top_level_index_and_filter: 1 2024-03-30T13:32:12.766 INFO:journalctl@ceph.mon.b.smithi181.stdout: index_type: 0 2024-03-30T13:32:12.766 INFO:journalctl@ceph.mon.b.smithi181.stdout: data_block_index_type: 0 2024-03-30T13:32:12.766 INFO:journalctl@ceph.mon.b.smithi181.stdout: index_shortening: 1 2024-03-30T13:32:12.766 INFO:journalctl@ceph.mon.b.smithi181.stdout: data_block_hash_table_util_ratio: 0.750000 2024-03-30T13:32:12.767 INFO:journalctl@ceph.mon.b.smithi181.stdout: hash_index_allow_collision: 1 2024-03-30T13:32:12.767 INFO:journalctl@ceph.mon.b.smithi181.stdout: checksum: 1 2024-03-30T13:32:12.767 INFO:journalctl@ceph.mon.b.smithi181.stdout: no_block_cache: 0 2024-03-30T13:32:12.767 INFO:journalctl@ceph.mon.b.smithi181.stdout: block_cache: 0x560303490170 2024-03-30T13:32:12.767 INFO:journalctl@ceph.mon.b.smithi181.stdout: block_cache_name: BinnedLRUCache 2024-03-30T13:32:12.767 INFO:journalctl@ceph.mon.b.smithi181.stdout: block_cache_options: 2024-03-30T13:32:12.767 INFO:journalctl@ceph.mon.b.smithi181.stdout: capacity : 536870912 2024-03-30T13:32:12.767 INFO:journalctl@ceph.mon.b.smithi181.stdout: num_shard_bits : 4 2024-03-30T13:32:12.767 INFO:journalctl@ceph.mon.b.smithi181.stdout: strict_capacity_limit : 0 2024-03-30T13:32:12.767 INFO:journalctl@ceph.mon.b.smithi181.stdout: high_pri_pool_ratio: 0.000 2024-03-30T13:32:12.767 INFO:journalctl@ceph.mon.b.smithi181.stdout: block_cache_compressed: (nil) 2024-03-30T13:32:12.767 INFO:journalctl@ceph.mon.b.smithi181.stdout: persistent_cache: (nil) 2024-03-30T13:32:12.767 INFO:journalctl@ceph.mon.b.smithi181.stdout: block_size: 4096 2024-03-30T13:32:12.767 INFO:journalctl@ceph.mon.b.smithi181.stdout: block_size_deviation: 10 2024-03-30T13:32:12.767 INFO:journalctl@ceph.mon.b.smithi181.stdout: block_restart_interval: 16 2024-03-30T13:32:12.767 INFO:journalctl@ceph.mon.b.smithi181.stdout: index_block_restart_interval: 1 2024-03-30T13:32:12.768 INFO:journalctl@ceph.mon.b.smithi181.stdout: metadata_block_size: 4096 2024-03-30T13:32:12.768 INFO:journalctl@ceph.mon.b.smithi181.stdout: partition_filters: 0 2024-03-30T13:32:12.768 INFO:journalctl@ceph.mon.b.smithi181.stdout: use_delta_encoding: 1 2024-03-30T13:32:12.768 INFO:journalctl@ceph.mon.b.smithi181.stdout: filter_policy: rocksdb.BuiltinBloomFilter 2024-03-30T13:32:12.768 INFO:journalctl@ceph.mon.b.smithi181.stdout: whole_key_filtering: 1 2024-03-30T13:32:12.768 INFO:journalctl@ceph.mon.b.smithi181.stdout: verify_compression: 0 2024-03-30T13:32:12.768 INFO:journalctl@ceph.mon.b.smithi181.stdout: read_amp_bytes_per_bit: 0 2024-03-30T13:32:12.768 INFO:journalctl@ceph.mon.b.smithi181.stdout: format_version: 4 2024-03-30T13:32:12.768 INFO:journalctl@ceph.mon.b.smithi181.stdout: enable_index_compression: 1 2024-03-30T13:32:12.768 INFO:journalctl@ceph.mon.b.smithi181.stdout: block_align: 0 2024-03-30T13:32:12.769 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:32:12 smithi181 ceph-mon[25762]: rocksdb: Options.write_buffer_size: 33554432 2024-03-30T13:32:12.769 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:32:12 smithi181 ceph-mon[25762]: rocksdb: Options.max_write_buffer_number: 2 2024-03-30T13:32:12.769 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:32:12 smithi181 ceph-mon[25762]: rocksdb: Options.compression: NoCompression 2024-03-30T13:32:12.769 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:32:12 smithi181 ceph-mon[25762]: rocksdb: Options.bottommost_compression: Disabled 2024-03-30T13:32:12.769 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:32:12 smithi181 ceph-mon[25762]: rocksdb: Options.prefix_extractor: nullptr 2024-03-30T13:32:12.769 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:32:12 smithi181 ceph-mon[25762]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-03-30T13:32:12.769 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:32:12 smithi181 ceph-mon[25762]: rocksdb: Options.num_levels: 7 2024-03-30T13:32:12.769 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:32:12 smithi181 ceph-mon[25762]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-03-30T13:32:12.769 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:32:12 smithi181 ceph-mon[25762]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-03-30T13:32:12.769 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:32:12 smithi181 ceph-mon[25762]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-03-30T13:32:12.769 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:32:12 smithi181 ceph-mon[25762]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-03-30T13:32:12.769 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:32:12 smithi181 ceph-mon[25762]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-03-30T13:32:12.769 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:32:12 smithi181 ceph-mon[25762]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-03-30T13:32:12.769 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:32:12 smithi181 ceph-mon[25762]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-03-30T13:32:12.769 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:32:12 smithi181 ceph-mon[25762]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-03-30T13:32:12.770 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:32:12 smithi181 ceph-mon[25762]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-03-30T13:32:12.770 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:32:12 smithi181 ceph-mon[25762]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-03-30T13:32:12.770 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:32:12 smithi181 ceph-mon[25762]: rocksdb: Options.compression_opts.window_bits: -14 2024-03-30T13:32:12.770 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:32:12 smithi181 ceph-mon[25762]: rocksdb: Options.compression_opts.level: 32767 2024-03-30T13:32:12.770 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:32:12 smithi181 ceph-mon[25762]: rocksdb: Options.compression_opts.strategy: 0 2024-03-30T13:32:12.770 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:32:12 smithi181 ceph-mon[25762]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-03-30T13:32:12.770 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:32:12 smithi181 ceph-mon[25762]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-03-30T13:32:12.770 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:32:12 smithi181 ceph-mon[25762]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-03-30T13:32:12.770 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:32:12 smithi181 ceph-mon[25762]: rocksdb: Options.compression_opts.enabled: false 2024-03-30T13:32:12.770 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:32:12 smithi181 ceph-mon[25762]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-03-30T13:32:12.770 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:32:12 smithi181 ceph-mon[25762]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-03-30T13:32:12.770 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:32:12 smithi181 ceph-mon[25762]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-03-30T13:32:12.770 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:32:12 smithi181 ceph-mon[25762]: rocksdb: Options.target_file_size_base: 67108864 2024-03-30T13:32:12.770 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:32:12 smithi181 ceph-mon[25762]: rocksdb: Options.target_file_size_multiplier: 1 2024-03-30T13:32:12.771 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:32:12 smithi181 ceph-mon[25762]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-03-30T13:32:12.771 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:32:12 smithi181 ceph-mon[25762]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-03-30T13:32:12.771 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:32:12 smithi181 ceph-mon[25762]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-03-30T13:32:12.771 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:32:12 smithi181 ceph-mon[25762]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-03-30T13:32:12.771 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:32:12 smithi181 ceph-mon[25762]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-03-30T13:32:12.771 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:32:12 smithi181 ceph-mon[25762]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-03-30T13:32:12.771 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:32:12 smithi181 ceph-mon[25762]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-03-30T13:32:12.771 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:32:12 smithi181 ceph-mon[25762]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-03-30T13:32:12.771 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:32:12 smithi181 ceph-mon[25762]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-03-30T13:32:12.771 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:32:12 smithi181 ceph-mon[25762]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-03-30T13:32:12.772 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:32:12 smithi181 ceph-mon[25762]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-03-30T13:32:12.772 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:32:12 smithi181 ceph-mon[25762]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-03-30T13:32:12.772 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:32:12 smithi181 ceph-mon[25762]: rocksdb: Options.arena_block_size: 4194304 2024-03-30T13:32:12.772 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:32:12 smithi181 ceph-mon[25762]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-03-30T13:32:12.772 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:32:12 smithi181 ceph-mon[25762]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-03-30T13:32:12.772 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:32:12 smithi181 ceph-mon[25762]: rocksdb: Options.rate_limit_delay_max_milliseconds: 100 2024-03-30T13:32:12.772 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:32:12 smithi181 ceph-mon[25762]: rocksdb: Options.disable_auto_compactions: 0 2024-03-30T13:32:12.772 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:32:12 smithi181 ceph-mon[25762]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-03-30T13:32:12.772 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:32:12 smithi181 ceph-mon[25762]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-03-30T13:32:12.772 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:32:12 smithi181 ceph-mon[25762]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-03-30T13:32:12.772 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:32:12 smithi181 ceph-mon[25762]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-03-30T13:32:12.772 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:32:12 smithi181 ceph-mon[25762]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-03-30T13:32:12.772 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:32:12 smithi181 ceph-mon[25762]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-03-30T13:32:12.772 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:32:12 smithi181 ceph-mon[25762]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-03-30T13:32:12.773 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:32:12 smithi181 ceph-mon[25762]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-03-30T13:32:12.773 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:32:12 smithi181 ceph-mon[25762]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-03-30T13:32:12.773 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:32:12 smithi181 ceph-mon[25762]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-03-30T13:32:12.773 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:32:12 smithi181 ceph-mon[25762]: rocksdb: Options.table_properties_collectors: 2024-03-30T13:32:12.773 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:32:12 smithi181 ceph-mon[25762]: rocksdb: Options.inplace_update_support: 0 2024-03-30T13:32:12.773 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:32:12 smithi181 ceph-mon[25762]: rocksdb: Options.inplace_update_num_locks: 10000 2024-03-30T13:32:12.773 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:32:12 smithi181 ceph-mon[25762]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-03-30T13:32:12.773 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:32:12 smithi181 ceph-mon[25762]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-03-30T13:32:12.773 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:32:12 smithi181 ceph-mon[25762]: rocksdb: Options.memtable_huge_page_size: 0 2024-03-30T13:32:12.773 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:32:12 smithi181 ceph-mon[25762]: rocksdb: Options.bloom_locality: 0 2024-03-30T13:32:12.773 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:32:12 smithi181 ceph-mon[25762]: rocksdb: Options.max_successive_merges: 0 2024-03-30T13:32:12.773 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:32:12 smithi181 ceph-mon[25762]: rocksdb: Options.optimize_filters_for_hits: 0 2024-03-30T13:32:12.774 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:32:12 smithi181 ceph-mon[25762]: rocksdb: Options.paranoid_file_checks: 0 2024-03-30T13:32:12.774 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:32:12 smithi181 ceph-mon[25762]: rocksdb: Options.force_consistency_checks: 1 2024-03-30T13:32:12.774 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:32:12 smithi181 ceph-mon[25762]: rocksdb: Options.report_bg_io_stats: 0 2024-03-30T13:32:12.774 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:32:12 smithi181 ceph-mon[25762]: rocksdb: Options.ttl: 2592000 2024-03-30T13:32:12.774 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:32:12 smithi181 ceph-mon[25762]: rocksdb: Options.periodic_compaction_seconds: 0 2024-03-30T13:32:12.774 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:32:12 smithi181 ceph-mon[25762]: rocksdb: Options.enable_blob_files: false 2024-03-30T13:32:12.774 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:32:12 smithi181 ceph-mon[25762]: rocksdb: Options.min_blob_size: 0 2024-03-30T13:32:12.774 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:32:12 smithi181 ceph-mon[25762]: rocksdb: Options.blob_file_size: 268435456 2024-03-30T13:32:12.774 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:32:12 smithi181 ceph-mon[25762]: rocksdb: Options.blob_compression_type: NoCompression 2024-03-30T13:32:12.774 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:32:12 smithi181 ceph-mon[25762]: rocksdb: Options.enable_blob_garbage_collection: false 2024-03-30T13:32:12.774 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:32:12 smithi181 ceph-mon[25762]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-03-30T13:32:12.775 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:32:12 smithi181 ceph-mon[25762]: rocksdb: [db/version_set.cc:4773] Recovered from manifest file:/var/lib/ceph/mon/ceph-b/store.db/MANIFEST-000003 succeeded,manifest_file_number is 3, next_file_number is 5, last_sequence is 0, log_number is 0,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2024-03-30T13:32:12.775 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:32:12 smithi181 ceph-mon[25762]: rocksdb: [db/version_set.cc:4782] Column family [default] (ID 0), log number is 0 2024-03-30T13:32:12.775 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:32:12 smithi181 ceph-mon[25762]: rocksdb: [db/version_set.cc:4083] Creating manifest 7 2024-03-30T13:32:12.775 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:32:12 smithi181 ceph-mon[25762]: rocksdb: EVENT_LOG_v1 {"time_micros": 1711805532631597, "job": 1, "event": "recovery_started", "wal_files": [4]} 2024-03-30T13:32:12.775 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:32:12 smithi181 ceph-mon[25762]: rocksdb: [db/db_impl/db_impl_open.cc:847] Recovering log #4 mode 2 2024-03-30T13:32:12.775 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:32:12 smithi181 ceph-mon[25762]: rocksdb: [table/block_based/filter_policy.cc:996] Using legacy Bloom filter with high (20) bits/key. Dramatic filter space and/or accuracy improvement is available with format_version>=5. 2024-03-30T13:32:12.775 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:32:12 smithi181 ceph-mon[25762]: rocksdb: EVENT_LOG_v1 {"time_micros": 1711805532631957, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 8, "file_size": 1670, "file_checksum": "", "file_checksum_func_name": "Unknown", "table_properties": {"data_size": 648, "index_size": 31, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 69, "raw_key_size": 115, "raw_average_key_size": 23, "raw_value_size": 526, "raw_average_value_size": 105, "num_data_blocks": 1, "num_entries": 5, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "rocksdb.BuiltinBloomFilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; ", "creation_time": 1711805532, "oldest_key_time": 0, "file_creation_time": 0, "db_id": "09382dc8-592d-4a95-86e6-0dbff9290808", "db_session_id": "EXOJJJ10MHCYWNCEZZHB"}} 2024-03-30T13:32:12.775 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:32:12 smithi181 ceph-mon[25762]: rocksdb: [db/version_set.cc:4083] Creating manifest 9 2024-03-30T13:32:12.775 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:32:12 smithi181 ceph-mon[25762]: rocksdb: EVENT_LOG_v1 {"time_micros": 1711805532632279, "job": 1, "event": "recovery_finished"} 2024-03-30T13:32:12.775 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:32:12 smithi181 ceph-mon[25762]: rocksdb: [file/delete_scheduler.cc:73] Deleted file /var/lib/ceph/mon/ceph-b/store.db/000004.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-03-30T13:32:12.775 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:32:12 smithi181 ceph-mon[25762]: rocksdb: [db/db_impl/db_impl_open.cc:1701] SstFileManager instance 0x560303476a80 2024-03-30T13:32:12.775 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:32:12 smithi181 ceph-mon[25762]: rocksdb: DB pointer 0x560303486000 2024-03-30T13:32:12.776 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:32:12 smithi181 ceph-mon[25762]: rocksdb: [db/db_impl/db_impl.cc:902] ------- DUMPING STATS ------- 2024-03-30T13:32:12.776 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:32:12 smithi181 ceph-mon[25762]: rocksdb: [db/db_impl/db_impl.cc:903] 2024-03-30T13:32:12.776 INFO:journalctl@ceph.mon.b.smithi181.stdout: ** DB Stats ** 2024-03-30T13:32:12.776 INFO:journalctl@ceph.mon.b.smithi181.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-03-30T13:32:12.776 INFO:journalctl@ceph.mon.b.smithi181.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-03-30T13:32:12.776 INFO:journalctl@ceph.mon.b.smithi181.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-03-30T13:32:12.776 INFO:journalctl@ceph.mon.b.smithi181.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-03-30T13:32:12.776 INFO:journalctl@ceph.mon.b.smithi181.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-03-30T13:32:12.776 INFO:journalctl@ceph.mon.b.smithi181.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 MB, 0.00 MB/s 2024-03-30T13:32:12.776 INFO:journalctl@ceph.mon.b.smithi181.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-03-30T13:32:12.776 INFO:journalctl@ceph.mon.b.smithi181.stdout: 2024-03-30T13:32:12.776 INFO:journalctl@ceph.mon.b.smithi181.stdout: ** Compaction Stats [default] ** 2024-03-30T13:32:12.776 INFO:journalctl@ceph.mon.b.smithi181.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2024-03-30T13:32:12.777 INFO:journalctl@ceph.mon.b.smithi181.stdout: ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-03-30T13:32:12.777 INFO:journalctl@ceph.mon.b.smithi181.stdout: L0 1/0 1.63 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 4.7 0.00 0.00 1 0.000 0 0 2024-03-30T13:32:12.777 INFO:journalctl@ceph.mon.b.smithi181.stdout: Sum 1/0 1.63 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 4.7 0.00 0.00 1 0.000 0 0 2024-03-30T13:32:12.777 INFO:journalctl@ceph.mon.b.smithi181.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 4.7 0.00 0.00 1 0.000 0 0 2024-03-30T13:32:12.777 INFO:journalctl@ceph.mon.b.smithi181.stdout: 2024-03-30T13:32:12.777 INFO:journalctl@ceph.mon.b.smithi181.stdout: ** Compaction Stats [default] ** 2024-03-30T13:32:12.777 INFO:journalctl@ceph.mon.b.smithi181.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2024-03-30T13:32:12.777 INFO:journalctl@ceph.mon.b.smithi181.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-03-30T13:32:12.777 INFO:journalctl@ceph.mon.b.smithi181.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 4.7 0.00 0.00 1 0.000 0 0 2024-03-30T13:32:12.777 INFO:journalctl@ceph.mon.b.smithi181.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-03-30T13:32:12.777 INFO:journalctl@ceph.mon.b.smithi181.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-03-30T13:32:12.777 INFO:journalctl@ceph.mon.b.smithi181.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-03-30T13:32:12.777 INFO:journalctl@ceph.mon.b.smithi181.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-03-30T13:32:12.777 INFO:journalctl@ceph.mon.b.smithi181.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-03-30T13:32:12.778 INFO:journalctl@ceph.mon.b.smithi181.stdout: AddFile(Keys): cumulative 0, interval 0 2024-03-30T13:32:12.778 INFO:journalctl@ceph.mon.b.smithi181.stdout: Cumulative compaction: 0.00 GB write, 0.56 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-03-30T13:32:12.778 INFO:journalctl@ceph.mon.b.smithi181.stdout: Interval compaction: 0.00 GB write, 0.56 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-03-30T13:32:12.778 INFO:journalctl@ceph.mon.b.smithi181.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-03-30T13:32:12.778 INFO:journalctl@ceph.mon.b.smithi181.stdout: 2024-03-30T13:32:12.778 INFO:journalctl@ceph.mon.b.smithi181.stdout: ** File Read Latency Histogram By Level [default] ** 2024-03-30T13:32:12.778 INFO:journalctl@ceph.mon.b.smithi181.stdout: 2024-03-30T13:32:12.778 INFO:journalctl@ceph.mon.b.smithi181.stdout: ** Compaction Stats [default] ** 2024-03-30T13:32:12.778 INFO:journalctl@ceph.mon.b.smithi181.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2024-03-30T13:32:12.778 INFO:journalctl@ceph.mon.b.smithi181.stdout: ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-03-30T13:32:12.778 INFO:journalctl@ceph.mon.b.smithi181.stdout: L0 1/0 1.63 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 4.7 0.00 0.00 1 0.000 0 0 2024-03-30T13:32:12.778 INFO:journalctl@ceph.mon.b.smithi181.stdout: Sum 1/0 1.63 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 4.7 0.00 0.00 1 0.000 0 0 2024-03-30T13:32:12.779 INFO:journalctl@ceph.mon.b.smithi181.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 2024-03-30T13:32:12.779 INFO:journalctl@ceph.mon.b.smithi181.stdout: 2024-03-30T13:32:12.779 INFO:journalctl@ceph.mon.b.smithi181.stdout: ** Compaction Stats [default] ** 2024-03-30T13:32:12.779 INFO:journalctl@ceph.mon.b.smithi181.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2024-03-30T13:32:12.779 INFO:journalctl@ceph.mon.b.smithi181.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-03-30T13:32:12.779 INFO:journalctl@ceph.mon.b.smithi181.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 4.7 0.00 0.00 1 0.000 0 0 2024-03-30T13:32:12.779 INFO:journalctl@ceph.mon.b.smithi181.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-03-30T13:32:12.779 INFO:journalctl@ceph.mon.b.smithi181.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-03-30T13:32:12.779 INFO:journalctl@ceph.mon.b.smithi181.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-03-30T13:32:12.779 INFO:journalctl@ceph.mon.b.smithi181.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-03-30T13:32:12.779 INFO:journalctl@ceph.mon.b.smithi181.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-03-30T13:32:12.779 INFO:journalctl@ceph.mon.b.smithi181.stdout: AddFile(Keys): cumulative 0, interval 0 2024-03-30T13:32:12.779 INFO:journalctl@ceph.mon.b.smithi181.stdout: Cumulative compaction: 0.00 GB write, 0.56 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-03-30T13:32:12.779 INFO:journalctl@ceph.mon.b.smithi181.stdout: Interval compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-03-30T13:32:12.779 INFO:journalctl@ceph.mon.b.smithi181.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-03-30T13:32:12.780 INFO:journalctl@ceph.mon.b.smithi181.stdout: 2024-03-30T13:32:12.780 INFO:journalctl@ceph.mon.b.smithi181.stdout: ** File Read Latency Histogram By Level [default] ** 2024-03-30T13:32:12.780 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:32:12 smithi181 ceph-mon[25762]: mon.b does not exist in monmap, will attempt to join an existing cluster 2024-03-30T13:32:12.780 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:32:12 smithi181 ceph-mon[25762]: using public_addr v2:172.21.15.181:0/0 -> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] 2024-03-30T13:32:12.780 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:32:12 smithi181 ceph-mon[25762]: starting mon.b rank -1 at public addrs [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] at bind addrs [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon_data /var/lib/ceph/mon/ceph-b fsid 98ebaeb8-ee99-11ee-b647-cb9ed24678a4 2024-03-30T13:32:12.780 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:32:12 smithi181 ceph-mon[25762]: mon.b@-1(???) e0 preinit fsid 98ebaeb8-ee99-11ee-b647-cb9ed24678a4 2024-03-30T13:32:12.780 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:32:12 smithi181 ceph-mon[25762]: mon.b@-1(synchronizing).mds e1 new map 2024-03-30T13:32:12.780 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:32:12 smithi181 ceph-mon[25762]: mon.b@-1(synchronizing).mds e1 print_map 2024-03-30T13:32:12.780 INFO:journalctl@ceph.mon.b.smithi181.stdout: e1 2024-03-30T13:32:12.780 INFO:journalctl@ceph.mon.b.smithi181.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-03-30T13:32:12.780 INFO:journalctl@ceph.mon.b.smithi181.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-03-30T13:32:12.780 INFO:journalctl@ceph.mon.b.smithi181.stdout: legacy client fscid: -1 2024-03-30T13:32:12.780 INFO:journalctl@ceph.mon.b.smithi181.stdout: 2024-03-30T13:32:12.780 INFO:journalctl@ceph.mon.b.smithi181.stdout: No filesystems configured 2024-03-30T13:32:12.781 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:32:12 smithi181 ceph-mon[25762]: mon.b@-1(synchronizing).osd e0 _set_cache_ratios kv ratio 0.25 inc ratio 0.375 full ratio 0.375 2024-03-30T13:32:12.781 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:32:12 smithi181 ceph-mon[25762]: mon.b@-1(synchronizing).osd e0 register_cache_with_pcm pcm target: 2147483648 pcm max: 1020054732 pcm min: 134217728 inc_osd_cache size: 1 2024-03-30T13:32:12.781 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:32:12 smithi181 ceph-mon[25762]: mon.b@-1(synchronizing).osd e1 e1: 0 total, 0 up, 0 in 2024-03-30T13:32:12.781 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:32:12 smithi181 ceph-mon[25762]: mon.b@-1(synchronizing).osd e2 e2: 0 total, 0 up, 0 in 2024-03-30T13:32:12.781 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:32:12 smithi181 ceph-mon[25762]: mon.b@-1(synchronizing).osd e3 e3: 0 total, 0 up, 0 in 2024-03-30T13:32:12.781 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:32:12 smithi181 ceph-mon[25762]: mon.b@-1(synchronizing).osd e4 e4: 0 total, 0 up, 0 in 2024-03-30T13:32:12.781 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:32:12 smithi181 ceph-mon[25762]: mon.b@-1(synchronizing).osd e4 crush map has features 3314932999778484224, adjusting msgr requires 2024-03-30T13:32:12.781 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:32:12 smithi181 ceph-mon[25762]: mon.b@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-03-30T13:32:12.781 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:32:12 smithi181 ceph-mon[25762]: mon.b@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-03-30T13:32:12.781 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:32:12 smithi181 ceph-mon[25762]: mon.b@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-03-30T13:32:12.781 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:32:12 smithi181 ceph-mon[25762]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-30T13:32:12.781 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:32:12 smithi181 ceph-mon[25762]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-03-30T13:32:12.781 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:32:12 smithi181 ceph-mon[25762]: mon.a calling monitor election 2024-03-30T13:32:12.781 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:32:12 smithi181 ceph-mon[25762]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-30T13:32:12.781 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:32:12 smithi181 ceph-mon[25762]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-30T13:32:12.781 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:32:12 smithi181 ceph-mon[25762]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-30T13:32:12.782 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:32:12 smithi181 ceph-mon[25762]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-30T13:32:12.782 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:32:12 smithi181 ceph-mon[25762]: mon.c calling monitor election 2024-03-30T13:32:12.782 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:32:12 smithi181 ceph-mon[25762]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-30T13:32:12.782 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:32:12 smithi181 ceph-mon[25762]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-30T13:32:12.782 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:32:12 smithi181 ceph-mon[25762]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-30T13:32:12.782 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:32:12 smithi181 ceph-mon[25762]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-30T13:32:12.782 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:32:12 smithi181 ceph-mon[25762]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-03-30T13:32:12.782 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:32:12 smithi181 ceph-mon[25762]: monmap e2: 2 mons at {a=[v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0],c=[v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0]} 2024-03-30T13:32:12.782 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:32:12 smithi181 ceph-mon[25762]: fsmap 2024-03-30T13:32:12.782 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:32:12 smithi181 ceph-mon[25762]: osdmap e4: 0 total, 0 up, 0 in 2024-03-30T13:32:12.782 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:32:12 smithi181 ceph-mon[25762]: mgrmap e13: y(active, since 35s) 2024-03-30T13:32:12.782 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:32:12 smithi181 ceph-mon[25762]: overall HEALTH_OK 2024-03-30T13:32:12.782 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:32:12 smithi181 ceph-mon[25762]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' 2024-03-30T13:32:12.782 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:32:12 smithi181 ceph-mon[25762]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' 2024-03-30T13:32:12.783 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:32:12 smithi181 ceph-mon[25762]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-03-30T13:32:12.783 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:32:12 smithi181 ceph-mon[25762]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:32:12.783 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:32:12 smithi181 ceph-mon[25762]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' 2024-03-30T13:32:12.783 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:32:12 smithi181 ceph-mon[25762]: Deploying daemon mon.b on smithi181 2024-03-30T13:32:12.783 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:32:12 smithi181 ceph-mon[25762]: from='client.? 172.21.15.181:0/2949151252' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-03-30T13:32:12.783 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:32:12 smithi181 ceph-mon[25762]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-30T13:32:12.783 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:32:12 smithi181 ceph-mon[25762]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-30T13:32:12.783 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:32:12 smithi181 ceph-mon[25762]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-30T13:32:12.783 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:32:12 smithi181 ceph-mon[25762]: mon.b@-1(synchronizing).paxosservice(auth 1..5) refresh upgraded, format 0 -> 3 2024-03-30T13:32:12.783 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:32:12 smithi181 ceph-mon[25762]: mon.b@-1(synchronizing) e2 handle_conf_change mon_allow_pool_delete,mon_cluster_log_to_file 2024-03-30T13:32:13.506 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:32:13 smithi181 bash[25734]: e678a2a25c90c7b3e7081be401dd2b98c91678d6a0f1cb5cc0bcc6c809c921fb 2024-03-30T13:32:13.506 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:32:13 smithi181 systemd[1]: Started Ceph mon.b for 98ebaeb8-ee99-11ee-b647-cb9ed24678a4. 2024-03-30T13:32:14.218 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-03-30T13:32:14.218 DEBUG:teuthology.orchestra.run.smithi181:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 98ebaeb8-ee99-11ee-b647-cb9ed24678a4 -- ceph mon dump -f json 2024-03-30T13:32:17.953 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:32:17 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[25141]: 172.21.15.181 - - [30/Mar/2024:13:32:17] "POST /data HTTP/1.1" 200 46 "" "Python-urllib/3.9" 2024-03-30T13:32:17.954 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:32:17 smithi099 ceph-mon[29691]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-03-30T13:32:17.954 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:32:17 smithi099 ceph-mon[29691]: mon.a calling monitor election 2024-03-30T13:32:17.954 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:32:17 smithi099 ceph-mon[29691]: mon.c calling monitor election 2024-03-30T13:32:17.954 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:32:17 smithi099 ceph-mon[29691]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-30T13:32:17.954 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:32:17 smithi099 ceph-mon[29691]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-30T13:32:17.954 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:32:17 smithi099 ceph-mon[29691]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-30T13:32:17.954 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:32:17 smithi099 ceph-mon[29691]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-30T13:32:17.954 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:32:17 smithi099 ceph-mon[29691]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-30T13:32:17.954 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:32:17 smithi099 ceph-mon[29691]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-30T13:32:17.955 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:32:17 smithi099 ceph-mon[29691]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-30T13:32:17.955 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:32:17 smithi099 ceph-mon[29691]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-30T13:32:17.955 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:32:17 smithi099 ceph-mon[29691]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-30T13:32:17.955 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:32:17 smithi099 ceph-mon[29691]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-03-30T13:32:17.955 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:32:17 smithi099 ceph-mon[29691]: monmap e3: 3 mons at {a=[v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0],b=[v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0],c=[v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0]} 2024-03-30T13:32:17.955 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:32:17 smithi099 ceph-mon[29691]: fsmap 2024-03-30T13:32:17.955 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:32:17 smithi099 ceph-mon[29691]: osdmap e4: 0 total, 0 up, 0 in 2024-03-30T13:32:17.955 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:32:17 smithi099 ceph-mon[29691]: mgrmap e13: y(active, since 45s) 2024-03-30T13:32:17.955 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:32:17 smithi099 ceph-mon[29691]: Health check failed: 1/3 mons down, quorum a,c (MON_DOWN) 2024-03-30T13:32:17.955 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:32:17 smithi099 ceph-mon[29691]: Health detail: HEALTH_WARN 1/3 mons down, quorum a,c 2024-03-30T13:32:17.955 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:32:17 smithi099 ceph-mon[29691]: [WRN] MON_DOWN: 1/3 mons down, quorum a,c 2024-03-30T13:32:17.955 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:32:17 smithi099 ceph-mon[29691]: mon.b (rank 2) addr [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] is down (out of quorum) 2024-03-30T13:32:17.955 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:32:17 smithi099 ceph-mon[29691]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' 2024-03-30T13:32:17.955 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:32:17 smithi099 ceph-mon[29691]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' 2024-03-30T13:32:17.955 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:32:17 smithi099 ceph-mon[29691]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:32:17.956 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:32:17 smithi099 ceph-mon[29691]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:32:17.956 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:32:17 smithi099 ceph-mon[29691]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' 2024-03-30T13:32:17.956 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:32:17 smithi099 ceph-mon[29691]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:32:17.956 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:32:17 smithi099 ceph-mon[24912]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-03-30T13:32:17.956 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:32:17 smithi099 ceph-mon[24912]: mon.a calling monitor election 2024-03-30T13:32:17.956 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:32:17 smithi099 ceph-mon[24912]: mon.c calling monitor election 2024-03-30T13:32:17.956 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:32:17 smithi099 ceph-mon[24912]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-30T13:32:17.956 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:32:17 smithi099 ceph-mon[24912]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-30T13:32:17.956 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:32:17 smithi099 ceph-mon[24912]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-30T13:32:17.956 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:32:17 smithi099 ceph-mon[24912]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-30T13:32:17.956 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:32:17 smithi099 ceph-mon[24912]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-30T13:32:17.956 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:32:17 smithi099 ceph-mon[24912]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-30T13:32:17.956 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:32:17 smithi099 ceph-mon[24912]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-30T13:32:17.956 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:32:17 smithi099 ceph-mon[24912]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-30T13:32:17.957 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:32:17 smithi099 ceph-mon[24912]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-30T13:32:17.957 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:32:17 smithi099 ceph-mon[24912]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-03-30T13:32:17.957 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:32:17 smithi099 ceph-mon[24912]: monmap e3: 3 mons at {a=[v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0],b=[v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0],c=[v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0]} 2024-03-30T13:32:17.957 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:32:17 smithi099 ceph-mon[24912]: fsmap 2024-03-30T13:32:17.957 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:32:17 smithi099 ceph-mon[24912]: osdmap e4: 0 total, 0 up, 0 in 2024-03-30T13:32:17.957 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:32:17 smithi099 ceph-mon[24912]: mgrmap e13: y(active, since 45s) 2024-03-30T13:32:17.957 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:32:17 smithi099 ceph-mon[24912]: Health check failed: 1/3 mons down, quorum a,c (MON_DOWN) 2024-03-30T13:32:17.957 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:32:17 smithi099 ceph-mon[24912]: Health detail: HEALTH_WARN 1/3 mons down, quorum a,c 2024-03-30T13:32:17.957 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:32:17 smithi099 ceph-mon[24912]: [WRN] MON_DOWN: 1/3 mons down, quorum a,c 2024-03-30T13:32:17.957 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:32:17 smithi099 ceph-mon[24912]: mon.b (rank 2) addr [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] is down (out of quorum) 2024-03-30T13:32:17.957 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:32:17 smithi099 ceph-mon[24912]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' 2024-03-30T13:32:17.957 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:32:17 smithi099 ceph-mon[24912]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' 2024-03-30T13:32:17.957 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:32:17 smithi099 ceph-mon[24912]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:32:17.957 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:32:17 smithi099 ceph-mon[24912]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:32:17.957 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:32:17 smithi099 ceph-mon[24912]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' 2024-03-30T13:32:17.957 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:32:17 smithi099 ceph-mon[24912]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:32:17.970 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-03-30T13:32:17.970 INFO:teuthology.orchestra.run.smithi181.stdout:{"epoch":3,"fsid":"98ebaeb8-ee99-11ee-b647-cb9ed24678a4","modified":"2024-03-30T13:32:12.662639Z","created":"2024-03-30T13:30:34.451427Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:3300","nonce":0},{"type":"v1","addr":"172.21.15.99:6789","nonce":0}]},"addr":"172.21.15.99:6789/0","public_addr":"172.21.15.99:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:3301","nonce":0},{"type":"v1","addr":"172.21.15.99:6790","nonce":0}]},"addr":"172.21.15.99:6790/0","public_addr":"172.21.15.99:6790/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:3300","nonce":0},{"type":"v1","addr":"172.21.15.181:6789","nonce":0}]},"addr":"172.21.15.181:6789/0","public_addr":"172.21.15.181:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2024-03-30T13:32:17.973 INFO:teuthology.orchestra.run.smithi181.stderr:dumped monmap epoch 3 2024-03-30T13:32:18.799 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:32:18 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[25141]: 172.21.15.181 - - [30/Mar/2024:13:32:18] "POST /data HTTP/1.1" 200 46 "" "Python-urllib/3.9" 2024-03-30T13:32:19.087 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:32:18 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[25141]: 172.21.15.99 - - [30/Mar/2024:13:32:18] "POST /data HTTP/1.1" 200 46 "" "Python-urllib/3.9" 2024-03-30T13:32:19.087 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:32:18 smithi099 ceph-mon[24912]: Updating smithi099:/etc/ceph/ceph.conf 2024-03-30T13:32:19.087 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:32:18 smithi099 ceph-mon[24912]: Updating smithi181:/etc/ceph/ceph.conf 2024-03-30T13:32:19.087 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:32:18 smithi099 ceph-mon[24912]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' 2024-03-30T13:32:19.087 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:32:18 smithi099 ceph-mon[24912]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' 2024-03-30T13:32:19.087 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:32:18 smithi099 ceph-mon[24912]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' 2024-03-30T13:32:19.087 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:32:18 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:32:19.087 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:32:18 smithi099 ceph-mon[24912]: Reconfiguring mon.a (unknown last config time)... 2024-03-30T13:32:19.087 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:32:18 smithi099 ceph-mon[24912]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-03-30T13:32:19.088 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:32:18 smithi099 ceph-mon[24912]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-03-30T13:32:19.088 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:32:18 smithi099 ceph-mon[24912]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:32:19.088 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:32:18 smithi099 ceph-mon[24912]: Reconfiguring daemon mon.a on smithi099 2024-03-30T13:32:19.088 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:32:18 smithi099 ceph-mon[24912]: from='client.? 172.21.15.181:0/1102122435' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-03-30T13:32:19.088 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:32:18 smithi099 ceph-mon[24912]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-30T13:32:19.088 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:32:18 smithi099 ceph-mon[24912]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' 2024-03-30T13:32:19.088 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:32:18 smithi099 ceph-mon[24912]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-30T13:32:19.088 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:32:18 smithi099 ceph-mon[24912]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' 2024-03-30T13:32:19.088 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:32:18 smithi099 ceph-mon[24912]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' 2024-03-30T13:32:19.088 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:32:18 smithi099 ceph-mon[29691]: Updating smithi099:/etc/ceph/ceph.conf 2024-03-30T13:32:19.088 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:32:18 smithi099 ceph-mon[29691]: Updating smithi181:/etc/ceph/ceph.conf 2024-03-30T13:32:19.088 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:32:18 smithi099 ceph-mon[29691]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' 2024-03-30T13:32:19.088 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:32:18 smithi099 ceph-mon[29691]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' 2024-03-30T13:32:19.088 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:32:18 smithi099 ceph-mon[29691]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' 2024-03-30T13:32:19.089 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:32:18 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:32:19.089 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:32:18 smithi099 ceph-mon[29691]: Reconfiguring mon.a (unknown last config time)... 2024-03-30T13:32:19.089 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:32:18 smithi099 ceph-mon[29691]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-03-30T13:32:19.089 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:32:18 smithi099 ceph-mon[29691]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-03-30T13:32:19.089 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:32:18 smithi099 ceph-mon[29691]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:32:19.089 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:32:18 smithi099 ceph-mon[29691]: Reconfiguring daemon mon.a on smithi099 2024-03-30T13:32:19.089 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:32:18 smithi099 ceph-mon[29691]: from='client.? 172.21.15.181:0/1102122435' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-03-30T13:32:19.089 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:32:18 smithi099 ceph-mon[29691]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-30T13:32:19.089 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:32:18 smithi099 ceph-mon[29691]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' 2024-03-30T13:32:19.089 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:32:18 smithi099 ceph-mon[29691]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-30T13:32:19.089 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:32:18 smithi099 ceph-mon[29691]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' 2024-03-30T13:32:19.089 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:32:18 smithi099 ceph-mon[29691]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' 2024-03-30T13:32:19.529 INFO:tasks.cephadm:Generating final ceph.conf file... 2024-03-30T13:32:19.529 DEBUG:teuthology.orchestra.run.smithi099:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 98ebaeb8-ee99-11ee-b647-cb9ed24678a4 -- ceph config generate-minimal-conf 2024-03-30T13:32:19.756 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:32:19 smithi181 ceph-mon[25762]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-03-30T13:32:19.756 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:32:19 smithi181 ceph-mon[25762]: mon.a calling monitor election 2024-03-30T13:32:19.756 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:32:19 smithi181 ceph-mon[25762]: mon.c calling monitor election 2024-03-30T13:32:19.757 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:32:19 smithi181 ceph-mon[25762]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-30T13:32:19.757 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:32:19 smithi181 ceph-mon[25762]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-30T13:32:19.757 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:32:19 smithi181 ceph-mon[25762]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-30T13:32:19.757 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:32:19 smithi181 ceph-mon[25762]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-30T13:32:19.757 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:32:19 smithi181 ceph-mon[25762]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-30T13:32:19.757 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:32:19 smithi181 ceph-mon[25762]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-30T13:32:19.757 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:32:19 smithi181 ceph-mon[25762]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-30T13:32:19.757 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:32:19 smithi181 ceph-mon[25762]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-30T13:32:19.757 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:32:19 smithi181 ceph-mon[25762]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-30T13:32:19.757 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:32:19 smithi181 ceph-mon[25762]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-03-30T13:32:19.757 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:32:19 smithi181 ceph-mon[25762]: monmap e3: 3 mons at {a=[v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0],b=[v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0],c=[v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0]} 2024-03-30T13:32:19.757 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:32:19 smithi181 ceph-mon[25762]: fsmap 2024-03-30T13:32:19.757 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:32:19 smithi181 ceph-mon[25762]: osdmap e4: 0 total, 0 up, 0 in 2024-03-30T13:32:19.757 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:32:19 smithi181 ceph-mon[25762]: mgrmap e13: y(active, since 45s) 2024-03-30T13:32:19.757 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:32:19 smithi181 ceph-mon[25762]: Health check failed: 1/3 mons down, quorum a,c (MON_DOWN) 2024-03-30T13:32:19.758 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:32:19 smithi181 ceph-mon[25762]: Health detail: HEALTH_WARN 1/3 mons down, quorum a,c 2024-03-30T13:32:19.758 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:32:19 smithi181 ceph-mon[25762]: [WRN] MON_DOWN: 1/3 mons down, quorum a,c 2024-03-30T13:32:19.758 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:32:19 smithi181 ceph-mon[25762]: mon.b (rank 2) addr [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] is down (out of quorum) 2024-03-30T13:32:19.758 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:32:19 smithi181 ceph-mon[25762]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' 2024-03-30T13:32:19.758 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:32:19 smithi181 ceph-mon[25762]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' 2024-03-30T13:32:19.758 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:32:19 smithi181 ceph-mon[25762]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:32:19.758 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:32:19 smithi181 ceph-mon[25762]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:32:19.758 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:32:19 smithi181 ceph-mon[25762]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' 2024-03-30T13:32:19.758 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:32:19 smithi181 ceph-mon[25762]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:32:19.758 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:32:19 smithi181 ceph-mon[25762]: Updating smithi099:/etc/ceph/ceph.conf 2024-03-30T13:32:19.758 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:32:19 smithi181 ceph-mon[25762]: Updating smithi181:/etc/ceph/ceph.conf 2024-03-30T13:32:19.758 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:32:19 smithi181 ceph-mon[25762]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' 2024-03-30T13:32:19.758 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:32:19 smithi181 ceph-mon[25762]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' 2024-03-30T13:32:19.758 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:32:19 smithi181 ceph-mon[25762]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' 2024-03-30T13:32:19.759 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:32:19 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:32:19.759 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:32:19 smithi181 ceph-mon[25762]: Reconfiguring mon.a (unknown last config time)... 2024-03-30T13:32:19.759 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:32:19 smithi181 ceph-mon[25762]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-03-30T13:32:19.759 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:32:19 smithi181 ceph-mon[25762]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-03-30T13:32:19.759 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:32:19 smithi181 ceph-mon[25762]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:32:19.759 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:32:19 smithi181 ceph-mon[25762]: Reconfiguring daemon mon.a on smithi099 2024-03-30T13:32:19.759 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:32:19 smithi181 ceph-mon[25762]: from='client.? 172.21.15.181:0/1102122435' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-03-30T13:32:19.759 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:32:19 smithi181 ceph-mon[25762]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-30T13:32:19.759 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:32:19 smithi181 ceph-mon[25762]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' 2024-03-30T13:32:19.759 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:32:19 smithi181 ceph-mon[25762]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-30T13:32:19.759 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:32:19 smithi181 ceph-mon[25762]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' 2024-03-30T13:32:19.759 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:32:19 smithi181 ceph-mon[25762]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' 2024-03-30T13:32:20.061 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:32:20 smithi181 ceph-mon[25762]: mon.b calling monitor election 2024-03-30T13:32:20.062 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:32:20 smithi181 ceph-mon[25762]: mon.b calling monitor election 2024-03-30T13:32:20.062 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:32:20 smithi181 ceph-mon[25762]: mon.c calling monitor election 2024-03-30T13:32:20.062 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:32:20 smithi181 ceph-mon[25762]: mon.a calling monitor election 2024-03-30T13:32:20.062 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:32:20 smithi181 ceph-mon[25762]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-03-30T13:32:20.062 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:32:20 smithi181 ceph-mon[25762]: monmap e3: 3 mons at {a=[v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0],b=[v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0],c=[v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0]} 2024-03-30T13:32:20.062 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:32:20 smithi181 ceph-mon[25762]: fsmap 2024-03-30T13:32:20.062 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:32:20 smithi181 ceph-mon[25762]: osdmap e4: 0 total, 0 up, 0 in 2024-03-30T13:32:20.062 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:32:20 smithi181 ceph-mon[25762]: mgrmap e13: y(active, since 47s) 2024-03-30T13:32:20.062 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:32:20 smithi181 ceph-mon[25762]: Health check cleared: MON_DOWN (was: 1/3 mons down, quorum a,c) 2024-03-30T13:32:20.062 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:32:20 smithi181 ceph-mon[25762]: Cluster is now healthy 2024-03-30T13:32:20.062 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:32:20 smithi181 ceph-mon[25762]: overall HEALTH_OK 2024-03-30T13:32:20.062 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:32:20 smithi181 ceph-mon[25762]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' 2024-03-30T13:32:20.063 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:32:20 smithi181 ceph-mon[25762]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' 2024-03-30T13:32:20.231 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:32:19 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[25141]: 172.21.15.181 - - [30/Mar/2024:13:32:19] "POST /data HTTP/1.1" 200 46 "" "Python-urllib/3.9" 2024-03-30T13:32:20.231 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:32:20 smithi099 ceph-mon[24912]: mon.b calling monitor election 2024-03-30T13:32:20.231 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:32:20 smithi099 ceph-mon[24912]: mon.b calling monitor election 2024-03-30T13:32:20.232 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:32:20 smithi099 ceph-mon[24912]: mon.c calling monitor election 2024-03-30T13:32:20.232 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:32:20 smithi099 ceph-mon[24912]: mon.a calling monitor election 2024-03-30T13:32:20.232 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:32:20 smithi099 ceph-mon[24912]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-03-30T13:32:20.232 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:32:20 smithi099 ceph-mon[24912]: monmap e3: 3 mons at {a=[v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0],b=[v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0],c=[v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0]} 2024-03-30T13:32:20.232 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:32:20 smithi099 ceph-mon[24912]: fsmap 2024-03-30T13:32:20.232 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:32:20 smithi099 ceph-mon[24912]: osdmap e4: 0 total, 0 up, 0 in 2024-03-30T13:32:20.232 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:32:20 smithi099 ceph-mon[24912]: mgrmap e13: y(active, since 47s) 2024-03-30T13:32:20.232 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:32:20 smithi099 ceph-mon[24912]: Health check cleared: MON_DOWN (was: 1/3 mons down, quorum a,c) 2024-03-30T13:32:20.232 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:32:20 smithi099 ceph-mon[24912]: Cluster is now healthy 2024-03-30T13:32:20.232 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:32:20 smithi099 ceph-mon[24912]: overall HEALTH_OK 2024-03-30T13:32:20.232 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:32:20 smithi099 ceph-mon[24912]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' 2024-03-30T13:32:20.232 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:32:20 smithi099 ceph-mon[24912]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' 2024-03-30T13:32:20.232 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:32:20 smithi099 ceph-mon[29691]: mon.b calling monitor election 2024-03-30T13:32:20.233 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:32:20 smithi099 ceph-mon[29691]: mon.b calling monitor election 2024-03-30T13:32:20.233 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:32:20 smithi099 ceph-mon[29691]: mon.c calling monitor election 2024-03-30T13:32:20.233 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:32:20 smithi099 ceph-mon[29691]: mon.a calling monitor election 2024-03-30T13:32:20.233 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:32:20 smithi099 ceph-mon[29691]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-03-30T13:32:20.233 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:32:20 smithi099 ceph-mon[29691]: monmap e3: 3 mons at {a=[v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0],b=[v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0],c=[v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0]} 2024-03-30T13:32:20.233 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:32:20 smithi099 ceph-mon[29691]: fsmap 2024-03-30T13:32:20.233 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:32:20 smithi099 ceph-mon[29691]: osdmap e4: 0 total, 0 up, 0 in 2024-03-30T13:32:20.233 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:32:20 smithi099 ceph-mon[29691]: mgrmap e13: y(active, since 47s) 2024-03-30T13:32:20.233 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:32:20 smithi099 ceph-mon[29691]: Health check cleared: MON_DOWN (was: 1/3 mons down, quorum a,c) 2024-03-30T13:32:20.233 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:32:20 smithi099 ceph-mon[29691]: Cluster is now healthy 2024-03-30T13:32:20.233 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:32:20 smithi099 ceph-mon[29691]: overall HEALTH_OK 2024-03-30T13:32:20.233 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:32:20 smithi099 ceph-mon[29691]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' 2024-03-30T13:32:20.233 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:32:20 smithi099 ceph-mon[29691]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' 2024-03-30T13:32:21.379 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:32:21 smithi181 ceph-mon[25762]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' 2024-03-30T13:32:21.379 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:32:21 smithi181 ceph-mon[25762]: Reconfiguring mon.c (monmap changed)... 2024-03-30T13:32:21.379 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:32:21 smithi181 ceph-mon[25762]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-03-30T13:32:21.379 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:32:21 smithi181 ceph-mon[25762]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-03-30T13:32:21.379 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:32:21 smithi181 ceph-mon[25762]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:32:21.379 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:32:21 smithi181 ceph-mon[25762]: Reconfiguring daemon mon.c on smithi099 2024-03-30T13:32:21.379 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:32:21 smithi181 ceph-mon[25762]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-30T13:32:21.379 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:32:21 smithi181 ceph-mon[25762]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-30T13:32:21.537 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:32:21 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[25141]: 172.21.15.181 - - [30/Mar/2024:13:32:21] "POST /data HTTP/1.1" 200 46 "" "Python-urllib/3.9" 2024-03-30T13:32:21.537 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:32:21 smithi099 ceph-mon[29691]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' 2024-03-30T13:32:21.537 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:32:21 smithi099 ceph-mon[29691]: Reconfiguring mon.c (monmap changed)... 2024-03-30T13:32:21.537 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:32:21 smithi099 ceph-mon[29691]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-03-30T13:32:21.537 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:32:21 smithi099 ceph-mon[29691]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-03-30T13:32:21.537 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:32:21 smithi099 ceph-mon[29691]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:32:21.537 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:32:21 smithi099 ceph-mon[29691]: Reconfiguring daemon mon.c on smithi099 2024-03-30T13:32:21.537 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:32:21 smithi099 ceph-mon[29691]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-30T13:32:21.537 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:32:21 smithi099 ceph-mon[29691]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-30T13:32:21.538 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:32:21 smithi099 ceph-mon[24912]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' 2024-03-30T13:32:21.538 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:32:21 smithi099 ceph-mon[24912]: Reconfiguring mon.c (monmap changed)... 2024-03-30T13:32:21.538 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:32:21 smithi099 ceph-mon[24912]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-03-30T13:32:21.538 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:32:21 smithi099 ceph-mon[24912]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-03-30T13:32:21.538 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:32:21 smithi099 ceph-mon[24912]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:32:21.538 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:32:21 smithi099 ceph-mon[24912]: Reconfiguring daemon mon.c on smithi099 2024-03-30T13:32:21.538 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:32:21 smithi099 ceph-mon[24912]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-30T13:32:21.538 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:32:21 smithi099 ceph-mon[24912]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-30T13:32:22.382 INFO:teuthology.orchestra.run.smithi099.stdout:# minimal ceph.conf for 98ebaeb8-ee99-11ee-b647-cb9ed24678a4 2024-03-30T13:32:22.382 INFO:teuthology.orchestra.run.smithi099.stdout:[global] 2024-03-30T13:32:22.382 INFO:teuthology.orchestra.run.smithi099.stdout: fsid = 98ebaeb8-ee99-11ee-b647-cb9ed24678a4 2024-03-30T13:32:22.382 INFO:teuthology.orchestra.run.smithi099.stdout: mon_host = [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] 2024-03-30T13:32:22.665 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:32:22 smithi099 ceph-mon[24912]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' 2024-03-30T13:32:22.665 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:32:22 smithi099 ceph-mon[24912]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' 2024-03-30T13:32:22.665 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:32:22 smithi099 ceph-mon[24912]: from='client.? 172.21.15.99:0/434185667' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:32:22.665 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:32:22 smithi099 ceph-mon[24912]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' 2024-03-30T13:32:22.666 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:32:22 smithi099 ceph-mon[29691]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' 2024-03-30T13:32:22.666 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:32:22 smithi099 ceph-mon[29691]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' 2024-03-30T13:32:22.666 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:32:22 smithi099 ceph-mon[29691]: from='client.? 172.21.15.99:0/434185667' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:32:22.666 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:32:22 smithi099 ceph-mon[29691]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' 2024-03-30T13:32:22.756 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:32:22 smithi181 ceph-mon[25762]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' 2024-03-30T13:32:22.756 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:32:22 smithi181 ceph-mon[25762]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' 2024-03-30T13:32:22.756 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:32:22 smithi181 ceph-mon[25762]: from='client.? 172.21.15.99:0/434185667' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:32:22.756 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:32:22 smithi181 ceph-mon[25762]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' 2024-03-30T13:32:23.443 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:32:23 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[25141]: 172.21.15.99 - - [30/Mar/2024:13:32:23] "POST /data HTTP/1.1" 200 46 "" "Python-urllib/3.9" 2024-03-30T13:32:23.756 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:32:23 smithi181 ceph-mon[25762]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-30T13:32:23.756 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:32:23 smithi181 ceph-mon[25762]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' 2024-03-30T13:32:23.756 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:32:23 smithi181 ceph-mon[25762]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' 2024-03-30T13:32:23.837 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:32:23 smithi099 ceph-mon[24912]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-30T13:32:23.837 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:32:23 smithi099 ceph-mon[24912]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' 2024-03-30T13:32:23.837 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:32:23 smithi099 ceph-mon[24912]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' 2024-03-30T13:32:23.837 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:32:23 smithi099 ceph-mon[29691]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-30T13:32:23.837 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:32:23 smithi099 ceph-mon[29691]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' 2024-03-30T13:32:23.837 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:32:23 smithi099 ceph-mon[29691]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' 2024-03-30T13:32:23.897 INFO:tasks.cephadm:Distributing (final) config and client.admin keyring... 2024-03-30T13:32:23.897 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2024-03-30T13:32:23.897 DEBUG:teuthology.orchestra.run.smithi099:> sudo dd of=/etc/ceph/ceph.conf 2024-03-30T13:32:23.926 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2024-03-30T13:32:23.926 DEBUG:teuthology.orchestra.run.smithi099:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-03-30T13:32:23.993 DEBUG:teuthology.orchestra.run.smithi181:> set -ex 2024-03-30T13:32:23.993 DEBUG:teuthology.orchestra.run.smithi181:> sudo dd of=/etc/ceph/ceph.conf 2024-03-30T13:32:24.029 DEBUG:teuthology.orchestra.run.smithi181:> set -ex 2024-03-30T13:32:24.030 DEBUG:teuthology.orchestra.run.smithi181:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-03-30T13:32:24.100 INFO:tasks.cephadm:Adding mgr.y on smithi099 2024-03-30T13:32:24.100 INFO:tasks.cephadm:Adding mgr.x on smithi181 2024-03-30T13:32:24.100 DEBUG:teuthology.orchestra.run.smithi181:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 98ebaeb8-ee99-11ee-b647-cb9ed24678a4 -- ceph orch apply mgr '2;smithi099=y;smithi181=x' 2024-03-30T13:32:25.506 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:32:25 smithi181 ceph-mon[25762]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-30T13:32:25.506 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:32:25 smithi181 ceph-mon[25762]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' 2024-03-30T13:32:25.506 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:32:25 smithi181 ceph-mon[25762]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:32:25.506 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:32:25 smithi181 ceph-mon[25762]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:32:25.506 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:32:25 smithi181 ceph-mon[25762]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:32:25.506 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:32:25 smithi181 ceph-mon[25762]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' 2024-03-30T13:32:25.506 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:32:25 smithi181 ceph-mon[25762]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-03-30T13:32:25.507 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:32:25 smithi181 ceph-mon[25762]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-03-30T13:32:25.507 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:32:25 smithi181 ceph-mon[25762]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:32:25.837 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:32:25 smithi099 ceph-mon[29691]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-30T13:32:25.837 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:32:25 smithi099 ceph-mon[29691]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' 2024-03-30T13:32:25.837 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:32:25 smithi099 ceph-mon[29691]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:32:25.837 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:32:25 smithi099 ceph-mon[29691]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:32:25.837 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:32:25 smithi099 ceph-mon[29691]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:32:25.837 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:32:25 smithi099 ceph-mon[29691]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' 2024-03-30T13:32:25.837 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:32:25 smithi099 ceph-mon[29691]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-03-30T13:32:25.837 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:32:25 smithi099 ceph-mon[29691]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-03-30T13:32:25.837 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:32:25 smithi099 ceph-mon[29691]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:32:25.838 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:32:25 smithi099 ceph-mon[24912]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-30T13:32:25.838 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:32:25 smithi099 ceph-mon[24912]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' 2024-03-30T13:32:25.838 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:32:25 smithi099 ceph-mon[24912]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:32:25.838 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:32:25 smithi099 ceph-mon[24912]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:32:25.838 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:32:25 smithi099 ceph-mon[24912]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:32:25.838 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:32:25 smithi099 ceph-mon[24912]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' 2024-03-30T13:32:25.838 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:32:25 smithi099 ceph-mon[24912]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-03-30T13:32:25.838 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:32:25 smithi099 ceph-mon[24912]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-03-30T13:32:25.838 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:32:25 smithi099 ceph-mon[24912]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:32:26.744 INFO:teuthology.orchestra.run.smithi181.stdout:Scheduled mgr update... 2024-03-30T13:32:26.744 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:32:26 smithi181 ceph-mon[25762]: Reconfiguring mon.b (monmap changed)... 2024-03-30T13:32:26.745 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:32:26 smithi181 ceph-mon[25762]: Reconfiguring daemon mon.b on smithi181 2024-03-30T13:32:26.745 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:32:26 smithi181 ceph-mon[25762]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' 2024-03-30T13:32:26.837 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:32:26 smithi099 ceph-mon[24912]: Reconfiguring mon.b (monmap changed)... 2024-03-30T13:32:26.837 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:32:26 smithi099 ceph-mon[24912]: Reconfiguring daemon mon.b on smithi181 2024-03-30T13:32:26.837 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:32:26 smithi099 ceph-mon[24912]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' 2024-03-30T13:32:26.837 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:32:26 smithi099 ceph-mon[29691]: Reconfiguring mon.b (monmap changed)... 2024-03-30T13:32:26.837 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:32:26 smithi099 ceph-mon[29691]: Reconfiguring daemon mon.b on smithi181 2024-03-30T13:32:26.837 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:32:26 smithi099 ceph-mon[29691]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' 2024-03-30T13:32:27.255 DEBUG:teuthology.orchestra.run.smithi181:mgr.x> sudo journalctl -f -n 0 -u ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4@mgr.x.service 2024-03-30T13:32:27.257 INFO:tasks.cephadm:Deploying OSDs... 2024-03-30T13:32:27.257 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2024-03-30T13:32:27.257 DEBUG:teuthology.orchestra.run.smithi099:> dd if=/scratch_devs of=/dev/stdout 2024-03-30T13:32:27.276 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-03-30T13:32:27.276 DEBUG:teuthology.orchestra.run.smithi099:> stat /dev/vg_nvme/lv_1 2024-03-30T13:32:27.334 INFO:teuthology.orchestra.run.smithi099.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-03-30T13:32:27.334 INFO:teuthology.orchestra.run.smithi099.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-03-30T13:32:27.334 INFO:teuthology.orchestra.run.smithi099.stdout:Device: 5h/5d Inode: 667 Links: 1 2024-03-30T13:32:27.334 INFO:teuthology.orchestra.run.smithi099.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-03-30T13:32:27.334 INFO:teuthology.orchestra.run.smithi099.stdout:Context: system_u:object_r:device_t:s0 2024-03-30T13:32:27.334 INFO:teuthology.orchestra.run.smithi099.stdout:Access: 2024-03-30 13:32:22.501078046 +0000 2024-03-30T13:32:27.334 INFO:teuthology.orchestra.run.smithi099.stdout:Modify: 2024-03-30 13:29:32.988555351 +0000 2024-03-30T13:32:27.334 INFO:teuthology.orchestra.run.smithi099.stdout:Change: 2024-03-30 13:29:32.988555351 +0000 2024-03-30T13:32:27.334 INFO:teuthology.orchestra.run.smithi099.stdout: Birth: 2024-03-30 13:29:32.988555351 +0000 2024-03-30T13:32:27.335 DEBUG:teuthology.orchestra.run.smithi099:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-03-30T13:32:27.403 INFO:teuthology.orchestra.run.smithi099.stderr:1+0 records in 2024-03-30T13:32:27.403 INFO:teuthology.orchestra.run.smithi099.stderr:1+0 records out 2024-03-30T13:32:27.403 INFO:teuthology.orchestra.run.smithi099.stderr:512 bytes copied, 0.000279046 s, 1.8 MB/s 2024-03-30T13:32:27.404 DEBUG:teuthology.orchestra.run.smithi099:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-03-30T13:32:27.462 DEBUG:teuthology.orchestra.run.smithi099:> stat /dev/vg_nvme/lv_2 2024-03-30T13:32:27.506 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:32:27 smithi181 ceph-mon[25762]: from='client.24107 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "2;smithi099=y;smithi181=x", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T13:32:27.506 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:32:27 smithi181 ceph-mon[25762]: Saving service mgr spec with placement smithi099=y;smithi181=x;count:2 2024-03-30T13:32:27.506 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:32:27 smithi181 ceph-mon[25762]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-30T13:32:27.506 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:32:27 smithi181 ceph-mon[25762]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' 2024-03-30T13:32:27.506 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:32:27 smithi181 ceph-mon[25762]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:32:27.506 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:32:27 smithi181 ceph-mon[25762]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:32:27.506 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:32:27 smithi181 ceph-mon[25762]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:32:27.506 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:32:27 smithi181 ceph-mon[25762]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' 2024-03-30T13:32:27.506 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:32:27 smithi181 ceph-mon[25762]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-03-30T13:32:27.506 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:32:27 smithi181 ceph-mon[25762]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-03-30T13:32:27.506 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:32:27 smithi181 ceph-mon[25762]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "mgr services"}]: dispatch 2024-03-30T13:32:27.507 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:32:27 smithi181 ceph-mon[25762]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:32:27.520 INFO:teuthology.orchestra.run.smithi099.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-03-30T13:32:27.520 INFO:teuthology.orchestra.run.smithi099.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-03-30T13:32:27.520 INFO:teuthology.orchestra.run.smithi099.stdout:Device: 5h/5d Inode: 686 Links: 1 2024-03-30T13:32:27.520 INFO:teuthology.orchestra.run.smithi099.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-03-30T13:32:27.520 INFO:teuthology.orchestra.run.smithi099.stdout:Context: system_u:object_r:device_t:s0 2024-03-30T13:32:27.520 INFO:teuthology.orchestra.run.smithi099.stdout:Access: 2024-03-30 13:32:22.501078046 +0000 2024-03-30T13:32:27.520 INFO:teuthology.orchestra.run.smithi099.stdout:Modify: 2024-03-30 13:29:33.327548022 +0000 2024-03-30T13:32:27.520 INFO:teuthology.orchestra.run.smithi099.stdout:Change: 2024-03-30 13:29:33.327548022 +0000 2024-03-30T13:32:27.520 INFO:teuthology.orchestra.run.smithi099.stdout: Birth: 2024-03-30 13:29:33.327548022 +0000 2024-03-30T13:32:27.521 DEBUG:teuthology.orchestra.run.smithi099:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-03-30T13:32:27.587 INFO:teuthology.orchestra.run.smithi099.stderr:1+0 records in 2024-03-30T13:32:27.588 INFO:teuthology.orchestra.run.smithi099.stderr:1+0 records out 2024-03-30T13:32:27.588 INFO:teuthology.orchestra.run.smithi099.stderr:512 bytes copied, 0.00020656 s, 2.5 MB/s 2024-03-30T13:32:27.589 DEBUG:teuthology.orchestra.run.smithi099:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-03-30T13:32:27.646 DEBUG:teuthology.orchestra.run.smithi099:> stat /dev/vg_nvme/lv_3 2024-03-30T13:32:27.702 INFO:teuthology.orchestra.run.smithi099.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-03-30T13:32:27.702 INFO:teuthology.orchestra.run.smithi099.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-03-30T13:32:27.702 INFO:teuthology.orchestra.run.smithi099.stdout:Device: 5h/5d Inode: 705 Links: 1 2024-03-30T13:32:27.702 INFO:teuthology.orchestra.run.smithi099.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-03-30T13:32:27.702 INFO:teuthology.orchestra.run.smithi099.stdout:Context: system_u:object_r:device_t:s0 2024-03-30T13:32:27.702 INFO:teuthology.orchestra.run.smithi099.stdout:Access: 2024-03-30 13:32:22.501078046 +0000 2024-03-30T13:32:27.702 INFO:teuthology.orchestra.run.smithi099.stdout:Modify: 2024-03-30 13:29:33.661540802 +0000 2024-03-30T13:32:27.703 INFO:teuthology.orchestra.run.smithi099.stdout:Change: 2024-03-30 13:29:33.661540802 +0000 2024-03-30T13:32:27.703 INFO:teuthology.orchestra.run.smithi099.stdout: Birth: 2024-03-30 13:29:33.661540802 +0000 2024-03-30T13:32:27.703 DEBUG:teuthology.orchestra.run.smithi099:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-03-30T13:32:27.767 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:32:27 smithi099 ceph-mon[29691]: from='client.24107 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "2;smithi099=y;smithi181=x", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T13:32:27.767 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:32:27 smithi099 ceph-mon[29691]: Saving service mgr spec with placement smithi099=y;smithi181=x;count:2 2024-03-30T13:32:27.767 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:32:27 smithi099 ceph-mon[29691]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-30T13:32:27.767 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:32:27 smithi099 ceph-mon[29691]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' 2024-03-30T13:32:27.767 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:32:27 smithi099 ceph-mon[29691]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:32:27.768 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:32:27 smithi099 ceph-mon[29691]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:32:27.768 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:32:27 smithi099 ceph-mon[29691]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:32:27.768 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:32:27 smithi099 ceph-mon[29691]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' 2024-03-30T13:32:27.768 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:32:27 smithi099 ceph-mon[29691]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-03-30T13:32:27.768 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:32:27 smithi099 ceph-mon[29691]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-03-30T13:32:27.768 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:32:27 smithi099 ceph-mon[29691]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "mgr services"}]: dispatch 2024-03-30T13:32:27.768 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:32:27 smithi099 ceph-mon[29691]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:32:27.768 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:32:27 smithi099 ceph-mon[24912]: from='client.24107 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "2;smithi099=y;smithi181=x", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T13:32:27.768 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:32:27 smithi099 ceph-mon[24912]: Saving service mgr spec with placement smithi099=y;smithi181=x;count:2 2024-03-30T13:32:27.768 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:32:27 smithi099 ceph-mon[24912]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-30T13:32:27.768 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:32:27 smithi099 ceph-mon[24912]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' 2024-03-30T13:32:27.768 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:32:27 smithi099 ceph-mon[24912]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:32:27.769 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:32:27 smithi099 ceph-mon[24912]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:32:27.769 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:32:27 smithi099 ceph-mon[24912]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:32:27.769 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:32:27 smithi099 ceph-mon[24912]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' 2024-03-30T13:32:27.769 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:32:27 smithi099 ceph-mon[24912]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-03-30T13:32:27.769 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:32:27 smithi099 ceph-mon[24912]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-03-30T13:32:27.769 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:32:27 smithi099 ceph-mon[24912]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "mgr services"}]: dispatch 2024-03-30T13:32:27.769 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:32:27 smithi099 ceph-mon[24912]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:32:27.769 INFO:teuthology.orchestra.run.smithi099.stderr:1+0 records in 2024-03-30T13:32:27.769 INFO:teuthology.orchestra.run.smithi099.stderr:1+0 records out 2024-03-30T13:32:27.769 INFO:teuthology.orchestra.run.smithi099.stderr:512 bytes copied, 0.000207852 s, 2.5 MB/s 2024-03-30T13:32:27.771 DEBUG:teuthology.orchestra.run.smithi099:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-03-30T13:32:27.827 DEBUG:teuthology.orchestra.run.smithi099:> stat /dev/vg_nvme/lv_4 2024-03-30T13:32:27.884 INFO:teuthology.orchestra.run.smithi099.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-03-30T13:32:27.884 INFO:teuthology.orchestra.run.smithi099.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-03-30T13:32:27.884 INFO:teuthology.orchestra.run.smithi099.stdout:Device: 5h/5d Inode: 724 Links: 1 2024-03-30T13:32:27.884 INFO:teuthology.orchestra.run.smithi099.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-03-30T13:32:27.884 INFO:teuthology.orchestra.run.smithi099.stdout:Context: system_u:object_r:device_t:s0 2024-03-30T13:32:27.884 INFO:teuthology.orchestra.run.smithi099.stdout:Access: 2024-03-30 13:32:22.501078046 +0000 2024-03-30T13:32:27.884 INFO:teuthology.orchestra.run.smithi099.stdout:Modify: 2024-03-30 13:29:34.002533431 +0000 2024-03-30T13:32:27.884 INFO:teuthology.orchestra.run.smithi099.stdout:Change: 2024-03-30 13:29:34.002533431 +0000 2024-03-30T13:32:27.884 INFO:teuthology.orchestra.run.smithi099.stdout: Birth: 2024-03-30 13:29:34.002533431 +0000 2024-03-30T13:32:27.884 DEBUG:teuthology.orchestra.run.smithi099:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-03-30T13:32:27.950 INFO:teuthology.orchestra.run.smithi099.stderr:1+0 records in 2024-03-30T13:32:27.951 INFO:teuthology.orchestra.run.smithi099.stderr:1+0 records out 2024-03-30T13:32:27.951 INFO:teuthology.orchestra.run.smithi099.stderr:512 bytes copied, 0.000199085 s, 2.6 MB/s 2024-03-30T13:32:27.952 DEBUG:teuthology.orchestra.run.smithi099:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-03-30T13:32:28.008 DEBUG:teuthology.orchestra.run.smithi181:> set -ex 2024-03-30T13:32:28.008 DEBUG:teuthology.orchestra.run.smithi181:> dd if=/scratch_devs of=/dev/stdout 2024-03-30T13:32:28.023 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-03-30T13:32:28.024 DEBUG:teuthology.orchestra.run.smithi181:> stat /dev/vg_nvme/lv_1 2024-03-30T13:32:28.079 INFO:teuthology.orchestra.run.smithi181.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-03-30T13:32:28.079 INFO:teuthology.orchestra.run.smithi181.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-03-30T13:32:28.079 INFO:teuthology.orchestra.run.smithi181.stdout:Device: 5h/5d Inode: 667 Links: 1 2024-03-30T13:32:28.080 INFO:teuthology.orchestra.run.smithi181.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-03-30T13:32:28.080 INFO:teuthology.orchestra.run.smithi181.stdout:Context: system_u:object_r:device_t:s0 2024-03-30T13:32:28.080 INFO:teuthology.orchestra.run.smithi181.stdout:Access: 2024-03-30 13:32:20.759210499 +0000 2024-03-30T13:32:28.080 INFO:teuthology.orchestra.run.smithi181.stdout:Modify: 2024-03-30 13:29:17.011855489 +0000 2024-03-30T13:32:28.080 INFO:teuthology.orchestra.run.smithi181.stdout:Change: 2024-03-30 13:29:17.011855489 +0000 2024-03-30T13:32:28.080 INFO:teuthology.orchestra.run.smithi181.stdout: Birth: 2024-03-30 13:29:17.011855489 +0000 2024-03-30T13:32:28.080 DEBUG:teuthology.orchestra.run.smithi181:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-03-30T13:32:28.146 INFO:teuthology.orchestra.run.smithi181.stderr:1+0 records in 2024-03-30T13:32:28.146 INFO:teuthology.orchestra.run.smithi181.stderr:1+0 records out 2024-03-30T13:32:28.147 INFO:teuthology.orchestra.run.smithi181.stderr:512 bytes copied, 0.000208015 s, 2.5 MB/s 2024-03-30T13:32:28.148 DEBUG:teuthology.orchestra.run.smithi181:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-03-30T13:32:28.203 DEBUG:teuthology.orchestra.run.smithi181:> stat /dev/vg_nvme/lv_2 2024-03-30T13:32:28.257 INFO:teuthology.orchestra.run.smithi181.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-03-30T13:32:28.257 INFO:teuthology.orchestra.run.smithi181.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-03-30T13:32:28.257 INFO:teuthology.orchestra.run.smithi181.stdout:Device: 5h/5d Inode: 686 Links: 1 2024-03-30T13:32:28.257 INFO:teuthology.orchestra.run.smithi181.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-03-30T13:32:28.257 INFO:teuthology.orchestra.run.smithi181.stdout:Context: system_u:object_r:device_t:s0 2024-03-30T13:32:28.258 INFO:teuthology.orchestra.run.smithi181.stdout:Access: 2024-03-30 13:32:20.759210499 +0000 2024-03-30T13:32:28.258 INFO:teuthology.orchestra.run.smithi181.stdout:Modify: 2024-03-30 13:29:17.347848876 +0000 2024-03-30T13:32:28.258 INFO:teuthology.orchestra.run.smithi181.stdout:Change: 2024-03-30 13:29:17.347848876 +0000 2024-03-30T13:32:28.258 INFO:teuthology.orchestra.run.smithi181.stdout: Birth: 2024-03-30 13:29:17.347848876 +0000 2024-03-30T13:32:28.258 DEBUG:teuthology.orchestra.run.smithi181:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-03-30T13:32:28.455 INFO:teuthology.orchestra.run.smithi181.stderr:1+0 records in 2024-03-30T13:32:28.455 INFO:teuthology.orchestra.run.smithi181.stderr:1+0 records out 2024-03-30T13:32:28.455 INFO:teuthology.orchestra.run.smithi181.stderr:512 bytes copied, 0.000212536 s, 2.4 MB/s 2024-03-30T13:32:28.456 DEBUG:teuthology.orchestra.run.smithi181:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-03-30T13:32:28.471 DEBUG:teuthology.orchestra.run.smithi181:> stat /dev/vg_nvme/lv_3 2024-03-30T13:32:28.532 INFO:teuthology.orchestra.run.smithi181.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-03-30T13:32:28.533 INFO:teuthology.orchestra.run.smithi181.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-03-30T13:32:28.533 INFO:teuthology.orchestra.run.smithi181.stdout:Device: 5h/5d Inode: 706 Links: 1 2024-03-30T13:32:28.533 INFO:teuthology.orchestra.run.smithi181.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-03-30T13:32:28.533 INFO:teuthology.orchestra.run.smithi181.stdout:Context: system_u:object_r:device_t:s0 2024-03-30T13:32:28.533 INFO:teuthology.orchestra.run.smithi181.stdout:Access: 2024-03-30 13:32:28.412061069 +0000 2024-03-30T13:32:28.534 INFO:teuthology.orchestra.run.smithi181.stdout:Modify: 2024-03-30 13:29:17.705841829 +0000 2024-03-30T13:32:28.534 INFO:teuthology.orchestra.run.smithi181.stdout:Change: 2024-03-30 13:29:17.705841829 +0000 2024-03-30T13:32:28.534 INFO:teuthology.orchestra.run.smithi181.stdout: Birth: 2024-03-30 13:29:17.705841829 +0000 2024-03-30T13:32:28.534 DEBUG:teuthology.orchestra.run.smithi181:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-03-30T13:32:28.631 INFO:teuthology.orchestra.run.smithi181.stderr:1+0 records in 2024-03-30T13:32:28.631 INFO:teuthology.orchestra.run.smithi181.stderr:1+0 records out 2024-03-30T13:32:28.632 INFO:teuthology.orchestra.run.smithi181.stderr:512 bytes copied, 0.000193711 s, 2.6 MB/s 2024-03-30T13:32:28.633 DEBUG:teuthology.orchestra.run.smithi181:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-03-30T13:32:28.647 DEBUG:teuthology.orchestra.run.smithi181:> stat /dev/vg_nvme/lv_4 2024-03-30T13:32:28.703 INFO:teuthology.orchestra.run.smithi181.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-03-30T13:32:28.703 INFO:teuthology.orchestra.run.smithi181.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-03-30T13:32:28.703 INFO:teuthology.orchestra.run.smithi181.stdout:Device: 5h/5d Inode: 723 Links: 1 2024-03-30T13:32:28.703 INFO:teuthology.orchestra.run.smithi181.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-03-30T13:32:28.704 INFO:teuthology.orchestra.run.smithi181.stdout:Context: system_u:object_r:device_t:s0 2024-03-30T13:32:28.704 INFO:teuthology.orchestra.run.smithi181.stdout:Access: 2024-03-30 13:32:28.590057593 +0000 2024-03-30T13:32:28.704 INFO:teuthology.orchestra.run.smithi181.stdout:Modify: 2024-03-30 13:29:18.042835196 +0000 2024-03-30T13:32:28.704 INFO:teuthology.orchestra.run.smithi181.stdout:Change: 2024-03-30 13:29:18.042835196 +0000 2024-03-30T13:32:28.704 INFO:teuthology.orchestra.run.smithi181.stdout: Birth: 2024-03-30 13:29:18.042835196 +0000 2024-03-30T13:32:28.704 DEBUG:teuthology.orchestra.run.smithi181:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-03-30T13:32:28.755 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:32:28 smithi181 ceph-mon[25762]: Deploying daemon mgr.x on smithi181 2024-03-30T13:32:28.756 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 13:32:28 smithi181 systemd[1]: Starting Ceph mgr.x for 98ebaeb8-ee99-11ee-b647-cb9ed24678a4... 2024-03-30T13:32:28.773 INFO:teuthology.orchestra.run.smithi181.stderr:1+0 records in 2024-03-30T13:32:28.773 INFO:teuthology.orchestra.run.smithi181.stderr:1+0 records out 2024-03-30T13:32:28.773 INFO:teuthology.orchestra.run.smithi181.stderr:512 bytes copied, 0.000198913 s, 2.6 MB/s 2024-03-30T13:32:28.775 DEBUG:teuthology.orchestra.run.smithi181:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-03-30T13:32:28.830 INFO:tasks.cephadm:Deploying osd.0 on smithi099 with /dev/vg_nvme/lv_4... 2024-03-30T13:32:28.831 DEBUG:teuthology.orchestra.run.smithi099:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 98ebaeb8-ee99-11ee-b647-cb9ed24678a4 -- ceph-volume lvm zap /dev/vg_nvme/lv_4 2024-03-30T13:32:28.836 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:32:28 smithi099 ceph-mon[24912]: Deploying daemon mgr.x on smithi181 2024-03-30T13:32:28.837 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:32:28 smithi099 ceph-mon[29691]: Deploying daemon mgr.x on smithi181 2024-03-30T13:32:29.058 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 13:32:28 smithi181 podman[27280]: 2024-03-30 13:32:28.768753847 +0000 UTC m=+0.019194647 image pull e1d6a67b021eb077ee22bf650f1a9fb1980a2cf5c36bdb9cba9eac6de8f702d9 quay.io/ceph/ceph@sha256:12a0a4f43413fd97a14a3d47a3451b2d2df50020835bb93db666209f3f77617a 2024-03-30T13:32:29.058 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 13:32:28 smithi181 podman[27280]: 2024-03-30 13:32:28.872071845 +0000 UTC m=+0.122512659 container create c3667b1b85f3fd0be7d1d77020a57249328f60d2a05d4f32490050f01a312b9b (image=quay.io/ceph/ceph@sha256:12a0a4f43413fd97a14a3d47a3451b2d2df50020835bb93db666209f3f77617a, name=ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-x, vcs-ref=f1ee6e37554363ec55e0035aba1a693d3627fdeb, maintainer=Guillaume Abrioux , io.k8s.description=The Universal Base Image is designed and engineered to be the base layer for all of your containerized applications, middleware and utilities. This base image is freely redistributable, but Red Hat only supports Red Hat technologies through subscriptions for Red Hat products. This image is maintained by Red Hat and updated regularly., GIT_REPO=https://github.com/ceph/ceph-container.git, build-date=2022-05-03T08:36:31.336870, GIT_BRANCH=HEAD, RELEASE=HEAD, io.buildah.version=1.19.8, CEPH_POINT_RELEASE=-17.2.0, vendor=Red Hat, Inc., io.k8s.display-name=CentOS Stream 8, GIT_CLEAN=True, io.openshift.expose-services=, com.redhat.component=centos-stream-container, release=754, distribution-scope=public, GIT_COMMIT=b613db0f44179c0940781c1c7fe04e1acb7093ac, com.redhat.license_terms=https://centos.org/legal/licensing-policy/, version=8, name=centos-stream, ceph=True, architecture=x86_64, vcs-type=git, com.redhat.build-host=cpt-1002.osbs.prod.upshift.rdu2.redhat.com, io.openshift.tags=base centos centos-stream, url=https://access.redhat.com/containers/#/registry.access.redhat.com/ubi8/images/8.6-754, summary=Provides a CentOS Stream container based on the Red Hat Universal Base Image, description=CentOS Stream is a continuously delivered distro that tracks just ahead of Red Hat Enterprise Linux development. This image takes the Red Hat UBI and layers on content from CentOS Stream) 2024-03-30T13:32:29.058 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 13:32:29 smithi181 podman[27280]: 2024-03-30 13:32:29.05766503 +0000 UTC m=+0.308105809 container init c3667b1b85f3fd0be7d1d77020a57249328f60d2a05d4f32490050f01a312b9b (image=quay.io/ceph/ceph@sha256:12a0a4f43413fd97a14a3d47a3451b2d2df50020835bb93db666209f3f77617a, name=ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-x, maintainer=Guillaume Abrioux , GIT_CLEAN=True, io.k8s.display-name=CentOS Stream 8, version=8, com.redhat.build-host=cpt-1002.osbs.prod.upshift.rdu2.redhat.com, url=https://access.redhat.com/containers/#/registry.access.redhat.com/ubi8/images/8.6-754, io.openshift.expose-services=, RELEASE=HEAD, vendor=Red Hat, Inc., io.k8s.description=The Universal Base Image is designed and engineered to be the base layer for all of your containerized applications, middleware and utilities. This base image is freely redistributable, but Red Hat only supports Red Hat technologies through subscriptions for Red Hat products. This image is maintained by Red Hat and updated regularly., summary=Provides a CentOS Stream container based on the Red Hat Universal Base Image, vcs-ref=f1ee6e37554363ec55e0035aba1a693d3627fdeb, description=CentOS Stream is a continuously delivered distro that tracks just ahead of Red Hat Enterprise Linux development. This image takes the Red Hat UBI and layers on content from CentOS Stream, GIT_REPO=https://github.com/ceph/ceph-container.git, GIT_BRANCH=HEAD, vcs-type=git, CEPH_POINT_RELEASE=-17.2.0, name=centos-stream, build-date=2022-05-03T08:36:31.336870, release=754, architecture=x86_64, io.openshift.tags=base centos centos-stream, GIT_COMMIT=b613db0f44179c0940781c1c7fe04e1acb7093ac, ceph=True, io.buildah.version=1.19.8, distribution-scope=public, com.redhat.license_terms=https://centos.org/legal/licensing-policy/, com.redhat.component=centos-stream-container) 2024-03-30T13:32:29.476 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 13:32:29 smithi181 podman[27280]: 2024-03-30 13:32:29.06025397 +0000 UTC m=+0.310694743 container start c3667b1b85f3fd0be7d1d77020a57249328f60d2a05d4f32490050f01a312b9b (image=quay.io/ceph/ceph@sha256:12a0a4f43413fd97a14a3d47a3451b2d2df50020835bb93db666209f3f77617a, name=ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-x, architecture=x86_64, release=754, GIT_CLEAN=True, name=centos-stream, url=https://access.redhat.com/containers/#/registry.access.redhat.com/ubi8/images/8.6-754, com.redhat.component=centos-stream-container, GIT_REPO=https://github.com/ceph/ceph-container.git, io.k8s.description=The Universal Base Image is designed and engineered to be the base layer for all of your containerized applications, middleware and utilities. This base image is freely redistributable, but Red Hat only supports Red Hat technologies through subscriptions for Red Hat products. This image is maintained by Red Hat and updated regularly., com.redhat.license_terms=https://centos.org/legal/licensing-policy/, build-date=2022-05-03T08:36:31.336870, GIT_BRANCH=HEAD, summary=Provides a CentOS Stream container based on the Red Hat Universal Base Image, com.redhat.build-host=cpt-1002.osbs.prod.upshift.rdu2.redhat.com, RELEASE=HEAD, io.buildah.version=1.19.8, vcs-ref=f1ee6e37554363ec55e0035aba1a693d3627fdeb, io.k8s.display-name=CentOS Stream 8, io.openshift.expose-services=, io.openshift.tags=base centos centos-stream, GIT_COMMIT=b613db0f44179c0940781c1c7fe04e1acb7093ac, version=8, vcs-type=git, CEPH_POINT_RELEASE=-17.2.0, maintainer=Guillaume Abrioux , distribution-scope=public, ceph=True, description=CentOS Stream is a continuously delivered distro that tracks just ahead of Red Hat Enterprise Linux development. This image takes the Red Hat UBI and layers on content from CentOS Stream, vendor=Red Hat, Inc.) 2024-03-30T13:32:29.476 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 13:32:29 smithi181 ceph-mgr[27336]: -- 172.21.15.181:0/1950045861 <== mon.2 v2:172.21.15.181:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x56292bde2340 con 0x56292bdbac00 2024-03-30T13:32:29.476 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 13:32:29 smithi181 bash[27280]: c3667b1b85f3fd0be7d1d77020a57249328f60d2a05d4f32490050f01a312b9b 2024-03-30T13:32:29.476 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 13:32:29 smithi181 systemd[1]: Started Ceph mgr.x for 98ebaeb8-ee99-11ee-b647-cb9ed24678a4. 2024-03-30T13:32:29.756 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 13:32:29 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-x[27332]: 2024-03-30T13:32:29.554+0000 7f4789900000 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-03-30T13:32:29.756 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 13:32:29 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-x[27332]: 2024-03-30T13:32:29.642+0000 7f4789900000 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-03-30T13:32:29.756 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:32:29 smithi181 ceph-mon[25762]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-30T13:32:29.756 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:32:29 smithi181 ceph-mon[25762]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' 2024-03-30T13:32:29.756 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:32:29 smithi181 ceph-mon[25762]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:32:29.757 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:32:29 smithi181 ceph-mon[25762]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:32:29.757 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:32:29 smithi181 ceph-mon[25762]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:32:29.757 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:32:29 smithi181 ceph-mon[25762]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' 2024-03-30T13:32:29.757 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:32:29 smithi181 ceph-mon[25762]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-03-30T13:32:29.757 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:32:29 smithi181 ceph-mon[25762]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "mgr services"}]: dispatch 2024-03-30T13:32:29.757 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:32:29 smithi181 ceph-mon[25762]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:32:29.837 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:32:29 smithi099 ceph-mon[29691]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-30T13:32:29.837 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:32:29 smithi099 ceph-mon[29691]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' 2024-03-30T13:32:29.837 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:32:29 smithi099 ceph-mon[29691]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:32:29.837 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:32:29 smithi099 ceph-mon[29691]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:32:29.837 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:32:29 smithi099 ceph-mon[29691]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:32:29.838 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:32:29 smithi099 ceph-mon[29691]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' 2024-03-30T13:32:29.838 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:32:29 smithi099 ceph-mon[29691]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-03-30T13:32:29.838 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:32:29 smithi099 ceph-mon[29691]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "mgr services"}]: dispatch 2024-03-30T13:32:29.838 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:32:29 smithi099 ceph-mon[29691]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:32:29.838 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:32:29 smithi099 ceph-mon[24912]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-30T13:32:29.838 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:32:29 smithi099 ceph-mon[24912]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' 2024-03-30T13:32:29.838 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:32:29 smithi099 ceph-mon[24912]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:32:29.838 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:32:29 smithi099 ceph-mon[24912]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:32:29.838 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:32:29 smithi099 ceph-mon[24912]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:32:29.838 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:32:29 smithi099 ceph-mon[24912]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' 2024-03-30T13:32:29.838 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:32:29 smithi099 ceph-mon[24912]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-03-30T13:32:29.839 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:32:29 smithi099 ceph-mon[24912]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "mgr services"}]: dispatch 2024-03-30T13:32:29.839 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:32:29 smithi099 ceph-mon[24912]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:32:30.484 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 13:32:30 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-x[27332]: 2024-03-30T13:32:30.239+0000 7f4789900000 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-03-30T13:32:30.484 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 13:32:30 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-x[27332]: 2024-03-30T13:32:30.332+0000 7f4789900000 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-03-30T13:32:30.484 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 13:32:30 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-x[27332]: 2024-03-30T13:32:30.415+0000 7f4789900000 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-03-30T13:32:30.587 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:32:30 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:32:30.587 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:32:30 smithi099 ceph-mon[29691]: Reconfiguring mgr.y (unknown last config time)... 2024-03-30T13:32:30.587 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:32:30 smithi099 ceph-mon[29691]: Reconfiguring daemon mgr.y on smithi099 2024-03-30T13:32:30.587 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:32:30 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:32:30.587 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:32:30 smithi099 ceph-mon[24912]: Reconfiguring mgr.y (unknown last config time)... 2024-03-30T13:32:30.587 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:32:30 smithi099 ceph-mon[24912]: Reconfiguring daemon mgr.y on smithi099 2024-03-30T13:32:30.755 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 13:32:30 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-x[27332]: 2024-03-30T13:32:30.566+0000 7f4789900000 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-03-30T13:32:30.755 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 13:32:30 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-x[27332]: 2024-03-30T13:32:30.652+0000 7f4789900000 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-03-30T13:32:30.755 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:32:30 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:32:30.756 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:32:30 smithi181 ceph-mon[25762]: Reconfiguring mgr.y (unknown last config time)... 2024-03-30T13:32:30.756 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:32:30 smithi181 ceph-mon[25762]: Reconfiguring daemon mgr.y on smithi099 2024-03-30T13:32:30.791 INFO:teuthology.orchestra.run.smithi099.stderr:--> Zapping: /dev/vg_nvme/lv_4 2024-03-30T13:32:30.792 INFO:teuthology.orchestra.run.smithi099.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_4 bs=1M count=10 conv=fsync 2024-03-30T13:32:30.792 INFO:teuthology.orchestra.run.smithi099.stderr: stderr: 10+0 records in 2024-03-30T13:32:30.792 INFO:teuthology.orchestra.run.smithi099.stderr:10+0 records out 2024-03-30T13:32:30.792 INFO:teuthology.orchestra.run.smithi099.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0115255 s, 910 MB/s 2024-03-30T13:32:30.792 INFO:teuthology.orchestra.run.smithi099.stderr:--> Zapping successful for: 2024-03-30T13:32:31.006 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 13:32:30 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-x[27332]: 2024-03-30T13:32:30.787+0000 7f4789900000 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-03-30T13:32:31.006 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 13:32:30 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-x[27332]: 2024-03-30T13:32:30.881+0000 7f4789900000 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-03-30T13:32:31.485 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 13:32:31 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-x[27332]: 2024-03-30T13:32:31.047+0000 7f4789900000 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-03-30T13:32:31.485 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 13:32:31 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-x[27332]: 2024-03-30T13:32:31.144+0000 7f4789900000 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-03-30T13:32:31.726 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:32:31 smithi099 ceph-mon[24912]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-30T13:32:31.727 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:32:31 smithi099 ceph-mon[29691]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-30T13:32:31.756 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:32:31 smithi181 ceph-mon[25762]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-30T13:32:32.179 DEBUG:teuthology.orchestra.run.smithi099:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 98ebaeb8-ee99-11ee-b647-cb9ed24678a4 -- ceph orch daemon add osd smithi099:vg_nvme/lv_4 2024-03-30T13:32:32.491 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 13:32:32 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-x[27332]: 2024-03-30T13:32:32.255+0000 7f4789900000 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-03-30T13:32:32.492 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 13:32:32 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-x[27332]: 2024-03-30T13:32:32.385+0000 7f4789900000 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-03-30T13:32:32.524 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:32:32 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[25141]: 172.21.15.181 - - [30/Mar/2024:13:32:32] "POST /data HTTP/1.1" 200 46 "" "Python-urllib/3.9" 2024-03-30T13:32:32.756 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 13:32:32 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-x[27332]: 2024-03-30T13:32:32.578+0000 7f4789900000 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-03-30T13:32:32.756 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 13:32:32 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-x[27332]: 2024-03-30T13:32:32.664+0000 7f4789900000 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-03-30T13:32:32.780 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:32:32 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[25141]: 172.21.15.181 - - [30/Mar/2024:13:32:32] "POST /data HTTP/1.1" 200 46 "" "Python-urllib/3.9" 2024-03-30T13:32:33.087 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:32:32 smithi099 ceph-mon[24912]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' 2024-03-30T13:32:33.087 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:32:32 smithi099 ceph-mon[24912]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:32:33.087 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:32:32 smithi099 ceph-mon[24912]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:32:33.087 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:32:32 smithi099 ceph-mon[24912]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:32:33.087 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:32:32 smithi099 ceph-mon[24912]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' 2024-03-30T13:32:33.087 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:32:32 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:32:33.087 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:32:32 smithi099 ceph-mon[24912]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' 2024-03-30T13:32:33.087 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:32:32 smithi099 ceph-mon[24912]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' 2024-03-30T13:32:33.087 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:32:32 smithi099 ceph-mon[24912]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:32:33.088 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:32:32 smithi099 ceph-mon[24912]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:32:33.088 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:32:32 smithi099 ceph-mon[24912]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:32:33.088 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:32:32 smithi099 ceph-mon[24912]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' 2024-03-30T13:32:33.088 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:32:32 smithi099 ceph-mon[24912]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-30T13:32:33.088 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:32:32 smithi099 ceph-mon[24912]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-03-30T13:32:33.088 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:32:32 smithi099 ceph-mon[24912]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-03-30T13:32:33.088 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:32:32 smithi099 ceph-mon[24912]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' 2024-03-30T13:32:33.088 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:32:32 smithi099 ceph-mon[24912]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' 2024-03-30T13:32:33.088 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:32:32 smithi099 ceph-mon[24912]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' 2024-03-30T13:32:33.088 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:32:32 smithi099 ceph-mon[29691]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' 2024-03-30T13:32:33.088 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:32:32 smithi099 ceph-mon[29691]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:32:33.088 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:32:32 smithi099 ceph-mon[29691]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:32:33.088 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:32:32 smithi099 ceph-mon[29691]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:32:33.089 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:32:32 smithi099 ceph-mon[29691]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' 2024-03-30T13:32:33.089 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:32:32 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:32:33.089 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:32:32 smithi099 ceph-mon[29691]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' 2024-03-30T13:32:33.089 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:32:32 smithi099 ceph-mon[29691]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' 2024-03-30T13:32:33.089 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:32:32 smithi099 ceph-mon[29691]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:32:33.089 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:32:32 smithi099 ceph-mon[29691]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:32:33.089 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:32:32 smithi099 ceph-mon[29691]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:32:33.089 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:32:32 smithi099 ceph-mon[29691]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' 2024-03-30T13:32:33.089 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:32:32 smithi099 ceph-mon[29691]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-30T13:32:33.089 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:32:32 smithi099 ceph-mon[29691]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-03-30T13:32:33.089 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:32:32 smithi099 ceph-mon[29691]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-03-30T13:32:33.089 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:32:32 smithi099 ceph-mon[29691]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' 2024-03-30T13:32:33.089 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:32:32 smithi099 ceph-mon[29691]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' 2024-03-30T13:32:33.089 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:32:32 smithi099 ceph-mon[29691]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' 2024-03-30T13:32:33.121 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 13:32:32 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-x[27332]: 2024-03-30T13:32:32.800+0000 7f4789900000 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-03-30T13:32:33.121 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 13:32:33 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-x[27332]: 2024-03-30T13:32:33.119+0000 7f4789900000 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-03-30T13:32:33.122 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:32:32 smithi181 ceph-mon[25762]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' 2024-03-30T13:32:33.122 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:32:32 smithi181 ceph-mon[25762]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:32:33.122 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:32:32 smithi181 ceph-mon[25762]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:32:33.122 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:32:32 smithi181 ceph-mon[25762]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:32:33.122 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:32:32 smithi181 ceph-mon[25762]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' 2024-03-30T13:32:33.122 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:32:32 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:32:33.122 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:32:32 smithi181 ceph-mon[25762]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' 2024-03-30T13:32:33.122 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:32:32 smithi181 ceph-mon[25762]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' 2024-03-30T13:32:33.122 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:32:32 smithi181 ceph-mon[25762]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:32:33.122 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:32:32 smithi181 ceph-mon[25762]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:32:33.123 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:32:32 smithi181 ceph-mon[25762]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:32:33.123 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:32:32 smithi181 ceph-mon[25762]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' 2024-03-30T13:32:33.123 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:32:32 smithi181 ceph-mon[25762]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-30T13:32:33.123 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:32:32 smithi181 ceph-mon[25762]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-03-30T13:32:33.123 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:32:32 smithi181 ceph-mon[25762]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-03-30T13:32:33.123 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:32:32 smithi181 ceph-mon[25762]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' 2024-03-30T13:32:33.123 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:32:32 smithi181 ceph-mon[25762]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' 2024-03-30T13:32:33.123 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:32:32 smithi181 ceph-mon[25762]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' 2024-03-30T13:32:33.421 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 13:32:33 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-x[27332]: 2024-03-30T13:32:33.337+0000 7f4789900000 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-03-30T13:32:33.422 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 13:32:33 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-x[27332]: 2024-03-30T13:32:33.419+0000 7f4789900000 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-03-30T13:32:33.756 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 13:32:33 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-x[27332]: 2024-03-30T13:32:33.587+0000 7f4789900000 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-03-30T13:32:34.495 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:32:34 smithi181 ceph-mon[25762]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-03-30T13:32:34.495 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:32:34 smithi181 ceph-mon[25762]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-03-30T13:32:34.495 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:32:34 smithi181 ceph-mon[25762]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:32:34.530 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:32:34 smithi099 ceph-mon[29691]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-03-30T13:32:34.530 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:32:34 smithi099 ceph-mon[29691]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-03-30T13:32:34.530 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:32:34 smithi099 ceph-mon[29691]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:32:34.531 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:32:34 smithi099 ceph-mon[24912]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-03-30T13:32:34.531 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:32:34 smithi099 ceph-mon[24912]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-03-30T13:32:34.531 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:32:34 smithi099 ceph-mon[24912]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:32:34.756 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 13:32:34 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-x[27332]: 2024-03-30T13:32:34.492+0000 7f4789900000 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-03-30T13:32:35.171 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 13:32:34 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-x[27332]: 2024-03-30T13:32:34.781+0000 7f4789900000 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-03-30T13:32:35.171 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 13:32:34 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-x[27332]: 2024-03-30T13:32:34.872+0000 7f4789900000 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-03-30T13:32:35.171 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 13:32:35 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-x[27332]: 2024-03-30T13:32:35.019+0000 7f4789900000 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-03-30T13:32:35.495 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:32:35 smithi099 ceph-mon[29691]: from='client.24112 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi099:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T13:32:35.552 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:32:35 smithi099 ceph-mon[29691]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-30T13:32:35.552 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:32:35 smithi099 ceph-mon[29691]: Standby manager daemon x started 2024-03-30T13:32:35.552 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:32:35 smithi099 ceph-mon[29691]: from='mgr.? 172.21.15.181:0/3831835465' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/crt"}]: dispatch 2024-03-30T13:32:35.552 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:32:35 smithi099 ceph-mon[29691]: from='mgr.? 172.21.15.181:0/3831835465' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-03-30T13:32:35.552 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:32:35 smithi099 ceph-mon[29691]: from='mgr.? 172.21.15.181:0/3831835465' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/key"}]: dispatch 2024-03-30T13:32:35.552 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:32:35 smithi099 ceph-mon[29691]: from='mgr.? 172.21.15.181:0/3831835465' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-03-30T13:32:35.553 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:32:35 smithi099 ceph-mon[24912]: from='client.24112 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi099:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T13:32:35.553 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:32:35 smithi099 ceph-mon[24912]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-30T13:32:35.553 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:32:35 smithi099 ceph-mon[24912]: Standby manager daemon x started 2024-03-30T13:32:35.553 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:32:35 smithi099 ceph-mon[24912]: from='mgr.? 172.21.15.181:0/3831835465' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/crt"}]: dispatch 2024-03-30T13:32:35.553 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:32:35 smithi099 ceph-mon[24912]: from='mgr.? 172.21.15.181:0/3831835465' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-03-30T13:32:35.553 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:32:35 smithi099 ceph-mon[24912]: from='mgr.? 172.21.15.181:0/3831835465' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/key"}]: dispatch 2024-03-30T13:32:35.553 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:32:35 smithi099 ceph-mon[24912]: from='mgr.? 172.21.15.181:0/3831835465' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-03-30T13:32:35.553 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:32:35 smithi181 ceph-mon[25762]: from='client.24112 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi099:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T13:32:35.554 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:32:35 smithi181 ceph-mon[25762]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-30T13:32:35.554 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:32:35 smithi181 ceph-mon[25762]: Standby manager daemon x started 2024-03-30T13:32:35.554 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:32:35 smithi181 ceph-mon[25762]: from='mgr.? 172.21.15.181:0/3831835465' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/crt"}]: dispatch 2024-03-30T13:32:35.554 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:32:35 smithi181 ceph-mon[25762]: from='mgr.? 172.21.15.181:0/3831835465' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-03-30T13:32:35.554 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:32:35 smithi181 ceph-mon[25762]: from='mgr.? 172.21.15.181:0/3831835465' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/key"}]: dispatch 2024-03-30T13:32:35.554 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:32:35 smithi181 ceph-mon[25762]: from='mgr.? 172.21.15.181:0/3831835465' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-03-30T13:32:36.506 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:32:36 smithi181 ceph-mon[25762]: mgrmap e14: y(active, since 62s), standbys: x 2024-03-30T13:32:36.506 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:32:36 smithi181 ceph-mon[25762]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-03-30T13:32:36.587 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:32:36 smithi099 ceph-mon[29691]: mgrmap e14: y(active, since 62s), standbys: x 2024-03-30T13:32:36.587 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:32:36 smithi099 ceph-mon[29691]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-03-30T13:32:36.587 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:32:36 smithi099 ceph-mon[24912]: mgrmap e14: y(active, since 62s), standbys: x 2024-03-30T13:32:36.587 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:32:36 smithi099 ceph-mon[24912]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-03-30T13:32:37.506 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:32:37 smithi181 ceph-mon[25762]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-30T13:32:37.506 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:32:37 smithi181 ceph-mon[25762]: from='client.? 172.21.15.99:0/2480755326' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "c684cee9-dc80-4a4a-8db8-8553daf0cc4f"}]: dispatch 2024-03-30T13:32:37.506 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:32:37 smithi181 ceph-mon[25762]: from='client.? 172.21.15.99:0/2480755326' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "c684cee9-dc80-4a4a-8db8-8553daf0cc4f"}]': finished 2024-03-30T13:32:37.506 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:32:37 smithi181 ceph-mon[25762]: osdmap e5: 1 total, 0 up, 1 in 2024-03-30T13:32:37.506 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:32:37 smithi181 ceph-mon[25762]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-03-30T13:32:37.506 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:32:37 smithi181 ceph-mon[25762]: from='client.? 172.21.15.99:0/1120622891' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-03-30T13:32:37.587 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:32:37 smithi099 ceph-mon[29691]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-30T13:32:37.587 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:32:37 smithi099 ceph-mon[29691]: from='client.? 172.21.15.99:0/2480755326' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "c684cee9-dc80-4a4a-8db8-8553daf0cc4f"}]: dispatch 2024-03-30T13:32:37.587 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:32:37 smithi099 ceph-mon[29691]: from='client.? 172.21.15.99:0/2480755326' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "c684cee9-dc80-4a4a-8db8-8553daf0cc4f"}]': finished 2024-03-30T13:32:37.587 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:32:37 smithi099 ceph-mon[29691]: osdmap e5: 1 total, 0 up, 1 in 2024-03-30T13:32:37.587 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:32:37 smithi099 ceph-mon[29691]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-03-30T13:32:37.588 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:32:37 smithi099 ceph-mon[29691]: from='client.? 172.21.15.99:0/1120622891' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-03-30T13:32:37.588 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:32:37 smithi099 ceph-mon[24912]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-30T13:32:37.588 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:32:37 smithi099 ceph-mon[24912]: from='client.? 172.21.15.99:0/2480755326' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "c684cee9-dc80-4a4a-8db8-8553daf0cc4f"}]: dispatch 2024-03-30T13:32:37.588 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:32:37 smithi099 ceph-mon[24912]: from='client.? 172.21.15.99:0/2480755326' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "c684cee9-dc80-4a4a-8db8-8553daf0cc4f"}]': finished 2024-03-30T13:32:37.588 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:32:37 smithi099 ceph-mon[24912]: osdmap e5: 1 total, 0 up, 1 in 2024-03-30T13:32:37.588 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:32:37 smithi099 ceph-mon[24912]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-03-30T13:32:37.588 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:32:37 smithi099 ceph-mon[24912]: from='client.? 172.21.15.99:0/1120622891' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-03-30T13:32:39.302 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:32:39 smithi099 ceph-mon[24912]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-30T13:32:39.302 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:32:39 smithi099 ceph-mon[29691]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-30T13:32:39.505 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:32:39 smithi181 ceph-mon[25762]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-30T13:32:41.755 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:32:41 smithi181 ceph-mon[25762]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-30T13:32:41.791 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:32:41 smithi099 ceph-mon[24912]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-30T13:32:41.791 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:32:41 smithi099 ceph-mon[29691]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-30T13:32:43.756 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:32:43 smithi181 ceph-mon[25762]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-30T13:32:43.756 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:32:43 smithi181 ceph-mon[25762]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' 2024-03-30T13:32:43.756 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:32:43 smithi181 ceph-mon[25762]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' 2024-03-30T13:32:43.774 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:32:43 smithi099 ceph-mon[24912]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-30T13:32:43.774 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:32:43 smithi099 ceph-mon[24912]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' 2024-03-30T13:32:43.774 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:32:43 smithi099 ceph-mon[24912]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' 2024-03-30T13:32:43.774 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:32:43 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[25141]: 172.21.15.99 - - [30/Mar/2024:13:32:43] "POST /data HTTP/1.1" 200 46 "" "Python-urllib/3.9" 2024-03-30T13:32:43.775 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:32:43 smithi099 ceph-mon[29691]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-30T13:32:43.775 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:32:43 smithi099 ceph-mon[29691]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' 2024-03-30T13:32:43.775 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:32:43 smithi099 ceph-mon[29691]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' 2024-03-30T13:32:44.725 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:32:44 smithi099 ceph-mon[24912]: Detected new or changed devices on smithi099 2024-03-30T13:32:44.725 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:32:44 smithi099 ceph-mon[24912]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-03-30T13:32:44.725 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:32:44 smithi099 ceph-mon[24912]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:32:44.725 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:32:44 smithi099 ceph-mon[29691]: Detected new or changed devices on smithi099 2024-03-30T13:32:44.725 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:32:44 smithi099 ceph-mon[29691]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-03-30T13:32:44.725 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:32:44 smithi099 ceph-mon[29691]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:32:44.755 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:32:44 smithi181 ceph-mon[25762]: Detected new or changed devices on smithi099 2024-03-30T13:32:44.756 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:32:44 smithi181 ceph-mon[25762]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-03-30T13:32:44.756 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:32:44 smithi181 ceph-mon[25762]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:32:45.755 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:32:45 smithi181 ceph-mon[25762]: Deploying daemon osd.0 on smithi099 2024-03-30T13:32:45.801 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:32:45 smithi181 ceph-mon[25762]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-30T13:32:45.801 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:32:45 smithi099 ceph-mon[24912]: Deploying daemon osd.0 on smithi099 2024-03-30T13:32:45.801 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:32:45 smithi099 ceph-mon[24912]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-30T13:32:45.802 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:32:45 smithi099 ceph-mon[29691]: Deploying daemon osd.0 on smithi099 2024-03-30T13:32:45.802 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:32:45 smithi099 ceph-mon[29691]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-30T13:32:47.755 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:32:47 smithi099 ceph-mon[24912]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-30T13:32:47.755 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:32:47 smithi099 ceph-mon[29691]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-30T13:32:47.755 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:32:47 smithi181 ceph-mon[25762]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-30T13:32:49.283 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:32:49 smithi099 ceph-mon[24912]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-30T13:32:49.283 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:32:49 smithi099 ceph-mon[29691]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-30T13:32:49.506 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:32:49 smithi181 ceph-mon[25762]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-30T13:32:50.506 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:32:50 smithi181 ceph-mon[25762]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' 2024-03-30T13:32:50.506 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:32:50 smithi181 ceph-mon[25762]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:32:50.506 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:32:50 smithi181 ceph-mon[25762]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:32:50.506 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:32:50 smithi181 ceph-mon[25762]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:32:50.506 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:32:50 smithi181 ceph-mon[25762]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' 2024-03-30T13:32:50.506 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:32:50 smithi181 ceph-mon[25762]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' 2024-03-30T13:32:50.575 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:32:50 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[25141]: 172.21.15.181 - - [30/Mar/2024:13:32:50] "POST /data HTTP/1.1" 200 46 "" "Python-urllib/3.9" 2024-03-30T13:32:50.576 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:32:50 smithi099 ceph-mon[24912]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' 2024-03-30T13:32:50.576 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:32:50 smithi099 ceph-mon[24912]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:32:50.576 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:32:50 smithi099 ceph-mon[24912]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:32:50.576 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:32:50 smithi099 ceph-mon[24912]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:32:50.576 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:32:50 smithi099 ceph-mon[24912]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' 2024-03-30T13:32:50.576 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:32:50 smithi099 ceph-mon[24912]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' 2024-03-30T13:32:50.576 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:32:50 smithi099 ceph-mon[29691]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' 2024-03-30T13:32:50.577 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:32:50 smithi099 ceph-mon[29691]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:32:50.577 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:32:50 smithi099 ceph-mon[29691]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:32:50.577 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:32:50 smithi099 ceph-mon[29691]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:32:50.577 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:32:50 smithi099 ceph-mon[29691]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' 2024-03-30T13:32:50.577 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:32:50 smithi099 ceph-mon[29691]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' 2024-03-30T13:32:51.506 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:32:51 smithi181 ceph-mon[25762]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' 2024-03-30T13:32:51.506 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:32:51 smithi181 ceph-mon[25762]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-30T13:32:51.587 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:32:51 smithi099 ceph-mon[24912]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' 2024-03-30T13:32:51.587 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:32:51 smithi099 ceph-mon[24912]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-30T13:32:51.587 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:32:51 smithi099 ceph-mon[29691]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' 2024-03-30T13:32:51.587 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:32:51 smithi099 ceph-mon[29691]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-30T13:32:51.953 INFO:teuthology.orchestra.run.smithi099.stdout:Created osd(s) 0 on host 'smithi099' 2024-03-30T13:32:52.575 DEBUG:teuthology.orchestra.run.smithi099:osd.0> sudo journalctl -f -n 0 -u ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4@osd.0.service 2024-03-30T13:32:52.577 INFO:tasks.cephadm:Deploying osd.1 on smithi099 with /dev/vg_nvme/lv_3... 2024-03-30T13:32:52.577 DEBUG:teuthology.orchestra.run.smithi099:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 98ebaeb8-ee99-11ee-b647-cb9ed24678a4 -- ceph-volume lvm zap /dev/vg_nvme/lv_3 2024-03-30T13:32:53.044 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:32:52 smithi181 ceph-mon[25762]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' 2024-03-30T13:32:53.044 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:32:52 smithi181 ceph-mon[25762]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:32:53.044 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:32:52 smithi181 ceph-mon[25762]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:32:53.045 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:32:52 smithi181 ceph-mon[25762]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:32:53.045 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:32:52 smithi181 ceph-mon[25762]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-03-30T13:32:53.045 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:32:52 smithi181 ceph-mon[25762]: Adjusting osd_memory_target on smithi099 to 15040M 2024-03-30T13:32:53.045 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:32:52 smithi181 ceph-mon[25762]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' 2024-03-30T13:32:53.045 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:32:52 smithi181 ceph-mon[25762]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' 2024-03-30T13:32:53.045 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:32:52 smithi181 ceph-mon[25762]: from='osd.0 [v2:172.21.15.99:6802/558005496,v1:172.21.15.99:6803/558005496]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-03-30T13:32:53.045 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:32:52 smithi181 ceph-mon[25762]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-30T13:32:53.189 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:32:52 smithi099 ceph-mon[24912]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' 2024-03-30T13:32:53.189 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:32:52 smithi099 ceph-mon[24912]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:32:53.189 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:32:52 smithi099 ceph-mon[24912]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:32:53.189 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:32:52 smithi099 ceph-mon[24912]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:32:53.189 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:32:52 smithi099 ceph-mon[24912]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-03-30T13:32:53.189 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:32:52 smithi099 ceph-mon[24912]: Adjusting osd_memory_target on smithi099 to 15040M 2024-03-30T13:32:53.190 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:32:52 smithi099 ceph-mon[24912]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' 2024-03-30T13:32:53.190 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:32:52 smithi099 ceph-mon[24912]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' 2024-03-30T13:32:53.190 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:32:52 smithi099 ceph-mon[24912]: from='osd.0 [v2:172.21.15.99:6802/558005496,v1:172.21.15.99:6803/558005496]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-03-30T13:32:53.190 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:32:52 smithi099 ceph-mon[24912]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-30T13:32:53.190 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:32:52 smithi099 ceph-mon[29691]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' 2024-03-30T13:32:53.190 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:32:52 smithi099 ceph-mon[29691]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:32:53.190 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:32:52 smithi099 ceph-mon[29691]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:32:53.190 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:32:52 smithi099 ceph-mon[29691]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:32:53.190 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:32:52 smithi099 ceph-mon[29691]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-03-30T13:32:53.190 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:32:52 smithi099 ceph-mon[29691]: Adjusting osd_memory_target on smithi099 to 15040M 2024-03-30T13:32:53.190 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:32:52 smithi099 ceph-mon[29691]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' 2024-03-30T13:32:53.190 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:32:52 smithi099 ceph-mon[29691]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' 2024-03-30T13:32:53.191 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:32:52 smithi099 ceph-mon[29691]: from='osd.0 [v2:172.21.15.99:6802/558005496,v1:172.21.15.99:6803/558005496]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-03-30T13:32:53.191 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:32:52 smithi099 ceph-mon[29691]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-30T13:32:54.254 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:32:53 smithi099 ceph-mon[24912]: from='osd.0 [v2:172.21.15.99:6802/558005496,v1:172.21.15.99:6803/558005496]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-03-30T13:32:54.254 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:32:53 smithi099 ceph-mon[24912]: osdmap e6: 1 total, 0 up, 1 in 2024-03-30T13:32:54.254 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:32:53 smithi099 ceph-mon[24912]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-03-30T13:32:54.254 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:32:53 smithi099 ceph-mon[24912]: from='osd.0 [v2:172.21.15.99:6802/558005496,v1:172.21.15.99:6803/558005496]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi099", "root=default"]}]: dispatch 2024-03-30T13:32:54.254 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:32:53 smithi099 ceph-mon[29691]: from='osd.0 [v2:172.21.15.99:6802/558005496,v1:172.21.15.99:6803/558005496]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-03-30T13:32:54.255 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:32:53 smithi099 ceph-mon[29691]: osdmap e6: 1 total, 0 up, 1 in 2024-03-30T13:32:54.255 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:32:53 smithi099 ceph-mon[29691]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-03-30T13:32:54.255 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:32:53 smithi099 ceph-mon[29691]: from='osd.0 [v2:172.21.15.99:6802/558005496,v1:172.21.15.99:6803/558005496]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi099", "root=default"]}]: dispatch 2024-03-30T13:32:54.255 INFO:journalctl@ceph.osd.0.smithi099.stdout:Mar 30 13:32:53 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-0[33076]: 2024-03-30T13:32:53.973+0000 7f26e522e700 -1 osd.0 0 waiting for initial osdmap 2024-03-30T13:32:54.255 INFO:journalctl@ceph.osd.0.smithi099.stdout:Mar 30 13:32:53 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-0[33076]: 2024-03-30T13:32:53.979+0000 7f26e13c8700 -1 osd.0 7 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-03-30T13:32:54.256 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:32:53 smithi181 ceph-mon[25762]: from='osd.0 [v2:172.21.15.99:6802/558005496,v1:172.21.15.99:6803/558005496]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-03-30T13:32:54.256 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:32:53 smithi181 ceph-mon[25762]: osdmap e6: 1 total, 0 up, 1 in 2024-03-30T13:32:54.256 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:32:53 smithi181 ceph-mon[25762]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-03-30T13:32:54.256 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:32:53 smithi181 ceph-mon[25762]: from='osd.0 [v2:172.21.15.99:6802/558005496,v1:172.21.15.99:6803/558005496]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi099", "root=default"]}]: dispatch 2024-03-30T13:32:54.622 INFO:teuthology.orchestra.run.smithi099.stderr:--> Zapping: /dev/vg_nvme/lv_3 2024-03-30T13:32:54.622 INFO:teuthology.orchestra.run.smithi099.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_3 bs=1M count=10 conv=fsync 2024-03-30T13:32:54.622 INFO:teuthology.orchestra.run.smithi099.stderr: stderr: 10+0 records in 2024-03-30T13:32:54.622 INFO:teuthology.orchestra.run.smithi099.stderr:10+0 records out 2024-03-30T13:32:54.622 INFO:teuthology.orchestra.run.smithi099.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0125342 s, 837 MB/s 2024-03-30T13:32:54.622 INFO:teuthology.orchestra.run.smithi099.stderr:--> Zapping successful for: 2024-03-30T13:32:55.248 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:32:54 smithi099 ceph-mon[24912]: from='osd.0 [v2:172.21.15.99:6802/558005496,v1:172.21.15.99:6803/558005496]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi099", "root=default"]}]': finished 2024-03-30T13:32:55.248 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:32:54 smithi099 ceph-mon[24912]: osdmap e7: 1 total, 0 up, 1 in 2024-03-30T13:32:55.248 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:32:54 smithi099 ceph-mon[24912]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-03-30T13:32:55.248 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:32:54 smithi099 ceph-mon[24912]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-03-30T13:32:55.248 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:32:54 smithi099 ceph-mon[24912]: pgmap v38: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-30T13:32:55.248 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:32:54 smithi099 ceph-mon[24912]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-03-30T13:32:55.248 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:32:54 smithi099 ceph-mon[29691]: from='osd.0 [v2:172.21.15.99:6802/558005496,v1:172.21.15.99:6803/558005496]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi099", "root=default"]}]': finished 2024-03-30T13:32:55.248 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:32:54 smithi099 ceph-mon[29691]: osdmap e7: 1 total, 0 up, 1 in 2024-03-30T13:32:55.249 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:32:54 smithi099 ceph-mon[29691]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-03-30T13:32:55.249 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:32:54 smithi099 ceph-mon[29691]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-03-30T13:32:55.249 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:32:54 smithi099 ceph-mon[29691]: pgmap v38: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-30T13:32:55.249 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:32:54 smithi099 ceph-mon[29691]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-03-30T13:32:55.250 DEBUG:teuthology.orchestra.run.smithi099:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 98ebaeb8-ee99-11ee-b647-cb9ed24678a4 -- ceph orch daemon add osd smithi099:vg_nvme/lv_3 2024-03-30T13:32:55.255 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:32:54 smithi181 ceph-mon[25762]: from='osd.0 [v2:172.21.15.99:6802/558005496,v1:172.21.15.99:6803/558005496]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi099", "root=default"]}]': finished 2024-03-30T13:32:55.256 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:32:54 smithi181 ceph-mon[25762]: osdmap e7: 1 total, 0 up, 1 in 2024-03-30T13:32:55.256 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:32:54 smithi181 ceph-mon[25762]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-03-30T13:32:55.256 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:32:54 smithi181 ceph-mon[25762]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-03-30T13:32:55.256 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:32:54 smithi181 ceph-mon[25762]: pgmap v38: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-30T13:32:55.256 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:32:54 smithi181 ceph-mon[25762]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-03-30T13:32:56.087 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:32:55 smithi099 ceph-mon[29691]: purged_snaps scrub starts 2024-03-30T13:32:56.087 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:32:55 smithi099 ceph-mon[29691]: purged_snaps scrub ok 2024-03-30T13:32:56.087 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:32:55 smithi099 ceph-mon[29691]: osd.0 [v2:172.21.15.99:6802/558005496,v1:172.21.15.99:6803/558005496] boot 2024-03-30T13:32:56.087 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:32:55 smithi099 ceph-mon[29691]: osdmap e8: 1 total, 1 up, 1 in 2024-03-30T13:32:56.087 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:32:55 smithi099 ceph-mon[29691]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-03-30T13:32:56.087 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:32:55 smithi099 ceph-mon[24912]: purged_snaps scrub starts 2024-03-30T13:32:56.087 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:32:55 smithi099 ceph-mon[24912]: purged_snaps scrub ok 2024-03-30T13:32:56.087 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:32:55 smithi099 ceph-mon[24912]: osd.0 [v2:172.21.15.99:6802/558005496,v1:172.21.15.99:6803/558005496] boot 2024-03-30T13:32:56.088 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:32:55 smithi099 ceph-mon[24912]: osdmap e8: 1 total, 1 up, 1 in 2024-03-30T13:32:56.088 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:32:55 smithi099 ceph-mon[24912]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-03-30T13:32:56.256 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:32:55 smithi181 ceph-mon[25762]: purged_snaps scrub starts 2024-03-30T13:32:56.256 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:32:55 smithi181 ceph-mon[25762]: purged_snaps scrub ok 2024-03-30T13:32:56.256 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:32:55 smithi181 ceph-mon[25762]: osd.0 [v2:172.21.15.99:6802/558005496,v1:172.21.15.99:6803/558005496] boot 2024-03-30T13:32:56.256 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:32:55 smithi181 ceph-mon[25762]: osdmap e8: 1 total, 1 up, 1 in 2024-03-30T13:32:56.256 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:32:55 smithi181 ceph-mon[25762]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-03-30T13:32:57.087 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:32:56 smithi099 ceph-mon[24912]: osdmap e9: 1 total, 1 up, 1 in 2024-03-30T13:32:57.087 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:32:56 smithi099 ceph-mon[24912]: pgmap v41: 0 pgs: ; 0 B data, 4.8 MiB used, 89 GiB / 89 GiB avail 2024-03-30T13:32:57.087 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:32:56 smithi099 ceph-mon[29691]: osdmap e9: 1 total, 1 up, 1 in 2024-03-30T13:32:57.087 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:32:56 smithi099 ceph-mon[29691]: pgmap v41: 0 pgs: ; 0 B data, 4.8 MiB used, 89 GiB / 89 GiB avail 2024-03-30T13:32:57.256 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:32:56 smithi181 ceph-mon[25762]: osdmap e9: 1 total, 1 up, 1 in 2024-03-30T13:32:57.256 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:32:56 smithi181 ceph-mon[25762]: pgmap v41: 0 pgs: ; 0 B data, 4.8 MiB used, 89 GiB / 89 GiB avail 2024-03-30T13:32:58.256 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:32:57 smithi181 ceph-mon[25762]: from='client.14238 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi099:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T13:32:58.256 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:32:57 smithi181 ceph-mon[25762]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-03-30T13:32:58.256 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:32:57 smithi181 ceph-mon[25762]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-03-30T13:32:58.256 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:32:57 smithi181 ceph-mon[25762]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:32:58.337 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:32:57 smithi099 ceph-mon[24912]: from='client.14238 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi099:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T13:32:58.337 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:32:57 smithi099 ceph-mon[24912]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-03-30T13:32:58.337 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:32:57 smithi099 ceph-mon[24912]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-03-30T13:32:58.337 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:32:57 smithi099 ceph-mon[24912]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:32:58.337 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:32:58 smithi099 ceph-mon[29691]: from='client.14238 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi099:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T13:32:58.337 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:32:58 smithi099 ceph-mon[29691]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-03-30T13:32:58.337 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:32:58 smithi099 ceph-mon[29691]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-03-30T13:32:58.337 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:32:58 smithi099 ceph-mon[29691]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:32:59.114 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:32:59 smithi099 ceph-mon[24912]: pgmap v42: 0 pgs: ; 0 B data, 4.8 MiB used, 89 GiB / 89 GiB avail 2024-03-30T13:32:59.114 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:32:59 smithi099 ceph-mon[29691]: pgmap v42: 0 pgs: ; 0 B data, 4.8 MiB used, 89 GiB / 89 GiB avail 2024-03-30T13:32:59.506 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:32:59 smithi181 ceph-mon[25762]: pgmap v42: 0 pgs: ; 0 B data, 4.8 MiB used, 89 GiB / 89 GiB avail 2024-03-30T13:32:59.705 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:32:59 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[25141]: 172.21.15.99 - - [30/Mar/2024:13:32:59] "POST /data HTTP/1.1" 200 46 "" "Python-urllib/3.9" 2024-03-30T13:33:00.656 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:33:00 smithi099 ceph-mon[29691]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' 2024-03-30T13:33:00.656 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:33:00 smithi099 ceph-mon[29691]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' 2024-03-30T13:33:00.656 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:33:00 smithi099 ceph-mon[29691]: from='client.? 172.21.15.99:0/721742313' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "41383fae-9172-4ba2-8a94-85a125de98e2"}]: dispatch 2024-03-30T13:33:00.656 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:33:00 smithi099 ceph-mon[29691]: from='client.? 172.21.15.99:0/721742313' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "41383fae-9172-4ba2-8a94-85a125de98e2"}]': finished 2024-03-30T13:33:00.657 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:33:00 smithi099 ceph-mon[29691]: osdmap e10: 2 total, 1 up, 2 in 2024-03-30T13:33:00.657 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:33:00 smithi099 ceph-mon[29691]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-03-30T13:33:00.657 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:33:00 smithi099 ceph-mon[24912]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' 2024-03-30T13:33:00.657 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:33:00 smithi099 ceph-mon[24912]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' 2024-03-30T13:33:00.657 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:33:00 smithi099 ceph-mon[24912]: from='client.? 172.21.15.99:0/721742313' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "41383fae-9172-4ba2-8a94-85a125de98e2"}]: dispatch 2024-03-30T13:33:00.657 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:33:00 smithi099 ceph-mon[24912]: from='client.? 172.21.15.99:0/721742313' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "41383fae-9172-4ba2-8a94-85a125de98e2"}]': finished 2024-03-30T13:33:00.657 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:33:00 smithi099 ceph-mon[24912]: osdmap e10: 2 total, 1 up, 2 in 2024-03-30T13:33:00.657 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:33:00 smithi099 ceph-mon[24912]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-03-30T13:33:00.756 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:33:00 smithi181 ceph-mon[25762]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' 2024-03-30T13:33:00.756 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:33:00 smithi181 ceph-mon[25762]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' 2024-03-30T13:33:00.756 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:33:00 smithi181 ceph-mon[25762]: from='client.? 172.21.15.99:0/721742313' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "41383fae-9172-4ba2-8a94-85a125de98e2"}]: dispatch 2024-03-30T13:33:00.756 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:33:00 smithi181 ceph-mon[25762]: from='client.? 172.21.15.99:0/721742313' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "41383fae-9172-4ba2-8a94-85a125de98e2"}]': finished 2024-03-30T13:33:00.756 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:33:00 smithi181 ceph-mon[25762]: osdmap e10: 2 total, 1 up, 2 in 2024-03-30T13:33:00.756 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:33:00 smithi181 ceph-mon[25762]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-03-30T13:33:01.756 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:33:01 smithi181 ceph-mon[25762]: pgmap v44: 0 pgs: ; 0 B data, 4.8 MiB used, 89 GiB / 89 GiB avail 2024-03-30T13:33:01.756 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:33:01 smithi181 ceph-mon[25762]: from='client.? 172.21.15.99:0/623414897' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-03-30T13:33:01.836 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:33:01 smithi099 ceph-mon[24912]: pgmap v44: 0 pgs: ; 0 B data, 4.8 MiB used, 89 GiB / 89 GiB avail 2024-03-30T13:33:01.836 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:33:01 smithi099 ceph-mon[24912]: from='client.? 172.21.15.99:0/623414897' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-03-30T13:33:01.837 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:33:01 smithi099 ceph-mon[29691]: pgmap v44: 0 pgs: ; 0 B data, 4.8 MiB used, 89 GiB / 89 GiB avail 2024-03-30T13:33:01.837 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:33:01 smithi099 ceph-mon[29691]: from='client.? 172.21.15.99:0/623414897' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-03-30T13:33:03.670 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:33:03 smithi099 ceph-mon[24912]: pgmap v45: 0 pgs: ; 0 B data, 4.8 MiB used, 89 GiB / 89 GiB avail 2024-03-30T13:33:03.670 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:33:03 smithi099 ceph-mon[29691]: pgmap v45: 0 pgs: ; 0 B data, 4.8 MiB used, 89 GiB / 89 GiB avail 2024-03-30T13:33:03.756 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:33:03 smithi181 ceph-mon[25762]: pgmap v45: 0 pgs: ; 0 B data, 4.8 MiB used, 89 GiB / 89 GiB avail 2024-03-30T13:33:05.756 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:33:05 smithi181 ceph-mon[25762]: pgmap v46: 0 pgs: ; 0 B data, 4.8 MiB used, 89 GiB / 89 GiB avail 2024-03-30T13:33:05.757 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:33:05 smithi099 ceph-mon[24912]: pgmap v46: 0 pgs: ; 0 B data, 4.8 MiB used, 89 GiB / 89 GiB avail 2024-03-30T13:33:05.757 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:33:05 smithi099 ceph-mon[29691]: pgmap v46: 0 pgs: ; 0 B data, 4.8 MiB used, 89 GiB / 89 GiB avail 2024-03-30T13:33:07.650 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:33:07 smithi099 ceph-mon[29691]: pgmap v47: 0 pgs: ; 0 B data, 4.8 MiB used, 89 GiB / 89 GiB avail 2024-03-30T13:33:07.651 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:33:07 smithi099 ceph-mon[29691]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-03-30T13:33:07.651 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:33:07 smithi099 ceph-mon[29691]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:33:07.651 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:33:07 smithi099 ceph-mon[24912]: pgmap v47: 0 pgs: ; 0 B data, 4.8 MiB used, 89 GiB / 89 GiB avail 2024-03-30T13:33:07.651 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:33:07 smithi099 ceph-mon[24912]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-03-30T13:33:07.651 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:33:07 smithi099 ceph-mon[24912]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:33:07.756 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:33:07 smithi181 ceph-mon[25762]: pgmap v47: 0 pgs: ; 0 B data, 4.8 MiB used, 89 GiB / 89 GiB avail 2024-03-30T13:33:07.756 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:33:07 smithi181 ceph-mon[25762]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-03-30T13:33:07.756 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:33:07 smithi181 ceph-mon[25762]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:33:08.587 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:33:08 smithi099 ceph-mon[24912]: Deploying daemon osd.1 on smithi099 2024-03-30T13:33:08.587 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:33:08 smithi099 ceph-mon[29691]: Deploying daemon osd.1 on smithi099 2024-03-30T13:33:08.756 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:33:08 smithi181 ceph-mon[25762]: Deploying daemon osd.1 on smithi099 2024-03-30T13:33:09.506 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:33:09 smithi181 ceph-mon[25762]: pgmap v48: 0 pgs: ; 0 B data, 4.8 MiB used, 89 GiB / 89 GiB avail 2024-03-30T13:33:09.621 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:33:09 smithi099 ceph-mon[24912]: pgmap v48: 0 pgs: ; 0 B data, 4.8 MiB used, 89 GiB / 89 GiB avail 2024-03-30T13:33:09.621 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:33:09 smithi099 ceph-mon[29691]: pgmap v48: 0 pgs: ; 0 B data, 4.8 MiB used, 89 GiB / 89 GiB avail 2024-03-30T13:33:10.572 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:33:10 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[25141]: 172.21.15.181 - - [30/Mar/2024:13:33:10] "POST /data HTTP/1.1" 200 46 "" "Python-urllib/3.9" 2024-03-30T13:33:11.496 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:33:11 smithi181 ceph-mon[25762]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' 2024-03-30T13:33:11.496 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:33:11 smithi181 ceph-mon[25762]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' 2024-03-30T13:33:11.496 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:33:11 smithi181 ceph-mon[25762]: pgmap v49: 0 pgs: ; 0 B data, 4.8 MiB used, 89 GiB / 89 GiB avail 2024-03-30T13:33:11.536 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:33:11 smithi099 ceph-mon[24912]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' 2024-03-30T13:33:11.536 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:33:11 smithi099 ceph-mon[24912]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' 2024-03-30T13:33:11.536 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:33:11 smithi099 ceph-mon[24912]: pgmap v49: 0 pgs: ; 0 B data, 4.8 MiB used, 89 GiB / 89 GiB avail 2024-03-30T13:33:11.537 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:33:11 smithi099 ceph-mon[29691]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' 2024-03-30T13:33:11.537 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:33:11 smithi099 ceph-mon[29691]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' 2024-03-30T13:33:11.537 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:33:11 smithi099 ceph-mon[29691]: pgmap v49: 0 pgs: ; 0 B data, 4.8 MiB used, 89 GiB / 89 GiB avail 2024-03-30T13:33:13.379 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:33:13 smithi181 ceph-mon[25762]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' 2024-03-30T13:33:13.379 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:33:13 smithi181 ceph-mon[25762]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:33:13.379 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:33:13 smithi181 ceph-mon[25762]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:33:13.379 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:33:13 smithi181 ceph-mon[25762]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:33:13.379 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:33:13 smithi181 ceph-mon[25762]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' 2024-03-30T13:33:13.379 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:33:13 smithi181 ceph-mon[25762]: pgmap v50: 0 pgs: ; 0 B data, 4.8 MiB used, 89 GiB / 89 GiB avail 2024-03-30T13:33:13.496 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:33:13 smithi099 ceph-mon[29691]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' 2024-03-30T13:33:13.496 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:33:13 smithi099 ceph-mon[29691]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:33:13.497 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:33:13 smithi099 ceph-mon[29691]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:33:13.497 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:33:13 smithi099 ceph-mon[29691]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:33:13.497 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:33:13 smithi099 ceph-mon[29691]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' 2024-03-30T13:33:13.497 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:33:13 smithi099 ceph-mon[29691]: pgmap v50: 0 pgs: ; 0 B data, 4.8 MiB used, 89 GiB / 89 GiB avail 2024-03-30T13:33:13.497 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:33:13 smithi099 ceph-mon[24912]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' 2024-03-30T13:33:13.497 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:33:13 smithi099 ceph-mon[24912]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:33:13.497 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:33:13 smithi099 ceph-mon[24912]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:33:13.497 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:33:13 smithi099 ceph-mon[24912]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:33:13.497 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:33:13 smithi099 ceph-mon[24912]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' 2024-03-30T13:33:13.497 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:33:13 smithi099 ceph-mon[24912]: pgmap v50: 0 pgs: ; 0 B data, 4.8 MiB used, 89 GiB / 89 GiB avail 2024-03-30T13:33:15.017 INFO:teuthology.orchestra.run.smithi099.stdout:Created osd(s) 1 on host 'smithi099' 2024-03-30T13:33:15.620 DEBUG:teuthology.orchestra.run.smithi099:osd.1> sudo journalctl -f -n 0 -u ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4@osd.1.service 2024-03-30T13:33:15.623 INFO:tasks.cephadm:Deploying osd.2 on smithi099 with /dev/vg_nvme/lv_2... 2024-03-30T13:33:15.623 DEBUG:teuthology.orchestra.run.smithi099:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 98ebaeb8-ee99-11ee-b647-cb9ed24678a4 -- ceph-volume lvm zap /dev/vg_nvme/lv_2 2024-03-30T13:33:15.756 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:33:15 smithi181 ceph-mon[25762]: pgmap v51: 0 pgs: ; 0 B data, 4.8 MiB used, 89 GiB / 89 GiB avail 2024-03-30T13:33:15.756 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:33:15 smithi181 ceph-mon[25762]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' 2024-03-30T13:33:15.756 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:33:15 smithi181 ceph-mon[25762]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:33:15.756 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:33:15 smithi181 ceph-mon[25762]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:33:15.756 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:33:15 smithi181 ceph-mon[25762]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:33:15.756 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:33:15 smithi181 ceph-mon[25762]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-03-30T13:33:15.756 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:33:15 smithi181 ceph-mon[25762]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-03-30T13:33:15.757 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:33:15 smithi181 ceph-mon[25762]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' 2024-03-30T13:33:15.757 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:33:15 smithi181 ceph-mon[25762]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' 2024-03-30T13:33:15.757 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:33:15 smithi181 ceph-mon[25762]: from='osd.1 [v2:172.21.15.99:6810/2317835991,v1:172.21.15.99:6811/2317835991]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-03-30T13:33:15.757 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:33:15 smithi181 ceph-mon[25762]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-03-30T13:33:15.837 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:33:15 smithi099 ceph-mon[24912]: pgmap v51: 0 pgs: ; 0 B data, 4.8 MiB used, 89 GiB / 89 GiB avail 2024-03-30T13:33:15.837 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:33:15 smithi099 ceph-mon[24912]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' 2024-03-30T13:33:15.837 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:33:15 smithi099 ceph-mon[24912]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:33:15.837 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:33:15 smithi099 ceph-mon[24912]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:33:15.837 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:33:15 smithi099 ceph-mon[24912]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:33:15.837 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:33:15 smithi099 ceph-mon[24912]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-03-30T13:33:15.837 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:33:15 smithi099 ceph-mon[24912]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-03-30T13:33:15.837 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:33:15 smithi099 ceph-mon[24912]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' 2024-03-30T13:33:15.837 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:33:15 smithi099 ceph-mon[24912]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' 2024-03-30T13:33:15.837 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:33:15 smithi099 ceph-mon[24912]: from='osd.1 [v2:172.21.15.99:6810/2317835991,v1:172.21.15.99:6811/2317835991]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-03-30T13:33:15.837 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:33:15 smithi099 ceph-mon[24912]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-03-30T13:33:15.838 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:33:15 smithi099 ceph-mon[29691]: pgmap v51: 0 pgs: ; 0 B data, 4.8 MiB used, 89 GiB / 89 GiB avail 2024-03-30T13:33:15.838 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:33:15 smithi099 ceph-mon[29691]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' 2024-03-30T13:33:15.838 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:33:15 smithi099 ceph-mon[29691]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:33:15.838 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:33:15 smithi099 ceph-mon[29691]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:33:15.838 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:33:15 smithi099 ceph-mon[29691]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:33:15.838 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:33:15 smithi099 ceph-mon[29691]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-03-30T13:33:15.838 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:33:15 smithi099 ceph-mon[29691]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-03-30T13:33:15.838 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:33:15 smithi099 ceph-mon[29691]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' 2024-03-30T13:33:15.838 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:33:15 smithi099 ceph-mon[29691]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' 2024-03-30T13:33:15.838 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:33:15 smithi099 ceph-mon[29691]: from='osd.1 [v2:172.21.15.99:6810/2317835991,v1:172.21.15.99:6811/2317835991]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-03-30T13:33:15.838 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:33:15 smithi099 ceph-mon[29691]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-03-30T13:33:16.587 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:33:16 smithi099 ceph-mon[24912]: Adjusting osd_memory_target on smithi099 to 7520M 2024-03-30T13:33:16.587 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:33:16 smithi099 ceph-mon[24912]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-03-30T13:33:16.587 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:33:16 smithi099 ceph-mon[24912]: osdmap e11: 2 total, 1 up, 2 in 2024-03-30T13:33:16.587 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:33:16 smithi099 ceph-mon[24912]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-03-30T13:33:16.587 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:33:16 smithi099 ceph-mon[24912]: from='osd.1 [v2:172.21.15.99:6810/2317835991,v1:172.21.15.99:6811/2317835991]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi099", "root=default"]}]: dispatch 2024-03-30T13:33:16.587 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:33:16 smithi099 ceph-mon[24912]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi099", "root=default"]}]: dispatch 2024-03-30T13:33:16.587 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:33:16 smithi099 ceph-mon[29691]: Adjusting osd_memory_target on smithi099 to 7520M 2024-03-30T13:33:16.587 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:33:16 smithi099 ceph-mon[29691]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-03-30T13:33:16.587 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:33:16 smithi099 ceph-mon[29691]: osdmap e11: 2 total, 1 up, 2 in 2024-03-30T13:33:16.587 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:33:16 smithi099 ceph-mon[29691]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-03-30T13:33:16.588 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:33:16 smithi099 ceph-mon[29691]: from='osd.1 [v2:172.21.15.99:6810/2317835991,v1:172.21.15.99:6811/2317835991]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi099", "root=default"]}]: dispatch 2024-03-30T13:33:16.588 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:33:16 smithi099 ceph-mon[29691]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi099", "root=default"]}]: dispatch 2024-03-30T13:33:16.756 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:33:16 smithi181 ceph-mon[25762]: Adjusting osd_memory_target on smithi099 to 7520M 2024-03-30T13:33:16.756 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:33:16 smithi181 ceph-mon[25762]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-03-30T13:33:16.756 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:33:16 smithi181 ceph-mon[25762]: osdmap e11: 2 total, 1 up, 2 in 2024-03-30T13:33:16.756 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:33:16 smithi181 ceph-mon[25762]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-03-30T13:33:16.756 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:33:16 smithi181 ceph-mon[25762]: from='osd.1 [v2:172.21.15.99:6810/2317835991,v1:172.21.15.99:6811/2317835991]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi099", "root=default"]}]: dispatch 2024-03-30T13:33:16.756 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:33:16 smithi181 ceph-mon[25762]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi099", "root=default"]}]: dispatch 2024-03-30T13:33:17.192 INFO:journalctl@ceph.osd.1.smithi099.stdout:Mar 30 13:33:17 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-1[35953]: 2024-03-30T13:33:17.063+0000 7ff8bc7d0700 -1 osd.1 0 waiting for initial osdmap 2024-03-30T13:33:17.192 INFO:journalctl@ceph.osd.1.smithi099.stdout:Mar 30 13:33:17 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-1[35953]: 2024-03-30T13:33:17.066+0000 7ff8b916b700 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-03-30T13:33:17.483 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:33:17 smithi099 ceph-mon[24912]: pgmap v53: 0 pgs: ; 0 B data, 4.8 MiB used, 89 GiB / 89 GiB avail 2024-03-30T13:33:17.483 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:33:17 smithi099 ceph-mon[24912]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi099", "root=default"]}]': finished 2024-03-30T13:33:17.483 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:33:17 smithi099 ceph-mon[24912]: osdmap e12: 2 total, 1 up, 2 in 2024-03-30T13:33:17.695 INFO:teuthology.orchestra.run.smithi099.stderr:--> Zapping: /dev/vg_nvme/lv_2 2024-03-30T13:33:17.695 INFO:teuthology.orchestra.run.smithi099.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_2 bs=1M count=10 conv=fsync 2024-03-30T13:33:17.695 INFO:teuthology.orchestra.run.smithi099.stderr: stderr: 10+0 records in 2024-03-30T13:33:17.695 INFO:teuthology.orchestra.run.smithi099.stderr:10+0 records out 2024-03-30T13:33:17.695 INFO:teuthology.orchestra.run.smithi099.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0128231 s, 818 MB/s 2024-03-30T13:33:17.695 INFO:teuthology.orchestra.run.smithi099.stderr:--> Zapping successful for: 2024-03-30T13:33:17.756 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:33:17 smithi181 ceph-mon[25762]: pgmap v53: 0 pgs: ; 0 B data, 4.8 MiB used, 89 GiB / 89 GiB avail 2024-03-30T13:33:17.756 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:33:17 smithi181 ceph-mon[25762]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi099", "root=default"]}]': finished 2024-03-30T13:33:17.756 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:33:17 smithi181 ceph-mon[25762]: osdmap e12: 2 total, 1 up, 2 in 2024-03-30T13:33:17.756 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:33:17 smithi181 ceph-mon[25762]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-03-30T13:33:17.756 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:33:17 smithi181 ceph-mon[25762]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-03-30T13:33:17.838 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:33:17 smithi099 ceph-mon[24912]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-03-30T13:33:17.838 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:33:17 smithi099 ceph-mon[24912]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-03-30T13:33:17.838 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:33:17 smithi099 ceph-mon[29691]: pgmap v53: 0 pgs: ; 0 B data, 4.8 MiB used, 89 GiB / 89 GiB avail 2024-03-30T13:33:17.838 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:33:17 smithi099 ceph-mon[29691]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi099", "root=default"]}]': finished 2024-03-30T13:33:17.838 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:33:17 smithi099 ceph-mon[29691]: osdmap e12: 2 total, 1 up, 2 in 2024-03-30T13:33:17.838 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:33:17 smithi099 ceph-mon[29691]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-03-30T13:33:17.838 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:33:17 smithi099 ceph-mon[29691]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-03-30T13:33:18.347 DEBUG:teuthology.orchestra.run.smithi099:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 98ebaeb8-ee99-11ee-b647-cb9ed24678a4 -- ceph orch daemon add osd smithi099:vg_nvme/lv_2 2024-03-30T13:33:19.337 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:33:19 smithi099 ceph-mon[24912]: purged_snaps scrub starts 2024-03-30T13:33:19.337 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:33:19 smithi099 ceph-mon[24912]: purged_snaps scrub ok 2024-03-30T13:33:19.337 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:33:19 smithi099 ceph-mon[24912]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-03-30T13:33:19.337 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:33:19 smithi099 ceph-mon[24912]: osd.1 [v2:172.21.15.99:6810/2317835991,v1:172.21.15.99:6811/2317835991] boot 2024-03-30T13:33:19.337 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:33:19 smithi099 ceph-mon[24912]: osdmap e13: 2 total, 2 up, 2 in 2024-03-30T13:33:19.337 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:33:19 smithi099 ceph-mon[24912]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-03-30T13:33:19.337 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:33:19 smithi099 ceph-mon[24912]: pgmap v56: 0 pgs: ; 0 B data, 4.8 MiB used, 89 GiB / 89 GiB avail 2024-03-30T13:33:19.337 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:33:19 smithi099 ceph-mon[29691]: purged_snaps scrub starts 2024-03-30T13:33:19.337 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:33:19 smithi099 ceph-mon[29691]: purged_snaps scrub ok 2024-03-30T13:33:19.338 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:33:19 smithi099 ceph-mon[29691]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-03-30T13:33:19.338 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:33:19 smithi099 ceph-mon[29691]: osd.1 [v2:172.21.15.99:6810/2317835991,v1:172.21.15.99:6811/2317835991] boot 2024-03-30T13:33:19.338 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:33:19 smithi099 ceph-mon[29691]: osdmap e13: 2 total, 2 up, 2 in 2024-03-30T13:33:19.338 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:33:19 smithi099 ceph-mon[29691]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-03-30T13:33:19.338 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:33:19 smithi099 ceph-mon[29691]: pgmap v56: 0 pgs: ; 0 B data, 4.8 MiB used, 89 GiB / 89 GiB avail 2024-03-30T13:33:19.506 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:33:19 smithi181 ceph-mon[25762]: purged_snaps scrub starts 2024-03-30T13:33:19.506 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:33:19 smithi181 ceph-mon[25762]: purged_snaps scrub ok 2024-03-30T13:33:19.506 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:33:19 smithi181 ceph-mon[25762]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-03-30T13:33:19.506 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:33:19 smithi181 ceph-mon[25762]: osd.1 [v2:172.21.15.99:6810/2317835991,v1:172.21.15.99:6811/2317835991] boot 2024-03-30T13:33:19.506 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:33:19 smithi181 ceph-mon[25762]: osdmap e13: 2 total, 2 up, 2 in 2024-03-30T13:33:19.506 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:33:19 smithi181 ceph-mon[25762]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-03-30T13:33:19.507 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:33:19 smithi181 ceph-mon[25762]: pgmap v56: 0 pgs: ; 0 B data, 4.8 MiB used, 89 GiB / 89 GiB avail 2024-03-30T13:33:19.823 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:33:19 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[25141]: 172.21.15.99 - - [30/Mar/2024:13:33:19] "POST /data HTTP/1.1" 200 46 "" "Python-urllib/3.9" 2024-03-30T13:33:20.337 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:33:20 smithi099 ceph-mon[24912]: osdmap e14: 2 total, 2 up, 2 in 2024-03-30T13:33:20.337 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:33:20 smithi099 ceph-mon[24912]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' 2024-03-30T13:33:20.337 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:33:20 smithi099 ceph-mon[24912]: Detected new or changed devices on smithi099 2024-03-30T13:33:20.337 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:33:20 smithi099 ceph-mon[24912]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' 2024-03-30T13:33:20.337 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:33:20 smithi099 ceph-mon[24912]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:33:20.338 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:33:20 smithi099 ceph-mon[24912]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:33:20.338 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:33:20 smithi099 ceph-mon[24912]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:33:20.338 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:33:20 smithi099 ceph-mon[24912]: pgmap v58: 0 pgs: ; 0 B data, 9.7 MiB used, 179 GiB / 179 GiB avail 2024-03-30T13:33:20.338 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:33:20 smithi099 ceph-mon[24912]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' 2024-03-30T13:33:20.338 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:33:20 smithi099 ceph-mon[29691]: osdmap e14: 2 total, 2 up, 2 in 2024-03-30T13:33:20.338 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:33:20 smithi099 ceph-mon[29691]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' 2024-03-30T13:33:20.338 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:33:20 smithi099 ceph-mon[29691]: Detected new or changed devices on smithi099 2024-03-30T13:33:20.338 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:33:20 smithi099 ceph-mon[29691]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' 2024-03-30T13:33:20.338 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:33:20 smithi099 ceph-mon[29691]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:33:20.339 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:33:20 smithi099 ceph-mon[29691]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:33:20.339 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:33:20 smithi099 ceph-mon[29691]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:33:20.339 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:33:20 smithi099 ceph-mon[29691]: pgmap v58: 0 pgs: ; 0 B data, 9.7 MiB used, 179 GiB / 179 GiB avail 2024-03-30T13:33:20.339 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:33:20 smithi099 ceph-mon[29691]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' 2024-03-30T13:33:20.506 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:33:20 smithi181 ceph-mon[25762]: osdmap e14: 2 total, 2 up, 2 in 2024-03-30T13:33:20.506 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:33:20 smithi181 ceph-mon[25762]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' 2024-03-30T13:33:20.506 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:33:20 smithi181 ceph-mon[25762]: Detected new or changed devices on smithi099 2024-03-30T13:33:20.506 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:33:20 smithi181 ceph-mon[25762]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' 2024-03-30T13:33:20.506 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:33:20 smithi181 ceph-mon[25762]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:33:20.506 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:33:20 smithi181 ceph-mon[25762]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:33:20.506 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:33:20 smithi181 ceph-mon[25762]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:33:20.506 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:33:20 smithi181 ceph-mon[25762]: pgmap v58: 0 pgs: ; 0 B data, 9.7 MiB used, 179 GiB / 179 GiB avail 2024-03-30T13:33:20.506 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:33:20 smithi181 ceph-mon[25762]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' 2024-03-30T13:33:21.269 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:33:20 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[25141]: 172.21.15.99 - - [30/Mar/2024:13:33:20] "POST /data HTTP/1.1" 200 46 "" "Python-urllib/3.9" 2024-03-30T13:33:21.270 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:33:21 smithi099 ceph-mon[29691]: Health check failed: 1 stray daemon(s) not managed by cephadm (CEPHADM_STRAY_DAEMON) 2024-03-30T13:33:21.270 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:33:21 smithi099 ceph-mon[29691]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-03-30T13:33:21.270 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:33:21 smithi099 ceph-mon[29691]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-03-30T13:33:21.270 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:33:21 smithi099 ceph-mon[29691]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:33:21.270 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:33:21 smithi099 ceph-mon[29691]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' 2024-03-30T13:33:21.270 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:33:21 smithi099 ceph-mon[29691]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' 2024-03-30T13:33:21.270 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:33:21 smithi099 ceph-mon[29691]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:33:21.270 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:33:21 smithi099 ceph-mon[29691]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:33:21.270 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:33:21 smithi099 ceph-mon[29691]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:33:21.270 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:33:21 smithi099 ceph-mon[29691]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' 2024-03-30T13:33:21.271 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:33:21 smithi099 ceph-mon[24912]: Health check failed: 1 stray daemon(s) not managed by cephadm (CEPHADM_STRAY_DAEMON) 2024-03-30T13:33:21.271 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:33:21 smithi099 ceph-mon[24912]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-03-30T13:33:21.271 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:33:21 smithi099 ceph-mon[24912]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-03-30T13:33:21.271 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:33:21 smithi099 ceph-mon[24912]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:33:21.271 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:33:21 smithi099 ceph-mon[24912]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' 2024-03-30T13:33:21.271 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:33:21 smithi099 ceph-mon[24912]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' 2024-03-30T13:33:21.271 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:33:21 smithi099 ceph-mon[24912]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:33:21.271 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:33:21 smithi099 ceph-mon[24912]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:33:21.271 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:33:21 smithi099 ceph-mon[24912]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:33:21.271 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:33:21 smithi099 ceph-mon[24912]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' 2024-03-30T13:33:21.506 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:33:21 smithi181 ceph-mon[25762]: Health check failed: 1 stray daemon(s) not managed by cephadm (CEPHADM_STRAY_DAEMON) 2024-03-30T13:33:21.506 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:33:21 smithi181 ceph-mon[25762]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-03-30T13:33:21.506 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:33:21 smithi181 ceph-mon[25762]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-03-30T13:33:21.506 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:33:21 smithi181 ceph-mon[25762]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:33:21.506 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:33:21 smithi181 ceph-mon[25762]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' 2024-03-30T13:33:21.506 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:33:21 smithi181 ceph-mon[25762]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' 2024-03-30T13:33:21.506 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:33:21 smithi181 ceph-mon[25762]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:33:21.506 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:33:21 smithi181 ceph-mon[25762]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:33:21.507 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:33:21 smithi181 ceph-mon[25762]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:33:21.507 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:33:21 smithi181 ceph-mon[25762]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' 2024-03-30T13:33:22.337 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:33:22 smithi099 ceph-mon[24912]: from='client.14265 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi099:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T13:33:22.337 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:33:22 smithi099 ceph-mon[24912]: pgmap v59: 0 pgs: ; 0 B data, 9.8 MiB used, 179 GiB / 179 GiB avail 2024-03-30T13:33:22.337 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:33:22 smithi099 ceph-mon[24912]: Health check cleared: CEPHADM_STRAY_DAEMON (was: 1 stray daemon(s) not managed by cephadm) 2024-03-30T13:33:22.337 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:33:22 smithi099 ceph-mon[24912]: Cluster is now healthy 2024-03-30T13:33:22.337 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:33:22 smithi099 ceph-mon[29691]: from='client.14265 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi099:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T13:33:22.337 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:33:22 smithi099 ceph-mon[29691]: pgmap v59: 0 pgs: ; 0 B data, 9.8 MiB used, 179 GiB / 179 GiB avail 2024-03-30T13:33:22.337 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:33:22 smithi099 ceph-mon[29691]: Health check cleared: CEPHADM_STRAY_DAEMON (was: 1 stray daemon(s) not managed by cephadm) 2024-03-30T13:33:22.338 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:33:22 smithi099 ceph-mon[29691]: Cluster is now healthy 2024-03-30T13:33:22.506 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:33:22 smithi181 ceph-mon[25762]: from='client.14265 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi099:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T13:33:22.506 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:33:22 smithi181 ceph-mon[25762]: pgmap v59: 0 pgs: ; 0 B data, 9.8 MiB used, 179 GiB / 179 GiB avail 2024-03-30T13:33:22.506 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:33:22 smithi181 ceph-mon[25762]: Health check cleared: CEPHADM_STRAY_DAEMON (was: 1 stray daemon(s) not managed by cephadm) 2024-03-30T13:33:22.506 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:33:22 smithi181 ceph-mon[25762]: Cluster is now healthy 2024-03-30T13:33:24.337 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:33:24 smithi099 ceph-mon[24912]: pgmap v60: 0 pgs: ; 0 B data, 9.8 MiB used, 179 GiB / 179 GiB avail 2024-03-30T13:33:24.337 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:33:24 smithi099 ceph-mon[29691]: pgmap v60: 0 pgs: ; 0 B data, 9.8 MiB used, 179 GiB / 179 GiB avail 2024-03-30T13:33:24.339 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:33:24 smithi181 ceph-mon[25762]: pgmap v60: 0 pgs: ; 0 B data, 9.8 MiB used, 179 GiB / 179 GiB avail 2024-03-30T13:33:26.337 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:33:26 smithi099 ceph-mon[24912]: pgmap v61: 0 pgs: ; 0 B data, 9.8 MiB used, 179 GiB / 179 GiB avail 2024-03-30T13:33:26.337 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:33:26 smithi099 ceph-mon[24912]: from='client.? 172.21.15.99:0/2172918936' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "c7ec9bfb-f6a2-444d-a004-391f602f07ec"}]: dispatch 2024-03-30T13:33:26.338 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:33:26 smithi099 ceph-mon[24912]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "c7ec9bfb-f6a2-444d-a004-391f602f07ec"}]: dispatch 2024-03-30T13:33:26.338 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:33:26 smithi099 ceph-mon[24912]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "c7ec9bfb-f6a2-444d-a004-391f602f07ec"}]': finished 2024-03-30T13:33:26.338 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:33:26 smithi099 ceph-mon[24912]: osdmap e15: 3 total, 2 up, 3 in 2024-03-30T13:33:26.338 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:33:26 smithi099 ceph-mon[24912]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-03-30T13:33:26.338 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:33:26 smithi099 ceph-mon[24912]: from='client.? 172.21.15.99:0/1829927307' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-03-30T13:33:26.338 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:33:26 smithi099 ceph-mon[29691]: pgmap v61: 0 pgs: ; 0 B data, 9.8 MiB used, 179 GiB / 179 GiB avail 2024-03-30T13:33:26.338 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:33:26 smithi099 ceph-mon[29691]: from='client.? 172.21.15.99:0/2172918936' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "c7ec9bfb-f6a2-444d-a004-391f602f07ec"}]: dispatch 2024-03-30T13:33:26.338 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:33:26 smithi099 ceph-mon[29691]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "c7ec9bfb-f6a2-444d-a004-391f602f07ec"}]: dispatch 2024-03-30T13:33:26.338 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:33:26 smithi099 ceph-mon[29691]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "c7ec9bfb-f6a2-444d-a004-391f602f07ec"}]': finished 2024-03-30T13:33:26.338 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:33:26 smithi099 ceph-mon[29691]: osdmap e15: 3 total, 2 up, 3 in 2024-03-30T13:33:26.339 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:33:26 smithi099 ceph-mon[29691]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-03-30T13:33:26.339 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:33:26 smithi099 ceph-mon[29691]: from='client.? 172.21.15.99:0/1829927307' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-03-30T13:33:26.506 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:33:26 smithi181 ceph-mon[25762]: pgmap v61: 0 pgs: ; 0 B data, 9.8 MiB used, 179 GiB / 179 GiB avail 2024-03-30T13:33:26.506 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:33:26 smithi181 ceph-mon[25762]: from='client.? 172.21.15.99:0/2172918936' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "c7ec9bfb-f6a2-444d-a004-391f602f07ec"}]: dispatch 2024-03-30T13:33:26.506 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:33:26 smithi181 ceph-mon[25762]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "c7ec9bfb-f6a2-444d-a004-391f602f07ec"}]: dispatch 2024-03-30T13:33:26.506 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:33:26 smithi181 ceph-mon[25762]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "c7ec9bfb-f6a2-444d-a004-391f602f07ec"}]': finished 2024-03-30T13:33:26.506 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:33:26 smithi181 ceph-mon[25762]: osdmap e15: 3 total, 2 up, 3 in 2024-03-30T13:33:26.506 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:33:26 smithi181 ceph-mon[25762]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-03-30T13:33:26.506 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:33:26 smithi181 ceph-mon[25762]: from='client.? 172.21.15.99:0/1829927307' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-03-30T13:33:28.337 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:33:28 smithi099 ceph-mon[24912]: pgmap v63: 0 pgs: ; 0 B data, 9.8 MiB used, 179 GiB / 179 GiB avail 2024-03-30T13:33:28.337 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:33:28 smithi099 ceph-mon[29691]: pgmap v63: 0 pgs: ; 0 B data, 9.8 MiB used, 179 GiB / 179 GiB avail 2024-03-30T13:33:28.505 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:33:28 smithi181 ceph-mon[25762]: pgmap v63: 0 pgs: ; 0 B data, 9.8 MiB used, 179 GiB / 179 GiB avail 2024-03-30T13:33:30.337 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:33:30 smithi099 ceph-mon[24912]: pgmap v64: 0 pgs: ; 0 B data, 9.8 MiB used, 179 GiB / 179 GiB avail 2024-03-30T13:33:30.337 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:33:30 smithi099 ceph-mon[29691]: pgmap v64: 0 pgs: ; 0 B data, 9.8 MiB used, 179 GiB / 179 GiB avail 2024-03-30T13:33:30.444 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:33:30 smithi181 ceph-mon[25762]: pgmap v64: 0 pgs: ; 0 B data, 9.8 MiB used, 179 GiB / 179 GiB avail 2024-03-30T13:33:30.828 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:33:30 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[25141]: 172.21.15.181 - - [30/Mar/2024:13:33:30] "POST /data HTTP/1.1" 200 46 "" "Python-urllib/3.9" 2024-03-30T13:33:31.756 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:33:31 smithi181 ceph-mon[25762]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' 2024-03-30T13:33:31.756 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:33:31 smithi181 ceph-mon[25762]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' 2024-03-30T13:33:31.837 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:33:31 smithi099 ceph-mon[29691]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' 2024-03-30T13:33:31.837 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:33:31 smithi099 ceph-mon[29691]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' 2024-03-30T13:33:31.837 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:33:31 smithi099 ceph-mon[24912]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' 2024-03-30T13:33:31.837 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:33:31 smithi099 ceph-mon[24912]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' 2024-03-30T13:33:32.735 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:33:32 smithi181 ceph-mon[25762]: pgmap v65: 0 pgs: ; 0 B data, 9.8 MiB used, 179 GiB / 179 GiB avail 2024-03-30T13:33:32.735 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:33:32 smithi181 ceph-mon[25762]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-03-30T13:33:32.735 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:33:32 smithi181 ceph-mon[25762]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:33:32.735 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:33:32 smithi181 ceph-mon[25762]: Deploying daemon osd.2 on smithi099 2024-03-30T13:33:32.774 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:33:32 smithi099 ceph-mon[29691]: pgmap v65: 0 pgs: ; 0 B data, 9.8 MiB used, 179 GiB / 179 GiB avail 2024-03-30T13:33:32.774 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:33:32 smithi099 ceph-mon[29691]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-03-30T13:33:32.775 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:33:32 smithi099 ceph-mon[29691]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:33:32.775 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:33:32 smithi099 ceph-mon[29691]: Deploying daemon osd.2 on smithi099 2024-03-30T13:33:32.775 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:33:32 smithi099 ceph-mon[24912]: pgmap v65: 0 pgs: ; 0 B data, 9.8 MiB used, 179 GiB / 179 GiB avail 2024-03-30T13:33:32.775 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:33:32 smithi099 ceph-mon[24912]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-03-30T13:33:32.775 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:33:32 smithi099 ceph-mon[24912]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:33:32.775 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:33:32 smithi099 ceph-mon[24912]: Deploying daemon osd.2 on smithi099 2024-03-30T13:33:33.743 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:33:33 smithi181 ceph-mon[25762]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-03-30T13:33:33.744 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:33:33 smithi181 ceph-mon[25762]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-03-30T13:33:33.836 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:33:33 smithi099 ceph-mon[24912]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-03-30T13:33:33.837 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:33:33 smithi099 ceph-mon[24912]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-03-30T13:33:33.837 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:33:33 smithi099 ceph-mon[29691]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-03-30T13:33:33.837 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:33:33 smithi099 ceph-mon[29691]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-03-30T13:33:34.587 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:33:34 smithi099 ceph-mon[24912]: pgmap v66: 0 pgs: ; 0 B data, 9.8 MiB used, 179 GiB / 179 GiB avail 2024-03-30T13:33:34.587 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:33:34 smithi099 ceph-mon[29691]: pgmap v66: 0 pgs: ; 0 B data, 9.8 MiB used, 179 GiB / 179 GiB avail 2024-03-30T13:33:34.756 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:33:34 smithi181 ceph-mon[25762]: pgmap v66: 0 pgs: ; 0 B data, 9.8 MiB used, 179 GiB / 179 GiB avail 2024-03-30T13:33:36.586 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:33:36 smithi099 ceph-mon[24912]: pgmap v67: 0 pgs: ; 0 B data, 9.8 MiB used, 179 GiB / 179 GiB avail 2024-03-30T13:33:36.587 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:33:36 smithi099 ceph-mon[24912]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' 2024-03-30T13:33:36.587 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:33:36 smithi099 ceph-mon[29691]: pgmap v67: 0 pgs: ; 0 B data, 9.8 MiB used, 179 GiB / 179 GiB avail 2024-03-30T13:33:36.587 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:33:36 smithi099 ceph-mon[29691]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' 2024-03-30T13:33:36.756 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:33:36 smithi181 ceph-mon[25762]: pgmap v67: 0 pgs: ; 0 B data, 9.8 MiB used, 179 GiB / 179 GiB avail 2024-03-30T13:33:36.756 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:33:36 smithi181 ceph-mon[25762]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' 2024-03-30T13:33:37.756 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:33:37 smithi181 ceph-mon[25762]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:33:37.756 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:33:37 smithi181 ceph-mon[25762]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:33:37.756 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:33:37 smithi181 ceph-mon[25762]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:33:37.756 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:33:37 smithi181 ceph-mon[25762]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' 2024-03-30T13:33:37.815 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:33:37 smithi099 ceph-mon[24912]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:33:37.815 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:33:37 smithi099 ceph-mon[24912]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:33:37.815 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:33:37 smithi099 ceph-mon[24912]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:33:37.815 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:33:37 smithi099 ceph-mon[24912]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' 2024-03-30T13:33:37.816 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:33:37 smithi099 ceph-mon[29691]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:33:37.816 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:33:37 smithi099 ceph-mon[29691]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:33:37.816 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:33:37 smithi099 ceph-mon[29691]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:33:37.816 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:33:37 smithi099 ceph-mon[29691]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' 2024-03-30T13:33:38.756 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:33:38 smithi181 ceph-mon[25762]: pgmap v68: 0 pgs: ; 0 B data, 9.8 MiB used, 179 GiB / 179 GiB avail 2024-03-30T13:33:38.836 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:33:38 smithi099 ceph-mon[24912]: pgmap v68: 0 pgs: ; 0 B data, 9.8 MiB used, 179 GiB / 179 GiB avail 2024-03-30T13:33:38.837 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:33:38 smithi099 ceph-mon[29691]: pgmap v68: 0 pgs: ; 0 B data, 9.8 MiB used, 179 GiB / 179 GiB avail 2024-03-30T13:33:39.175 INFO:teuthology.orchestra.run.smithi099.stdout:Created osd(s) 2 on host 'smithi099' 2024-03-30T13:33:39.799 DEBUG:teuthology.orchestra.run.smithi099:osd.2> sudo journalctl -f -n 0 -u ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4@osd.2.service 2024-03-30T13:33:39.802 INFO:tasks.cephadm:Deploying osd.3 on smithi099 with /dev/vg_nvme/lv_1... 2024-03-30T13:33:39.802 DEBUG:teuthology.orchestra.run.smithi099:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 98ebaeb8-ee99-11ee-b647-cb9ed24678a4 -- ceph-volume lvm zap /dev/vg_nvme/lv_1 2024-03-30T13:33:40.506 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:33:40 smithi181 ceph-mon[25762]: pgmap v69: 0 pgs: ; 0 B data, 9.8 MiB used, 179 GiB / 179 GiB avail 2024-03-30T13:33:40.506 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:33:40 smithi181 ceph-mon[25762]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' 2024-03-30T13:33:40.506 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:33:40 smithi181 ceph-mon[25762]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:33:40.506 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:33:40 smithi181 ceph-mon[25762]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:33:40.506 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:33:40 smithi181 ceph-mon[25762]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:33:40.506 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:33:40 smithi181 ceph-mon[25762]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-03-30T13:33:40.506 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:33:40 smithi181 ceph-mon[25762]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-03-30T13:33:40.507 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:33:40 smithi181 ceph-mon[25762]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-03-30T13:33:40.507 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:33:40 smithi181 ceph-mon[25762]: Adjusting osd_memory_target on smithi099 to 5013M 2024-03-30T13:33:40.507 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:33:40 smithi181 ceph-mon[25762]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' 2024-03-30T13:33:40.507 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:33:40 smithi181 ceph-mon[25762]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' 2024-03-30T13:33:40.507 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:33:40 smithi181 ceph-mon[25762]: from='osd.2 [v2:172.21.15.99:6818/770589655,v1:172.21.15.99:6819/770589655]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-03-30T13:33:40.587 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:33:40 smithi099 ceph-mon[24912]: pgmap v69: 0 pgs: ; 0 B data, 9.8 MiB used, 179 GiB / 179 GiB avail 2024-03-30T13:33:40.587 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:33:40 smithi099 ceph-mon[24912]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' 2024-03-30T13:33:40.587 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:33:40 smithi099 ceph-mon[24912]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:33:40.587 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:33:40 smithi099 ceph-mon[24912]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:33:40.587 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:33:40 smithi099 ceph-mon[24912]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:33:40.587 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:33:40 smithi099 ceph-mon[24912]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-03-30T13:33:40.587 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:33:40 smithi099 ceph-mon[24912]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-03-30T13:33:40.587 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:33:40 smithi099 ceph-mon[24912]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-03-30T13:33:40.587 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:33:40 smithi099 ceph-mon[24912]: Adjusting osd_memory_target on smithi099 to 5013M 2024-03-30T13:33:40.587 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:33:40 smithi099 ceph-mon[24912]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' 2024-03-30T13:33:40.587 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:33:40 smithi099 ceph-mon[24912]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' 2024-03-30T13:33:40.588 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:33:40 smithi099 ceph-mon[24912]: from='osd.2 [v2:172.21.15.99:6818/770589655,v1:172.21.15.99:6819/770589655]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-03-30T13:33:40.588 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:33:40 smithi099 ceph-mon[29691]: pgmap v69: 0 pgs: ; 0 B data, 9.8 MiB used, 179 GiB / 179 GiB avail 2024-03-30T13:33:40.588 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:33:40 smithi099 ceph-mon[29691]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' 2024-03-30T13:33:40.588 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:33:40 smithi099 ceph-mon[29691]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:33:40.588 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:33:40 smithi099 ceph-mon[29691]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:33:40.588 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:33:40 smithi099 ceph-mon[29691]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:33:40.588 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:33:40 smithi099 ceph-mon[29691]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-03-30T13:33:40.588 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:33:40 smithi099 ceph-mon[29691]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-03-30T13:33:40.588 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:33:40 smithi099 ceph-mon[29691]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-03-30T13:33:40.588 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:33:40 smithi099 ceph-mon[29691]: Adjusting osd_memory_target on smithi099 to 5013M 2024-03-30T13:33:40.588 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:33:40 smithi099 ceph-mon[29691]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' 2024-03-30T13:33:40.588 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:33:40 smithi099 ceph-mon[29691]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' 2024-03-30T13:33:40.588 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:33:40 smithi099 ceph-mon[29691]: from='osd.2 [v2:172.21.15.99:6818/770589655,v1:172.21.15.99:6819/770589655]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-03-30T13:33:41.337 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:33:41 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[25141]: 172.21.15.99 - - [30/Mar/2024:13:33:41] "POST /data HTTP/1.1" 200 46 "" "Python-urllib/3.9" 2024-03-30T13:33:41.756 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:33:41 smithi181 ceph-mon[25762]: from='osd.2 [v2:172.21.15.99:6818/770589655,v1:172.21.15.99:6819/770589655]' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-03-30T13:33:41.756 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:33:41 smithi181 ceph-mon[25762]: osdmap e16: 3 total, 2 up, 3 in 2024-03-30T13:33:41.756 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:33:41 smithi181 ceph-mon[25762]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-03-30T13:33:41.756 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:33:41 smithi181 ceph-mon[25762]: from='osd.2 [v2:172.21.15.99:6818/770589655,v1:172.21.15.99:6819/770589655]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi099", "root=default"]}]: dispatch 2024-03-30T13:33:41.756 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:33:41 smithi181 ceph-mon[25762]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' 2024-03-30T13:33:41.756 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:33:41 smithi181 ceph-mon[25762]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' 2024-03-30T13:33:41.756 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:33:41 smithi181 ceph-mon[25762]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:33:41.756 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:33:41 smithi181 ceph-mon[25762]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:33:41.757 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:33:41 smithi181 ceph-mon[25762]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:33:41.757 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:33:41 smithi181 ceph-mon[25762]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' 2024-03-30T13:33:41.804 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:33:41 smithi099 ceph-mon[24912]: from='osd.2 [v2:172.21.15.99:6818/770589655,v1:172.21.15.99:6819/770589655]' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-03-30T13:33:41.804 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:33:41 smithi099 ceph-mon[24912]: osdmap e16: 3 total, 2 up, 3 in 2024-03-30T13:33:41.804 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:33:41 smithi099 ceph-mon[24912]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-03-30T13:33:41.804 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:33:41 smithi099 ceph-mon[24912]: from='osd.2 [v2:172.21.15.99:6818/770589655,v1:172.21.15.99:6819/770589655]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi099", "root=default"]}]: dispatch 2024-03-30T13:33:41.804 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:33:41 smithi099 ceph-mon[24912]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' 2024-03-30T13:33:41.804 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:33:41 smithi099 ceph-mon[24912]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' 2024-03-30T13:33:41.804 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:33:41 smithi099 ceph-mon[24912]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:33:41.804 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:33:41 smithi099 ceph-mon[24912]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:33:41.804 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:33:41 smithi099 ceph-mon[24912]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:33:41.805 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:33:41 smithi099 ceph-mon[24912]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' 2024-03-30T13:33:41.805 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:33:41 smithi099 ceph-mon[29691]: from='osd.2 [v2:172.21.15.99:6818/770589655,v1:172.21.15.99:6819/770589655]' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-03-30T13:33:41.805 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:33:41 smithi099 ceph-mon[29691]: osdmap e16: 3 total, 2 up, 3 in 2024-03-30T13:33:41.805 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:33:41 smithi099 ceph-mon[29691]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-03-30T13:33:41.805 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:33:41 smithi099 ceph-mon[29691]: from='osd.2 [v2:172.21.15.99:6818/770589655,v1:172.21.15.99:6819/770589655]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi099", "root=default"]}]: dispatch 2024-03-30T13:33:41.805 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:33:41 smithi099 ceph-mon[29691]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' 2024-03-30T13:33:41.805 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:33:41 smithi099 ceph-mon[29691]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' 2024-03-30T13:33:41.805 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:33:41 smithi099 ceph-mon[29691]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:33:41.805 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:33:41 smithi099 ceph-mon[29691]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:33:41.805 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:33:41 smithi099 ceph-mon[29691]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:33:41.805 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:33:41 smithi099 ceph-mon[29691]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' 2024-03-30T13:33:41.806 INFO:journalctl@ceph.osd.2.smithi099.stdout:Mar 30 13:33:41 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-2[38881]: 2024-03-30T13:33:41.484+0000 7fba23034700 -1 osd.2 0 waiting for initial osdmap 2024-03-30T13:33:41.806 INFO:journalctl@ceph.osd.2.smithi099.stdout:Mar 30 13:33:41 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-2[38881]: 2024-03-30T13:33:41.489+0000 7fba1e1cc700 -1 osd.2 17 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-03-30T13:33:42.755 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:33:42 smithi181 ceph-mon[25762]: pgmap v71: 0 pgs: ; 0 B data, 9.8 MiB used, 179 GiB / 179 GiB avail 2024-03-30T13:33:42.756 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:33:42 smithi181 ceph-mon[25762]: from='osd.2 [v2:172.21.15.99:6818/770589655,v1:172.21.15.99:6819/770589655]' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi099", "root=default"]}]': finished 2024-03-30T13:33:42.756 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:33:42 smithi181 ceph-mon[25762]: osdmap e17: 3 total, 2 up, 3 in 2024-03-30T13:33:42.756 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:33:42 smithi181 ceph-mon[25762]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-03-30T13:33:42.756 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:33:42 smithi181 ceph-mon[25762]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-03-30T13:33:42.778 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:33:42 smithi099 ceph-mon[29691]: pgmap v71: 0 pgs: ; 0 B data, 9.8 MiB used, 179 GiB / 179 GiB avail 2024-03-30T13:33:42.778 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:33:42 smithi099 ceph-mon[29691]: from='osd.2 [v2:172.21.15.99:6818/770589655,v1:172.21.15.99:6819/770589655]' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi099", "root=default"]}]': finished 2024-03-30T13:33:42.778 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:33:42 smithi099 ceph-mon[29691]: osdmap e17: 3 total, 2 up, 3 in 2024-03-30T13:33:42.778 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:33:42 smithi099 ceph-mon[29691]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-03-30T13:33:42.778 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:33:42 smithi099 ceph-mon[29691]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-03-30T13:33:42.778 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:33:42 smithi099 ceph-mon[24912]: pgmap v71: 0 pgs: ; 0 B data, 9.8 MiB used, 179 GiB / 179 GiB avail 2024-03-30T13:33:42.778 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:33:42 smithi099 ceph-mon[24912]: from='osd.2 [v2:172.21.15.99:6818/770589655,v1:172.21.15.99:6819/770589655]' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi099", "root=default"]}]': finished 2024-03-30T13:33:42.779 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:33:42 smithi099 ceph-mon[24912]: osdmap e17: 3 total, 2 up, 3 in 2024-03-30T13:33:42.779 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:33:42 smithi099 ceph-mon[24912]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-03-30T13:33:42.779 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:33:42 smithi099 ceph-mon[24912]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-03-30T13:33:43.273 INFO:teuthology.orchestra.run.smithi099.stderr:--> Zapping: /dev/vg_nvme/lv_1 2024-03-30T13:33:43.273 INFO:teuthology.orchestra.run.smithi099.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_1 bs=1M count=10 conv=fsync 2024-03-30T13:33:43.273 INFO:teuthology.orchestra.run.smithi099.stderr: stderr: 10+0 records in 2024-03-30T13:33:43.273 INFO:teuthology.orchestra.run.smithi099.stderr:10+0 records out 2024-03-30T13:33:43.273 INFO:teuthology.orchestra.run.smithi099.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.012378 s, 847 MB/s 2024-03-30T13:33:43.274 INFO:teuthology.orchestra.run.smithi099.stderr: stderr: 2024-03-30T13:33:43.274 INFO:teuthology.orchestra.run.smithi099.stderr:--> Zapping successful for: 2024-03-30T13:33:43.476 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:33:43 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[25141]: 172.21.15.99 - - [30/Mar/2024:13:33:43] "POST /data HTTP/1.1" 200 46 "" "Python-urllib/3.9" 2024-03-30T13:33:43.756 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:33:43 smithi181 ceph-mon[25762]: purged_snaps scrub starts 2024-03-30T13:33:43.757 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:33:43 smithi181 ceph-mon[25762]: purged_snaps scrub ok 2024-03-30T13:33:43.757 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:33:43 smithi181 ceph-mon[25762]: osd.2 [v2:172.21.15.99:6818/770589655,v1:172.21.15.99:6819/770589655] boot 2024-03-30T13:33:43.757 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:33:43 smithi181 ceph-mon[25762]: osdmap e18: 3 total, 3 up, 3 in 2024-03-30T13:33:43.757 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:33:43 smithi181 ceph-mon[25762]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-03-30T13:33:43.757 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:33:43 smithi181 ceph-mon[25762]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' 2024-03-30T13:33:43.757 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:33:43 smithi181 ceph-mon[25762]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' 2024-03-30T13:33:43.757 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:33:43 smithi181 ceph-mon[25762]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:33:43.757 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:33:43 smithi181 ceph-mon[25762]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:33:43.757 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:33:43 smithi181 ceph-mon[25762]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:33:43.757 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:33:43 smithi181 ceph-mon[25762]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' 2024-03-30T13:33:43.816 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:33:43 smithi099 ceph-mon[24912]: purged_snaps scrub starts 2024-03-30T13:33:43.816 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:33:43 smithi099 ceph-mon[24912]: purged_snaps scrub ok 2024-03-30T13:33:43.816 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:33:43 smithi099 ceph-mon[24912]: osd.2 [v2:172.21.15.99:6818/770589655,v1:172.21.15.99:6819/770589655] boot 2024-03-30T13:33:43.817 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:33:43 smithi099 ceph-mon[24912]: osdmap e18: 3 total, 3 up, 3 in 2024-03-30T13:33:43.817 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:33:43 smithi099 ceph-mon[24912]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-03-30T13:33:43.817 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:33:43 smithi099 ceph-mon[24912]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' 2024-03-30T13:33:43.817 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:33:43 smithi099 ceph-mon[24912]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' 2024-03-30T13:33:43.817 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:33:43 smithi099 ceph-mon[24912]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:33:43.817 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:33:43 smithi099 ceph-mon[24912]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:33:43.817 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:33:43 smithi099 ceph-mon[24912]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:33:43.817 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:33:43 smithi099 ceph-mon[24912]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' 2024-03-30T13:33:43.817 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:33:43 smithi099 ceph-mon[29691]: purged_snaps scrub starts 2024-03-30T13:33:43.817 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:33:43 smithi099 ceph-mon[29691]: purged_snaps scrub ok 2024-03-30T13:33:43.817 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:33:43 smithi099 ceph-mon[29691]: osd.2 [v2:172.21.15.99:6818/770589655,v1:172.21.15.99:6819/770589655] boot 2024-03-30T13:33:43.817 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:33:43 smithi099 ceph-mon[29691]: osdmap e18: 3 total, 3 up, 3 in 2024-03-30T13:33:43.818 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:33:43 smithi099 ceph-mon[29691]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-03-30T13:33:43.818 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:33:43 smithi099 ceph-mon[29691]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' 2024-03-30T13:33:43.818 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:33:43 smithi099 ceph-mon[29691]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' 2024-03-30T13:33:43.818 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:33:43 smithi099 ceph-mon[29691]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:33:43.818 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:33:43 smithi099 ceph-mon[29691]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:33:43.818 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:33:43 smithi099 ceph-mon[29691]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:33:43.818 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:33:43 smithi099 ceph-mon[29691]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' 2024-03-30T13:33:44.116 DEBUG:teuthology.orchestra.run.smithi099:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 98ebaeb8-ee99-11ee-b647-cb9ed24678a4 -- ceph orch daemon add osd smithi099:vg_nvme/lv_1 2024-03-30T13:33:44.966 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:33:44 smithi099 ceph-mon[24912]: pgmap v74: 0 pgs: ; 0 B data, 9.8 MiB used, 179 GiB / 179 GiB avail 2024-03-30T13:33:44.966 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:33:44 smithi099 ceph-mon[24912]: osdmap e19: 3 total, 3 up, 3 in 2024-03-30T13:33:44.966 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:33:44 smithi099 ceph-mon[24912]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32}]: dispatch 2024-03-30T13:33:44.966 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:33:44 smithi099 ceph-mon[29691]: pgmap v74: 0 pgs: ; 0 B data, 9.8 MiB used, 179 GiB / 179 GiB avail 2024-03-30T13:33:44.966 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:33:44 smithi099 ceph-mon[29691]: osdmap e19: 3 total, 3 up, 3 in 2024-03-30T13:33:44.966 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:33:44 smithi099 ceph-mon[29691]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32}]: dispatch 2024-03-30T13:33:45.006 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:33:44 smithi181 ceph-mon[25762]: pgmap v74: 0 pgs: ; 0 B data, 9.8 MiB used, 179 GiB / 179 GiB avail 2024-03-30T13:33:45.006 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:33:44 smithi181 ceph-mon[25762]: osdmap e19: 3 total, 3 up, 3 in 2024-03-30T13:33:45.006 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:33:44 smithi181 ceph-mon[25762]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32}]: dispatch 2024-03-30T13:33:45.812 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:33:45 smithi099 ceph-mon[24912]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32}]': finished 2024-03-30T13:33:45.812 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:33:45 smithi099 ceph-mon[24912]: osdmap e20: 3 total, 3 up, 3 in 2024-03-30T13:33:45.812 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:33:45 smithi099 ceph-mon[24912]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-03-30T13:33:45.812 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:33:45 smithi099 ceph-mon[24912]: pgmap v77: 1 pgs: 1 unknown; 0 B data, 15 MiB used, 268 GiB / 268 GiB avail 2024-03-30T13:33:45.812 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:33:45 smithi099 ceph-mon[29691]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32}]': finished 2024-03-30T13:33:45.812 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:33:45 smithi099 ceph-mon[29691]: osdmap e20: 3 total, 3 up, 3 in 2024-03-30T13:33:45.812 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:33:45 smithi099 ceph-mon[29691]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-03-30T13:33:45.812 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:33:45 smithi099 ceph-mon[29691]: pgmap v77: 1 pgs: 1 unknown; 0 B data, 15 MiB used, 268 GiB / 268 GiB avail 2024-03-30T13:33:46.256 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:33:45 smithi181 ceph-mon[25762]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32}]': finished 2024-03-30T13:33:46.256 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:33:45 smithi181 ceph-mon[25762]: osdmap e20: 3 total, 3 up, 3 in 2024-03-30T13:33:46.256 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:33:45 smithi181 ceph-mon[25762]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-03-30T13:33:46.256 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:33:45 smithi181 ceph-mon[25762]: pgmap v77: 1 pgs: 1 unknown; 0 B data, 15 MiB used, 268 GiB / 268 GiB avail 2024-03-30T13:33:46.959 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:33:46 smithi099 ceph-mon[29691]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-03-30T13:33:46.960 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:33:46 smithi099 ceph-mon[29691]: osdmap e21: 3 total, 3 up, 3 in 2024-03-30T13:33:46.960 INFO:journalctl@ceph.osd.0.smithi099.stdout:Mar 30 13:33:46 smithi099 sudo[40214]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/smartctl -x --json=o /dev/nvme0n1 2024-03-30T13:33:46.960 INFO:journalctl@ceph.osd.0.smithi099.stdout:Mar 30 13:33:46 smithi099 sudo[40214]: pam_unix(sudo:session): session opened for user root by (uid=0) 2024-03-30T13:33:46.960 INFO:journalctl@ceph.osd.0.smithi099.stdout:Mar 30 13:33:46 smithi099 sudo[40214]: pam_unix(sudo:session): session closed for user root 2024-03-30T13:33:46.960 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:33:46 smithi099 ceph-mon[24912]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-03-30T13:33:46.960 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:33:46 smithi099 ceph-mon[24912]: osdmap e21: 3 total, 3 up, 3 in 2024-03-30T13:33:47.252 INFO:journalctl@ceph.osd.0.smithi099.stdout:Mar 30 13:33:46 smithi099 sudo[40260]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-03-30T13:33:47.252 INFO:journalctl@ceph.osd.0.smithi099.stdout:Mar 30 13:33:46 smithi099 sudo[40260]: pam_unix(sudo:session): session opened for user root by (uid=0) 2024-03-30T13:33:47.252 INFO:journalctl@ceph.osd.0.smithi099.stdout:Mar 30 13:33:46 smithi099 sudo[40260]: pam_unix(sudo:session): session closed for user root 2024-03-30T13:33:47.256 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:33:46 smithi181 ceph-mon[25762]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-03-30T13:33:47.256 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:33:46 smithi181 ceph-mon[25762]: osdmap e21: 3 total, 3 up, 3 in 2024-03-30T13:33:47.507 INFO:journalctl@ceph.osd.1.smithi099.stdout:Mar 30 13:33:47 smithi099 sudo[40316]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/smartctl -x --json=o /dev/nvme0n1 2024-03-30T13:33:47.507 INFO:journalctl@ceph.osd.1.smithi099.stdout:Mar 30 13:33:47 smithi099 sudo[40316]: pam_unix(sudo:session): session opened for user root by (uid=0) 2024-03-30T13:33:47.507 INFO:journalctl@ceph.osd.1.smithi099.stdout:Mar 30 13:33:47 smithi099 sudo[40316]: pam_unix(sudo:session): session closed for user root 2024-03-30T13:33:47.766 INFO:journalctl@ceph.osd.1.smithi099.stdout:Mar 30 13:33:47 smithi099 sudo[40323]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-03-30T13:33:47.766 INFO:journalctl@ceph.osd.1.smithi099.stdout:Mar 30 13:33:47 smithi099 sudo[40323]: pam_unix(sudo:session): session opened for user root by (uid=0) 2024-03-30T13:33:47.766 INFO:journalctl@ceph.osd.1.smithi099.stdout:Mar 30 13:33:47 smithi099 sudo[40323]: pam_unix(sudo:session): session closed for user root 2024-03-30T13:33:47.766 INFO:journalctl@ceph.osd.2.smithi099.stdout:Mar 30 13:33:47 smithi099 sudo[40340]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/smartctl -x --json=o /dev/nvme0n1 2024-03-30T13:33:47.766 INFO:journalctl@ceph.osd.2.smithi099.stdout:Mar 30 13:33:47 smithi099 sudo[40340]: pam_unix(sudo:session): session opened for user root by (uid=0) 2024-03-30T13:33:47.766 INFO:journalctl@ceph.osd.2.smithi099.stdout:Mar 30 13:33:47 smithi099 sudo[40340]: pam_unix(sudo:session): session closed for user root 2024-03-30T13:33:48.075 INFO:journalctl@ceph.osd.2.smithi099.stdout:Mar 30 13:33:48 smithi099 sudo[40345]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-03-30T13:33:48.075 INFO:journalctl@ceph.osd.2.smithi099.stdout:Mar 30 13:33:48 smithi099 sudo[40345]: pam_unix(sudo:session): session opened for user root by (uid=0) 2024-03-30T13:33:48.075 INFO:journalctl@ceph.osd.2.smithi099.stdout:Mar 30 13:33:48 smithi099 sudo[40345]: pam_unix(sudo:session): session closed for user root 2024-03-30T13:33:48.076 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:33:47 smithi099 ceph-mon[29691]: osdmap e22: 3 total, 3 up, 3 in 2024-03-30T13:33:48.076 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:33:47 smithi099 ceph-mon[29691]: from='client.24199 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi099:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T13:33:48.076 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:33:47 smithi099 ceph-mon[29691]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-03-30T13:33:48.076 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:33:47 smithi099 ceph-mon[29691]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-03-30T13:33:48.076 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:33:47 smithi099 ceph-mon[29691]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:33:48.076 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:33:47 smithi099 ceph-mon[29691]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' 2024-03-30T13:33:48.076 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:33:47 smithi099 ceph-mon[29691]: pgmap v80: 1 pgs: 1 unknown; 0 B data, 15 MiB used, 268 GiB / 268 GiB avail 2024-03-30T13:33:48.076 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:33:47 smithi099 ceph-mon[24912]: osdmap e22: 3 total, 3 up, 3 in 2024-03-30T13:33:48.076 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:33:47 smithi099 ceph-mon[24912]: from='client.24199 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi099:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T13:33:48.076 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:33:47 smithi099 ceph-mon[24912]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-03-30T13:33:48.077 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:33:47 smithi099 ceph-mon[24912]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-03-30T13:33:48.077 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:33:47 smithi099 ceph-mon[24912]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:33:48.077 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:33:47 smithi099 ceph-mon[24912]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' 2024-03-30T13:33:48.077 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:33:47 smithi099 ceph-mon[24912]: pgmap v80: 1 pgs: 1 unknown; 0 B data, 15 MiB used, 268 GiB / 268 GiB avail 2024-03-30T13:33:48.256 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:33:47 smithi181 ceph-mon[25762]: osdmap e22: 3 total, 3 up, 3 in 2024-03-30T13:33:48.256 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:33:47 smithi181 ceph-mon[25762]: from='client.24199 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi099:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T13:33:48.256 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:33:47 smithi181 ceph-mon[25762]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-03-30T13:33:48.256 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:33:47 smithi181 ceph-mon[25762]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-03-30T13:33:48.256 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:33:47 smithi181 ceph-mon[25762]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:33:48.256 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:33:47 smithi181 ceph-mon[25762]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' 2024-03-30T13:33:48.256 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:33:47 smithi181 ceph-mon[25762]: pgmap v80: 1 pgs: 1 unknown; 0 B data, 15 MiB used, 268 GiB / 268 GiB avail 2024-03-30T13:33:48.336 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:33:48 smithi099 sudo[40348]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/smartctl -x --json=o /dev/nvme0n1 2024-03-30T13:33:48.337 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:33:48 smithi099 sudo[40348]: pam_unix(sudo:session): session opened for user root by (uid=0) 2024-03-30T13:33:48.337 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:33:48 smithi099 sudo[40348]: pam_unix(sudo:session): session closed for user root 2024-03-30T13:33:48.614 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:33:48 smithi099 sudo[40370]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-03-30T13:33:48.615 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:33:48 smithi099 sudo[40370]: pam_unix(sudo:session): session opened for user root by (uid=0) 2024-03-30T13:33:48.615 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:33:48 smithi099 sudo[40370]: pam_unix(sudo:session): session closed for user root 2024-03-30T13:33:49.035 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:33:48 smithi099 sudo[40380]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/smartctl -x --json=o /dev/nvme0n1 2024-03-30T13:33:49.035 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:33:48 smithi099 sudo[40380]: pam_unix(sudo:session): session opened for user root by (uid=0) 2024-03-30T13:33:49.035 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:33:48 smithi099 sudo[40380]: pam_unix(sudo:session): session closed for user root 2024-03-30T13:33:49.336 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:33:49 smithi099 sudo[40396]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-03-30T13:33:49.337 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:33:49 smithi099 sudo[40396]: pam_unix(sudo:session): session opened for user root by (uid=0) 2024-03-30T13:33:49.337 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:33:49 smithi099 sudo[40396]: pam_unix(sudo:session): session closed for user root 2024-03-30T13:33:49.544 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:33:49 smithi181 sudo[28309]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/smartctl -x --json=o /dev/nvme0n1 2024-03-30T13:33:49.544 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:33:49 smithi181 sudo[28309]: pam_unix(sudo:session): session opened for user root by (uid=0) 2024-03-30T13:33:49.544 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:33:49 smithi181 sudo[28309]: pam_unix(sudo:session): session closed for user root 2024-03-30T13:33:49.837 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:33:49 smithi099 ceph-mon[24912]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-03-30T13:33:49.837 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:33:49 smithi099 ceph-mon[24912]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-03-30T13:33:49.837 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:33:49 smithi099 ceph-mon[24912]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-03-30T13:33:49.837 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:33:49 smithi099 ceph-mon[24912]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-30T13:33:49.837 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:33:49 smithi099 ceph-mon[24912]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-30T13:33:49.838 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:33:49 smithi099 ceph-mon[24912]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-03-30T13:33:49.838 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:33:49 smithi099 ceph-mon[24912]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-30T13:33:49.838 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:33:49 smithi099 ceph-mon[24912]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-30T13:33:49.838 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:33:49 smithi099 ceph-mon[29691]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-03-30T13:33:49.838 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:33:49 smithi099 ceph-mon[29691]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-03-30T13:33:49.838 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:33:49 smithi099 ceph-mon[29691]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-03-30T13:33:49.838 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:33:49 smithi099 ceph-mon[29691]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-30T13:33:49.838 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:33:49 smithi099 ceph-mon[29691]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-30T13:33:49.838 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:33:49 smithi099 ceph-mon[29691]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-03-30T13:33:49.838 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:33:49 smithi099 ceph-mon[29691]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-30T13:33:49.838 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:33:49 smithi099 ceph-mon[29691]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-30T13:33:50.006 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:33:49 smithi181 sudo[28352]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-03-30T13:33:50.006 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:33:49 smithi181 sudo[28352]: pam_unix(sudo:session): session opened for user root by (uid=0) 2024-03-30T13:33:50.006 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:33:49 smithi181 sudo[28352]: pam_unix(sudo:session): session closed for user root 2024-03-30T13:33:50.006 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:33:49 smithi181 ceph-mon[25762]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-03-30T13:33:50.006 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:33:49 smithi181 ceph-mon[25762]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-03-30T13:33:50.006 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:33:49 smithi181 ceph-mon[25762]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-03-30T13:33:50.006 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:33:49 smithi181 ceph-mon[25762]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-30T13:33:50.006 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:33:49 smithi181 ceph-mon[25762]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-30T13:33:50.006 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:33:49 smithi181 ceph-mon[25762]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-03-30T13:33:50.006 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:33:49 smithi181 ceph-mon[25762]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-30T13:33:50.007 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:33:49 smithi181 ceph-mon[25762]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-30T13:33:50.837 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:33:50 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[25141]: 172.21.15.181 - - [30/Mar/2024:13:33:50] "POST /data HTTP/1.1" 200 46 "" "Python-urllib/3.9" 2024-03-30T13:33:50.837 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:33:50 smithi099 ceph-mon[24912]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-03-30T13:33:50.837 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:33:50 smithi099 ceph-mon[24912]: pgmap v81: 1 pgs: 1 unknown; 0 B data, 16 MiB used, 268 GiB / 268 GiB avail 2024-03-30T13:33:50.837 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:33:50 smithi099 ceph-mon[24912]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-03-30T13:33:50.837 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:33:50 smithi099 ceph-mon[24912]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-03-30T13:33:50.838 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:33:50 smithi099 ceph-mon[24912]: mgrmap e15: y(active, since 2m), standbys: x 2024-03-30T13:33:50.838 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:33:50 smithi099 ceph-mon[24912]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-03-30T13:33:50.838 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:33:50 smithi099 ceph-mon[24912]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-30T13:33:50.838 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:33:50 smithi099 ceph-mon[24912]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-30T13:33:50.838 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:33:50 smithi099 ceph-mon[24912]: from='client.? 172.21.15.99:0/2183078381' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ed272b2b-e9e4-42f7-bf4b-12b5c3d7b90e"}]: dispatch 2024-03-30T13:33:50.838 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:33:50 smithi099 ceph-mon[24912]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-03-30T13:33:50.838 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:33:50 smithi099 ceph-mon[24912]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ed272b2b-e9e4-42f7-bf4b-12b5c3d7b90e"}]: dispatch 2024-03-30T13:33:50.838 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:33:50 smithi099 ceph-mon[24912]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "ed272b2b-e9e4-42f7-bf4b-12b5c3d7b90e"}]': finished 2024-03-30T13:33:50.838 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:33:50 smithi099 ceph-mon[24912]: osdmap e23: 4 total, 3 up, 4 in 2024-03-30T13:33:50.838 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:33:50 smithi099 ceph-mon[24912]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-03-30T13:33:50.838 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:33:50 smithi099 ceph-mon[24912]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' 2024-03-30T13:33:50.838 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:33:50 smithi099 ceph-mon[24912]: from='client.? 172.21.15.99:0/2025766117' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-03-30T13:33:50.838 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:33:50 smithi099 ceph-mon[24912]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' 2024-03-30T13:33:50.838 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:33:50 smithi099 ceph-mon[24912]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' 2024-03-30T13:33:50.839 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:33:50 smithi099 ceph-mon[29691]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-03-30T13:33:50.839 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:33:50 smithi099 ceph-mon[29691]: pgmap v81: 1 pgs: 1 unknown; 0 B data, 16 MiB used, 268 GiB / 268 GiB avail 2024-03-30T13:33:50.839 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:33:50 smithi099 ceph-mon[29691]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-03-30T13:33:50.839 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:33:50 smithi099 ceph-mon[29691]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-03-30T13:33:50.839 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:33:50 smithi099 ceph-mon[29691]: mgrmap e15: y(active, since 2m), standbys: x 2024-03-30T13:33:50.839 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:33:50 smithi099 ceph-mon[29691]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-03-30T13:33:50.839 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:33:50 smithi099 ceph-mon[29691]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-30T13:33:50.839 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:33:50 smithi099 ceph-mon[29691]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-30T13:33:50.839 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:33:50 smithi099 ceph-mon[29691]: from='client.? 172.21.15.99:0/2183078381' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ed272b2b-e9e4-42f7-bf4b-12b5c3d7b90e"}]: dispatch 2024-03-30T13:33:50.839 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:33:50 smithi099 ceph-mon[29691]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-03-30T13:33:50.839 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:33:50 smithi099 ceph-mon[29691]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ed272b2b-e9e4-42f7-bf4b-12b5c3d7b90e"}]: dispatch 2024-03-30T13:33:50.839 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:33:50 smithi099 ceph-mon[29691]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "ed272b2b-e9e4-42f7-bf4b-12b5c3d7b90e"}]': finished 2024-03-30T13:33:50.839 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:33:50 smithi099 ceph-mon[29691]: osdmap e23: 4 total, 3 up, 4 in 2024-03-30T13:33:50.839 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:33:50 smithi099 ceph-mon[29691]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-03-30T13:33:50.840 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:33:50 smithi099 ceph-mon[29691]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' 2024-03-30T13:33:50.840 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:33:50 smithi099 ceph-mon[29691]: from='client.? 172.21.15.99:0/2025766117' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-03-30T13:33:50.840 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:33:50 smithi099 ceph-mon[29691]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' 2024-03-30T13:33:50.840 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:33:50 smithi099 ceph-mon[29691]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' 2024-03-30T13:33:51.006 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:33:50 smithi181 ceph-mon[25762]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-03-30T13:33:51.006 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:33:50 smithi181 ceph-mon[25762]: pgmap v81: 1 pgs: 1 unknown; 0 B data, 16 MiB used, 268 GiB / 268 GiB avail 2024-03-30T13:33:51.006 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:33:50 smithi181 ceph-mon[25762]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-03-30T13:33:51.006 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:33:50 smithi181 ceph-mon[25762]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-03-30T13:33:51.006 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:33:50 smithi181 ceph-mon[25762]: mgrmap e15: y(active, since 2m), standbys: x 2024-03-30T13:33:51.006 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:33:50 smithi181 ceph-mon[25762]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-03-30T13:33:51.006 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:33:50 smithi181 ceph-mon[25762]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-30T13:33:51.006 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:33:50 smithi181 ceph-mon[25762]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-30T13:33:51.007 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:33:50 smithi181 ceph-mon[25762]: from='client.? 172.21.15.99:0/2183078381' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ed272b2b-e9e4-42f7-bf4b-12b5c3d7b90e"}]: dispatch 2024-03-30T13:33:51.007 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:33:50 smithi181 ceph-mon[25762]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-03-30T13:33:51.007 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:33:50 smithi181 ceph-mon[25762]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ed272b2b-e9e4-42f7-bf4b-12b5c3d7b90e"}]: dispatch 2024-03-30T13:33:51.007 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:33:50 smithi181 ceph-mon[25762]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "ed272b2b-e9e4-42f7-bf4b-12b5c3d7b90e"}]': finished 2024-03-30T13:33:51.007 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:33:50 smithi181 ceph-mon[25762]: osdmap e23: 4 total, 3 up, 4 in 2024-03-30T13:33:51.007 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:33:50 smithi181 ceph-mon[25762]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-03-30T13:33:51.007 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:33:50 smithi181 ceph-mon[25762]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' 2024-03-30T13:33:51.007 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:33:50 smithi181 ceph-mon[25762]: from='client.? 172.21.15.99:0/2025766117' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-03-30T13:33:51.007 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:33:50 smithi181 ceph-mon[25762]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' 2024-03-30T13:33:51.007 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:33:50 smithi181 ceph-mon[25762]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' 2024-03-30T13:33:52.665 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:33:52 smithi181 ceph-mon[25762]: pgmap v83: 1 pgs: 1 active+clean; 577 KiB data, 18 MiB used, 268 GiB / 268 GiB avail 2024-03-30T13:33:52.671 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:33:52 smithi099 ceph-mon[24912]: pgmap v83: 1 pgs: 1 active+clean; 577 KiB data, 18 MiB used, 268 GiB / 268 GiB avail 2024-03-30T13:33:52.671 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:33:52 smithi099 ceph-mon[29691]: pgmap v83: 1 pgs: 1 active+clean; 577 KiB data, 18 MiB used, 268 GiB / 268 GiB avail 2024-03-30T13:33:54.631 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:33:54 smithi099 ceph-mon[24912]: pgmap v84: 1 pgs: 1 active+clean; 577 KiB data, 18 MiB used, 268 GiB / 268 GiB avail 2024-03-30T13:33:54.631 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:33:54 smithi099 ceph-mon[29691]: pgmap v84: 1 pgs: 1 active+clean; 577 KiB data, 18 MiB used, 268 GiB / 268 GiB avail 2024-03-30T13:33:54.789 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:33:54 smithi181 ceph-mon[25762]: pgmap v84: 1 pgs: 1 active+clean; 577 KiB data, 18 MiB used, 268 GiB / 268 GiB avail 2024-03-30T13:33:56.837 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:33:56 smithi099 ceph-mon[24912]: pgmap v85: 1 pgs: 1 active+clean; 577 KiB data, 19 MiB used, 268 GiB / 268 GiB avail; 3.3 KiB/s rd, 144 KiB/s wr, 10 op/s 2024-03-30T13:33:56.837 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:33:56 smithi099 ceph-mon[24912]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-03-30T13:33:56.837 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:33:56 smithi099 ceph-mon[24912]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:33:56.837 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:33:56 smithi099 ceph-mon[29691]: pgmap v85: 1 pgs: 1 active+clean; 577 KiB data, 19 MiB used, 268 GiB / 268 GiB avail; 3.3 KiB/s rd, 144 KiB/s wr, 10 op/s 2024-03-30T13:33:56.837 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:33:56 smithi099 ceph-mon[29691]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-03-30T13:33:56.837 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:33:56 smithi099 ceph-mon[29691]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:33:57.005 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:33:56 smithi181 ceph-mon[25762]: pgmap v85: 1 pgs: 1 active+clean; 577 KiB data, 19 MiB used, 268 GiB / 268 GiB avail; 3.3 KiB/s rd, 144 KiB/s wr, 10 op/s 2024-03-30T13:33:57.006 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:33:56 smithi181 ceph-mon[25762]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-03-30T13:33:57.006 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:33:56 smithi181 ceph-mon[25762]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:33:57.718 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:33:57 smithi099 ceph-mon[24912]: Deploying daemon osd.3 on smithi099 2024-03-30T13:33:57.719 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:33:57 smithi099 ceph-mon[29691]: Deploying daemon osd.3 on smithi099 2024-03-30T13:33:58.005 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:33:57 smithi181 ceph-mon[25762]: Deploying daemon osd.3 on smithi099 2024-03-30T13:33:58.837 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:33:58 smithi099 ceph-mon[24912]: pgmap v86: 1 pgs: 1 active+clean; 577 KiB data, 19 MiB used, 268 GiB / 268 GiB avail; 2.4 KiB/s rd, 105 KiB/s wr, 7 op/s 2024-03-30T13:33:58.837 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:33:58 smithi099 ceph-mon[29691]: pgmap v86: 1 pgs: 1 active+clean; 577 KiB data, 19 MiB used, 268 GiB / 268 GiB avail; 2.4 KiB/s rd, 105 KiB/s wr, 7 op/s 2024-03-30T13:33:59.006 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:33:58 smithi181 ceph-mon[25762]: pgmap v86: 1 pgs: 1 active+clean; 577 KiB data, 19 MiB used, 268 GiB / 268 GiB avail; 2.4 KiB/s rd, 105 KiB/s wr, 7 op/s 2024-03-30T13:34:00.783 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:34:00 smithi099 ceph-mon[24912]: pgmap v87: 1 pgs: 1 active+clean; 577 KiB data, 19 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 83 KiB/s wr, 5 op/s 2024-03-30T13:34:00.783 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:34:00 smithi099 ceph-mon[29691]: pgmap v87: 1 pgs: 1 active+clean; 577 KiB data, 19 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 83 KiB/s wr, 5 op/s 2024-03-30T13:34:01.005 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:34:00 smithi181 ceph-mon[25762]: pgmap v87: 1 pgs: 1 active+clean; 577 KiB data, 19 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 83 KiB/s wr, 5 op/s 2024-03-30T13:34:01.718 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:34:01 smithi099 ceph-mon[29691]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:34:01.718 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:34:01 smithi099 ceph-mon[29691]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' 2024-03-30T13:34:01.718 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:34:01 smithi099 ceph-mon[29691]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:34:01.718 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:34:01 smithi099 ceph-mon[29691]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:34:01.718 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:34:01 smithi099 ceph-mon[29691]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' 2024-03-30T13:34:01.718 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:34:01 smithi099 ceph-mon[24912]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:34:01.718 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:34:01 smithi099 ceph-mon[24912]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' 2024-03-30T13:34:01.718 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:34:01 smithi099 ceph-mon[24912]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:34:01.719 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:34:01 smithi099 ceph-mon[24912]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:34:01.719 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:34:01 smithi099 ceph-mon[24912]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' 2024-03-30T13:34:02.006 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:34:01 smithi181 ceph-mon[25762]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:34:02.006 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:34:01 smithi181 ceph-mon[25762]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' 2024-03-30T13:34:02.006 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:34:01 smithi181 ceph-mon[25762]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:34:02.006 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:34:01 smithi181 ceph-mon[25762]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:34:02.006 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:34:01 smithi181 ceph-mon[25762]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' 2024-03-30T13:34:02.837 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:34:02 smithi099 ceph-mon[24912]: pgmap v88: 1 pgs: 1 active+clean; 577 KiB data, 19 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 68 KiB/s wr, 4 op/s 2024-03-30T13:34:02.837 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:34:02 smithi099 ceph-mon[29691]: pgmap v88: 1 pgs: 1 active+clean; 577 KiB data, 19 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 68 KiB/s wr, 4 op/s 2024-03-30T13:34:03.005 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:34:02 smithi181 ceph-mon[25762]: pgmap v88: 1 pgs: 1 active+clean; 577 KiB data, 19 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 68 KiB/s wr, 4 op/s 2024-03-30T13:34:03.500 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:34:03 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[25141]: 172.21.15.99 - - [30/Mar/2024:13:34:03] "POST /data HTTP/1.1" 200 46 "" "Python-urllib/3.9" 2024-03-30T13:34:04.417 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:34:04 smithi099 ceph-mon[24912]: pgmap v89: 1 pgs: 1 active+clean; 577 KiB data, 19 MiB used, 268 GiB / 268 GiB avail; 1.5 KiB/s rd, 65 KiB/s wr, 4 op/s 2024-03-30T13:34:04.417 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:34:04 smithi099 ceph-mon[24912]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' 2024-03-30T13:34:04.417 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:34:04 smithi099 ceph-mon[24912]: Detected new or changed devices on smithi099 2024-03-30T13:34:04.417 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:34:04 smithi099 ceph-mon[24912]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' 2024-03-30T13:34:04.417 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:34:04 smithi099 ceph-mon[24912]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:34:04.417 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:34:04 smithi099 ceph-mon[24912]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:34:04.418 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:34:04 smithi099 ceph-mon[24912]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:34:04.418 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:34:04 smithi099 ceph-mon[24912]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' 2024-03-30T13:34:04.418 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:34:04 smithi099 ceph-mon[24912]: from='osd.3 [v2:172.21.15.99:6826/2046550873,v1:172.21.15.99:6827/2046550873]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-03-30T13:34:04.418 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:34:04 smithi099 ceph-mon[29691]: pgmap v89: 1 pgs: 1 active+clean; 577 KiB data, 19 MiB used, 268 GiB / 268 GiB avail; 1.5 KiB/s rd, 65 KiB/s wr, 4 op/s 2024-03-30T13:34:04.418 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:34:04 smithi099 ceph-mon[29691]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' 2024-03-30T13:34:04.418 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:34:04 smithi099 ceph-mon[29691]: Detected new or changed devices on smithi099 2024-03-30T13:34:04.418 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:34:04 smithi099 ceph-mon[29691]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' 2024-03-30T13:34:04.418 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:34:04 smithi099 ceph-mon[29691]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:34:04.418 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:34:04 smithi099 ceph-mon[29691]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:34:04.418 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:34:04 smithi099 ceph-mon[29691]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:34:04.418 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:34:04 smithi099 ceph-mon[29691]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' 2024-03-30T13:34:04.418 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:34:04 smithi099 ceph-mon[29691]: from='osd.3 [v2:172.21.15.99:6826/2046550873,v1:172.21.15.99:6827/2046550873]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-03-30T13:34:04.506 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:34:04 smithi181 ceph-mon[25762]: pgmap v89: 1 pgs: 1 active+clean; 577 KiB data, 19 MiB used, 268 GiB / 268 GiB avail; 1.5 KiB/s rd, 65 KiB/s wr, 4 op/s 2024-03-30T13:34:04.506 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:34:04 smithi181 ceph-mon[25762]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' 2024-03-30T13:34:04.506 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:34:04 smithi181 ceph-mon[25762]: Detected new or changed devices on smithi099 2024-03-30T13:34:04.506 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:34:04 smithi181 ceph-mon[25762]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' 2024-03-30T13:34:04.506 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:34:04 smithi181 ceph-mon[25762]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:34:04.506 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:34:04 smithi181 ceph-mon[25762]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:34:04.506 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:34:04 smithi181 ceph-mon[25762]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:34:04.506 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:34:04 smithi181 ceph-mon[25762]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' 2024-03-30T13:34:04.507 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:34:04 smithi181 ceph-mon[25762]: from='osd.3 [v2:172.21.15.99:6826/2046550873,v1:172.21.15.99:6827/2046550873]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-03-30T13:34:04.773 INFO:teuthology.orchestra.run.smithi099.stdout:Created osd(s) 3 on host 'smithi099' 2024-03-30T13:34:05.424 DEBUG:teuthology.orchestra.run.smithi099:osd.3> sudo journalctl -f -n 0 -u ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4@osd.3.service 2024-03-30T13:34:05.428 INFO:tasks.cephadm:Deploying osd.4 on smithi181 with /dev/vg_nvme/lv_4... 2024-03-30T13:34:05.428 DEBUG:teuthology.orchestra.run.smithi181:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 98ebaeb8-ee99-11ee-b647-cb9ed24678a4 -- ceph-volume lvm zap /dev/vg_nvme/lv_4 2024-03-30T13:34:05.744 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:34:05 smithi099 ceph-mon[24912]: from='osd.3 [v2:172.21.15.99:6826/2046550873,v1:172.21.15.99:6827/2046550873]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-03-30T13:34:05.744 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:34:05 smithi099 ceph-mon[24912]: osdmap e24: 4 total, 3 up, 4 in 2024-03-30T13:34:05.744 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:34:05 smithi099 ceph-mon[24912]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-03-30T13:34:05.744 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:34:05 smithi099 ceph-mon[24912]: from='osd.3 [v2:172.21.15.99:6826/2046550873,v1:172.21.15.99:6827/2046550873]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi099", "root=default"]}]: dispatch 2024-03-30T13:34:05.744 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:34:05 smithi099 ceph-mon[24912]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' 2024-03-30T13:34:05.744 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:34:05 smithi099 ceph-mon[24912]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:34:05.744 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:34:05 smithi099 ceph-mon[24912]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:34:05.744 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:34:05 smithi099 ceph-mon[24912]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:34:05.744 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:34:05 smithi099 ceph-mon[24912]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' 2024-03-30T13:34:05.745 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:34:05 smithi099 ceph-mon[29691]: from='osd.3 [v2:172.21.15.99:6826/2046550873,v1:172.21.15.99:6827/2046550873]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-03-30T13:34:05.745 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:34:05 smithi099 ceph-mon[29691]: osdmap e24: 4 total, 3 up, 4 in 2024-03-30T13:34:05.745 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:34:05 smithi099 ceph-mon[29691]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-03-30T13:34:05.745 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:34:05 smithi099 ceph-mon[29691]: from='osd.3 [v2:172.21.15.99:6826/2046550873,v1:172.21.15.99:6827/2046550873]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi099", "root=default"]}]: dispatch 2024-03-30T13:34:05.745 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:34:05 smithi099 ceph-mon[29691]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' 2024-03-30T13:34:05.745 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:34:05 smithi099 ceph-mon[29691]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:34:05.745 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:34:05 smithi099 ceph-mon[29691]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:34:05.745 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:34:05 smithi099 ceph-mon[29691]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:34:05.745 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:34:05 smithi099 ceph-mon[29691]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' 2024-03-30T13:34:05.745 INFO:journalctl@ceph.osd.3.smithi099.stdout:Mar 30 13:34:05 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-3[41935]: 2024-03-30T13:34:05.576+0000 7f7f4362c700 -1 osd.3 0 waiting for initial osdmap 2024-03-30T13:34:05.745 INFO:journalctl@ceph.osd.3.smithi099.stdout:Mar 30 13:34:05 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-3[41935]: 2024-03-30T13:34:05.585+0000 7f7f3bfbf700 -1 osd.3 25 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-03-30T13:34:05.749 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:34:05 smithi181 ceph-mon[25762]: from='osd.3 [v2:172.21.15.99:6826/2046550873,v1:172.21.15.99:6827/2046550873]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-03-30T13:34:05.749 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:34:05 smithi181 ceph-mon[25762]: osdmap e24: 4 total, 3 up, 4 in 2024-03-30T13:34:05.749 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:34:05 smithi181 ceph-mon[25762]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-03-30T13:34:05.749 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:34:05 smithi181 ceph-mon[25762]: from='osd.3 [v2:172.21.15.99:6826/2046550873,v1:172.21.15.99:6827/2046550873]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi099", "root=default"]}]: dispatch 2024-03-30T13:34:05.749 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:34:05 smithi181 ceph-mon[25762]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' 2024-03-30T13:34:05.749 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:34:05 smithi181 ceph-mon[25762]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:34:05.749 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:34:05 smithi181 ceph-mon[25762]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:34:05.749 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:34:05 smithi181 ceph-mon[25762]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:34:05.749 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:34:05 smithi181 ceph-mon[25762]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' 2024-03-30T13:34:06.337 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:34:06 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[25141]: 172.21.15.99 - - [30/Mar/2024:13:34:06] "POST /data HTTP/1.1" 200 46 "" "Python-urllib/3.9" 2024-03-30T13:34:06.771 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:34:06 smithi099 ceph-mon[24912]: pgmap v91: 1 pgs: 1 active+clean; 577 KiB data, 19 MiB used, 268 GiB / 268 GiB avail 2024-03-30T13:34:06.772 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:34:06 smithi099 ceph-mon[24912]: from='osd.3 [v2:172.21.15.99:6826/2046550873,v1:172.21.15.99:6827/2046550873]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi099", "root=default"]}]': finished 2024-03-30T13:34:06.772 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:34:06 smithi099 ceph-mon[24912]: osdmap e25: 4 total, 3 up, 4 in 2024-03-30T13:34:06.772 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:34:06 smithi099 ceph-mon[24912]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-03-30T13:34:06.772 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:34:06 smithi099 ceph-mon[24912]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-03-30T13:34:06.772 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:34:06 smithi099 ceph-mon[24912]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' 2024-03-30T13:34:06.772 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:34:06 smithi099 ceph-mon[24912]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' 2024-03-30T13:34:06.772 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:34:06 smithi099 ceph-mon[24912]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:34:06.772 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:34:06 smithi099 ceph-mon[24912]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:34:06.772 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:34:06 smithi099 ceph-mon[24912]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:34:06.772 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:34:06 smithi099 ceph-mon[24912]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' 2024-03-30T13:34:06.773 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:34:06 smithi099 ceph-mon[29691]: pgmap v91: 1 pgs: 1 active+clean; 577 KiB data, 19 MiB used, 268 GiB / 268 GiB avail 2024-03-30T13:34:06.773 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:34:06 smithi099 ceph-mon[29691]: from='osd.3 [v2:172.21.15.99:6826/2046550873,v1:172.21.15.99:6827/2046550873]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi099", "root=default"]}]': finished 2024-03-30T13:34:06.773 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:34:06 smithi099 ceph-mon[29691]: osdmap e25: 4 total, 3 up, 4 in 2024-03-30T13:34:06.773 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:34:06 smithi099 ceph-mon[29691]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-03-30T13:34:06.773 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:34:06 smithi099 ceph-mon[29691]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-03-30T13:34:06.773 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:34:06 smithi099 ceph-mon[29691]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' 2024-03-30T13:34:06.773 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:34:06 smithi099 ceph-mon[29691]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' 2024-03-30T13:34:06.773 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:34:06 smithi099 ceph-mon[29691]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:34:06.773 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:34:06 smithi099 ceph-mon[29691]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:34:06.773 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:34:06 smithi099 ceph-mon[29691]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:34:06.773 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:34:06 smithi099 ceph-mon[29691]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' 2024-03-30T13:34:06.833 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:34:06 smithi181 ceph-mon[25762]: pgmap v91: 1 pgs: 1 active+clean; 577 KiB data, 19 MiB used, 268 GiB / 268 GiB avail 2024-03-30T13:34:06.833 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:34:06 smithi181 ceph-mon[25762]: from='osd.3 [v2:172.21.15.99:6826/2046550873,v1:172.21.15.99:6827/2046550873]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi099", "root=default"]}]': finished 2024-03-30T13:34:06.833 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:34:06 smithi181 ceph-mon[25762]: osdmap e25: 4 total, 3 up, 4 in 2024-03-30T13:34:06.833 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:34:06 smithi181 ceph-mon[25762]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-03-30T13:34:06.833 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:34:06 smithi181 ceph-mon[25762]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-03-30T13:34:06.834 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:34:06 smithi181 ceph-mon[25762]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' 2024-03-30T13:34:06.834 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:34:06 smithi181 ceph-mon[25762]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' 2024-03-30T13:34:06.834 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:34:06 smithi181 ceph-mon[25762]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:34:06.834 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:34:06 smithi181 ceph-mon[25762]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:34:06.834 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:34:06 smithi181 ceph-mon[25762]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:34:06.834 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:34:06 smithi181 ceph-mon[25762]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' 2024-03-30T13:34:07.401 INFO:teuthology.orchestra.run.smithi181.stderr:--> Zapping: /dev/vg_nvme/lv_4 2024-03-30T13:34:07.401 INFO:teuthology.orchestra.run.smithi181.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_4 bs=1M count=10 conv=fsync 2024-03-30T13:34:07.401 INFO:teuthology.orchestra.run.smithi181.stderr: stderr: 10+0 records in 2024-03-30T13:34:07.401 INFO:teuthology.orchestra.run.smithi181.stderr:10+0 records out 2024-03-30T13:34:07.401 INFO:teuthology.orchestra.run.smithi181.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0113878 s, 921 MB/s 2024-03-30T13:34:07.401 INFO:teuthology.orchestra.run.smithi181.stderr:--> Zapping successful for: 2024-03-30T13:34:07.756 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:34:07 smithi181 ceph-mon[25762]: purged_snaps scrub starts 2024-03-30T13:34:07.756 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:34:07 smithi181 ceph-mon[25762]: purged_snaps scrub ok 2024-03-30T13:34:07.756 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:34:07 smithi181 ceph-mon[25762]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-03-30T13:34:07.756 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:34:07 smithi181 ceph-mon[25762]: osd.3 [v2:172.21.15.99:6826/2046550873,v1:172.21.15.99:6827/2046550873] boot 2024-03-30T13:34:07.756 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:34:07 smithi181 ceph-mon[25762]: osdmap e26: 4 total, 4 up, 4 in 2024-03-30T13:34:07.756 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:34:07 smithi181 ceph-mon[25762]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-03-30T13:34:07.756 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:34:07 smithi181 ceph-mon[25762]: pgmap v94: 1 pgs: 1 active+clean; 577 KiB data, 19 MiB used, 268 GiB / 268 GiB avail 2024-03-30T13:34:08.004 DEBUG:teuthology.orchestra.run.smithi181:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 98ebaeb8-ee99-11ee-b647-cb9ed24678a4 -- ceph orch daemon add osd smithi181:vg_nvme/lv_4 2024-03-30T13:34:08.086 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:34:07 smithi099 ceph-mon[24912]: purged_snaps scrub starts 2024-03-30T13:34:08.087 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:34:07 smithi099 ceph-mon[24912]: purged_snaps scrub ok 2024-03-30T13:34:08.087 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:34:07 smithi099 ceph-mon[24912]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-03-30T13:34:08.087 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:34:07 smithi099 ceph-mon[24912]: osd.3 [v2:172.21.15.99:6826/2046550873,v1:172.21.15.99:6827/2046550873] boot 2024-03-30T13:34:08.087 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:34:07 smithi099 ceph-mon[24912]: osdmap e26: 4 total, 4 up, 4 in 2024-03-30T13:34:08.087 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:34:07 smithi099 ceph-mon[24912]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-03-30T13:34:08.087 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:34:07 smithi099 ceph-mon[24912]: pgmap v94: 1 pgs: 1 active+clean; 577 KiB data, 19 MiB used, 268 GiB / 268 GiB avail 2024-03-30T13:34:08.087 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:34:07 smithi099 ceph-mon[29691]: purged_snaps scrub starts 2024-03-30T13:34:08.087 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:34:07 smithi099 ceph-mon[29691]: purged_snaps scrub ok 2024-03-30T13:34:08.087 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:34:07 smithi099 ceph-mon[29691]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-03-30T13:34:08.087 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:34:07 smithi099 ceph-mon[29691]: osd.3 [v2:172.21.15.99:6826/2046550873,v1:172.21.15.99:6827/2046550873] boot 2024-03-30T13:34:08.087 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:34:07 smithi099 ceph-mon[29691]: osdmap e26: 4 total, 4 up, 4 in 2024-03-30T13:34:08.087 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:34:07 smithi099 ceph-mon[29691]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-03-30T13:34:08.088 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:34:07 smithi099 ceph-mon[29691]: pgmap v94: 1 pgs: 1 active+clean; 577 KiB data, 19 MiB used, 268 GiB / 268 GiB avail 2024-03-30T13:34:08.952 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:34:08 smithi181 ceph-mon[25762]: osdmap e27: 4 total, 4 up, 4 in 2024-03-30T13:34:09.086 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:34:08 smithi099 ceph-mon[24912]: osdmap e27: 4 total, 4 up, 4 in 2024-03-30T13:34:09.087 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:34:08 smithi099 ceph-mon[29691]: osdmap e27: 4 total, 4 up, 4 in 2024-03-30T13:34:09.894 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:34:09 smithi181 ceph-mon[25762]: pgmap v96: 1 pgs: 1 active+clean; 577 KiB data, 23 MiB used, 358 GiB / 358 GiB avail 2024-03-30T13:34:10.086 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:34:09 smithi099 ceph-mon[24912]: pgmap v96: 1 pgs: 1 active+clean; 577 KiB data, 23 MiB used, 358 GiB / 358 GiB avail 2024-03-30T13:34:10.087 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:34:09 smithi099 ceph-mon[29691]: pgmap v96: 1 pgs: 1 active+clean; 577 KiB data, 23 MiB used, 358 GiB / 358 GiB avail 2024-03-30T13:34:10.862 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:34:10 smithi181 ceph-mon[25762]: from='client.24188 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi181:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T13:34:10.862 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:34:10 smithi181 ceph-mon[25762]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-03-30T13:34:10.862 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:34:10 smithi181 ceph-mon[25762]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-03-30T13:34:10.862 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:34:10 smithi181 ceph-mon[25762]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:34:11.087 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:34:10 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[25141]: 172.21.15.181 - - [30/Mar/2024:13:34:10] "POST /data HTTP/1.1" 200 46 "" "Python-urllib/3.9" 2024-03-30T13:34:11.087 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:34:10 smithi099 ceph-mon[24912]: from='client.24188 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi181:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T13:34:11.087 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:34:10 smithi099 ceph-mon[24912]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-03-30T13:34:11.087 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:34:10 smithi099 ceph-mon[24912]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-03-30T13:34:11.087 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:34:10 smithi099 ceph-mon[24912]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:34:11.087 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:34:10 smithi099 ceph-mon[29691]: from='client.24188 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi181:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T13:34:11.088 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:34:10 smithi099 ceph-mon[29691]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-03-30T13:34:11.088 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:34:10 smithi099 ceph-mon[29691]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-03-30T13:34:11.088 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:34:10 smithi099 ceph-mon[29691]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:34:11.756 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:34:11 smithi181 ceph-mon[25762]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' 2024-03-30T13:34:11.756 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:34:11 smithi181 ceph-mon[25762]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' 2024-03-30T13:34:11.756 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:34:11 smithi181 ceph-mon[25762]: pgmap v97: 1 pgs: 1 active+clean; 577 KiB data, 23 MiB used, 358 GiB / 358 GiB avail 2024-03-30T13:34:12.087 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:34:11 smithi099 ceph-mon[24912]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' 2024-03-30T13:34:12.087 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:34:11 smithi099 ceph-mon[24912]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' 2024-03-30T13:34:12.087 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:34:11 smithi099 ceph-mon[24912]: pgmap v97: 1 pgs: 1 active+clean; 577 KiB data, 23 MiB used, 358 GiB / 358 GiB avail 2024-03-30T13:34:12.087 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:34:11 smithi099 ceph-mon[29691]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' 2024-03-30T13:34:12.087 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:34:11 smithi099 ceph-mon[29691]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' 2024-03-30T13:34:12.087 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:34:11 smithi099 ceph-mon[29691]: pgmap v97: 1 pgs: 1 active+clean; 577 KiB data, 23 MiB used, 358 GiB / 358 GiB avail 2024-03-30T13:34:13.006 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:34:12 smithi181 ceph-mon[25762]: from='client.? 172.21.15.181:0/1802232785' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "cfa9365d-3adb-4f07-94a0-1ae739a22d74"}]: dispatch 2024-03-30T13:34:13.006 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:34:12 smithi181 ceph-mon[25762]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "cfa9365d-3adb-4f07-94a0-1ae739a22d74"}]: dispatch 2024-03-30T13:34:13.006 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:34:12 smithi181 ceph-mon[25762]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "cfa9365d-3adb-4f07-94a0-1ae739a22d74"}]': finished 2024-03-30T13:34:13.006 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:34:12 smithi181 ceph-mon[25762]: osdmap e28: 5 total, 4 up, 5 in 2024-03-30T13:34:13.006 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:34:12 smithi181 ceph-mon[25762]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-03-30T13:34:13.006 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:34:12 smithi181 ceph-mon[25762]: from='client.? 172.21.15.181:0/1114365196' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-03-30T13:34:13.087 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:34:12 smithi099 ceph-mon[24912]: from='client.? 172.21.15.181:0/1802232785' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "cfa9365d-3adb-4f07-94a0-1ae739a22d74"}]: dispatch 2024-03-30T13:34:13.087 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:34:12 smithi099 ceph-mon[24912]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "cfa9365d-3adb-4f07-94a0-1ae739a22d74"}]: dispatch 2024-03-30T13:34:13.087 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:34:12 smithi099 ceph-mon[24912]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "cfa9365d-3adb-4f07-94a0-1ae739a22d74"}]': finished 2024-03-30T13:34:13.087 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:34:12 smithi099 ceph-mon[24912]: osdmap e28: 5 total, 4 up, 5 in 2024-03-30T13:34:13.087 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:34:12 smithi099 ceph-mon[24912]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-03-30T13:34:13.087 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:34:12 smithi099 ceph-mon[24912]: from='client.? 172.21.15.181:0/1114365196' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-03-30T13:34:13.087 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:34:12 smithi099 ceph-mon[29691]: from='client.? 172.21.15.181:0/1802232785' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "cfa9365d-3adb-4f07-94a0-1ae739a22d74"}]: dispatch 2024-03-30T13:34:13.088 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:34:12 smithi099 ceph-mon[29691]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "cfa9365d-3adb-4f07-94a0-1ae739a22d74"}]: dispatch 2024-03-30T13:34:13.088 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:34:12 smithi099 ceph-mon[29691]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "cfa9365d-3adb-4f07-94a0-1ae739a22d74"}]': finished 2024-03-30T13:34:13.088 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:34:12 smithi099 ceph-mon[29691]: osdmap e28: 5 total, 4 up, 5 in 2024-03-30T13:34:13.088 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:34:12 smithi099 ceph-mon[29691]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-03-30T13:34:13.088 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:34:12 smithi099 ceph-mon[29691]: from='client.? 172.21.15.181:0/1114365196' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-03-30T13:34:14.833 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:34:14 smithi181 ceph-mon[25762]: pgmap v99: 1 pgs: 1 active+clean; 577 KiB data, 23 MiB used, 358 GiB / 358 GiB avail 2024-03-30T13:34:14.837 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:34:14 smithi099 ceph-mon[24912]: pgmap v99: 1 pgs: 1 active+clean; 577 KiB data, 23 MiB used, 358 GiB / 358 GiB avail 2024-03-30T13:34:14.837 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:34:14 smithi099 ceph-mon[29691]: pgmap v99: 1 pgs: 1 active+clean; 577 KiB data, 23 MiB used, 358 GiB / 358 GiB avail 2024-03-30T13:34:16.706 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:34:16 smithi181 ceph-mon[25762]: pgmap v100: 1 pgs: 1 active+clean; 577 KiB data, 23 MiB used, 358 GiB / 358 GiB avail 2024-03-30T13:34:16.837 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:34:16 smithi099 ceph-mon[24912]: pgmap v100: 1 pgs: 1 active+clean; 577 KiB data, 23 MiB used, 358 GiB / 358 GiB avail 2024-03-30T13:34:16.837 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:34:16 smithi099 ceph-mon[29691]: pgmap v100: 1 pgs: 1 active+clean; 577 KiB data, 23 MiB used, 358 GiB / 358 GiB avail 2024-03-30T13:34:18.756 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:34:18 smithi181 ceph-mon[25762]: pgmap v101: 1 pgs: 1 active+clean; 577 KiB data, 23 MiB used, 358 GiB / 358 GiB avail 2024-03-30T13:34:18.837 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:34:18 smithi099 ceph-mon[24912]: pgmap v101: 1 pgs: 1 active+clean; 577 KiB data, 23 MiB used, 358 GiB / 358 GiB avail 2024-03-30T13:34:18.837 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:34:18 smithi099 ceph-mon[29691]: pgmap v101: 1 pgs: 1 active+clean; 577 KiB data, 23 MiB used, 358 GiB / 358 GiB avail 2024-03-30T13:34:19.740 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:34:19 smithi181 ceph-mon[25762]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-03-30T13:34:19.741 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:34:19 smithi181 ceph-mon[25762]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:34:19.836 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:34:19 smithi099 ceph-mon[24912]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-03-30T13:34:19.837 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:34:19 smithi099 ceph-mon[24912]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:34:19.837 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:34:19 smithi099 ceph-mon[29691]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-03-30T13:34:19.837 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:34:19 smithi099 ceph-mon[29691]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:34:20.705 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:34:20 smithi181 ceph-mon[25762]: pgmap v102: 1 pgs: 1 active+clean; 577 KiB data, 23 MiB used, 358 GiB / 358 GiB avail 2024-03-30T13:34:20.705 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:34:20 smithi181 ceph-mon[25762]: Deploying daemon osd.4 on smithi181 2024-03-30T13:34:20.837 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:34:20 smithi099 ceph-mon[24912]: pgmap v102: 1 pgs: 1 active+clean; 577 KiB data, 23 MiB used, 358 GiB / 358 GiB avail 2024-03-30T13:34:20.837 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:34:20 smithi099 ceph-mon[24912]: Deploying daemon osd.4 on smithi181 2024-03-30T13:34:20.837 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:34:20 smithi099 ceph-mon[29691]: pgmap v102: 1 pgs: 1 active+clean; 577 KiB data, 23 MiB used, 358 GiB / 358 GiB avail 2024-03-30T13:34:20.837 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:34:20 smithi099 ceph-mon[29691]: Deploying daemon osd.4 on smithi181 2024-03-30T13:34:22.337 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:34:22 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[25141]: 172.21.15.99 - - [30/Mar/2024:13:34:22] "POST /data HTTP/1.1" 200 46 "" "Python-urllib/3.9" 2024-03-30T13:34:22.837 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:34:22 smithi099 ceph-mon[24912]: pgmap v103: 1 pgs: 1 active+clean; 577 KiB data, 23 MiB used, 358 GiB / 358 GiB avail 2024-03-30T13:34:22.837 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:34:22 smithi099 ceph-mon[24912]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' 2024-03-30T13:34:22.837 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:34:22 smithi099 ceph-mon[24912]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' 2024-03-30T13:34:22.837 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:34:22 smithi099 ceph-mon[29691]: pgmap v103: 1 pgs: 1 active+clean; 577 KiB data, 23 MiB used, 358 GiB / 358 GiB avail 2024-03-30T13:34:22.837 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:34:22 smithi099 ceph-mon[29691]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' 2024-03-30T13:34:22.837 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:34:22 smithi099 ceph-mon[29691]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' 2024-03-30T13:34:22.924 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:34:22 smithi181 ceph-mon[25762]: pgmap v103: 1 pgs: 1 active+clean; 577 KiB data, 23 MiB used, 358 GiB / 358 GiB avail 2024-03-30T13:34:22.924 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:34:22 smithi181 ceph-mon[25762]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' 2024-03-30T13:34:22.924 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:34:22 smithi181 ceph-mon[25762]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' 2024-03-30T13:34:23.825 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:34:23 smithi181 ceph-mon[25762]: Detected new or changed devices on smithi099 2024-03-30T13:34:23.836 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:34:23 smithi099 ceph-mon[24912]: Detected new or changed devices on smithi099 2024-03-30T13:34:23.836 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:34:23 smithi099 ceph-mon[29691]: Detected new or changed devices on smithi099 2024-03-30T13:34:24.756 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:34:24 smithi181 ceph-mon[25762]: pgmap v104: 1 pgs: 1 active+clean; 577 KiB data, 23 MiB used, 358 GiB / 358 GiB avail 2024-03-30T13:34:24.756 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:34:24 smithi181 ceph-mon[25762]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' 2024-03-30T13:34:24.756 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:34:24 smithi181 ceph-mon[25762]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:34:24.756 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:34:24 smithi181 ceph-mon[25762]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:34:24.756 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:34:24 smithi181 ceph-mon[25762]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:34:24.756 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:34:24 smithi181 ceph-mon[25762]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' 2024-03-30T13:34:24.837 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:34:24 smithi099 ceph-mon[24912]: pgmap v104: 1 pgs: 1 active+clean; 577 KiB data, 23 MiB used, 358 GiB / 358 GiB avail 2024-03-30T13:34:24.837 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:34:24 smithi099 ceph-mon[24912]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' 2024-03-30T13:34:24.837 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:34:24 smithi099 ceph-mon[24912]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:34:24.837 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:34:24 smithi099 ceph-mon[24912]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:34:24.837 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:34:24 smithi099 ceph-mon[24912]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:34:24.837 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:34:24 smithi099 ceph-mon[24912]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' 2024-03-30T13:34:24.837 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:34:24 smithi099 ceph-mon[29691]: pgmap v104: 1 pgs: 1 active+clean; 577 KiB data, 23 MiB used, 358 GiB / 358 GiB avail 2024-03-30T13:34:24.837 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:34:24 smithi099 ceph-mon[29691]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' 2024-03-30T13:34:24.837 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:34:24 smithi099 ceph-mon[29691]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:34:24.837 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:34:24 smithi099 ceph-mon[29691]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:34:24.838 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:34:24 smithi099 ceph-mon[29691]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:34:24.838 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:34:24 smithi099 ceph-mon[29691]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' 2024-03-30T13:34:26.521 INFO:teuthology.orchestra.run.smithi181.stdout:Created osd(s) 4 on host 'smithi181' 2024-03-30T13:34:26.756 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:34:26 smithi181 ceph-mon[25762]: pgmap v105: 1 pgs: 1 active+clean; 577 KiB data, 23 MiB used, 358 GiB / 358 GiB avail 2024-03-30T13:34:26.756 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:34:26 smithi181 ceph-mon[25762]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' 2024-03-30T13:34:26.837 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:34:26 smithi099 ceph-mon[29691]: pgmap v105: 1 pgs: 1 active+clean; 577 KiB data, 23 MiB used, 358 GiB / 358 GiB avail 2024-03-30T13:34:26.837 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:34:26 smithi099 ceph-mon[29691]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' 2024-03-30T13:34:26.837 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:34:26 smithi099 ceph-mon[24912]: pgmap v105: 1 pgs: 1 active+clean; 577 KiB data, 23 MiB used, 358 GiB / 358 GiB avail 2024-03-30T13:34:26.837 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:34:26 smithi099 ceph-mon[24912]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' 2024-03-30T13:34:27.100 DEBUG:teuthology.orchestra.run.smithi181:osd.4> sudo journalctl -f -n 0 -u ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4@osd.4.service 2024-03-30T13:34:27.102 INFO:tasks.cephadm:Deploying osd.5 on smithi181 with /dev/vg_nvme/lv_3... 2024-03-30T13:34:27.103 DEBUG:teuthology.orchestra.run.smithi181:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 98ebaeb8-ee99-11ee-b647-cb9ed24678a4 -- ceph-volume lvm zap /dev/vg_nvme/lv_3 2024-03-30T13:34:27.756 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:34:27 smithi181 ceph-mon[25762]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:34:27.756 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:34:27 smithi181 ceph-mon[25762]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:34:27.756 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:34:27 smithi181 ceph-mon[25762]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:34:27.757 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:34:27 smithi181 ceph-mon[25762]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-03-30T13:34:27.757 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:34:27 smithi181 ceph-mon[25762]: Adjusting osd_memory_target on smithi181 to 16064M 2024-03-30T13:34:27.757 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:34:27 smithi181 ceph-mon[25762]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' 2024-03-30T13:34:27.757 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:34:27 smithi181 ceph-mon[25762]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' 2024-03-30T13:34:27.757 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:34:27 smithi181 ceph-mon[25762]: from='osd.4 [v2:172.21.15.181:6800/2876720616,v1:172.21.15.181:6801/2876720616]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-03-30T13:34:27.757 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:34:27 smithi181 ceph-mon[25762]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-03-30T13:34:27.837 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:34:27 smithi099 ceph-mon[29691]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:34:27.837 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:34:27 smithi099 ceph-mon[29691]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:34:27.837 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:34:27 smithi099 ceph-mon[29691]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:34:27.837 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:34:27 smithi099 ceph-mon[29691]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-03-30T13:34:27.837 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:34:27 smithi099 ceph-mon[29691]: Adjusting osd_memory_target on smithi181 to 16064M 2024-03-30T13:34:27.837 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:34:27 smithi099 ceph-mon[29691]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' 2024-03-30T13:34:27.837 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:34:27 smithi099 ceph-mon[29691]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' 2024-03-30T13:34:27.838 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:34:27 smithi099 ceph-mon[29691]: from='osd.4 [v2:172.21.15.181:6800/2876720616,v1:172.21.15.181:6801/2876720616]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-03-30T13:34:27.838 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:34:27 smithi099 ceph-mon[29691]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-03-30T13:34:27.838 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:34:27 smithi099 ceph-mon[24912]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:34:27.838 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:34:27 smithi099 ceph-mon[24912]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:34:27.838 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:34:27 smithi099 ceph-mon[24912]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:34:27.838 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:34:27 smithi099 ceph-mon[24912]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-03-30T13:34:27.838 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:34:27 smithi099 ceph-mon[24912]: Adjusting osd_memory_target on smithi181 to 16064M 2024-03-30T13:34:27.838 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:34:27 smithi099 ceph-mon[24912]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' 2024-03-30T13:34:27.838 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:34:27 smithi099 ceph-mon[24912]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' 2024-03-30T13:34:27.838 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:34:27 smithi099 ceph-mon[24912]: from='osd.4 [v2:172.21.15.181:6800/2876720616,v1:172.21.15.181:6801/2876720616]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-03-30T13:34:27.839 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:34:27 smithi099 ceph-mon[24912]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-03-30T13:34:28.678 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:34:28 smithi181 ceph-mon[25762]: pgmap v106: 1 pgs: 1 active+clean; 577 KiB data, 23 MiB used, 358 GiB / 358 GiB avail 2024-03-30T13:34:28.679 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:34:28 smithi181 ceph-mon[25762]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-03-30T13:34:28.679 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:34:28 smithi181 ceph-mon[25762]: osdmap e29: 5 total, 4 up, 5 in 2024-03-30T13:34:28.679 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:34:28 smithi181 ceph-mon[25762]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-03-30T13:34:28.679 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:34:28 smithi181 ceph-mon[25762]: from='osd.4 [v2:172.21.15.181:6800/2876720616,v1:172.21.15.181:6801/2876720616]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi181", "root=default"]}]: dispatch 2024-03-30T13:34:28.679 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:34:28 smithi181 ceph-mon[25762]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi181", "root=default"]}]: dispatch 2024-03-30T13:34:28.679 INFO:journalctl@ceph.osd.4.smithi181.stdout:Mar 30 13:34:28 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-4[30503]: 2024-03-30T13:34:28.594+0000 7f4323a3b700 -1 osd.4 0 waiting for initial osdmap 2024-03-30T13:34:28.679 INFO:journalctl@ceph.osd.4.smithi181.stdout:Mar 30 13:34:28 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-4[30503]: 2024-03-30T13:34:28.599+0000 7f431fbd5700 -1 osd.4 30 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-03-30T13:34:28.837 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:34:28 smithi099 ceph-mon[29691]: pgmap v106: 1 pgs: 1 active+clean; 577 KiB data, 23 MiB used, 358 GiB / 358 GiB avail 2024-03-30T13:34:28.837 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:34:28 smithi099 ceph-mon[29691]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-03-30T13:34:28.837 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:34:28 smithi099 ceph-mon[29691]: osdmap e29: 5 total, 4 up, 5 in 2024-03-30T13:34:28.837 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:34:28 smithi099 ceph-mon[29691]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-03-30T13:34:28.837 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:34:28 smithi099 ceph-mon[29691]: from='osd.4 [v2:172.21.15.181:6800/2876720616,v1:172.21.15.181:6801/2876720616]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi181", "root=default"]}]: dispatch 2024-03-30T13:34:28.837 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:34:28 smithi099 ceph-mon[29691]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi181", "root=default"]}]: dispatch 2024-03-30T13:34:28.837 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:34:28 smithi099 ceph-mon[24912]: pgmap v106: 1 pgs: 1 active+clean; 577 KiB data, 23 MiB used, 358 GiB / 358 GiB avail 2024-03-30T13:34:28.838 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:34:28 smithi099 ceph-mon[24912]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-03-30T13:34:28.838 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:34:28 smithi099 ceph-mon[24912]: osdmap e29: 5 total, 4 up, 5 in 2024-03-30T13:34:28.838 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:34:28 smithi099 ceph-mon[24912]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-03-30T13:34:28.838 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:34:28 smithi099 ceph-mon[24912]: from='osd.4 [v2:172.21.15.181:6800/2876720616,v1:172.21.15.181:6801/2876720616]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi181", "root=default"]}]: dispatch 2024-03-30T13:34:28.838 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:34:28 smithi099 ceph-mon[24912]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi181", "root=default"]}]: dispatch 2024-03-30T13:34:29.181 INFO:teuthology.orchestra.run.smithi181.stderr:--> Zapping: /dev/vg_nvme/lv_3 2024-03-30T13:34:29.181 INFO:teuthology.orchestra.run.smithi181.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_3 bs=1M count=10 conv=fsync 2024-03-30T13:34:29.181 INFO:teuthology.orchestra.run.smithi181.stderr: stderr: 10+0 records in 2024-03-30T13:34:29.181 INFO:teuthology.orchestra.run.smithi181.stderr:10+0 records out 2024-03-30T13:34:29.181 INFO:teuthology.orchestra.run.smithi181.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0123636 s, 848 MB/s 2024-03-30T13:34:29.182 INFO:teuthology.orchestra.run.smithi181.stderr:--> Zapping successful for: 2024-03-30T13:34:29.756 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:34:29 smithi181 ceph-mon[25762]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi181", "root=default"]}]': finished 2024-03-30T13:34:29.756 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:34:29 smithi181 ceph-mon[25762]: osdmap e30: 5 total, 4 up, 5 in 2024-03-30T13:34:29.756 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:34:29 smithi181 ceph-mon[25762]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-03-30T13:34:29.756 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:34:29 smithi181 ceph-mon[25762]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-03-30T13:34:29.756 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:34:29 smithi181 ceph-mon[25762]: pgmap v109: 1 pgs: 1 active+clean; 577 KiB data, 23 MiB used, 358 GiB / 358 GiB avail 2024-03-30T13:34:29.817 DEBUG:teuthology.orchestra.run.smithi181:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 98ebaeb8-ee99-11ee-b647-cb9ed24678a4 -- ceph orch daemon add osd smithi181:vg_nvme/lv_3 2024-03-30T13:34:30.087 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:34:29 smithi099 ceph-mon[24912]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi181", "root=default"]}]': finished 2024-03-30T13:34:30.087 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:34:29 smithi099 ceph-mon[24912]: osdmap e30: 5 total, 4 up, 5 in 2024-03-30T13:34:30.087 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:34:29 smithi099 ceph-mon[24912]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-03-30T13:34:30.087 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:34:29 smithi099 ceph-mon[24912]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-03-30T13:34:30.087 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:34:29 smithi099 ceph-mon[24912]: pgmap v109: 1 pgs: 1 active+clean; 577 KiB data, 23 MiB used, 358 GiB / 358 GiB avail 2024-03-30T13:34:30.088 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:34:29 smithi099 ceph-mon[29691]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi181", "root=default"]}]': finished 2024-03-30T13:34:30.088 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:34:29 smithi099 ceph-mon[29691]: osdmap e30: 5 total, 4 up, 5 in 2024-03-30T13:34:30.088 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:34:29 smithi099 ceph-mon[29691]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-03-30T13:34:30.088 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:34:29 smithi099 ceph-mon[29691]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-03-30T13:34:30.088 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:34:29 smithi099 ceph-mon[29691]: pgmap v109: 1 pgs: 1 active+clean; 577 KiB data, 23 MiB used, 358 GiB / 358 GiB avail 2024-03-30T13:34:30.729 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:34:30 smithi181 ceph-mon[25762]: purged_snaps scrub starts 2024-03-30T13:34:30.730 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:34:30 smithi181 ceph-mon[25762]: purged_snaps scrub ok 2024-03-30T13:34:30.730 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:34:30 smithi181 ceph-mon[25762]: osd.4 [v2:172.21.15.181:6800/2876720616,v1:172.21.15.181:6801/2876720616] boot 2024-03-30T13:34:30.730 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:34:30 smithi181 ceph-mon[25762]: osdmap e31: 5 total, 5 up, 5 in 2024-03-30T13:34:30.730 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:34:30 smithi181 ceph-mon[25762]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-03-30T13:34:30.988 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:34:30 smithi099 ceph-mon[24912]: purged_snaps scrub starts 2024-03-30T13:34:30.988 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:34:30 smithi099 ceph-mon[24912]: purged_snaps scrub ok 2024-03-30T13:34:30.988 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:34:30 smithi099 ceph-mon[24912]: osd.4 [v2:172.21.15.181:6800/2876720616,v1:172.21.15.181:6801/2876720616] boot 2024-03-30T13:34:30.988 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:34:30 smithi099 ceph-mon[24912]: osdmap e31: 5 total, 5 up, 5 in 2024-03-30T13:34:30.988 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:34:30 smithi099 ceph-mon[24912]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-03-30T13:34:30.989 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:34:30 smithi099 ceph-mon[29691]: purged_snaps scrub starts 2024-03-30T13:34:30.989 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:34:30 smithi099 ceph-mon[29691]: purged_snaps scrub ok 2024-03-30T13:34:30.989 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:34:30 smithi099 ceph-mon[29691]: osd.4 [v2:172.21.15.181:6800/2876720616,v1:172.21.15.181:6801/2876720616] boot 2024-03-30T13:34:30.989 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:34:30 smithi099 ceph-mon[29691]: osdmap e31: 5 total, 5 up, 5 in 2024-03-30T13:34:30.989 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:34:30 smithi099 ceph-mon[29691]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-03-30T13:34:30.989 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:34:30 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[25141]: 172.21.15.181 - - [30/Mar/2024:13:34:30] "POST /data HTTP/1.1" 200 46 "" "Python-urllib/3.9" 2024-03-30T13:34:31.756 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:34:31 smithi181 ceph-mon[25762]: osdmap e32: 5 total, 5 up, 5 in 2024-03-30T13:34:31.756 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:34:31 smithi181 ceph-mon[25762]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' 2024-03-30T13:34:31.756 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:34:31 smithi181 ceph-mon[25762]: Detected new or changed devices on smithi181 2024-03-30T13:34:31.756 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:34:31 smithi181 ceph-mon[25762]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' 2024-03-30T13:34:31.756 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:34:31 smithi181 ceph-mon[25762]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:34:31.756 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:34:31 smithi181 ceph-mon[25762]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:34:31.757 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:34:31 smithi181 ceph-mon[25762]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:34:31.757 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:34:31 smithi181 ceph-mon[25762]: pgmap v112: 1 pgs: 1 peering; 577 KiB data, 28 MiB used, 447 GiB / 447 GiB avail 2024-03-30T13:34:31.757 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:34:31 smithi181 ceph-mon[25762]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' 2024-03-30T13:34:32.004 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:34:31 smithi099 ceph-mon[29691]: osdmap e32: 5 total, 5 up, 5 in 2024-03-30T13:34:32.004 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:34:31 smithi099 ceph-mon[29691]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' 2024-03-30T13:34:32.004 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:34:31 smithi099 ceph-mon[29691]: Detected new or changed devices on smithi181 2024-03-30T13:34:32.004 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:34:31 smithi099 ceph-mon[29691]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' 2024-03-30T13:34:32.004 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:34:31 smithi099 ceph-mon[29691]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:34:32.004 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:34:31 smithi099 ceph-mon[29691]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:34:32.004 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:34:31 smithi099 ceph-mon[29691]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:34:32.004 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:34:31 smithi099 ceph-mon[29691]: pgmap v112: 1 pgs: 1 peering; 577 KiB data, 28 MiB used, 447 GiB / 447 GiB avail 2024-03-30T13:34:32.004 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:34:31 smithi099 ceph-mon[29691]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' 2024-03-30T13:34:32.004 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:34:31 smithi099 ceph-mon[24912]: osdmap e32: 5 total, 5 up, 5 in 2024-03-30T13:34:32.004 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:34:31 smithi099 ceph-mon[24912]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' 2024-03-30T13:34:32.004 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:34:31 smithi099 ceph-mon[24912]: Detected new or changed devices on smithi181 2024-03-30T13:34:32.005 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:34:31 smithi099 ceph-mon[24912]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' 2024-03-30T13:34:32.005 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:34:31 smithi099 ceph-mon[24912]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:34:32.005 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:34:31 smithi099 ceph-mon[24912]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:34:32.005 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:34:31 smithi099 ceph-mon[24912]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:34:32.005 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:34:31 smithi099 ceph-mon[24912]: pgmap v112: 1 pgs: 1 peering; 577 KiB data, 28 MiB used, 447 GiB / 447 GiB avail 2024-03-30T13:34:32.005 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:34:31 smithi099 ceph-mon[24912]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' 2024-03-30T13:34:32.756 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:34:32 smithi181 ceph-mon[25762]: osdmap e33: 5 total, 5 up, 5 in 2024-03-30T13:34:32.756 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:34:32 smithi181 ceph-mon[25762]: Health check failed: 1 stray daemon(s) not managed by cephadm (CEPHADM_STRAY_DAEMON) 2024-03-30T13:34:32.756 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:34:32 smithi181 ceph-mon[25762]: from='client.24215 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi181:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T13:34:32.756 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:34:32 smithi181 ceph-mon[25762]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-03-30T13:34:32.756 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:34:32 smithi181 ceph-mon[25762]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-03-30T13:34:32.756 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:34:32 smithi181 ceph-mon[25762]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:34:32.757 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:34:32 smithi181 ceph-mon[25762]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' 2024-03-30T13:34:32.757 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:34:32 smithi181 ceph-mon[25762]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' 2024-03-30T13:34:32.757 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:34:32 smithi181 ceph-mon[25762]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:34:32.757 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:34:32 smithi181 ceph-mon[25762]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:34:32.757 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:34:32 smithi181 ceph-mon[25762]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:34:32.757 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:34:32 smithi181 ceph-mon[25762]: pgmap v114: 1 pgs: 1 peering; 577 KiB data, 28 MiB used, 447 GiB / 447 GiB avail 2024-03-30T13:34:32.757 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:34:32 smithi181 ceph-mon[25762]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' 2024-03-30T13:34:32.757 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:34:32 smithi181 ceph-mon[25762]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-03-30T13:34:32.757 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:34:32 smithi181 ceph-mon[25762]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-03-30T13:34:32.837 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:34:32 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[25141]: 172.21.15.181 - - [30/Mar/2024:13:34:32] "POST /data HTTP/1.1" 200 46 "" "Python-urllib/3.9" 2024-03-30T13:34:32.837 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:34:32 smithi099 ceph-mon[24912]: osdmap e33: 5 total, 5 up, 5 in 2024-03-30T13:34:32.837 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:34:32 smithi099 ceph-mon[24912]: Health check failed: 1 stray daemon(s) not managed by cephadm (CEPHADM_STRAY_DAEMON) 2024-03-30T13:34:32.837 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:34:32 smithi099 ceph-mon[24912]: from='client.24215 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi181:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T13:34:32.837 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:34:32 smithi099 ceph-mon[24912]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-03-30T13:34:32.837 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:34:32 smithi099 ceph-mon[24912]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-03-30T13:34:32.837 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:34:32 smithi099 ceph-mon[24912]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:34:32.838 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:34:32 smithi099 ceph-mon[24912]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' 2024-03-30T13:34:32.838 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:34:32 smithi099 ceph-mon[24912]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' 2024-03-30T13:34:32.838 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:34:32 smithi099 ceph-mon[24912]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:34:32.838 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:34:32 smithi099 ceph-mon[24912]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:34:32.838 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:34:32 smithi099 ceph-mon[24912]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:34:32.838 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:34:32 smithi099 ceph-mon[24912]: pgmap v114: 1 pgs: 1 peering; 577 KiB data, 28 MiB used, 447 GiB / 447 GiB avail 2024-03-30T13:34:32.838 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:34:32 smithi099 ceph-mon[24912]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' 2024-03-30T13:34:32.838 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:34:32 smithi099 ceph-mon[24912]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-03-30T13:34:32.838 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:34:32 smithi099 ceph-mon[24912]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-03-30T13:34:32.838 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:34:32 smithi099 ceph-mon[29691]: osdmap e33: 5 total, 5 up, 5 in 2024-03-30T13:34:32.838 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:34:32 smithi099 ceph-mon[29691]: Health check failed: 1 stray daemon(s) not managed by cephadm (CEPHADM_STRAY_DAEMON) 2024-03-30T13:34:32.838 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:34:32 smithi099 ceph-mon[29691]: from='client.24215 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi181:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T13:34:32.839 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:34:32 smithi099 ceph-mon[29691]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-03-30T13:34:32.839 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:34:32 smithi099 ceph-mon[29691]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-03-30T13:34:32.839 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:34:32 smithi099 ceph-mon[29691]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:34:32.839 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:34:32 smithi099 ceph-mon[29691]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' 2024-03-30T13:34:32.839 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:34:32 smithi099 ceph-mon[29691]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' 2024-03-30T13:34:32.839 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:34:32 smithi099 ceph-mon[29691]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:34:32.839 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:34:32 smithi099 ceph-mon[29691]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:34:32.839 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:34:32 smithi099 ceph-mon[29691]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:34:32.839 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:34:32 smithi099 ceph-mon[29691]: pgmap v114: 1 pgs: 1 peering; 577 KiB data, 28 MiB used, 447 GiB / 447 GiB avail 2024-03-30T13:34:32.839 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:34:32 smithi099 ceph-mon[29691]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' 2024-03-30T13:34:32.839 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:34:32 smithi099 ceph-mon[29691]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-03-30T13:34:32.839 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:34:32 smithi099 ceph-mon[29691]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-03-30T13:34:34.006 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:34:33 smithi181 ceph-mon[25762]: osdmap e34: 5 total, 5 up, 5 in 2024-03-30T13:34:34.006 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:34:33 smithi181 ceph-mon[25762]: Health check cleared: CEPHADM_STRAY_DAEMON (was: 1 stray daemon(s) not managed by cephadm) 2024-03-30T13:34:34.006 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:34:33 smithi181 ceph-mon[25762]: Cluster is now healthy 2024-03-30T13:34:34.087 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:34:33 smithi099 ceph-mon[24912]: osdmap e34: 5 total, 5 up, 5 in 2024-03-30T13:34:34.088 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:34:33 smithi099 ceph-mon[24912]: Health check cleared: CEPHADM_STRAY_DAEMON (was: 1 stray daemon(s) not managed by cephadm) 2024-03-30T13:34:34.088 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:34:33 smithi099 ceph-mon[24912]: Cluster is now healthy 2024-03-30T13:34:34.088 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:34:33 smithi099 ceph-mon[29691]: osdmap e34: 5 total, 5 up, 5 in 2024-03-30T13:34:34.088 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:34:33 smithi099 ceph-mon[29691]: Health check cleared: CEPHADM_STRAY_DAEMON (was: 1 stray daemon(s) not managed by cephadm) 2024-03-30T13:34:34.088 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:34:33 smithi099 ceph-mon[29691]: Cluster is now healthy 2024-03-30T13:34:34.942 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:34:34 smithi181 ceph-mon[25762]: osdmap e35: 5 total, 5 up, 5 in 2024-03-30T13:34:34.943 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:34:34 smithi181 ceph-mon[25762]: from='client.? 172.21.15.181:0/686731543' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "7c7289ba-f1a8-4b64-99d4-e42343eb5f49"}]: dispatch 2024-03-30T13:34:34.943 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:34:34 smithi181 ceph-mon[25762]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "7c7289ba-f1a8-4b64-99d4-e42343eb5f49"}]: dispatch 2024-03-30T13:34:34.943 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:34:34 smithi181 ceph-mon[25762]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "7c7289ba-f1a8-4b64-99d4-e42343eb5f49"}]': finished 2024-03-30T13:34:34.943 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:34:34 smithi181 ceph-mon[25762]: osdmap e36: 6 total, 5 up, 6 in 2024-03-30T13:34:34.943 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:34:34 smithi181 ceph-mon[25762]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-03-30T13:34:34.943 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:34:34 smithi181 ceph-mon[25762]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 29 MiB used, 447 GiB / 447 GiB avail; 140 KiB/s, 0 objects/s recovering 2024-03-30T13:34:35.087 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:34:34 smithi099 ceph-mon[24912]: osdmap e35: 5 total, 5 up, 5 in 2024-03-30T13:34:35.087 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:34:34 smithi099 ceph-mon[24912]: from='client.? 172.21.15.181:0/686731543' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "7c7289ba-f1a8-4b64-99d4-e42343eb5f49"}]: dispatch 2024-03-30T13:34:35.087 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:34:34 smithi099 ceph-mon[24912]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "7c7289ba-f1a8-4b64-99d4-e42343eb5f49"}]: dispatch 2024-03-30T13:34:35.087 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:34:34 smithi099 ceph-mon[24912]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "7c7289ba-f1a8-4b64-99d4-e42343eb5f49"}]': finished 2024-03-30T13:34:35.087 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:34:34 smithi099 ceph-mon[24912]: osdmap e36: 6 total, 5 up, 6 in 2024-03-30T13:34:35.087 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:34:34 smithi099 ceph-mon[24912]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-03-30T13:34:35.087 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:34:34 smithi099 ceph-mon[24912]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 29 MiB used, 447 GiB / 447 GiB avail; 140 KiB/s, 0 objects/s recovering 2024-03-30T13:34:35.088 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:34:34 smithi099 ceph-mon[29691]: osdmap e35: 5 total, 5 up, 5 in 2024-03-30T13:34:35.088 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:34:34 smithi099 ceph-mon[29691]: from='client.? 172.21.15.181:0/686731543' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "7c7289ba-f1a8-4b64-99d4-e42343eb5f49"}]: dispatch 2024-03-30T13:34:35.088 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:34:34 smithi099 ceph-mon[29691]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "7c7289ba-f1a8-4b64-99d4-e42343eb5f49"}]: dispatch 2024-03-30T13:34:35.088 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:34:34 smithi099 ceph-mon[29691]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "7c7289ba-f1a8-4b64-99d4-e42343eb5f49"}]': finished 2024-03-30T13:34:35.088 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:34:34 smithi099 ceph-mon[29691]: osdmap e36: 6 total, 5 up, 6 in 2024-03-30T13:34:35.088 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:34:34 smithi099 ceph-mon[29691]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-03-30T13:34:35.088 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:34:34 smithi099 ceph-mon[29691]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 29 MiB used, 447 GiB / 447 GiB avail; 140 KiB/s, 0 objects/s recovering 2024-03-30T13:34:35.756 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:34:35 smithi181 ceph-mon[25762]: from='client.? 172.21.15.181:0/2135946286' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-03-30T13:34:36.086 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:34:35 smithi099 ceph-mon[24912]: from='client.? 172.21.15.181:0/2135946286' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-03-30T13:34:36.087 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:34:35 smithi099 ceph-mon[29691]: from='client.? 172.21.15.181:0/2135946286' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-03-30T13:34:37.005 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:34:36 smithi181 ceph-mon[25762]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 29 MiB used, 447 GiB / 447 GiB avail; 107 KiB/s, 0 objects/s recovering 2024-03-30T13:34:37.086 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:34:36 smithi099 ceph-mon[24912]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 29 MiB used, 447 GiB / 447 GiB avail; 107 KiB/s, 0 objects/s recovering 2024-03-30T13:34:37.087 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:34:36 smithi099 ceph-mon[29691]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 29 MiB used, 447 GiB / 447 GiB avail; 107 KiB/s, 0 objects/s recovering 2024-03-30T13:34:39.808 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:34:39 smithi181 ceph-mon[25762]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 29 MiB used, 447 GiB / 447 GiB avail; 86 KiB/s, 0 objects/s recovering 2024-03-30T13:34:39.837 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:34:39 smithi099 ceph-mon[24912]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 29 MiB used, 447 GiB / 447 GiB avail; 86 KiB/s, 0 objects/s recovering 2024-03-30T13:34:39.837 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:34:39 smithi099 ceph-mon[29691]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 29 MiB used, 447 GiB / 447 GiB avail; 86 KiB/s, 0 objects/s recovering 2024-03-30T13:34:41.755 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:34:41 smithi181 ceph-mon[25762]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 29 MiB used, 447 GiB / 447 GiB avail; 66 KiB/s, 0 objects/s recovering 2024-03-30T13:34:41.756 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:34:41 smithi181 ceph-mon[25762]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-03-30T13:34:41.756 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:34:41 smithi181 ceph-mon[25762]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:34:41.837 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:34:41 smithi099 ceph-mon[24912]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 29 MiB used, 447 GiB / 447 GiB avail; 66 KiB/s, 0 objects/s recovering 2024-03-30T13:34:41.837 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:34:41 smithi099 ceph-mon[24912]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-03-30T13:34:41.837 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:34:41 smithi099 ceph-mon[24912]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:34:41.837 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:34:41 smithi099 ceph-mon[29691]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 29 MiB used, 447 GiB / 447 GiB avail; 66 KiB/s, 0 objects/s recovering 2024-03-30T13:34:41.837 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:34:41 smithi099 ceph-mon[29691]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-03-30T13:34:41.837 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:34:41 smithi099 ceph-mon[29691]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:34:42.337 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:34:42 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[25141]: 172.21.15.99 - - [30/Mar/2024:13:34:42] "POST /data HTTP/1.1" 200 46 "" "Python-urllib/3.9" 2024-03-30T13:34:42.623 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:34:42 smithi099 ceph-mon[24912]: Deploying daemon osd.5 on smithi181 2024-03-30T13:34:42.623 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:34:42 smithi099 ceph-mon[24912]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' 2024-03-30T13:34:42.624 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:34:42 smithi099 ceph-mon[24912]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' 2024-03-30T13:34:42.624 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:34:42 smithi099 ceph-mon[29691]: Deploying daemon osd.5 on smithi181 2024-03-30T13:34:42.624 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:34:42 smithi099 ceph-mon[29691]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' 2024-03-30T13:34:42.624 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:34:42 smithi099 ceph-mon[29691]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' 2024-03-30T13:34:42.795 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:34:42 smithi181 ceph-mon[25762]: Deploying daemon osd.5 on smithi181 2024-03-30T13:34:42.795 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:34:42 smithi181 ceph-mon[25762]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' 2024-03-30T13:34:42.795 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:34:42 smithi181 ceph-mon[25762]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' 2024-03-30T13:34:43.756 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:34:43 smithi181 ceph-mon[25762]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 29 MiB used, 447 GiB / 447 GiB avail; 59 KiB/s, 0 objects/s recovering 2024-03-30T13:34:43.837 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:34:43 smithi099 ceph-mon[24912]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 29 MiB used, 447 GiB / 447 GiB avail; 59 KiB/s, 0 objects/s recovering 2024-03-30T13:34:43.837 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:34:43 smithi099 ceph-mon[29691]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 29 MiB used, 447 GiB / 447 GiB avail; 59 KiB/s, 0 objects/s recovering 2024-03-30T13:34:45.835 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:34:45 smithi181 ceph-mon[25762]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 29 MiB used, 447 GiB / 447 GiB avail 2024-03-30T13:34:45.837 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:34:45 smithi099 ceph-mon[29691]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 29 MiB used, 447 GiB / 447 GiB avail 2024-03-30T13:34:45.837 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:34:45 smithi099 ceph-mon[24912]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 29 MiB used, 447 GiB / 447 GiB avail 2024-03-30T13:34:47.748 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:34:47 smithi181 ceph-mon[25762]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' 2024-03-30T13:34:47.748 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:34:47 smithi181 ceph-mon[25762]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:34:47.748 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:34:47 smithi181 ceph-mon[25762]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:34:47.748 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:34:47 smithi181 ceph-mon[25762]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:34:47.748 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:34:47 smithi181 ceph-mon[25762]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' 2024-03-30T13:34:47.748 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:34:47 smithi181 ceph-mon[25762]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 29 MiB used, 447 GiB / 447 GiB avail 2024-03-30T13:34:47.837 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:34:47 smithi099 ceph-mon[24912]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' 2024-03-30T13:34:47.837 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:34:47 smithi099 ceph-mon[24912]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:34:47.837 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:34:47 smithi099 ceph-mon[24912]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:34:47.837 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:34:47 smithi099 ceph-mon[24912]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:34:47.837 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:34:47 smithi099 ceph-mon[24912]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' 2024-03-30T13:34:47.837 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:34:47 smithi099 ceph-mon[24912]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 29 MiB used, 447 GiB / 447 GiB avail 2024-03-30T13:34:47.837 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:34:47 smithi099 ceph-mon[29691]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' 2024-03-30T13:34:47.837 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:34:47 smithi099 ceph-mon[29691]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:34:47.838 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:34:47 smithi099 ceph-mon[29691]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:34:47.838 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:34:47 smithi099 ceph-mon[29691]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:34:47.838 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:34:47 smithi099 ceph-mon[29691]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' 2024-03-30T13:34:47.838 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:34:47 smithi099 ceph-mon[29691]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 29 MiB used, 447 GiB / 447 GiB avail 2024-03-30T13:34:49.001 INFO:teuthology.orchestra.run.smithi181.stdout:Created osd(s) 5 on host 'smithi181' 2024-03-30T13:34:49.548 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:34:49 smithi181 ceph-mon[25762]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 29 MiB used, 447 GiB / 447 GiB avail 2024-03-30T13:34:49.549 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:34:49 smithi181 ceph-mon[25762]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' 2024-03-30T13:34:49.549 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:34:49 smithi181 ceph-mon[25762]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:34:49.549 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:34:49 smithi181 ceph-mon[25762]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:34:49.549 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:34:49 smithi181 ceph-mon[25762]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:34:49.549 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:34:49 smithi181 ceph-mon[25762]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-03-30T13:34:49.549 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:34:49 smithi181 ceph-mon[25762]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-03-30T13:34:49.549 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:34:49 smithi181 ceph-mon[25762]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' 2024-03-30T13:34:49.549 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:34:49 smithi181 ceph-mon[25762]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' 2024-03-30T13:34:49.549 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:34:49 smithi181 ceph-mon[25762]: from='osd.5 [v2:172.21.15.181:6808/1648947487,v1:172.21.15.181:6809/1648947487]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-03-30T13:34:49.549 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:34:49 smithi181 ceph-mon[25762]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-03-30T13:34:49.568 DEBUG:teuthology.orchestra.run.smithi181:osd.5> sudo journalctl -f -n 0 -u ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4@osd.5.service 2024-03-30T13:34:49.571 INFO:tasks.cephadm:Deploying osd.6 on smithi181 with /dev/vg_nvme/lv_2... 2024-03-30T13:34:49.571 DEBUG:teuthology.orchestra.run.smithi181:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 98ebaeb8-ee99-11ee-b647-cb9ed24678a4 -- ceph-volume lvm zap /dev/vg_nvme/lv_2 2024-03-30T13:34:49.837 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:34:49 smithi099 ceph-mon[24912]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 29 MiB used, 447 GiB / 447 GiB avail 2024-03-30T13:34:49.837 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:34:49 smithi099 ceph-mon[24912]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' 2024-03-30T13:34:49.837 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:34:49 smithi099 ceph-mon[24912]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:34:49.837 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:34:49 smithi099 ceph-mon[24912]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:34:49.837 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:34:49 smithi099 ceph-mon[24912]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:34:49.838 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:34:49 smithi099 ceph-mon[24912]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-03-30T13:34:49.838 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:34:49 smithi099 ceph-mon[24912]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-03-30T13:34:49.838 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:34:49 smithi099 ceph-mon[24912]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' 2024-03-30T13:34:49.838 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:34:49 smithi099 ceph-mon[24912]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' 2024-03-30T13:34:49.838 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:34:49 smithi099 ceph-mon[24912]: from='osd.5 [v2:172.21.15.181:6808/1648947487,v1:172.21.15.181:6809/1648947487]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-03-30T13:34:49.838 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:34:49 smithi099 ceph-mon[24912]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-03-30T13:34:49.838 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:34:49 smithi099 ceph-mon[29691]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 29 MiB used, 447 GiB / 447 GiB avail 2024-03-30T13:34:49.838 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:34:49 smithi099 ceph-mon[29691]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' 2024-03-30T13:34:49.838 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:34:49 smithi099 ceph-mon[29691]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:34:49.838 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:34:49 smithi099 ceph-mon[29691]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:34:49.838 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:34:49 smithi099 ceph-mon[29691]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:34:49.839 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:34:49 smithi099 ceph-mon[29691]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-03-30T13:34:49.839 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:34:49 smithi099 ceph-mon[29691]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-03-30T13:34:49.839 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:34:49 smithi099 ceph-mon[29691]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' 2024-03-30T13:34:49.839 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:34:49 smithi099 ceph-mon[29691]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' 2024-03-30T13:34:49.839 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:34:49 smithi099 ceph-mon[29691]: from='osd.5 [v2:172.21.15.181:6808/1648947487,v1:172.21.15.181:6809/1648947487]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-03-30T13:34:49.839 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:34:49 smithi099 ceph-mon[29691]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-03-30T13:34:50.794 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:34:50 smithi181 ceph-mon[25762]: Adjusting osd_memory_target on smithi181 to 8032M 2024-03-30T13:34:50.794 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:34:50 smithi181 ceph-mon[25762]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-03-30T13:34:50.794 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:34:50 smithi181 ceph-mon[25762]: osdmap e37: 6 total, 5 up, 6 in 2024-03-30T13:34:50.794 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:34:50 smithi181 ceph-mon[25762]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-03-30T13:34:50.795 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:34:50 smithi181 ceph-mon[25762]: from='osd.5 [v2:172.21.15.181:6808/1648947487,v1:172.21.15.181:6809/1648947487]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi181", "root=default"]}]: dispatch 2024-03-30T13:34:50.795 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:34:50 smithi181 ceph-mon[25762]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi181", "root=default"]}]: dispatch 2024-03-30T13:34:50.837 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:34:50 smithi099 ceph-mon[24912]: Adjusting osd_memory_target on smithi181 to 8032M 2024-03-30T13:34:50.837 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:34:50 smithi099 ceph-mon[24912]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-03-30T13:34:50.837 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:34:50 smithi099 ceph-mon[24912]: osdmap e37: 6 total, 5 up, 6 in 2024-03-30T13:34:50.837 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:34:50 smithi099 ceph-mon[24912]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-03-30T13:34:50.837 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:34:50 smithi099 ceph-mon[24912]: from='osd.5 [v2:172.21.15.181:6808/1648947487,v1:172.21.15.181:6809/1648947487]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi181", "root=default"]}]: dispatch 2024-03-30T13:34:50.837 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:34:50 smithi099 ceph-mon[24912]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi181", "root=default"]}]: dispatch 2024-03-30T13:34:50.837 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:34:50 smithi099 ceph-mon[29691]: Adjusting osd_memory_target on smithi181 to 8032M 2024-03-30T13:34:50.837 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:34:50 smithi099 ceph-mon[29691]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-03-30T13:34:50.837 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:34:50 smithi099 ceph-mon[29691]: osdmap e37: 6 total, 5 up, 6 in 2024-03-30T13:34:50.837 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:34:50 smithi099 ceph-mon[29691]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-03-30T13:34:50.837 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:34:50 smithi099 ceph-mon[29691]: from='osd.5 [v2:172.21.15.181:6808/1648947487,v1:172.21.15.181:6809/1648947487]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi181", "root=default"]}]: dispatch 2024-03-30T13:34:50.838 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:34:50 smithi099 ceph-mon[29691]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi181", "root=default"]}]: dispatch 2024-03-30T13:34:51.506 INFO:journalctl@ceph.osd.5.smithi181.stdout:Mar 30 13:34:51 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-5[33388]: 2024-03-30T13:34:51.057+0000 7fdfd6b73700 -1 osd.5 0 waiting for initial osdmap 2024-03-30T13:34:51.506 INFO:journalctl@ceph.osd.5.smithi181.stdout:Mar 30 13:34:51 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-5[33388]: 2024-03-30T13:34:51.062+0000 7fdfcfd07700 -1 osd.5 38 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-03-30T13:34:51.522 INFO:teuthology.orchestra.run.smithi181.stderr:--> Zapping: /dev/vg_nvme/lv_2 2024-03-30T13:34:51.522 INFO:teuthology.orchestra.run.smithi181.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_2 bs=1M count=10 conv=fsync 2024-03-30T13:34:51.522 INFO:teuthology.orchestra.run.smithi181.stderr: stderr: 10+0 records in 2024-03-30T13:34:51.522 INFO:teuthology.orchestra.run.smithi181.stderr:10+0 records out 2024-03-30T13:34:51.522 INFO:teuthology.orchestra.run.smithi181.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0126812 s, 827 MB/s 2024-03-30T13:34:51.522 INFO:teuthology.orchestra.run.smithi181.stderr:--> Zapping successful for: 2024-03-30T13:34:51.837 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:34:51 smithi099 ceph-mon[24912]: pgmap v127: 1 pgs: 1 active+clean; 577 KiB data, 29 MiB used, 447 GiB / 447 GiB avail 2024-03-30T13:34:51.837 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:34:51 smithi099 ceph-mon[24912]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi181", "root=default"]}]': finished 2024-03-30T13:34:51.837 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:34:51 smithi099 ceph-mon[24912]: osdmap e38: 6 total, 5 up, 6 in 2024-03-30T13:34:51.837 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:34:51 smithi099 ceph-mon[24912]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-03-30T13:34:51.837 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:34:51 smithi099 ceph-mon[24912]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-03-30T13:34:51.837 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:34:51 smithi099 ceph-mon[29691]: pgmap v127: 1 pgs: 1 active+clean; 577 KiB data, 29 MiB used, 447 GiB / 447 GiB avail 2024-03-30T13:34:51.837 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:34:51 smithi099 ceph-mon[29691]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi181", "root=default"]}]': finished 2024-03-30T13:34:51.837 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:34:51 smithi099 ceph-mon[29691]: osdmap e38: 6 total, 5 up, 6 in 2024-03-30T13:34:51.838 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:34:51 smithi099 ceph-mon[29691]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-03-30T13:34:51.838 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:34:51 smithi099 ceph-mon[29691]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-03-30T13:34:51.925 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:34:51 smithi181 ceph-mon[25762]: pgmap v127: 1 pgs: 1 active+clean; 577 KiB data, 29 MiB used, 447 GiB / 447 GiB avail 2024-03-30T13:34:51.925 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:34:51 smithi181 ceph-mon[25762]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi181", "root=default"]}]': finished 2024-03-30T13:34:51.925 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:34:51 smithi181 ceph-mon[25762]: osdmap e38: 6 total, 5 up, 6 in 2024-03-30T13:34:51.925 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:34:51 smithi181 ceph-mon[25762]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-03-30T13:34:51.925 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:34:51 smithi181 ceph-mon[25762]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-03-30T13:34:52.183 DEBUG:teuthology.orchestra.run.smithi181:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 98ebaeb8-ee99-11ee-b647-cb9ed24678a4 -- ceph orch daemon add osd smithi181:vg_nvme/lv_2 2024-03-30T13:34:52.837 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:34:52 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[25141]: 172.21.15.181 - - [30/Mar/2024:13:34:52] "POST /data HTTP/1.1" 200 46 "" "Python-urllib/3.9" 2024-03-30T13:34:53.337 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:34:53 smithi099 ceph-mon[24912]: purged_snaps scrub starts 2024-03-30T13:34:53.337 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:34:53 smithi099 ceph-mon[24912]: purged_snaps scrub ok 2024-03-30T13:34:53.337 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:34:53 smithi099 ceph-mon[24912]: osd.5 [v2:172.21.15.181:6808/1648947487,v1:172.21.15.181:6809/1648947487] boot 2024-03-30T13:34:53.337 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:34:53 smithi099 ceph-mon[24912]: osdmap e39: 6 total, 6 up, 6 in 2024-03-30T13:34:53.337 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:34:53 smithi099 ceph-mon[24912]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-03-30T13:34:53.337 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:34:53 smithi099 ceph-mon[24912]: pgmap v130: 1 pgs: 1 active+clean; 577 KiB data, 34 MiB used, 536 GiB / 536 GiB avail 2024-03-30T13:34:53.337 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:34:53 smithi099 ceph-mon[24912]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' 2024-03-30T13:34:53.337 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:34:53 smithi099 ceph-mon[24912]: Detected new or changed devices on smithi181 2024-03-30T13:34:53.338 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:34:53 smithi099 ceph-mon[24912]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' 2024-03-30T13:34:53.338 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:34:53 smithi099 ceph-mon[24912]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:34:53.338 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:34:53 smithi099 ceph-mon[24912]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:34:53.338 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:34:53 smithi099 ceph-mon[24912]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:34:53.338 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:34:53 smithi099 ceph-mon[24912]: pgmap v131: 1 pgs: 1 active+clean; 577 KiB data, 34 MiB used, 536 GiB / 536 GiB avail 2024-03-30T13:34:53.338 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:34:53 smithi099 ceph-mon[24912]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' 2024-03-30T13:34:53.338 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:34:53 smithi099 ceph-mon[29691]: purged_snaps scrub starts 2024-03-30T13:34:53.338 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:34:53 smithi099 ceph-mon[29691]: purged_snaps scrub ok 2024-03-30T13:34:53.338 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:34:53 smithi099 ceph-mon[29691]: osd.5 [v2:172.21.15.181:6808/1648947487,v1:172.21.15.181:6809/1648947487] boot 2024-03-30T13:34:53.338 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:34:53 smithi099 ceph-mon[29691]: osdmap e39: 6 total, 6 up, 6 in 2024-03-30T13:34:53.339 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:34:53 smithi099 ceph-mon[29691]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-03-30T13:34:53.339 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:34:53 smithi099 ceph-mon[29691]: pgmap v130: 1 pgs: 1 active+clean; 577 KiB data, 34 MiB used, 536 GiB / 536 GiB avail 2024-03-30T13:34:53.339 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:34:53 smithi099 ceph-mon[29691]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' 2024-03-30T13:34:53.339 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:34:53 smithi099 ceph-mon[29691]: Detected new or changed devices on smithi181 2024-03-30T13:34:53.339 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:34:53 smithi099 ceph-mon[29691]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' 2024-03-30T13:34:53.339 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:34:53 smithi099 ceph-mon[29691]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:34:53.339 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:34:53 smithi099 ceph-mon[29691]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:34:53.339 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:34:53 smithi099 ceph-mon[29691]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:34:53.339 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:34:53 smithi099 ceph-mon[29691]: pgmap v131: 1 pgs: 1 active+clean; 577 KiB data, 34 MiB used, 536 GiB / 536 GiB avail 2024-03-30T13:34:53.339 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:34:53 smithi099 ceph-mon[29691]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' 2024-03-30T13:34:53.506 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:34:53 smithi181 ceph-mon[25762]: purged_snaps scrub starts 2024-03-30T13:34:53.506 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:34:53 smithi181 ceph-mon[25762]: purged_snaps scrub ok 2024-03-30T13:34:53.506 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:34:53 smithi181 ceph-mon[25762]: osd.5 [v2:172.21.15.181:6808/1648947487,v1:172.21.15.181:6809/1648947487] boot 2024-03-30T13:34:53.506 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:34:53 smithi181 ceph-mon[25762]: osdmap e39: 6 total, 6 up, 6 in 2024-03-30T13:34:53.507 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:34:53 smithi181 ceph-mon[25762]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-03-30T13:34:53.507 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:34:53 smithi181 ceph-mon[25762]: pgmap v130: 1 pgs: 1 active+clean; 577 KiB data, 34 MiB used, 536 GiB / 536 GiB avail 2024-03-30T13:34:53.507 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:34:53 smithi181 ceph-mon[25762]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' 2024-03-30T13:34:53.507 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:34:53 smithi181 ceph-mon[25762]: Detected new or changed devices on smithi181 2024-03-30T13:34:53.507 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:34:53 smithi181 ceph-mon[25762]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' 2024-03-30T13:34:53.507 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:34:53 smithi181 ceph-mon[25762]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:34:53.507 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:34:53 smithi181 ceph-mon[25762]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:34:53.507 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:34:53 smithi181 ceph-mon[25762]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:34:53.507 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:34:53 smithi181 ceph-mon[25762]: pgmap v131: 1 pgs: 1 active+clean; 577 KiB data, 34 MiB used, 536 GiB / 536 GiB avail 2024-03-30T13:34:53.507 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:34:53 smithi181 ceph-mon[25762]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' 2024-03-30T13:34:54.256 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:34:54 smithi181 ceph-mon[25762]: Health check failed: 1 stray daemon(s) not managed by cephadm (CEPHADM_STRAY_DAEMON) 2024-03-30T13:34:54.256 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:34:54 smithi181 ceph-mon[25762]: osdmap e40: 6 total, 6 up, 6 in 2024-03-30T13:34:54.337 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:34:54 smithi099 ceph-mon[29691]: Health check failed: 1 stray daemon(s) not managed by cephadm (CEPHADM_STRAY_DAEMON) 2024-03-30T13:34:54.337 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:34:54 smithi099 ceph-mon[29691]: osdmap e40: 6 total, 6 up, 6 in 2024-03-30T13:34:54.337 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:34:54 smithi099 ceph-mon[24912]: Health check failed: 1 stray daemon(s) not managed by cephadm (CEPHADM_STRAY_DAEMON) 2024-03-30T13:34:54.337 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:34:54 smithi099 ceph-mon[24912]: osdmap e40: 6 total, 6 up, 6 in 2024-03-30T13:34:55.337 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:34:55 smithi099 ceph-mon[24912]: osdmap e41: 6 total, 6 up, 6 in 2024-03-30T13:34:55.337 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:34:55 smithi099 ceph-mon[24912]: from='client.24242 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi181:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T13:34:55.337 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:34:55 smithi099 ceph-mon[24912]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-03-30T13:34:55.337 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:34:55 smithi099 ceph-mon[24912]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-03-30T13:34:55.337 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:34:55 smithi099 ceph-mon[24912]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:34:55.337 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:34:55 smithi099 ceph-mon[24912]: pgmap v134: 1 pgs: 1 active+clean; 577 KiB data, 34 MiB used, 536 GiB / 536 GiB avail 2024-03-30T13:34:55.337 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:34:55 smithi099 ceph-mon[29691]: osdmap e41: 6 total, 6 up, 6 in 2024-03-30T13:34:55.337 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:34:55 smithi099 ceph-mon[29691]: from='client.24242 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi181:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T13:34:55.338 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:34:55 smithi099 ceph-mon[29691]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-03-30T13:34:55.338 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:34:55 smithi099 ceph-mon[29691]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-03-30T13:34:55.338 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:34:55 smithi099 ceph-mon[29691]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:34:55.338 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:34:55 smithi099 ceph-mon[29691]: pgmap v134: 1 pgs: 1 active+clean; 577 KiB data, 34 MiB used, 536 GiB / 536 GiB avail 2024-03-30T13:34:55.401 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:34:55 smithi181 ceph-mon[25762]: osdmap e41: 6 total, 6 up, 6 in 2024-03-30T13:34:55.401 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:34:55 smithi181 ceph-mon[25762]: from='client.24242 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi181:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T13:34:55.401 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:34:55 smithi181 ceph-mon[25762]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-03-30T13:34:55.401 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:34:55 smithi181 ceph-mon[25762]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-03-30T13:34:55.401 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:34:55 smithi181 ceph-mon[25762]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:34:55.401 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:34:55 smithi181 ceph-mon[25762]: pgmap v134: 1 pgs: 1 active+clean; 577 KiB data, 34 MiB used, 536 GiB / 536 GiB avail 2024-03-30T13:34:56.337 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:34:56 smithi099 ceph-mon[24912]: osdmap e42: 6 total, 6 up, 6 in 2024-03-30T13:34:56.337 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:34:56 smithi099 ceph-mon[29691]: osdmap e42: 6 total, 6 up, 6 in 2024-03-30T13:34:56.461 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:34:56 smithi181 ceph-mon[25762]: osdmap e42: 6 total, 6 up, 6 in 2024-03-30T13:34:56.837 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:34:56 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[25141]: 172.21.15.181 - - [30/Mar/2024:13:34:56] "POST /data HTTP/1.1" 200 46 "" "Python-urllib/3.9" 2024-03-30T13:34:57.337 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:34:57 smithi099 ceph-mon[24912]: osdmap e43: 6 total, 6 up, 6 in 2024-03-30T13:34:57.337 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:34:57 smithi099 ceph-mon[24912]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' 2024-03-30T13:34:57.337 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:34:57 smithi099 ceph-mon[24912]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' 2024-03-30T13:34:57.337 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:34:57 smithi099 ceph-mon[24912]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:34:57.337 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:34:57 smithi099 ceph-mon[24912]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:34:57.337 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:34:57 smithi099 ceph-mon[24912]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:34:57.337 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:34:57 smithi099 ceph-mon[24912]: pgmap v137: 1 pgs: 1 active+clean; 577 KiB data, 34 MiB used, 536 GiB / 536 GiB avail 2024-03-30T13:34:57.337 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:34:57 smithi099 ceph-mon[24912]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' 2024-03-30T13:34:57.337 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:34:57 smithi099 ceph-mon[29691]: osdmap e43: 6 total, 6 up, 6 in 2024-03-30T13:34:57.337 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:34:57 smithi099 ceph-mon[29691]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' 2024-03-30T13:34:57.338 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:34:57 smithi099 ceph-mon[29691]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' 2024-03-30T13:34:57.338 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:34:57 smithi099 ceph-mon[29691]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:34:57.338 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:34:57 smithi099 ceph-mon[29691]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:34:57.338 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:34:57 smithi099 ceph-mon[29691]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:34:57.338 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:34:57 smithi099 ceph-mon[29691]: pgmap v137: 1 pgs: 1 active+clean; 577 KiB data, 34 MiB used, 536 GiB / 536 GiB avail 2024-03-30T13:34:57.338 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:34:57 smithi099 ceph-mon[29691]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' 2024-03-30T13:34:57.490 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:34:57 smithi181 ceph-mon[25762]: osdmap e43: 6 total, 6 up, 6 in 2024-03-30T13:34:57.490 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:34:57 smithi181 ceph-mon[25762]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' 2024-03-30T13:34:57.490 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:34:57 smithi181 ceph-mon[25762]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' 2024-03-30T13:34:57.490 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:34:57 smithi181 ceph-mon[25762]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:34:57.490 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:34:57 smithi181 ceph-mon[25762]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:34:57.490 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:34:57 smithi181 ceph-mon[25762]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:34:57.490 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:34:57 smithi181 ceph-mon[25762]: pgmap v137: 1 pgs: 1 active+clean; 577 KiB data, 34 MiB used, 536 GiB / 536 GiB avail 2024-03-30T13:34:57.490 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:34:57 smithi181 ceph-mon[25762]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' 2024-03-30T13:34:58.337 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:34:58 smithi099 ceph-mon[24912]: Health check cleared: CEPHADM_STRAY_DAEMON (was: 1 stray daemon(s) not managed by cephadm) 2024-03-30T13:34:58.337 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:34:58 smithi099 ceph-mon[24912]: Cluster is now healthy 2024-03-30T13:34:58.338 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:34:58 smithi099 ceph-mon[29691]: Health check cleared: CEPHADM_STRAY_DAEMON (was: 1 stray daemon(s) not managed by cephadm) 2024-03-30T13:34:58.338 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:34:58 smithi099 ceph-mon[29691]: Cluster is now healthy 2024-03-30T13:34:58.506 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:34:58 smithi181 ceph-mon[25762]: Health check cleared: CEPHADM_STRAY_DAEMON (was: 1 stray daemon(s) not managed by cephadm) 2024-03-30T13:34:58.506 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:34:58 smithi181 ceph-mon[25762]: Cluster is now healthy 2024-03-30T13:34:59.337 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:34:59 smithi099 ceph-mon[24912]: from='client.? 172.21.15.181:0/2476064280' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "eee64a05-4d3a-4ba4-b1d2-43a9aeec31ed"}]: dispatch 2024-03-30T13:34:59.337 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:34:59 smithi099 ceph-mon[24912]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "eee64a05-4d3a-4ba4-b1d2-43a9aeec31ed"}]: dispatch 2024-03-30T13:34:59.337 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:34:59 smithi099 ceph-mon[24912]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "eee64a05-4d3a-4ba4-b1d2-43a9aeec31ed"}]': finished 2024-03-30T13:34:59.337 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:34:59 smithi099 ceph-mon[24912]: osdmap e44: 7 total, 6 up, 7 in 2024-03-30T13:34:59.337 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:34:59 smithi099 ceph-mon[24912]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-03-30T13:34:59.337 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:34:59 smithi099 ceph-mon[24912]: pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 35 MiB used, 536 GiB / 536 GiB avail 2024-03-30T13:34:59.337 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:34:59 smithi099 ceph-mon[24912]: from='client.? 172.21.15.181:0/3865734432' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-03-30T13:34:59.338 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:34:59 smithi099 ceph-mon[29691]: from='client.? 172.21.15.181:0/2476064280' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "eee64a05-4d3a-4ba4-b1d2-43a9aeec31ed"}]: dispatch 2024-03-30T13:34:59.338 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:34:59 smithi099 ceph-mon[29691]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "eee64a05-4d3a-4ba4-b1d2-43a9aeec31ed"}]: dispatch 2024-03-30T13:34:59.338 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:34:59 smithi099 ceph-mon[29691]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "eee64a05-4d3a-4ba4-b1d2-43a9aeec31ed"}]': finished 2024-03-30T13:34:59.338 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:34:59 smithi099 ceph-mon[29691]: osdmap e44: 7 total, 6 up, 7 in 2024-03-30T13:34:59.338 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:34:59 smithi099 ceph-mon[29691]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-03-30T13:34:59.338 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:34:59 smithi099 ceph-mon[29691]: pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 35 MiB used, 536 GiB / 536 GiB avail 2024-03-30T13:34:59.338 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:34:59 smithi099 ceph-mon[29691]: from='client.? 172.21.15.181:0/3865734432' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-03-30T13:34:59.506 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:34:59 smithi181 ceph-mon[25762]: from='client.? 172.21.15.181:0/2476064280' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "eee64a05-4d3a-4ba4-b1d2-43a9aeec31ed"}]: dispatch 2024-03-30T13:34:59.506 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:34:59 smithi181 ceph-mon[25762]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "eee64a05-4d3a-4ba4-b1d2-43a9aeec31ed"}]: dispatch 2024-03-30T13:34:59.506 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:34:59 smithi181 ceph-mon[25762]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "eee64a05-4d3a-4ba4-b1d2-43a9aeec31ed"}]': finished 2024-03-30T13:34:59.506 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:34:59 smithi181 ceph-mon[25762]: osdmap e44: 7 total, 6 up, 7 in 2024-03-30T13:34:59.506 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:34:59 smithi181 ceph-mon[25762]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-03-30T13:34:59.506 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:34:59 smithi181 ceph-mon[25762]: pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 35 MiB used, 536 GiB / 536 GiB avail 2024-03-30T13:34:59.506 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:34:59 smithi181 ceph-mon[25762]: from='client.? 172.21.15.181:0/3865734432' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-03-30T13:35:01.756 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:35:01 smithi181 ceph-mon[25762]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 35 MiB used, 536 GiB / 536 GiB avail 2024-03-30T13:35:01.836 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:35:01 smithi099 ceph-mon[24912]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 35 MiB used, 536 GiB / 536 GiB avail 2024-03-30T13:35:01.837 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:35:01 smithi099 ceph-mon[29691]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 35 MiB used, 536 GiB / 536 GiB avail 2024-03-30T13:35:02.828 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:35:02 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[25141]: 172.21.15.99 - - [30/Mar/2024:13:35:02] "POST /data HTTP/1.1" 200 46 "" "Python-urllib/3.9" 2024-03-30T13:35:03.587 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:35:03 smithi099 ceph-mon[24912]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' 2024-03-30T13:35:03.587 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:35:03 smithi099 ceph-mon[24912]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' 2024-03-30T13:35:03.587 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:35:03 smithi099 ceph-mon[24912]: pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 35 MiB used, 536 GiB / 536 GiB avail 2024-03-30T13:35:03.588 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:35:03 smithi099 ceph-mon[29691]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' 2024-03-30T13:35:03.588 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:35:03 smithi099 ceph-mon[29691]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' 2024-03-30T13:35:03.588 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:35:03 smithi099 ceph-mon[29691]: pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 35 MiB used, 536 GiB / 536 GiB avail 2024-03-30T13:35:03.756 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:35:03 smithi181 ceph-mon[25762]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' 2024-03-30T13:35:03.756 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:35:03 smithi181 ceph-mon[25762]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' 2024-03-30T13:35:03.756 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:35:03 smithi181 ceph-mon[25762]: pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 35 MiB used, 536 GiB / 536 GiB avail 2024-03-30T13:35:05.705 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:35:05 smithi181 ceph-mon[25762]: pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 35 MiB used, 536 GiB / 536 GiB avail 2024-03-30T13:35:05.837 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:35:05 smithi099 ceph-mon[24912]: pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 35 MiB used, 536 GiB / 536 GiB avail 2024-03-30T13:35:05.837 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:35:05 smithi099 ceph-mon[29691]: pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 35 MiB used, 536 GiB / 536 GiB avail 2024-03-30T13:35:06.756 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:35:06 smithi181 ceph-mon[25762]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2024-03-30T13:35:06.756 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:35:06 smithi181 ceph-mon[25762]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:35:06.837 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:35:06 smithi099 ceph-mon[29691]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2024-03-30T13:35:06.837 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:35:06 smithi099 ceph-mon[29691]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:35:06.837 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:35:06 smithi099 ceph-mon[24912]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2024-03-30T13:35:06.837 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:35:06 smithi099 ceph-mon[24912]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:35:07.837 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:35:07 smithi099 ceph-mon[24912]: Deploying daemon osd.6 on smithi181 2024-03-30T13:35:07.837 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:35:07 smithi099 ceph-mon[24912]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 35 MiB used, 536 GiB / 536 GiB avail 2024-03-30T13:35:07.837 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:35:07 smithi099 ceph-mon[29691]: Deploying daemon osd.6 on smithi181 2024-03-30T13:35:07.837 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:35:07 smithi099 ceph-mon[29691]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 35 MiB used, 536 GiB / 536 GiB avail 2024-03-30T13:35:07.964 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:35:07 smithi181 ceph-mon[25762]: Deploying daemon osd.6 on smithi181 2024-03-30T13:35:07.964 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:35:07 smithi181 ceph-mon[25762]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 35 MiB used, 536 GiB / 536 GiB avail 2024-03-30T13:35:09.836 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:35:09 smithi099 ceph-mon[24912]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 35 MiB used, 536 GiB / 536 GiB avail 2024-03-30T13:35:09.837 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:35:09 smithi099 ceph-mon[29691]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 35 MiB used, 536 GiB / 536 GiB avail 2024-03-30T13:35:09.893 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:35:09 smithi181 ceph-mon[25762]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 35 MiB used, 536 GiB / 536 GiB avail 2024-03-30T13:35:11.618 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:35:11 smithi181 ceph-mon[25762]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 35 MiB used, 536 GiB / 536 GiB avail 2024-03-30T13:35:11.619 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:35:11 smithi181 ceph-mon[25762]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' 2024-03-30T13:35:11.619 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:35:11 smithi181 ceph-mon[25762]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:35:11.619 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:35:11 smithi181 ceph-mon[25762]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:35:11.619 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:35:11 smithi181 ceph-mon[25762]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:35:11.619 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:35:11 smithi181 ceph-mon[25762]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' 2024-03-30T13:35:11.837 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:35:11 smithi099 ceph-mon[24912]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 35 MiB used, 536 GiB / 536 GiB avail 2024-03-30T13:35:11.837 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:35:11 smithi099 ceph-mon[24912]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' 2024-03-30T13:35:11.837 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:35:11 smithi099 ceph-mon[24912]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:35:11.837 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:35:11 smithi099 ceph-mon[24912]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:35:11.837 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:35:11 smithi099 ceph-mon[24912]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:35:11.837 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:35:11 smithi099 ceph-mon[24912]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' 2024-03-30T13:35:11.837 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:35:11 smithi099 ceph-mon[29691]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 35 MiB used, 536 GiB / 536 GiB avail 2024-03-30T13:35:11.837 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:35:11 smithi099 ceph-mon[29691]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' 2024-03-30T13:35:11.837 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:35:11 smithi099 ceph-mon[29691]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:35:11.838 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:35:11 smithi099 ceph-mon[29691]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:35:11.838 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:35:11 smithi099 ceph-mon[29691]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:35:11.838 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:35:11 smithi099 ceph-mon[29691]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' 2024-03-30T13:35:13.513 INFO:teuthology.orchestra.run.smithi181.stdout:Created osd(s) 6 on host 'smithi181' 2024-03-30T13:35:13.756 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:35:13 smithi181 ceph-mon[25762]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 35 MiB used, 536 GiB / 536 GiB avail 2024-03-30T13:35:13.756 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:35:13 smithi181 ceph-mon[25762]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' 2024-03-30T13:35:13.756 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:35:13 smithi181 ceph-mon[25762]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:35:13.756 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:35:13 smithi181 ceph-mon[25762]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:35:13.756 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:35:13 smithi181 ceph-mon[25762]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:35:13.756 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:35:13 smithi181 ceph-mon[25762]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-03-30T13:35:13.756 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:35:13 smithi181 ceph-mon[25762]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-03-30T13:35:13.756 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:35:13 smithi181 ceph-mon[25762]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-03-30T13:35:13.756 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:35:13 smithi181 ceph-mon[25762]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' 2024-03-30T13:35:13.757 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:35:13 smithi181 ceph-mon[25762]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' 2024-03-30T13:35:13.837 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:35:13 smithi099 ceph-mon[24912]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 35 MiB used, 536 GiB / 536 GiB avail 2024-03-30T13:35:13.837 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:35:13 smithi099 ceph-mon[24912]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' 2024-03-30T13:35:13.837 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:35:13 smithi099 ceph-mon[24912]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:35:13.837 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:35:13 smithi099 ceph-mon[24912]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:35:13.837 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:35:13 smithi099 ceph-mon[24912]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:35:13.837 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:35:13 smithi099 ceph-mon[24912]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-03-30T13:35:13.837 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:35:13 smithi099 ceph-mon[24912]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-03-30T13:35:13.837 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:35:13 smithi099 ceph-mon[24912]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-03-30T13:35:13.837 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:35:13 smithi099 ceph-mon[24912]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' 2024-03-30T13:35:13.838 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:35:13 smithi099 ceph-mon[24912]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' 2024-03-30T13:35:13.838 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:35:13 smithi099 ceph-mon[29691]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 35 MiB used, 536 GiB / 536 GiB avail 2024-03-30T13:35:13.838 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:35:13 smithi099 ceph-mon[29691]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' 2024-03-30T13:35:13.838 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:35:13 smithi099 ceph-mon[29691]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:35:13.838 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:35:13 smithi099 ceph-mon[29691]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:35:13.838 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:35:13 smithi099 ceph-mon[29691]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:35:13.838 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:35:13 smithi099 ceph-mon[29691]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-03-30T13:35:13.838 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:35:13 smithi099 ceph-mon[29691]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-03-30T13:35:13.838 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:35:13 smithi099 ceph-mon[29691]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-03-30T13:35:13.838 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:35:13 smithi099 ceph-mon[29691]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' 2024-03-30T13:35:13.838 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:35:13 smithi099 ceph-mon[29691]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' 2024-03-30T13:35:14.167 DEBUG:teuthology.orchestra.run.smithi181:osd.6> sudo journalctl -f -n 0 -u ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4@osd.6.service 2024-03-30T13:35:14.170 INFO:tasks.cephadm:Deploying osd.7 on smithi181 with /dev/vg_nvme/lv_1... 2024-03-30T13:35:14.171 DEBUG:teuthology.orchestra.run.smithi181:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 98ebaeb8-ee99-11ee-b647-cb9ed24678a4 -- ceph-volume lvm zap /dev/vg_nvme/lv_1 2024-03-30T13:35:14.837 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:35:14 smithi099 ceph-mon[24912]: Adjusting osd_memory_target on smithi181 to 5354M 2024-03-30T13:35:14.837 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:35:14 smithi099 ceph-mon[24912]: from='osd.6 [v2:172.21.15.181:6816/4097845576,v1:172.21.15.181:6817/4097845576]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-03-30T13:35:14.837 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:35:14 smithi099 ceph-mon[24912]: from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-03-30T13:35:14.837 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:35:14 smithi099 ceph-mon[29691]: Adjusting osd_memory_target on smithi181 to 5354M 2024-03-30T13:35:14.837 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:35:14 smithi099 ceph-mon[29691]: from='osd.6 [v2:172.21.15.181:6816/4097845576,v1:172.21.15.181:6817/4097845576]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-03-30T13:35:14.837 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:35:14 smithi099 ceph-mon[29691]: from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-03-30T13:35:14.837 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:35:14 smithi181 ceph-mon[25762]: Adjusting osd_memory_target on smithi181 to 5354M 2024-03-30T13:35:14.838 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:35:14 smithi181 ceph-mon[25762]: from='osd.6 [v2:172.21.15.181:6816/4097845576,v1:172.21.15.181:6817/4097845576]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-03-30T13:35:14.838 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:35:14 smithi181 ceph-mon[25762]: from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-03-30T13:35:15.756 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:35:15 smithi181 ceph-mon[25762]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 35 MiB used, 536 GiB / 536 GiB avail 2024-03-30T13:35:15.756 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:35:15 smithi181 ceph-mon[25762]: from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-03-30T13:35:15.756 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:35:15 smithi181 ceph-mon[25762]: osdmap e45: 7 total, 6 up, 7 in 2024-03-30T13:35:15.756 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:35:15 smithi181 ceph-mon[25762]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-03-30T13:35:15.756 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:35:15 smithi181 ceph-mon[25762]: from='osd.6 [v2:172.21.15.181:6816/4097845576,v1:172.21.15.181:6817/4097845576]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi181", "root=default"]}]: dispatch 2024-03-30T13:35:15.757 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:35:15 smithi181 ceph-mon[25762]: from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi181", "root=default"]}]: dispatch 2024-03-30T13:35:15.757 INFO:journalctl@ceph.osd.6.smithi181.stdout:Mar 30 13:35:15 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-6[36302]: 2024-03-30T13:35:15.576+0000 7f64acf55700 -1 osd.6 0 waiting for initial osdmap 2024-03-30T13:35:15.757 INFO:journalctl@ceph.osd.6.smithi181.stdout:Mar 30 13:35:15 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-6[36302]: 2024-03-30T13:35:15.582+0000 7f64a80ed700 -1 osd.6 46 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-03-30T13:35:15.837 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:35:15 smithi099 ceph-mon[24912]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 35 MiB used, 536 GiB / 536 GiB avail 2024-03-30T13:35:15.837 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:35:15 smithi099 ceph-mon[24912]: from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-03-30T13:35:15.837 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:35:15 smithi099 ceph-mon[24912]: osdmap e45: 7 total, 6 up, 7 in 2024-03-30T13:35:15.837 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:35:15 smithi099 ceph-mon[24912]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-03-30T13:35:15.837 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:35:15 smithi099 ceph-mon[24912]: from='osd.6 [v2:172.21.15.181:6816/4097845576,v1:172.21.15.181:6817/4097845576]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi181", "root=default"]}]: dispatch 2024-03-30T13:35:15.837 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:35:15 smithi099 ceph-mon[24912]: from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi181", "root=default"]}]: dispatch 2024-03-30T13:35:15.838 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:35:15 smithi099 ceph-mon[29691]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 35 MiB used, 536 GiB / 536 GiB avail 2024-03-30T13:35:15.838 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:35:15 smithi099 ceph-mon[29691]: from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-03-30T13:35:15.838 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:35:15 smithi099 ceph-mon[29691]: osdmap e45: 7 total, 6 up, 7 in 2024-03-30T13:35:15.838 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:35:15 smithi099 ceph-mon[29691]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-03-30T13:35:15.838 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:35:15 smithi099 ceph-mon[29691]: from='osd.6 [v2:172.21.15.181:6816/4097845576,v1:172.21.15.181:6817/4097845576]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi181", "root=default"]}]: dispatch 2024-03-30T13:35:15.838 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:35:15 smithi099 ceph-mon[29691]: from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi181", "root=default"]}]: dispatch 2024-03-30T13:35:16.320 INFO:teuthology.orchestra.run.smithi181.stderr:--> Zapping: /dev/vg_nvme/lv_1 2024-03-30T13:35:16.320 INFO:teuthology.orchestra.run.smithi181.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_1 bs=1M count=10 conv=fsync 2024-03-30T13:35:16.320 INFO:teuthology.orchestra.run.smithi181.stderr: stderr: 10+0 records in 2024-03-30T13:35:16.320 INFO:teuthology.orchestra.run.smithi181.stderr:10+0 records out 2024-03-30T13:35:16.320 INFO:teuthology.orchestra.run.smithi181.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0177276 s, 591 MB/s 2024-03-30T13:35:16.320 INFO:teuthology.orchestra.run.smithi181.stderr:--> Zapping successful for: 2024-03-30T13:35:16.837 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:35:16 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[25141]: 172.21.15.181 - - [30/Mar/2024:13:35:16] "POST /data HTTP/1.1" 200 46 "" "Python-urllib/3.9" 2024-03-30T13:35:16.837 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:35:16 smithi099 ceph-mon[24912]: from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi181", "root=default"]}]': finished 2024-03-30T13:35:16.837 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:35:16 smithi099 ceph-mon[24912]: osdmap e46: 7 total, 6 up, 7 in 2024-03-30T13:35:16.837 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:35:16 smithi099 ceph-mon[24912]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-03-30T13:35:16.837 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:35:16 smithi099 ceph-mon[24912]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-03-30T13:35:16.837 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:35:16 smithi099 ceph-mon[24912]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' 2024-03-30T13:35:16.837 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:35:16 smithi099 ceph-mon[24912]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' 2024-03-30T13:35:16.838 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:35:16 smithi099 ceph-mon[24912]: osd.6 [v2:172.21.15.181:6816/4097845576,v1:172.21.15.181:6817/4097845576] boot 2024-03-30T13:35:16.838 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:35:16 smithi099 ceph-mon[24912]: osdmap e47: 7 total, 7 up, 7 in 2024-03-30T13:35:16.838 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:35:16 smithi099 ceph-mon[24912]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-03-30T13:35:16.838 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:35:16 smithi099 ceph-mon[29691]: from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi181", "root=default"]}]': finished 2024-03-30T13:35:16.838 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:35:16 smithi099 ceph-mon[29691]: osdmap e46: 7 total, 6 up, 7 in 2024-03-30T13:35:16.838 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:35:16 smithi099 ceph-mon[29691]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-03-30T13:35:16.838 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:35:16 smithi099 ceph-mon[29691]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-03-30T13:35:16.838 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:35:16 smithi099 ceph-mon[29691]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' 2024-03-30T13:35:16.838 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:35:16 smithi099 ceph-mon[29691]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' 2024-03-30T13:35:16.838 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:35:16 smithi099 ceph-mon[29691]: osd.6 [v2:172.21.15.181:6816/4097845576,v1:172.21.15.181:6817/4097845576] boot 2024-03-30T13:35:16.838 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:35:16 smithi099 ceph-mon[29691]: osdmap e47: 7 total, 7 up, 7 in 2024-03-30T13:35:16.839 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:35:16 smithi099 ceph-mon[29691]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-03-30T13:35:16.973 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:35:16 smithi181 ceph-mon[25762]: from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi181", "root=default"]}]': finished 2024-03-30T13:35:16.973 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:35:16 smithi181 ceph-mon[25762]: osdmap e46: 7 total, 6 up, 7 in 2024-03-30T13:35:16.973 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:35:16 smithi181 ceph-mon[25762]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-03-30T13:35:16.973 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:35:16 smithi181 ceph-mon[25762]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-03-30T13:35:16.973 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:35:16 smithi181 ceph-mon[25762]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' 2024-03-30T13:35:16.973 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:35:16 smithi181 ceph-mon[25762]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' 2024-03-30T13:35:16.973 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:35:16 smithi181 ceph-mon[25762]: osd.6 [v2:172.21.15.181:6816/4097845576,v1:172.21.15.181:6817/4097845576] boot 2024-03-30T13:35:16.973 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:35:16 smithi181 ceph-mon[25762]: osdmap e47: 7 total, 7 up, 7 in 2024-03-30T13:35:16.973 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:35:16 smithi181 ceph-mon[25762]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-03-30T13:35:17.606 DEBUG:teuthology.orchestra.run.smithi181:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 98ebaeb8-ee99-11ee-b647-cb9ed24678a4 -- ceph orch daemon add osd smithi181:vg_nvme/lv_1 2024-03-30T13:35:17.838 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:35:17 smithi099 ceph-mon[24912]: purged_snaps scrub starts 2024-03-30T13:35:17.838 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:35:17 smithi099 ceph-mon[24912]: purged_snaps scrub ok 2024-03-30T13:35:17.838 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:35:17 smithi099 ceph-mon[24912]: pgmap v150: 1 pgs: 1 peering; 577 KiB data, 35 MiB used, 536 GiB / 536 GiB avail 2024-03-30T13:35:17.838 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:35:17 smithi099 ceph-mon[24912]: Detected new or changed devices on smithi181 2024-03-30T13:35:17.838 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:35:17 smithi099 ceph-mon[24912]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:35:17.838 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:35:17 smithi099 ceph-mon[24912]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:35:17.838 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:35:17 smithi099 ceph-mon[24912]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:35:17.838 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:35:17 smithi099 ceph-mon[24912]: pgmap v152: 1 pgs: 1 peering; 577 KiB data, 40 MiB used, 626 GiB / 626 GiB avail 2024-03-30T13:35:17.838 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:35:17 smithi099 ceph-mon[24912]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' 2024-03-30T13:35:17.839 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:35:17 smithi099 ceph-mon[24912]: osdmap e48: 7 total, 7 up, 7 in 2024-03-30T13:35:17.839 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:35:17 smithi099 ceph-mon[29691]: purged_snaps scrub starts 2024-03-30T13:35:17.839 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:35:17 smithi099 ceph-mon[29691]: purged_snaps scrub ok 2024-03-30T13:35:17.839 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:35:17 smithi099 ceph-mon[29691]: pgmap v150: 1 pgs: 1 peering; 577 KiB data, 35 MiB used, 536 GiB / 536 GiB avail 2024-03-30T13:35:17.839 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:35:17 smithi099 ceph-mon[29691]: Detected new or changed devices on smithi181 2024-03-30T13:35:17.839 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:35:17 smithi099 ceph-mon[29691]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:35:17.839 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:35:17 smithi099 ceph-mon[29691]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:35:17.839 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:35:17 smithi099 ceph-mon[29691]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:35:17.839 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:35:17 smithi099 ceph-mon[29691]: pgmap v152: 1 pgs: 1 peering; 577 KiB data, 40 MiB used, 626 GiB / 626 GiB avail 2024-03-30T13:35:17.839 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:35:17 smithi099 ceph-mon[29691]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' 2024-03-30T13:35:17.839 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:35:17 smithi099 ceph-mon[29691]: osdmap e48: 7 total, 7 up, 7 in 2024-03-30T13:35:17.886 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:35:17 smithi181 ceph-mon[25762]: purged_snaps scrub starts 2024-03-30T13:35:17.887 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:35:17 smithi181 ceph-mon[25762]: purged_snaps scrub ok 2024-03-30T13:35:17.887 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:35:17 smithi181 ceph-mon[25762]: pgmap v150: 1 pgs: 1 peering; 577 KiB data, 35 MiB used, 536 GiB / 536 GiB avail 2024-03-30T13:35:17.887 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:35:17 smithi181 ceph-mon[25762]: Detected new or changed devices on smithi181 2024-03-30T13:35:17.887 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:35:17 smithi181 ceph-mon[25762]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:35:17.887 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:35:17 smithi181 ceph-mon[25762]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:35:17.887 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:35:17 smithi181 ceph-mon[25762]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:35:17.887 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:35:17 smithi181 ceph-mon[25762]: pgmap v152: 1 pgs: 1 peering; 577 KiB data, 40 MiB used, 626 GiB / 626 GiB avail 2024-03-30T13:35:17.887 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:35:17 smithi181 ceph-mon[25762]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' 2024-03-30T13:35:17.887 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:35:17 smithi181 ceph-mon[25762]: osdmap e48: 7 total, 7 up, 7 in 2024-03-30T13:35:18.336 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:35:17 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[25141]: 172.21.15.181 - - [30/Mar/2024:13:35:17] "POST /data HTTP/1.1" 200 46 "" "Python-urllib/3.9" 2024-03-30T13:35:18.837 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:35:18 smithi099 ceph-mon[24912]: Health check failed: 1 stray daemon(s) not managed by cephadm (CEPHADM_STRAY_DAEMON) 2024-03-30T13:35:18.837 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:35:18 smithi099 ceph-mon[24912]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' 2024-03-30T13:35:18.837 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:35:18 smithi099 ceph-mon[24912]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' 2024-03-30T13:35:18.838 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:35:18 smithi099 ceph-mon[24912]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:35:18.838 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:35:18 smithi099 ceph-mon[24912]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:35:18.838 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:35:18 smithi099 ceph-mon[24912]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:35:18.838 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:35:18 smithi099 ceph-mon[24912]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' 2024-03-30T13:35:18.838 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:35:18 smithi099 ceph-mon[24912]: osdmap e49: 7 total, 7 up, 7 in 2024-03-30T13:35:18.838 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:35:18 smithi099 ceph-mon[29691]: Health check failed: 1 stray daemon(s) not managed by cephadm (CEPHADM_STRAY_DAEMON) 2024-03-30T13:35:18.838 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:35:18 smithi099 ceph-mon[29691]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' 2024-03-30T13:35:18.838 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:35:18 smithi099 ceph-mon[29691]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' 2024-03-30T13:35:18.839 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:35:18 smithi099 ceph-mon[29691]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:35:18.839 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:35:18 smithi099 ceph-mon[29691]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:35:18.839 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:35:18 smithi099 ceph-mon[29691]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:35:18.839 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:35:18 smithi099 ceph-mon[29691]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' 2024-03-30T13:35:18.839 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:35:18 smithi099 ceph-mon[29691]: osdmap e49: 7 total, 7 up, 7 in 2024-03-30T13:35:18.959 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:35:18 smithi181 ceph-mon[25762]: Health check failed: 1 stray daemon(s) not managed by cephadm (CEPHADM_STRAY_DAEMON) 2024-03-30T13:35:18.959 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:35:18 smithi181 ceph-mon[25762]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' 2024-03-30T13:35:18.959 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:35:18 smithi181 ceph-mon[25762]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' 2024-03-30T13:35:18.959 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:35:18 smithi181 ceph-mon[25762]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:35:18.959 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:35:18 smithi181 ceph-mon[25762]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:35:18.959 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:35:18 smithi181 ceph-mon[25762]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:35:18.959 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:35:18 smithi181 ceph-mon[25762]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' 2024-03-30T13:35:18.959 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:35:18 smithi181 ceph-mon[25762]: osdmap e49: 7 total, 7 up, 7 in 2024-03-30T13:35:19.837 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:35:19 smithi099 ceph-mon[24912]: pgmap v154: 1 pgs: 1 peering; 577 KiB data, 40 MiB used, 626 GiB / 626 GiB avail 2024-03-30T13:35:19.837 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:35:19 smithi099 ceph-mon[24912]: Health check cleared: CEPHADM_STRAY_DAEMON (was: 1 stray daemon(s) not managed by cephadm) 2024-03-30T13:35:19.837 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:35:19 smithi099 ceph-mon[24912]: Cluster is now healthy 2024-03-30T13:35:19.837 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:35:19 smithi099 ceph-mon[29691]: pgmap v154: 1 pgs: 1 peering; 577 KiB data, 40 MiB used, 626 GiB / 626 GiB avail 2024-03-30T13:35:19.837 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:35:19 smithi099 ceph-mon[29691]: Health check cleared: CEPHADM_STRAY_DAEMON (was: 1 stray daemon(s) not managed by cephadm) 2024-03-30T13:35:19.837 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:35:19 smithi099 ceph-mon[29691]: Cluster is now healthy 2024-03-30T13:35:19.842 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:35:19 smithi181 ceph-mon[25762]: pgmap v154: 1 pgs: 1 peering; 577 KiB data, 40 MiB used, 626 GiB / 626 GiB avail 2024-03-30T13:35:19.842 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:35:19 smithi181 ceph-mon[25762]: Health check cleared: CEPHADM_STRAY_DAEMON (was: 1 stray daemon(s) not managed by cephadm) 2024-03-30T13:35:19.842 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:35:19 smithi181 ceph-mon[25762]: Cluster is now healthy 2024-03-30T13:35:20.756 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:35:20 smithi181 ceph-mon[25762]: osdmap e50: 7 total, 7 up, 7 in 2024-03-30T13:35:20.756 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:35:20 smithi181 ceph-mon[25762]: pgmap v157: 1 pgs: 1 peering; 577 KiB data, 40 MiB used, 626 GiB / 626 GiB avail 2024-03-30T13:35:20.756 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:35:20 smithi181 ceph-mon[25762]: from='client.24269 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi181:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T13:35:20.757 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:35:20 smithi181 ceph-mon[25762]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-03-30T13:35:20.757 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:35:20 smithi181 ceph-mon[25762]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-03-30T13:35:20.757 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:35:20 smithi181 ceph-mon[25762]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:35:21.087 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:35:20 smithi099 ceph-mon[24912]: osdmap e50: 7 total, 7 up, 7 in 2024-03-30T13:35:21.087 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:35:20 smithi099 ceph-mon[24912]: pgmap v157: 1 pgs: 1 peering; 577 KiB data, 40 MiB used, 626 GiB / 626 GiB avail 2024-03-30T13:35:21.087 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:35:20 smithi099 ceph-mon[24912]: from='client.24269 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi181:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T13:35:21.087 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:35:20 smithi099 ceph-mon[24912]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-03-30T13:35:21.087 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:35:20 smithi099 ceph-mon[24912]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-03-30T13:35:21.087 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:35:20 smithi099 ceph-mon[24912]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:35:21.088 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:35:20 smithi099 ceph-mon[29691]: osdmap e50: 7 total, 7 up, 7 in 2024-03-30T13:35:21.088 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:35:20 smithi099 ceph-mon[29691]: pgmap v157: 1 pgs: 1 peering; 577 KiB data, 40 MiB used, 626 GiB / 626 GiB avail 2024-03-30T13:35:21.088 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:35:20 smithi099 ceph-mon[29691]: from='client.24269 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi181:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T13:35:21.088 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:35:20 smithi099 ceph-mon[29691]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-03-30T13:35:21.088 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:35:20 smithi099 ceph-mon[29691]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-03-30T13:35:21.088 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:35:20 smithi099 ceph-mon[29691]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:35:21.854 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:35:21 smithi181 ceph-mon[25762]: osdmap e51: 7 total, 7 up, 7 in 2024-03-30T13:35:22.087 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:35:21 smithi099 ceph-mon[24912]: osdmap e51: 7 total, 7 up, 7 in 2024-03-30T13:35:22.087 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:35:21 smithi099 ceph-mon[29691]: osdmap e51: 7 total, 7 up, 7 in 2024-03-30T13:35:22.771 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:35:22 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[25141]: 172.21.15.99 - - [30/Mar/2024:13:35:22] "POST /data HTTP/1.1" 200 46 "" "Python-urllib/3.9" 2024-03-30T13:35:23.756 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:35:23 smithi181 ceph-mon[25762]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 41 MiB used, 626 GiB / 626 GiB avail; 119 KiB/s, 0 objects/s recovering 2024-03-30T13:35:23.756 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:35:23 smithi181 ceph-mon[25762]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' 2024-03-30T13:35:23.756 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:35:23 smithi181 ceph-mon[25762]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' 2024-03-30T13:35:23.823 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:35:23 smithi099 ceph-mon[24912]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 41 MiB used, 626 GiB / 626 GiB avail; 119 KiB/s, 0 objects/s recovering 2024-03-30T13:35:23.823 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:35:23 smithi099 ceph-mon[24912]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' 2024-03-30T13:35:23.823 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:35:23 smithi099 ceph-mon[24912]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' 2024-03-30T13:35:23.823 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:35:23 smithi099 ceph-mon[29691]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 41 MiB used, 626 GiB / 626 GiB avail; 119 KiB/s, 0 objects/s recovering 2024-03-30T13:35:23.823 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:35:23 smithi099 ceph-mon[29691]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' 2024-03-30T13:35:23.823 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:35:23 smithi099 ceph-mon[29691]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' 2024-03-30T13:35:24.837 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:35:24 smithi099 ceph-mon[24912]: from='client.? 172.21.15.181:0/801597702' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "165196c5-8792-4379-87ba-bb9917938028"}]: dispatch 2024-03-30T13:35:24.837 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:35:24 smithi099 ceph-mon[24912]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "165196c5-8792-4379-87ba-bb9917938028"}]: dispatch 2024-03-30T13:35:24.837 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:35:24 smithi099 ceph-mon[24912]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "165196c5-8792-4379-87ba-bb9917938028"}]': finished 2024-03-30T13:35:24.837 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:35:24 smithi099 ceph-mon[24912]: osdmap e52: 8 total, 7 up, 8 in 2024-03-30T13:35:24.837 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:35:24 smithi099 ceph-mon[24912]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-03-30T13:35:24.837 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:35:24 smithi099 ceph-mon[24912]: from='client.? 172.21.15.181:0/815957714' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-03-30T13:35:24.837 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:35:24 smithi099 ceph-mon[29691]: from='client.? 172.21.15.181:0/801597702' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "165196c5-8792-4379-87ba-bb9917938028"}]: dispatch 2024-03-30T13:35:24.837 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:35:24 smithi099 ceph-mon[29691]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "165196c5-8792-4379-87ba-bb9917938028"}]: dispatch 2024-03-30T13:35:24.838 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:35:24 smithi099 ceph-mon[29691]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "165196c5-8792-4379-87ba-bb9917938028"}]': finished 2024-03-30T13:35:24.838 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:35:24 smithi099 ceph-mon[29691]: osdmap e52: 8 total, 7 up, 8 in 2024-03-30T13:35:24.838 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:35:24 smithi099 ceph-mon[29691]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-03-30T13:35:24.838 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:35:24 smithi099 ceph-mon[29691]: from='client.? 172.21.15.181:0/815957714' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-03-30T13:35:25.005 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:35:24 smithi181 ceph-mon[25762]: from='client.? 172.21.15.181:0/801597702' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "165196c5-8792-4379-87ba-bb9917938028"}]: dispatch 2024-03-30T13:35:25.006 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:35:24 smithi181 ceph-mon[25762]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "165196c5-8792-4379-87ba-bb9917938028"}]: dispatch 2024-03-30T13:35:25.006 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:35:24 smithi181 ceph-mon[25762]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "165196c5-8792-4379-87ba-bb9917938028"}]': finished 2024-03-30T13:35:25.006 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:35:24 smithi181 ceph-mon[25762]: osdmap e52: 8 total, 7 up, 8 in 2024-03-30T13:35:25.006 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:35:24 smithi181 ceph-mon[25762]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-03-30T13:35:25.006 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:35:24 smithi181 ceph-mon[25762]: from='client.? 172.21.15.181:0/815957714' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-03-30T13:35:25.837 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:35:25 smithi099 ceph-mon[24912]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 41 MiB used, 626 GiB / 626 GiB avail; 97 KiB/s, 0 objects/s recovering 2024-03-30T13:35:25.837 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:35:25 smithi099 ceph-mon[29691]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 41 MiB used, 626 GiB / 626 GiB avail; 97 KiB/s, 0 objects/s recovering 2024-03-30T13:35:26.005 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:35:25 smithi181 ceph-mon[25762]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 41 MiB used, 626 GiB / 626 GiB avail; 97 KiB/s, 0 objects/s recovering 2024-03-30T13:35:27.837 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:35:27 smithi099 ceph-mon[24912]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 41 MiB used, 626 GiB / 626 GiB avail; 82 KiB/s, 0 objects/s recovering 2024-03-30T13:35:27.837 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:35:27 smithi099 ceph-mon[29691]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 41 MiB used, 626 GiB / 626 GiB avail; 82 KiB/s, 0 objects/s recovering 2024-03-30T13:35:28.006 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:35:27 smithi181 ceph-mon[25762]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 41 MiB used, 626 GiB / 626 GiB avail; 82 KiB/s, 0 objects/s recovering 2024-03-30T13:35:29.837 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:35:29 smithi099 ceph-mon[24912]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 41 MiB used, 626 GiB / 626 GiB avail; 65 KiB/s, 0 objects/s recovering 2024-03-30T13:35:29.837 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:35:29 smithi099 ceph-mon[29691]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 41 MiB used, 626 GiB / 626 GiB avail; 65 KiB/s, 0 objects/s recovering 2024-03-30T13:35:29.956 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:35:29 smithi181 ceph-mon[25762]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 41 MiB used, 626 GiB / 626 GiB avail; 65 KiB/s, 0 objects/s recovering 2024-03-30T13:35:30.837 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:35:30 smithi099 ceph-mon[24912]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2024-03-30T13:35:30.837 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:35:30 smithi099 ceph-mon[24912]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:35:30.837 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:35:30 smithi099 ceph-mon[29691]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2024-03-30T13:35:30.837 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:35:30 smithi099 ceph-mon[29691]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:35:30.881 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:35:30 smithi181 ceph-mon[25762]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2024-03-30T13:35:30.881 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:35:30 smithi181 ceph-mon[25762]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:35:31.747 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:35:31 smithi181 ceph-mon[25762]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 41 MiB used, 626 GiB / 626 GiB avail; 55 KiB/s, 0 objects/s recovering 2024-03-30T13:35:31.747 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:35:31 smithi181 ceph-mon[25762]: Deploying daemon osd.7 on smithi181 2024-03-30T13:35:31.837 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:35:31 smithi099 ceph-mon[24912]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 41 MiB used, 626 GiB / 626 GiB avail; 55 KiB/s, 0 objects/s recovering 2024-03-30T13:35:31.837 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:35:31 smithi099 ceph-mon[24912]: Deploying daemon osd.7 on smithi181 2024-03-30T13:35:31.837 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:35:31 smithi099 ceph-mon[29691]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 41 MiB used, 626 GiB / 626 GiB avail; 55 KiB/s, 0 objects/s recovering 2024-03-30T13:35:31.837 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:35:31 smithi099 ceph-mon[29691]: Deploying daemon osd.7 on smithi181 2024-03-30T13:35:32.694 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:35:32 smithi181 ceph-mon[25762]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-03-30T13:35:32.695 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:35:32 smithi181 ceph-mon[25762]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-03-30T13:35:32.837 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:35:32 smithi099 ceph-mon[24912]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-03-30T13:35:32.837 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:35:32 smithi099 ceph-mon[24912]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-03-30T13:35:32.837 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:35:32 smithi099 ceph-mon[29691]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-03-30T13:35:32.837 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:35:32 smithi099 ceph-mon[29691]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-03-30T13:35:33.692 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:35:33 smithi181 ceph-mon[25762]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 41 MiB used, 626 GiB / 626 GiB avail 2024-03-30T13:35:33.837 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:35:33 smithi099 ceph-mon[24912]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 41 MiB used, 626 GiB / 626 GiB avail 2024-03-30T13:35:33.837 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:35:33 smithi099 ceph-mon[29691]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 41 MiB used, 626 GiB / 626 GiB avail 2024-03-30T13:35:35.586 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:35:35 smithi099 ceph-mon[24912]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 41 MiB used, 626 GiB / 626 GiB avail 2024-03-30T13:35:35.587 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:35:35 smithi099 ceph-mon[29691]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 41 MiB used, 626 GiB / 626 GiB avail 2024-03-30T13:35:35.601 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:35:35 smithi181 ceph-mon[25762]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 41 MiB used, 626 GiB / 626 GiB avail 2024-03-30T13:35:36.854 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:35:36 smithi181 ceph-mon[25762]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' 2024-03-30T13:35:36.854 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:35:36 smithi181 ceph-mon[25762]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:35:36.854 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:35:36 smithi181 ceph-mon[25762]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:35:36.854 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:35:36 smithi181 ceph-mon[25762]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:35:36.854 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:35:36 smithi181 ceph-mon[25762]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' 2024-03-30T13:35:36.854 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:35:36 smithi181 ceph-mon[25762]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 41 MiB used, 626 GiB / 626 GiB avail 2024-03-30T13:35:37.087 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:35:36 smithi099 ceph-mon[24912]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' 2024-03-30T13:35:37.087 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:35:36 smithi099 ceph-mon[24912]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:35:37.087 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:35:36 smithi099 ceph-mon[24912]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:35:37.087 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:35:36 smithi099 ceph-mon[24912]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:35:37.087 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:35:36 smithi099 ceph-mon[24912]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' 2024-03-30T13:35:37.087 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:35:36 smithi099 ceph-mon[24912]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 41 MiB used, 626 GiB / 626 GiB avail 2024-03-30T13:35:37.088 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:35:36 smithi099 ceph-mon[29691]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' 2024-03-30T13:35:37.088 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:35:36 smithi099 ceph-mon[29691]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:35:37.088 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:35:36 smithi099 ceph-mon[29691]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:35:37.088 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:35:36 smithi099 ceph-mon[29691]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:35:37.088 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:35:36 smithi099 ceph-mon[29691]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' 2024-03-30T13:35:37.088 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:35:36 smithi099 ceph-mon[29691]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 41 MiB used, 626 GiB / 626 GiB avail 2024-03-30T13:35:38.337 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:35:37 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[25141]: 172.21.15.181 - - [30/Mar/2024:13:35:37] "POST /data HTTP/1.1" 200 46 "" "Python-urllib/3.9" 2024-03-30T13:35:39.006 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:35:38 smithi181 ceph-mon[25762]: pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 41 MiB used, 626 GiB / 626 GiB avail 2024-03-30T13:35:39.006 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:35:38 smithi181 ceph-mon[25762]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' 2024-03-30T13:35:39.006 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:35:38 smithi181 ceph-mon[25762]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' 2024-03-30T13:35:39.006 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:35:38 smithi181 ceph-mon[25762]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:35:39.006 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:35:38 smithi181 ceph-mon[25762]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:35:39.007 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:35:38 smithi181 ceph-mon[25762]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:35:39.007 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:35:38 smithi181 ceph-mon[25762]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' 2024-03-30T13:35:39.007 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:35:38 smithi181 ceph-mon[25762]: from='osd.7 [v2:172.21.15.181:6824/1455575993,v1:172.21.15.181:6825/1455575993]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-03-30T13:35:39.007 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:35:38 smithi181 ceph-mon[25762]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-03-30T13:35:39.203 INFO:teuthology.orchestra.run.smithi181.stdout:Created osd(s) 7 on host 'smithi181' 2024-03-30T13:35:39.320 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:35:38 smithi099 ceph-mon[29691]: pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 41 MiB used, 626 GiB / 626 GiB avail 2024-03-30T13:35:39.320 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:35:38 smithi099 ceph-mon[29691]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' 2024-03-30T13:35:39.320 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:35:38 smithi099 ceph-mon[29691]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' 2024-03-30T13:35:39.320 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:35:38 smithi099 ceph-mon[29691]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:35:39.320 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:35:38 smithi099 ceph-mon[29691]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:35:39.320 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:35:38 smithi099 ceph-mon[29691]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:35:39.320 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:35:38 smithi099 ceph-mon[29691]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' 2024-03-30T13:35:39.320 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:35:38 smithi099 ceph-mon[29691]: from='osd.7 [v2:172.21.15.181:6824/1455575993,v1:172.21.15.181:6825/1455575993]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-03-30T13:35:39.321 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:35:38 smithi099 ceph-mon[29691]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-03-30T13:35:39.321 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:35:38 smithi099 ceph-mon[24912]: pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 41 MiB used, 626 GiB / 626 GiB avail 2024-03-30T13:35:39.321 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:35:38 smithi099 ceph-mon[24912]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' 2024-03-30T13:35:39.321 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:35:38 smithi099 ceph-mon[24912]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' 2024-03-30T13:35:39.321 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:35:38 smithi099 ceph-mon[24912]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:35:39.321 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:35:38 smithi099 ceph-mon[24912]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:35:39.321 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:35:38 smithi099 ceph-mon[24912]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:35:39.321 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:35:38 smithi099 ceph-mon[24912]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' 2024-03-30T13:35:39.321 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:35:38 smithi099 ceph-mon[24912]: from='osd.7 [v2:172.21.15.181:6824/1455575993,v1:172.21.15.181:6825/1455575993]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-03-30T13:35:39.321 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:35:38 smithi099 ceph-mon[24912]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-03-30T13:35:39.587 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:35:39 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[25141]: 172.21.15.181 - - [30/Mar/2024:13:35:39] "POST /data HTTP/1.1" 200 46 "" "Python-urllib/3.9" 2024-03-30T13:35:39.845 DEBUG:teuthology.orchestra.run.smithi181:osd.7> sudo journalctl -f -n 0 -u ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4@osd.7.service 2024-03-30T13:35:39.847 INFO:tasks.cephadm:Waiting for 8 OSDs to come up... 2024-03-30T13:35:39.847 DEBUG:teuthology.orchestra.run.smithi099:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 98ebaeb8-ee99-11ee-b647-cb9ed24678a4 -- ceph osd stat -f json 2024-03-30T13:35:40.475 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:35:40 smithi099 ceph-mon[24912]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' 2024-03-30T13:35:40.475 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:35:40 smithi099 ceph-mon[24912]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:35:40.475 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:35:40 smithi099 ceph-mon[24912]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:35:40.475 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:35:40 smithi099 ceph-mon[24912]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:35:40.475 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:35:40 smithi099 ceph-mon[24912]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' 2024-03-30T13:35:40.476 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:35:40 smithi099 ceph-mon[24912]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' 2024-03-30T13:35:40.476 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:35:40 smithi099 ceph-mon[24912]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' 2024-03-30T13:35:40.476 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:35:40 smithi099 ceph-mon[24912]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:35:40.476 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:35:40 smithi099 ceph-mon[24912]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:35:40.476 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:35:40 smithi099 ceph-mon[24912]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:35:40.476 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:35:40 smithi099 ceph-mon[24912]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' 2024-03-30T13:35:40.476 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:35:40 smithi099 ceph-mon[24912]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-03-30T13:35:40.476 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:35:40 smithi099 ceph-mon[24912]: osdmap e53: 8 total, 7 up, 8 in 2024-03-30T13:35:40.476 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:35:40 smithi099 ceph-mon[24912]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-03-30T13:35:40.476 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:35:40 smithi099 ceph-mon[24912]: from='osd.7 [v2:172.21.15.181:6824/1455575993,v1:172.21.15.181:6825/1455575993]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi181", "root=default"]}]: dispatch 2024-03-30T13:35:40.476 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:35:40 smithi099 ceph-mon[24912]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi181", "root=default"]}]: dispatch 2024-03-30T13:35:40.476 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:35:40 smithi099 ceph-mon[29691]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' 2024-03-30T13:35:40.477 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:35:40 smithi099 ceph-mon[29691]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:35:40.477 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:35:40 smithi099 ceph-mon[29691]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:35:40.477 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:35:40 smithi099 ceph-mon[29691]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:35:40.477 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:35:40 smithi099 ceph-mon[29691]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' 2024-03-30T13:35:40.477 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:35:40 smithi099 ceph-mon[29691]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' 2024-03-30T13:35:40.477 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:35:40 smithi099 ceph-mon[29691]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' 2024-03-30T13:35:40.477 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:35:40 smithi099 ceph-mon[29691]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:35:40.477 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:35:40 smithi099 ceph-mon[29691]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:35:40.477 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:35:40 smithi099 ceph-mon[29691]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:35:40.477 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:35:40 smithi099 ceph-mon[29691]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' 2024-03-30T13:35:40.477 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:35:40 smithi099 ceph-mon[29691]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-03-30T13:35:40.477 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:35:40 smithi099 ceph-mon[29691]: osdmap e53: 8 total, 7 up, 8 in 2024-03-30T13:35:40.477 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:35:40 smithi099 ceph-mon[29691]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-03-30T13:35:40.477 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:35:40 smithi099 ceph-mon[29691]: from='osd.7 [v2:172.21.15.181:6824/1455575993,v1:172.21.15.181:6825/1455575993]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi181", "root=default"]}]: dispatch 2024-03-30T13:35:40.477 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:35:40 smithi099 ceph-mon[29691]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi181", "root=default"]}]: dispatch 2024-03-30T13:35:40.501 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:35:40 smithi181 ceph-mon[25762]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' 2024-03-30T13:35:40.501 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:35:40 smithi181 ceph-mon[25762]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:35:40.501 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:35:40 smithi181 ceph-mon[25762]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:35:40.501 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:35:40 smithi181 ceph-mon[25762]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:35:40.501 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:35:40 smithi181 ceph-mon[25762]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' 2024-03-30T13:35:40.501 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:35:40 smithi181 ceph-mon[25762]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' 2024-03-30T13:35:40.501 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:35:40 smithi181 ceph-mon[25762]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' 2024-03-30T13:35:40.501 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:35:40 smithi181 ceph-mon[25762]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:35:40.501 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:35:40 smithi181 ceph-mon[25762]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:35:40.501 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:35:40 smithi181 ceph-mon[25762]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:35:40.501 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:35:40 smithi181 ceph-mon[25762]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' 2024-03-30T13:35:40.501 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:35:40 smithi181 ceph-mon[25762]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-03-30T13:35:40.501 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:35:40 smithi181 ceph-mon[25762]: osdmap e53: 8 total, 7 up, 8 in 2024-03-30T13:35:40.502 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:35:40 smithi181 ceph-mon[25762]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-03-30T13:35:40.502 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:35:40 smithi181 ceph-mon[25762]: from='osd.7 [v2:172.21.15.181:6824/1455575993,v1:172.21.15.181:6825/1455575993]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi181", "root=default"]}]: dispatch 2024-03-30T13:35:40.502 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:35:40 smithi181 ceph-mon[25762]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi181", "root=default"]}]: dispatch 2024-03-30T13:35:40.756 INFO:journalctl@ceph.osd.7.smithi181.stdout:Mar 30 13:35:40 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-7[39311]: 2024-03-30T13:35:40.553+0000 7f77cd4ab700 -1 osd.7 0 waiting for initial osdmap 2024-03-30T13:35:40.756 INFO:journalctl@ceph.osd.7.smithi181.stdout:Mar 30 13:35:40 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-7[39311]: 2024-03-30T13:35:40.560+0000 7f77c6e40700 -1 osd.7 54 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-03-30T13:35:41.835 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-03-30T13:35:41.835 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:35:41 smithi099 ceph-mon[24912]: pgmap v170: 1 pgs: 1 active+clean; 577 KiB data, 41 MiB used, 626 GiB / 626 GiB avail 2024-03-30T13:35:41.835 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:35:41 smithi099 ceph-mon[24912]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi181", "root=default"]}]': finished 2024-03-30T13:35:41.835 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:35:41 smithi099 ceph-mon[24912]: osdmap e54: 8 total, 7 up, 8 in 2024-03-30T13:35:41.835 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:35:41 smithi099 ceph-mon[24912]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-03-30T13:35:41.835 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:35:41 smithi099 ceph-mon[24912]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-03-30T13:35:41.836 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:35:41 smithi099 ceph-mon[29691]: pgmap v170: 1 pgs: 1 active+clean; 577 KiB data, 41 MiB used, 626 GiB / 626 GiB avail 2024-03-30T13:35:41.836 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:35:41 smithi099 ceph-mon[29691]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi181", "root=default"]}]': finished 2024-03-30T13:35:41.836 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:35:41 smithi099 ceph-mon[29691]: osdmap e54: 8 total, 7 up, 8 in 2024-03-30T13:35:41.836 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:35:41 smithi099 ceph-mon[29691]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-03-30T13:35:41.836 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:35:41 smithi099 ceph-mon[29691]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-03-30T13:35:41.847 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:35:41 smithi181 ceph-mon[25762]: pgmap v170: 1 pgs: 1 active+clean; 577 KiB data, 41 MiB used, 626 GiB / 626 GiB avail 2024-03-30T13:35:41.847 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:35:41 smithi181 ceph-mon[25762]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi181", "root=default"]}]': finished 2024-03-30T13:35:41.847 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:35:41 smithi181 ceph-mon[25762]: osdmap e54: 8 total, 7 up, 8 in 2024-03-30T13:35:41.847 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:35:41 smithi181 ceph-mon[25762]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-03-30T13:35:41.848 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:35:41 smithi181 ceph-mon[25762]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-03-30T13:35:42.495 INFO:teuthology.orchestra.run.smithi099.stdout:{"epoch":55,"num_osds":8,"num_up_osds":8,"osd_up_since":1711805741,"num_in_osds":8,"osd_in_since":1711805723,"num_remapped_pgs":1} 2024-03-30T13:35:42.495 DEBUG:teuthology.orchestra.run.smithi099:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell --fsid 98ebaeb8-ee99-11ee-b647-cb9ed24678a4 -- ceph osd dump --format=json 2024-03-30T13:35:42.716 INFO:teuthology.orchestra.run.smithi099.stderr:Inferring config /var/lib/ceph/98ebaeb8-ee99-11ee-b647-cb9ed24678a4/mon.a/config 2024-03-30T13:35:42.837 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:35:42 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[25141]: 172.21.15.99 - - [30/Mar/2024:13:35:42] "POST /data HTTP/1.1" 200 46 "" "Python-urllib/3.9" 2024-03-30T13:35:42.837 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:35:42 smithi099 ceph-mon[24912]: purged_snaps scrub starts 2024-03-30T13:35:42.837 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:35:42 smithi099 ceph-mon[24912]: purged_snaps scrub ok 2024-03-30T13:35:42.837 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:35:42 smithi099 ceph-mon[24912]: osd.7 [v2:172.21.15.181:6824/1455575993,v1:172.21.15.181:6825/1455575993] boot 2024-03-30T13:35:42.837 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:35:42 smithi099 ceph-mon[24912]: osdmap e55: 8 total, 8 up, 8 in 2024-03-30T13:35:42.837 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:35:42 smithi099 ceph-mon[24912]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-03-30T13:35:42.837 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:35:42 smithi099 ceph-mon[24912]: from='client.? 172.21.15.99:0/2968696592' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-03-30T13:35:42.837 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:35:42 smithi099 ceph-mon[24912]: osdmap e56: 8 total, 8 up, 8 in 2024-03-30T13:35:42.838 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:35:42 smithi099 ceph-mon[29691]: purged_snaps scrub starts 2024-03-30T13:35:42.838 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:35:42 smithi099 ceph-mon[29691]: purged_snaps scrub ok 2024-03-30T13:35:42.838 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:35:42 smithi099 ceph-mon[29691]: osd.7 [v2:172.21.15.181:6824/1455575993,v1:172.21.15.181:6825/1455575993] boot 2024-03-30T13:35:42.838 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:35:42 smithi099 ceph-mon[29691]: osdmap e55: 8 total, 8 up, 8 in 2024-03-30T13:35:42.838 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:35:42 smithi099 ceph-mon[29691]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-03-30T13:35:42.838 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:35:42 smithi099 ceph-mon[29691]: from='client.? 172.21.15.99:0/2968696592' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-03-30T13:35:42.838 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:35:42 smithi099 ceph-mon[29691]: osdmap e56: 8 total, 8 up, 8 in 2024-03-30T13:35:43.006 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:35:42 smithi181 ceph-mon[25762]: purged_snaps scrub starts 2024-03-30T13:35:43.006 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:35:42 smithi181 ceph-mon[25762]: purged_snaps scrub ok 2024-03-30T13:35:43.006 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:35:42 smithi181 ceph-mon[25762]: osd.7 [v2:172.21.15.181:6824/1455575993,v1:172.21.15.181:6825/1455575993] boot 2024-03-30T13:35:43.006 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:35:42 smithi181 ceph-mon[25762]: osdmap e55: 8 total, 8 up, 8 in 2024-03-30T13:35:43.006 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:35:42 smithi181 ceph-mon[25762]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-03-30T13:35:43.006 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:35:42 smithi181 ceph-mon[25762]: from='client.? 172.21.15.99:0/2968696592' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-03-30T13:35:43.006 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:35:42 smithi181 ceph-mon[25762]: osdmap e56: 8 total, 8 up, 8 in 2024-03-30T13:35:43.819 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:35:43 smithi099 ceph-mon[24912]: pgmap v173: 1 pgs: 1 peering; 577 KiB data, 47 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:35:43.819 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:35:43 smithi099 ceph-mon[24912]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' 2024-03-30T13:35:43.820 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:35:43 smithi099 ceph-mon[24912]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' 2024-03-30T13:35:43.820 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:35:43 smithi099 ceph-mon[24912]: osdmap e57: 8 total, 8 up, 8 in 2024-03-30T13:35:43.820 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:35:43 smithi099 ceph-mon[29691]: pgmap v173: 1 pgs: 1 peering; 577 KiB data, 47 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:35:43.820 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:35:43 smithi099 ceph-mon[29691]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' 2024-03-30T13:35:43.820 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:35:43 smithi099 ceph-mon[29691]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' 2024-03-30T13:35:43.820 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:35:43 smithi099 ceph-mon[29691]: osdmap e57: 8 total, 8 up, 8 in 2024-03-30T13:35:44.006 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:35:43 smithi181 ceph-mon[25762]: pgmap v173: 1 pgs: 1 peering; 577 KiB data, 47 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:35:44.006 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:35:43 smithi181 ceph-mon[25762]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' 2024-03-30T13:35:44.006 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:35:43 smithi181 ceph-mon[25762]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' 2024-03-30T13:35:44.006 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:35:43 smithi181 ceph-mon[25762]: osdmap e57: 8 total, 8 up, 8 in 2024-03-30T13:35:45.837 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:35:45 smithi099 ceph-mon[24912]: pgmap v176: 1 pgs: 1 peering; 577 KiB data, 47 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:35:45.837 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:35:45 smithi099 ceph-mon[24912]: osdmap e58: 8 total, 8 up, 8 in 2024-03-30T13:35:45.837 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:35:45 smithi099 ceph-mon[29691]: pgmap v176: 1 pgs: 1 peering; 577 KiB data, 47 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:35:45.837 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:35:45 smithi099 ceph-mon[29691]: osdmap e58: 8 total, 8 up, 8 in 2024-03-30T13:35:46.006 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:35:45 smithi181 ceph-mon[25762]: pgmap v176: 1 pgs: 1 peering; 577 KiB data, 47 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:35:46.006 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:35:45 smithi181 ceph-mon[25762]: osdmap e58: 8 total, 8 up, 8 in 2024-03-30T13:35:46.182 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-03-30T13:35:46.182 INFO:teuthology.orchestra.run.smithi099.stdout:{"epoch":59,"fsid":"98ebaeb8-ee99-11ee-b647-cb9ed24678a4","created":"2024-03-30T13:30:46.740035+0000","modified":"2024-03-30T13:35:45.578532+0000","last_up_change":"2024-03-30T13:35:41.547669+0000","last_in_change":"2024-03-30T13:35:23.656525+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":18,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-30T13:33:44.717293+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"c684cee9-dc80-4a4a-8db8-8553daf0cc4f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6802","nonce":558005496},{"type":"v1","addr":"172.21.15.99:6803","nonce":558005496}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6804","nonce":558005496},{"type":"v1","addr":"172.21.15.99:6805","nonce":558005496}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6808","nonce":558005496},{"type":"v1","addr":"172.21.15.99:6809","nonce":558005496}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6806","nonce":558005496},{"type":"v1","addr":"172.21.15.99:6807","nonce":558005496}]},"public_addr":"172.21.15.99:6803/558005496","cluster_addr":"172.21.15.99:6805/558005496","heartbeat_back_addr":"172.21.15.99:6809/558005496","heartbeat_front_addr":"172.21.15.99:6807/558005496","state":["exists","up"]},{"osd":1,"uuid":"41383fae-9172-4ba2-8a94-85a125de98e2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6810","nonce":2317835991},{"type":"v1","addr":"172.21.15.99:6811","nonce":2317835991}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6812","nonce":2317835991},{"type":"v1","addr":"172.21.15.99:6813","nonce":2317835991}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6816","nonce":2317835991},{"type":"v1","addr":"172.21.15.99:6817","nonce":2317835991}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6814","nonce":2317835991},{"type":"v1","addr":"172.21.15.99:6815","nonce":2317835991}]},"public_addr":"172.21.15.99:6811/2317835991","cluster_addr":"172.21.15.99:6813/2317835991","heartbeat_back_addr":"172.21.15.99:6817/2317835991","heartbeat_front_addr":"172.21.15.99:6815/2317835991","state":["exists","up"]},{"osd":2,"uuid":"c7ec9bfb-f6a2-444d-a004-391f602f07ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6818","nonce":770589655},{"type":"v1","addr":"172.21.15.99:6819","nonce":770589655}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6820","nonce":770589655},{"type":"v1","addr":"172.21.15.99:6821","nonce":770589655}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6824","nonce":770589655},{"type":"v1","addr":"172.21.15.99:6825","nonce":770589655}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6822","nonce":770589655},{"type":"v1","addr":"172.21.15.99:6823","nonce":770589655}]},"public_addr":"172.21.15.99:6819/770589655","cluster_addr":"172.21.15.99:6821/770589655","heartbeat_back_addr":"172.21.15.99:6825/770589655","heartbeat_front_addr":"172.21.15.99:6823/770589655","state":["exists","up"]},{"osd":3,"uuid":"ed272b2b-e9e4-42f7-bf4b-12b5c3d7b90e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6826","nonce":2046550873},{"type":"v1","addr":"172.21.15.99:6827","nonce":2046550873}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6828","nonce":2046550873},{"type":"v1","addr":"172.21.15.99:6829","nonce":2046550873}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6832","nonce":2046550873},{"type":"v1","addr":"172.21.15.99:6833","nonce":2046550873}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6830","nonce":2046550873},{"type":"v1","addr":"172.21.15.99:6831","nonce":2046550873}]},"public_addr":"172.21.15.99:6827/2046550873","cluster_addr":"172.21.15.99:6829/2046550873","heartbeat_back_addr":"172.21.15.99:6833/2046550873","heartbeat_front_addr":"172.21.15.99:6831/2046550873","state":["exists","up"]},{"osd":4,"uuid":"cfa9365d-3adb-4f07-94a0-1ae739a22d74","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6800","nonce":2876720616},{"type":"v1","addr":"172.21.15.181:6801","nonce":2876720616}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6802","nonce":2876720616},{"type":"v1","addr":"172.21.15.181:6803","nonce":2876720616}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6806","nonce":2876720616},{"type":"v1","addr":"172.21.15.181:6807","nonce":2876720616}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6804","nonce":2876720616},{"type":"v1","addr":"172.21.15.181:6805","nonce":2876720616}]},"public_addr":"172.21.15.181:6801/2876720616","cluster_addr":"172.21.15.181:6803/2876720616","heartbeat_back_addr":"172.21.15.181:6807/2876720616","heartbeat_front_addr":"172.21.15.181:6805/2876720616","state":["exists","up"]},{"osd":5,"uuid":"7c7289ba-f1a8-4b64-99d4-e42343eb5f49","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6808","nonce":1648947487},{"type":"v1","addr":"172.21.15.181:6809","nonce":1648947487}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6810","nonce":1648947487},{"type":"v1","addr":"172.21.15.181:6811","nonce":1648947487}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6814","nonce":1648947487},{"type":"v1","addr":"172.21.15.181:6815","nonce":1648947487}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6812","nonce":1648947487},{"type":"v1","addr":"172.21.15.181:6813","nonce":1648947487}]},"public_addr":"172.21.15.181:6809/1648947487","cluster_addr":"172.21.15.181:6811/1648947487","heartbeat_back_addr":"172.21.15.181:6815/1648947487","heartbeat_front_addr":"172.21.15.181:6813/1648947487","state":["exists","up"]},{"osd":6,"uuid":"eee64a05-4d3a-4ba4-b1d2-43a9aeec31ed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6816","nonce":4097845576},{"type":"v1","addr":"172.21.15.181:6817","nonce":4097845576}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6818","nonce":4097845576},{"type":"v1","addr":"172.21.15.181:6819","nonce":4097845576}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6822","nonce":4097845576},{"type":"v1","addr":"172.21.15.181:6823","nonce":4097845576}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6820","nonce":4097845576},{"type":"v1","addr":"172.21.15.181:6821","nonce":4097845576}]},"public_addr":"172.21.15.181:6817/4097845576","cluster_addr":"172.21.15.181:6819/4097845576","heartbeat_back_addr":"172.21.15.181:6823/4097845576","heartbeat_front_addr":"172.21.15.181:6821/4097845576","state":["exists","up"]},{"osd":7,"uuid":"165196c5-8792-4379-87ba-bb9917938028","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":55,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6824","nonce":1455575993},{"type":"v1","addr":"172.21.15.181:6825","nonce":1455575993}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6826","nonce":1455575993},{"type":"v1","addr":"172.21.15.181:6827","nonce":1455575993}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6830","nonce":1455575993},{"type":"v1","addr":"172.21.15.181:6831","nonce":1455575993}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6828","nonce":1455575993},{"type":"v1","addr":"172.21.15.181:6829","nonce":1455575993}]},"public_addr":"172.21.15.181:6825/1455575993","cluster_addr":"172.21.15.181:6827/1455575993","heartbeat_back_addr":"172.21.15.181:6831/1455575993","heartbeat_front_addr":"172.21.15.181:6829/1455575993","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:32:53.321390+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:33:16.239976+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:33:40.545655+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:34:04.901544+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:34:27.871028+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:34:50.499151+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:35:14.795730+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:35:39.703762+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.99:0/1283915670":"2024-03-31T13:31:32.352898+0000","172.21.15.99:6800/639013456":"2024-03-31T13:31:32.352898+0000","172.21.15.99:6801/639013456":"2024-03-31T13:31:32.352898+0000","172.21.15.99:0/2902659920":"2024-03-31T13:31:32.352898+0000","172.21.15.99:0/3964022543":"2024-03-31T13:31:32.352898+0000","172.21.15.99:0/3234417163":"2024-03-31T13:31:10.668046+0000","172.21.15.99:0/3448119368":"2024-03-31T13:31:10.668046+0000","172.21.15.99:6800/4092149076":"2024-03-31T13:31:10.668046+0000","172.21.15.99:0/2799400391":"2024-03-31T13:31:10.668046+0000","172.21.15.99:6801/4092149076":"2024-03-31T13:31:10.668046+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-30T13:35:46.905 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:35:46 smithi099 ceph-mon[24912]: osdmap e59: 8 total, 8 up, 8 in 2024-03-30T13:35:46.905 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:35:46 smithi099 ceph-mon[24912]: from='client.? 172.21.15.99:0/1670584865' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-30T13:35:46.906 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:35:46 smithi099 ceph-mon[29691]: osdmap e59: 8 total, 8 up, 8 in 2024-03-30T13:35:46.906 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:35:46 smithi099 ceph-mon[29691]: from='client.? 172.21.15.99:0/1670584865' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-30T13:35:46.929 INFO:tasks.cephadm.ceph_manager.ceph:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-30T13:33:44.717293+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}] 2024-03-30T13:35:46.929 DEBUG:teuthology.orchestra.run.smithi099:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell --fsid 98ebaeb8-ee99-11ee-b647-cb9ed24678a4 -- ceph osd pool get .mgr pg_num 2024-03-30T13:35:47.006 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:35:46 smithi181 ceph-mon[25762]: osdmap e59: 8 total, 8 up, 8 in 2024-03-30T13:35:47.006 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:35:46 smithi181 ceph-mon[25762]: from='client.? 172.21.15.99:0/1670584865' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-30T13:35:47.576 INFO:teuthology.orchestra.run.smithi099.stderr:Inferring config /var/lib/ceph/98ebaeb8-ee99-11ee-b647-cb9ed24678a4/mon.a/config 2024-03-30T13:35:47.820 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:35:47 smithi099 ceph-mon[24912]: pgmap v179: 1 pgs: 1 peering; 577 KiB data, 47 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:35:47.821 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:35:47 smithi099 ceph-mon[29691]: pgmap v179: 1 pgs: 1 peering; 577 KiB data, 47 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:35:48.006 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:35:47 smithi181 ceph-mon[25762]: pgmap v179: 1 pgs: 1 peering; 577 KiB data, 47 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:35:49.326 INFO:teuthology.orchestra.run.smithi099.stdout:pg_num: 1 2024-03-30T13:35:50.006 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:35:49 smithi181 ceph-mon[25762]: pgmap v180: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-03-30T13:35:50.006 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:35:49 smithi181 ceph-mon[25762]: from='client.? 172.21.15.99:0/3550461376' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-03-30T13:35:50.007 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:35:49 smithi099 ceph-mon[24912]: pgmap v180: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-03-30T13:35:50.007 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:35:49 smithi099 ceph-mon[24912]: from='client.? 172.21.15.99:0/3550461376' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-03-30T13:35:50.007 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:35:49 smithi099 ceph-mon[29691]: pgmap v180: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-03-30T13:35:50.007 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:35:49 smithi099 ceph-mon[29691]: from='client.? 172.21.15.99:0/3550461376' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-03-30T13:35:50.032 INFO:tasks.cephadm:Adding prometheus.a on smithi181 2024-03-30T13:35:50.033 DEBUG:teuthology.orchestra.run.smithi181:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 98ebaeb8-ee99-11ee-b647-cb9ed24678a4 -- ceph orch apply prometheus '1;smithi181=a' 2024-03-30T13:35:51.006 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:35:50 smithi181 ceph-mon[25762]: pgmap v181: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail; 81 KiB/s, 0 objects/s recovering 2024-03-30T13:35:51.087 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:35:50 smithi099 ceph-mon[24912]: pgmap v181: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail; 81 KiB/s, 0 objects/s recovering 2024-03-30T13:35:51.087 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:35:50 smithi099 ceph-mon[29691]: pgmap v181: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail; 81 KiB/s, 0 objects/s recovering 2024-03-30T13:35:51.906 INFO:teuthology.orchestra.run.smithi181.stdout:Scheduled prometheus update... 2024-03-30T13:35:52.559 DEBUG:teuthology.orchestra.run.smithi181:prometheus.a> sudo journalctl -f -n 0 -u ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4@prometheus.a.service 2024-03-30T13:35:52.561 INFO:tasks.cephadm:Adding node-exporter.a on smithi099 2024-03-30T13:35:52.561 INFO:tasks.cephadm:Adding node-exporter.b on smithi181 2024-03-30T13:35:52.561 DEBUG:teuthology.orchestra.run.smithi181:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 98ebaeb8-ee99-11ee-b647-cb9ed24678a4 -- ceph orch apply node-exporter '2;smithi099=a;smithi181=b' 2024-03-30T13:35:53.205 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 13:35:53 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-x[27332]: ignoring --setuser ceph since I am not root 2024-03-30T13:35:53.205 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 13:35:53 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-x[27332]: ignoring --setgroup ceph since I am not root 2024-03-30T13:35:53.205 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 13:35:53 smithi181 ceph-mgr[27336]: -- 172.21.15.181:0/817736010 <== mon.2 v2:172.21.15.181:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x557ecfa38340 con 0x557ecfa11000 2024-03-30T13:35:53.206 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:35:52 smithi181 ceph-mon[25762]: from='client.24311 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "prometheus", "placement": "1;smithi181=a", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T13:35:53.206 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:35:52 smithi181 ceph-mon[25762]: Saving service prometheus spec with placement smithi181=a;count:1 2024-03-30T13:35:53.206 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:35:52 smithi181 ceph-mon[25762]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' 2024-03-30T13:35:53.206 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:35:52 smithi181 ceph-mon[25762]: pgmap v182: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail; 65 KiB/s, 0 objects/s recovering 2024-03-30T13:35:53.206 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:35:52 smithi181 ceph-mon[25762]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:35:53.206 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:35:52 smithi181 ceph-mon[25762]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:35:53.206 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:35:52 smithi181 ceph-mon[25762]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:35:53.206 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:35:52 smithi181 ceph-mon[25762]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' 2024-03-30T13:35:53.206 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:35:52 smithi181 ceph-mon[25762]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "mgr module enable", "module": "prometheus"}]: dispatch 2024-03-30T13:35:53.337 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:35:52 smithi099 ceph-mon[29691]: from='client.24311 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "prometheus", "placement": "1;smithi181=a", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T13:35:53.337 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:35:52 smithi099 ceph-mon[29691]: Saving service prometheus spec with placement smithi181=a;count:1 2024-03-30T13:35:53.337 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:35:52 smithi099 ceph-mon[29691]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' 2024-03-30T13:35:53.337 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:35:52 smithi099 ceph-mon[29691]: pgmap v182: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail; 65 KiB/s, 0 objects/s recovering 2024-03-30T13:35:53.337 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:35:52 smithi099 ceph-mon[29691]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:35:53.337 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:35:52 smithi099 ceph-mon[29691]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:35:53.337 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:35:52 smithi099 ceph-mon[29691]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:35:53.337 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:35:52 smithi099 ceph-mon[29691]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' 2024-03-30T13:35:53.337 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:35:52 smithi099 ceph-mon[29691]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "mgr module enable", "module": "prometheus"}]: dispatch 2024-03-30T13:35:53.338 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:35:53 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[25141]: ignoring --setuser ceph since I am not root 2024-03-30T13:35:53.338 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:35:53 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[25141]: ignoring --setgroup ceph since I am not root 2024-03-30T13:35:53.338 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:35:53 smithi099 ceph-mgr[25145]: -- 172.21.15.99:0/768715695 <== mon.0 v2:172.21.15.99:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x557ef78ec340 con 0x557ef78c4c00 2024-03-30T13:35:53.338 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:35:52 smithi099 ceph-mon[24912]: from='client.24311 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "prometheus", "placement": "1;smithi181=a", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T13:35:53.338 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:35:52 smithi099 ceph-mon[24912]: Saving service prometheus spec with placement smithi181=a;count:1 2024-03-30T13:35:53.338 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:35:52 smithi099 ceph-mon[24912]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' 2024-03-30T13:35:53.338 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:35:52 smithi099 ceph-mon[24912]: pgmap v182: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail; 65 KiB/s, 0 objects/s recovering 2024-03-30T13:35:53.338 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:35:52 smithi099 ceph-mon[24912]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:35:53.338 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:35:52 smithi099 ceph-mon[24912]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:35:53.338 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:35:52 smithi099 ceph-mon[24912]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:35:53.338 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:35:52 smithi099 ceph-mon[24912]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' 2024-03-30T13:35:53.339 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:35:52 smithi099 ceph-mon[24912]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd=[{"prefix": "mgr module enable", "module": "prometheus"}]: dispatch 2024-03-30T13:35:53.755 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 13:35:53 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-x[27332]: 2024-03-30T13:35:53.464+0000 7f38fec6a000 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-03-30T13:35:53.756 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 13:35:53 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-x[27332]: 2024-03-30T13:35:53.557+0000 7f38fec6a000 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-03-30T13:35:53.836 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:35:53 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[25141]: 2024-03-30T13:35:53.465+0000 7f938a7c5000 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-03-30T13:35:53.837 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:35:53 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[25141]: 2024-03-30T13:35:53.555+0000 7f938a7c5000 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-03-30T13:35:54.121 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:35:53 smithi181 ceph-mon[25762]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd='[{"prefix": "mgr module enable", "module": "prometheus"}]': finished 2024-03-30T13:35:54.121 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:35:53 smithi181 ceph-mon[25762]: mgrmap e16: y(active, since 4m), standbys: x 2024-03-30T13:35:54.230 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:35:53 smithi099 ceph-mon[29691]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd='[{"prefix": "mgr module enable", "module": "prometheus"}]': finished 2024-03-30T13:35:54.231 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:35:53 smithi099 ceph-mon[29691]: mgrmap e16: y(active, since 4m), standbys: x 2024-03-30T13:35:54.231 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:35:53 smithi099 ceph-mon[24912]: from='mgr.14150 172.21.15.99:0/2289130056' entity='mgr.y' cmd='[{"prefix": "mgr module enable", "module": "prometheus"}]': finished 2024-03-30T13:35:54.231 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:35:53 smithi099 ceph-mon[24912]: mgrmap e16: y(active, since 4m), standbys: x 2024-03-30T13:35:54.231 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:35:54 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[25141]: 2024-03-30T13:35:54.141+0000 7f938a7c5000 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-03-30T13:35:54.231 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:35:54 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[25141]: 2024-03-30T13:35:54.229+0000 7f938a7c5000 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-03-30T13:35:54.506 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 13:35:54 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-x[27332]: 2024-03-30T13:35:54.174+0000 7f38fec6a000 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-03-30T13:35:54.506 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 13:35:54 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-x[27332]: 2024-03-30T13:35:54.264+0000 7f38fec6a000 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-03-30T13:35:54.506 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 13:35:54 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-x[27332]: 2024-03-30T13:35:54.364+0000 7f38fec6a000 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-03-30T13:35:54.539 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:35:54 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[25141]: 2024-03-30T13:35:54.311+0000 7f938a7c5000 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-03-30T13:35:54.540 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:35:54 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[25141]: 2024-03-30T13:35:54.458+0000 7f938a7c5000 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-03-30T13:35:54.540 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:35:54 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[25141]: 2024-03-30T13:35:54.538+0000 7f938a7c5000 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-03-30T13:35:54.798 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 13:35:54 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-x[27332]: 2024-03-30T13:35:54.523+0000 7f38fec6a000 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-03-30T13:35:54.799 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 13:35:54 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-x[27332]: 2024-03-30T13:35:54.605+0000 7f38fec6a000 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-03-30T13:35:54.799 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 13:35:54 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-x[27332]: 2024-03-30T13:35:54.713+0000 7f38fec6a000 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-03-30T13:35:54.799 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 13:35:54 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-x[27332]: 2024-03-30T13:35:54.797+0000 7f38fec6a000 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-03-30T13:35:54.836 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:35:54 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[25141]: 2024-03-30T13:35:54.646+0000 7f938a7c5000 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-03-30T13:35:54.837 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:35:54 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[25141]: 2024-03-30T13:35:54.728+0000 7f938a7c5000 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-03-30T13:35:55.256 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 13:35:54 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-x[27332]: 2024-03-30T13:35:54.960+0000 7f38fec6a000 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-03-30T13:35:55.256 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 13:35:55 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-x[27332]: 2024-03-30T13:35:55.046+0000 7f38fec6a000 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-03-30T13:35:55.336 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:35:54 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[25141]: 2024-03-30T13:35:54.891+0000 7f938a7c5000 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-03-30T13:35:55.336 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:35:54 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[25141]: 2024-03-30T13:35:54.977+0000 7f938a7c5000 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-03-30T13:35:56.311 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:35:55 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[25141]: 2024-03-30T13:35:55.990+0000 7f938a7c5000 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-03-30T13:35:56.312 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:35:56 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[25141]: 2024-03-30T13:35:56.120+0000 7f938a7c5000 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-03-30T13:35:56.312 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:35:56 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[25141]: 2024-03-30T13:35:56.310+0000 7f938a7c5000 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-03-30T13:35:56.405 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 13:35:56 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-x[27332]: 2024-03-30T13:35:56.067+0000 7f38fec6a000 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-03-30T13:35:56.405 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 13:35:56 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-x[27332]: 2024-03-30T13:35:56.196+0000 7f38fec6a000 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-03-30T13:35:56.405 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 13:35:56 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-x[27332]: 2024-03-30T13:35:56.402+0000 7f38fec6a000 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-03-30T13:35:56.586 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:35:56 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[25141]: 2024-03-30T13:35:56.397+0000 7f938a7c5000 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-03-30T13:35:56.587 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:35:56 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[25141]: 2024-03-30T13:35:56.532+0000 7f938a7c5000 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-03-30T13:35:56.756 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 13:35:56 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-x[27332]: 2024-03-30T13:35:56.493+0000 7f38fec6a000 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-03-30T13:35:56.756 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 13:35:56 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-x[27332]: 2024-03-30T13:35:56.628+0000 7f38fec6a000 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-03-30T13:35:57.160 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:35:56 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[25141]: 2024-03-30T13:35:56.850+0000 7f938a7c5000 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-03-30T13:35:57.161 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:35:57 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[25141]: 2024-03-30T13:35:57.074+0000 7f938a7c5000 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-03-30T13:35:57.161 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:35:57 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[25141]: 2024-03-30T13:35:57.159+0000 7f938a7c5000 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-03-30T13:35:57.256 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 13:35:56 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-x[27332]: 2024-03-30T13:35:56.953+0000 7f38fec6a000 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-03-30T13:35:57.256 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 13:35:57 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-x[27332]: 2024-03-30T13:35:57.178+0000 7f38fec6a000 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-03-30T13:35:57.587 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:35:57 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[25141]: 2024-03-30T13:35:57.327+0000 7f938a7c5000 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-03-30T13:35:57.756 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 13:35:57 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-x[27332]: 2024-03-30T13:35:57.267+0000 7f38fec6a000 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-03-30T13:35:57.756 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 13:35:57 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-x[27332]: 2024-03-30T13:35:57.439+0000 7f38fec6a000 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-03-30T13:35:58.506 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 13:35:58 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-x[27332]: 2024-03-30T13:35:58.382+0000 7f38fec6a000 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-03-30T13:35:58.566 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:35:58 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[25141]: 2024-03-30T13:35:58.271+0000 7f938a7c5000 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-03-30T13:35:58.837 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:35:58 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[25141]: 2024-03-30T13:35:58.565+0000 7f938a7c5000 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-03-30T13:35:58.837 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:35:58 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[25141]: 2024-03-30T13:35:58.661+0000 7f938a7c5000 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-03-30T13:35:58.837 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:35:58 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[25141]: 2024-03-30T13:35:58.811+0000 7f938a7c5000 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-03-30T13:35:58.945 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 13:35:58 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-x[27332]: 2024-03-30T13:35:58.688+0000 7f38fec6a000 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-03-30T13:35:58.945 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 13:35:58 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-x[27332]: 2024-03-30T13:35:58.786+0000 7f38fec6a000 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-03-30T13:35:59.256 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 13:35:58 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-x[27332]: 2024-03-30T13:35:58.942+0000 7f38fec6a000 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-03-30T13:35:59.256 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 13:35:58 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-x[27332]: [30/Mar/2024:13:35:58] ENGINE Bus STARTING 2024-03-30T13:35:59.256 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 13:35:59 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-x[27332]: CherryPy Checker: 2024-03-30T13:35:59.256 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 13:35:59 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-x[27332]: The Application mounted at '' has an empty config. 2024-03-30T13:35:59.256 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 13:35:59 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-x[27332]: 2024-03-30T13:35:59.256 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 13:35:59 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-x[27332]: [30/Mar/2024:13:35:59] ENGINE Serving on http://:::9283 2024-03-30T13:35:59.256 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 13:35:59 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-x[27332]: [30/Mar/2024:13:35:59] ENGINE Bus STARTED 2024-03-30T13:35:59.672 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:35:59 smithi181 ceph-mon[25762]: Active manager daemon y restarted 2024-03-30T13:35:59.672 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:35:59 smithi181 ceph-mon[25762]: Activating manager daemon y 2024-03-30T13:35:59.672 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:35:59 smithi181 ceph-mon[25762]: osdmap e60: 8 total, 8 up, 8 in 2024-03-30T13:35:59.672 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:35:59 smithi181 ceph-mon[25762]: Standby manager daemon x restarted 2024-03-30T13:35:59.672 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:35:59 smithi181 ceph-mon[25762]: Standby manager daemon x started 2024-03-30T13:35:59.672 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:35:59 smithi181 ceph-mon[25762]: from='mgr.? 172.21.15.181:0/1611638583' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/crt"}]: dispatch 2024-03-30T13:35:59.672 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:35:59 smithi181 ceph-mon[25762]: from='mgr.? 172.21.15.181:0/1611638583' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-03-30T13:35:59.672 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:35:59 smithi181 ceph-mon[25762]: from='mgr.? 172.21.15.181:0/1611638583' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/key"}]: dispatch 2024-03-30T13:35:59.672 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:35:59 smithi181 ceph-mon[25762]: from='mgr.? 172.21.15.181:0/1611638583' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-03-30T13:35:59.837 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:35:59 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[25141]: [30/Mar/2024:13:35:59] ENGINE Bus STARTING 2024-03-30T13:35:59.837 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:35:59 smithi099 ceph-mon[29691]: Active manager daemon y restarted 2024-03-30T13:35:59.837 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:35:59 smithi099 ceph-mon[29691]: Activating manager daemon y 2024-03-30T13:35:59.837 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:35:59 smithi099 ceph-mon[29691]: osdmap e60: 8 total, 8 up, 8 in 2024-03-30T13:35:59.837 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:35:59 smithi099 ceph-mon[29691]: Standby manager daemon x restarted 2024-03-30T13:35:59.837 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:35:59 smithi099 ceph-mon[29691]: Standby manager daemon x started 2024-03-30T13:35:59.837 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:35:59 smithi099 ceph-mon[29691]: from='mgr.? 172.21.15.181:0/1611638583' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/crt"}]: dispatch 2024-03-30T13:35:59.838 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:35:59 smithi099 ceph-mon[29691]: from='mgr.? 172.21.15.181:0/1611638583' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-03-30T13:35:59.838 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:35:59 smithi099 ceph-mon[29691]: from='mgr.? 172.21.15.181:0/1611638583' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/key"}]: dispatch 2024-03-30T13:35:59.838 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:35:59 smithi099 ceph-mon[29691]: from='mgr.? 172.21.15.181:0/1611638583' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-03-30T13:35:59.838 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:35:59 smithi099 ceph-mon[24912]: Active manager daemon y restarted 2024-03-30T13:35:59.838 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:35:59 smithi099 ceph-mon[24912]: Activating manager daemon y 2024-03-30T13:35:59.838 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:35:59 smithi099 ceph-mon[24912]: osdmap e60: 8 total, 8 up, 8 in 2024-03-30T13:35:59.838 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:35:59 smithi099 ceph-mon[24912]: Standby manager daemon x restarted 2024-03-30T13:35:59.838 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:35:59 smithi099 ceph-mon[24912]: Standby manager daemon x started 2024-03-30T13:35:59.838 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:35:59 smithi099 ceph-mon[24912]: from='mgr.? 172.21.15.181:0/1611638583' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/crt"}]: dispatch 2024-03-30T13:35:59.838 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:35:59 smithi099 ceph-mon[24912]: from='mgr.? 172.21.15.181:0/1611638583' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-03-30T13:35:59.838 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:35:59 smithi099 ceph-mon[24912]: from='mgr.? 172.21.15.181:0/1611638583' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/key"}]: dispatch 2024-03-30T13:35:59.839 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:35:59 smithi099 ceph-mon[24912]: from='mgr.? 172.21.15.181:0/1611638583' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-03-30T13:36:00.174 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:35:59 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[25141]: CherryPy Checker: 2024-03-30T13:36:00.174 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:35:59 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[25141]: The Application mounted at '' has an empty config. 2024-03-30T13:36:00.174 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:35:59 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[25141]: 2024-03-30T13:36:00.174 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:35:59 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[25141]: [30/Mar/2024:13:35:59] ENGINE Serving on http://:::9283 2024-03-30T13:36:00.174 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:35:59 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[25141]: [30/Mar/2024:13:35:59] ENGINE Bus STARTED 2024-03-30T13:36:00.580 INFO:teuthology.orchestra.run.smithi181.stdout:Scheduled node-exporter update... 2024-03-30T13:36:00.756 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:36:00 smithi181 ceph-mon[25762]: mgrmap e17: y(active, starting, since 0.745912s), standbys: x 2024-03-30T13:36:00.757 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:36:00 smithi181 ceph-mon[25762]: from='mgr.14439 172.21.15.99:0/1757456350' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-03-30T13:36:00.757 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:36:00 smithi181 ceph-mon[25762]: from='mgr.14439 172.21.15.99:0/1757456350' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-30T13:36:00.757 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:36:00 smithi181 ceph-mon[25762]: from='mgr.14439 172.21.15.99:0/1757456350' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-30T13:36:00.757 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:36:00 smithi181 ceph-mon[25762]: from='mgr.14439 172.21.15.99:0/1757456350' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-03-30T13:36:00.757 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:36:00 smithi181 ceph-mon[25762]: from='mgr.14439 172.21.15.99:0/1757456350' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-03-30T13:36:00.757 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:36:00 smithi181 ceph-mon[25762]: from='mgr.14439 172.21.15.99:0/1757456350' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-03-30T13:36:00.757 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:36:00 smithi181 ceph-mon[25762]: from='mgr.14439 172.21.15.99:0/1757456350' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-03-30T13:36:00.757 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:36:00 smithi181 ceph-mon[25762]: from='mgr.14439 172.21.15.99:0/1757456350' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-03-30T13:36:00.757 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:36:00 smithi181 ceph-mon[25762]: from='mgr.14439 172.21.15.99:0/1757456350' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-03-30T13:36:00.757 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:36:00 smithi181 ceph-mon[25762]: from='mgr.14439 172.21.15.99:0/1757456350' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-03-30T13:36:00.757 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:36:00 smithi181 ceph-mon[25762]: from='mgr.14439 172.21.15.99:0/1757456350' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-03-30T13:36:00.757 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:36:00 smithi181 ceph-mon[25762]: from='mgr.14439 172.21.15.99:0/1757456350' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-03-30T13:36:00.757 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:36:00 smithi181 ceph-mon[25762]: from='mgr.14439 172.21.15.99:0/1757456350' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-03-30T13:36:00.757 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:36:00 smithi181 ceph-mon[25762]: from='mgr.14439 172.21.15.99:0/1757456350' entity='mgr.y' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-03-30T13:36:00.758 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:36:00 smithi181 ceph-mon[25762]: from='mgr.14439 172.21.15.99:0/1757456350' entity='mgr.y' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-03-30T13:36:00.758 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:36:00 smithi181 ceph-mon[25762]: from='mgr.14439 172.21.15.99:0/1757456350' entity='mgr.y' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-03-30T13:36:00.758 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:36:00 smithi181 ceph-mon[25762]: Manager daemon y is now available 2024-03-30T13:36:00.758 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:36:00 smithi181 ceph-mon[25762]: from='mgr.14439 ' entity='mgr.y' 2024-03-30T13:36:00.758 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:36:00 smithi181 ceph-mon[25762]: from='mgr.14439 172.21.15.99:0/1757456350' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:36:00.758 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:36:00 smithi181 ceph-mon[25762]: from='mgr.14439 172.21.15.99:0/1757456350' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:36:00.758 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:36:00 smithi181 ceph-mon[25762]: from='mgr.14439 172.21.15.99:0/1757456350' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:36:00.758 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:36:00 smithi181 ceph-mon[25762]: from='mgr.14439 172.21.15.99:0/1757456350' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:36:00.758 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:36:00 smithi181 ceph-mon[25762]: from='mgr.14439 172.21.15.99:0/1757456350' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd/host:smithi181", "name": "osd_memory_target"}]: dispatch 2024-03-30T13:36:00.758 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:36:00 smithi181 ceph-mon[25762]: from='mgr.14439 ' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd/host:smithi181", "name": "osd_memory_target"}]: dispatch 2024-03-30T13:36:00.758 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:36:00 smithi181 ceph-mon[25762]: from='mgr.14439 172.21.15.99:0/1757456350' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd/host:smithi099", "name": "osd_memory_target"}]: dispatch 2024-03-30T13:36:00.758 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:36:00 smithi181 ceph-mon[25762]: from='mgr.14439 ' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd/host:smithi099", "name": "osd_memory_target"}]: dispatch 2024-03-30T13:36:00.758 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:36:00 smithi181 ceph-mon[25762]: from='mgr.14439 ' entity='mgr.y' cmd='[{"prefix": "config rm", "who": "osd/host:smithi181", "name": "osd_memory_target"}]': finished 2024-03-30T13:36:00.758 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:36:00 smithi181 ceph-mon[25762]: from='mgr.14439 ' entity='mgr.y' cmd='[{"prefix": "config rm", "who": "osd/host:smithi099", "name": "osd_memory_target"}]': finished 2024-03-30T13:36:00.759 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:36:00 smithi181 ceph-mon[25762]: Updating smithi181:/etc/ceph/ceph.conf 2024-03-30T13:36:00.759 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:36:00 smithi181 ceph-mon[25762]: from='mgr.14439 ' entity='mgr.y' 2024-03-30T13:36:00.759 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:36:00 smithi181 ceph-mon[25762]: Updating smithi099:/etc/ceph/ceph.conf 2024-03-30T13:36:00.759 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:36:00 smithi181 ceph-mon[25762]: from='mgr.14439 172.21.15.99:0/1757456350' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-03-30T13:36:00.759 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:36:00 smithi181 ceph-mon[25762]: from='mgr.14439 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-03-30T13:36:00.759 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:36:00 smithi181 ceph-mon[25762]: from='mgr.14439 172.21.15.99:0/1757456350' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-03-30T13:36:00.759 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:36:00 smithi181 ceph-mon[25762]: from='mgr.14439 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-03-30T13:36:00.837 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:36:00 smithi099 ceph-mon[29691]: mgrmap e17: y(active, starting, since 0.745912s), standbys: x 2024-03-30T13:36:00.837 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:36:00 smithi099 ceph-mon[29691]: from='mgr.14439 172.21.15.99:0/1757456350' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-03-30T13:36:00.837 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:36:00 smithi099 ceph-mon[29691]: from='mgr.14439 172.21.15.99:0/1757456350' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-30T13:36:00.837 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:36:00 smithi099 ceph-mon[29691]: from='mgr.14439 172.21.15.99:0/1757456350' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-30T13:36:00.837 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:36:00 smithi099 ceph-mon[29691]: from='mgr.14439 172.21.15.99:0/1757456350' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-03-30T13:36:00.837 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:36:00 smithi099 ceph-mon[29691]: from='mgr.14439 172.21.15.99:0/1757456350' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-03-30T13:36:00.837 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:36:00 smithi099 ceph-mon[29691]: from='mgr.14439 172.21.15.99:0/1757456350' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-03-30T13:36:00.837 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:36:00 smithi099 ceph-mon[29691]: from='mgr.14439 172.21.15.99:0/1757456350' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-03-30T13:36:00.838 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:36:00 smithi099 ceph-mon[29691]: from='mgr.14439 172.21.15.99:0/1757456350' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-03-30T13:36:00.838 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:36:00 smithi099 ceph-mon[29691]: from='mgr.14439 172.21.15.99:0/1757456350' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-03-30T13:36:00.838 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:36:00 smithi099 ceph-mon[29691]: from='mgr.14439 172.21.15.99:0/1757456350' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-03-30T13:36:00.838 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:36:00 smithi099 ceph-mon[29691]: from='mgr.14439 172.21.15.99:0/1757456350' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-03-30T13:36:00.838 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:36:00 smithi099 ceph-mon[29691]: from='mgr.14439 172.21.15.99:0/1757456350' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-03-30T13:36:00.838 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:36:00 smithi099 ceph-mon[29691]: from='mgr.14439 172.21.15.99:0/1757456350' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-03-30T13:36:00.838 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:36:00 smithi099 ceph-mon[29691]: from='mgr.14439 172.21.15.99:0/1757456350' entity='mgr.y' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-03-30T13:36:00.838 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:36:00 smithi099 ceph-mon[29691]: from='mgr.14439 172.21.15.99:0/1757456350' entity='mgr.y' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-03-30T13:36:00.838 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:36:00 smithi099 ceph-mon[29691]: from='mgr.14439 172.21.15.99:0/1757456350' entity='mgr.y' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-03-30T13:36:00.838 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:36:00 smithi099 ceph-mon[29691]: Manager daemon y is now available 2024-03-30T13:36:00.838 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:36:00 smithi099 ceph-mon[29691]: from='mgr.14439 ' entity='mgr.y' 2024-03-30T13:36:00.838 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:36:00 smithi099 ceph-mon[29691]: from='mgr.14439 172.21.15.99:0/1757456350' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:36:00.838 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:36:00 smithi099 ceph-mon[29691]: from='mgr.14439 172.21.15.99:0/1757456350' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:36:00.838 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:36:00 smithi099 ceph-mon[29691]: from='mgr.14439 172.21.15.99:0/1757456350' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:36:00.839 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:36:00 smithi099 ceph-mon[29691]: from='mgr.14439 172.21.15.99:0/1757456350' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:36:00.839 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:36:00 smithi099 ceph-mon[29691]: from='mgr.14439 172.21.15.99:0/1757456350' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd/host:smithi181", "name": "osd_memory_target"}]: dispatch 2024-03-30T13:36:00.839 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:36:00 smithi099 ceph-mon[29691]: from='mgr.14439 ' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd/host:smithi181", "name": "osd_memory_target"}]: dispatch 2024-03-30T13:36:00.839 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:36:00 smithi099 ceph-mon[29691]: from='mgr.14439 172.21.15.99:0/1757456350' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd/host:smithi099", "name": "osd_memory_target"}]: dispatch 2024-03-30T13:36:00.839 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:36:00 smithi099 ceph-mon[29691]: from='mgr.14439 ' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd/host:smithi099", "name": "osd_memory_target"}]: dispatch 2024-03-30T13:36:00.839 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:36:00 smithi099 ceph-mon[29691]: from='mgr.14439 ' entity='mgr.y' cmd='[{"prefix": "config rm", "who": "osd/host:smithi181", "name": "osd_memory_target"}]': finished 2024-03-30T13:36:00.839 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:36:00 smithi099 ceph-mon[29691]: from='mgr.14439 ' entity='mgr.y' cmd='[{"prefix": "config rm", "who": "osd/host:smithi099", "name": "osd_memory_target"}]': finished 2024-03-30T13:36:00.839 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:36:00 smithi099 ceph-mon[29691]: Updating smithi181:/etc/ceph/ceph.conf 2024-03-30T13:36:00.839 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:36:00 smithi099 ceph-mon[29691]: from='mgr.14439 ' entity='mgr.y' 2024-03-30T13:36:00.839 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:36:00 smithi099 ceph-mon[29691]: Updating smithi099:/etc/ceph/ceph.conf 2024-03-30T13:36:00.839 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:36:00 smithi099 ceph-mon[29691]: from='mgr.14439 172.21.15.99:0/1757456350' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-03-30T13:36:00.839 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:36:00 smithi099 ceph-mon[29691]: from='mgr.14439 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-03-30T13:36:00.840 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:36:00 smithi099 ceph-mon[29691]: from='mgr.14439 172.21.15.99:0/1757456350' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-03-30T13:36:00.840 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:36:00 smithi099 ceph-mon[29691]: from='mgr.14439 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-03-30T13:36:00.840 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:36:00 smithi099 ceph-mon[24912]: mgrmap e17: y(active, starting, since 0.745912s), standbys: x 2024-03-30T13:36:00.840 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:36:00 smithi099 ceph-mon[24912]: from='mgr.14439 172.21.15.99:0/1757456350' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-03-30T13:36:00.840 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:36:00 smithi099 ceph-mon[24912]: from='mgr.14439 172.21.15.99:0/1757456350' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-30T13:36:00.840 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:36:00 smithi099 ceph-mon[24912]: from='mgr.14439 172.21.15.99:0/1757456350' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-30T13:36:00.840 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:36:00 smithi099 ceph-mon[24912]: from='mgr.14439 172.21.15.99:0/1757456350' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-03-30T13:36:00.840 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:36:00 smithi099 ceph-mon[24912]: from='mgr.14439 172.21.15.99:0/1757456350' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-03-30T13:36:00.840 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:36:00 smithi099 ceph-mon[24912]: from='mgr.14439 172.21.15.99:0/1757456350' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-03-30T13:36:00.840 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:36:00 smithi099 ceph-mon[24912]: from='mgr.14439 172.21.15.99:0/1757456350' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-03-30T13:36:00.840 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:36:00 smithi099 ceph-mon[24912]: from='mgr.14439 172.21.15.99:0/1757456350' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-03-30T13:36:00.841 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:36:00 smithi099 ceph-mon[24912]: from='mgr.14439 172.21.15.99:0/1757456350' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-03-30T13:36:00.841 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:36:00 smithi099 ceph-mon[24912]: from='mgr.14439 172.21.15.99:0/1757456350' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-03-30T13:36:00.841 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:36:00 smithi099 ceph-mon[24912]: from='mgr.14439 172.21.15.99:0/1757456350' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-03-30T13:36:00.841 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:36:00 smithi099 ceph-mon[24912]: from='mgr.14439 172.21.15.99:0/1757456350' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-03-30T13:36:00.841 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:36:00 smithi099 ceph-mon[24912]: from='mgr.14439 172.21.15.99:0/1757456350' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-03-30T13:36:00.841 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:36:00 smithi099 ceph-mon[24912]: from='mgr.14439 172.21.15.99:0/1757456350' entity='mgr.y' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-03-30T13:36:00.841 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:36:00 smithi099 ceph-mon[24912]: from='mgr.14439 172.21.15.99:0/1757456350' entity='mgr.y' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-03-30T13:36:00.841 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:36:00 smithi099 ceph-mon[24912]: from='mgr.14439 172.21.15.99:0/1757456350' entity='mgr.y' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-03-30T13:36:00.841 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:36:00 smithi099 ceph-mon[24912]: Manager daemon y is now available 2024-03-30T13:36:00.841 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:36:00 smithi099 ceph-mon[24912]: from='mgr.14439 ' entity='mgr.y' 2024-03-30T13:36:00.841 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:36:00 smithi099 ceph-mon[24912]: from='mgr.14439 172.21.15.99:0/1757456350' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:36:00.841 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:36:00 smithi099 ceph-mon[24912]: from='mgr.14439 172.21.15.99:0/1757456350' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:36:00.841 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:36:00 smithi099 ceph-mon[24912]: from='mgr.14439 172.21.15.99:0/1757456350' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:36:00.841 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:36:00 smithi099 ceph-mon[24912]: from='mgr.14439 172.21.15.99:0/1757456350' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:36:00.842 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:36:00 smithi099 ceph-mon[24912]: from='mgr.14439 172.21.15.99:0/1757456350' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd/host:smithi181", "name": "osd_memory_target"}]: dispatch 2024-03-30T13:36:00.842 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:36:00 smithi099 ceph-mon[24912]: from='mgr.14439 ' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd/host:smithi181", "name": "osd_memory_target"}]: dispatch 2024-03-30T13:36:00.842 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:36:00 smithi099 ceph-mon[24912]: from='mgr.14439 172.21.15.99:0/1757456350' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd/host:smithi099", "name": "osd_memory_target"}]: dispatch 2024-03-30T13:36:00.842 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:36:00 smithi099 ceph-mon[24912]: from='mgr.14439 ' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd/host:smithi099", "name": "osd_memory_target"}]: dispatch 2024-03-30T13:36:00.842 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:36:00 smithi099 ceph-mon[24912]: from='mgr.14439 ' entity='mgr.y' cmd='[{"prefix": "config rm", "who": "osd/host:smithi181", "name": "osd_memory_target"}]': finished 2024-03-30T13:36:00.842 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:36:00 smithi099 ceph-mon[24912]: from='mgr.14439 ' entity='mgr.y' cmd='[{"prefix": "config rm", "who": "osd/host:smithi099", "name": "osd_memory_target"}]': finished 2024-03-30T13:36:00.842 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:36:00 smithi099 ceph-mon[24912]: Updating smithi181:/etc/ceph/ceph.conf 2024-03-30T13:36:00.842 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:36:00 smithi099 ceph-mon[24912]: from='mgr.14439 ' entity='mgr.y' 2024-03-30T13:36:00.842 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:36:00 smithi099 ceph-mon[24912]: Updating smithi099:/etc/ceph/ceph.conf 2024-03-30T13:36:00.842 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:36:00 smithi099 ceph-mon[24912]: from='mgr.14439 172.21.15.99:0/1757456350' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-03-30T13:36:00.842 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:36:00 smithi099 ceph-mon[24912]: from='mgr.14439 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-03-30T13:36:00.842 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:36:00 smithi099 ceph-mon[24912]: from='mgr.14439 172.21.15.99:0/1757456350' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-03-30T13:36:00.842 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:36:00 smithi099 ceph-mon[24912]: from='mgr.14439 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-03-30T13:36:01.337 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:36:00 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[25141]: [30/Mar/2024:13:36:00] ENGINE Bus STARTING 2024-03-30T13:36:01.337 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:36:01 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[25141]: [30/Mar/2024:13:36:01] ENGINE Serving on https://172.21.15.99:7150 2024-03-30T13:36:01.337 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:36:01 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[25141]: [30/Mar/2024:13:36:01] ENGINE Bus STARTED 2024-03-30T13:36:01.357 DEBUG:teuthology.orchestra.run.smithi099:node-exporter.a> sudo journalctl -f -n 0 -u ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4@node-exporter.a.service 2024-03-30T13:36:01.359 DEBUG:teuthology.orchestra.run.smithi181:node-exporter.b> sudo journalctl -f -n 0 -u ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4@node-exporter.b.service 2024-03-30T13:36:01.362 INFO:tasks.cephadm:Adding alertmanager.a on smithi099 2024-03-30T13:36:01.362 DEBUG:teuthology.orchestra.run.smithi181:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 98ebaeb8-ee99-11ee-b647-cb9ed24678a4 -- ceph orch apply alertmanager '1;smithi099=a' 2024-03-30T13:36:01.646 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:36:01 smithi181 ceph-mon[25762]: Updating smithi099:/etc/ceph/ceph.client.admin.keyring 2024-03-30T13:36:01.646 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:36:01 smithi181 ceph-mon[25762]: Updating smithi181:/etc/ceph/ceph.client.admin.keyring 2024-03-30T13:36:01.646 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:36:01 smithi181 ceph-mon[25762]: mgrmap e18: y(active, since 1.75458s), standbys: x 2024-03-30T13:36:01.646 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:36:01 smithi181 ceph-mon[25762]: from='client.24329 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "node-exporter", "placement": "2;smithi099=a;smithi181=b", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T13:36:01.647 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:36:01 smithi181 ceph-mon[25762]: Saving service node-exporter spec with placement smithi099=a;smithi181=b;count:2 2024-03-30T13:36:01.647 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:36:01 smithi181 ceph-mon[25762]: pgmap v3: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:36:01.647 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:36:01 smithi181 ceph-mon[25762]: from='mgr.14439 ' entity='mgr.y' 2024-03-30T13:36:01.647 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:36:01 smithi181 ceph-mon[25762]: from='mgr.14439 ' entity='mgr.y' 2024-03-30T13:36:01.647 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:36:01 smithi181 ceph-mon[25762]: from='mgr.14439 ' entity='mgr.y' 2024-03-30T13:36:01.647 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:36:01 smithi181 ceph-mon[25762]: from='mgr.14439 ' entity='mgr.y' 2024-03-30T13:36:01.647 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:36:01 smithi181 ceph-mon[25762]: from='mgr.14439 172.21.15.99:0/1757456350' entity='mgr.y' cmd=[{"prefix": "mgr module enable", "module": "prometheus"}]: dispatch 2024-03-30T13:36:01.647 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:36:01 smithi181 ceph-mon[25762]: from='mgr.14439 ' entity='mgr.y' cmd=[{"prefix": "mgr module enable", "module": "prometheus"}]: dispatch 2024-03-30T13:36:01.647 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:36:01 smithi181 ceph-mon[25762]: [30/Mar/2024:13:36:00] ENGINE Bus STARTING 2024-03-30T13:36:01.647 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:36:01 smithi181 ceph-mon[25762]: from='mgr.14439 ' entity='mgr.y' 2024-03-30T13:36:01.745 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:36:01 smithi099 ceph-mon[24912]: Updating smithi099:/etc/ceph/ceph.client.admin.keyring 2024-03-30T13:36:01.745 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:36:01 smithi099 ceph-mon[24912]: Updating smithi181:/etc/ceph/ceph.client.admin.keyring 2024-03-30T13:36:01.745 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:36:01 smithi099 ceph-mon[24912]: mgrmap e18: y(active, since 1.75458s), standbys: x 2024-03-30T13:36:01.745 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:36:01 smithi099 ceph-mon[24912]: from='client.24329 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "node-exporter", "placement": "2;smithi099=a;smithi181=b", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T13:36:01.745 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:36:01 smithi099 ceph-mon[24912]: Saving service node-exporter spec with placement smithi099=a;smithi181=b;count:2 2024-03-30T13:36:01.745 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:36:01 smithi099 ceph-mon[24912]: pgmap v3: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:36:01.745 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:36:01 smithi099 ceph-mon[24912]: from='mgr.14439 ' entity='mgr.y' 2024-03-30T13:36:01.745 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:36:01 smithi099 ceph-mon[24912]: from='mgr.14439 ' entity='mgr.y' 2024-03-30T13:36:01.745 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:36:01 smithi099 ceph-mon[24912]: from='mgr.14439 ' entity='mgr.y' 2024-03-30T13:36:01.745 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:36:01 smithi099 ceph-mon[24912]: from='mgr.14439 ' entity='mgr.y' 2024-03-30T13:36:01.745 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:36:01 smithi099 ceph-mon[24912]: from='mgr.14439 172.21.15.99:0/1757456350' entity='mgr.y' cmd=[{"prefix": "mgr module enable", "module": "prometheus"}]: dispatch 2024-03-30T13:36:01.746 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:36:01 smithi099 ceph-mon[24912]: from='mgr.14439 ' entity='mgr.y' cmd=[{"prefix": "mgr module enable", "module": "prometheus"}]: dispatch 2024-03-30T13:36:01.746 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:36:01 smithi099 ceph-mon[24912]: [30/Mar/2024:13:36:00] ENGINE Bus STARTING 2024-03-30T13:36:01.746 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:36:01 smithi099 ceph-mon[24912]: from='mgr.14439 ' entity='mgr.y' 2024-03-30T13:36:01.746 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:36:01 smithi099 ceph-mon[29691]: Updating smithi099:/etc/ceph/ceph.client.admin.keyring 2024-03-30T13:36:01.746 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:36:01 smithi099 ceph-mon[29691]: Updating smithi181:/etc/ceph/ceph.client.admin.keyring 2024-03-30T13:36:01.746 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:36:01 smithi099 ceph-mon[29691]: mgrmap e18: y(active, since 1.75458s), standbys: x 2024-03-30T13:36:01.746 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:36:01 smithi099 ceph-mon[29691]: from='client.24329 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "node-exporter", "placement": "2;smithi099=a;smithi181=b", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T13:36:01.746 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:36:01 smithi099 ceph-mon[29691]: Saving service node-exporter spec with placement smithi099=a;smithi181=b;count:2 2024-03-30T13:36:01.746 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:36:01 smithi099 ceph-mon[29691]: pgmap v3: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:36:01.746 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:36:01 smithi099 ceph-mon[29691]: from='mgr.14439 ' entity='mgr.y' 2024-03-30T13:36:01.746 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:36:01 smithi099 ceph-mon[29691]: from='mgr.14439 ' entity='mgr.y' 2024-03-30T13:36:01.747 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:36:01 smithi099 ceph-mon[29691]: from='mgr.14439 ' entity='mgr.y' 2024-03-30T13:36:01.747 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:36:01 smithi099 ceph-mon[29691]: from='mgr.14439 ' entity='mgr.y' 2024-03-30T13:36:01.747 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:36:01 smithi099 ceph-mon[29691]: from='mgr.14439 172.21.15.99:0/1757456350' entity='mgr.y' cmd=[{"prefix": "mgr module enable", "module": "prometheus"}]: dispatch 2024-03-30T13:36:01.747 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:36:01 smithi099 ceph-mon[29691]: from='mgr.14439 ' entity='mgr.y' cmd=[{"prefix": "mgr module enable", "module": "prometheus"}]: dispatch 2024-03-30T13:36:01.747 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:36:01 smithi099 ceph-mon[29691]: [30/Mar/2024:13:36:00] ENGINE Bus STARTING 2024-03-30T13:36:01.747 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:36:01 smithi099 ceph-mon[29691]: from='mgr.14439 ' entity='mgr.y' 2024-03-30T13:36:02.756 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:36:02 smithi181 ceph-mon[25762]: [30/Mar/2024:13:36:01] ENGINE Serving on https://172.21.15.99:7150 2024-03-30T13:36:02.756 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:36:02 smithi181 ceph-mon[25762]: [30/Mar/2024:13:36:01] ENGINE Bus STARTED 2024-03-30T13:36:02.756 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:36:02 smithi181 ceph-mon[25762]: pgmap v4: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:36:02.756 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:36:02 smithi181 ceph-mon[25762]: from='mgr.14439 ' entity='mgr.y' cmd='[{"prefix": "mgr module enable", "module": "prometheus"}]': finished 2024-03-30T13:36:02.756 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:36:02 smithi181 ceph-mon[25762]: mgrmap e19: y(active, since 2s), standbys: x 2024-03-30T13:36:02.756 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:36:02 smithi181 ceph-mon[25762]: Deploying daemon prometheus.a on smithi181 2024-03-30T13:36:02.837 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:36:02 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[25141]: 172.21.15.99 - - [30/Mar/2024:13:36:02] "POST /data HTTP/1.1" 200 46 "" "Python-urllib/3.9" 2024-03-30T13:36:02.837 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:36:02 smithi099 ceph-mon[24912]: [30/Mar/2024:13:36:01] ENGINE Serving on https://172.21.15.99:7150 2024-03-30T13:36:02.837 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:36:02 smithi099 ceph-mon[24912]: [30/Mar/2024:13:36:01] ENGINE Bus STARTED 2024-03-30T13:36:02.838 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:36:02 smithi099 ceph-mon[24912]: pgmap v4: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:36:02.838 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:36:02 smithi099 ceph-mon[24912]: from='mgr.14439 ' entity='mgr.y' cmd='[{"prefix": "mgr module enable", "module": "prometheus"}]': finished 2024-03-30T13:36:02.838 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:36:02 smithi099 ceph-mon[24912]: mgrmap e19: y(active, since 2s), standbys: x 2024-03-30T13:36:02.838 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:36:02 smithi099 ceph-mon[24912]: Deploying daemon prometheus.a on smithi181 2024-03-30T13:36:02.838 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:36:02 smithi099 ceph-mon[29691]: [30/Mar/2024:13:36:01] ENGINE Serving on https://172.21.15.99:7150 2024-03-30T13:36:02.838 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:36:02 smithi099 ceph-mon[29691]: [30/Mar/2024:13:36:01] ENGINE Bus STARTED 2024-03-30T13:36:02.838 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:36:02 smithi099 ceph-mon[29691]: pgmap v4: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:36:02.838 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:36:02 smithi099 ceph-mon[29691]: from='mgr.14439 ' entity='mgr.y' cmd='[{"prefix": "mgr module enable", "module": "prometheus"}]': finished 2024-03-30T13:36:02.839 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:36:02 smithi099 ceph-mon[29691]: mgrmap e19: y(active, since 2s), standbys: x 2024-03-30T13:36:02.839 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:36:02 smithi099 ceph-mon[29691]: Deploying daemon prometheus.a on smithi181 2024-03-30T13:36:03.359 INFO:teuthology.orchestra.run.smithi181.stdout:Scheduled alertmanager update... 2024-03-30T13:36:04.006 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:36:03 smithi181 ceph-mon[25762]: from='mgr.14439 ' entity='mgr.y' 2024-03-30T13:36:04.006 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:36:03 smithi181 ceph-mon[25762]: from='mgr.14439 ' entity='mgr.y' 2024-03-30T13:36:04.006 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:36:03 smithi181 ceph-mon[25762]: from='mgr.14439 ' entity='mgr.y' 2024-03-30T13:36:04.087 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:36:03 smithi099 ceph-mon[24912]: from='mgr.14439 ' entity='mgr.y' 2024-03-30T13:36:04.087 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:36:03 smithi099 ceph-mon[24912]: from='mgr.14439 ' entity='mgr.y' 2024-03-30T13:36:04.087 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:36:03 smithi099 ceph-mon[24912]: from='mgr.14439 ' entity='mgr.y' 2024-03-30T13:36:04.087 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:36:03 smithi099 ceph-mon[29691]: from='mgr.14439 ' entity='mgr.y' 2024-03-30T13:36:04.087 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:36:03 smithi099 ceph-mon[29691]: from='mgr.14439 ' entity='mgr.y' 2024-03-30T13:36:04.087 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:36:03 smithi099 ceph-mon[29691]: from='mgr.14439 ' entity='mgr.y' 2024-03-30T13:36:04.298 DEBUG:teuthology.orchestra.run.smithi099:alertmanager.a> sudo journalctl -f -n 0 -u ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4@alertmanager.a.service 2024-03-30T13:36:04.301 INFO:tasks.cephadm:Adding grafana.a on smithi181 2024-03-30T13:36:04.301 DEBUG:teuthology.orchestra.run.smithi181:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 98ebaeb8-ee99-11ee-b647-cb9ed24678a4 -- ceph orch apply grafana '1;smithi181=a' 2024-03-30T13:36:04.870 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:36:04 smithi099 ceph-mon[24912]: from='client.24359 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "alertmanager", "placement": "1;smithi099=a", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T13:36:04.870 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:36:04 smithi099 ceph-mon[24912]: Saving service alertmanager spec with placement smithi099=a;count:1 2024-03-30T13:36:04.870 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:36:04 smithi099 ceph-mon[24912]: pgmap v5: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:36:04.870 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:36:04 smithi099 ceph-mon[29691]: from='client.24359 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "alertmanager", "placement": "1;smithi099=a", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T13:36:04.870 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:36:04 smithi099 ceph-mon[29691]: Saving service alertmanager spec with placement smithi099=a;count:1 2024-03-30T13:36:04.870 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:36:04 smithi099 ceph-mon[29691]: pgmap v5: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:36:05.006 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:36:04 smithi181 ceph-mon[25762]: from='client.24359 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "alertmanager", "placement": "1;smithi099=a", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T13:36:05.006 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:36:04 smithi181 ceph-mon[25762]: Saving service alertmanager spec with placement smithi099=a;count:1 2024-03-30T13:36:05.006 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:36:04 smithi181 ceph-mon[25762]: pgmap v5: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:36:06.977 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:36:06 smithi181 ceph-mon[25762]: pgmap v6: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:36:07.087 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:36:06 smithi099 ceph-mon[24912]: pgmap v6: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:36:07.087 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:36:06 smithi099 ceph-mon[29691]: pgmap v6: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:36:07.432 INFO:teuthology.orchestra.run.smithi181.stdout:Scheduled grafana update... 2024-03-30T13:36:08.322 DEBUG:teuthology.orchestra.run.smithi181:grafana.a> sudo journalctl -f -n 0 -u ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4@grafana.a.service 2024-03-30T13:36:08.324 INFO:tasks.cephadm:Setting up client nodes... 2024-03-30T13:36:08.327 DEBUG:teuthology.orchestra.run.smithi099:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 98ebaeb8-ee99-11ee-b647-cb9ed24678a4 -- ceph auth get-or-create client.0 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2024-03-30T13:36:08.648 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:36:08 smithi099 ceph-mon[24912]: from='client.24365 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "grafana", "placement": "1;smithi181=a", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T13:36:08.648 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:36:08 smithi099 ceph-mon[24912]: Saving service grafana spec with placement smithi181=a;count:1 2024-03-30T13:36:08.648 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:36:08 smithi099 ceph-mon[24912]: from='mgr.14439 ' entity='mgr.y' 2024-03-30T13:36:08.648 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:36:08 smithi099 ceph-mon[24912]: pgmap v7: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:36:08.648 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:36:08 smithi099 ceph-mon[29691]: from='client.24365 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "grafana", "placement": "1;smithi181=a", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T13:36:08.648 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:36:08 smithi099 ceph-mon[29691]: Saving service grafana spec with placement smithi181=a;count:1 2024-03-30T13:36:08.649 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:36:08 smithi099 ceph-mon[29691]: from='mgr.14439 ' entity='mgr.y' 2024-03-30T13:36:08.649 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:36:08 smithi099 ceph-mon[29691]: pgmap v7: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:36:08.755 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:36:08 smithi181 ceph-mon[25762]: from='client.24365 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "grafana", "placement": "1;smithi181=a", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T13:36:08.756 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:36:08 smithi181 ceph-mon[25762]: Saving service grafana spec with placement smithi181=a;count:1 2024-03-30T13:36:08.756 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:36:08 smithi181 ceph-mon[25762]: from='mgr.14439 ' entity='mgr.y' 2024-03-30T13:36:08.756 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:36:08 smithi181 ceph-mon[25762]: pgmap v7: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:36:10.414 INFO:teuthology.orchestra.run.smithi099.stdout:[client.0] 2024-03-30T13:36:10.414 INFO:teuthology.orchestra.run.smithi099.stdout: key = AQBKFQhmsnRpGBAAckOhGYANCyqljL3rJuoUUQ== 2024-03-30T13:36:10.837 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:36:10 smithi099 ceph-mon[24912]: pgmap v8: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:36:10.837 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:36:10 smithi099 ceph-mon[24912]: from='client.? 172.21.15.99:0/2888392741' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-03-30T13:36:10.837 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:36:10 smithi099 ceph-mon[24912]: from='client.? ' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-03-30T13:36:10.837 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:36:10 smithi099 ceph-mon[24912]: from='client.? ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-03-30T13:36:10.837 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:36:10 smithi099 ceph-mon[29691]: pgmap v8: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:36:10.837 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:36:10 smithi099 ceph-mon[29691]: from='client.? 172.21.15.99:0/2888392741' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-03-30T13:36:10.838 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:36:10 smithi099 ceph-mon[29691]: from='client.? ' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-03-30T13:36:10.838 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:36:10 smithi099 ceph-mon[29691]: from='client.? ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-03-30T13:36:11.006 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:36:10 smithi181 ceph-mon[25762]: pgmap v8: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:36:11.006 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:36:10 smithi181 ceph-mon[25762]: from='client.? 172.21.15.99:0/2888392741' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-03-30T13:36:11.006 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:36:10 smithi181 ceph-mon[25762]: from='client.? ' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-03-30T13:36:11.006 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:36:10 smithi181 ceph-mon[25762]: from='client.? ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-03-30T13:36:11.062 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2024-03-30T13:36:11.062 DEBUG:teuthology.orchestra.run.smithi099:> sudo dd of=/etc/ceph/ceph.client.0.keyring 2024-03-30T13:36:11.062 DEBUG:teuthology.orchestra.run.smithi099:> sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-03-30T13:36:11.107 DEBUG:teuthology.orchestra.run.smithi181:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 98ebaeb8-ee99-11ee-b647-cb9ed24678a4 -- ceph auth get-or-create client.1 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2024-03-30T13:36:12.979 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:36:12 smithi181 ceph-mon[25762]: pgmap v9: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:36:13.087 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:36:12 smithi099 ceph-mon[24912]: pgmap v9: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:36:13.087 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:36:12 smithi099 ceph-mon[29691]: pgmap v9: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:36:14.837 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:36:14 smithi099 ceph-mon[24912]: pgmap v10: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:36:14.837 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:36:14 smithi099 ceph-mon[29691]: pgmap v10: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:36:14.837 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:36:14 smithi181 ceph-mon[25762]: pgmap v10: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:36:16.835 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:36:16 smithi181 ceph-mon[25762]: pgmap v11: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:36:16.835 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:36:16 smithi181 ceph-mon[25762]: from='mgr.14439 ' entity='mgr.y' 2024-03-30T13:36:16.836 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:36:16 smithi181 ceph-mon[25762]: from='mgr.14439 ' entity='mgr.y' 2024-03-30T13:36:16.836 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:36:16 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[25141]: 172.21.15.181 - - [30/Mar/2024:13:36:16] "POST /data HTTP/1.1" 200 46 "" "Python-urllib/3.9" 2024-03-30T13:36:16.837 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:36:16 smithi099 ceph-mon[29691]: pgmap v11: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:36:16.837 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:36:16 smithi099 ceph-mon[29691]: from='mgr.14439 ' entity='mgr.y' 2024-03-30T13:36:16.837 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:36:16 smithi099 ceph-mon[29691]: from='mgr.14439 ' entity='mgr.y' 2024-03-30T13:36:16.837 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:36:16 smithi099 ceph-mon[24912]: pgmap v11: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:36:16.837 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:36:16 smithi099 ceph-mon[24912]: from='mgr.14439 ' entity='mgr.y' 2024-03-30T13:36:16.837 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:36:16 smithi099 ceph-mon[24912]: from='mgr.14439 ' entity='mgr.y' 2024-03-30T13:36:16.962 INFO:teuthology.orchestra.run.smithi181.stdout:[client.1] 2024-03-30T13:36:16.963 INFO:teuthology.orchestra.run.smithi181.stdout: key = AQBQFQhmCv8HORAADMzeUOHgTNYiujgejXmfFg== 2024-03-30T13:36:17.932 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:36:17 smithi181 ceph-mon[25762]: Detected new or changed devices on smithi181 2024-03-30T13:36:17.933 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:36:17 smithi181 ceph-mon[25762]: from='client.? 172.21.15.181:0/4094533572' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-03-30T13:36:17.933 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:36:17 smithi181 ceph-mon[25762]: from='client.? ' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-03-30T13:36:17.933 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:36:17 smithi181 ceph-mon[25762]: from='client.? ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-03-30T13:36:18.086 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:36:17 smithi099 ceph-mon[24912]: Detected new or changed devices on smithi181 2024-03-30T13:36:18.086 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:36:17 smithi099 ceph-mon[24912]: from='client.? 172.21.15.181:0/4094533572' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-03-30T13:36:18.086 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:36:17 smithi099 ceph-mon[24912]: from='client.? ' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-03-30T13:36:18.086 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:36:17 smithi099 ceph-mon[24912]: from='client.? ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-03-30T13:36:18.087 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:36:17 smithi099 ceph-mon[29691]: Detected new or changed devices on smithi181 2024-03-30T13:36:18.087 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:36:17 smithi099 ceph-mon[29691]: from='client.? 172.21.15.181:0/4094533572' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-03-30T13:36:18.087 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:36:17 smithi099 ceph-mon[29691]: from='client.? ' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-03-30T13:36:18.087 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:36:17 smithi099 ceph-mon[29691]: from='client.? ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-03-30T13:36:18.228 INFO:journalctl@ceph.prometheus.a.smithi181.stdout:Mar 30 13:36:18 smithi181 systemd[1]: Starting Ceph prometheus.a for 98ebaeb8-ee99-11ee-b647-cb9ed24678a4... 2024-03-30T13:36:18.967 DEBUG:teuthology.orchestra.run.smithi181:> set -ex 2024-03-30T13:36:18.967 DEBUG:teuthology.orchestra.run.smithi181:> sudo dd of=/etc/ceph/ceph.client.1.keyring 2024-03-30T13:36:18.968 DEBUG:teuthology.orchestra.run.smithi181:> sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2024-03-30T13:36:19.014 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-03-30T13:36:19.014 INFO:tasks.cephadm.ceph_manager.ceph:waiting for mgr available 2024-03-30T13:36:19.014 DEBUG:teuthology.orchestra.run.smithi099:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell --fsid 98ebaeb8-ee99-11ee-b647-cb9ed24678a4 -- ceph mgr dump --format=json 2024-03-30T13:36:19.198 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:36:18 smithi181 ceph-mon[25762]: pgmap v12: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:36:19.239 INFO:teuthology.orchestra.run.smithi099.stderr:Inferring config /var/lib/ceph/98ebaeb8-ee99-11ee-b647-cb9ed24678a4/mon.a/config 2024-03-30T13:36:19.336 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:36:18 smithi099 ceph-mon[24912]: pgmap v12: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:36:19.337 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:36:18 smithi099 ceph-mon[29691]: pgmap v12: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:36:19.468 INFO:journalctl@ceph.prometheus.a.smithi181.stdout:Mar 30 13:36:19 smithi181 podman[42152]: 2024-03-30 13:36:19.101445456 +0000 UTC m=+0.018934588 image pull 514e6a882f6e74806a5856468489eeff8d7106095557578da96935e4d0ba4d9d quay.io/prometheus/prometheus:v2.33.4 2024-03-30T13:36:19.468 INFO:journalctl@ceph.prometheus.a.smithi181.stdout:Mar 30 13:36:19 smithi181 podman[42152]: 2024-03-30 13:36:19.23098709 +0000 UTC m=+0.148476201 container create c27da06eacc2db3a3d99b22e562f9fd80efd12da3e98d9aaccd90b1f22e0ba16 (image=quay.io/prometheus/prometheus:v2.33.4, name=ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-prometheus-a, maintainer=The Prometheus Authors ) 2024-03-30T13:36:19.468 INFO:journalctl@ceph.prometheus.a.smithi181.stdout:Mar 30 13:36:19 smithi181 podman[42152]: 2024-03-30 13:36:19.441380121 +0000 UTC m=+0.358869242 container init c27da06eacc2db3a3d99b22e562f9fd80efd12da3e98d9aaccd90b1f22e0ba16 (image=quay.io/prometheus/prometheus:v2.33.4, name=ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-prometheus-a, maintainer=The Prometheus Authors ) 2024-03-30T13:36:19.468 INFO:journalctl@ceph.prometheus.a.smithi181.stdout:Mar 30 13:36:19 smithi181 podman[42152]: 2024-03-30 13:36:19.443924374 +0000 UTC m=+0.361413490 container start c27da06eacc2db3a3d99b22e562f9fd80efd12da3e98d9aaccd90b1f22e0ba16 (image=quay.io/prometheus/prometheus:v2.33.4, name=ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-prometheus-a, maintainer=The Prometheus Authors ) 2024-03-30T13:36:19.730 INFO:journalctl@ceph.prometheus.a.smithi181.stdout:Mar 30 13:36:19 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-prometheus-a[42166]: ts=2024-03-30T13:36:19.467Z caller=main.go:475 level=info msg="No time or size retention was set so using the default time retention" duration=15d 2024-03-30T13:36:19.730 INFO:journalctl@ceph.prometheus.a.smithi181.stdout:Mar 30 13:36:19 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-prometheus-a[42166]: ts=2024-03-30T13:36:19.467Z caller=main.go:512 level=info msg="Starting Prometheus" version="(version=2.33.4, branch=HEAD, revision=83032011a5d3e6102624fe58241a374a7201fee8)" 2024-03-30T13:36:19.730 INFO:journalctl@ceph.prometheus.a.smithi181.stdout:Mar 30 13:36:19 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-prometheus-a[42166]: ts=2024-03-30T13:36:19.467Z caller=main.go:517 level=info build_context="(go=go1.17.7, user=root@d13bf69e7be8, date=20220222-16:51:28)" 2024-03-30T13:36:19.730 INFO:journalctl@ceph.prometheus.a.smithi181.stdout:Mar 30 13:36:19 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-prometheus-a[42166]: ts=2024-03-30T13:36:19.467Z caller=main.go:518 level=info host_details="(Linux 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 x86_64 smithi181 (none))" 2024-03-30T13:36:19.730 INFO:journalctl@ceph.prometheus.a.smithi181.stdout:Mar 30 13:36:19 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-prometheus-a[42166]: ts=2024-03-30T13:36:19.467Z caller=main.go:519 level=info fd_limits="(soft=1048576, hard=1048576)" 2024-03-30T13:36:19.730 INFO:journalctl@ceph.prometheus.a.smithi181.stdout:Mar 30 13:36:19 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-prometheus-a[42166]: ts=2024-03-30T13:36:19.467Z caller=main.go:520 level=info vm_limits="(soft=unlimited, hard=unlimited)" 2024-03-30T13:36:19.730 INFO:journalctl@ceph.prometheus.a.smithi181.stdout:Mar 30 13:36:19 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-prometheus-a[42166]: ts=2024-03-30T13:36:19.468Z caller=web.go:570 level=info component=web msg="Start listening for connections" address=:9095 2024-03-30T13:36:19.731 INFO:journalctl@ceph.prometheus.a.smithi181.stdout:Mar 30 13:36:19 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-prometheus-a[42166]: ts=2024-03-30T13:36:19.469Z caller=main.go:923 level=info msg="Starting TSDB ..." 2024-03-30T13:36:19.731 INFO:journalctl@ceph.prometheus.a.smithi181.stdout:Mar 30 13:36:19 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-prometheus-a[42166]: ts=2024-03-30T13:36:19.471Z caller=tls_config.go:195 level=info component=web msg="TLS is disabled." http2=false 2024-03-30T13:36:19.731 INFO:journalctl@ceph.prometheus.a.smithi181.stdout:Mar 30 13:36:19 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-prometheus-a[42166]: ts=2024-03-30T13:36:19.472Z caller=head.go:493 level=info component=tsdb msg="Replaying on-disk memory mappable chunks if any" 2024-03-30T13:36:19.731 INFO:journalctl@ceph.prometheus.a.smithi181.stdout:Mar 30 13:36:19 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-prometheus-a[42166]: ts=2024-03-30T13:36:19.472Z caller=head.go:527 level=info component=tsdb msg="On-disk memory mappable chunks replay completed" duration=1.514µs 2024-03-30T13:36:19.731 INFO:journalctl@ceph.prometheus.a.smithi181.stdout:Mar 30 13:36:19 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-prometheus-a[42166]: ts=2024-03-30T13:36:19.472Z caller=head.go:533 level=info component=tsdb msg="Replaying WAL, this may take a while" 2024-03-30T13:36:19.731 INFO:journalctl@ceph.prometheus.a.smithi181.stdout:Mar 30 13:36:19 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-prometheus-a[42166]: ts=2024-03-30T13:36:19.472Z caller=head.go:604 level=info component=tsdb msg="WAL segment loaded" segment=0 maxSegment=0 2024-03-30T13:36:19.731 INFO:journalctl@ceph.prometheus.a.smithi181.stdout:Mar 30 13:36:19 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-prometheus-a[42166]: ts=2024-03-30T13:36:19.472Z caller=head.go:610 level=info component=tsdb msg="WAL replay completed" checkpoint_replay_duration=20.106µs wal_replay_duration=313.396µs total_replay_duration=351.996µs 2024-03-30T13:36:19.731 INFO:journalctl@ceph.prometheus.a.smithi181.stdout:Mar 30 13:36:19 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-prometheus-a[42166]: ts=2024-03-30T13:36:19.473Z caller=main.go:944 level=info fs_type=XFS_SUPER_MAGIC 2024-03-30T13:36:19.731 INFO:journalctl@ceph.prometheus.a.smithi181.stdout:Mar 30 13:36:19 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-prometheus-a[42166]: ts=2024-03-30T13:36:19.473Z caller=main.go:947 level=info msg="TSDB started" 2024-03-30T13:36:19.731 INFO:journalctl@ceph.prometheus.a.smithi181.stdout:Mar 30 13:36:19 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-prometheus-a[42166]: ts=2024-03-30T13:36:19.473Z caller=main.go:1128 level=info msg="Loading configuration file" filename=/etc/prometheus/prometheus.yml 2024-03-30T13:36:19.731 INFO:journalctl@ceph.prometheus.a.smithi181.stdout:Mar 30 13:36:19 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-prometheus-a[42166]: ts=2024-03-30T13:36:19.487Z caller=main.go:1165 level=info msg="Completed loading of configuration file" filename=/etc/prometheus/prometheus.yml totalDuration=14.155443ms db_storage=699ns remote_storage=1.118µs web_handler=274ns query_engine=784ns scrape=369.476µs scrape_sd=15.934µs notify=1.011µs notify_sd=1.928µs rules=13.602216ms 2024-03-30T13:36:19.731 INFO:journalctl@ceph.prometheus.a.smithi181.stdout:Mar 30 13:36:19 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-prometheus-a[42166]: ts=2024-03-30T13:36:19.487Z caller=main.go:896 level=info msg="Server is ready to receive web requests." 2024-03-30T13:36:19.731 INFO:journalctl@ceph.prometheus.a.smithi181.stdout:Mar 30 13:36:19 smithi181 bash[42152]: c27da06eacc2db3a3d99b22e562f9fd80efd12da3e98d9aaccd90b1f22e0ba16 2024-03-30T13:36:19.731 INFO:journalctl@ceph.prometheus.a.smithi181.stdout:Mar 30 13:36:19 smithi181 systemd[1]: Started Ceph prometheus.a for 98ebaeb8-ee99-11ee-b647-cb9ed24678a4. 2024-03-30T13:36:20.756 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:36:20 smithi181 ceph-mon[25762]: pgmap v13: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:36:20.756 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:36:20 smithi181 ceph-mon[25762]: from='mgr.14439 ' entity='mgr.y' 2024-03-30T13:36:20.756 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:36:20 smithi181 ceph-mon[25762]: Deploying daemon node-exporter.a on smithi099 2024-03-30T13:36:20.756 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:36:20 smithi181 ceph-mon[25762]: from='mgr.14439 ' entity='mgr.y' 2024-03-30T13:36:20.837 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:36:20 smithi099 ceph-mon[24912]: pgmap v13: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:36:20.837 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:36:20 smithi099 ceph-mon[24912]: from='mgr.14439 ' entity='mgr.y' 2024-03-30T13:36:20.837 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:36:20 smithi099 ceph-mon[24912]: Deploying daemon node-exporter.a on smithi099 2024-03-30T13:36:20.838 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:36:20 smithi099 ceph-mon[24912]: from='mgr.14439 ' entity='mgr.y' 2024-03-30T13:36:20.838 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:36:20 smithi099 ceph-mon[29691]: pgmap v13: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:36:20.838 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:36:20 smithi099 ceph-mon[29691]: from='mgr.14439 ' entity='mgr.y' 2024-03-30T13:36:20.838 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:36:20 smithi099 ceph-mon[29691]: Deploying daemon node-exporter.a on smithi099 2024-03-30T13:36:20.838 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:36:20 smithi099 ceph-mon[29691]: from='mgr.14439 ' entity='mgr.y' 2024-03-30T13:36:21.177 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-03-30T13:36:21.178 INFO:journalctl@ceph.node-exporter.a.smithi099.stdout:Mar 30 13:36:21 smithi099 bash[45607]: Trying to pull quay.io/prometheus/node-exporter:v1.3.1... 2024-03-30T13:36:22.006 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:36:21 smithi181 ceph-mon[25762]: from='client.? 172.21.15.99:0/3425050483' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-03-30T13:36:22.086 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:36:21 smithi099 ceph-mon[24912]: from='client.? 172.21.15.99:0/3425050483' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-03-30T13:36:22.087 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:36:21 smithi099 ceph-mon[29691]: from='client.? 172.21.15.99:0/3425050483' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-03-30T13:36:22.087 INFO:journalctl@ceph.node-exporter.a.smithi099.stdout:Mar 30 13:36:21 smithi099 bash[45607]: Getting image source signatures 2024-03-30T13:36:22.087 INFO:journalctl@ceph.node-exporter.a.smithi099.stdout:Mar 30 13:36:21 smithi099 bash[45607]: Copying blob sha256:b5db1e299295edf3005515ab7879c1df64a33c185d3a7a23aa4dcaa17d26f7b3 2024-03-30T13:36:22.087 INFO:journalctl@ceph.node-exporter.a.smithi099.stdout:Mar 30 13:36:21 smithi099 bash[45607]: Copying blob sha256:aa2a8d90b84cb2a9c422e7005cd166a008ccf22ef5d7d4f07128478585ce35ea 2024-03-30T13:36:22.087 INFO:journalctl@ceph.node-exporter.a.smithi099.stdout:Mar 30 13:36:21 smithi099 bash[45607]: Copying blob sha256:b45d31ee2d7f9f452678a85b0c837c29e12089f31ee8dbac6c8c24dfa4054a30 2024-03-30T13:36:22.307 INFO:teuthology.orchestra.run.smithi099.stdout:{"epoch":19,"active_gid":14439,"active_name":"y","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6800","nonce":995392081},{"type":"v1","addr":"172.21.15.99:6801","nonce":995392081}]},"active_addr":"172.21.15.99:6801/995392081","active_change":"2024-03-30T13:35:58.813486+0000","active_mgr_features":4540138303579357183,"available":true,"standbys":[{"gid":24317,"name":"x","mgr_features":4540138303579357183,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.23.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:8.3.5","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"docker.io/library/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"docker.io/arcts/keepalived","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.3.1","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.33.4","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"noautoscale":{"name":"noautoscale","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"global autoscale flag","long_desc":"Option to turn on/off the autoscaler for all pools","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["cephadm","dashboard","iostat","nfs","prometheus","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.23.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:8.3.5","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"docker.io/library/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"docker.io/arcts/keepalived","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.3.1","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.33.4","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"noautoscale":{"name":"noautoscale","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"global autoscale flag","long_desc":"Option to turn on/off the autoscaler for all pools","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{"dashboard":"https://172.21.15.99:8443/","prometheus":"http://172.21.15.99:9283/"},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"last_failure_osd_epoch":60,"active_clients":[{"addrvec":[{"type":"v2","addr":"172.21.15.99:0","nonce":1421105802}]},{"addrvec":[{"type":"v2","addr":"172.21.15.99:0","nonce":1556138711}]},{"addrvec":[{"type":"v2","addr":"172.21.15.99:0","nonce":1422060755}]},{"addrvec":[{"type":"v2","addr":"172.21.15.99:0","nonce":1053708127}]}]}} 2024-03-30T13:36:22.311 INFO:tasks.cephadm.ceph_manager.ceph:mgr available! 2024-03-30T13:36:22.311 INFO:tasks.cephadm.ceph_manager.ceph:waiting for all up 2024-03-30T13:36:22.311 DEBUG:teuthology.orchestra.run.smithi099:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell --fsid 98ebaeb8-ee99-11ee-b647-cb9ed24678a4 -- ceph osd dump --format=json 2024-03-30T13:36:22.667 INFO:teuthology.orchestra.run.smithi099.stderr:Inferring config /var/lib/ceph/98ebaeb8-ee99-11ee-b647-cb9ed24678a4/mon.a/config 2024-03-30T13:36:22.902 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:36:22 smithi181 ceph-mon[25762]: pgmap v14: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:36:22.955 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:36:22 smithi099 ceph-mon[24912]: pgmap v14: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:36:22.956 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:36:22 smithi099 ceph-mon[29691]: pgmap v14: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:36:22.956 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:36:22 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[25141]: 172.21.15.99 - - [30/Mar/2024:13:36:22] "POST /data HTTP/1.1" 200 46 "" "Python-urllib/3.9" 2024-03-30T13:36:23.899 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:36:23 smithi181 ceph-mon[25762]: from='mgr.14439 ' entity='mgr.y' 2024-03-30T13:36:23.899 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:36:23 smithi181 ceph-mon[25762]: from='mgr.14439 ' entity='mgr.y' 2024-03-30T13:36:24.087 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:36:23 smithi099 ceph-mon[24912]: from='mgr.14439 ' entity='mgr.y' 2024-03-30T13:36:24.087 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:36:23 smithi099 ceph-mon[24912]: from='mgr.14439 ' entity='mgr.y' 2024-03-30T13:36:24.087 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:36:24 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[25141]: 172.21.15.181 - - [30/Mar/2024:13:36:24] "POST /data HTTP/1.1" 200 46 "" "Python-urllib/3.9" 2024-03-30T13:36:24.087 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:36:23 smithi099 ceph-mon[29691]: from='mgr.14439 ' entity='mgr.y' 2024-03-30T13:36:24.088 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:36:23 smithi099 ceph-mon[29691]: from='mgr.14439 ' entity='mgr.y' 2024-03-30T13:36:24.836 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-03-30T13:36:24.836 INFO:teuthology.orchestra.run.smithi099.stdout:{"epoch":60,"fsid":"98ebaeb8-ee99-11ee-b647-cb9ed24678a4","created":"2024-03-30T13:30:46.740035+0000","modified":"2024-03-30T13:35:58.813133+0000","last_up_change":"2024-03-30T13:35:41.547669+0000","last_in_change":"2024-03-30T13:35:23.656525+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":18,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-30T13:33:44.717293+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"c684cee9-dc80-4a4a-8db8-8553daf0cc4f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6802","nonce":558005496},{"type":"v1","addr":"172.21.15.99:6803","nonce":558005496}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6804","nonce":558005496},{"type":"v1","addr":"172.21.15.99:6805","nonce":558005496}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6808","nonce":558005496},{"type":"v1","addr":"172.21.15.99:6809","nonce":558005496}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6806","nonce":558005496},{"type":"v1","addr":"172.21.15.99:6807","nonce":558005496}]},"public_addr":"172.21.15.99:6803/558005496","cluster_addr":"172.21.15.99:6805/558005496","heartbeat_back_addr":"172.21.15.99:6809/558005496","heartbeat_front_addr":"172.21.15.99:6807/558005496","state":["exists","up"]},{"osd":1,"uuid":"41383fae-9172-4ba2-8a94-85a125de98e2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6810","nonce":2317835991},{"type":"v1","addr":"172.21.15.99:6811","nonce":2317835991}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6812","nonce":2317835991},{"type":"v1","addr":"172.21.15.99:6813","nonce":2317835991}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6816","nonce":2317835991},{"type":"v1","addr":"172.21.15.99:6817","nonce":2317835991}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6814","nonce":2317835991},{"type":"v1","addr":"172.21.15.99:6815","nonce":2317835991}]},"public_addr":"172.21.15.99:6811/2317835991","cluster_addr":"172.21.15.99:6813/2317835991","heartbeat_back_addr":"172.21.15.99:6817/2317835991","heartbeat_front_addr":"172.21.15.99:6815/2317835991","state":["exists","up"]},{"osd":2,"uuid":"c7ec9bfb-f6a2-444d-a004-391f602f07ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6818","nonce":770589655},{"type":"v1","addr":"172.21.15.99:6819","nonce":770589655}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6820","nonce":770589655},{"type":"v1","addr":"172.21.15.99:6821","nonce":770589655}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6824","nonce":770589655},{"type":"v1","addr":"172.21.15.99:6825","nonce":770589655}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6822","nonce":770589655},{"type":"v1","addr":"172.21.15.99:6823","nonce":770589655}]},"public_addr":"172.21.15.99:6819/770589655","cluster_addr":"172.21.15.99:6821/770589655","heartbeat_back_addr":"172.21.15.99:6825/770589655","heartbeat_front_addr":"172.21.15.99:6823/770589655","state":["exists","up"]},{"osd":3,"uuid":"ed272b2b-e9e4-42f7-bf4b-12b5c3d7b90e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6826","nonce":2046550873},{"type":"v1","addr":"172.21.15.99:6827","nonce":2046550873}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6828","nonce":2046550873},{"type":"v1","addr":"172.21.15.99:6829","nonce":2046550873}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6832","nonce":2046550873},{"type":"v1","addr":"172.21.15.99:6833","nonce":2046550873}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6830","nonce":2046550873},{"type":"v1","addr":"172.21.15.99:6831","nonce":2046550873}]},"public_addr":"172.21.15.99:6827/2046550873","cluster_addr":"172.21.15.99:6829/2046550873","heartbeat_back_addr":"172.21.15.99:6833/2046550873","heartbeat_front_addr":"172.21.15.99:6831/2046550873","state":["exists","up"]},{"osd":4,"uuid":"cfa9365d-3adb-4f07-94a0-1ae739a22d74","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6800","nonce":2876720616},{"type":"v1","addr":"172.21.15.181:6801","nonce":2876720616}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6802","nonce":2876720616},{"type":"v1","addr":"172.21.15.181:6803","nonce":2876720616}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6806","nonce":2876720616},{"type":"v1","addr":"172.21.15.181:6807","nonce":2876720616}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6804","nonce":2876720616},{"type":"v1","addr":"172.21.15.181:6805","nonce":2876720616}]},"public_addr":"172.21.15.181:6801/2876720616","cluster_addr":"172.21.15.181:6803/2876720616","heartbeat_back_addr":"172.21.15.181:6807/2876720616","heartbeat_front_addr":"172.21.15.181:6805/2876720616","state":["exists","up"]},{"osd":5,"uuid":"7c7289ba-f1a8-4b64-99d4-e42343eb5f49","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6808","nonce":1648947487},{"type":"v1","addr":"172.21.15.181:6809","nonce":1648947487}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6810","nonce":1648947487},{"type":"v1","addr":"172.21.15.181:6811","nonce":1648947487}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6814","nonce":1648947487},{"type":"v1","addr":"172.21.15.181:6815","nonce":1648947487}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6812","nonce":1648947487},{"type":"v1","addr":"172.21.15.181:6813","nonce":1648947487}]},"public_addr":"172.21.15.181:6809/1648947487","cluster_addr":"172.21.15.181:6811/1648947487","heartbeat_back_addr":"172.21.15.181:6815/1648947487","heartbeat_front_addr":"172.21.15.181:6813/1648947487","state":["exists","up"]},{"osd":6,"uuid":"eee64a05-4d3a-4ba4-b1d2-43a9aeec31ed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6816","nonce":4097845576},{"type":"v1","addr":"172.21.15.181:6817","nonce":4097845576}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6818","nonce":4097845576},{"type":"v1","addr":"172.21.15.181:6819","nonce":4097845576}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6822","nonce":4097845576},{"type":"v1","addr":"172.21.15.181:6823","nonce":4097845576}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6820","nonce":4097845576},{"type":"v1","addr":"172.21.15.181:6821","nonce":4097845576}]},"public_addr":"172.21.15.181:6817/4097845576","cluster_addr":"172.21.15.181:6819/4097845576","heartbeat_back_addr":"172.21.15.181:6823/4097845576","heartbeat_front_addr":"172.21.15.181:6821/4097845576","state":["exists","up"]},{"osd":7,"uuid":"165196c5-8792-4379-87ba-bb9917938028","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":55,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6824","nonce":1455575993},{"type":"v1","addr":"172.21.15.181:6825","nonce":1455575993}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6826","nonce":1455575993},{"type":"v1","addr":"172.21.15.181:6827","nonce":1455575993}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6830","nonce":1455575993},{"type":"v1","addr":"172.21.15.181:6831","nonce":1455575993}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6828","nonce":1455575993},{"type":"v1","addr":"172.21.15.181:6829","nonce":1455575993}]},"public_addr":"172.21.15.181:6825/1455575993","cluster_addr":"172.21.15.181:6827/1455575993","heartbeat_back_addr":"172.21.15.181:6831/1455575993","heartbeat_front_addr":"172.21.15.181:6829/1455575993","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:32:53.321390+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:33:16.239976+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:33:40.545655+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:34:04.901544+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:34:27.871028+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:34:50.499151+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:35:14.795730+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:35:39.703762+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.99:0/2227521083":"2024-03-31T13:35:58.813099+0000","172.21.15.99:0/2680510373":"2024-03-31T13:35:58.813099+0000","172.21.15.99:6801/1198750999":"2024-03-31T13:35:58.813099+0000","172.21.15.99:0/1283915670":"2024-03-31T13:31:32.352898+0000","172.21.15.99:0/3435366269":"2024-03-31T13:35:58.813099+0000","172.21.15.99:6800/639013456":"2024-03-31T13:31:32.352898+0000","172.21.15.99:6801/639013456":"2024-03-31T13:31:32.352898+0000","172.21.15.99:0/2902659920":"2024-03-31T13:31:32.352898+0000","172.21.15.99:0/3964022543":"2024-03-31T13:31:32.352898+0000","172.21.15.99:0/3234417163":"2024-03-31T13:31:10.668046+0000","172.21.15.99:6800/1198750999":"2024-03-31T13:35:58.813099+0000","172.21.15.99:0/3448119368":"2024-03-31T13:31:10.668046+0000","172.21.15.99:6800/4092149076":"2024-03-31T13:31:10.668046+0000","172.21.15.99:0/3858852026":"2024-03-31T13:35:58.813099+0000","172.21.15.99:0/2799400391":"2024-03-31T13:31:10.668046+0000","172.21.15.99:6801/4092149076":"2024-03-31T13:31:10.668046+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-30T13:36:25.186 INFO:journalctl@ceph.node-exporter.a.smithi099.stdout:Mar 30 13:36:24 smithi099 bash[45607]: Copying config sha256:1dbe0e931976487e20e5cfb272087e08a9779c88fd5e9617ed7042dd9751ec26 2024-03-30T13:36:25.186 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:36:25 smithi099 ceph-mon[24912]: pgmap v15: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:36:25.186 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:36:25 smithi099 ceph-mon[24912]: from='mgr.14439 ' entity='mgr.y' 2024-03-30T13:36:25.186 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:36:25 smithi099 ceph-mon[24912]: from='client.? 172.21.15.99:0/2309027688' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-30T13:36:25.186 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:36:25 smithi099 ceph-mon[24912]: from='mgr.14439 ' entity='mgr.y' 2024-03-30T13:36:25.186 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:36:25 smithi099 ceph-mon[24912]: from='mgr.14439 ' entity='mgr.y' 2024-03-30T13:36:25.187 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:36:24 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[25141]: 172.21.15.181 - - [30/Mar/2024:13:36:24] "POST /data HTTP/1.1" 200 46 "" "Python-urllib/3.9" 2024-03-30T13:36:25.187 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:36:25 smithi099 ceph-mon[29691]: pgmap v15: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:36:25.187 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:36:25 smithi099 ceph-mon[29691]: from='mgr.14439 ' entity='mgr.y' 2024-03-30T13:36:25.187 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:36:25 smithi099 ceph-mon[29691]: from='client.? 172.21.15.99:0/2309027688' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-30T13:36:25.187 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:36:25 smithi099 ceph-mon[29691]: from='mgr.14439 ' entity='mgr.y' 2024-03-30T13:36:25.187 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:36:25 smithi099 ceph-mon[29691]: from='mgr.14439 ' entity='mgr.y' 2024-03-30T13:36:25.255 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:36:25 smithi181 ceph-mon[25762]: pgmap v15: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:36:25.256 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:36:25 smithi181 ceph-mon[25762]: from='mgr.14439 ' entity='mgr.y' 2024-03-30T13:36:25.256 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:36:25 smithi181 ceph-mon[25762]: from='client.? 172.21.15.99:0/2309027688' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-30T13:36:25.256 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:36:25 smithi181 ceph-mon[25762]: from='mgr.14439 ' entity='mgr.y' 2024-03-30T13:36:25.256 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:36:25 smithi181 ceph-mon[25762]: from='mgr.14439 ' entity='mgr.y' 2024-03-30T13:36:25.586 INFO:journalctl@ceph.node-exporter.a.smithi099.stdout:Mar 30 13:36:25 smithi099 bash[45607]: Writing manifest to image destination 2024-03-30T13:36:25.927 INFO:journalctl@ceph.node-exporter.a.smithi099.stdout:Mar 30 13:36:25 smithi099 podman[45607]: 2024-03-30 13:36:25.499787944 +0000 UTC m=+4.765226312 image pull 1dbe0e931976487e20e5cfb272087e08a9779c88fd5e9617ed7042dd9751ec26 quay.io/prometheus/node-exporter:v1.3.1 2024-03-30T13:36:25.927 INFO:journalctl@ceph.node-exporter.a.smithi099.stdout:Mar 30 13:36:25 smithi099 podman[45607]: 2024-03-30 13:36:25.699576728 +0000 UTC m=+4.965015120 container create ad756dd8c3f9d4a77fe080331c99db18358a30037602413befd82919f17ed4f8 (image=quay.io/prometheus/node-exporter:v1.3.1, name=ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-node-exporter-a, maintainer=The Prometheus Authors ) 2024-03-30T13:36:26.289 INFO:journalctl@ceph.node-exporter.a.smithi099.stdout:Mar 30 13:36:26 smithi099 podman[45607]: 2024-03-30 13:36:26.027392967 +0000 UTC m=+5.292831320 container init ad756dd8c3f9d4a77fe080331c99db18358a30037602413befd82919f17ed4f8 (image=quay.io/prometheus/node-exporter:v1.3.1, name=ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-node-exporter-a, maintainer=The Prometheus Authors ) 2024-03-30T13:36:26.289 INFO:journalctl@ceph.node-exporter.a.smithi099.stdout:Mar 30 13:36:26 smithi099 podman[45607]: 2024-03-30 13:36:26.030193282 +0000 UTC m=+5.295631632 container start ad756dd8c3f9d4a77fe080331c99db18358a30037602413befd82919f17ed4f8 (image=quay.io/prometheus/node-exporter:v1.3.1, name=ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-node-exporter-a, maintainer=The Prometheus Authors ) 2024-03-30T13:36:26.289 INFO:journalctl@ceph.node-exporter.a.smithi099.stdout:Mar 30 13:36:26 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-node-exporter-a[45875]: ts=2024-03-30T13:36:26.033Z caller=node_exporter.go:182 level=info msg="Starting node_exporter" version="(version=1.3.1, branch=HEAD, revision=a2321e7b940ddcff26873612bccdf7cd4c42b6b6)" 2024-03-30T13:36:26.289 INFO:journalctl@ceph.node-exporter.a.smithi099.stdout:Mar 30 13:36:26 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-node-exporter-a[45875]: ts=2024-03-30T13:36:26.033Z caller=node_exporter.go:183 level=info msg="Build context" build_context="(go=go1.17.3, user=root@243aafa5525c, date=20211205-11:09:49)" 2024-03-30T13:36:26.290 INFO:journalctl@ceph.node-exporter.a.smithi099.stdout:Mar 30 13:36:26 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-node-exporter-a[45875]: ts=2024-03-30T13:36:26.034Z caller=filesystem_common.go:111 level=info collector=filesystem msg="Parsed flag --collector.filesystem.mount-points-exclude" flag=^/(dev|proc|run/credentials/.+|sys|var/lib/docker/.+)($|/) 2024-03-30T13:36:26.290 INFO:journalctl@ceph.node-exporter.a.smithi099.stdout:Mar 30 13:36:26 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-node-exporter-a[45875]: ts=2024-03-30T13:36:26.034Z caller=filesystem_common.go:113 level=info collector=filesystem msg="Parsed flag --collector.filesystem.fs-types-exclude" flag=^(autofs|binfmt_misc|bpf|cgroup2?|configfs|debugfs|devpts|devtmpfs|fusectl|hugetlbfs|iso9660|mqueue|nsfs|overlay|proc|procfs|pstore|rpc_pipefs|securityfs|selinuxfs|squashfs|sysfs|tracefs)$ 2024-03-30T13:36:26.290 INFO:journalctl@ceph.node-exporter.a.smithi099.stdout:Mar 30 13:36:26 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-node-exporter-a[45875]: ts=2024-03-30T13:36:26.034Z caller=node_exporter.go:108 level=info msg="Enabled collectors" 2024-03-30T13:36:26.290 INFO:journalctl@ceph.node-exporter.a.smithi099.stdout:Mar 30 13:36:26 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-node-exporter-a[45875]: ts=2024-03-30T13:36:26.034Z caller=node_exporter.go:115 level=info collector=arp 2024-03-30T13:36:26.290 INFO:journalctl@ceph.node-exporter.a.smithi099.stdout:Mar 30 13:36:26 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-node-exporter-a[45875]: ts=2024-03-30T13:36:26.034Z caller=node_exporter.go:115 level=info collector=bcache 2024-03-30T13:36:26.290 INFO:journalctl@ceph.node-exporter.a.smithi099.stdout:Mar 30 13:36:26 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-node-exporter-a[45875]: ts=2024-03-30T13:36:26.034Z caller=node_exporter.go:115 level=info collector=bonding 2024-03-30T13:36:26.290 INFO:journalctl@ceph.node-exporter.a.smithi099.stdout:Mar 30 13:36:26 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-node-exporter-a[45875]: ts=2024-03-30T13:36:26.034Z caller=node_exporter.go:115 level=info collector=btrfs 2024-03-30T13:36:26.290 INFO:journalctl@ceph.node-exporter.a.smithi099.stdout:Mar 30 13:36:26 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-node-exporter-a[45875]: ts=2024-03-30T13:36:26.034Z caller=node_exporter.go:115 level=info collector=conntrack 2024-03-30T13:36:26.290 INFO:journalctl@ceph.node-exporter.a.smithi099.stdout:Mar 30 13:36:26 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-node-exporter-a[45875]: ts=2024-03-30T13:36:26.034Z caller=node_exporter.go:115 level=info collector=cpu 2024-03-30T13:36:26.290 INFO:journalctl@ceph.node-exporter.a.smithi099.stdout:Mar 30 13:36:26 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-node-exporter-a[45875]: ts=2024-03-30T13:36:26.034Z caller=node_exporter.go:115 level=info collector=cpufreq 2024-03-30T13:36:26.290 INFO:journalctl@ceph.node-exporter.a.smithi099.stdout:Mar 30 13:36:26 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-node-exporter-a[45875]: ts=2024-03-30T13:36:26.034Z caller=node_exporter.go:115 level=info collector=diskstats 2024-03-30T13:36:26.290 INFO:journalctl@ceph.node-exporter.a.smithi099.stdout:Mar 30 13:36:26 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-node-exporter-a[45875]: ts=2024-03-30T13:36:26.034Z caller=node_exporter.go:115 level=info collector=dmi 2024-03-30T13:36:26.290 INFO:journalctl@ceph.node-exporter.a.smithi099.stdout:Mar 30 13:36:26 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-node-exporter-a[45875]: ts=2024-03-30T13:36:26.035Z caller=node_exporter.go:115 level=info collector=edac 2024-03-30T13:36:26.290 INFO:journalctl@ceph.node-exporter.a.smithi099.stdout:Mar 30 13:36:26 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-node-exporter-a[45875]: ts=2024-03-30T13:36:26.035Z caller=node_exporter.go:115 level=info collector=entropy 2024-03-30T13:36:26.291 INFO:journalctl@ceph.node-exporter.a.smithi099.stdout:Mar 30 13:36:26 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-node-exporter-a[45875]: ts=2024-03-30T13:36:26.035Z caller=node_exporter.go:115 level=info collector=fibrechannel 2024-03-30T13:36:26.291 INFO:journalctl@ceph.node-exporter.a.smithi099.stdout:Mar 30 13:36:26 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-node-exporter-a[45875]: ts=2024-03-30T13:36:26.035Z caller=node_exporter.go:115 level=info collector=filefd 2024-03-30T13:36:26.291 INFO:journalctl@ceph.node-exporter.a.smithi099.stdout:Mar 30 13:36:26 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-node-exporter-a[45875]: ts=2024-03-30T13:36:26.035Z caller=node_exporter.go:115 level=info collector=filesystem 2024-03-30T13:36:26.291 INFO:journalctl@ceph.node-exporter.a.smithi099.stdout:Mar 30 13:36:26 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-node-exporter-a[45875]: ts=2024-03-30T13:36:26.035Z caller=node_exporter.go:115 level=info collector=hwmon 2024-03-30T13:36:26.291 INFO:journalctl@ceph.node-exporter.a.smithi099.stdout:Mar 30 13:36:26 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-node-exporter-a[45875]: ts=2024-03-30T13:36:26.035Z caller=node_exporter.go:115 level=info collector=infiniband 2024-03-30T13:36:26.291 INFO:journalctl@ceph.node-exporter.a.smithi099.stdout:Mar 30 13:36:26 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-node-exporter-a[45875]: ts=2024-03-30T13:36:26.035Z caller=node_exporter.go:115 level=info collector=ipvs 2024-03-30T13:36:26.291 INFO:journalctl@ceph.node-exporter.a.smithi099.stdout:Mar 30 13:36:26 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-node-exporter-a[45875]: ts=2024-03-30T13:36:26.035Z caller=node_exporter.go:115 level=info collector=loadavg 2024-03-30T13:36:26.291 INFO:journalctl@ceph.node-exporter.a.smithi099.stdout:Mar 30 13:36:26 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-node-exporter-a[45875]: ts=2024-03-30T13:36:26.035Z caller=node_exporter.go:115 level=info collector=mdadm 2024-03-30T13:36:26.291 INFO:journalctl@ceph.node-exporter.a.smithi099.stdout:Mar 30 13:36:26 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-node-exporter-a[45875]: ts=2024-03-30T13:36:26.035Z caller=node_exporter.go:115 level=info collector=meminfo 2024-03-30T13:36:26.291 INFO:journalctl@ceph.node-exporter.a.smithi099.stdout:Mar 30 13:36:26 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-node-exporter-a[45875]: ts=2024-03-30T13:36:26.035Z caller=node_exporter.go:115 level=info collector=netclass 2024-03-30T13:36:26.291 INFO:journalctl@ceph.node-exporter.a.smithi099.stdout:Mar 30 13:36:26 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-node-exporter-a[45875]: ts=2024-03-30T13:36:26.035Z caller=node_exporter.go:115 level=info collector=netdev 2024-03-30T13:36:26.291 INFO:journalctl@ceph.node-exporter.a.smithi099.stdout:Mar 30 13:36:26 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-node-exporter-a[45875]: ts=2024-03-30T13:36:26.035Z caller=node_exporter.go:115 level=info collector=netstat 2024-03-30T13:36:26.291 INFO:journalctl@ceph.node-exporter.a.smithi099.stdout:Mar 30 13:36:26 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-node-exporter-a[45875]: ts=2024-03-30T13:36:26.035Z caller=node_exporter.go:115 level=info collector=nfs 2024-03-30T13:36:26.291 INFO:journalctl@ceph.node-exporter.a.smithi099.stdout:Mar 30 13:36:26 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-node-exporter-a[45875]: ts=2024-03-30T13:36:26.035Z caller=node_exporter.go:115 level=info collector=nfsd 2024-03-30T13:36:26.291 INFO:journalctl@ceph.node-exporter.a.smithi099.stdout:Mar 30 13:36:26 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-node-exporter-a[45875]: ts=2024-03-30T13:36:26.035Z caller=node_exporter.go:115 level=info collector=nvme 2024-03-30T13:36:26.292 INFO:journalctl@ceph.node-exporter.a.smithi099.stdout:Mar 30 13:36:26 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-node-exporter-a[45875]: ts=2024-03-30T13:36:26.035Z caller=node_exporter.go:115 level=info collector=os 2024-03-30T13:36:26.292 INFO:journalctl@ceph.node-exporter.a.smithi099.stdout:Mar 30 13:36:26 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-node-exporter-a[45875]: ts=2024-03-30T13:36:26.035Z caller=node_exporter.go:115 level=info collector=powersupplyclass 2024-03-30T13:36:26.292 INFO:journalctl@ceph.node-exporter.a.smithi099.stdout:Mar 30 13:36:26 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-node-exporter-a[45875]: ts=2024-03-30T13:36:26.035Z caller=node_exporter.go:115 level=info collector=pressure 2024-03-30T13:36:26.292 INFO:journalctl@ceph.node-exporter.a.smithi099.stdout:Mar 30 13:36:26 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-node-exporter-a[45875]: ts=2024-03-30T13:36:26.035Z caller=node_exporter.go:115 level=info collector=rapl 2024-03-30T13:36:26.292 INFO:journalctl@ceph.node-exporter.a.smithi099.stdout:Mar 30 13:36:26 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-node-exporter-a[45875]: ts=2024-03-30T13:36:26.035Z caller=node_exporter.go:115 level=info collector=schedstat 2024-03-30T13:36:26.292 INFO:journalctl@ceph.node-exporter.a.smithi099.stdout:Mar 30 13:36:26 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-node-exporter-a[45875]: ts=2024-03-30T13:36:26.035Z caller=node_exporter.go:115 level=info collector=sockstat 2024-03-30T13:36:26.292 INFO:journalctl@ceph.node-exporter.a.smithi099.stdout:Mar 30 13:36:26 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-node-exporter-a[45875]: ts=2024-03-30T13:36:26.035Z caller=node_exporter.go:115 level=info collector=softnet 2024-03-30T13:36:26.292 INFO:journalctl@ceph.node-exporter.a.smithi099.stdout:Mar 30 13:36:26 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-node-exporter-a[45875]: ts=2024-03-30T13:36:26.035Z caller=node_exporter.go:115 level=info collector=stat 2024-03-30T13:36:26.292 INFO:journalctl@ceph.node-exporter.a.smithi099.stdout:Mar 30 13:36:26 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-node-exporter-a[45875]: ts=2024-03-30T13:36:26.035Z caller=node_exporter.go:115 level=info collector=tapestats 2024-03-30T13:36:26.292 INFO:journalctl@ceph.node-exporter.a.smithi099.stdout:Mar 30 13:36:26 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-node-exporter-a[45875]: ts=2024-03-30T13:36:26.035Z caller=node_exporter.go:115 level=info collector=textfile 2024-03-30T13:36:26.293 INFO:journalctl@ceph.node-exporter.a.smithi099.stdout:Mar 30 13:36:26 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-node-exporter-a[45875]: ts=2024-03-30T13:36:26.035Z caller=node_exporter.go:115 level=info collector=thermal_zone 2024-03-30T13:36:26.293 INFO:journalctl@ceph.node-exporter.a.smithi099.stdout:Mar 30 13:36:26 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-node-exporter-a[45875]: ts=2024-03-30T13:36:26.035Z caller=node_exporter.go:115 level=info collector=time 2024-03-30T13:36:26.293 INFO:journalctl@ceph.node-exporter.a.smithi099.stdout:Mar 30 13:36:26 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-node-exporter-a[45875]: ts=2024-03-30T13:36:26.035Z caller=node_exporter.go:115 level=info collector=udp_queues 2024-03-30T13:36:26.293 INFO:journalctl@ceph.node-exporter.a.smithi099.stdout:Mar 30 13:36:26 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-node-exporter-a[45875]: ts=2024-03-30T13:36:26.035Z caller=node_exporter.go:115 level=info collector=uname 2024-03-30T13:36:26.293 INFO:journalctl@ceph.node-exporter.a.smithi099.stdout:Mar 30 13:36:26 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-node-exporter-a[45875]: ts=2024-03-30T13:36:26.035Z caller=node_exporter.go:115 level=info collector=vmstat 2024-03-30T13:36:26.293 INFO:journalctl@ceph.node-exporter.a.smithi099.stdout:Mar 30 13:36:26 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-node-exporter-a[45875]: ts=2024-03-30T13:36:26.035Z caller=node_exporter.go:115 level=info collector=xfs 2024-03-30T13:36:26.293 INFO:journalctl@ceph.node-exporter.a.smithi099.stdout:Mar 30 13:36:26 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-node-exporter-a[45875]: ts=2024-03-30T13:36:26.035Z caller=node_exporter.go:115 level=info collector=zfs 2024-03-30T13:36:26.293 INFO:journalctl@ceph.node-exporter.a.smithi099.stdout:Mar 30 13:36:26 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-node-exporter-a[45875]: ts=2024-03-30T13:36:26.035Z caller=node_exporter.go:199 level=info msg="Listening on" address=:9100 2024-03-30T13:36:26.293 INFO:journalctl@ceph.node-exporter.a.smithi099.stdout:Mar 30 13:36:26 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-node-exporter-a[45875]: ts=2024-03-30T13:36:26.035Z caller=tls_config.go:195 level=info msg="TLS is disabled." http2=false 2024-03-30T13:36:26.293 INFO:journalctl@ceph.node-exporter.a.smithi099.stdout:Mar 30 13:36:26 smithi099 bash[45607]: ad756dd8c3f9d4a77fe080331c99db18358a30037602413befd82919f17ed4f8 2024-03-30T13:36:26.547 INFO:journalctl@ceph.node-exporter.a.smithi099.stdout:Mar 30 13:36:26 smithi099 systemd[1]: Started Ceph node-exporter.a for 98ebaeb8-ee99-11ee-b647-cb9ed24678a4. 2024-03-30T13:36:26.837 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:36:26 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[25141]: ::ffff:172.21.15.181 - - [30/Mar/2024:13:36:26] "GET /metrics HTTP/1.1" 200 191510 "" "Prometheus/2.33.4" 2024-03-30T13:36:27.243 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:36:27 smithi181 ceph-mon[25762]: pgmap v16: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:36:27.243 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:36:27 smithi181 ceph-mon[25762]: from='mgr.14439 ' entity='mgr.y' 2024-03-30T13:36:27.244 INFO:journalctl@ceph.node-exporter.b.smithi181.stdout:Mar 30 13:36:27 smithi181 systemd[1]: Starting Ceph node-exporter.b for 98ebaeb8-ee99-11ee-b647-cb9ed24678a4... 2024-03-30T13:36:27.336 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:36:27 smithi099 ceph-mon[24912]: pgmap v16: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:36:27.337 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:36:27 smithi099 ceph-mon[24912]: from='mgr.14439 ' entity='mgr.y' 2024-03-30T13:36:27.337 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:36:27 smithi099 ceph-mon[29691]: pgmap v16: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:36:27.337 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:36:27 smithi099 ceph-mon[29691]: from='mgr.14439 ' entity='mgr.y' 2024-03-30T13:36:27.506 INFO:journalctl@ceph.node-exporter.b.smithi181.stdout:Mar 30 13:36:27 smithi181 bash[42961]: Trying to pull quay.io/prometheus/node-exporter:v1.3.1... 2024-03-30T13:36:28.006 INFO:journalctl@ceph.node-exporter.b.smithi181.stdout:Mar 30 13:36:27 smithi181 bash[42961]: Getting image source signatures 2024-03-30T13:36:28.006 INFO:journalctl@ceph.node-exporter.b.smithi181.stdout:Mar 30 13:36:27 smithi181 bash[42961]: Copying blob sha256:b45d31ee2d7f9f452678a85b0c837c29e12089f31ee8dbac6c8c24dfa4054a30 2024-03-30T13:36:28.006 INFO:journalctl@ceph.node-exporter.b.smithi181.stdout:Mar 30 13:36:27 smithi181 bash[42961]: Copying blob sha256:aa2a8d90b84cb2a9c422e7005cd166a008ccf22ef5d7d4f07128478585ce35ea 2024-03-30T13:36:28.006 INFO:journalctl@ceph.node-exporter.b.smithi181.stdout:Mar 30 13:36:27 smithi181 bash[42961]: Copying blob sha256:b5db1e299295edf3005515ab7879c1df64a33c185d3a7a23aa4dcaa17d26f7b3 2024-03-30T13:36:28.276 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:36:28 smithi099 ceph-mon[24912]: Deploying daemon node-exporter.b on smithi181 2024-03-30T13:36:28.276 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:36:28 smithi099 ceph-mon[29691]: Deploying daemon node-exporter.b on smithi181 2024-03-30T13:36:28.326 INFO:tasks.cephadm.ceph_manager.ceph:all up! 2024-03-30T13:36:28.326 DEBUG:teuthology.orchestra.run.smithi099:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell --fsid 98ebaeb8-ee99-11ee-b647-cb9ed24678a4 -- ceph osd dump --format=json 2024-03-30T13:36:28.506 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:36:28 smithi181 ceph-mon[25762]: Deploying daemon node-exporter.b on smithi181 2024-03-30T13:36:28.953 INFO:teuthology.orchestra.run.smithi099.stderr:Inferring config /var/lib/ceph/98ebaeb8-ee99-11ee-b647-cb9ed24678a4/mon.a/config 2024-03-30T13:36:29.194 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:36:29 smithi099 ceph-mon[24912]: pgmap v17: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:36:29.195 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:36:29 smithi099 ceph-mon[29691]: pgmap v17: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:36:29.375 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:36:29 smithi181 ceph-mon[25762]: pgmap v17: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:36:29.677 INFO:journalctl@ceph.node-exporter.b.smithi181.stdout:Mar 30 13:36:29 smithi181 bash[42961]: Copying config sha256:1dbe0e931976487e20e5cfb272087e08a9779c88fd5e9617ed7042dd9751ec26 2024-03-30T13:36:29.677 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 13:36:29 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-x[27332]: ::ffff:172.21.15.181 - - [30/Mar/2024:13:36:29] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-03-30T13:36:29.976 INFO:journalctl@ceph.node-exporter.b.smithi181.stdout:Mar 30 13:36:29 smithi181 bash[42961]: Writing manifest to image destination 2024-03-30T13:36:30.227 INFO:journalctl@ceph.node-exporter.b.smithi181.stdout:Mar 30 13:36:29 smithi181 podman[42961]: 2024-03-30 13:36:29.940239225 +0000 UTC m=+2.789261095 image pull 1dbe0e931976487e20e5cfb272087e08a9779c88fd5e9617ed7042dd9751ec26 quay.io/prometheus/node-exporter:v1.3.1 2024-03-30T13:36:30.227 INFO:journalctl@ceph.node-exporter.b.smithi181.stdout:Mar 30 13:36:30 smithi181 podman[42961]: 2024-03-30 13:36:30.038402714 +0000 UTC m=+2.887424614 container create 5a3d4484d23a114b9e6a4bb34b1da3c8bed605c9a43d15b7d5148755c54ff44f (image=quay.io/prometheus/node-exporter:v1.3.1, name=ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-node-exporter-b, maintainer=The Prometheus Authors ) 2024-03-30T13:36:30.227 INFO:journalctl@ceph.node-exporter.b.smithi181.stdout:Mar 30 13:36:30 smithi181 podman[42961]: 2024-03-30 13:36:30.223605546 +0000 UTC m=+3.072627413 container init 5a3d4484d23a114b9e6a4bb34b1da3c8bed605c9a43d15b7d5148755c54ff44f (image=quay.io/prometheus/node-exporter:v1.3.1, name=ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-node-exporter-b, maintainer=The Prometheus Authors ) 2024-03-30T13:36:30.228 INFO:journalctl@ceph.node-exporter.b.smithi181.stdout:Mar 30 13:36:30 smithi181 podman[42961]: 2024-03-30 13:36:30.226654719 +0000 UTC m=+3.075676573 container start 5a3d4484d23a114b9e6a4bb34b1da3c8bed605c9a43d15b7d5148755c54ff44f (image=quay.io/prometheus/node-exporter:v1.3.1, name=ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-node-exporter-b, maintainer=The Prometheus Authors ) 2024-03-30T13:36:30.506 INFO:journalctl@ceph.node-exporter.b.smithi181.stdout:Mar 30 13:36:30 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-node-exporter-b[43011]: ts=2024-03-30T13:36:30.231Z caller=node_exporter.go:182 level=info msg="Starting node_exporter" version="(version=1.3.1, branch=HEAD, revision=a2321e7b940ddcff26873612bccdf7cd4c42b6b6)" 2024-03-30T13:36:30.506 INFO:journalctl@ceph.node-exporter.b.smithi181.stdout:Mar 30 13:36:30 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-node-exporter-b[43011]: ts=2024-03-30T13:36:30.231Z caller=node_exporter.go:183 level=info msg="Build context" build_context="(go=go1.17.3, user=root@243aafa5525c, date=20211205-11:09:49)" 2024-03-30T13:36:30.506 INFO:journalctl@ceph.node-exporter.b.smithi181.stdout:Mar 30 13:36:30 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-node-exporter-b[43011]: ts=2024-03-30T13:36:30.231Z caller=filesystem_common.go:111 level=info collector=filesystem msg="Parsed flag --collector.filesystem.mount-points-exclude" flag=^/(dev|proc|run/credentials/.+|sys|var/lib/docker/.+)($|/) 2024-03-30T13:36:30.506 INFO:journalctl@ceph.node-exporter.b.smithi181.stdout:Mar 30 13:36:30 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-node-exporter-b[43011]: ts=2024-03-30T13:36:30.232Z caller=filesystem_common.go:113 level=info collector=filesystem msg="Parsed flag --collector.filesystem.fs-types-exclude" flag=^(autofs|binfmt_misc|bpf|cgroup2?|configfs|debugfs|devpts|devtmpfs|fusectl|hugetlbfs|iso9660|mqueue|nsfs|overlay|proc|procfs|pstore|rpc_pipefs|securityfs|selinuxfs|squashfs|sysfs|tracefs)$ 2024-03-30T13:36:30.506 INFO:journalctl@ceph.node-exporter.b.smithi181.stdout:Mar 30 13:36:30 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-node-exporter-b[43011]: ts=2024-03-30T13:36:30.232Z caller=node_exporter.go:108 level=info msg="Enabled collectors" 2024-03-30T13:36:30.507 INFO:journalctl@ceph.node-exporter.b.smithi181.stdout:Mar 30 13:36:30 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-node-exporter-b[43011]: ts=2024-03-30T13:36:30.232Z caller=node_exporter.go:115 level=info collector=arp 2024-03-30T13:36:30.507 INFO:journalctl@ceph.node-exporter.b.smithi181.stdout:Mar 30 13:36:30 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-node-exporter-b[43011]: ts=2024-03-30T13:36:30.232Z caller=node_exporter.go:115 level=info collector=bcache 2024-03-30T13:36:30.507 INFO:journalctl@ceph.node-exporter.b.smithi181.stdout:Mar 30 13:36:30 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-node-exporter-b[43011]: ts=2024-03-30T13:36:30.232Z caller=node_exporter.go:115 level=info collector=bonding 2024-03-30T13:36:30.507 INFO:journalctl@ceph.node-exporter.b.smithi181.stdout:Mar 30 13:36:30 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-node-exporter-b[43011]: ts=2024-03-30T13:36:30.232Z caller=node_exporter.go:115 level=info collector=btrfs 2024-03-30T13:36:30.507 INFO:journalctl@ceph.node-exporter.b.smithi181.stdout:Mar 30 13:36:30 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-node-exporter-b[43011]: ts=2024-03-30T13:36:30.233Z caller=node_exporter.go:115 level=info collector=conntrack 2024-03-30T13:36:30.507 INFO:journalctl@ceph.node-exporter.b.smithi181.stdout:Mar 30 13:36:30 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-node-exporter-b[43011]: ts=2024-03-30T13:36:30.233Z caller=node_exporter.go:115 level=info collector=cpu 2024-03-30T13:36:30.507 INFO:journalctl@ceph.node-exporter.b.smithi181.stdout:Mar 30 13:36:30 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-node-exporter-b[43011]: ts=2024-03-30T13:36:30.233Z caller=node_exporter.go:115 level=info collector=cpufreq 2024-03-30T13:36:30.507 INFO:journalctl@ceph.node-exporter.b.smithi181.stdout:Mar 30 13:36:30 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-node-exporter-b[43011]: ts=2024-03-30T13:36:30.233Z caller=node_exporter.go:115 level=info collector=diskstats 2024-03-30T13:36:30.507 INFO:journalctl@ceph.node-exporter.b.smithi181.stdout:Mar 30 13:36:30 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-node-exporter-b[43011]: ts=2024-03-30T13:36:30.233Z caller=node_exporter.go:115 level=info collector=dmi 2024-03-30T13:36:30.507 INFO:journalctl@ceph.node-exporter.b.smithi181.stdout:Mar 30 13:36:30 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-node-exporter-b[43011]: ts=2024-03-30T13:36:30.233Z caller=node_exporter.go:115 level=info collector=edac 2024-03-30T13:36:30.507 INFO:journalctl@ceph.node-exporter.b.smithi181.stdout:Mar 30 13:36:30 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-node-exporter-b[43011]: ts=2024-03-30T13:36:30.233Z caller=node_exporter.go:115 level=info collector=entropy 2024-03-30T13:36:30.507 INFO:journalctl@ceph.node-exporter.b.smithi181.stdout:Mar 30 13:36:30 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-node-exporter-b[43011]: ts=2024-03-30T13:36:30.233Z caller=node_exporter.go:115 level=info collector=fibrechannel 2024-03-30T13:36:30.507 INFO:journalctl@ceph.node-exporter.b.smithi181.stdout:Mar 30 13:36:30 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-node-exporter-b[43011]: ts=2024-03-30T13:36:30.233Z caller=node_exporter.go:115 level=info collector=filefd 2024-03-30T13:36:30.507 INFO:journalctl@ceph.node-exporter.b.smithi181.stdout:Mar 30 13:36:30 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-node-exporter-b[43011]: ts=2024-03-30T13:36:30.233Z caller=node_exporter.go:115 level=info collector=filesystem 2024-03-30T13:36:30.508 INFO:journalctl@ceph.node-exporter.b.smithi181.stdout:Mar 30 13:36:30 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-node-exporter-b[43011]: ts=2024-03-30T13:36:30.233Z caller=node_exporter.go:115 level=info collector=hwmon 2024-03-30T13:36:30.508 INFO:journalctl@ceph.node-exporter.b.smithi181.stdout:Mar 30 13:36:30 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-node-exporter-b[43011]: ts=2024-03-30T13:36:30.233Z caller=node_exporter.go:115 level=info collector=infiniband 2024-03-30T13:36:30.508 INFO:journalctl@ceph.node-exporter.b.smithi181.stdout:Mar 30 13:36:30 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-node-exporter-b[43011]: ts=2024-03-30T13:36:30.233Z caller=node_exporter.go:115 level=info collector=ipvs 2024-03-30T13:36:30.508 INFO:journalctl@ceph.node-exporter.b.smithi181.stdout:Mar 30 13:36:30 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-node-exporter-b[43011]: ts=2024-03-30T13:36:30.233Z caller=node_exporter.go:115 level=info collector=loadavg 2024-03-30T13:36:30.508 INFO:journalctl@ceph.node-exporter.b.smithi181.stdout:Mar 30 13:36:30 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-node-exporter-b[43011]: ts=2024-03-30T13:36:30.233Z caller=node_exporter.go:115 level=info collector=mdadm 2024-03-30T13:36:30.508 INFO:journalctl@ceph.node-exporter.b.smithi181.stdout:Mar 30 13:36:30 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-node-exporter-b[43011]: ts=2024-03-30T13:36:30.233Z caller=node_exporter.go:115 level=info collector=meminfo 2024-03-30T13:36:30.508 INFO:journalctl@ceph.node-exporter.b.smithi181.stdout:Mar 30 13:36:30 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-node-exporter-b[43011]: ts=2024-03-30T13:36:30.233Z caller=node_exporter.go:115 level=info collector=netclass 2024-03-30T13:36:30.509 INFO:journalctl@ceph.node-exporter.b.smithi181.stdout:Mar 30 13:36:30 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-node-exporter-b[43011]: ts=2024-03-30T13:36:30.233Z caller=node_exporter.go:115 level=info collector=netdev 2024-03-30T13:36:30.509 INFO:journalctl@ceph.node-exporter.b.smithi181.stdout:Mar 30 13:36:30 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-node-exporter-b[43011]: ts=2024-03-30T13:36:30.233Z caller=node_exporter.go:115 level=info collector=netstat 2024-03-30T13:36:30.509 INFO:journalctl@ceph.node-exporter.b.smithi181.stdout:Mar 30 13:36:30 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-node-exporter-b[43011]: ts=2024-03-30T13:36:30.233Z caller=node_exporter.go:115 level=info collector=nfs 2024-03-30T13:36:30.509 INFO:journalctl@ceph.node-exporter.b.smithi181.stdout:Mar 30 13:36:30 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-node-exporter-b[43011]: ts=2024-03-30T13:36:30.233Z caller=node_exporter.go:115 level=info collector=nfsd 2024-03-30T13:36:30.509 INFO:journalctl@ceph.node-exporter.b.smithi181.stdout:Mar 30 13:36:30 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-node-exporter-b[43011]: ts=2024-03-30T13:36:30.233Z caller=node_exporter.go:115 level=info collector=nvme 2024-03-30T13:36:30.509 INFO:journalctl@ceph.node-exporter.b.smithi181.stdout:Mar 30 13:36:30 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-node-exporter-b[43011]: ts=2024-03-30T13:36:30.233Z caller=node_exporter.go:115 level=info collector=os 2024-03-30T13:36:30.509 INFO:journalctl@ceph.node-exporter.b.smithi181.stdout:Mar 30 13:36:30 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-node-exporter-b[43011]: ts=2024-03-30T13:36:30.233Z caller=node_exporter.go:115 level=info collector=powersupplyclass 2024-03-30T13:36:30.509 INFO:journalctl@ceph.node-exporter.b.smithi181.stdout:Mar 30 13:36:30 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-node-exporter-b[43011]: ts=2024-03-30T13:36:30.233Z caller=node_exporter.go:115 level=info collector=pressure 2024-03-30T13:36:30.509 INFO:journalctl@ceph.node-exporter.b.smithi181.stdout:Mar 30 13:36:30 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-node-exporter-b[43011]: ts=2024-03-30T13:36:30.233Z caller=node_exporter.go:115 level=info collector=rapl 2024-03-30T13:36:30.509 INFO:journalctl@ceph.node-exporter.b.smithi181.stdout:Mar 30 13:36:30 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-node-exporter-b[43011]: ts=2024-03-30T13:36:30.233Z caller=node_exporter.go:115 level=info collector=schedstat 2024-03-30T13:36:30.509 INFO:journalctl@ceph.node-exporter.b.smithi181.stdout:Mar 30 13:36:30 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-node-exporter-b[43011]: ts=2024-03-30T13:36:30.233Z caller=node_exporter.go:115 level=info collector=sockstat 2024-03-30T13:36:30.509 INFO:journalctl@ceph.node-exporter.b.smithi181.stdout:Mar 30 13:36:30 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-node-exporter-b[43011]: ts=2024-03-30T13:36:30.233Z caller=node_exporter.go:115 level=info collector=softnet 2024-03-30T13:36:30.509 INFO:journalctl@ceph.node-exporter.b.smithi181.stdout:Mar 30 13:36:30 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-node-exporter-b[43011]: ts=2024-03-30T13:36:30.233Z caller=node_exporter.go:115 level=info collector=stat 2024-03-30T13:36:30.509 INFO:journalctl@ceph.node-exporter.b.smithi181.stdout:Mar 30 13:36:30 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-node-exporter-b[43011]: ts=2024-03-30T13:36:30.233Z caller=node_exporter.go:115 level=info collector=tapestats 2024-03-30T13:36:30.509 INFO:journalctl@ceph.node-exporter.b.smithi181.stdout:Mar 30 13:36:30 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-node-exporter-b[43011]: ts=2024-03-30T13:36:30.233Z caller=node_exporter.go:115 level=info collector=textfile 2024-03-30T13:36:30.509 INFO:journalctl@ceph.node-exporter.b.smithi181.stdout:Mar 30 13:36:30 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-node-exporter-b[43011]: ts=2024-03-30T13:36:30.233Z caller=node_exporter.go:115 level=info collector=thermal_zone 2024-03-30T13:36:30.510 INFO:journalctl@ceph.node-exporter.b.smithi181.stdout:Mar 30 13:36:30 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-node-exporter-b[43011]: ts=2024-03-30T13:36:30.233Z caller=node_exporter.go:115 level=info collector=time 2024-03-30T13:36:30.510 INFO:journalctl@ceph.node-exporter.b.smithi181.stdout:Mar 30 13:36:30 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-node-exporter-b[43011]: ts=2024-03-30T13:36:30.233Z caller=node_exporter.go:115 level=info collector=udp_queues 2024-03-30T13:36:30.510 INFO:journalctl@ceph.node-exporter.b.smithi181.stdout:Mar 30 13:36:30 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-node-exporter-b[43011]: ts=2024-03-30T13:36:30.233Z caller=node_exporter.go:115 level=info collector=uname 2024-03-30T13:36:30.510 INFO:journalctl@ceph.node-exporter.b.smithi181.stdout:Mar 30 13:36:30 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-node-exporter-b[43011]: ts=2024-03-30T13:36:30.233Z caller=node_exporter.go:115 level=info collector=vmstat 2024-03-30T13:36:30.510 INFO:journalctl@ceph.node-exporter.b.smithi181.stdout:Mar 30 13:36:30 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-node-exporter-b[43011]: ts=2024-03-30T13:36:30.233Z caller=node_exporter.go:115 level=info collector=xfs 2024-03-30T13:36:30.510 INFO:journalctl@ceph.node-exporter.b.smithi181.stdout:Mar 30 13:36:30 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-node-exporter-b[43011]: ts=2024-03-30T13:36:30.233Z caller=node_exporter.go:115 level=info collector=zfs 2024-03-30T13:36:30.510 INFO:journalctl@ceph.node-exporter.b.smithi181.stdout:Mar 30 13:36:30 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-node-exporter-b[43011]: ts=2024-03-30T13:36:30.233Z caller=node_exporter.go:199 level=info msg="Listening on" address=:9100 2024-03-30T13:36:30.510 INFO:journalctl@ceph.node-exporter.b.smithi181.stdout:Mar 30 13:36:30 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-node-exporter-b[43011]: ts=2024-03-30T13:36:30.233Z caller=tls_config.go:195 level=info msg="TLS is disabled." http2=false 2024-03-30T13:36:30.510 INFO:journalctl@ceph.node-exporter.b.smithi181.stdout:Mar 30 13:36:30 smithi181 bash[42961]: 5a3d4484d23a114b9e6a4bb34b1da3c8bed605c9a43d15b7d5148755c54ff44f 2024-03-30T13:36:30.510 INFO:journalctl@ceph.node-exporter.b.smithi181.stdout:Mar 30 13:36:30 smithi181 systemd[1]: Started Ceph node-exporter.b for 98ebaeb8-ee99-11ee-b647-cb9ed24678a4. 2024-03-30T13:36:30.575 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-03-30T13:36:30.575 INFO:teuthology.orchestra.run.smithi099.stdout:{"epoch":60,"fsid":"98ebaeb8-ee99-11ee-b647-cb9ed24678a4","created":"2024-03-30T13:30:46.740035+0000","modified":"2024-03-30T13:35:58.813133+0000","last_up_change":"2024-03-30T13:35:41.547669+0000","last_in_change":"2024-03-30T13:35:23.656525+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":18,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-30T13:33:44.717293+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"c684cee9-dc80-4a4a-8db8-8553daf0cc4f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6802","nonce":558005496},{"type":"v1","addr":"172.21.15.99:6803","nonce":558005496}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6804","nonce":558005496},{"type":"v1","addr":"172.21.15.99:6805","nonce":558005496}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6808","nonce":558005496},{"type":"v1","addr":"172.21.15.99:6809","nonce":558005496}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6806","nonce":558005496},{"type":"v1","addr":"172.21.15.99:6807","nonce":558005496}]},"public_addr":"172.21.15.99:6803/558005496","cluster_addr":"172.21.15.99:6805/558005496","heartbeat_back_addr":"172.21.15.99:6809/558005496","heartbeat_front_addr":"172.21.15.99:6807/558005496","state":["exists","up"]},{"osd":1,"uuid":"41383fae-9172-4ba2-8a94-85a125de98e2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6810","nonce":2317835991},{"type":"v1","addr":"172.21.15.99:6811","nonce":2317835991}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6812","nonce":2317835991},{"type":"v1","addr":"172.21.15.99:6813","nonce":2317835991}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6816","nonce":2317835991},{"type":"v1","addr":"172.21.15.99:6817","nonce":2317835991}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6814","nonce":2317835991},{"type":"v1","addr":"172.21.15.99:6815","nonce":2317835991}]},"public_addr":"172.21.15.99:6811/2317835991","cluster_addr":"172.21.15.99:6813/2317835991","heartbeat_back_addr":"172.21.15.99:6817/2317835991","heartbeat_front_addr":"172.21.15.99:6815/2317835991","state":["exists","up"]},{"osd":2,"uuid":"c7ec9bfb-f6a2-444d-a004-391f602f07ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6818","nonce":770589655},{"type":"v1","addr":"172.21.15.99:6819","nonce":770589655}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6820","nonce":770589655},{"type":"v1","addr":"172.21.15.99:6821","nonce":770589655}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6824","nonce":770589655},{"type":"v1","addr":"172.21.15.99:6825","nonce":770589655}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6822","nonce":770589655},{"type":"v1","addr":"172.21.15.99:6823","nonce":770589655}]},"public_addr":"172.21.15.99:6819/770589655","cluster_addr":"172.21.15.99:6821/770589655","heartbeat_back_addr":"172.21.15.99:6825/770589655","heartbeat_front_addr":"172.21.15.99:6823/770589655","state":["exists","up"]},{"osd":3,"uuid":"ed272b2b-e9e4-42f7-bf4b-12b5c3d7b90e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6826","nonce":2046550873},{"type":"v1","addr":"172.21.15.99:6827","nonce":2046550873}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6828","nonce":2046550873},{"type":"v1","addr":"172.21.15.99:6829","nonce":2046550873}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6832","nonce":2046550873},{"type":"v1","addr":"172.21.15.99:6833","nonce":2046550873}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6830","nonce":2046550873},{"type":"v1","addr":"172.21.15.99:6831","nonce":2046550873}]},"public_addr":"172.21.15.99:6827/2046550873","cluster_addr":"172.21.15.99:6829/2046550873","heartbeat_back_addr":"172.21.15.99:6833/2046550873","heartbeat_front_addr":"172.21.15.99:6831/2046550873","state":["exists","up"]},{"osd":4,"uuid":"cfa9365d-3adb-4f07-94a0-1ae739a22d74","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6800","nonce":2876720616},{"type":"v1","addr":"172.21.15.181:6801","nonce":2876720616}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6802","nonce":2876720616},{"type":"v1","addr":"172.21.15.181:6803","nonce":2876720616}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6806","nonce":2876720616},{"type":"v1","addr":"172.21.15.181:6807","nonce":2876720616}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6804","nonce":2876720616},{"type":"v1","addr":"172.21.15.181:6805","nonce":2876720616}]},"public_addr":"172.21.15.181:6801/2876720616","cluster_addr":"172.21.15.181:6803/2876720616","heartbeat_back_addr":"172.21.15.181:6807/2876720616","heartbeat_front_addr":"172.21.15.181:6805/2876720616","state":["exists","up"]},{"osd":5,"uuid":"7c7289ba-f1a8-4b64-99d4-e42343eb5f49","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6808","nonce":1648947487},{"type":"v1","addr":"172.21.15.181:6809","nonce":1648947487}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6810","nonce":1648947487},{"type":"v1","addr":"172.21.15.181:6811","nonce":1648947487}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6814","nonce":1648947487},{"type":"v1","addr":"172.21.15.181:6815","nonce":1648947487}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6812","nonce":1648947487},{"type":"v1","addr":"172.21.15.181:6813","nonce":1648947487}]},"public_addr":"172.21.15.181:6809/1648947487","cluster_addr":"172.21.15.181:6811/1648947487","heartbeat_back_addr":"172.21.15.181:6815/1648947487","heartbeat_front_addr":"172.21.15.181:6813/1648947487","state":["exists","up"]},{"osd":6,"uuid":"eee64a05-4d3a-4ba4-b1d2-43a9aeec31ed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6816","nonce":4097845576},{"type":"v1","addr":"172.21.15.181:6817","nonce":4097845576}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6818","nonce":4097845576},{"type":"v1","addr":"172.21.15.181:6819","nonce":4097845576}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6822","nonce":4097845576},{"type":"v1","addr":"172.21.15.181:6823","nonce":4097845576}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6820","nonce":4097845576},{"type":"v1","addr":"172.21.15.181:6821","nonce":4097845576}]},"public_addr":"172.21.15.181:6817/4097845576","cluster_addr":"172.21.15.181:6819/4097845576","heartbeat_back_addr":"172.21.15.181:6823/4097845576","heartbeat_front_addr":"172.21.15.181:6821/4097845576","state":["exists","up"]},{"osd":7,"uuid":"165196c5-8792-4379-87ba-bb9917938028","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":55,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6824","nonce":1455575993},{"type":"v1","addr":"172.21.15.181:6825","nonce":1455575993}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6826","nonce":1455575993},{"type":"v1","addr":"172.21.15.181:6827","nonce":1455575993}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6830","nonce":1455575993},{"type":"v1","addr":"172.21.15.181:6831","nonce":1455575993}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6828","nonce":1455575993},{"type":"v1","addr":"172.21.15.181:6829","nonce":1455575993}]},"public_addr":"172.21.15.181:6825/1455575993","cluster_addr":"172.21.15.181:6827/1455575993","heartbeat_back_addr":"172.21.15.181:6831/1455575993","heartbeat_front_addr":"172.21.15.181:6829/1455575993","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:32:53.321390+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:33:16.239976+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:33:40.545655+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:34:04.901544+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:34:27.871028+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:34:50.499151+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:35:14.795730+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:35:39.703762+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.99:0/2227521083":"2024-03-31T13:35:58.813099+0000","172.21.15.99:0/2680510373":"2024-03-31T13:35:58.813099+0000","172.21.15.99:6801/1198750999":"2024-03-31T13:35:58.813099+0000","172.21.15.99:0/1283915670":"2024-03-31T13:31:32.352898+0000","172.21.15.99:0/3435366269":"2024-03-31T13:35:58.813099+0000","172.21.15.99:6800/639013456":"2024-03-31T13:31:32.352898+0000","172.21.15.99:6801/639013456":"2024-03-31T13:31:32.352898+0000","172.21.15.99:0/2902659920":"2024-03-31T13:31:32.352898+0000","172.21.15.99:0/3964022543":"2024-03-31T13:31:32.352898+0000","172.21.15.99:0/3234417163":"2024-03-31T13:31:10.668046+0000","172.21.15.99:6800/1198750999":"2024-03-31T13:35:58.813099+0000","172.21.15.99:0/3448119368":"2024-03-31T13:31:10.668046+0000","172.21.15.99:6800/4092149076":"2024-03-31T13:31:10.668046+0000","172.21.15.99:0/3858852026":"2024-03-31T13:35:58.813099+0000","172.21.15.99:0/2799400391":"2024-03-31T13:31:10.668046+0000","172.21.15.99:6801/4092149076":"2024-03-31T13:31:10.668046+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-30T13:36:31.109 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:36:31 smithi099 ceph-mon[24912]: pgmap v18: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:36:31.110 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:36:31 smithi099 ceph-mon[24912]: from='mgr.14439 ' entity='mgr.y' 2024-03-30T13:36:31.110 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:36:31 smithi099 ceph-mon[24912]: from='mgr.14439 172.21.15.99:0/1757456350' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:36:31.110 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:36:31 smithi099 ceph-mon[24912]: from='mgr.14439 172.21.15.99:0/1757456350' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:36:31.110 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:36:31 smithi099 ceph-mon[24912]: from='mgr.14439 172.21.15.99:0/1757456350' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:36:31.110 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:36:31 smithi099 ceph-mon[24912]: from='mgr.14439 ' entity='mgr.y' 2024-03-30T13:36:31.110 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:36:31 smithi099 ceph-mon[24912]: from='client.? 172.21.15.99:0/4138139244' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-30T13:36:31.110 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:36:31 smithi099 ceph-mon[29691]: pgmap v18: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:36:31.110 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:36:31 smithi099 ceph-mon[29691]: from='mgr.14439 ' entity='mgr.y' 2024-03-30T13:36:31.111 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:36:31 smithi099 ceph-mon[29691]: from='mgr.14439 172.21.15.99:0/1757456350' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:36:31.111 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:36:31 smithi099 ceph-mon[29691]: from='mgr.14439 172.21.15.99:0/1757456350' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:36:31.111 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:36:31 smithi099 ceph-mon[29691]: from='mgr.14439 172.21.15.99:0/1757456350' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:36:31.111 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:36:31 smithi099 ceph-mon[29691]: from='mgr.14439 ' entity='mgr.y' 2024-03-30T13:36:31.111 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:36:31 smithi099 ceph-mon[29691]: from='client.? 172.21.15.99:0/4138139244' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-30T13:36:31.225 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:36:31 smithi181 ceph-mon[25762]: pgmap v18: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:36:31.225 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:36:31 smithi181 ceph-mon[25762]: from='mgr.14439 ' entity='mgr.y' 2024-03-30T13:36:31.225 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:36:31 smithi181 ceph-mon[25762]: from='mgr.14439 172.21.15.99:0/1757456350' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:36:31.225 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:36:31 smithi181 ceph-mon[25762]: from='mgr.14439 172.21.15.99:0/1757456350' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:36:31.225 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:36:31 smithi181 ceph-mon[25762]: from='mgr.14439 172.21.15.99:0/1757456350' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:36:31.225 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:36:31 smithi181 ceph-mon[25762]: from='mgr.14439 ' entity='mgr.y' 2024-03-30T13:36:31.225 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:36:31 smithi181 ceph-mon[25762]: from='client.? 172.21.15.99:0/4138139244' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-30T13:36:31.861 DEBUG:teuthology.orchestra.run.smithi099:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell --fsid 98ebaeb8-ee99-11ee-b647-cb9ed24678a4 -- ceph tell osd.0 flush_pg_stats 2024-03-30T13:36:31.862 DEBUG:teuthology.orchestra.run.smithi099:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell --fsid 98ebaeb8-ee99-11ee-b647-cb9ed24678a4 -- ceph tell osd.1 flush_pg_stats 2024-03-30T13:36:31.862 DEBUG:teuthology.orchestra.run.smithi099:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell --fsid 98ebaeb8-ee99-11ee-b647-cb9ed24678a4 -- ceph tell osd.2 flush_pg_stats 2024-03-30T13:36:31.863 DEBUG:teuthology.orchestra.run.smithi099:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell --fsid 98ebaeb8-ee99-11ee-b647-cb9ed24678a4 -- ceph tell osd.3 flush_pg_stats 2024-03-30T13:36:31.863 DEBUG:teuthology.orchestra.run.smithi099:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell --fsid 98ebaeb8-ee99-11ee-b647-cb9ed24678a4 -- ceph tell osd.4 flush_pg_stats 2024-03-30T13:36:31.864 DEBUG:teuthology.orchestra.run.smithi099:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell --fsid 98ebaeb8-ee99-11ee-b647-cb9ed24678a4 -- ceph tell osd.5 flush_pg_stats 2024-03-30T13:36:31.864 DEBUG:teuthology.orchestra.run.smithi099:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell --fsid 98ebaeb8-ee99-11ee-b647-cb9ed24678a4 -- ceph tell osd.6 flush_pg_stats 2024-03-30T13:36:31.864 DEBUG:teuthology.orchestra.run.smithi099:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell --fsid 98ebaeb8-ee99-11ee-b647-cb9ed24678a4 -- ceph tell osd.7 flush_pg_stats 2024-03-30T13:36:32.074 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:36:32 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:36:32.075 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:36:32 smithi181 ceph-mon[25762]: Reconfiguring prometheus.a (dependencies changed)... 2024-03-30T13:36:32.075 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:36:32 smithi181 ceph-mon[25762]: Reconfiguring daemon prometheus.a on smithi181 2024-03-30T13:36:32.179 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:36:32 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:36:32.179 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:36:32 smithi099 ceph-mon[24912]: Reconfiguring prometheus.a (dependencies changed)... 2024-03-30T13:36:32.179 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:36:32 smithi099 ceph-mon[24912]: Reconfiguring daemon prometheus.a on smithi181 2024-03-30T13:36:32.179 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:36:32 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:36:32.179 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:36:32 smithi099 ceph-mon[29691]: Reconfiguring prometheus.a (dependencies changed)... 2024-03-30T13:36:32.179 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:36:32 smithi099 ceph-mon[29691]: Reconfiguring daemon prometheus.a on smithi181 2024-03-30T13:36:32.913 INFO:teuthology.orchestra.run.smithi099.stderr:Inferring config /var/lib/ceph/98ebaeb8-ee99-11ee-b647-cb9ed24678a4/mon.a/config 2024-03-30T13:36:32.921 INFO:teuthology.orchestra.run.smithi099.stderr:Inferring config /var/lib/ceph/98ebaeb8-ee99-11ee-b647-cb9ed24678a4/mon.a/config 2024-03-30T13:36:32.923 INFO:teuthology.orchestra.run.smithi099.stderr:Inferring config /var/lib/ceph/98ebaeb8-ee99-11ee-b647-cb9ed24678a4/mon.a/config 2024-03-30T13:36:32.923 INFO:teuthology.orchestra.run.smithi099.stderr:Inferring config /var/lib/ceph/98ebaeb8-ee99-11ee-b647-cb9ed24678a4/mon.a/config 2024-03-30T13:36:32.930 INFO:teuthology.orchestra.run.smithi099.stderr:Inferring config /var/lib/ceph/98ebaeb8-ee99-11ee-b647-cb9ed24678a4/mon.a/config 2024-03-30T13:36:32.930 INFO:teuthology.orchestra.run.smithi099.stderr:Inferring config /var/lib/ceph/98ebaeb8-ee99-11ee-b647-cb9ed24678a4/mon.a/config 2024-03-30T13:36:32.936 INFO:teuthology.orchestra.run.smithi099.stderr:Inferring config /var/lib/ceph/98ebaeb8-ee99-11ee-b647-cb9ed24678a4/mon.a/config 2024-03-30T13:36:32.943 INFO:teuthology.orchestra.run.smithi099.stderr:Inferring config /var/lib/ceph/98ebaeb8-ee99-11ee-b647-cb9ed24678a4/mon.a/config 2024-03-30T13:36:33.041 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:36:33 smithi099 ceph-mon[24912]: pgmap v19: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:36:33.042 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:36:33 smithi099 ceph-mon[29691]: pgmap v19: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:36:33.215 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:36:33 smithi181 ceph-mon[25762]: pgmap v19: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:36:34.506 INFO:journalctl@ceph.prometheus.a.smithi181.stdout:Mar 30 13:36:34 smithi181 systemd[1]: Stopping Ceph prometheus.a for 98ebaeb8-ee99-11ee-b647-cb9ed24678a4... 2024-03-30T13:36:34.837 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:36:34 smithi099 ceph-mon[24912]: pgmap v20: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:36:34.838 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:36:34 smithi099 ceph-mon[29691]: pgmap v20: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:36:34.874 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:36:34 smithi181 ceph-mon[25762]: pgmap v20: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:36:35.256 INFO:journalctl@ceph.prometheus.a.smithi181.stdout:Mar 30 13:36:34 smithi181 bash[43223]: Error: no container with name or ID "ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-prometheus.a" found: no such container 2024-03-30T13:36:35.257 INFO:journalctl@ceph.prometheus.a.smithi181.stdout:Mar 30 13:36:35 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-prometheus-a[42166]: ts=2024-03-30T13:36:35.043Z caller=main.go:775 level=warn msg="Received SIGTERM, exiting gracefully..." 2024-03-30T13:36:35.257 INFO:journalctl@ceph.prometheus.a.smithi181.stdout:Mar 30 13:36:35 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-prometheus-a[42166]: ts=2024-03-30T13:36:35.043Z caller=main.go:798 level=info msg="Stopping scrape discovery manager..." 2024-03-30T13:36:35.257 INFO:journalctl@ceph.prometheus.a.smithi181.stdout:Mar 30 13:36:35 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-prometheus-a[42166]: ts=2024-03-30T13:36:35.043Z caller=main.go:812 level=info msg="Stopping notify discovery manager..." 2024-03-30T13:36:35.257 INFO:journalctl@ceph.prometheus.a.smithi181.stdout:Mar 30 13:36:35 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-prometheus-a[42166]: ts=2024-03-30T13:36:35.043Z caller=main.go:834 level=info msg="Stopping scrape manager..." 2024-03-30T13:36:35.257 INFO:journalctl@ceph.prometheus.a.smithi181.stdout:Mar 30 13:36:35 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-prometheus-a[42166]: ts=2024-03-30T13:36:35.043Z caller=main.go:794 level=info msg="Scrape discovery manager stopped" 2024-03-30T13:36:35.257 INFO:journalctl@ceph.prometheus.a.smithi181.stdout:Mar 30 13:36:35 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-prometheus-a[42166]: ts=2024-03-30T13:36:35.043Z caller=main.go:808 level=info msg="Notify discovery manager stopped" 2024-03-30T13:36:35.257 INFO:journalctl@ceph.prometheus.a.smithi181.stdout:Mar 30 13:36:35 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-prometheus-a[42166]: ts=2024-03-30T13:36:35.043Z caller=manager.go:945 level=info component="rule manager" msg="Stopping rule manager..." 2024-03-30T13:36:35.257 INFO:journalctl@ceph.prometheus.a.smithi181.stdout:Mar 30 13:36:35 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-prometheus-a[42166]: ts=2024-03-30T13:36:35.043Z caller=main.go:828 level=info msg="Scrape manager stopped" 2024-03-30T13:36:35.257 INFO:journalctl@ceph.prometheus.a.smithi181.stdout:Mar 30 13:36:35 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-prometheus-a[42166]: ts=2024-03-30T13:36:35.043Z caller=manager.go:955 level=info component="rule manager" msg="Rule manager stopped" 2024-03-30T13:36:35.257 INFO:journalctl@ceph.prometheus.a.smithi181.stdout:Mar 30 13:36:35 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-prometheus-a[42166]: ts=2024-03-30T13:36:35.044Z caller=notifier.go:600 level=info component=notifier msg="Stopping notification manager..." 2024-03-30T13:36:35.257 INFO:journalctl@ceph.prometheus.a.smithi181.stdout:Mar 30 13:36:35 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-prometheus-a[42166]: ts=2024-03-30T13:36:35.044Z caller=main.go:1054 level=info msg="Notifier manager stopped" 2024-03-30T13:36:35.257 INFO:journalctl@ceph.prometheus.a.smithi181.stdout:Mar 30 13:36:35 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-prometheus-a[42166]: ts=2024-03-30T13:36:35.044Z caller=main.go:1066 level=info msg="See you next time!" 2024-03-30T13:36:35.257 INFO:journalctl@ceph.prometheus.a.smithi181.stdout:Mar 30 13:36:35 smithi181 podman[43250]: 2024-03-30 13:36:35.053618182 +0000 UTC m=+0.133993542 container died c27da06eacc2db3a3d99b22e562f9fd80efd12da3e98d9aaccd90b1f22e0ba16 (image=quay.io/prometheus/prometheus:v2.33.4, name=ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-prometheus-a, maintainer=The Prometheus Authors ) 2024-03-30T13:36:35.629 INFO:journalctl@ceph.prometheus.a.smithi181.stdout:Mar 30 13:36:35 smithi181 podman[43250]: 2024-03-30 13:36:35.451415343 +0000 UTC m=+0.531790708 container cleanup c27da06eacc2db3a3d99b22e562f9fd80efd12da3e98d9aaccd90b1f22e0ba16 (image=quay.io/prometheus/prometheus:v2.33.4, name=ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-prometheus-a, maintainer=The Prometheus Authors ) 2024-03-30T13:36:35.630 INFO:journalctl@ceph.prometheus.a.smithi181.stdout:Mar 30 13:36:35 smithi181 bash[43250]: ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-prometheus-a 2024-03-30T13:36:35.630 INFO:journalctl@ceph.prometheus.a.smithi181.stdout:Mar 30 13:36:35 smithi181 bash[43318]: Error: no container with name or ID "ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-prometheus.a" found: no such container 2024-03-30T13:36:35.976 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:36:35 smithi181 ceph-mon[25762]: from='mgr.14439 ' entity='mgr.y' 2024-03-30T13:36:35.976 INFO:journalctl@ceph.prometheus.a.smithi181.stdout:Mar 30 13:36:35 smithi181 podman[43303]: 2024-03-30 13:36:35.74494776 +0000 UTC m=+0.689707164 container remove c27da06eacc2db3a3d99b22e562f9fd80efd12da3e98d9aaccd90b1f22e0ba16 (image=quay.io/prometheus/prometheus:v2.33.4, name=ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-prometheus-a, maintainer=The Prometheus Authors ) 2024-03-30T13:36:35.977 INFO:journalctl@ceph.prometheus.a.smithi181.stdout:Mar 30 13:36:35 smithi181 systemd[1]: ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4@prometheus.a.service: Deactivated successfully. 2024-03-30T13:36:35.977 INFO:journalctl@ceph.prometheus.a.smithi181.stdout:Mar 30 13:36:35 smithi181 systemd[1]: Stopped Ceph prometheus.a for 98ebaeb8-ee99-11ee-b647-cb9ed24678a4. 2024-03-30T13:36:35.977 INFO:journalctl@ceph.prometheus.a.smithi181.stdout:Mar 30 13:36:35 smithi181 systemd[1]: Starting Ceph prometheus.a for 98ebaeb8-ee99-11ee-b647-cb9ed24678a4... 2024-03-30T13:36:36.034 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:36:35 smithi099 ceph-mon[24912]: from='mgr.14439 ' entity='mgr.y' 2024-03-30T13:36:36.034 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:36:35 smithi099 ceph-mon[29691]: from='mgr.14439 ' entity='mgr.y' 2024-03-30T13:36:36.256 INFO:journalctl@ceph.prometheus.a.smithi181.stdout:Mar 30 13:36:35 smithi181 podman[43407]: 2024-03-30 13:36:35.879539461 +0000 UTC m=+0.024659281 image pull 514e6a882f6e74806a5856468489eeff8d7106095557578da96935e4d0ba4d9d quay.io/prometheus/prometheus:v2.33.4 2024-03-30T13:36:36.631 INFO:journalctl@ceph.prometheus.a.smithi181.stdout:Mar 30 13:36:36 smithi181 podman[43407]: 2024-03-30 13:36:36.287785215 +0000 UTC m=+0.432905065 container create ea2c80227becd8812abcb33d6c37ba5d9b4c2b676045b814e42c73ef116d9dac (image=quay.io/prometheus/prometheus:v2.33.4, name=ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-prometheus-a, maintainer=The Prometheus Authors ) 2024-03-30T13:36:36.901 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:36:36 smithi099 ceph-mon[24912]: pgmap v21: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:36:36.902 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:36:36 smithi099 ceph-mon[29691]: pgmap v21: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:36:37.006 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:36:36 smithi181 ceph-mon[25762]: pgmap v21: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:36:37.492 INFO:journalctl@ceph.prometheus.a.smithi181.stdout:Mar 30 13:36:37 smithi181 podman[43407]: 2024-03-30 13:36:37.26567929 +0000 UTC m=+1.410799095 container init ea2c80227becd8812abcb33d6c37ba5d9b4c2b676045b814e42c73ef116d9dac (image=quay.io/prometheus/prometheus:v2.33.4, name=ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-prometheus-a, maintainer=The Prometheus Authors ) 2024-03-30T13:36:37.492 INFO:journalctl@ceph.prometheus.a.smithi181.stdout:Mar 30 13:36:37 smithi181 podman[43407]: 2024-03-30 13:36:37.26864982 +0000 UTC m=+1.413769638 container start ea2c80227becd8812abcb33d6c37ba5d9b4c2b676045b814e42c73ef116d9dac (image=quay.io/prometheus/prometheus:v2.33.4, name=ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-prometheus-a, maintainer=The Prometheus Authors ) 2024-03-30T13:36:37.493 INFO:journalctl@ceph.prometheus.a.smithi181.stdout:Mar 30 13:36:37 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-prometheus-a[43437]: ts=2024-03-30T13:36:37.294Z caller=main.go:475 level=info msg="No time or size retention was set so using the default time retention" duration=15d 2024-03-30T13:36:37.493 INFO:journalctl@ceph.prometheus.a.smithi181.stdout:Mar 30 13:36:37 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-prometheus-a[43437]: ts=2024-03-30T13:36:37.294Z caller=main.go:512 level=info msg="Starting Prometheus" version="(version=2.33.4, branch=HEAD, revision=83032011a5d3e6102624fe58241a374a7201fee8)" 2024-03-30T13:36:37.493 INFO:journalctl@ceph.prometheus.a.smithi181.stdout:Mar 30 13:36:37 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-prometheus-a[43437]: ts=2024-03-30T13:36:37.294Z caller=main.go:517 level=info build_context="(go=go1.17.7, user=root@d13bf69e7be8, date=20220222-16:51:28)" 2024-03-30T13:36:37.493 INFO:journalctl@ceph.prometheus.a.smithi181.stdout:Mar 30 13:36:37 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-prometheus-a[43437]: ts=2024-03-30T13:36:37.294Z caller=main.go:518 level=info host_details="(Linux 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 x86_64 smithi181 (none))" 2024-03-30T13:36:37.493 INFO:journalctl@ceph.prometheus.a.smithi181.stdout:Mar 30 13:36:37 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-prometheus-a[43437]: ts=2024-03-30T13:36:37.294Z caller=main.go:519 level=info fd_limits="(soft=1048576, hard=1048576)" 2024-03-30T13:36:37.493 INFO:journalctl@ceph.prometheus.a.smithi181.stdout:Mar 30 13:36:37 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-prometheus-a[43437]: ts=2024-03-30T13:36:37.294Z caller=main.go:520 level=info vm_limits="(soft=unlimited, hard=unlimited)" 2024-03-30T13:36:37.493 INFO:journalctl@ceph.prometheus.a.smithi181.stdout:Mar 30 13:36:37 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-prometheus-a[43437]: ts=2024-03-30T13:36:37.295Z caller=web.go:570 level=info component=web msg="Start listening for connections" address=:9095 2024-03-30T13:36:37.493 INFO:journalctl@ceph.prometheus.a.smithi181.stdout:Mar 30 13:36:37 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-prometheus-a[43437]: ts=2024-03-30T13:36:37.296Z caller=main.go:923 level=info msg="Starting TSDB ..." 2024-03-30T13:36:37.493 INFO:journalctl@ceph.prometheus.a.smithi181.stdout:Mar 30 13:36:37 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-prometheus-a[43437]: ts=2024-03-30T13:36:37.297Z caller=tls_config.go:195 level=info component=web msg="TLS is disabled." http2=false 2024-03-30T13:36:37.493 INFO:journalctl@ceph.prometheus.a.smithi181.stdout:Mar 30 13:36:37 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-prometheus-a[43437]: ts=2024-03-30T13:36:37.300Z caller=head.go:493 level=info component=tsdb msg="Replaying on-disk memory mappable chunks if any" 2024-03-30T13:36:37.493 INFO:journalctl@ceph.prometheus.a.smithi181.stdout:Mar 30 13:36:37 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-prometheus-a[43437]: ts=2024-03-30T13:36:37.300Z caller=head.go:527 level=info component=tsdb msg="On-disk memory mappable chunks replay completed" duration=1.97µs 2024-03-30T13:36:37.493 INFO:journalctl@ceph.prometheus.a.smithi181.stdout:Mar 30 13:36:37 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-prometheus-a[43437]: ts=2024-03-30T13:36:37.300Z caller=head.go:533 level=info component=tsdb msg="Replaying WAL, this may take a while" 2024-03-30T13:36:37.493 INFO:journalctl@ceph.prometheus.a.smithi181.stdout:Mar 30 13:36:37 smithi181 bash[43407]: ea2c80227becd8812abcb33d6c37ba5d9b4c2b676045b814e42c73ef116d9dac 2024-03-30T13:36:37.494 INFO:journalctl@ceph.prometheus.a.smithi181.stdout:Mar 30 13:36:37 smithi181 systemd[1]: Started Ceph prometheus.a for 98ebaeb8-ee99-11ee-b647-cb9ed24678a4. 2024-03-30T13:36:37.494 INFO:journalctl@ceph.prometheus.a.smithi181.stdout:Mar 30 13:36:37 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-prometheus-a[43437]: ts=2024-03-30T13:36:37.491Z caller=head.go:604 level=info component=tsdb msg="WAL segment loaded" segment=0 maxSegment=1 2024-03-30T13:36:37.494 INFO:journalctl@ceph.prometheus.a.smithi181.stdout:Mar 30 13:36:37 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-prometheus-a[43437]: ts=2024-03-30T13:36:37.491Z caller=head.go:604 level=info component=tsdb msg="WAL segment loaded" segment=1 maxSegment=1 2024-03-30T13:36:37.494 INFO:journalctl@ceph.prometheus.a.smithi181.stdout:Mar 30 13:36:37 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-prometheus-a[43437]: ts=2024-03-30T13:36:37.491Z caller=head.go:610 level=info component=tsdb msg="WAL replay completed" checkpoint_replay_duration=27.682µs wal_replay_duration=191.17095ms total_replay_duration=191.2136ms 2024-03-30T13:36:37.756 INFO:journalctl@ceph.prometheus.a.smithi181.stdout:Mar 30 13:36:37 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-prometheus-a[43437]: ts=2024-03-30T13:36:37.493Z caller=main.go:944 level=info fs_type=XFS_SUPER_MAGIC 2024-03-30T13:36:37.756 INFO:journalctl@ceph.prometheus.a.smithi181.stdout:Mar 30 13:36:37 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-prometheus-a[43437]: ts=2024-03-30T13:36:37.493Z caller=main.go:947 level=info msg="TSDB started" 2024-03-30T13:36:37.756 INFO:journalctl@ceph.prometheus.a.smithi181.stdout:Mar 30 13:36:37 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-prometheus-a[43437]: ts=2024-03-30T13:36:37.493Z caller=main.go:1128 level=info msg="Loading configuration file" filename=/etc/prometheus/prometheus.yml 2024-03-30T13:36:37.756 INFO:journalctl@ceph.prometheus.a.smithi181.stdout:Mar 30 13:36:37 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-prometheus-a[43437]: ts=2024-03-30T13:36:37.510Z caller=main.go:1165 level=info msg="Completed loading of configuration file" filename=/etc/prometheus/prometheus.yml totalDuration=16.825275ms db_storage=1.087µs remote_storage=1.302µs web_handler=388ns query_engine=671ns scrape=349.851µs scrape_sd=23.471µs notify=869ns notify_sd=1.249µs rules=16.242953ms 2024-03-30T13:36:37.756 INFO:journalctl@ceph.prometheus.a.smithi181.stdout:Mar 30 13:36:37 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-prometheus-a[43437]: ts=2024-03-30T13:36:37.510Z caller=main.go:896 level=info msg="Server is ready to receive web requests." 2024-03-30T13:36:38.689 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:36:38 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[25141]: 172.21.15.99 - - [30/Mar/2024:13:36:38] "POST /data HTTP/1.1" 200 46 "" "Python-urllib/3.9" 2024-03-30T13:36:38.689 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:36:38 smithi099 ceph-mon[24912]: from='mgr.14439 ' entity='mgr.y' 2024-03-30T13:36:38.689 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:36:38 smithi099 ceph-mon[24912]: from='mgr.14439 172.21.15.99:0/1757456350' entity='mgr.y' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-03-30T13:36:38.689 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:36:38 smithi099 ceph-mon[24912]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-03-30T13:36:38.689 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:36:38 smithi099 ceph-mon[24912]: from='mgr.14439 172.21.15.99:0/1757456350' entity='mgr.y' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://172.21.15.181:9095"}]: dispatch 2024-03-30T13:36:38.689 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:36:38 smithi099 ceph-mon[24912]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://172.21.15.181:9095"}]: dispatch 2024-03-30T13:36:38.689 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:36:38 smithi099 ceph-mon[24912]: from='mgr.14439 ' entity='mgr.y' 2024-03-30T13:36:38.689 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:36:38 smithi099 ceph-mon[24912]: from='mgr.14439 172.21.15.99:0/1757456350' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:36:38.689 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:36:38 smithi099 ceph-mon[24912]: from='mgr.14439 172.21.15.99:0/1757456350' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:36:38.690 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:36:38 smithi099 ceph-mon[24912]: from='mgr.14439 172.21.15.99:0/1757456350' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:36:38.690 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:36:38 smithi099 ceph-mon[24912]: from='mgr.14439 ' entity='mgr.y' 2024-03-30T13:36:38.690 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:36:38 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:36:38.690 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:36:38 smithi099 ceph-mon[24912]: from='mgr.14439 172.21.15.99:0/1757456350' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:36:38.690 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:36:38 smithi099 ceph-mon[24912]: from='mgr.14439 172.21.15.99:0/1757456350' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:36:38.690 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:36:38 smithi099 ceph-mon[24912]: from='mgr.14439 172.21.15.99:0/1757456350' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:36:38.690 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:36:38 smithi099 ceph-mon[24912]: from='mgr.14439 ' entity='mgr.y' 2024-03-30T13:36:38.690 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:36:38 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:36:38.690 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:36:38 smithi099 ceph-mon[24912]: pgmap v22: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:36:38.690 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:36:38 smithi099 ceph-mon[29691]: from='mgr.14439 ' entity='mgr.y' 2024-03-30T13:36:38.691 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:36:38 smithi099 ceph-mon[29691]: from='mgr.14439 172.21.15.99:0/1757456350' entity='mgr.y' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-03-30T13:36:38.691 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:36:38 smithi099 ceph-mon[29691]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-03-30T13:36:38.691 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:36:38 smithi099 ceph-mon[29691]: from='mgr.14439 172.21.15.99:0/1757456350' entity='mgr.y' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://172.21.15.181:9095"}]: dispatch 2024-03-30T13:36:38.691 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:36:38 smithi099 ceph-mon[29691]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://172.21.15.181:9095"}]: dispatch 2024-03-30T13:36:38.691 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:36:38 smithi099 ceph-mon[29691]: from='mgr.14439 ' entity='mgr.y' 2024-03-30T13:36:38.691 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:36:38 smithi099 ceph-mon[29691]: from='mgr.14439 172.21.15.99:0/1757456350' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:36:38.691 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:36:38 smithi099 ceph-mon[29691]: from='mgr.14439 172.21.15.99:0/1757456350' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:36:38.691 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:36:38 smithi099 ceph-mon[29691]: from='mgr.14439 172.21.15.99:0/1757456350' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:36:38.691 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:36:38 smithi099 ceph-mon[29691]: from='mgr.14439 ' entity='mgr.y' 2024-03-30T13:36:38.691 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:36:38 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:36:38.691 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:36:38 smithi099 ceph-mon[29691]: from='mgr.14439 172.21.15.99:0/1757456350' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:36:38.691 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:36:38 smithi099 ceph-mon[29691]: from='mgr.14439 172.21.15.99:0/1757456350' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:36:38.691 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:36:38 smithi099 ceph-mon[29691]: from='mgr.14439 172.21.15.99:0/1757456350' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:36:38.691 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:36:38 smithi099 ceph-mon[29691]: from='mgr.14439 ' entity='mgr.y' 2024-03-30T13:36:38.692 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:36:38 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:36:38.692 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:36:38 smithi099 ceph-mon[29691]: pgmap v22: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:36:38.756 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:36:38 smithi181 ceph-mon[25762]: from='mgr.14439 ' entity='mgr.y' 2024-03-30T13:36:38.756 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:36:38 smithi181 ceph-mon[25762]: from='mgr.14439 172.21.15.99:0/1757456350' entity='mgr.y' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-03-30T13:36:38.756 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:36:38 smithi181 ceph-mon[25762]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-03-30T13:36:38.757 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:36:38 smithi181 ceph-mon[25762]: from='mgr.14439 172.21.15.99:0/1757456350' entity='mgr.y' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://172.21.15.181:9095"}]: dispatch 2024-03-30T13:36:38.757 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:36:38 smithi181 ceph-mon[25762]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://172.21.15.181:9095"}]: dispatch 2024-03-30T13:36:38.757 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:36:38 smithi181 ceph-mon[25762]: from='mgr.14439 ' entity='mgr.y' 2024-03-30T13:36:38.757 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:36:38 smithi181 ceph-mon[25762]: from='mgr.14439 172.21.15.99:0/1757456350' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:36:38.757 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:36:38 smithi181 ceph-mon[25762]: from='mgr.14439 172.21.15.99:0/1757456350' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:36:38.757 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:36:38 smithi181 ceph-mon[25762]: from='mgr.14439 172.21.15.99:0/1757456350' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:36:38.757 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:36:38 smithi181 ceph-mon[25762]: from='mgr.14439 ' entity='mgr.y' 2024-03-30T13:36:38.757 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:36:38 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:36:38.757 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:36:38 smithi181 ceph-mon[25762]: from='mgr.14439 172.21.15.99:0/1757456350' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:36:38.757 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:36:38 smithi181 ceph-mon[25762]: from='mgr.14439 172.21.15.99:0/1757456350' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:36:38.757 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:36:38 smithi181 ceph-mon[25762]: from='mgr.14439 172.21.15.99:0/1757456350' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:36:38.757 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:36:38 smithi181 ceph-mon[25762]: from='mgr.14439 ' entity='mgr.y' 2024-03-30T13:36:38.757 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:36:38 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:36:38.757 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:36:38 smithi181 ceph-mon[25762]: pgmap v22: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:36:39.488 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:36:39 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[25141]: 172.21.15.181 - - [30/Mar/2024:13:36:39] "POST /data HTTP/1.1" 200 46 "" "Python-urllib/3.9" 2024-03-30T13:36:39.743 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:36:39 smithi099 ceph-mon[24912]: from='mgr.14439 ' entity='mgr.y' 2024-03-30T13:36:39.743 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:36:39 smithi099 ceph-mon[24912]: from='mgr.14439 ' entity='mgr.y' 2024-03-30T13:36:39.743 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:36:39 smithi099 ceph-mon[29691]: from='mgr.14439 ' entity='mgr.y' 2024-03-30T13:36:39.743 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:36:39 smithi099 ceph-mon[29691]: from='mgr.14439 ' entity='mgr.y' 2024-03-30T13:36:39.755 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:36:39 smithi181 ceph-mon[25762]: from='mgr.14439 ' entity='mgr.y' 2024-03-30T13:36:39.756 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:36:39 smithi181 ceph-mon[25762]: from='mgr.14439 ' entity='mgr.y' 2024-03-30T13:36:40.743 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:36:40 smithi099 ceph-mon[24912]: pgmap v23: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:36:40.744 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:36:40 smithi099 ceph-mon[29691]: pgmap v23: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:36:40.756 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:36:40 smithi181 ceph-mon[25762]: pgmap v23: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:36:40.996 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:36:40 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[25141]: 172.21.15.181 - - [30/Mar/2024:13:36:40] "POST /data HTTP/1.1" 200 46 "" "Python-urllib/3.9" 2024-03-30T13:36:42.256 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:36:41 smithi181 ceph-mon[25762]: from='mgr.14439 ' entity='mgr.y' 2024-03-30T13:36:42.256 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:36:41 smithi181 ceph-mon[25762]: from='mgr.14439 ' entity='mgr.y' 2024-03-30T13:36:42.337 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:36:41 smithi099 ceph-mon[24912]: from='mgr.14439 ' entity='mgr.y' 2024-03-30T13:36:42.337 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:36:41 smithi099 ceph-mon[24912]: from='mgr.14439 ' entity='mgr.y' 2024-03-30T13:36:42.337 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:36:41 smithi099 ceph-mon[29691]: from='mgr.14439 ' entity='mgr.y' 2024-03-30T13:36:42.337 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:36:41 smithi099 ceph-mon[29691]: from='mgr.14439 ' entity='mgr.y' 2024-03-30T13:36:42.738 INFO:teuthology.orchestra.run.smithi099.stdout:34359738416 2024-03-30T13:36:42.739 DEBUG:teuthology.orchestra.run.smithi099:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell --fsid 98ebaeb8-ee99-11ee-b647-cb9ed24678a4 -- ceph osd last-stat-seq osd.0 2024-03-30T13:36:43.086 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:36:42 smithi099 ceph-mon[24912]: pgmap v24: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:36:43.087 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:36:42 smithi099 ceph-mon[29691]: pgmap v24: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:36:43.256 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:36:42 smithi181 ceph-mon[25762]: pgmap v24: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:36:44.826 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:36:44 smithi099 ceph-mon[24912]: pgmap v25: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:36:44.827 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:36:44 smithi099 ceph-mon[29691]: pgmap v25: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:36:45.006 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:36:44 smithi181 ceph-mon[25762]: pgmap v25: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:36:46.837 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:36:46 smithi099 ceph-mon[24912]: pgmap v26: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:36:46.837 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:36:46 smithi099 ceph-mon[29691]: pgmap v26: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:36:46.837 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:36:46 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[25141]: ::ffff:172.21.15.181 - - [30/Mar/2024:13:36:46] "GET /metrics HTTP/1.1" 200 191491 "" "Prometheus/2.33.4" 2024-03-30T13:36:47.006 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:36:46 smithi181 ceph-mon[25762]: pgmap v26: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:36:47.957 INFO:teuthology.orchestra.run.smithi099.stdout:236223201294 2024-03-30T13:36:47.957 DEBUG:teuthology.orchestra.run.smithi099:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell --fsid 98ebaeb8-ee99-11ee-b647-cb9ed24678a4 -- ceph osd last-stat-seq osd.7 2024-03-30T13:36:48.687 INFO:teuthology.orchestra.run.smithi099.stdout:201863462931 2024-03-30T13:36:48.687 DEBUG:teuthology.orchestra.run.smithi099:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell --fsid 98ebaeb8-ee99-11ee-b647-cb9ed24678a4 -- ceph osd last-stat-seq osd.6 2024-03-30T13:36:48.965 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:36:48 smithi099 ceph-mon[24912]: pgmap v27: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:36:48.965 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:36:48 smithi099 ceph-mon[29691]: pgmap v27: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:36:49.006 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:36:48 smithi181 ceph-mon[25762]: pgmap v27: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:36:49.625 INFO:teuthology.orchestra.run.smithi099.stdout:55834574891 2024-03-30T13:36:49.625 DEBUG:teuthology.orchestra.run.smithi099:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell --fsid 98ebaeb8-ee99-11ee-b647-cb9ed24678a4 -- ceph osd last-stat-seq osd.1 2024-03-30T13:36:49.756 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 13:36:49 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-x[27332]: ::ffff:172.21.15.181 - - [30/Mar/2024:13:36:49] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-03-30T13:36:50.576 INFO:teuthology.orchestra.run.smithi099.stdout:133143986205 2024-03-30T13:36:50.577 DEBUG:teuthology.orchestra.run.smithi099:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell --fsid 98ebaeb8-ee99-11ee-b647-cb9ed24678a4 -- ceph osd last-stat-seq osd.4 2024-03-30T13:36:50.837 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:36:50 smithi099 ceph-mon[24912]: pgmap v28: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:36:50.837 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:36:50 smithi099 ceph-mon[29691]: pgmap v28: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:36:51.006 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:36:50 smithi181 ceph-mon[25762]: pgmap v28: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:36:51.247 INFO:teuthology.orchestra.run.smithi099.stdout:77309411367 2024-03-30T13:36:51.247 DEBUG:teuthology.orchestra.run.smithi099:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell --fsid 98ebaeb8-ee99-11ee-b647-cb9ed24678a4 -- ceph osd last-stat-seq osd.2 2024-03-30T13:36:51.852 INFO:teuthology.orchestra.run.smithi099.stderr:Inferring config /var/lib/ceph/98ebaeb8-ee99-11ee-b647-cb9ed24678a4/mon.a/config 2024-03-30T13:36:51.884 INFO:teuthology.orchestra.run.smithi099.stdout:111669149730 2024-03-30T13:36:51.884 DEBUG:teuthology.orchestra.run.smithi099:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell --fsid 98ebaeb8-ee99-11ee-b647-cb9ed24678a4 -- ceph osd last-stat-seq osd.3 2024-03-30T13:36:52.650 INFO:teuthology.orchestra.run.smithi099.stderr:Inferring config /var/lib/ceph/98ebaeb8-ee99-11ee-b647-cb9ed24678a4/mon.a/config 2024-03-30T13:36:52.650 INFO:teuthology.orchestra.run.smithi099.stderr:Inferring config /var/lib/ceph/98ebaeb8-ee99-11ee-b647-cb9ed24678a4/mon.a/config 2024-03-30T13:36:52.651 INFO:teuthology.orchestra.run.smithi099.stderr:Inferring config /var/lib/ceph/98ebaeb8-ee99-11ee-b647-cb9ed24678a4/mon.a/config 2024-03-30T13:36:52.681 INFO:teuthology.orchestra.run.smithi099.stdout:167503724569 2024-03-30T13:36:52.681 DEBUG:teuthology.orchestra.run.smithi099:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell --fsid 98ebaeb8-ee99-11ee-b647-cb9ed24678a4 -- ceph osd last-stat-seq osd.5 2024-03-30T13:36:52.895 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:36:52 smithi099 ceph-mon[24912]: pgmap v29: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:36:52.895 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:36:52 smithi099 ceph-mon[29691]: pgmap v29: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:36:53.006 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:36:52 smithi181 ceph-mon[25762]: pgmap v29: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:36:53.230 INFO:teuthology.orchestra.run.smithi099.stderr:Inferring config /var/lib/ceph/98ebaeb8-ee99-11ee-b647-cb9ed24678a4/mon.a/config 2024-03-30T13:36:53.233 INFO:teuthology.orchestra.run.smithi099.stderr:Inferring config /var/lib/ceph/98ebaeb8-ee99-11ee-b647-cb9ed24678a4/mon.a/config 2024-03-30T13:36:53.233 INFO:teuthology.orchestra.run.smithi099.stderr:Inferring config /var/lib/ceph/98ebaeb8-ee99-11ee-b647-cb9ed24678a4/mon.a/config 2024-03-30T13:36:53.234 INFO:teuthology.orchestra.run.smithi099.stderr:Inferring config /var/lib/ceph/98ebaeb8-ee99-11ee-b647-cb9ed24678a4/mon.a/config 2024-03-30T13:36:54.748 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:36:54 smithi181 ceph-mon[25762]: pgmap v30: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:36:54.837 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:36:54 smithi099 ceph-mon[24912]: pgmap v30: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:36:54.838 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:36:54 smithi099 ceph-mon[29691]: pgmap v30: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:36:56.337 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:36:56 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[25141]: 172.21.15.181 - - [30/Mar/2024:13:36:56] "POST /data HTTP/1.1" 200 46 "" "Python-urllib/3.9" 2024-03-30T13:36:56.756 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:36:56 smithi181 ceph-mon[25762]: pgmap v31: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:36:56.756 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:36:56 smithi181 ceph-mon[25762]: from='mgr.14439 ' entity='mgr.y' 2024-03-30T13:36:56.756 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:36:56 smithi181 ceph-mon[25762]: from='mgr.14439 ' entity='mgr.y' 2024-03-30T13:36:56.837 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:36:56 smithi099 ceph-mon[29691]: pgmap v31: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:36:56.837 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:36:56 smithi099 ceph-mon[29691]: from='mgr.14439 ' entity='mgr.y' 2024-03-30T13:36:56.837 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:36:56 smithi099 ceph-mon[29691]: from='mgr.14439 ' entity='mgr.y' 2024-03-30T13:36:56.837 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:36:56 smithi099 ceph-mon[24912]: pgmap v31: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:36:56.837 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:36:56 smithi099 ceph-mon[24912]: from='mgr.14439 ' entity='mgr.y' 2024-03-30T13:36:56.837 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:36:56 smithi099 ceph-mon[24912]: from='mgr.14439 ' entity='mgr.y' 2024-03-30T13:36:56.837 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:36:56 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[25141]: ::ffff:172.21.15.181 - - [30/Mar/2024:13:36:56] "GET /metrics HTTP/1.1" 200 191491 "" "Prometheus/2.33.4" 2024-03-30T13:36:58.837 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:36:58 smithi099 ceph-mon[24912]: pgmap v32: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:36:58.837 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:36:58 smithi099 ceph-mon[24912]: from='mgr.14439 ' entity='mgr.y' 2024-03-30T13:36:58.837 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:36:58 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[25141]: 172.21.15.99 - - [30/Mar/2024:13:36:58] "POST /data HTTP/1.1" 200 46 "" "Python-urllib/3.9" 2024-03-30T13:36:58.837 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:36:58 smithi099 ceph-mon[29691]: pgmap v32: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:36:58.838 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:36:58 smithi099 ceph-mon[29691]: from='mgr.14439 ' entity='mgr.y' 2024-03-30T13:36:59.006 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:36:58 smithi181 ceph-mon[25762]: pgmap v32: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:36:59.006 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:36:58 smithi181 ceph-mon[25762]: from='mgr.14439 ' entity='mgr.y' 2024-03-30T13:36:59.756 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 13:36:59 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-x[27332]: ::ffff:172.21.15.181 - - [30/Mar/2024:13:36:59] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-03-30T13:37:00.930 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:37:00 smithi099 ceph-mon[24912]: pgmap v33: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:37:00.930 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:37:00 smithi099 ceph-mon[24912]: from='mgr.14439 172.21.15.99:0/1757456350' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-03-30T13:37:00.930 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:37:00 smithi099 ceph-mon[24912]: from='mgr.14439 172.21.15.99:0/1757456350' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-03-30T13:37:00.931 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:37:00 smithi099 ceph-mon[24912]: from='mgr.14439 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-03-30T13:37:00.931 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:37:00 smithi099 ceph-mon[24912]: from='mgr.14439 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-03-30T13:37:00.931 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:37:00 smithi099 ceph-mon[29691]: pgmap v33: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:37:00.931 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:37:00 smithi099 ceph-mon[29691]: from='mgr.14439 172.21.15.99:0/1757456350' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-03-30T13:37:00.931 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:37:00 smithi099 ceph-mon[29691]: from='mgr.14439 172.21.15.99:0/1757456350' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-03-30T13:37:00.931 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:37:00 smithi099 ceph-mon[29691]: from='mgr.14439 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-03-30T13:37:00.931 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:37:00 smithi099 ceph-mon[29691]: from='mgr.14439 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-03-30T13:37:01.006 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:37:00 smithi181 ceph-mon[25762]: pgmap v33: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:37:01.006 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:37:00 smithi181 ceph-mon[25762]: from='mgr.14439 172.21.15.99:0/1757456350' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-03-30T13:37:01.006 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:37:00 smithi181 ceph-mon[25762]: from='mgr.14439 172.21.15.99:0/1757456350' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-03-30T13:37:01.006 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:37:00 smithi181 ceph-mon[25762]: from='mgr.14439 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-03-30T13:37:01.006 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:37:00 smithi181 ceph-mon[25762]: from='mgr.14439 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-03-30T13:37:02.322 INFO:teuthology.orchestra.run.smithi099.stdout:201863462935 2024-03-30T13:37:02.911 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:37:02 smithi099 ceph-mon[24912]: pgmap v34: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:37:02.911 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:37:02 smithi099 ceph-mon[24912]: from='client.? 172.21.15.99:0/3484374608' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2024-03-30T13:37:02.911 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:37:02 smithi099 ceph-mon[29691]: pgmap v34: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:37:02.912 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:37:02 smithi099 ceph-mon[29691]: from='client.? 172.21.15.99:0/3484374608' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2024-03-30T13:37:03.006 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:37:02 smithi181 ceph-mon[25762]: pgmap v34: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:37:03.006 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:37:02 smithi181 ceph-mon[25762]: from='client.? 172.21.15.99:0/3484374608' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2024-03-30T13:37:03.192 INFO:teuthology.orchestra.run.smithi099.stdout:77309411370 2024-03-30T13:37:03.458 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:37:03 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[25141]: 172.21.15.99 - - [30/Mar/2024:13:37:03] "POST /data HTTP/1.1" 200 46 "" "Python-urllib/3.9" 2024-03-30T13:37:03.565 INFO:teuthology.orchestra.run.smithi099.stdout:34359738420 2024-03-30T13:37:03.837 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:37:03 smithi099 ceph-mon[24912]: from='client.? 172.21.15.99:0/275948450' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-03-30T13:37:03.837 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:37:03 smithi099 ceph-mon[24912]: from='mgr.14439 ' entity='mgr.y' 2024-03-30T13:37:03.837 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:37:03 smithi099 ceph-mon[24912]: from='mgr.14439 ' entity='mgr.y' 2024-03-30T13:37:03.837 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:37:03 smithi099 ceph-mon[24912]: from='mgr.14439 172.21.15.99:0/1757456350' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:37:03.837 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:37:03 smithi099 ceph-mon[24912]: from='mgr.14439 172.21.15.99:0/1757456350' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:37:03.837 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:37:03 smithi099 ceph-mon[24912]: from='mgr.14439 172.21.15.99:0/1757456350' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:37:03.838 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:37:03 smithi099 ceph-mon[24912]: from='mgr.14439 ' entity='mgr.y' 2024-03-30T13:37:03.838 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:37:03 smithi099 ceph-mon[24912]: from='client.? 172.21.15.99:0/2486917212' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-03-30T13:37:03.838 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:37:03 smithi099 ceph-mon[29691]: from='client.? 172.21.15.99:0/275948450' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-03-30T13:37:03.838 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:37:03 smithi099 ceph-mon[29691]: from='mgr.14439 ' entity='mgr.y' 2024-03-30T13:37:03.838 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:37:03 smithi099 ceph-mon[29691]: from='mgr.14439 ' entity='mgr.y' 2024-03-30T13:37:03.838 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:37:03 smithi099 ceph-mon[29691]: from='mgr.14439 172.21.15.99:0/1757456350' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:37:03.838 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:37:03 smithi099 ceph-mon[29691]: from='mgr.14439 172.21.15.99:0/1757456350' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:37:03.838 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:37:03 smithi099 ceph-mon[29691]: from='mgr.14439 172.21.15.99:0/1757456350' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:37:03.839 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:37:03 smithi099 ceph-mon[29691]: from='mgr.14439 ' entity='mgr.y' 2024-03-30T13:37:03.839 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:37:03 smithi099 ceph-mon[29691]: from='client.? 172.21.15.99:0/2486917212' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-03-30T13:37:04.006 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:37:03 smithi181 ceph-mon[25762]: from='client.? 172.21.15.99:0/275948450' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-03-30T13:37:04.006 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:37:03 smithi181 ceph-mon[25762]: from='mgr.14439 ' entity='mgr.y' 2024-03-30T13:37:04.006 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:37:03 smithi181 ceph-mon[25762]: from='mgr.14439 ' entity='mgr.y' 2024-03-30T13:37:04.006 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:37:03 smithi181 ceph-mon[25762]: from='mgr.14439 172.21.15.99:0/1757456350' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:37:04.006 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:37:03 smithi181 ceph-mon[25762]: from='mgr.14439 172.21.15.99:0/1757456350' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:37:04.006 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:37:03 smithi181 ceph-mon[25762]: from='mgr.14439 172.21.15.99:0/1757456350' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:37:04.006 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:37:03 smithi181 ceph-mon[25762]: from='mgr.14439 ' entity='mgr.y' 2024-03-30T13:37:04.006 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:37:03 smithi181 ceph-mon[25762]: from='client.? 172.21.15.99:0/2486917212' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-03-30T13:37:04.481 INFO:teuthology.orchestra.run.smithi099.stdout:133143986208 2024-03-30T13:37:04.761 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:37:04 smithi099 ceph-mon[24912]: Deploying daemon alertmanager.a on smithi099 2024-03-30T13:37:04.761 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:37:04 smithi099 ceph-mon[24912]: pgmap v35: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:37:04.761 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:37:04 smithi099 ceph-mon[24912]: from='client.? 172.21.15.99:0/3806637268' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-03-30T13:37:04.762 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:37:04 smithi099 ceph-mon[29691]: Deploying daemon alertmanager.a on smithi099 2024-03-30T13:37:04.762 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:37:04 smithi099 ceph-mon[29691]: pgmap v35: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:37:04.762 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:37:04 smithi099 ceph-mon[29691]: from='client.? 172.21.15.99:0/3806637268' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-03-30T13:37:05.006 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:37:04 smithi181 ceph-mon[25762]: Deploying daemon alertmanager.a on smithi099 2024-03-30T13:37:05.006 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:37:04 smithi181 ceph-mon[25762]: pgmap v35: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:37:05.006 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:37:04 smithi181 ceph-mon[25762]: from='client.? 172.21.15.99:0/3806637268' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-03-30T13:37:06.451 INFO:teuthology.orchestra.run.smithi099.stdout:111669149735 2024-03-30T13:37:06.784 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:37:06 smithi099 ceph-mon[24912]: pgmap v36: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:37:06.784 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:37:06 smithi099 ceph-mon[24912]: from='client.? 172.21.15.99:0/4205734297' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-03-30T13:37:06.784 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:37:06 smithi099 ceph-mon[29691]: pgmap v36: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:37:06.784 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:37:06 smithi099 ceph-mon[29691]: from='client.? 172.21.15.99:0/4205734297' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-03-30T13:37:06.784 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:37:06 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[25141]: ::ffff:172.21.15.181 - - [30/Mar/2024:13:37:06] "GET /metrics HTTP/1.1" 200 191495 "" "Prometheus/2.33.4" 2024-03-30T13:37:07.006 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:37:06 smithi181 ceph-mon[25762]: pgmap v36: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:37:07.006 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:37:06 smithi181 ceph-mon[25762]: from='client.? 172.21.15.99:0/4205734297' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-03-30T13:37:07.193 INFO:tasks.cephadm.ceph_manager.ceph:need seq 77309411367 got 77309411370 for osd.2 2024-03-30T13:37:07.193 DEBUG:teuthology.parallel:result is None 2024-03-30T13:37:07.826 INFO:tasks.cephadm.ceph_manager.ceph:need seq 201863462931 got 201863462935 for osd.6 2024-03-30T13:37:07.826 DEBUG:teuthology.parallel:result is None 2024-03-30T13:37:08.431 INFO:tasks.cephadm.ceph_manager.ceph:need seq 34359738416 got 34359738420 for osd.0 2024-03-30T13:37:08.431 DEBUG:teuthology.parallel:result is None 2024-03-30T13:37:08.981 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:37:08 smithi099 ceph-mon[24912]: pgmap v37: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:37:08.981 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:37:08 smithi099 ceph-mon[29691]: pgmap v37: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:37:09.005 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:37:08 smithi181 ceph-mon[25762]: pgmap v37: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:37:09.682 INFO:tasks.cephadm.ceph_manager.ceph:need seq 111669149730 got 111669149735 for osd.3 2024-03-30T13:37:09.682 DEBUG:teuthology.parallel:result is None 2024-03-30T13:37:09.756 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:37:09 smithi181 ceph-mon[25762]: from='client.? 172.21.15.99:0/485338087' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-03-30T13:37:09.756 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 13:37:09 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-x[27332]: ::ffff:172.21.15.181 - - [30/Mar/2024:13:37:09] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-03-30T13:37:09.955 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:37:09 smithi099 ceph-mon[24912]: from='client.? 172.21.15.99:0/485338087' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-03-30T13:37:09.955 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:37:09 smithi099 ceph-mon[29691]: from='client.? 172.21.15.99:0/485338087' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-03-30T13:37:10.634 INFO:teuthology.orchestra.run.smithi099.stdout:167503724573 2024-03-30T13:37:10.837 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:37:10 smithi099 ceph-mon[24912]: pgmap v38: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:37:10.837 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:37:10 smithi099 ceph-mon[24912]: from='client.? 172.21.15.99:0/3628896788' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-03-30T13:37:10.837 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:37:10 smithi099 ceph-mon[29691]: pgmap v38: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:37:10.837 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:37:10 smithi099 ceph-mon[29691]: from='client.? 172.21.15.99:0/3628896788' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-03-30T13:37:10.967 INFO:tasks.cephadm.ceph_manager.ceph:need seq 133143986205 got 133143986208 for osd.4 2024-03-30T13:37:10.967 DEBUG:teuthology.parallel:result is None 2024-03-30T13:37:11.006 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:37:10 smithi181 ceph-mon[25762]: pgmap v38: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:37:11.006 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:37:10 smithi181 ceph-mon[25762]: from='client.? 172.21.15.99:0/3628896788' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-03-30T13:37:11.245 INFO:teuthology.orchestra.run.smithi099.stdout:55834574896 2024-03-30T13:37:11.328 INFO:teuthology.orchestra.run.smithi099.stdout:236223201299 2024-03-30T13:37:12.006 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:37:11 smithi181 ceph-mon[25762]: from='client.? 172.21.15.99:0/3598139521' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2024-03-30T13:37:12.017 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:37:11 smithi099 ceph-mon[24912]: from='client.? 172.21.15.99:0/3598139521' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2024-03-30T13:37:12.017 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:37:11 smithi099 ceph-mon[29691]: from='client.? 172.21.15.99:0/3598139521' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2024-03-30T13:37:12.040 INFO:tasks.cephadm.ceph_manager.ceph:need seq 236223201294 got 236223201299 for osd.7 2024-03-30T13:37:12.041 DEBUG:teuthology.parallel:result is None 2024-03-30T13:37:12.483 INFO:tasks.cephadm.ceph_manager.ceph:need seq 167503724569 got 167503724573 for osd.5 2024-03-30T13:37:12.483 DEBUG:teuthology.parallel:result is None 2024-03-30T13:37:12.837 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:37:12 smithi099 ceph-mon[24912]: pgmap v39: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:37:12.837 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:37:12 smithi099 ceph-mon[29691]: pgmap v39: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:37:12.920 INFO:tasks.cephadm.ceph_manager.ceph:need seq 55834574891 got 55834574896 for osd.1 2024-03-30T13:37:12.921 DEBUG:teuthology.parallel:result is None 2024-03-30T13:37:12.921 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2024-03-30T13:37:12.921 DEBUG:teuthology.orchestra.run.smithi099:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell --fsid 98ebaeb8-ee99-11ee-b647-cb9ed24678a4 -- ceph pg dump --format=json 2024-03-30T13:37:12.969 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:37:12 smithi181 ceph-mon[25762]: pgmap v39: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:37:13.136 INFO:teuthology.orchestra.run.smithi099.stderr:Inferring config /var/lib/ceph/98ebaeb8-ee99-11ee-b647-cb9ed24678a4/mon.a/config 2024-03-30T13:37:14.587 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:37:14 smithi099 ceph-mon[24912]: pgmap v40: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:37:14.587 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:37:14 smithi099 ceph-mon[29691]: pgmap v40: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:37:15.006 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:37:14 smithi181 ceph-mon[25762]: pgmap v40: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:37:15.265 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-03-30T13:37:15.267 INFO:teuthology.orchestra.run.smithi099.stderr:dumped all 2024-03-30T13:37:15.586 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:37:15 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[25141]: 172.21.15.99 - - [30/Mar/2024:13:37:15] "POST /data HTTP/1.1" 200 46 "" "Python-urllib/3.9" 2024-03-30T13:37:15.948 INFO:teuthology.orchestra.run.smithi099.stdout:{"pg_ready":true,"pg_map":{"version":40,"stamp":"2024-03-30T13:37:13.579248+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":212,"num_read_kb":306,"num_write":179,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":1586784,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":128,"ondisk_log_size":128,"up":3,"acting":3,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":3,"num_osds":8,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":749961216,"kb_used":48968,"kb_used_data":6152,"kb_used_omap":0,"kb_used_meta":42752,"kb_avail":749912248,"statfs":{"total":767960285184,"available":767910141952,"internally_reserved":0,"allocated":6299648,"data_stored":3510888,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":43778048},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002338"},"pg_stats":[{"pgid":"1.0","version":"60'128","reported_seq":267,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-03-30T13:35:59.650362+0000","last_change":"2024-03-30T13:35:45.592959+0000","last_active":"2024-03-30T13:35:59.650362+0000","last_peered":"2024-03-30T13:35:59.650362+0000","last_clean":"2024-03-30T13:35:59.650362+0000","last_became_active":"2024-03-30T13:35:45.592585+0000","last_became_peered":"2024-03-30T13:35:45.592585+0000","last_unstale":"2024-03-30T13:35:59.650362+0000","last_undegraded":"2024-03-30T13:35:59.650362+0000","last_fullsized":"2024-03-30T13:35:59.650362+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:33:44.767452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:33:44.767452+0000","last_clean_scrub_stamp":"2024-03-30T13:33:44.767452+0000","objects_scrubbed":0,"log_size":128,"ondisk_log_size":128,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:59:18.458210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":212,"num_read_kb":306,"num_write":179,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":1586784,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,6],"acting":[7,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":212,"num_read_kb":306,"num_write":179,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":1586784,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1597440,"data_stored":1586784,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":128,"ondisk_log_size":128,"up":3,"acting":3,"num_store_stats":3}],"osd_stats":[{"osd":7,"up_from":55,"seq":236223201300,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":6096,"kb_used_data":1096,"kb_used_omap":0,"kb_used_meta":4992,"kb_avail":93739056,"statfs":{"total":95995035648,"available":95988793344,"internally_reserved":0,"allocated":1122304,"data_stored":769588,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5111808},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Mar 30 13:36:43 2024","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"min":{"1min":0.216,"5min":0.216,"15min":0.216},"max":{"1min":1.9179999999999999,"5min":1.9179999999999999,"15min":1.9179999999999999},"last":0.49299999999999999},{"interface":"front","average":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"last":0.58699999999999997}]},{"osd":1,"last update":"Sat Mar 30 13:36:43 2024","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"min":{"1min":0.255,"5min":0.255,"15min":0.255},"max":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"last":0.44900000000000001},{"interface":"front","average":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.746,"5min":0.746,"15min":0.746},"last":0.66500000000000004}]},{"osd":2,"last update":"Sat Mar 30 13:36:43 2024","interfaces":[{"interface":"back","average":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"last":0.504},{"interface":"front","average":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"min":{"1min":0.28199999999999997,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":0.65500000000000003},"last":0.52900000000000003}]},{"osd":3,"last update":"Sat Mar 30 13:36:43 2024","interfaces":[{"interface":"back","average":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"last":0.56599999999999995},{"interface":"front","average":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"min":{"1min":0.307,"5min":0.307,"15min":0.307},"max":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.72499999999999998},"last":0.64400000000000002}]},{"osd":4,"last update":"Sat Mar 30 13:36:43 2024","interfaces":[{"interface":"back","average":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"last":0.73899999999999999},{"interface":"front","average":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"last":0.69999999999999996}]},{"osd":5,"last update":"Sat Mar 30 13:36:43 2024","interfaces":[{"interface":"back","average":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"min":{"1min":0.26100000000000001,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"last":0.71099999999999997},{"interface":"front","average":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"last":0.67900000000000005}]},{"osd":6,"last update":"Sat Mar 30 13:36:43 2024","interfaces":[{"interface":"back","average":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"last":0.75900000000000001},{"interface":"front","average":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"last":0.61599999999999999}]}]},{"osd":6,"up_from":47,"seq":201863462937,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":6152,"kb_used_data":1088,"kb_used_omap":0,"kb_used_meta":5056,"kb_avail":93739000,"statfs":{"total":95995035648,"available":95988736000,"internally_reserved":0,"allocated":1114112,"data_stored":769000,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5177344},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Mar 30 13:36:19 2024","interfaces":[{"interface":"back","average":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":0.68999999999999995,"5min":0.68999999999999995,"15min":0.68999999999999995},"last":0.52600000000000002},{"interface":"front","average":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":0.73499999999999999},"last":0.48999999999999999}]},{"osd":1,"last update":"Sat Mar 30 13:36:19 2024","interfaces":[{"interface":"back","average":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"last":0.47699999999999998},{"interface":"front","average":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.65400000000000003}]},{"osd":2,"last update":"Sat Mar 30 13:36:19 2024","interfaces":[{"interface":"back","average":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.79900000000000004},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"last":0.46200000000000002}]},{"osd":3,"last update":"Sat Mar 30 13:36:19 2024","interfaces":[{"interface":"back","average":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"last":0.64100000000000001},{"interface":"front","average":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.877,"5min":0.877,"15min":0.877},"last":0.70799999999999996}]},{"osd":4,"last update":"Sat Mar 30 13:36:19 2024","interfaces":[{"interface":"back","average":{"1min":0.434,"5min":0.434,"15min":0.434},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"last":0.57299999999999995},{"interface":"front","average":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"min":{"1min":0.29099999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"last":0.67100000000000004}]},{"osd":5,"last update":"Sat Mar 30 13:36:19 2024","interfaces":[{"interface":"back","average":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"last":0.68300000000000005},{"interface":"front","average":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.89300000000000002,"5min":0.89300000000000002,"15min":0.89300000000000002},"last":0.69799999999999995}]},{"osd":7,"last update":"Sat Mar 30 13:36:45 2024","interfaces":[{"interface":"back","average":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.97999999999999998,"5min":0.97999999999999998,"15min":0.97999999999999998},"last":0.751},{"interface":"front","average":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.755,"5min":0.755,"15min":0.755},"last":0.72699999999999998}]}]},{"osd":1,"up_from":13,"seq":55834574897,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":6344,"kb_used_data":576,"kb_used_omap":0,"kb_used_meta":5760,"kb_avail":93738808,"statfs":{"total":95995035648,"available":95988539392,"internally_reserved":0,"allocated":589824,"data_stored":240660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5898240},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Mar 30 13:36:26 2024","interfaces":[{"interface":"back","average":{"1min":0.35699999999999998,"5min":0.33100000000000002,"15min":0.311},"min":{"1min":0.20699999999999999,"5min":0.17599999999999999,"15min":0.17599999999999999},"max":{"1min":0.56899999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"last":0.35399999999999998},{"interface":"front","average":{"1min":0.39100000000000001,"5min":0.33900000000000002,"15min":0.315},"min":{"1min":0.20999999999999999,"5min":0.19900000000000001,"15min":0.19900000000000001},"max":{"1min":0.61099999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"last":0.28999999999999998}]},{"osd":2,"last update":"Sat Mar 30 13:36:47 2024","interfaces":[{"interface":"back","average":{"1min":0.42299999999999999,"5min":0.374,"15min":0.35399999999999998},"min":{"1min":0.27000000000000002,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":1.022,"5min":1.022,"15min":1.022},"last":0.374},{"interface":"front","average":{"1min":0.376,"5min":0.35099999999999998,"15min":0.33400000000000002},"min":{"1min":0.254,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":0.96299999999999997,"5min":0.96299999999999997,"15min":0.96299999999999997},"last":0.32200000000000001}]},{"osd":3,"last update":"Sat Mar 30 13:37:10 2024","interfaces":[{"interface":"back","average":{"1min":0.436,"5min":0.39300000000000002,"15min":0.38100000000000001},"min":{"1min":0.255,"5min":0.22,"15min":0.22},"max":{"1min":1.8340000000000001,"5min":1.8340000000000001,"15min":1.8340000000000001},"last":0.39300000000000002},{"interface":"front","average":{"1min":0.42799999999999999,"5min":0.436,"15min":0.436},"min":{"1min":0.27300000000000002,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":1.044,"5min":1.044,"15min":1.044},"last":0.33100000000000002}]},{"osd":4,"last update":"Sat Mar 30 13:36:31 2024","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.57399999999999995,"15min":0.56599999999999995},"min":{"1min":0.39900000000000002,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":1.7929999999999999,"5min":1.7929999999999999,"15min":1.7929999999999999},"last":0.51400000000000001},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"min":{"1min":0.39900000000000002,"5min":0.374,"15min":0.374},"max":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.77200000000000002},"last":0.52300000000000002}]},{"osd":5,"last update":"Sat Mar 30 13:36:55 2024","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.60599999999999998,"15min":0.60799999999999998},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":1.0640000000000001,"5min":1.0640000000000001,"15min":1.0640000000000001},"last":0.46800000000000003},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.61499999999999999,"15min":0.61199999999999999},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":1.8879999999999999,"5min":1.8879999999999999,"15min":1.8879999999999999},"last":0.45200000000000001}]},{"osd":6,"last update":"Sat Mar 30 13:36:17 2024","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"last":0.433},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":0.80100000000000005},"last":0.47899999999999998}]},{"osd":7,"last update":"Sat Mar 30 13:36:41 2024","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.872,"5min":0.872,"15min":0.872},"last":0.497},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":1.738,"5min":1.738,"15min":1.738},"last":0.54100000000000004}]}]},{"osd":0,"up_from":8,"seq":34359738422,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":6928,"kb_used_data":1096,"kb_used_omap":0,"kb_used_meta":5824,"kb_avail":93738224,"statfs":{"total":95995035648,"available":95987941376,"internally_reserved":0,"allocated":1122304,"data_stored":769588,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5963776},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Mar 30 13:36:22 2024","interfaces":[{"interface":"back","average":{"1min":0.35899999999999999,"5min":0.32500000000000001,"15min":0.29899999999999999},"min":{"1min":0.19900000000000001,"5min":0.19900000000000001,"15min":0.19900000000000001},"max":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.63500000000000001},"last":0.40100000000000002},{"interface":"front","average":{"1min":0.39600000000000002,"5min":0.34699999999999998,"15min":0.32500000000000001},"min":{"1min":0.248,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.62,"5min":0.62,"15min":0.62},"last":0.29999999999999999}]},{"osd":2,"last update":"Sat Mar 30 13:36:47 2024","interfaces":[{"interface":"back","average":{"1min":0.39000000000000001,"5min":0.39700000000000002,"15min":0.39300000000000002},"min":{"1min":0.21299999999999999,"5min":0.21299999999999999,"15min":0.21299999999999999},"max":{"1min":0.64200000000000002,"5min":0.65700000000000003,"15min":0.65700000000000003},"last":0.34899999999999998},{"interface":"front","average":{"1min":0.378,"5min":0.377,"15min":0.36699999999999999},"min":{"1min":0.224,"5min":0.224,"15min":0.224},"max":{"1min":0.65700000000000003,"5min":0.65700000000000003,"15min":0.65700000000000003},"last":0.36599999999999999}]},{"osd":3,"last update":"Sat Mar 30 13:36:12 2024","interfaces":[{"interface":"back","average":{"1min":0.40999999999999998,"5min":0.44700000000000001,"15min":0.45300000000000001},"min":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.54800000000000004,"5min":0.57999999999999996,"15min":0.57999999999999996},"last":0.33300000000000002},{"interface":"front","average":{"1min":0.40600000000000003,"5min":0.45300000000000001,"15min":0.46100000000000002},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":0.55900000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"last":0.316}]},{"osd":4,"last update":"Sat Mar 30 13:36:32 2024","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.56899999999999995,"15min":0.56999999999999995},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":0.92700000000000005,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.67800000000000005},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.58299999999999996,"15min":0.58199999999999996},"min":{"1min":0.38800000000000001,"5min":0.377,"15min":0.377},"max":{"1min":0.95999999999999996,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.68300000000000005}]},{"osd":5,"last update":"Sat Mar 30 13:36:57 2024","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.58099999999999996,"15min":0.57699999999999996},"min":{"1min":0.41199999999999998,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.93999999999999995,"5min":0.93999999999999995,"15min":0.93999999999999995},"last":0.72599999999999998},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.57699999999999996,"15min":0.57499999999999996},"min":{"1min":0.40400000000000003,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"last":0.59899999999999998}]},{"osd":6,"last update":"Sat Mar 30 13:36:22 2024","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.751,"5min":0.751,"15min":0.751},"last":0.65600000000000003},{"interface":"front","average":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"last":0.61599999999999999}]},{"osd":7,"last update":"Sat Mar 30 13:36:47 2024","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.92000000000000004,"5min":0.92000000000000004,"15min":0.92000000000000004},"last":0.58199999999999996},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.81200000000000006},"last":0.64700000000000002}]}]},{"osd":2,"up_from":18,"seq":77309411372,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":6280,"kb_used_data":576,"kb_used_omap":0,"kb_used_meta":5696,"kb_avail":93738872,"statfs":{"total":95995035648,"available":95988604928,"internally_reserved":0,"allocated":589824,"data_stored":240660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5832704},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Mar 30 13:36:51 2024","interfaces":[{"interface":"back","average":{"1min":0.34699999999999998,"5min":0.37,"15min":0.37},"min":{"1min":0.255,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":0.45900000000000002,"5min":0.66200000000000003,"15min":0.66200000000000003},"last":0.46899999999999997},{"interface":"front","average":{"1min":0.34899999999999998,"5min":0.38600000000000001,"15min":0.39100000000000001},"min":{"1min":0.23699999999999999,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":0.60599999999999998,"5min":0.66900000000000004,"15min":0.66900000000000004},"last":0.41599999999999998}]},{"osd":1,"last update":"Sat Mar 30 13:36:51 2024","interfaces":[{"interface":"back","average":{"1min":0.33100000000000002,"5min":0.38,"15min":0.38400000000000001},"min":{"1min":0.22800000000000001,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.49299999999999999,"5min":0.67700000000000005,"15min":0.67700000000000005},"last":0.40699999999999997},{"interface":"front","average":{"1min":0.36599999999999999,"5min":0.40699999999999997,"15min":0.41799999999999998},"min":{"1min":0.26900000000000002,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.51200000000000001,"5min":0.58499999999999996,"15min":0.58499999999999996},"last":0.42799999999999999}]},{"osd":3,"last update":"Sat Mar 30 13:36:16 2024","interfaces":[{"interface":"back","average":{"1min":0.41499999999999998,"5min":0.435,"15min":0.439},"min":{"1min":0.21299999999999999,"5min":0.21299999999999999,"15min":0.21299999999999999},"max":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"last":0.44400000000000001},{"interface":"front","average":{"1min":0.40899999999999997,"5min":0.44900000000000001,"15min":0.45500000000000002},"min":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.53000000000000003,"5min":0.71099999999999997,"15min":0.71099999999999997},"last":0.5}]},{"osd":4,"last update":"Sat Mar 30 13:36:33 2024","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.54200000000000004,"15min":0.54200000000000004},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.74099999999999999,"5min":0.83999999999999997,"15min":0.83999999999999997},"last":0.55700000000000005},{"interface":"front","average":{"1min":0.56399999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.73599999999999999,"5min":0.81699999999999995,"15min":0.81699999999999995},"last":0.58099999999999996}]},{"osd":5,"last update":"Sat Mar 30 13:36:55 2024","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.55500000000000005,"15min":0.55800000000000005},"min":{"1min":0.41499999999999998,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"last":0.53500000000000003},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.55100000000000005,"15min":0.55400000000000005},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.77800000000000002,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.56399999999999995}]},{"osd":6,"last update":"Sat Mar 30 13:36:17 2024","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":0.92300000000000004,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":0.54800000000000004},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.88,"5min":0.88,"15min":0.88},"last":0.60499999999999998}]},{"osd":7,"last update":"Sat Mar 30 13:36:42 2024","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"last":0.626},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"last":0.67500000000000004}]}]},{"osd":3,"up_from":26,"seq":111669149736,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":5704,"kb_used_data":576,"kb_used_omap":0,"kb_used_meta":5120,"kb_avail":93739448,"statfs":{"total":95995035648,"available":95989194752,"internally_reserved":0,"allocated":589824,"data_stored":240660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5242880},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Mar 30 13:37:09 2024","interfaces":[{"interface":"back","average":{"1min":0.379,"5min":0.39500000000000002,"15min":0.39900000000000002},"min":{"1min":0.245,"5min":0.192,"15min":0.192},"max":{"1min":0.621,"5min":0.621,"15min":0.621},"last":0.28100000000000003},{"interface":"front","average":{"1min":0.39200000000000002,"5min":0.42399999999999999,"15min":0.436},"min":{"1min":0.255,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.59699999999999998,"5min":0.66400000000000003,"15min":0.66400000000000003},"last":0.30199999999999999}]},{"osd":1,"last update":"Sat Mar 30 13:37:09 2024","interfaces":[{"interface":"back","average":{"1min":0.374,"5min":0.40100000000000002,"15min":0.41499999999999998},"min":{"1min":0.22800000000000001,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.55000000000000004,"5min":0.60399999999999998,"15min":0.60399999999999998},"last":0.22800000000000001},{"interface":"front","average":{"1min":0.40200000000000002,"5min":0.435,"15min":0.44700000000000001},"min":{"1min":0.307,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.52100000000000002,"5min":0.67300000000000004,"15min":0.67300000000000004},"last":0.34899999999999998}]},{"osd":2,"last update":"Sat Mar 30 13:37:09 2024","interfaces":[{"interface":"back","average":{"1min":0.41399999999999998,"5min":0.45200000000000001,"15min":0.46800000000000003},"min":{"1min":0.28399999999999997,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.57699999999999996,"5min":0.72999999999999998,"15min":0.72999999999999998},"last":0.318},{"interface":"front","average":{"1min":0.41599999999999998,"5min":0.44400000000000001,"15min":0.45800000000000002},"min":{"1min":0.253,"5min":0.253,"15min":0.253},"max":{"1min":0.59099999999999997,"5min":0.65900000000000003,"15min":0.65900000000000003},"last":0.253}]},{"osd":4,"last update":"Sat Mar 30 13:36:33 2024","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.55900000000000005,"15min":0.55700000000000005},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.54400000000000004},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.55700000000000005,"15min":0.55200000000000005},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.76400000000000001,"5min":0.79700000000000004,"15min":0.79700000000000004},"last":0.48399999999999999}]},{"osd":5,"last update":"Sat Mar 30 13:36:54 2024","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.59499999999999997,"15min":0.60099999999999998},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.753,"5min":0.84999999999999998,"15min":0.84999999999999998},"last":0.42699999999999999},{"interface":"front","average":{"1min":0.56999999999999995,"5min":0.57799999999999996,"15min":0.57999999999999996},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"last":0.48899999999999999}]},{"osd":6,"last update":"Sat Mar 30 13:36:18 2024","interfaces":[{"interface":"back","average":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.55700000000000005},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.879,"5min":0.879,"15min":0.879},"last":0.45200000000000001}]},{"osd":7,"last update":"Sat Mar 30 13:36:44 2024","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.86399999999999999},"last":0.56799999999999995},{"interface":"front","average":{"1min":0.625,"5min":0.625,"15min":0.625},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.86799999999999999,"5min":0.86799999999999999,"15min":0.86799999999999999},"last":0.53100000000000003}]}]},{"osd":4,"up_from":31,"seq":133143986210,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":5768,"kb_used_data":576,"kb_used_omap":0,"kb_used_meta":5184,"kb_avail":93739384,"statfs":{"total":95995035648,"available":95989129216,"internally_reserved":0,"allocated":589824,"data_stored":240660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5308416},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Mar 30 13:36:32 2024","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.48599999999999999,"15min":0.47699999999999998},"min":{"1min":0.34899999999999998,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"last":0.47599999999999998},{"interface":"front","average":{"1min":0.51300000000000001,"5min":0.5,"15min":0.498},"min":{"1min":0.38300000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.77200000000000002},"last":0.51900000000000002}]},{"osd":1,"last update":"Sat Mar 30 13:36:32 2024","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.47499999999999998,"15min":0.46300000000000002},"min":{"1min":0.36499999999999999,"5min":0.316,"15min":0.316},"max":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"last":0.57199999999999995},{"interface":"front","average":{"1min":0.52500000000000002,"5min":0.47499999999999998,"15min":0.46700000000000003},"min":{"1min":0.38,"5min":0.317,"15min":0.317},"max":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"last":0.46300000000000002}]},{"osd":2,"last update":"Sat Mar 30 13:36:32 2024","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.49099999999999999,"15min":0.48599999999999999},"min":{"1min":0.373,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.88200000000000001,"5min":0.88200000000000001,"15min":0.88200000000000001},"last":0.51100000000000001},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.49399999999999999,"15min":0.48699999999999999},"min":{"1min":0.42199999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.755,"5min":0.755,"15min":0.755},"last":0.55200000000000005}]},{"osd":3,"last update":"Sat Mar 30 13:36:32 2024","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.504,"15min":0.499},"min":{"1min":0.372,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.83299999999999996,"5min":0.83299999999999996,"15min":0.83299999999999996},"last":0.63200000000000001},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.495,"15min":0.48699999999999999},"min":{"1min":0.40100000000000002,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"last":0.67300000000000004}]},{"osd":5,"last update":"Sat Mar 30 13:36:54 2024","interfaces":[{"interface":"back","average":{"1min":0.48299999999999998,"5min":0.36799999999999999,"15min":0.34899999999999998},"min":{"1min":0.29999999999999999,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.755,"5min":0.755,"15min":0.755},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.47299999999999998,"5min":0.38500000000000001,"15min":0.37},"min":{"1min":0.29099999999999998,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"last":0.66200000000000003}]},{"osd":6,"last update":"Sat Mar 30 13:36:19 2024","interfaces":[{"interface":"back","average":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"min":{"1min":0.28699999999999998,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":0.65500000000000003},"last":0.58499999999999996},{"interface":"front","average":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"min":{"1min":0.26500000000000001,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"last":0.64600000000000002}]},{"osd":7,"last update":"Sat Mar 30 13:36:45 2024","interfaces":[{"interface":"back","average":{"1min":0.496,"5min":0.496,"15min":0.496},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"last":0.54400000000000004},{"interface":"front","average":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"last":0.71099999999999997}]}]},{"osd":5,"up_from":39,"seq":167503724574,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":5696,"kb_used_data":568,"kb_used_omap":0,"kb_used_meta":5120,"kb_avail":93739456,"statfs":{"total":95995035648,"available":95989202944,"internally_reserved":0,"allocated":581632,"data_stored":240072,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5242880},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Mar 30 13:36:57 2024","interfaces":[{"interface":"back","average":{"1min":0.49199999999999999,"5min":0.51900000000000002,"15min":0.52300000000000002},"min":{"1min":0.19900000000000001,"5min":0.19900000000000001,"15min":0.19900000000000001},"max":{"1min":0.70399999999999996,"5min":0.84999999999999998,"15min":0.84999999999999998},"last":0.47699999999999998},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.51200000000000001,"15min":0.50900000000000001},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":0.67800000000000005,"5min":0.78600000000000003,"15min":0.78600000000000003},"last":0.50600000000000001}]},{"osd":1,"last update":"Sat Mar 30 13:36:57 2024","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"min":{"1min":0.26700000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.79700000000000004},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.49299999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"last":0.48399999999999999}]},{"osd":2,"last update":"Sat Mar 30 13:36:57 2024","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.501,"15min":0.499},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"last":0.40500000000000003},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.54200000000000004,"15min":0.54400000000000004},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":0.72199999999999998,"5min":0.76000000000000001,"15min":0.76000000000000001},"last":0.41399999999999998}]},{"osd":3,"last update":"Sat Mar 30 13:36:57 2024","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.52500000000000002,"15min":0.52800000000000002},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.442},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.53900000000000003,"15min":0.53500000000000003},"min":{"1min":0.39200000000000002,"5min":0.379,"15min":0.379},"max":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"last":0.44800000000000001}]},{"osd":4,"last update":"Sat Mar 30 13:36:57 2024","interfaces":[{"interface":"back","average":{"1min":0.42799999999999999,"5min":0.40899999999999997,"15min":0.40600000000000003},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"last":0.38200000000000001},{"interface":"front","average":{"1min":0.47799999999999998,"5min":0.42199999999999999,"15min":0.41299999999999998},"min":{"1min":0.33700000000000002,"5min":0.31,"15min":0.31},"max":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"last":0.36499999999999999}]},{"osd":6,"last update":"Sat Mar 30 13:36:18 2024","interfaces":[{"interface":"back","average":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.626,"5min":0.626,"15min":0.626},"last":0.45700000000000002},{"interface":"front","average":{"1min":0.432,"5min":0.432,"15min":0.432},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"last":0.53500000000000003}]},{"osd":7,"last update":"Sat Mar 30 13:36:43 2024","interfaces":[{"interface":"back","average":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"last":0.57499999999999996},{"interface":"front","average":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.747,"5min":0.747,"15min":0.747},"last":0.52300000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-30T13:37:15.950 DEBUG:teuthology.orchestra.run.smithi099:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell --fsid 98ebaeb8-ee99-11ee-b647-cb9ed24678a4 -- ceph pg dump --format=json 2024-03-30T13:37:16.172 INFO:teuthology.orchestra.run.smithi099.stderr:Inferring config /var/lib/ceph/98ebaeb8-ee99-11ee-b647-cb9ed24678a4/mon.a/config 2024-03-30T13:37:16.295 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:37:16 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[25141]: 172.21.15.181 - - [30/Mar/2024:13:37:16] "POST /data HTTP/1.1" 200 46 "" "Python-urllib/3.9" 2024-03-30T13:37:16.506 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:37:16 smithi181 ceph-mon[25762]: from='client.24502 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-03-30T13:37:16.506 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:37:16 smithi181 ceph-mon[25762]: from='mgr.14439 ' entity='mgr.y' 2024-03-30T13:37:16.507 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:37:16 smithi181 ceph-mon[25762]: from='mgr.14439 ' entity='mgr.y' 2024-03-30T13:37:16.507 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:37:16 smithi181 ceph-mon[25762]: pgmap v41: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:37:16.507 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:37:16 smithi181 ceph-mon[25762]: from='mgr.14439 ' entity='mgr.y' 2024-03-30T13:37:16.507 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:37:16 smithi181 ceph-mon[25762]: from='mgr.14439 ' entity='mgr.y' 2024-03-30T13:37:16.563 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:37:16 smithi099 ceph-mon[29691]: from='client.24502 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-03-30T13:37:16.563 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:37:16 smithi099 ceph-mon[29691]: from='mgr.14439 ' entity='mgr.y' 2024-03-30T13:37:16.565 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:37:16 smithi099 ceph-mon[29691]: from='mgr.14439 ' entity='mgr.y' 2024-03-30T13:37:16.565 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:37:16 smithi099 ceph-mon[29691]: pgmap v41: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:37:16.565 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:37:16 smithi099 ceph-mon[29691]: from='mgr.14439 ' entity='mgr.y' 2024-03-30T13:37:16.565 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:37:16 smithi099 ceph-mon[29691]: from='mgr.14439 ' entity='mgr.y' 2024-03-30T13:37:16.566 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:37:16 smithi099 ceph-mon[24912]: from='client.24502 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-03-30T13:37:16.566 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:37:16 smithi099 ceph-mon[24912]: from='mgr.14439 ' entity='mgr.y' 2024-03-30T13:37:16.566 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:37:16 smithi099 ceph-mon[24912]: from='mgr.14439 ' entity='mgr.y' 2024-03-30T13:37:16.566 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:37:16 smithi099 ceph-mon[24912]: pgmap v41: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:37:16.566 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:37:16 smithi099 ceph-mon[24912]: from='mgr.14439 ' entity='mgr.y' 2024-03-30T13:37:16.566 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:37:16 smithi099 ceph-mon[24912]: from='mgr.14439 ' entity='mgr.y' 2024-03-30T13:37:16.836 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:37:16 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[25141]: ::ffff:172.21.15.181 - - [30/Mar/2024:13:37:16] "GET /metrics HTTP/1.1" 200 191496 "" "Prometheus/2.33.4" 2024-03-30T13:37:18.897 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:37:18 smithi099 ceph-mon[24912]: pgmap v42: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:37:18.898 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:37:18 smithi099 ceph-mon[29691]: pgmap v42: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:37:19.005 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:37:18 smithi181 ceph-mon[25762]: pgmap v42: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:37:19.272 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-03-30T13:37:19.274 INFO:teuthology.orchestra.run.smithi099.stderr:dumped all 2024-03-30T13:37:19.756 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 13:37:19 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-x[27332]: ::ffff:172.21.15.181 - - [30/Mar/2024:13:37:19] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-03-30T13:37:20.037 INFO:teuthology.orchestra.run.smithi099.stdout:{"pg_ready":true,"pg_map":{"version":42,"stamp":"2024-03-30T13:37:17.579935+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":212,"num_read_kb":306,"num_write":179,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":1586784,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":128,"ondisk_log_size":128,"up":3,"acting":3,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":3,"num_osds":8,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":749961216,"kb_used":48968,"kb_used_data":6152,"kb_used_omap":0,"kb_used_meta":42752,"kb_avail":749912248,"statfs":{"total":767960285184,"available":767910141952,"internally_reserved":0,"allocated":6299648,"data_stored":3510888,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":43778048},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002290"},"pg_stats":[{"pgid":"1.0","version":"60'128","reported_seq":267,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-03-30T13:35:59.650362+0000","last_change":"2024-03-30T13:35:45.592959+0000","last_active":"2024-03-30T13:35:59.650362+0000","last_peered":"2024-03-30T13:35:59.650362+0000","last_clean":"2024-03-30T13:35:59.650362+0000","last_became_active":"2024-03-30T13:35:45.592585+0000","last_became_peered":"2024-03-30T13:35:45.592585+0000","last_unstale":"2024-03-30T13:35:59.650362+0000","last_undegraded":"2024-03-30T13:35:59.650362+0000","last_fullsized":"2024-03-30T13:35:59.650362+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:33:44.767452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:33:44.767452+0000","last_clean_scrub_stamp":"2024-03-30T13:33:44.767452+0000","objects_scrubbed":0,"log_size":128,"ondisk_log_size":128,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:59:18.458210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":212,"num_read_kb":306,"num_write":179,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":1586784,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,6],"acting":[7,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":212,"num_read_kb":306,"num_write":179,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":1586784,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1597440,"data_stored":1586784,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":128,"ondisk_log_size":128,"up":3,"acting":3,"num_store_stats":3}],"osd_stats":[{"osd":7,"up_from":55,"seq":236223201301,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":6096,"kb_used_data":1096,"kb_used_omap":0,"kb_used_meta":4992,"kb_avail":93739056,"statfs":{"total":95995035648,"available":95988793344,"internally_reserved":0,"allocated":1122304,"data_stored":769588,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5111808},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Mar 30 13:36:43 2024","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"min":{"1min":0.216,"5min":0.216,"15min":0.216},"max":{"1min":1.9179999999999999,"5min":1.9179999999999999,"15min":1.9179999999999999},"last":0.48899999999999999},{"interface":"front","average":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"last":0.442}]},{"osd":1,"last update":"Sat Mar 30 13:36:43 2024","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"min":{"1min":0.255,"5min":0.255,"15min":0.255},"max":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"last":0.55100000000000005},{"interface":"front","average":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.746,"5min":0.746,"15min":0.746},"last":0.502}]},{"osd":2,"last update":"Sat Mar 30 13:36:43 2024","interfaces":[{"interface":"back","average":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"last":0.42499999999999999},{"interface":"front","average":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"min":{"1min":0.28199999999999997,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":0.65500000000000003},"last":0.52200000000000002}]},{"osd":3,"last update":"Sat Mar 30 13:36:43 2024","interfaces":[{"interface":"back","average":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"last":0.375},{"interface":"front","average":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"min":{"1min":0.307,"5min":0.307,"15min":0.307},"max":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.72499999999999998},"last":0.45000000000000001}]},{"osd":4,"last update":"Sat Mar 30 13:36:43 2024","interfaces":[{"interface":"back","average":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"last":0.34899999999999998},{"interface":"front","average":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"last":0.57199999999999995}]},{"osd":5,"last update":"Sat Mar 30 13:36:43 2024","interfaces":[{"interface":"back","average":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"min":{"1min":0.26100000000000001,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"last":0.39300000000000002},{"interface":"front","average":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"last":0.47099999999999997}]},{"osd":6,"last update":"Sat Mar 30 13:36:43 2024","interfaces":[{"interface":"back","average":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"last":0.53100000000000003},{"interface":"front","average":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"last":0.51500000000000001}]}]},{"osd":6,"up_from":47,"seq":201863462938,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":6152,"kb_used_data":1088,"kb_used_omap":0,"kb_used_meta":5056,"kb_avail":93739000,"statfs":{"total":95995035648,"available":95988736000,"internally_reserved":0,"allocated":1114112,"data_stored":769000,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5177344},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Mar 30 13:36:19 2024","interfaces":[{"interface":"back","average":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":0.68999999999999995,"5min":0.68999999999999995,"15min":0.68999999999999995},"last":0.63200000000000001},{"interface":"front","average":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":0.73499999999999999},"last":0.50600000000000001}]},{"osd":1,"last update":"Sat Mar 30 13:36:19 2024","interfaces":[{"interface":"back","average":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"last":0.59999999999999998},{"interface":"front","average":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.54300000000000004}]},{"osd":2,"last update":"Sat Mar 30 13:36:19 2024","interfaces":[{"interface":"back","average":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.79900000000000004},"last":0.61199999999999999},{"interface":"front","average":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"last":0.51600000000000001}]},{"osd":3,"last update":"Sat Mar 30 13:36:19 2024","interfaces":[{"interface":"back","average":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"last":0.65900000000000003},{"interface":"front","average":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.877,"5min":0.877,"15min":0.877},"last":0.57699999999999996}]},{"osd":4,"last update":"Sat Mar 30 13:36:19 2024","interfaces":[{"interface":"back","average":{"1min":0.434,"5min":0.434,"15min":0.434},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"last":0.41399999999999998},{"interface":"front","average":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"min":{"1min":0.29099999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"last":0.56699999999999995}]},{"osd":5,"last update":"Sat Mar 30 13:36:19 2024","interfaces":[{"interface":"back","average":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"last":0.46600000000000003},{"interface":"front","average":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.89300000000000002,"5min":0.89300000000000002,"15min":0.89300000000000002},"last":0.53000000000000003}]},{"osd":7,"last update":"Sat Mar 30 13:36:45 2024","interfaces":[{"interface":"back","average":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.97999999999999998,"5min":0.97999999999999998,"15min":0.97999999999999998},"last":0.44700000000000001},{"interface":"front","average":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.755,"5min":0.755,"15min":0.755},"last":0.47499999999999998}]}]},{"osd":1,"up_from":13,"seq":55834574898,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":6344,"kb_used_data":576,"kb_used_omap":0,"kb_used_meta":5760,"kb_avail":93738808,"statfs":{"total":95995035648,"available":95988539392,"internally_reserved":0,"allocated":589824,"data_stored":240660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5898240},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Mar 30 13:36:26 2024","interfaces":[{"interface":"back","average":{"1min":0.35699999999999998,"5min":0.33100000000000002,"15min":0.311},"min":{"1min":0.20699999999999999,"5min":0.17599999999999999,"15min":0.17599999999999999},"max":{"1min":0.56899999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"last":0.23699999999999999},{"interface":"front","average":{"1min":0.39100000000000001,"5min":0.33900000000000002,"15min":0.315},"min":{"1min":0.20999999999999999,"5min":0.19900000000000001,"15min":0.19900000000000001},"max":{"1min":0.61099999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"last":0.317}]},{"osd":2,"last update":"Sat Mar 30 13:36:47 2024","interfaces":[{"interface":"back","average":{"1min":0.42299999999999999,"5min":0.374,"15min":0.35399999999999998},"min":{"1min":0.27000000000000002,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":1.022,"5min":1.022,"15min":1.022},"last":0.26200000000000001},{"interface":"front","average":{"1min":0.376,"5min":0.35099999999999998,"15min":0.33400000000000002},"min":{"1min":0.254,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":0.96299999999999997,"5min":0.96299999999999997,"15min":0.96299999999999997},"last":0.32200000000000001}]},{"osd":3,"last update":"Sat Mar 30 13:37:10 2024","interfaces":[{"interface":"back","average":{"1min":0.436,"5min":0.39300000000000002,"15min":0.38100000000000001},"min":{"1min":0.255,"5min":0.22,"15min":0.22},"max":{"1min":1.8340000000000001,"5min":1.8340000000000001,"15min":1.8340000000000001},"last":0.28100000000000003},{"interface":"front","average":{"1min":0.42799999999999999,"5min":0.436,"15min":0.436},"min":{"1min":0.27300000000000002,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":1.044,"5min":1.044,"15min":1.044},"last":0.29299999999999998}]},{"osd":4,"last update":"Sat Mar 30 13:36:31 2024","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.57399999999999995,"15min":0.56599999999999995},"min":{"1min":0.39900000000000002,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":1.7929999999999999,"5min":1.7929999999999999,"15min":1.7929999999999999},"last":0.39900000000000002},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"min":{"1min":0.39900000000000002,"5min":0.374,"15min":0.374},"max":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.77200000000000002},"last":0.42799999999999999}]},{"osd":5,"last update":"Sat Mar 30 13:36:55 2024","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.60599999999999998,"15min":0.60799999999999998},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":1.0640000000000001,"5min":1.0640000000000001,"15min":1.0640000000000001},"last":0.40500000000000003},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.61499999999999999,"15min":0.61199999999999999},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":1.8879999999999999,"5min":1.8879999999999999,"15min":1.8879999999999999},"last":0.41199999999999998}]},{"osd":6,"last update":"Sat Mar 30 13:36:17 2024","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"last":0.35299999999999998},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":0.80100000000000005},"last":0.374}]},{"osd":7,"last update":"Sat Mar 30 13:36:41 2024","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.872,"5min":0.872,"15min":0.872},"last":0.443},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":1.738,"5min":1.738,"15min":1.738},"last":0.38200000000000001}]}]},{"osd":0,"up_from":8,"seq":34359738423,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":6928,"kb_used_data":1096,"kb_used_omap":0,"kb_used_meta":5824,"kb_avail":93738224,"statfs":{"total":95995035648,"available":95987941376,"internally_reserved":0,"allocated":1122304,"data_stored":769588,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5963776},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Mar 30 13:36:22 2024","interfaces":[{"interface":"back","average":{"1min":0.35899999999999999,"5min":0.32500000000000001,"15min":0.29899999999999999},"min":{"1min":0.19900000000000001,"5min":0.19900000000000001,"15min":0.19900000000000001},"max":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.63500000000000001},"last":0.29799999999999999},{"interface":"front","average":{"1min":0.39600000000000002,"5min":0.34699999999999998,"15min":0.32500000000000001},"min":{"1min":0.248,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.62,"5min":0.62,"15min":0.62},"last":0.32200000000000001}]},{"osd":2,"last update":"Sat Mar 30 13:36:47 2024","interfaces":[{"interface":"back","average":{"1min":0.39000000000000001,"5min":0.39700000000000002,"15min":0.39300000000000002},"min":{"1min":0.21299999999999999,"5min":0.21299999999999999,"15min":0.21299999999999999},"max":{"1min":0.64200000000000002,"5min":0.65700000000000003,"15min":0.65700000000000003},"last":0.39000000000000001},{"interface":"front","average":{"1min":0.378,"5min":0.377,"15min":0.36699999999999999},"min":{"1min":0.224,"5min":0.224,"15min":0.224},"max":{"1min":0.65700000000000003,"5min":0.65700000000000003,"15min":0.65700000000000003},"last":0.38}]},{"osd":3,"last update":"Sat Mar 30 13:37:13 2024","interfaces":[{"interface":"back","average":{"1min":0.44800000000000001,"5min":0.44500000000000001,"15min":0.45300000000000001},"min":{"1min":0.30199999999999999,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.62,"5min":0.62,"15min":0.62},"last":0.437},{"interface":"front","average":{"1min":0.42899999999999999,"5min":0.44600000000000001,"15min":0.45800000000000002},"min":{"1min":0.28199999999999997,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.58899999999999997,"5min":0.68400000000000005,"15min":0.68400000000000005},"last":0.33300000000000002}]},{"osd":4,"last update":"Sat Mar 30 13:36:32 2024","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.56899999999999995,"15min":0.56999999999999995},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":0.92700000000000005,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.75800000000000001},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.58299999999999996,"15min":0.58199999999999996},"min":{"1min":0.38800000000000001,"5min":0.377,"15min":0.377},"max":{"1min":0.95999999999999996,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.77500000000000002}]},{"osd":5,"last update":"Sat Mar 30 13:36:57 2024","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.58099999999999996,"15min":0.57699999999999996},"min":{"1min":0.41199999999999998,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.93999999999999995,"5min":0.93999999999999995,"15min":0.93999999999999995},"last":0.65600000000000003},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.57699999999999996,"15min":0.57499999999999996},"min":{"1min":0.40400000000000003,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"last":0.80400000000000005}]},{"osd":6,"last update":"Sat Mar 30 13:36:22 2024","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.751,"5min":0.751,"15min":0.751},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"last":0.67300000000000004}]},{"osd":7,"last update":"Sat Mar 30 13:36:47 2024","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.92000000000000004,"5min":0.92000000000000004,"15min":0.92000000000000004},"last":0.78600000000000003},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.81200000000000006},"last":0.60799999999999998}]}]},{"osd":2,"up_from":18,"seq":77309411373,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":6280,"kb_used_data":576,"kb_used_omap":0,"kb_used_meta":5696,"kb_avail":93738872,"statfs":{"total":95995035648,"available":95988604928,"internally_reserved":0,"allocated":589824,"data_stored":240660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5832704},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Mar 30 13:36:51 2024","interfaces":[{"interface":"back","average":{"1min":0.34699999999999998,"5min":0.37,"15min":0.37},"min":{"1min":0.255,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":0.45900000000000002,"5min":0.66200000000000003,"15min":0.66200000000000003},"last":0.25800000000000001},{"interface":"front","average":{"1min":0.34899999999999998,"5min":0.38600000000000001,"15min":0.39100000000000001},"min":{"1min":0.23699999999999999,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":0.60599999999999998,"5min":0.66900000000000004,"15min":0.66900000000000004},"last":0.29999999999999999}]},{"osd":1,"last update":"Sat Mar 30 13:36:51 2024","interfaces":[{"interface":"back","average":{"1min":0.33100000000000002,"5min":0.38,"15min":0.38400000000000001},"min":{"1min":0.22800000000000001,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.49299999999999999,"5min":0.67700000000000005,"15min":0.67700000000000005},"last":0.35099999999999998},{"interface":"front","average":{"1min":0.36599999999999999,"5min":0.40699999999999997,"15min":0.41799999999999998},"min":{"1min":0.26900000000000002,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.51200000000000001,"5min":0.58499999999999996,"15min":0.58499999999999996},"last":0.32900000000000001}]},{"osd":3,"last update":"Sat Mar 30 13:36:16 2024","interfaces":[{"interface":"back","average":{"1min":0.41499999999999998,"5min":0.435,"15min":0.439},"min":{"1min":0.21299999999999999,"5min":0.21299999999999999,"15min":0.21299999999999999},"max":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"last":0.317},{"interface":"front","average":{"1min":0.40899999999999997,"5min":0.44900000000000001,"15min":0.45500000000000002},"min":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.53000000000000003,"5min":0.71099999999999997,"15min":0.71099999999999997},"last":0.29199999999999998}]},{"osd":4,"last update":"Sat Mar 30 13:36:33 2024","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.54200000000000004,"15min":0.54200000000000004},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.74099999999999999,"5min":0.83999999999999997,"15min":0.83999999999999997},"last":0.47299999999999998},{"interface":"front","average":{"1min":0.56399999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.73599999999999999,"5min":0.81699999999999995,"15min":0.81699999999999995},"last":0.40000000000000002}]},{"osd":5,"last update":"Sat Mar 30 13:36:55 2024","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.55500000000000005,"15min":0.55800000000000005},"min":{"1min":0.41499999999999998,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"last":0.56399999999999995},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.55100000000000005,"15min":0.55400000000000005},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.77800000000000002,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.53800000000000003}]},{"osd":6,"last update":"Sat Mar 30 13:36:17 2024","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":0.92300000000000004,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":0.41399999999999998},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.88,"5min":0.88,"15min":0.88},"last":0.5}]},{"osd":7,"last update":"Sat Mar 30 13:36:42 2024","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"last":0.58599999999999997}]}]},{"osd":3,"up_from":26,"seq":111669149737,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":5704,"kb_used_data":576,"kb_used_omap":0,"kb_used_meta":5120,"kb_avail":93739448,"statfs":{"total":95995035648,"available":95989194752,"internally_reserved":0,"allocated":589824,"data_stored":240660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5242880},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Mar 30 13:37:09 2024","interfaces":[{"interface":"back","average":{"1min":0.379,"5min":0.39500000000000002,"15min":0.39900000000000002},"min":{"1min":0.245,"5min":0.192,"15min":0.192},"max":{"1min":0.621,"5min":0.621,"15min":0.621},"last":0.45300000000000001},{"interface":"front","average":{"1min":0.39200000000000002,"5min":0.42399999999999999,"15min":0.436},"min":{"1min":0.255,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.59699999999999998,"5min":0.66400000000000003,"15min":0.66400000000000003},"last":0.379}]},{"osd":1,"last update":"Sat Mar 30 13:37:09 2024","interfaces":[{"interface":"back","average":{"1min":0.374,"5min":0.40100000000000002,"15min":0.41499999999999998},"min":{"1min":0.22800000000000001,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.55000000000000004,"5min":0.60399999999999998,"15min":0.60399999999999998},"last":0.46400000000000002},{"interface":"front","average":{"1min":0.40200000000000002,"5min":0.435,"15min":0.44700000000000001},"min":{"1min":0.307,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.52100000000000002,"5min":0.67300000000000004,"15min":0.67300000000000004},"last":0.497}]},{"osd":2,"last update":"Sat Mar 30 13:37:09 2024","interfaces":[{"interface":"back","average":{"1min":0.41399999999999998,"5min":0.45200000000000001,"15min":0.46800000000000003},"min":{"1min":0.28399999999999997,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.57699999999999996,"5min":0.72999999999999998,"15min":0.72999999999999998},"last":0.47999999999999998},{"interface":"front","average":{"1min":0.41599999999999998,"5min":0.44400000000000001,"15min":0.45800000000000002},"min":{"1min":0.253,"5min":0.253,"15min":0.253},"max":{"1min":0.59099999999999997,"5min":0.65900000000000003,"15min":0.65900000000000003},"last":0.42799999999999999}]},{"osd":4,"last update":"Sat Mar 30 13:36:33 2024","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.55900000000000005,"15min":0.55700000000000005},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.77800000000000002},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.55700000000000005,"15min":0.55200000000000005},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.76400000000000001,"5min":0.79700000000000004,"15min":0.79700000000000004},"last":0.79500000000000004}]},{"osd":5,"last update":"Sat Mar 30 13:36:54 2024","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.59499999999999997,"15min":0.60099999999999998},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.753,"5min":0.84999999999999998,"15min":0.84999999999999998},"last":0.73599999999999999},{"interface":"front","average":{"1min":0.56999999999999995,"5min":0.57799999999999996,"15min":0.57999999999999996},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"last":0.66000000000000003}]},{"osd":6,"last update":"Sat Mar 30 13:36:18 2024","interfaces":[{"interface":"back","average":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.64100000000000001},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.879,"5min":0.879,"15min":0.879},"last":0.75600000000000001}]},{"osd":7,"last update":"Sat Mar 30 13:36:44 2024","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.86399999999999999},"last":0.72899999999999998},{"interface":"front","average":{"1min":0.625,"5min":0.625,"15min":0.625},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.86799999999999999,"5min":0.86799999999999999,"15min":0.86799999999999999},"last":0.76700000000000002}]}]},{"osd":4,"up_from":31,"seq":133143986211,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":5768,"kb_used_data":576,"kb_used_omap":0,"kb_used_meta":5184,"kb_avail":93739384,"statfs":{"total":95995035648,"available":95989129216,"internally_reserved":0,"allocated":589824,"data_stored":240660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5308416},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Mar 30 13:36:32 2024","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.48599999999999999,"15min":0.47699999999999998},"min":{"1min":0.34899999999999998,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"last":0.47099999999999997},{"interface":"front","average":{"1min":0.51300000000000001,"5min":0.5,"15min":0.498},"min":{"1min":0.38300000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.77200000000000002},"last":0.40799999999999997}]},{"osd":1,"last update":"Sat Mar 30 13:36:32 2024","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.47499999999999998,"15min":0.46300000000000002},"min":{"1min":0.36499999999999999,"5min":0.316,"15min":0.316},"max":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"last":0.39700000000000002},{"interface":"front","average":{"1min":0.52500000000000002,"5min":0.47499999999999998,"15min":0.46700000000000003},"min":{"1min":0.38,"5min":0.317,"15min":0.317},"max":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"last":0.43099999999999999}]},{"osd":2,"last update":"Sat Mar 30 13:36:32 2024","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.49099999999999999,"15min":0.48599999999999999},"min":{"1min":0.373,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.88200000000000001,"5min":0.88200000000000001,"15min":0.88200000000000001},"last":0.32000000000000001},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.49399999999999999,"15min":0.48699999999999999},"min":{"1min":0.42199999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.755,"5min":0.755,"15min":0.755},"last":0.42199999999999999}]},{"osd":3,"last update":"Sat Mar 30 13:36:32 2024","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.504,"15min":0.499},"min":{"1min":0.372,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.83299999999999996,"5min":0.83299999999999996,"15min":0.83299999999999996},"last":0.39100000000000001},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.495,"15min":0.48699999999999999},"min":{"1min":0.40100000000000002,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"last":0.441}]},{"osd":5,"last update":"Sat Mar 30 13:36:54 2024","interfaces":[{"interface":"back","average":{"1min":0.48299999999999998,"5min":0.36799999999999999,"15min":0.34899999999999998},"min":{"1min":0.29999999999999999,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.755,"5min":0.755,"15min":0.755},"last":0.50600000000000001},{"interface":"front","average":{"1min":0.47299999999999998,"5min":0.38500000000000001,"15min":0.37},"min":{"1min":0.29099999999999998,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"last":0.34200000000000003}]},{"osd":6,"last update":"Sat Mar 30 13:36:19 2024","interfaces":[{"interface":"back","average":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"min":{"1min":0.28699999999999998,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":0.65500000000000003},"last":0.374},{"interface":"front","average":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"min":{"1min":0.26500000000000001,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"last":0.46100000000000002}]},{"osd":7,"last update":"Sat Mar 30 13:36:45 2024","interfaces":[{"interface":"back","average":{"1min":0.496,"5min":0.496,"15min":0.496},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"last":0.38500000000000001},{"interface":"front","average":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"last":0.49099999999999999}]}]},{"osd":5,"up_from":39,"seq":167503724575,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":5696,"kb_used_data":568,"kb_used_omap":0,"kb_used_meta":5120,"kb_avail":93739456,"statfs":{"total":95995035648,"available":95989202944,"internally_reserved":0,"allocated":581632,"data_stored":240072,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5242880},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Mar 30 13:36:57 2024","interfaces":[{"interface":"back","average":{"1min":0.49199999999999999,"5min":0.51900000000000002,"15min":0.52300000000000002},"min":{"1min":0.19900000000000001,"5min":0.19900000000000001,"15min":0.19900000000000001},"max":{"1min":0.70399999999999996,"5min":0.84999999999999998,"15min":0.84999999999999998},"last":0.33300000000000002},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.51200000000000001,"15min":0.50900000000000001},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":0.67800000000000005,"5min":0.78600000000000003,"15min":0.78600000000000003},"last":0.372}]},{"osd":1,"last update":"Sat Mar 30 13:36:57 2024","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"min":{"1min":0.26700000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.79700000000000004},"last":0.40799999999999997},{"interface":"front","average":{"1min":0.49299999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"last":0.32900000000000001}]},{"osd":2,"last update":"Sat Mar 30 13:36:57 2024","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.501,"15min":0.499},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"last":0.36799999999999999},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.54200000000000004,"15min":0.54400000000000004},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":0.72199999999999998,"5min":0.76000000000000001,"15min":0.76000000000000001},"last":0.42199999999999999}]},{"osd":3,"last update":"Sat Mar 30 13:36:57 2024","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.52500000000000002,"15min":0.52800000000000002},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.38200000000000001},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.53900000000000003,"15min":0.53500000000000003},"min":{"1min":0.39200000000000002,"5min":0.379,"15min":0.379},"max":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"last":0.34999999999999998}]},{"osd":4,"last update":"Sat Mar 30 13:36:57 2024","interfaces":[{"interface":"back","average":{"1min":0.42799999999999999,"5min":0.40899999999999997,"15min":0.40600000000000003},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"last":0.24299999999999999},{"interface":"front","average":{"1min":0.47799999999999998,"5min":0.42199999999999999,"15min":0.41299999999999998},"min":{"1min":0.33700000000000002,"5min":0.31,"15min":0.31},"max":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"last":0.27700000000000002}]},{"osd":6,"last update":"Sat Mar 30 13:36:18 2024","interfaces":[{"interface":"back","average":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.626,"5min":0.626,"15min":0.626},"last":0.26900000000000002},{"interface":"front","average":{"1min":0.432,"5min":0.432,"15min":0.432},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"last":0.315}]},{"osd":7,"last update":"Sat Mar 30 13:36:43 2024","interfaces":[{"interface":"back","average":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"last":0.39100000000000001},{"interface":"front","average":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.747,"5min":0.747,"15min":0.747},"last":0.29199999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-30T13:37:20.039 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2024-03-30T13:37:20.039 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-03-30T13:37:20.039 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy 2024-03-30T13:37:20.039 DEBUG:teuthology.orchestra.run.smithi099:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell --fsid 98ebaeb8-ee99-11ee-b647-cb9ed24678a4 -- ceph health --format=json 2024-03-30T13:37:21.006 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:37:20 smithi181 ceph-mon[25762]: from='client.24508 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-03-30T13:37:21.006 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:37:20 smithi181 ceph-mon[25762]: pgmap v43: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:37:21.087 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:37:20 smithi099 ceph-mon[24912]: from='client.24508 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-03-30T13:37:21.087 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:37:20 smithi099 ceph-mon[24912]: pgmap v43: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:37:21.087 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:37:20 smithi099 ceph-mon[29691]: from='client.24508 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-03-30T13:37:21.087 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:37:20 smithi099 ceph-mon[29691]: pgmap v43: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:37:21.678 INFO:teuthology.orchestra.run.smithi099.stderr:Inferring config /var/lib/ceph/98ebaeb8-ee99-11ee-b647-cb9ed24678a4/mon.a/config 2024-03-30T13:37:23.006 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:37:22 smithi181 ceph-mon[25762]: pgmap v44: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:37:23.046 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:37:22 smithi099 ceph-mon[24912]: pgmap v44: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:37:23.046 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:37:22 smithi099 ceph-mon[29691]: pgmap v44: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:37:24.587 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:37:24 smithi099 ceph-mon[24912]: pgmap v45: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:37:24.587 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:37:24 smithi099 ceph-mon[29691]: pgmap v45: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:37:25.006 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:37:24 smithi181 ceph-mon[25762]: pgmap v45: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:37:26.078 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-03-30T13:37:26.078 INFO:teuthology.orchestra.run.smithi099.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-03-30T13:37:26.337 INFO:journalctl@ceph.alertmanager.a.smithi099.stdout:Mar 30 13:37:26 smithi099 podman[49920]: 2024-03-30 13:37:26.180223513 +0000 UTC m=+0.251669043 container create fa0c3fad86005730f08f989e05b9b25abb6058376dbb5336bde90ea68d717ca0 (image=quay.io/prometheus/alertmanager:v0.23.0, name=ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-alertmanager-a, maintainer=The Prometheus Authors ) 2024-03-30T13:37:26.620 INFO:journalctl@ceph.alertmanager.a.smithi099.stdout:Mar 30 13:37:26 smithi099 podman[49920]: 2024-03-30 13:37:26.466471829 +0000 UTC m=+0.537917368 container init fa0c3fad86005730f08f989e05b9b25abb6058376dbb5336bde90ea68d717ca0 (image=quay.io/prometheus/alertmanager:v0.23.0, name=ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-alertmanager-a, maintainer=The Prometheus Authors ) 2024-03-30T13:37:26.620 INFO:journalctl@ceph.alertmanager.a.smithi099.stdout:Mar 30 13:37:26 smithi099 podman[49920]: 2024-03-30 13:37:26.469245307 +0000 UTC m=+0.540690839 container start fa0c3fad86005730f08f989e05b9b25abb6058376dbb5336bde90ea68d717ca0 (image=quay.io/prometheus/alertmanager:v0.23.0, name=ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-alertmanager-a, maintainer=The Prometheus Authors ) 2024-03-30T13:37:26.620 INFO:journalctl@ceph.alertmanager.a.smithi099.stdout:Mar 30 13:37:26 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-alertmanager-a[49977]: level=info ts=2024-03-30T13:37:26.480Z caller=main.go:225 msg="Starting Alertmanager" version="(version=0.23.0, branch=HEAD, revision=61046b17771a57cfd4c4a51be370ab930a4d7d54)" 2024-03-30T13:37:26.620 INFO:journalctl@ceph.alertmanager.a.smithi099.stdout:Mar 30 13:37:26 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-alertmanager-a[49977]: level=info ts=2024-03-30T13:37:26.480Z caller=main.go:226 build_context="(go=go1.16.7, user=root@e21a959be8d2, date=20210825-10:48:55)" 2024-03-30T13:37:26.620 INFO:journalctl@ceph.alertmanager.a.smithi099.stdout:Mar 30 13:37:26 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-alertmanager-a[49977]: level=info ts=2024-03-30T13:37:26.481Z caller=cluster.go:184 component=cluster msg="setting advertise address explicitly" addr=172.21.15.99 port=9094 2024-03-30T13:37:26.620 INFO:journalctl@ceph.alertmanager.a.smithi099.stdout:Mar 30 13:37:26 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-alertmanager-a[49977]: level=info ts=2024-03-30T13:37:26.482Z caller=cluster.go:671 component=cluster msg="Waiting for gossip to settle..." interval=2s 2024-03-30T13:37:26.620 INFO:journalctl@ceph.alertmanager.a.smithi099.stdout:Mar 30 13:37:26 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-alertmanager-a[49977]: level=info ts=2024-03-30T13:37:26.507Z caller=coordinator.go:113 component=configuration msg="Loading configuration file" file=/etc/alertmanager/alertmanager.yml 2024-03-30T13:37:26.620 INFO:journalctl@ceph.alertmanager.a.smithi099.stdout:Mar 30 13:37:26 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-alertmanager-a[49977]: level=info ts=2024-03-30T13:37:26.507Z caller=coordinator.go:126 component=configuration msg="Completed loading of configuration file" file=/etc/alertmanager/alertmanager.yml 2024-03-30T13:37:26.621 INFO:journalctl@ceph.alertmanager.a.smithi099.stdout:Mar 30 13:37:26 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-alertmanager-a[49977]: level=info ts=2024-03-30T13:37:26.509Z caller=main.go:518 msg=Listening address=:9093 2024-03-30T13:37:26.621 INFO:journalctl@ceph.alertmanager.a.smithi099.stdout:Mar 30 13:37:26 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-alertmanager-a[49977]: level=info ts=2024-03-30T13:37:26.509Z caller=tls_config.go:191 msg="TLS is disabled." http2=false 2024-03-30T13:37:26.621 INFO:journalctl@ceph.alertmanager.a.smithi099.stdout:Mar 30 13:37:26 smithi099 bash[49920]: fa0c3fad86005730f08f989e05b9b25abb6058376dbb5336bde90ea68d717ca0 2024-03-30T13:37:26.621 INFO:journalctl@ceph.alertmanager.a.smithi099.stdout:Mar 30 13:37:26 smithi099 systemd[1]: Started Ceph alertmanager.a for 98ebaeb8-ee99-11ee-b647-cb9ed24678a4. 2024-03-30T13:37:26.947 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:37:26 smithi099 ceph-mon[29691]: pgmap v46: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:37:26.948 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:37:26 smithi099 ceph-mon[29691]: from='client.? 172.21.15.99:0/841974599' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-03-30T13:37:26.948 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:37:26 smithi099 ceph-mon[29691]: from='mgr.14439 ' entity='mgr.y' 2024-03-30T13:37:26.948 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:37:26 smithi099 ceph-mon[24912]: pgmap v46: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:37:26.948 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:37:26 smithi099 ceph-mon[24912]: from='client.? 172.21.15.99:0/841974599' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-03-30T13:37:26.948 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:37:26 smithi099 ceph-mon[24912]: from='mgr.14439 ' entity='mgr.y' 2024-03-30T13:37:26.948 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:37:26 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[25141]: ::ffff:172.21.15.181 - - [30/Mar/2024:13:37:26] "GET /metrics HTTP/1.1" 200 191496 "" "Prometheus/2.33.4" 2024-03-30T13:37:27.006 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:37:26 smithi181 ceph-mon[25762]: pgmap v46: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:37:27.006 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:37:26 smithi181 ceph-mon[25762]: from='client.? 172.21.15.99:0/841974599' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-03-30T13:37:27.006 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:37:26 smithi181 ceph-mon[25762]: from='mgr.14439 ' entity='mgr.y' 2024-03-30T13:37:27.264 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy done 2024-03-30T13:37:27.265 INFO:tasks.cephadm:Setup complete, yielding 2024-03-30T13:37:27.265 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-03-30T13:37:27.275 INFO:tasks.cephadm:Running commands on role mon.a host ubuntu@smithi099.front.sepia.ceph.com 2024-03-30T13:37:27.276 DEBUG:teuthology.orchestra.run.smithi099:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 98ebaeb8-ee99-11ee-b647-cb9ed24678a4 -- bash -c 'ceph config set mgr mgr/cephadm/use_repo_digest false --force' 2024-03-30T13:37:27.742 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:37:27 smithi099 ceph-mon[24912]: from='mgr.14439 ' entity='mgr.y' 2024-03-30T13:37:27.742 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:37:27 smithi099 ceph-mon[24912]: from='mgr.14439 ' entity='mgr.y' 2024-03-30T13:37:27.742 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:37:27 smithi099 ceph-mon[24912]: from='mgr.14439 172.21.15.99:0/1757456350' entity='mgr.y' cmd=[{"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"}]: dispatch 2024-03-30T13:37:27.742 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:37:27 smithi099 ceph-mon[24912]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"}]: dispatch 2024-03-30T13:37:27.743 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:37:27 smithi099 ceph-mon[24912]: from='mgr.14439 ' entity='mgr.y' 2024-03-30T13:37:27.743 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:37:27 smithi099 ceph-mon[24912]: Deploying daemon grafana.a on smithi181 2024-03-30T13:37:27.743 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:37:27 smithi099 ceph-mon[29691]: from='mgr.14439 ' entity='mgr.y' 2024-03-30T13:37:27.743 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:37:27 smithi099 ceph-mon[29691]: from='mgr.14439 ' entity='mgr.y' 2024-03-30T13:37:27.743 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:37:27 smithi099 ceph-mon[29691]: from='mgr.14439 172.21.15.99:0/1757456350' entity='mgr.y' cmd=[{"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"}]: dispatch 2024-03-30T13:37:27.743 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:37:27 smithi099 ceph-mon[29691]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"}]: dispatch 2024-03-30T13:37:27.743 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:37:27 smithi099 ceph-mon[29691]: from='mgr.14439 ' entity='mgr.y' 2024-03-30T13:37:27.743 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:37:27 smithi099 ceph-mon[29691]: Deploying daemon grafana.a on smithi181 2024-03-30T13:37:28.006 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:37:27 smithi181 ceph-mon[25762]: from='mgr.14439 ' entity='mgr.y' 2024-03-30T13:37:28.006 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:37:27 smithi181 ceph-mon[25762]: from='mgr.14439 ' entity='mgr.y' 2024-03-30T13:37:28.006 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:37:27 smithi181 ceph-mon[25762]: from='mgr.14439 172.21.15.99:0/1757456350' entity='mgr.y' cmd=[{"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"}]: dispatch 2024-03-30T13:37:28.006 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:37:27 smithi181 ceph-mon[25762]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"}]: dispatch 2024-03-30T13:37:28.006 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:37:27 smithi181 ceph-mon[25762]: from='mgr.14439 ' entity='mgr.y' 2024-03-30T13:37:28.006 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:37:27 smithi181 ceph-mon[25762]: Deploying daemon grafana.a on smithi181 2024-03-30T13:37:28.587 INFO:journalctl@ceph.alertmanager.a.smithi099.stdout:Mar 30 13:37:28 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-alertmanager-a[49977]: level=info ts=2024-03-30T13:37:28.482Z caller=cluster.go:696 component=cluster msg="gossip not settled" polls=0 before=0 now=1 elapsed=2.000015441s 2024-03-30T13:37:28.884 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:37:28 smithi099 ceph-mon[24912]: pgmap v47: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:37:28.884 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:37:28 smithi099 ceph-mon[29691]: pgmap v47: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:37:29.213 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:37:28 smithi181 ceph-mon[25762]: pgmap v47: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:37:29.506 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 13:37:29 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-x[27332]: ::ffff:172.21.15.181 - - [30/Mar/2024:13:37:29] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-03-30T13:37:30.899 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:37:30 smithi099 ceph-mon[24912]: pgmap v48: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:37:30.899 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:37:30 smithi099 ceph-mon[24912]: from='mgr.14439 ' entity='mgr.y' 2024-03-30T13:37:30.899 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:37:30 smithi099 ceph-mon[29691]: pgmap v48: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:37:30.899 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:37:30 smithi099 ceph-mon[29691]: from='mgr.14439 ' entity='mgr.y' 2024-03-30T13:37:31.005 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:37:30 smithi181 ceph-mon[25762]: pgmap v48: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:37:31.006 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:37:30 smithi181 ceph-mon[25762]: from='mgr.14439 ' entity='mgr.y' 2024-03-30T13:37:32.837 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:37:32 smithi099 ceph-mon[24912]: pgmap v49: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:37:32.837 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:37:32 smithi099 ceph-mon[24912]: from='client.? 172.21.15.99:0/3037730324' entity='client.admin' 2024-03-30T13:37:32.837 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:37:32 smithi099 ceph-mon[29691]: pgmap v49: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:37:32.837 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:37:32 smithi099 ceph-mon[29691]: from='client.? 172.21.15.99:0/3037730324' entity='client.admin' 2024-03-30T13:37:33.006 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:37:32 smithi181 ceph-mon[25762]: pgmap v49: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:37:33.006 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:37:32 smithi181 ceph-mon[25762]: from='client.? 172.21.15.99:0/3037730324' entity='client.admin' 2024-03-30T13:37:33.100 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-03-30T13:37:33.108 INFO:tasks.cephadm:Running commands on role mon.a host ubuntu@smithi099.front.sepia.ceph.com 2024-03-30T13:37:33.109 DEBUG:teuthology.orchestra.run.smithi099:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 98ebaeb8-ee99-11ee-b647-cb9ed24678a4 -e sha1=4e50bbcdd1630c7760b708f3a5b4d38a121e66cb -- bash -c 'radosgw-admin realm create --rgw-realm=r --default' 2024-03-30T13:37:34.007 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:37:33 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[25141]: 172.21.15.99 - - [30/Mar/2024:13:37:33] "POST /data HTTP/1.1" 200 46 "" "Python-urllib/3.9" 2024-03-30T13:37:35.117 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:37:34 smithi099 ceph-mon[24912]: pgmap v50: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:37:35.117 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:37:34 smithi099 ceph-mon[24912]: from='mgr.14439 ' entity='mgr.y' 2024-03-30T13:37:35.117 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:37:34 smithi099 ceph-mon[29691]: pgmap v50: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:37:35.117 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:37:34 smithi099 ceph-mon[29691]: from='mgr.14439 ' entity='mgr.y' 2024-03-30T13:37:35.256 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:37:34 smithi181 ceph-mon[25762]: pgmap v50: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:37:35.256 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:37:34 smithi181 ceph-mon[25762]: from='mgr.14439 ' entity='mgr.y' 2024-03-30T13:37:36.484 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:37:36 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[25141]: 172.21.15.181 - - [30/Mar/2024:13:37:36] "POST /data HTTP/1.1" 200 46 "" "Python-urllib/3.9" 2024-03-30T13:37:36.750 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:37:36 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[25141]: 172.21.15.99 - - [30/Mar/2024:13:37:36] "POST /data HTTP/1.1" 200 46 "" "Python-urllib/3.9" 2024-03-30T13:37:36.751 INFO:journalctl@ceph.alertmanager.a.smithi099.stdout:Mar 30 13:37:36 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-alertmanager-a[49977]: level=info ts=2024-03-30T13:37:36.483Z caller=cluster.go:688 component=cluster msg="gossip settled; proceeding" elapsed=10.00175532s 2024-03-30T13:37:36.883 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-03-30T13:37:36.883 INFO:teuthology.orchestra.run.smithi099.stdout: "id": "8415daa6-f354-4a6d-9b77-a7b63f225e62", 2024-03-30T13:37:36.883 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "r", 2024-03-30T13:37:36.883 INFO:teuthology.orchestra.run.smithi099.stdout: "current_period": "58ad8575-d9f9-48f2-967e-8573b6e54039", 2024-03-30T13:37:36.883 INFO:teuthology.orchestra.run.smithi099.stdout: "epoch": 1 2024-03-30T13:37:36.883 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-03-30T13:37:37.087 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:37:36 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[25141]: ::ffff:172.21.15.181 - - [30/Mar/2024:13:37:36] "GET /metrics HTTP/1.1" 200 191500 "" "Prometheus/2.33.4" 2024-03-30T13:37:37.087 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:37:36 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[25141]: 172.21.15.99 - - [30/Mar/2024:13:37:36] "POST /data HTTP/1.1" 200 46 "" "Python-urllib/3.9" 2024-03-30T13:37:37.087 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:37:36 smithi099 ceph-mon[24912]: pgmap v51: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:37:37.087 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:37:36 smithi099 ceph-mon[24912]: osdmap e61: 8 total, 8 up, 8 in 2024-03-30T13:37:37.087 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:37:36 smithi099 ceph-mon[24912]: from='client.? 172.21.15.99:0/1540263984' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": ".rgw.root","app": "rgw"}]: dispatch 2024-03-30T13:37:37.087 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:37:36 smithi099 ceph-mon[24912]: from='mgr.14439 ' entity='mgr.y' 2024-03-30T13:37:37.087 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:37:36 smithi099 ceph-mon[24912]: from='mgr.14439 ' entity='mgr.y' 2024-03-30T13:37:37.087 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:37:36 smithi099 ceph-mon[24912]: from='mgr.14439 ' entity='mgr.y' 2024-03-30T13:37:37.087 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:37:36 smithi099 ceph-mon[24912]: from='mgr.14439 ' entity='mgr.y' 2024-03-30T13:37:37.088 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:37:36 smithi099 ceph-mon[24912]: from='mgr.14439 ' entity='mgr.y' 2024-03-30T13:37:37.088 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:37:36 smithi099 ceph-mon[29691]: pgmap v51: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:37:37.088 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:37:36 smithi099 ceph-mon[29691]: osdmap e61: 8 total, 8 up, 8 in 2024-03-30T13:37:37.088 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:37:36 smithi099 ceph-mon[29691]: from='client.? 172.21.15.99:0/1540263984' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": ".rgw.root","app": "rgw"}]: dispatch 2024-03-30T13:37:37.088 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:37:36 smithi099 ceph-mon[29691]: from='mgr.14439 ' entity='mgr.y' 2024-03-30T13:37:37.088 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:37:36 smithi099 ceph-mon[29691]: from='mgr.14439 ' entity='mgr.y' 2024-03-30T13:37:37.088 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:37:36 smithi099 ceph-mon[29691]: from='mgr.14439 ' entity='mgr.y' 2024-03-30T13:37:37.088 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:37:36 smithi099 ceph-mon[29691]: from='mgr.14439 ' entity='mgr.y' 2024-03-30T13:37:37.088 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:37:36 smithi099 ceph-mon[29691]: from='mgr.14439 ' entity='mgr.y' 2024-03-30T13:37:37.256 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:37:36 smithi181 ceph-mon[25762]: pgmap v51: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:37:37.256 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:37:36 smithi181 ceph-mon[25762]: osdmap e61: 8 total, 8 up, 8 in 2024-03-30T13:37:37.256 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:37:36 smithi181 ceph-mon[25762]: from='client.? 172.21.15.99:0/1540263984' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": ".rgw.root","app": "rgw"}]: dispatch 2024-03-30T13:37:37.256 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:37:36 smithi181 ceph-mon[25762]: from='mgr.14439 ' entity='mgr.y' 2024-03-30T13:37:37.256 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:37:36 smithi181 ceph-mon[25762]: from='mgr.14439 ' entity='mgr.y' 2024-03-30T13:37:37.256 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:37:36 smithi181 ceph-mon[25762]: from='mgr.14439 ' entity='mgr.y' 2024-03-30T13:37:37.256 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:37:36 smithi181 ceph-mon[25762]: from='mgr.14439 ' entity='mgr.y' 2024-03-30T13:37:37.256 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:37:36 smithi181 ceph-mon[25762]: from='mgr.14439 ' entity='mgr.y' 2024-03-30T13:37:37.525 DEBUG:teuthology.orchestra.run.smithi099:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 98ebaeb8-ee99-11ee-b647-cb9ed24678a4 -e sha1=4e50bbcdd1630c7760b708f3a5b4d38a121e66cb -- bash -c 'radosgw-admin zonegroup create --rgw-zonegroup=default --master --default' 2024-03-30T13:37:38.085 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:37:37 smithi099 ceph-mon[24912]: from='client.? 172.21.15.99:0/1540263984' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": ".rgw.root","app": "rgw"}]': finished 2024-03-30T13:37:38.085 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:37:37 smithi099 ceph-mon[24912]: osdmap e62: 8 total, 8 up, 8 in 2024-03-30T13:37:38.086 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:37:37 smithi099 ceph-mon[29691]: from='client.? 172.21.15.99:0/1540263984' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": ".rgw.root","app": "rgw"}]': finished 2024-03-30T13:37:38.086 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:37:37 smithi099 ceph-mon[29691]: osdmap e62: 8 total, 8 up, 8 in 2024-03-30T13:37:38.255 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:37:37 smithi181 ceph-mon[25762]: from='client.? 172.21.15.99:0/1540263984' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": ".rgw.root","app": "rgw"}]': finished 2024-03-30T13:37:38.256 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:37:37 smithi181 ceph-mon[25762]: osdmap e62: 8 total, 8 up, 8 in 2024-03-30T13:37:39.112 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:37:38 smithi099 ceph-mon[24912]: pgmap v54: 33 pgs: 32 unknown, 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:37:39.112 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:37:38 smithi099 ceph-mon[24912]: osdmap e63: 8 total, 8 up, 8 in 2024-03-30T13:37:39.112 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:37:38 smithi099 ceph-mon[29691]: pgmap v54: 33 pgs: 32 unknown, 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:37:39.112 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:37:38 smithi099 ceph-mon[29691]: osdmap e63: 8 total, 8 up, 8 in 2024-03-30T13:37:39.258 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:37:38 smithi181 ceph-mon[25762]: pgmap v54: 33 pgs: 32 unknown, 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:37:39.258 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:37:38 smithi181 ceph-mon[25762]: osdmap e63: 8 total, 8 up, 8 in 2024-03-30T13:37:39.320 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-03-30T13:37:39.320 INFO:teuthology.orchestra.run.smithi099.stdout: "id": "0db24327-f34b-4f88-a44a-55f13e4a2cf0", 2024-03-30T13:37:39.320 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "default", 2024-03-30T13:37:39.320 INFO:teuthology.orchestra.run.smithi099.stdout: "api_name": "default", 2024-03-30T13:37:39.320 INFO:teuthology.orchestra.run.smithi099.stdout: "is_master": "true", 2024-03-30T13:37:39.320 INFO:teuthology.orchestra.run.smithi099.stdout: "endpoints": [], 2024-03-30T13:37:39.320 INFO:teuthology.orchestra.run.smithi099.stdout: "hostnames": [], 2024-03-30T13:37:39.320 INFO:teuthology.orchestra.run.smithi099.stdout: "hostnames_s3website": [], 2024-03-30T13:37:39.320 INFO:teuthology.orchestra.run.smithi099.stdout: "master_zone": "", 2024-03-30T13:37:39.320 INFO:teuthology.orchestra.run.smithi099.stdout: "zones": [], 2024-03-30T13:37:39.320 INFO:teuthology.orchestra.run.smithi099.stdout: "placement_targets": [], 2024-03-30T13:37:39.321 INFO:teuthology.orchestra.run.smithi099.stdout: "default_placement": "", 2024-03-30T13:37:39.321 INFO:teuthology.orchestra.run.smithi099.stdout: "realm_id": "8415daa6-f354-4a6d-9b77-a7b63f225e62", 2024-03-30T13:37:39.321 INFO:teuthology.orchestra.run.smithi099.stdout: "sync_policy": { 2024-03-30T13:37:39.321 INFO:teuthology.orchestra.run.smithi099.stdout: "groups": [] 2024-03-30T13:37:39.321 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-03-30T13:37:39.321 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-03-30T13:37:39.756 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 13:37:39 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-x[27332]: ::ffff:172.21.15.181 - - [30/Mar/2024:13:37:39] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-03-30T13:37:40.076 DEBUG:teuthology.orchestra.run.smithi099:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 98ebaeb8-ee99-11ee-b647-cb9ed24678a4 -e sha1=4e50bbcdd1630c7760b708f3a5b4d38a121e66cb -- bash -c 'radosgw-admin zone create --rgw-zonegroup=default --rgw-zone=z --master --default' 2024-03-30T13:37:41.090 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:37:40 smithi099 ceph-mon[24912]: pgmap v56: 33 pgs: 32 unknown, 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:37:41.090 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:37:40 smithi099 ceph-mon[29691]: pgmap v56: 33 pgs: 32 unknown, 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:37:41.256 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:37:40 smithi181 ceph-mon[25762]: pgmap v56: 33 pgs: 32 unknown, 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:37:41.850 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-03-30T13:37:41.850 INFO:teuthology.orchestra.run.smithi099.stdout: "id": "3afd1167-b8b2-4ab6-a71f-22d886e9d5cf", 2024-03-30T13:37:41.850 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "z", 2024-03-30T13:37:41.850 INFO:teuthology.orchestra.run.smithi099.stdout: "domain_root": "z.rgw.meta:root", 2024-03-30T13:37:41.850 INFO:teuthology.orchestra.run.smithi099.stdout: "control_pool": "z.rgw.control", 2024-03-30T13:37:41.850 INFO:teuthology.orchestra.run.smithi099.stdout: "gc_pool": "z.rgw.log:gc", 2024-03-30T13:37:41.850 INFO:teuthology.orchestra.run.smithi099.stdout: "lc_pool": "z.rgw.log:lc", 2024-03-30T13:37:41.850 INFO:teuthology.orchestra.run.smithi099.stdout: "log_pool": "z.rgw.log", 2024-03-30T13:37:41.850 INFO:teuthology.orchestra.run.smithi099.stdout: "intent_log_pool": "z.rgw.log:intent", 2024-03-30T13:37:41.851 INFO:teuthology.orchestra.run.smithi099.stdout: "usage_log_pool": "z.rgw.log:usage", 2024-03-30T13:37:41.851 INFO:teuthology.orchestra.run.smithi099.stdout: "roles_pool": "z.rgw.meta:roles", 2024-03-30T13:37:41.851 INFO:teuthology.orchestra.run.smithi099.stdout: "reshard_pool": "z.rgw.log:reshard", 2024-03-30T13:37:41.851 INFO:teuthology.orchestra.run.smithi099.stdout: "user_keys_pool": "z.rgw.meta:users.keys", 2024-03-30T13:37:41.851 INFO:teuthology.orchestra.run.smithi099.stdout: "user_email_pool": "z.rgw.meta:users.email", 2024-03-30T13:37:41.851 INFO:teuthology.orchestra.run.smithi099.stdout: "user_swift_pool": "z.rgw.meta:users.swift", 2024-03-30T13:37:41.851 INFO:teuthology.orchestra.run.smithi099.stdout: "user_uid_pool": "z.rgw.meta:users.uid", 2024-03-30T13:37:41.851 INFO:teuthology.orchestra.run.smithi099.stdout: "otp_pool": "z.rgw.otp", 2024-03-30T13:37:41.851 INFO:teuthology.orchestra.run.smithi099.stdout: "system_key": { 2024-03-30T13:37:41.851 INFO:teuthology.orchestra.run.smithi099.stdout: "access_key": "", 2024-03-30T13:37:41.851 INFO:teuthology.orchestra.run.smithi099.stdout: "secret_key": "" 2024-03-30T13:37:41.851 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:37:41.851 INFO:teuthology.orchestra.run.smithi099.stdout: "placement_pools": [ 2024-03-30T13:37:41.851 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-03-30T13:37:41.851 INFO:teuthology.orchestra.run.smithi099.stdout: "key": "default-placement", 2024-03-30T13:37:41.851 INFO:teuthology.orchestra.run.smithi099.stdout: "val": { 2024-03-30T13:37:41.851 INFO:teuthology.orchestra.run.smithi099.stdout: "index_pool": "z.rgw.buckets.index", 2024-03-30T13:37:41.852 INFO:teuthology.orchestra.run.smithi099.stdout: "storage_classes": { 2024-03-30T13:37:41.852 INFO:teuthology.orchestra.run.smithi099.stdout: "STANDARD": { 2024-03-30T13:37:41.852 INFO:teuthology.orchestra.run.smithi099.stdout: "data_pool": "z.rgw.buckets.data" 2024-03-30T13:37:41.852 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-03-30T13:37:41.852 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:37:41.852 INFO:teuthology.orchestra.run.smithi099.stdout: "data_extra_pool": "z.rgw.buckets.non-ec", 2024-03-30T13:37:41.852 INFO:teuthology.orchestra.run.smithi099.stdout: "index_type": 0 2024-03-30T13:37:41.852 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-03-30T13:37:41.852 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-03-30T13:37:41.852 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-03-30T13:37:41.852 INFO:teuthology.orchestra.run.smithi099.stdout: "realm_id": "8415daa6-f354-4a6d-9b77-a7b63f225e62", 2024-03-30T13:37:41.852 INFO:teuthology.orchestra.run.smithi099.stdout: "notif_pool": "z.rgw.log:notif" 2024-03-30T13:37:41.852 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-03-30T13:37:42.578 DEBUG:teuthology.orchestra.run.smithi099:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 98ebaeb8-ee99-11ee-b647-cb9ed24678a4 -e sha1=4e50bbcdd1630c7760b708f3a5b4d38a121e66cb -- bash -c 'radosgw-admin period update --rgw-realm=r --commit' 2024-03-30T13:37:43.012 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:37:42 smithi099 ceph-mon[24912]: pgmap v57: 33 pgs: 33 active+clean; 578 KiB data, 49 MiB used, 715 GiB / 715 GiB avail; 682 B/s rd, 1.8 KiB/s wr, 2 op/s 2024-03-30T13:37:43.013 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:37:42 smithi099 ceph-mon[29691]: pgmap v57: 33 pgs: 33 active+clean; 578 KiB data, 49 MiB used, 715 GiB / 715 GiB avail; 682 B/s rd, 1.8 KiB/s wr, 2 op/s 2024-03-30T13:37:43.256 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:37:42 smithi181 ceph-mon[25762]: pgmap v57: 33 pgs: 33 active+clean; 578 KiB data, 49 MiB used, 715 GiB / 715 GiB avail; 682 B/s rd, 1.8 KiB/s wr, 2 op/s 2024-03-30T13:37:44.891 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:37:44 smithi099 ceph-mon[24912]: pgmap v58: 33 pgs: 33 active+clean; 578 KiB data, 49 MiB used, 715 GiB / 715 GiB avail; 529 B/s rd, 1.4 KiB/s wr, 2 op/s 2024-03-30T13:37:44.892 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:37:44 smithi099 ceph-mon[29691]: pgmap v58: 33 pgs: 33 active+clean; 578 KiB data, 49 MiB used, 715 GiB / 715 GiB avail; 529 B/s rd, 1.4 KiB/s wr, 2 op/s 2024-03-30T13:37:45.006 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:37:44 smithi181 ceph-mon[25762]: pgmap v58: 33 pgs: 33 active+clean; 578 KiB data, 49 MiB used, 715 GiB / 715 GiB avail; 529 B/s rd, 1.4 KiB/s wr, 2 op/s 2024-03-30T13:37:45.981 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:37:45 smithi099 ceph-mon[24912]: osdmap e64: 8 total, 8 up, 8 in 2024-03-30T13:37:45.981 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:37:45 smithi099 ceph-mon[24912]: from='client.? 172.21.15.99:0/3684869916' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "z.rgw.log","app": "rgw"}]: dispatch 2024-03-30T13:37:45.981 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:37:45 smithi099 ceph-mon[29691]: osdmap e64: 8 total, 8 up, 8 in 2024-03-30T13:37:45.981 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:37:45 smithi099 ceph-mon[29691]: from='client.? 172.21.15.99:0/3684869916' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "z.rgw.log","app": "rgw"}]: dispatch 2024-03-30T13:37:46.006 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:37:45 smithi181 ceph-mon[25762]: osdmap e64: 8 total, 8 up, 8 in 2024-03-30T13:37:46.006 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:37:45 smithi181 ceph-mon[25762]: from='client.? 172.21.15.99:0/3684869916' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "z.rgw.log","app": "rgw"}]: dispatch 2024-03-30T13:37:47.000 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:37:46 smithi099 ceph-mon[24912]: pgmap v60: 65 pgs: 32 creating+peering, 33 active+clean; 579 KiB data, 49 MiB used, 715 GiB / 715 GiB avail; 3.7 KiB/s rd, 2.0 KiB/s wr, 6 op/s 2024-03-30T13:37:47.000 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:37:46 smithi099 ceph-mon[24912]: from='client.? 172.21.15.99:0/3684869916' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "z.rgw.log","app": "rgw"}]': finished 2024-03-30T13:37:47.000 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:37:46 smithi099 ceph-mon[24912]: osdmap e65: 8 total, 8 up, 8 in 2024-03-30T13:37:47.000 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:37:46 smithi099 ceph-mon[29691]: pgmap v60: 65 pgs: 32 creating+peering, 33 active+clean; 579 KiB data, 49 MiB used, 715 GiB / 715 GiB avail; 3.7 KiB/s rd, 2.0 KiB/s wr, 6 op/s 2024-03-30T13:37:47.000 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:37:46 smithi099 ceph-mon[29691]: from='client.? 172.21.15.99:0/3684869916' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "z.rgw.log","app": "rgw"}]': finished 2024-03-30T13:37:47.000 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:37:46 smithi099 ceph-mon[29691]: osdmap e65: 8 total, 8 up, 8 in 2024-03-30T13:37:47.000 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:37:46 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[25141]: ::ffff:172.21.15.181 - - [30/Mar/2024:13:37:46] "GET /metrics HTTP/1.1" 200 193030 "" "Prometheus/2.33.4" 2024-03-30T13:37:47.005 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:37:46 smithi181 ceph-mon[25762]: pgmap v60: 65 pgs: 32 creating+peering, 33 active+clean; 579 KiB data, 49 MiB used, 715 GiB / 715 GiB avail; 3.7 KiB/s rd, 2.0 KiB/s wr, 6 op/s 2024-03-30T13:37:47.006 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:37:46 smithi181 ceph-mon[25762]: from='client.? 172.21.15.99:0/3684869916' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "z.rgw.log","app": "rgw"}]': finished 2024-03-30T13:37:47.006 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:37:46 smithi181 ceph-mon[25762]: osdmap e65: 8 total, 8 up, 8 in 2024-03-30T13:37:48.006 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:37:47 smithi181 ceph-mon[25762]: osdmap e66: 8 total, 8 up, 8 in 2024-03-30T13:37:48.006 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:37:47 smithi181 ceph-mon[25762]: from='client.? 172.21.15.99:0/3684869916' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "z.rgw.control","app": "rgw"}]: dispatch 2024-03-30T13:37:48.006 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:37:47 smithi181 ceph-mon[25762]: from='client.? 172.21.15.99:0/3684869916' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "z.rgw.control","app": "rgw"}]': finished 2024-03-30T13:37:48.006 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:37:47 smithi181 ceph-mon[25762]: osdmap e67: 8 total, 8 up, 8 in 2024-03-30T13:37:48.087 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:37:47 smithi099 ceph-mon[29691]: osdmap e66: 8 total, 8 up, 8 in 2024-03-30T13:37:48.087 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:37:47 smithi099 ceph-mon[29691]: from='client.? 172.21.15.99:0/3684869916' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "z.rgw.control","app": "rgw"}]: dispatch 2024-03-30T13:37:48.087 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:37:47 smithi099 ceph-mon[29691]: from='client.? 172.21.15.99:0/3684869916' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "z.rgw.control","app": "rgw"}]': finished 2024-03-30T13:37:48.087 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:37:47 smithi099 ceph-mon[29691]: osdmap e67: 8 total, 8 up, 8 in 2024-03-30T13:37:48.087 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:37:47 smithi099 ceph-mon[24912]: osdmap e66: 8 total, 8 up, 8 in 2024-03-30T13:37:48.087 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:37:47 smithi099 ceph-mon[24912]: from='client.? 172.21.15.99:0/3684869916' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "z.rgw.control","app": "rgw"}]: dispatch 2024-03-30T13:37:48.087 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:37:47 smithi099 ceph-mon[24912]: from='client.? 172.21.15.99:0/3684869916' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "z.rgw.control","app": "rgw"}]': finished 2024-03-30T13:37:48.087 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:37:47 smithi099 ceph-mon[24912]: osdmap e67: 8 total, 8 up, 8 in 2024-03-30T13:37:49.006 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:37:48 smithi181 ceph-mon[25762]: pgmap v63: 97 pgs: 32 unknown, 32 creating+peering, 33 active+clean; 579 KiB data, 49 MiB used, 715 GiB / 715 GiB avail; 4.3 KiB/s rd, 853 B/s wr, 5 op/s 2024-03-30T13:37:49.006 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:37:48 smithi181 ceph-mon[25762]: osdmap e68: 8 total, 8 up, 8 in 2024-03-30T13:37:49.006 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:37:48 smithi181 ceph-mon[25762]: from='client.? 172.21.15.99:0/3557053015' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "z.rgw.meta","app": "rgw"}]: dispatch 2024-03-30T13:37:49.087 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:37:48 smithi099 ceph-mon[24912]: pgmap v63: 97 pgs: 32 unknown, 32 creating+peering, 33 active+clean; 579 KiB data, 49 MiB used, 715 GiB / 715 GiB avail; 4.3 KiB/s rd, 853 B/s wr, 5 op/s 2024-03-30T13:37:49.087 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:37:48 smithi099 ceph-mon[24912]: osdmap e68: 8 total, 8 up, 8 in 2024-03-30T13:37:49.087 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:37:48 smithi099 ceph-mon[24912]: from='client.? 172.21.15.99:0/3557053015' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "z.rgw.meta","app": "rgw"}]: dispatch 2024-03-30T13:37:49.087 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:37:48 smithi099 ceph-mon[29691]: pgmap v63: 97 pgs: 32 unknown, 32 creating+peering, 33 active+clean; 579 KiB data, 49 MiB used, 715 GiB / 715 GiB avail; 4.3 KiB/s rd, 853 B/s wr, 5 op/s 2024-03-30T13:37:49.087 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:37:48 smithi099 ceph-mon[29691]: osdmap e68: 8 total, 8 up, 8 in 2024-03-30T13:37:49.087 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:37:48 smithi099 ceph-mon[29691]: from='client.? 172.21.15.99:0/3557053015' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "z.rgw.meta","app": "rgw"}]: dispatch 2024-03-30T13:37:49.671 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 13:37:49 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-x[27332]: ::ffff:172.21.15.181 - - [30/Mar/2024:13:37:49] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-03-30T13:37:50.254 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 13:37:50 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a[44815]: t=2024-03-30T13:37:50+0000 lvl=info msg="Executing migration" logger=migrator id="create index UQE_org_name - v1" 2024-03-30T13:37:50.254 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 13:37:50 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a[44815]: t=2024-03-30T13:37:50+0000 lvl=info msg="Executing migration" logger=migrator id="create org_user table v1" 2024-03-30T13:37:50.505 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 13:37:50 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a[44815]: t=2024-03-30T13:37:50+0000 lvl=info msg="Executing migration" logger=migrator id="create index IDX_org_user_org_id - v1" 2024-03-30T13:37:50.505 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 13:37:50 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a[44815]: t=2024-03-30T13:37:50+0000 lvl=info msg="Executing migration" logger=migrator id="create index UQE_org_user_org_id_user_id - v1" 2024-03-30T13:37:50.505 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 13:37:50 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a[44815]: t=2024-03-30T13:37:50+0000 lvl=info msg="Executing migration" logger=migrator id="create index IDX_org_user_user_id - v1" 2024-03-30T13:37:50.505 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 13:37:50 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a[44815]: t=2024-03-30T13:37:50+0000 lvl=info msg="Executing migration" logger=migrator id="Update org table charset" 2024-03-30T13:37:50.505 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 13:37:50 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a[44815]: t=2024-03-30T13:37:50+0000 lvl=info msg="Executing migration" logger=migrator id="Update org_user table charset" 2024-03-30T13:37:50.505 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 13:37:50 smithi181 bash[44784]: 084559d0032875674dc1160d184b442de5ccc83e0cf6edf5296b78d9007e071c 2024-03-30T13:37:50.506 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 13:37:50 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a[44815]: t=2024-03-30T13:37:50+0000 lvl=info msg="Executing migration" logger=migrator id="Migrate all Read Only Viewers to Viewers" 2024-03-30T13:37:50.506 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 13:37:50 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a[44815]: t=2024-03-30T13:37:50+0000 lvl=info msg="Executing migration" logger=migrator id="create dashboard table" 2024-03-30T13:37:50.506 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 13:37:50 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a[44815]: t=2024-03-30T13:37:50+0000 lvl=info msg="Executing migration" logger=migrator id="add index dashboard.account_id" 2024-03-30T13:37:50.506 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 13:37:50 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a[44815]: t=2024-03-30T13:37:50+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index dashboard_account_id_slug" 2024-03-30T13:37:50.506 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 13:37:50 smithi181 systemd[1]: Started Ceph grafana.a for 98ebaeb8-ee99-11ee-b647-cb9ed24678a4. 2024-03-30T13:37:50.506 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 13:37:50 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a[44815]: t=2024-03-30T13:37:50+0000 lvl=info msg="Executing migration" logger=migrator id="create dashboard_tag table" 2024-03-30T13:37:50.506 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 13:37:50 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a[44815]: t=2024-03-30T13:37:50+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index dashboard_tag.dasboard_id_term" 2024-03-30T13:37:50.506 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 13:37:50 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a[44815]: t=2024-03-30T13:37:50+0000 lvl=info msg="Executing migration" logger=migrator id="drop index UQE_dashboard_tag_dashboard_id_term - v1" 2024-03-30T13:37:50.506 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 13:37:50 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a[44815]: t=2024-03-30T13:37:50+0000 lvl=info msg="Executing migration" logger=migrator id="Rename table dashboard to dashboard_v1 - v1" 2024-03-30T13:37:50.506 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 13:37:50 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a[44815]: t=2024-03-30T13:37:50+0000 lvl=info msg="Executing migration" logger=migrator id="create dashboard v2" 2024-03-30T13:37:50.506 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 13:37:50 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a[44815]: t=2024-03-30T13:37:50+0000 lvl=info msg="Executing migration" logger=migrator id="create index IDX_dashboard_org_id - v2" 2024-03-30T13:37:50.506 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 13:37:50 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a[44815]: t=2024-03-30T13:37:50+0000 lvl=info msg="Executing migration" logger=migrator id="create index UQE_dashboard_org_id_slug - v2" 2024-03-30T13:37:50.507 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 13:37:50 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a[44815]: t=2024-03-30T13:37:50+0000 lvl=info msg="Executing migration" logger=migrator id="copy dashboard v1 to v2" 2024-03-30T13:37:50.507 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 13:37:50 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a[44815]: t=2024-03-30T13:37:50+0000 lvl=info msg="Executing migration" logger=migrator id="drop table dashboard_v1" 2024-03-30T13:37:50.507 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 13:37:50 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a[44815]: t=2024-03-30T13:37:50+0000 lvl=info msg="Executing migration" logger=migrator id="alter dashboard.data to mediumtext v1" 2024-03-30T13:37:50.507 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 13:37:50 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a[44815]: t=2024-03-30T13:37:50+0000 lvl=info msg="Executing migration" logger=migrator id="Add column updated_by in dashboard - v2" 2024-03-30T13:37:50.507 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 13:37:50 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a[44815]: t=2024-03-30T13:37:50+0000 lvl=info msg="Executing migration" logger=migrator id="Add column created_by in dashboard - v2" 2024-03-30T13:37:50.507 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 13:37:50 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a[44815]: t=2024-03-30T13:37:50+0000 lvl=info msg="Executing migration" logger=migrator id="Add column gnetId in dashboard" 2024-03-30T13:37:50.507 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 13:37:50 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a[44815]: t=2024-03-30T13:37:50+0000 lvl=info msg="Executing migration" logger=migrator id="Add index for gnetId in dashboard" 2024-03-30T13:37:50.507 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 13:37:50 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a[44815]: t=2024-03-30T13:37:50+0000 lvl=info msg="Executing migration" logger=migrator id="Add column plugin_id in dashboard" 2024-03-30T13:37:50.507 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 13:37:50 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a[44815]: t=2024-03-30T13:37:50+0000 lvl=info msg="Executing migration" logger=migrator id="Add index for plugin_id in dashboard" 2024-03-30T13:37:50.507 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 13:37:50 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a[44815]: t=2024-03-30T13:37:50+0000 lvl=info msg="Executing migration" logger=migrator id="Add index for dashboard_id in dashboard_tag" 2024-03-30T13:37:50.507 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 13:37:50 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a[44815]: t=2024-03-30T13:37:50+0000 lvl=info msg="Executing migration" logger=migrator id="Update dashboard table charset" 2024-03-30T13:37:50.507 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 13:37:50 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a[44815]: t=2024-03-30T13:37:50+0000 lvl=info msg="Executing migration" logger=migrator id="Update dashboard_tag table charset" 2024-03-30T13:37:50.507 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 13:37:50 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a[44815]: t=2024-03-30T13:37:50+0000 lvl=info msg="Executing migration" logger=migrator id="Add column folder_id in dashboard" 2024-03-30T13:37:50.508 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 13:37:50 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a[44815]: t=2024-03-30T13:37:50+0000 lvl=info msg="Executing migration" logger=migrator id="Add column isFolder in dashboard" 2024-03-30T13:37:50.508 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 13:37:50 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a[44815]: t=2024-03-30T13:37:50+0000 lvl=info msg="Executing migration" logger=migrator id="Add column has_acl in dashboard" 2024-03-30T13:37:50.508 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 13:37:50 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a[44815]: t=2024-03-30T13:37:50+0000 lvl=info msg="Executing migration" logger=migrator id="Add column uid in dashboard" 2024-03-30T13:37:50.508 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 13:37:50 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a[44815]: t=2024-03-30T13:37:50+0000 lvl=info msg="Executing migration" logger=migrator id="Update uid column values in dashboard" 2024-03-30T13:37:50.508 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 13:37:50 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a[44815]: t=2024-03-30T13:37:50+0000 lvl=info msg="Executing migration" logger=migrator id="Add unique index dashboard_org_id_uid" 2024-03-30T13:37:50.508 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 13:37:50 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a[44815]: t=2024-03-30T13:37:50+0000 lvl=info msg="Executing migration" logger=migrator id="Remove unique index org_id_slug" 2024-03-30T13:37:50.508 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 13:37:50 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a[44815]: t=2024-03-30T13:37:50+0000 lvl=info msg="Executing migration" logger=migrator id="Update dashboard title length" 2024-03-30T13:37:50.508 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 13:37:50 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a[44815]: t=2024-03-30T13:37:50+0000 lvl=info msg="Executing migration" logger=migrator id="Add unique index for dashboard_org_id_title_folder_id" 2024-03-30T13:37:50.508 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 13:37:50 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a[44815]: t=2024-03-30T13:37:50+0000 lvl=info msg="Executing migration" logger=migrator id="create dashboard_provisioning" 2024-03-30T13:37:50.509 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 13:37:50 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a[44815]: t=2024-03-30T13:37:50+0000 lvl=info msg="Executing migration" logger=migrator id="Rename table dashboard_provisioning to dashboard_provisioning_tmp_qwerty - v1" 2024-03-30T13:37:50.509 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 13:37:50 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a[44815]: t=2024-03-30T13:37:50+0000 lvl=info msg="Executing migration" logger=migrator id="create dashboard_provisioning v2" 2024-03-30T13:37:50.509 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 13:37:50 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a[44815]: t=2024-03-30T13:37:50+0000 lvl=info msg="Executing migration" logger=migrator id="create index IDX_dashboard_provisioning_dashboard_id - v2" 2024-03-30T13:37:50.509 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 13:37:50 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a[44815]: t=2024-03-30T13:37:50+0000 lvl=info msg="Executing migration" logger=migrator id="create index IDX_dashboard_provisioning_dashboard_id_name - v2" 2024-03-30T13:37:50.509 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 13:37:50 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a[44815]: t=2024-03-30T13:37:50+0000 lvl=info msg="Executing migration" logger=migrator id="copy dashboard_provisioning v1 to v2" 2024-03-30T13:37:50.510 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 13:37:50 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a[44815]: t=2024-03-30T13:37:50+0000 lvl=info msg="Executing migration" logger=migrator id="drop dashboard_provisioning_tmp_qwerty" 2024-03-30T13:37:50.510 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 13:37:50 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a[44815]: t=2024-03-30T13:37:50+0000 lvl=info msg="Executing migration" logger=migrator id="Add check_sum column" 2024-03-30T13:37:50.510 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 13:37:50 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a[44815]: t=2024-03-30T13:37:50+0000 lvl=info msg="Executing migration" logger=migrator id="Add index for dashboard_title" 2024-03-30T13:37:50.510 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 13:37:50 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a[44815]: t=2024-03-30T13:37:50+0000 lvl=info msg="Executing migration" logger=migrator id="delete tags for deleted dashboards" 2024-03-30T13:37:50.510 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 13:37:50 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a[44815]: t=2024-03-30T13:37:50+0000 lvl=info msg="Executing migration" logger=migrator id="delete stars for deleted dashboards" 2024-03-30T13:37:50.510 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 13:37:50 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a[44815]: t=2024-03-30T13:37:50+0000 lvl=info msg="Executing migration" logger=migrator id="Add index for dashboard_is_folder" 2024-03-30T13:37:50.510 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 13:37:50 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a[44815]: t=2024-03-30T13:37:50+0000 lvl=info msg="Executing migration" logger=migrator id="create data_source table" 2024-03-30T13:37:50.510 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 13:37:50 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a[44815]: t=2024-03-30T13:37:50+0000 lvl=info msg="Executing migration" logger=migrator id="add index data_source.account_id" 2024-03-30T13:37:50.510 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 13:37:50 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a[44815]: t=2024-03-30T13:37:50+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index data_source.account_id_name" 2024-03-30T13:37:50.510 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 13:37:50 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a[44815]: t=2024-03-30T13:37:50+0000 lvl=info msg="Executing migration" logger=migrator id="drop index IDX_data_source_account_id - v1" 2024-03-30T13:37:50.510 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 13:37:50 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a[44815]: t=2024-03-30T13:37:50+0000 lvl=info msg="Executing migration" logger=migrator id="drop index UQE_data_source_account_id_name - v1" 2024-03-30T13:37:50.510 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 13:37:50 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a[44815]: t=2024-03-30T13:37:50+0000 lvl=info msg="Executing migration" logger=migrator id="Rename table data_source to data_source_v1 - v1" 2024-03-30T13:37:50.510 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 13:37:50 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a[44815]: t=2024-03-30T13:37:50+0000 lvl=info msg="Executing migration" logger=migrator id="create data_source table v2" 2024-03-30T13:37:50.510 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 13:37:50 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a[44815]: t=2024-03-30T13:37:50+0000 lvl=info msg="Executing migration" logger=migrator id="create index IDX_data_source_org_id - v2" 2024-03-30T13:37:50.511 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 13:37:50 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a[44815]: t=2024-03-30T13:37:50+0000 lvl=info msg="Executing migration" logger=migrator id="create index UQE_data_source_org_id_name - v2" 2024-03-30T13:37:50.511 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 13:37:50 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a[44815]: t=2024-03-30T13:37:50+0000 lvl=info msg="Executing migration" logger=migrator id="copy data_source v1 to v2" 2024-03-30T13:37:50.511 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 13:37:50 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a[44815]: t=2024-03-30T13:37:50+0000 lvl=info msg="Executing migration" logger=migrator id="Drop old table data_source_v1 #2" 2024-03-30T13:37:50.511 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 13:37:50 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a[44815]: t=2024-03-30T13:37:50+0000 lvl=info msg="Executing migration" logger=migrator id="Add column with_credentials" 2024-03-30T13:37:50.511 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 13:37:50 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a[44815]: t=2024-03-30T13:37:50+0000 lvl=info msg="Executing migration" logger=migrator id="Add secure json data column" 2024-03-30T13:37:50.511 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 13:37:50 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a[44815]: t=2024-03-30T13:37:50+0000 lvl=info msg="Executing migration" logger=migrator id="Update data_source table charset" 2024-03-30T13:37:50.511 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 13:37:50 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a[44815]: t=2024-03-30T13:37:50+0000 lvl=info msg="Executing migration" logger=migrator id="Update initial version to 1" 2024-03-30T13:37:50.511 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 13:37:50 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a[44815]: t=2024-03-30T13:37:50+0000 lvl=info msg="Executing migration" logger=migrator id="Add read_only data column" 2024-03-30T13:37:50.511 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 13:37:50 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a[44815]: t=2024-03-30T13:37:50+0000 lvl=info msg="Executing migration" logger=migrator id="Migrate logging ds to loki ds" 2024-03-30T13:37:50.511 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 13:37:50 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a[44815]: t=2024-03-30T13:37:50+0000 lvl=info msg="Executing migration" logger=migrator id="Update json_data with nulls" 2024-03-30T13:37:50.511 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 13:37:50 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a[44815]: t=2024-03-30T13:37:50+0000 lvl=info msg="Executing migration" logger=migrator id="Add uid column" 2024-03-30T13:37:50.511 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 13:37:50 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a[44815]: t=2024-03-30T13:37:50+0000 lvl=info msg="Executing migration" logger=migrator id="Update uid value" 2024-03-30T13:37:50.511 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 13:37:50 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a[44815]: t=2024-03-30T13:37:50+0000 lvl=info msg="Executing migration" logger=migrator id="Add unique index datasource_org_id_uid" 2024-03-30T13:37:50.512 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 13:37:50 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a[44815]: t=2024-03-30T13:37:50+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index datasource_org_id_is_default" 2024-03-30T13:37:50.512 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 13:37:50 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a[44815]: t=2024-03-30T13:37:50+0000 lvl=info msg="Executing migration" logger=migrator id="create api_key table" 2024-03-30T13:37:50.512 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 13:37:50 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a[44815]: t=2024-03-30T13:37:50+0000 lvl=info msg="Executing migration" logger=migrator id="add index api_key.account_id" 2024-03-30T13:37:50.512 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 13:37:50 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a[44815]: t=2024-03-30T13:37:50+0000 lvl=info msg="Executing migration" logger=migrator id="add index api_key.key" 2024-03-30T13:37:50.512 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 13:37:50 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a[44815]: t=2024-03-30T13:37:50+0000 lvl=info msg="Executing migration" logger=migrator id="add index api_key.account_id_name" 2024-03-30T13:37:50.512 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 13:37:50 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a[44815]: t=2024-03-30T13:37:50+0000 lvl=info msg="Executing migration" logger=migrator id="drop index IDX_api_key_account_id - v1" 2024-03-30T13:37:50.512 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 13:37:50 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a[44815]: t=2024-03-30T13:37:50+0000 lvl=info msg="Executing migration" logger=migrator id="drop index UQE_api_key_key - v1" 2024-03-30T13:37:50.512 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 13:37:50 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a[44815]: t=2024-03-30T13:37:50+0000 lvl=info msg="Executing migration" logger=migrator id="drop index UQE_api_key_account_id_name - v1" 2024-03-30T13:37:50.512 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 13:37:50 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a[44815]: t=2024-03-30T13:37:50+0000 lvl=info msg="Executing migration" logger=migrator id="Rename table api_key to api_key_v1 - v1" 2024-03-30T13:37:50.512 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 13:37:50 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a[44815]: t=2024-03-30T13:37:50+0000 lvl=info msg="Executing migration" logger=migrator id="create api_key table v2" 2024-03-30T13:37:50.512 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 13:37:50 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a[44815]: t=2024-03-30T13:37:50+0000 lvl=info msg="Executing migration" logger=migrator id="create index IDX_api_key_org_id - v2" 2024-03-30T13:37:50.512 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 13:37:50 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a[44815]: t=2024-03-30T13:37:50+0000 lvl=info msg="Executing migration" logger=migrator id="create index UQE_api_key_key - v2" 2024-03-30T13:37:50.512 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 13:37:50 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a[44815]: t=2024-03-30T13:37:50+0000 lvl=info msg="Executing migration" logger=migrator id="create index UQE_api_key_org_id_name - v2" 2024-03-30T13:37:50.513 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 13:37:50 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a[44815]: t=2024-03-30T13:37:50+0000 lvl=info msg="Executing migration" logger=migrator id="copy api_key v1 to v2" 2024-03-30T13:37:50.513 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 13:37:50 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a[44815]: t=2024-03-30T13:37:50+0000 lvl=info msg="Executing migration" logger=migrator id="Drop old table api_key_v1" 2024-03-30T13:37:50.513 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 13:37:50 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a[44815]: t=2024-03-30T13:37:50+0000 lvl=info msg="Executing migration" logger=migrator id="Update api_key table charset" 2024-03-30T13:37:50.513 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 13:37:50 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a[44815]: t=2024-03-30T13:37:50+0000 lvl=info msg="Executing migration" logger=migrator id="Add expires to api_key table" 2024-03-30T13:37:50.513 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 13:37:50 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a[44815]: t=2024-03-30T13:37:50+0000 lvl=info msg="Executing migration" logger=migrator id="Add service account foreign key" 2024-03-30T13:37:50.513 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 13:37:50 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a[44815]: t=2024-03-30T13:37:50+0000 lvl=info msg="Executing migration" logger=migrator id="create dashboard_snapshot table v4" 2024-03-30T13:37:50.513 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 13:37:50 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a[44815]: t=2024-03-30T13:37:50+0000 lvl=info msg="Executing migration" logger=migrator id="drop table dashboard_snapshot_v4 #1" 2024-03-30T13:37:50.513 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 13:37:50 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a[44815]: t=2024-03-30T13:37:50+0000 lvl=info msg="Executing migration" logger=migrator id="create dashboard_snapshot table v5 #2" 2024-03-30T13:37:50.513 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 13:37:50 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a[44815]: t=2024-03-30T13:37:50+0000 lvl=info msg="Executing migration" logger=migrator id="create index UQE_dashboard_snapshot_key - v5" 2024-03-30T13:37:50.513 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 13:37:50 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a[44815]: t=2024-03-30T13:37:50+0000 lvl=info msg="Executing migration" logger=migrator id="create index UQE_dashboard_snapshot_delete_key - v5" 2024-03-30T13:37:50.513 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 13:37:50 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a[44815]: t=2024-03-30T13:37:50+0000 lvl=info msg="Executing migration" logger=migrator id="create index IDX_dashboard_snapshot_user_id - v5" 2024-03-30T13:37:50.513 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 13:37:50 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a[44815]: t=2024-03-30T13:37:50+0000 lvl=info msg="Executing migration" logger=migrator id="alter dashboard_snapshot to mediumtext v2" 2024-03-30T13:37:50.513 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 13:37:50 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a[44815]: t=2024-03-30T13:37:50+0000 lvl=info msg="Executing migration" logger=migrator id="Update dashboard_snapshot table charset" 2024-03-30T13:37:50.514 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 13:37:50 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a[44815]: t=2024-03-30T13:37:50+0000 lvl=info msg="Executing migration" logger=migrator id="Add column external_delete_url to dashboard_snapshots table" 2024-03-30T13:37:50.514 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 13:37:50 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a[44815]: t=2024-03-30T13:37:50+0000 lvl=info msg="Executing migration" logger=migrator id="Add encrypted dashboard json column" 2024-03-30T13:37:50.514 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 13:37:50 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a[44815]: t=2024-03-30T13:37:50+0000 lvl=info msg="Executing migration" logger=migrator id="Change dashboard_encrypted column to MEDIUMBLOB" 2024-03-30T13:37:50.514 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 13:37:50 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a[44815]: t=2024-03-30T13:37:50+0000 lvl=info msg="Executing migration" logger=migrator id="create quota table v1" 2024-03-30T13:37:50.514 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 13:37:50 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a[44815]: t=2024-03-30T13:37:50+0000 lvl=info msg="Executing migration" logger=migrator id="create index UQE_quota_org_id_user_id_target - v1" 2024-03-30T13:37:50.514 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 13:37:50 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a[44815]: t=2024-03-30T13:37:50+0000 lvl=info msg="Executing migration" logger=migrator id="Update quota table charset" 2024-03-30T13:37:50.514 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 13:37:50 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a[44815]: t=2024-03-30T13:37:50+0000 lvl=info msg="Executing migration" logger=migrator id="create plugin_setting table" 2024-03-30T13:37:50.514 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 13:37:50 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a[44815]: t=2024-03-30T13:37:50+0000 lvl=info msg="Executing migration" logger=migrator id="create index UQE_plugin_setting_org_id_plugin_id - v1" 2024-03-30T13:37:50.514 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 13:37:50 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a[44815]: t=2024-03-30T13:37:50+0000 lvl=info msg="Executing migration" logger=migrator id="Add column plugin_version to plugin_settings" 2024-03-30T13:37:50.514 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 13:37:50 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a[44815]: t=2024-03-30T13:37:50+0000 lvl=info msg="Executing migration" logger=migrator id="Update plugin_setting table charset" 2024-03-30T13:37:50.514 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 13:37:50 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a[44815]: t=2024-03-30T13:37:50+0000 lvl=info msg="Executing migration" logger=migrator id="create session table" 2024-03-30T13:37:50.514 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 13:37:50 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a[44815]: t=2024-03-30T13:37:50+0000 lvl=info msg="Executing migration" logger=migrator id="Drop old table playlist table" 2024-03-30T13:37:50.514 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 13:37:50 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a[44815]: t=2024-03-30T13:37:50+0000 lvl=info msg="Executing migration" logger=migrator id="Drop old table playlist_item table" 2024-03-30T13:37:50.514 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 13:37:50 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a[44815]: t=2024-03-30T13:37:50+0000 lvl=info msg="Executing migration" logger=migrator id="create playlist table v2" 2024-03-30T13:37:50.514 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 13:37:50 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a[44815]: t=2024-03-30T13:37:50+0000 lvl=info msg="Executing migration" logger=migrator id="create playlist item table v2" 2024-03-30T13:37:50.515 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 13:37:50 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a[44815]: t=2024-03-30T13:37:50+0000 lvl=info msg="Executing migration" logger=migrator id="Update playlist table charset" 2024-03-30T13:37:50.515 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 13:37:50 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a[44815]: t=2024-03-30T13:37:50+0000 lvl=info msg="Executing migration" logger=migrator id="Update playlist_item table charset" 2024-03-30T13:37:50.515 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 13:37:50 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a[44815]: t=2024-03-30T13:37:50+0000 lvl=info msg="Executing migration" logger=migrator id="drop preferences table v2" 2024-03-30T13:37:50.515 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 13:37:50 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a[44815]: t=2024-03-30T13:37:50+0000 lvl=info msg="Executing migration" logger=migrator id="drop preferences table v3" 2024-03-30T13:37:50.515 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 13:37:50 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a[44815]: t=2024-03-30T13:37:50+0000 lvl=info msg="Executing migration" logger=migrator id="create preferences table v3" 2024-03-30T13:37:50.515 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 13:37:50 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a[44815]: t=2024-03-30T13:37:50+0000 lvl=info msg="Executing migration" logger=migrator id="Update preferences table charset" 2024-03-30T13:37:50.515 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 13:37:50 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a[44815]: t=2024-03-30T13:37:50+0000 lvl=info msg="Executing migration" logger=migrator id="Add column team_id in preferences" 2024-03-30T13:37:50.515 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 13:37:50 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a[44815]: t=2024-03-30T13:37:50+0000 lvl=info msg="Executing migration" logger=migrator id="Update team_id column values in preferences" 2024-03-30T13:37:50.515 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 13:37:50 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a[44815]: t=2024-03-30T13:37:50+0000 lvl=info msg="Executing migration" logger=migrator id="Add column week_start in preferences" 2024-03-30T13:37:50.515 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 13:37:50 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a[44815]: t=2024-03-30T13:37:50+0000 lvl=info msg="Executing migration" logger=migrator id="create alert table v1" 2024-03-30T13:37:50.515 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 13:37:50 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a[44815]: t=2024-03-30T13:37:50+0000 lvl=info msg="Executing migration" logger=migrator id="add index alert org_id & id " 2024-03-30T13:37:50.515 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 13:37:50 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a[44815]: t=2024-03-30T13:37:50+0000 lvl=info msg="Executing migration" logger=migrator id="add index alert state" 2024-03-30T13:37:50.515 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 13:37:50 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a[44815]: t=2024-03-30T13:37:50+0000 lvl=info msg="Executing migration" logger=migrator id="add index alert dashboard_id" 2024-03-30T13:37:50.516 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 13:37:50 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a[44815]: t=2024-03-30T13:37:50+0000 lvl=info msg="Executing migration" logger=migrator id="Create alert_rule_tag table v1" 2024-03-30T13:37:50.516 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 13:37:50 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a[44815]: t=2024-03-30T13:37:50+0000 lvl=info msg="Executing migration" logger=migrator id="Add unique index alert_rule_tag.alert_id_tag_id" 2024-03-30T13:37:50.516 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 13:37:50 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a[44815]: t=2024-03-30T13:37:50+0000 lvl=info msg="Executing migration" logger=migrator id="drop index UQE_alert_rule_tag_alert_id_tag_id - v1" 2024-03-30T13:37:50.516 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 13:37:50 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a[44815]: t=2024-03-30T13:37:50+0000 lvl=info msg="Executing migration" logger=migrator id="Rename table alert_rule_tag to alert_rule_tag_v1 - v1" 2024-03-30T13:37:50.516 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 13:37:50 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a[44815]: t=2024-03-30T13:37:50+0000 lvl=info msg="Executing migration" logger=migrator id="Create alert_rule_tag table v2" 2024-03-30T13:37:50.516 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 13:37:50 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a[44815]: t=2024-03-30T13:37:50+0000 lvl=info msg="Executing migration" logger=migrator id="create index UQE_alert_rule_tag_alert_id_tag_id - Add unique index alert_rule_tag.alert_id_tag_id V2" 2024-03-30T13:37:50.516 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 13:37:50 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a[44815]: t=2024-03-30T13:37:50+0000 lvl=info msg="Executing migration" logger=migrator id="copy alert_rule_tag v1 to v2" 2024-03-30T13:37:50.516 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 13:37:50 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a[44815]: t=2024-03-30T13:37:50+0000 lvl=info msg="Executing migration" logger=migrator id="drop table alert_rule_tag_v1" 2024-03-30T13:37:50.516 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 13:37:50 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a[44815]: t=2024-03-30T13:37:50+0000 lvl=info msg="Executing migration" logger=migrator id="create alert_notification table v1" 2024-03-30T13:37:50.516 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 13:37:50 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a[44815]: t=2024-03-30T13:37:50+0000 lvl=info msg="Executing migration" logger=migrator id="Add column is_default" 2024-03-30T13:37:50.516 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 13:37:50 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a[44815]: t=2024-03-30T13:37:50+0000 lvl=info msg="Executing migration" logger=migrator id="Add column frequency" 2024-03-30T13:37:50.516 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 13:37:50 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a[44815]: t=2024-03-30T13:37:50+0000 lvl=info msg="Executing migration" logger=migrator id="Add column send_reminder" 2024-03-30T13:37:50.516 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 13:37:50 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a[44815]: t=2024-03-30T13:37:50+0000 lvl=info msg="Executing migration" logger=migrator id="Add column disable_resolve_message" 2024-03-30T13:37:50.516 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 13:37:50 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a[44815]: t=2024-03-30T13:37:50+0000 lvl=info msg="Executing migration" logger=migrator id="add index alert_notification org_id & name" 2024-03-30T13:37:50.517 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 13:37:50 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a[44815]: t=2024-03-30T13:37:50+0000 lvl=info msg="Executing migration" logger=migrator id="Update alert table charset" 2024-03-30T13:37:50.517 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 13:37:50 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a[44815]: t=2024-03-30T13:37:50+0000 lvl=info msg="Executing migration" logger=migrator id="Update alert_notification table charset" 2024-03-30T13:37:50.517 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 13:37:50 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a[44815]: t=2024-03-30T13:37:50+0000 lvl=info msg="Executing migration" logger=migrator id="create notification_journal table v1" 2024-03-30T13:37:50.517 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 13:37:50 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a[44815]: t=2024-03-30T13:37:50+0000 lvl=info msg="Executing migration" logger=migrator id="add index notification_journal org_id & alert_id & notifier_id" 2024-03-30T13:37:50.517 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 13:37:50 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a[44815]: t=2024-03-30T13:37:50+0000 lvl=info msg="Executing migration" logger=migrator id="drop alert_notification_journal" 2024-03-30T13:37:50.517 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 13:37:50 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a[44815]: t=2024-03-30T13:37:50+0000 lvl=info msg="Executing migration" logger=migrator id="create alert_notification_state table v1" 2024-03-30T13:37:50.517 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 13:37:50 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a[44815]: t=2024-03-30T13:37:50+0000 lvl=info msg="Executing migration" logger=migrator id="add index alert_notification_state org_id & alert_id & notifier_id" 2024-03-30T13:37:50.517 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 13:37:50 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a[44815]: t=2024-03-30T13:37:50+0000 lvl=info msg="Executing migration" logger=migrator id="Add for to alert table" 2024-03-30T13:37:50.517 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 13:37:50 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a[44815]: t=2024-03-30T13:37:50+0000 lvl=info msg="Executing migration" logger=migrator id="Add column uid in alert_notification" 2024-03-30T13:37:50.517 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 13:37:50 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a[44815]: t=2024-03-30T13:37:50+0000 lvl=info msg="Executing migration" logger=migrator id="Update uid column values in alert_notification" 2024-03-30T13:37:50.517 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 13:37:50 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a[44815]: t=2024-03-30T13:37:50+0000 lvl=info msg="Executing migration" logger=migrator id="Add unique index alert_notification_org_id_uid" 2024-03-30T13:37:50.517 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 13:37:50 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a[44815]: t=2024-03-30T13:37:50+0000 lvl=info msg="Executing migration" logger=migrator id="Remove unique index org_id_name" 2024-03-30T13:37:50.517 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 13:37:50 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a[44815]: t=2024-03-30T13:37:50+0000 lvl=info msg="Executing migration" logger=migrator id="Add column secure_settings in alert_notification" 2024-03-30T13:37:50.517 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 13:37:50 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a[44815]: t=2024-03-30T13:37:50+0000 lvl=info msg="Executing migration" logger=migrator id="alter alert.settings to mediumtext" 2024-03-30T13:37:50.517 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 13:37:50 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a[44815]: t=2024-03-30T13:37:50+0000 lvl=info msg="Executing migration" logger=migrator id="Add non-unique index alert_notification_state_alert_id" 2024-03-30T13:37:50.518 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 13:37:50 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a[44815]: t=2024-03-30T13:37:50+0000 lvl=info msg="Executing migration" logger=migrator id="Add non-unique index alert_rule_tag_alert_id" 2024-03-30T13:37:50.518 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 13:37:50 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a[44815]: t=2024-03-30T13:37:50+0000 lvl=info msg="Executing migration" logger=migrator id="Drop old annotation table v4" 2024-03-30T13:37:50.518 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 13:37:50 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a[44815]: t=2024-03-30T13:37:50+0000 lvl=info msg="Executing migration" logger=migrator id="create annotation table v5" 2024-03-30T13:37:50.518 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 13:37:50 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a[44815]: t=2024-03-30T13:37:50+0000 lvl=info msg="Executing migration" logger=migrator id="add index annotation 0 v3" 2024-03-30T13:37:50.518 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 13:37:50 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a[44815]: t=2024-03-30T13:37:50+0000 lvl=info msg="Executing migration" logger=migrator id="add index annotation 1 v3" 2024-03-30T13:37:50.518 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 13:37:50 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a[44815]: t=2024-03-30T13:37:50+0000 lvl=info msg="Executing migration" logger=migrator id="add index annotation 2 v3" 2024-03-30T13:37:50.518 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 13:37:50 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a[44815]: t=2024-03-30T13:37:50+0000 lvl=info msg="Executing migration" logger=migrator id="add index annotation 3 v3" 2024-03-30T13:37:50.518 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 13:37:50 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a[44815]: t=2024-03-30T13:37:50+0000 lvl=info msg="Executing migration" logger=migrator id="add index annotation 4 v3" 2024-03-30T13:37:50.518 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 13:37:50 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a[44815]: t=2024-03-30T13:37:50+0000 lvl=info msg="Executing migration" logger=migrator id="Update annotation table charset" 2024-03-30T13:37:50.518 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 13:37:50 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a[44815]: t=2024-03-30T13:37:50+0000 lvl=info msg="Executing migration" logger=migrator id="Add column region_id to annotation table" 2024-03-30T13:37:50.518 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 13:37:50 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a[44815]: t=2024-03-30T13:37:50+0000 lvl=info msg="Executing migration" logger=migrator id="Drop category_id index" 2024-03-30T13:37:50.518 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 13:37:50 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a[44815]: t=2024-03-30T13:37:50+0000 lvl=info msg="Executing migration" logger=migrator id="Add column tags to annotation table" 2024-03-30T13:37:50.518 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 13:37:50 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a[44815]: t=2024-03-30T13:37:50+0000 lvl=info msg="Executing migration" logger=migrator id="Create annotation_tag table v2" 2024-03-30T13:37:50.518 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 13:37:50 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a[44815]: t=2024-03-30T13:37:50+0000 lvl=info msg="Executing migration" logger=migrator id="Add unique index annotation_tag.annotation_id_tag_id" 2024-03-30T13:37:50.518 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 13:37:50 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a[44815]: t=2024-03-30T13:37:50+0000 lvl=info msg="Executing migration" logger=migrator id="drop index UQE_annotation_tag_annotation_id_tag_id - v2" 2024-03-30T13:37:50.519 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 13:37:50 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a[44815]: t=2024-03-30T13:37:50+0000 lvl=info msg="Executing migration" logger=migrator id="Rename table annotation_tag to annotation_tag_v2 - v2" 2024-03-30T13:37:50.519 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 13:37:50 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a[44815]: t=2024-03-30T13:37:50+0000 lvl=info msg="Executing migration" logger=migrator id="Create annotation_tag table v3" 2024-03-30T13:37:50.519 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 13:37:50 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a[44815]: t=2024-03-30T13:37:50+0000 lvl=info msg="Executing migration" logger=migrator id="create index UQE_annotation_tag_annotation_id_tag_id - Add unique index annotation_tag.annotation_id_tag_id V3" 2024-03-30T13:37:50.519 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 13:37:50 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a[44815]: t=2024-03-30T13:37:50+0000 lvl=info msg="Executing migration" logger=migrator id="copy annotation_tag v2 to v3" 2024-03-30T13:37:50.519 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 13:37:50 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a[44815]: t=2024-03-30T13:37:50+0000 lvl=info msg="Executing migration" logger=migrator id="drop table annotation_tag_v2" 2024-03-30T13:37:50.519 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 13:37:50 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a[44815]: t=2024-03-30T13:37:50+0000 lvl=info msg="Executing migration" logger=migrator id="Update alert annotations and set TEXT to empty" 2024-03-30T13:37:50.519 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 13:37:50 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a[44815]: t=2024-03-30T13:37:50+0000 lvl=info msg="Executing migration" logger=migrator id="Add created time to annotation table" 2024-03-30T13:37:50.519 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 13:37:50 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a[44815]: t=2024-03-30T13:37:50+0000 lvl=info msg="Executing migration" logger=migrator id="Add updated time to annotation table" 2024-03-30T13:37:50.519 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 13:37:50 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a[44815]: t=2024-03-30T13:37:50+0000 lvl=info msg="Executing migration" logger=migrator id="Add index for created in annotation table" 2024-03-30T13:37:50.756 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:37:50 smithi181 ceph-mon[25762]: pgmap v66: 129 pgs: 64 unknown, 32 creating+peering, 33 active+clean; 579 KiB data, 49 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:37:50.756 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:37:50 smithi181 ceph-mon[25762]: from='mgr.14439 ' entity='mgr.y' 2024-03-30T13:37:50.756 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:37:50 smithi181 ceph-mon[25762]: from='client.? 172.21.15.99:0/3557053015' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "z.rgw.meta","app": "rgw"}]': finished 2024-03-30T13:37:50.756 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:37:50 smithi181 ceph-mon[25762]: osdmap e69: 8 total, 8 up, 8 in 2024-03-30T13:37:50.756 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:37:50 smithi181 ceph-mon[25762]: from='client.? 172.21.15.99:0/3557053015' entity='client.admin' cmd=[{"prefix": "osd pool set", "pool": "z.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]: dispatch 2024-03-30T13:37:50.756 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:37:50 smithi181 ceph-mon[25762]: from='mgr.14439 ' entity='mgr.y' 2024-03-30T13:37:50.756 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:37:50 smithi181 ceph-mon[25762]: from='mgr.14439 172.21.15.99:0/1757456350' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:37:50.756 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:37:50 smithi181 ceph-mon[25762]: from='mgr.14439 172.21.15.99:0/1757456350' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:37:50.757 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:37:50 smithi181 ceph-mon[25762]: from='mgr.14439 ' entity='mgr.y' 2024-03-30T13:37:50.757 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 13:37:50 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a[44815]: t=2024-03-30T13:37:50+0000 lvl=info msg="Executing migration" logger=migrator id="Add index for updated in annotation table" 2024-03-30T13:37:50.758 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 13:37:50 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a[44815]: t=2024-03-30T13:37:50+0000 lvl=info msg="Executing migration" logger=migrator id="Convert existing annotations from seconds to milliseconds" 2024-03-30T13:37:50.758 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 13:37:50 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a[44815]: t=2024-03-30T13:37:50+0000 lvl=info msg="Executing migration" logger=migrator id="Add epoch_end column" 2024-03-30T13:37:50.758 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 13:37:50 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a[44815]: t=2024-03-30T13:37:50+0000 lvl=info msg="Executing migration" logger=migrator id="Add index for epoch_end" 2024-03-30T13:37:50.758 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 13:37:50 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a[44815]: t=2024-03-30T13:37:50+0000 lvl=info msg="Executing migration" logger=migrator id="Make epoch_end the same as epoch" 2024-03-30T13:37:50.758 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 13:37:50 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a[44815]: t=2024-03-30T13:37:50+0000 lvl=info msg="Executing migration" logger=migrator id="Move region to single row" 2024-03-30T13:37:50.758 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 13:37:50 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a[44815]: t=2024-03-30T13:37:50+0000 lvl=info msg="Executing migration" logger=migrator id="Remove index org_id_epoch from annotation table" 2024-03-30T13:37:50.758 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 13:37:50 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a[44815]: t=2024-03-30T13:37:50+0000 lvl=info msg="Executing migration" logger=migrator id="Remove index org_id_dashboard_id_panel_id_epoch from annotation table" 2024-03-30T13:37:50.758 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 13:37:50 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a[44815]: t=2024-03-30T13:37:50+0000 lvl=info msg="Executing migration" logger=migrator id="Add index for org_id_dashboard_id_epoch_end_epoch on annotation table" 2024-03-30T13:37:50.758 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 13:37:50 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a[44815]: t=2024-03-30T13:37:50+0000 lvl=info msg="Executing migration" logger=migrator id="Add index for org_id_epoch_end_epoch on annotation table" 2024-03-30T13:37:50.758 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 13:37:50 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a[44815]: t=2024-03-30T13:37:50+0000 lvl=info msg="Executing migration" logger=migrator id="Remove index org_id_epoch_epoch_end from annotation table" 2024-03-30T13:37:50.758 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 13:37:50 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a[44815]: t=2024-03-30T13:37:50+0000 lvl=info msg="Executing migration" logger=migrator id="Add index for alert_id on annotation table" 2024-03-30T13:37:50.758 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 13:37:50 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a[44815]: t=2024-03-30T13:37:50+0000 lvl=info msg="Executing migration" logger=migrator id="create test_data table" 2024-03-30T13:37:50.758 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 13:37:50 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a[44815]: t=2024-03-30T13:37:50+0000 lvl=info msg="Executing migration" logger=migrator id="create dashboard_version table v1" 2024-03-30T13:37:50.759 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 13:37:50 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a[44815]: t=2024-03-30T13:37:50+0000 lvl=info msg="Executing migration" logger=migrator id="add index dashboard_version.dashboard_id" 2024-03-30T13:37:50.759 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 13:37:50 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a[44815]: t=2024-03-30T13:37:50+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index dashboard_version.dashboard_id and dashboard_version.version" 2024-03-30T13:37:50.759 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 13:37:50 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a[44815]: t=2024-03-30T13:37:50+0000 lvl=info msg="Executing migration" logger=migrator id="Set dashboard version to 1 where 0" 2024-03-30T13:37:50.759 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 13:37:50 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a[44815]: t=2024-03-30T13:37:50+0000 lvl=info msg="Executing migration" logger=migrator id="save existing dashboard data in dashboard_version table v1" 2024-03-30T13:37:50.759 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 13:37:50 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a[44815]: t=2024-03-30T13:37:50+0000 lvl=info msg="Executing migration" logger=migrator id="alter dashboard_version.data to mediumtext v1" 2024-03-30T13:37:50.759 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 13:37:50 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a[44815]: t=2024-03-30T13:37:50+0000 lvl=info msg="Executing migration" logger=migrator id="create team table" 2024-03-30T13:37:50.759 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 13:37:50 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a[44815]: t=2024-03-30T13:37:50+0000 lvl=info msg="Executing migration" logger=migrator id="add index team.org_id" 2024-03-30T13:37:50.759 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 13:37:50 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a[44815]: t=2024-03-30T13:37:50+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index team_org_id_name" 2024-03-30T13:37:50.759 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 13:37:50 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a[44815]: t=2024-03-30T13:37:50+0000 lvl=info msg="Executing migration" logger=migrator id="create team member table" 2024-03-30T13:37:50.759 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 13:37:50 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a[44815]: t=2024-03-30T13:37:50+0000 lvl=info msg="Executing migration" logger=migrator id="add index team_member.org_id" 2024-03-30T13:37:50.759 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 13:37:50 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a[44815]: t=2024-03-30T13:37:50+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index team_member_org_id_team_id_user_id" 2024-03-30T13:37:50.759 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 13:37:50 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a[44815]: t=2024-03-30T13:37:50+0000 lvl=info msg="Executing migration" logger=migrator id="add index team_member.team_id" 2024-03-30T13:37:50.759 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 13:37:50 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a[44815]: t=2024-03-30T13:37:50+0000 lvl=info msg="Executing migration" logger=migrator id="Add column email to team table" 2024-03-30T13:37:50.759 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 13:37:50 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a[44815]: t=2024-03-30T13:37:50+0000 lvl=info msg="Executing migration" logger=migrator id="Add column external to team_member table" 2024-03-30T13:37:50.760 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 13:37:50 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a[44815]: t=2024-03-30T13:37:50+0000 lvl=info msg="Executing migration" logger=migrator id="Add column permission to team_member table" 2024-03-30T13:37:50.760 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 13:37:50 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a[44815]: t=2024-03-30T13:37:50+0000 lvl=info msg="Executing migration" logger=migrator id="create dashboard acl table" 2024-03-30T13:37:50.760 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 13:37:50 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a[44815]: t=2024-03-30T13:37:50+0000 lvl=info msg="Executing migration" logger=migrator id="add index dashboard_acl_dashboard_id" 2024-03-30T13:37:50.760 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 13:37:50 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a[44815]: t=2024-03-30T13:37:50+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index dashboard_acl_dashboard_id_user_id" 2024-03-30T13:37:50.760 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 13:37:50 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a[44815]: t=2024-03-30T13:37:50+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index dashboard_acl_dashboard_id_team_id" 2024-03-30T13:37:50.760 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 13:37:50 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a[44815]: t=2024-03-30T13:37:50+0000 lvl=info msg="Executing migration" logger=migrator id="add index dashboard_acl_user_id" 2024-03-30T13:37:50.760 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 13:37:50 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a[44815]: t=2024-03-30T13:37:50+0000 lvl=info msg="Executing migration" logger=migrator id="add index dashboard_acl_team_id" 2024-03-30T13:37:50.760 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 13:37:50 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a[44815]: t=2024-03-30T13:37:50+0000 lvl=info msg="Executing migration" logger=migrator id="add index dashboard_acl_org_id_role" 2024-03-30T13:37:50.760 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 13:37:50 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a[44815]: t=2024-03-30T13:37:50+0000 lvl=info msg="Executing migration" logger=migrator id="add index dashboard_permission" 2024-03-30T13:37:50.760 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 13:37:50 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a[44815]: t=2024-03-30T13:37:50+0000 lvl=info msg="Executing migration" logger=migrator id="save default acl rules in dashboard_acl table" 2024-03-30T13:37:50.760 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 13:37:50 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a[44815]: t=2024-03-30T13:37:50+0000 lvl=info msg="Executing migration" logger=migrator id="delete acl rules for deleted dashboards and folders" 2024-03-30T13:37:50.760 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 13:37:50 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a[44815]: t=2024-03-30T13:37:50+0000 lvl=info msg="Executing migration" logger=migrator id="create tag table" 2024-03-30T13:37:50.760 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 13:37:50 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a[44815]: t=2024-03-30T13:37:50+0000 lvl=info msg="Executing migration" logger=migrator id="add index tag.key_value" 2024-03-30T13:37:50.760 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 13:37:50 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a[44815]: t=2024-03-30T13:37:50+0000 lvl=info msg="Executing migration" logger=migrator id="create login attempt table" 2024-03-30T13:37:50.761 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 13:37:50 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a[44815]: t=2024-03-30T13:37:50+0000 lvl=info msg="Executing migration" logger=migrator id="add index login_attempt.username" 2024-03-30T13:37:50.761 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 13:37:50 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a[44815]: t=2024-03-30T13:37:50+0000 lvl=info msg="Executing migration" logger=migrator id="drop index IDX_login_attempt_username - v1" 2024-03-30T13:37:50.761 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 13:37:50 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a[44815]: t=2024-03-30T13:37:50+0000 lvl=info msg="Executing migration" logger=migrator id="Rename table login_attempt to login_attempt_tmp_qwerty - v1" 2024-03-30T13:37:50.761 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 13:37:50 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a[44815]: t=2024-03-30T13:37:50+0000 lvl=info msg="Executing migration" logger=migrator id="create login_attempt v2" 2024-03-30T13:37:50.761 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 13:37:50 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a[44815]: t=2024-03-30T13:37:50+0000 lvl=info msg="Executing migration" logger=migrator id="create index IDX_login_attempt_username - v2" 2024-03-30T13:37:50.761 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 13:37:50 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a[44815]: t=2024-03-30T13:37:50+0000 lvl=info msg="Executing migration" logger=migrator id="copy login_attempt v1 to v2" 2024-03-30T13:37:50.761 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 13:37:50 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a[44815]: t=2024-03-30T13:37:50+0000 lvl=info msg="Executing migration" logger=migrator id="drop login_attempt_tmp_qwerty" 2024-03-30T13:37:50.761 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 13:37:50 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a[44815]: t=2024-03-30T13:37:50+0000 lvl=info msg="Executing migration" logger=migrator id="create user auth table" 2024-03-30T13:37:50.761 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 13:37:50 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a[44815]: t=2024-03-30T13:37:50+0000 lvl=info msg="Executing migration" logger=migrator id="create index IDX_user_auth_auth_module_auth_id - v1" 2024-03-30T13:37:50.761 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 13:37:50 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a[44815]: t=2024-03-30T13:37:50+0000 lvl=info msg="Executing migration" logger=migrator id="alter user_auth.auth_id to length 190" 2024-03-30T13:37:50.761 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 13:37:50 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a[44815]: t=2024-03-30T13:37:50+0000 lvl=info msg="Executing migration" logger=migrator id="Add OAuth access token to user_auth" 2024-03-30T13:37:50.761 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 13:37:50 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a[44815]: t=2024-03-30T13:37:50+0000 lvl=info msg="Executing migration" logger=migrator id="Add OAuth refresh token to user_auth" 2024-03-30T13:37:50.761 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 13:37:50 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a[44815]: t=2024-03-30T13:37:50+0000 lvl=info msg="Executing migration" logger=migrator id="Add OAuth token type to user_auth" 2024-03-30T13:37:50.761 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 13:37:50 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a[44815]: t=2024-03-30T13:37:50+0000 lvl=info msg="Executing migration" logger=migrator id="Add OAuth expiry to user_auth" 2024-03-30T13:37:50.762 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 13:37:50 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a[44815]: t=2024-03-30T13:37:50+0000 lvl=info msg="Executing migration" logger=migrator id="Add index to user_id column in user_auth" 2024-03-30T13:37:50.762 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 13:37:50 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a[44815]: t=2024-03-30T13:37:50+0000 lvl=info msg="Executing migration" logger=migrator id="create server_lock table" 2024-03-30T13:37:50.762 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 13:37:50 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a[44815]: t=2024-03-30T13:37:50+0000 lvl=info msg="Executing migration" logger=migrator id="add index server_lock.operation_uid" 2024-03-30T13:37:50.762 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 13:37:50 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a[44815]: t=2024-03-30T13:37:50+0000 lvl=info msg="Executing migration" logger=migrator id="create user auth token table" 2024-03-30T13:37:50.762 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 13:37:50 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a[44815]: t=2024-03-30T13:37:50+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index user_auth_token.auth_token" 2024-03-30T13:37:50.762 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 13:37:50 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a[44815]: t=2024-03-30T13:37:50+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index user_auth_token.prev_auth_token" 2024-03-30T13:37:50.762 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 13:37:50 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a[44815]: t=2024-03-30T13:37:50+0000 lvl=info msg="Executing migration" logger=migrator id="add index user_auth_token.user_id" 2024-03-30T13:37:50.762 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 13:37:50 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a[44815]: t=2024-03-30T13:37:50+0000 lvl=info msg="Executing migration" logger=migrator id="Add revoked_at to the user auth token" 2024-03-30T13:37:50.762 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 13:37:50 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a[44815]: t=2024-03-30T13:37:50+0000 lvl=info msg="Executing migration" logger=migrator id="create cache_data table" 2024-03-30T13:37:50.762 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 13:37:50 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a[44815]: t=2024-03-30T13:37:50+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index cache_data.cache_key" 2024-03-30T13:37:50.762 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 13:37:50 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a[44815]: t=2024-03-30T13:37:50+0000 lvl=info msg="Executing migration" logger=migrator id="create short_url table v1" 2024-03-30T13:37:50.762 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 13:37:50 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a[44815]: t=2024-03-30T13:37:50+0000 lvl=info msg="Executing migration" logger=migrator id="add index short_url.org_id-uid" 2024-03-30T13:37:50.762 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 13:37:50 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a[44815]: t=2024-03-30T13:37:50+0000 lvl=info msg="Executing migration" logger=migrator id="delete alert_definition table" 2024-03-30T13:37:50.762 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 13:37:50 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a[44815]: t=2024-03-30T13:37:50+0000 lvl=info msg="Executing migration" logger=migrator id="recreate alert_definition table" 2024-03-30T13:37:50.763 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 13:37:50 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a[44815]: t=2024-03-30T13:37:50+0000 lvl=info msg="Executing migration" logger=migrator id="add index in alert_definition on org_id and title columns" 2024-03-30T13:37:50.763 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 13:37:50 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a[44815]: t=2024-03-30T13:37:50+0000 lvl=info msg="Executing migration" logger=migrator id="add index in alert_definition on org_id and uid columns" 2024-03-30T13:37:50.763 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 13:37:50 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a[44815]: t=2024-03-30T13:37:50+0000 lvl=info msg="Executing migration" logger=migrator id="alter alert_definition table data column to mediumtext in mysql" 2024-03-30T13:37:50.763 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 13:37:50 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a[44815]: t=2024-03-30T13:37:50+0000 lvl=info msg="Executing migration" logger=migrator id="drop index in alert_definition on org_id and title columns" 2024-03-30T13:37:50.763 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 13:37:50 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a[44815]: t=2024-03-30T13:37:50+0000 lvl=info msg="Executing migration" logger=migrator id="drop index in alert_definition on org_id and uid columns" 2024-03-30T13:37:50.763 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 13:37:50 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a[44815]: t=2024-03-30T13:37:50+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index in alert_definition on org_id and title columns" 2024-03-30T13:37:50.763 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 13:37:50 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a[44815]: t=2024-03-30T13:37:50+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index in alert_definition on org_id and uid columns" 2024-03-30T13:37:50.763 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 13:37:50 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a[44815]: t=2024-03-30T13:37:50+0000 lvl=info msg="Executing migration" logger=migrator id="Add column paused in alert_definition" 2024-03-30T13:37:50.763 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 13:37:50 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a[44815]: t=2024-03-30T13:37:50+0000 lvl=info msg="Executing migration" logger=migrator id="drop alert_definition table" 2024-03-30T13:37:50.763 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 13:37:50 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a[44815]: t=2024-03-30T13:37:50+0000 lvl=info msg="Executing migration" logger=migrator id="delete alert_definition_version table" 2024-03-30T13:37:50.763 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 13:37:50 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a[44815]: t=2024-03-30T13:37:50+0000 lvl=info msg="Executing migration" logger=migrator id="recreate alert_definition_version table" 2024-03-30T13:37:50.763 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 13:37:50 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a[44815]: t=2024-03-30T13:37:50+0000 lvl=info msg="Executing migration" logger=migrator id="add index in alert_definition_version table on alert_definition_id and version columns" 2024-03-30T13:37:50.763 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 13:37:50 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a[44815]: t=2024-03-30T13:37:50+0000 lvl=info msg="Executing migration" logger=migrator id="add index in alert_definition_version table on alert_definition_uid and version columns" 2024-03-30T13:37:50.763 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 13:37:50 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a[44815]: t=2024-03-30T13:37:50+0000 lvl=info msg="Executing migration" logger=migrator id="alter alert_definition_version table data column to mediumtext in mysql" 2024-03-30T13:37:50.764 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 13:37:50 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a[44815]: t=2024-03-30T13:37:50+0000 lvl=info msg="Executing migration" logger=migrator id="drop alert_definition_version table" 2024-03-30T13:37:50.764 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 13:37:50 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a[44815]: t=2024-03-30T13:37:50+0000 lvl=info msg="Executing migration" logger=migrator id="create alert_instance table" 2024-03-30T13:37:50.764 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 13:37:50 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a[44815]: t=2024-03-30T13:37:50+0000 lvl=info msg="Executing migration" logger=migrator id="add index in alert_instance table on def_org_id, def_uid and current_state columns" 2024-03-30T13:37:50.764 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 13:37:50 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a[44815]: t=2024-03-30T13:37:50+0000 lvl=info msg="Executing migration" logger=migrator id="add index in alert_instance table on def_org_id, current_state columns" 2024-03-30T13:37:50.764 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 13:37:50 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a[44815]: t=2024-03-30T13:37:50+0000 lvl=info msg="Executing migration" logger=migrator id="add column current_state_end to alert_instance" 2024-03-30T13:37:50.764 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 13:37:50 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a[44815]: t=2024-03-30T13:37:50+0000 lvl=info msg="Executing migration" logger=migrator id="remove index def_org_id, def_uid, current_state on alert_instance" 2024-03-30T13:37:50.764 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 13:37:50 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a[44815]: t=2024-03-30T13:37:50+0000 lvl=info msg="Executing migration" logger=migrator id="remove index def_org_id, current_state on alert_instance" 2024-03-30T13:37:50.764 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 13:37:50 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a[44815]: t=2024-03-30T13:37:50+0000 lvl=info msg="Executing migration" logger=migrator id="rename def_org_id to rule_org_id in alert_instance" 2024-03-30T13:37:50.764 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 13:37:50 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a[44815]: t=2024-03-30T13:37:50+0000 lvl=info msg="Executing migration" logger=migrator id="rename def_uid to rule_uid in alert_instance" 2024-03-30T13:37:50.764 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 13:37:50 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a[44815]: t=2024-03-30T13:37:50+0000 lvl=info msg="Executing migration" logger=migrator id="add index rule_org_id, rule_uid, current_state on alert_instance" 2024-03-30T13:37:50.764 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 13:37:50 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a[44815]: t=2024-03-30T13:37:50+0000 lvl=info msg="Executing migration" logger=migrator id="add index rule_org_id, current_state on alert_instance" 2024-03-30T13:37:50.764 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 13:37:50 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a[44815]: t=2024-03-30T13:37:50+0000 lvl=info msg="Executing migration" logger=migrator id="create alert_rule table" 2024-03-30T13:37:50.764 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 13:37:50 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a[44815]: t=2024-03-30T13:37:50+0000 lvl=info msg="Executing migration" logger=migrator id="add index in alert_rule on org_id and title columns" 2024-03-30T13:37:50.764 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 13:37:50 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a[44815]: t=2024-03-30T13:37:50+0000 lvl=info msg="Executing migration" logger=migrator id="add index in alert_rule on org_id and uid columns" 2024-03-30T13:37:50.764 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 13:37:50 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a[44815]: t=2024-03-30T13:37:50+0000 lvl=info msg="Executing migration" logger=migrator id="add index in alert_rule on org_id, namespace_uid, group_uid columns" 2024-03-30T13:37:50.765 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 13:37:50 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a[44815]: t=2024-03-30T13:37:50+0000 lvl=info msg="Executing migration" logger=migrator id="alter alert_rule table data column to mediumtext in mysql" 2024-03-30T13:37:50.765 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 13:37:50 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a[44815]: t=2024-03-30T13:37:50+0000 lvl=info msg="Executing migration" logger=migrator id="add column for to alert_rule" 2024-03-30T13:37:50.765 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 13:37:50 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a[44815]: t=2024-03-30T13:37:50+0000 lvl=info msg="Executing migration" logger=migrator id="add column annotations to alert_rule" 2024-03-30T13:37:50.765 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 13:37:50 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a[44815]: t=2024-03-30T13:37:50+0000 lvl=info msg="Executing migration" logger=migrator id="add column labels to alert_rule" 2024-03-30T13:37:50.765 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 13:37:50 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a[44815]: t=2024-03-30T13:37:50+0000 lvl=info msg="Executing migration" logger=migrator id="remove unique index from alert_rule on org_id, title columns" 2024-03-30T13:37:50.765 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 13:37:50 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a[44815]: t=2024-03-30T13:37:50+0000 lvl=info msg="Executing migration" logger=migrator id="add index in alert_rule on org_id, namespase_uid and title columns" 2024-03-30T13:37:50.765 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 13:37:50 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a[44815]: t=2024-03-30T13:37:50+0000 lvl=info msg="Executing migration" logger=migrator id="add dashboard_uid column to alert_rule" 2024-03-30T13:37:50.765 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 13:37:50 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a[44815]: t=2024-03-30T13:37:50+0000 lvl=info msg="Executing migration" logger=migrator id="add panel_id column to alert_rule" 2024-03-30T13:37:50.765 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 13:37:50 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a[44815]: t=2024-03-30T13:37:50+0000 lvl=info msg="Executing migration" logger=migrator id="add index in alert_rule on org_id, dashboard_uid and panel_id columns" 2024-03-30T13:37:50.765 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 13:37:50 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a[44815]: t=2024-03-30T13:37:50+0000 lvl=info msg="Executing migration" logger=migrator id="create alert_rule_version table" 2024-03-30T13:37:50.765 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 13:37:50 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a[44815]: t=2024-03-30T13:37:50+0000 lvl=info msg="Executing migration" logger=migrator id="add index in alert_rule_version table on rule_org_id, rule_uid and version columns" 2024-03-30T13:37:50.765 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 13:37:50 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a[44815]: t=2024-03-30T13:37:50+0000 lvl=info msg="Executing migration" logger=migrator id="add index in alert_rule_version table on rule_org_id, rule_namespace_uid and rule_group columns" 2024-03-30T13:37:50.765 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 13:37:50 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a[44815]: t=2024-03-30T13:37:50+0000 lvl=info msg="Executing migration" logger=migrator id="alter alert_rule_version table data column to mediumtext in mysql" 2024-03-30T13:37:50.765 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 13:37:50 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a[44815]: t=2024-03-30T13:37:50+0000 lvl=info msg="Executing migration" logger=migrator id="add column for to alert_rule_version" 2024-03-30T13:37:50.766 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 13:37:50 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a[44815]: t=2024-03-30T13:37:50+0000 lvl=info msg="Executing migration" logger=migrator id="add column annotations to alert_rule_version" 2024-03-30T13:37:50.766 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 13:37:50 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a[44815]: t=2024-03-30T13:37:50+0000 lvl=info msg="Executing migration" logger=migrator id="add column labels to alert_rule_version" 2024-03-30T13:37:50.766 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 13:37:50 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a[44815]: t=2024-03-30T13:37:50+0000 lvl=info msg="Executing migration" logger=migrator id=create_alert_configuration_table 2024-03-30T13:37:50.766 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 13:37:50 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a[44815]: t=2024-03-30T13:37:50+0000 lvl=info msg="Executing migration" logger=migrator id="Add column default in alert_configuration" 2024-03-30T13:37:50.766 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 13:37:50 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a[44815]: t=2024-03-30T13:37:50+0000 lvl=info msg="Executing migration" logger=migrator id="alert alert_configuration alertmanager_configuration column from TEXT to MEDIUMTEXT if mysql" 2024-03-30T13:37:50.767 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 13:37:50 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a[44815]: t=2024-03-30T13:37:50+0000 lvl=info msg="Executing migration" logger=migrator id="add column org_id in alert_configuration" 2024-03-30T13:37:50.767 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 13:37:50 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a[44815]: t=2024-03-30T13:37:50+0000 lvl=info msg="Executing migration" logger=migrator id="add index in alert_configuration table on org_id column" 2024-03-30T13:37:50.767 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 13:37:50 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a[44815]: t=2024-03-30T13:37:50+0000 lvl=info msg="Executing migration" logger=migrator id=create_ngalert_configuration_table 2024-03-30T13:37:50.767 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 13:37:50 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a[44815]: t=2024-03-30T13:37:50+0000 lvl=info msg="Executing migration" logger=migrator id="add index in ngalert_configuration on org_id column" 2024-03-30T13:37:50.767 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 13:37:50 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a[44815]: t=2024-03-30T13:37:50+0000 lvl=info msg="Executing migration" logger=migrator id="clear migration entry \"remove unified alerting data\"" 2024-03-30T13:37:50.767 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 13:37:50 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a[44815]: t=2024-03-30T13:37:50+0000 lvl=info msg="Executing migration" logger=migrator id="move dashboard alerts to unified alerting" 2024-03-30T13:37:50.767 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 13:37:50 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a[44815]: t=2024-03-30T13:37:50+0000 lvl=info msg="Executing migration" logger=migrator id="create library_element table v1" 2024-03-30T13:37:50.767 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 13:37:50 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a[44815]: t=2024-03-30T13:37:50+0000 lvl=info msg="Executing migration" logger=migrator id="add index library_element org_id-folder_id-name-kind" 2024-03-30T13:37:50.767 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 13:37:50 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a[44815]: t=2024-03-30T13:37:50+0000 lvl=info msg="Executing migration" logger=migrator id="create library_element_connection table v1" 2024-03-30T13:37:50.767 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 13:37:50 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a[44815]: t=2024-03-30T13:37:50+0000 lvl=info msg="Executing migration" logger=migrator id="add index library_element_connection element_id-kind-connection_id" 2024-03-30T13:37:50.767 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 13:37:50 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a[44815]: t=2024-03-30T13:37:50+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index library_element org_id_uid" 2024-03-30T13:37:50.767 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 13:37:50 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a[44815]: t=2024-03-30T13:37:50+0000 lvl=info msg="Executing migration" logger=migrator id="clone move dashboard alerts to unified alerting" 2024-03-30T13:37:50.767 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 13:37:50 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a[44815]: t=2024-03-30T13:37:50+0000 lvl=info msg="Executing migration" logger=migrator id="create data_keys table" 2024-03-30T13:37:50.767 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 13:37:50 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a[44815]: t=2024-03-30T13:37:50+0000 lvl=info msg="Executing migration" logger=migrator id="create kv_store table v1" 2024-03-30T13:37:50.767 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 13:37:50 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a[44815]: t=2024-03-30T13:37:50+0000 lvl=info msg="Executing migration" logger=migrator id="add index kv_store.org_id-namespace-key" 2024-03-30T13:37:50.768 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 13:37:50 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a[44815]: t=2024-03-30T13:37:50+0000 lvl=info msg="Executing migration" logger=migrator id="update dashboard_uid and panel_id from existing annotations" 2024-03-30T13:37:50.768 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 13:37:50 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a[44815]: t=2024-03-30T13:37:50+0000 lvl=info msg="Executing migration" logger=migrator id="create permission table" 2024-03-30T13:37:50.768 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 13:37:50 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a[44815]: t=2024-03-30T13:37:50+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index permission.role_id" 2024-03-30T13:37:50.768 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 13:37:50 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a[44815]: t=2024-03-30T13:37:50+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index role_id_action_scope" 2024-03-30T13:37:50.768 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 13:37:50 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a[44815]: t=2024-03-30T13:37:50+0000 lvl=info msg="Executing migration" logger=migrator id="create role table" 2024-03-30T13:37:50.768 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 13:37:50 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a[44815]: t=2024-03-30T13:37:50+0000 lvl=info msg="Executing migration" logger=migrator id="add column display_name" 2024-03-30T13:37:50.768 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 13:37:50 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a[44815]: t=2024-03-30T13:37:50+0000 lvl=info msg="Executing migration" logger=migrator id="add column group_name" 2024-03-30T13:37:50.768 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 13:37:50 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a[44815]: t=2024-03-30T13:37:50+0000 lvl=info msg="Executing migration" logger=migrator id="add index role.org_id" 2024-03-30T13:37:50.768 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 13:37:50 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a[44815]: t=2024-03-30T13:37:50+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index role_org_id_name" 2024-03-30T13:37:50.768 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 13:37:50 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a[44815]: t=2024-03-30T13:37:50+0000 lvl=info msg="Executing migration" logger=migrator id="add index role_org_id_uid" 2024-03-30T13:37:50.768 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 13:37:50 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a[44815]: t=2024-03-30T13:37:50+0000 lvl=info msg="Executing migration" logger=migrator id="create team role table" 2024-03-30T13:37:50.768 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 13:37:50 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a[44815]: t=2024-03-30T13:37:50+0000 lvl=info msg="Executing migration" logger=migrator id="add index team_role.org_id" 2024-03-30T13:37:50.768 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 13:37:50 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a[44815]: t=2024-03-30T13:37:50+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index team_role_org_id_team_id_role_id" 2024-03-30T13:37:50.768 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 13:37:50 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a[44815]: t=2024-03-30T13:37:50+0000 lvl=info msg="Executing migration" logger=migrator id="add index team_role.team_id" 2024-03-30T13:37:50.769 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 13:37:50 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a[44815]: t=2024-03-30T13:37:50+0000 lvl=info msg="Executing migration" logger=migrator id="create user role table" 2024-03-30T13:37:50.769 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 13:37:50 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a[44815]: t=2024-03-30T13:37:50+0000 lvl=info msg="Executing migration" logger=migrator id="add index user_role.org_id" 2024-03-30T13:37:50.769 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 13:37:50 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a[44815]: t=2024-03-30T13:37:50+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index user_role_org_id_user_id_role_id" 2024-03-30T13:37:50.769 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 13:37:50 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a[44815]: t=2024-03-30T13:37:50+0000 lvl=info msg="Executing migration" logger=migrator id="add index user_role.user_id" 2024-03-30T13:37:50.769 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 13:37:50 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a[44815]: t=2024-03-30T13:37:50+0000 lvl=info msg="Executing migration" logger=migrator id="create builtin role table" 2024-03-30T13:37:50.769 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 13:37:50 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a[44815]: t=2024-03-30T13:37:50+0000 lvl=info msg="Executing migration" logger=migrator id="add index builtin_role.role_id" 2024-03-30T13:37:50.769 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 13:37:50 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a[44815]: t=2024-03-30T13:37:50+0000 lvl=info msg="Executing migration" logger=migrator id="add index builtin_role.name" 2024-03-30T13:37:50.769 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 13:37:50 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a[44815]: t=2024-03-30T13:37:50+0000 lvl=info msg="Executing migration" logger=migrator id="Add column org_id to builtin_role table" 2024-03-30T13:37:50.769 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 13:37:50 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a[44815]: t=2024-03-30T13:37:50+0000 lvl=info msg="Executing migration" logger=migrator id="add index builtin_role.org_id" 2024-03-30T13:37:50.769 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 13:37:50 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a[44815]: t=2024-03-30T13:37:50+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index builtin_role_org_id_role_id_role" 2024-03-30T13:37:50.769 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 13:37:50 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a[44815]: t=2024-03-30T13:37:50+0000 lvl=info msg="Executing migration" logger=migrator id="Remove unique index role_org_id_uid" 2024-03-30T13:37:50.769 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 13:37:50 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a[44815]: t=2024-03-30T13:37:50+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index role.uid" 2024-03-30T13:37:50.769 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 13:37:50 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a[44815]: t=2024-03-30T13:37:50+0000 lvl=info msg="Executing migration" logger=migrator id="create seed assignment table" 2024-03-30T13:37:50.769 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 13:37:50 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a[44815]: t=2024-03-30T13:37:50+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index builtin_role_role_name" 2024-03-30T13:37:50.769 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 13:37:50 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a[44815]: t=2024-03-30T13:37:50+0000 lvl=info msg="migrations completed" logger=migrator performed=381 skipped=0 duration=476.833877ms 2024-03-30T13:37:50.770 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 13:37:50 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a[44815]: t=2024-03-30T13:37:50+0000 lvl=info msg="Created default organization" logger=sqlstore 2024-03-30T13:37:50.770 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 13:37:50 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a[44815]: t=2024-03-30T13:37:50+0000 lvl=info msg="Initialising plugins" logger=plugin.manager 2024-03-30T13:37:50.770 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 13:37:50 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a[44815]: t=2024-03-30T13:37:50+0000 lvl=info msg="Plugin registered" logger=plugin.manager pluginId=input 2024-03-30T13:37:50.770 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 13:37:50 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a[44815]: t=2024-03-30T13:37:50+0000 lvl=info msg="Plugin registered" logger=plugin.manager pluginId=grafana-piechart-panel 2024-03-30T13:37:50.770 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 13:37:50 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a[44815]: t=2024-03-30T13:37:50+0000 lvl=info msg="Plugin registered" logger=plugin.manager pluginId=vonage-status-panel 2024-03-30T13:37:50.770 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 13:37:50 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a[44815]: t=2024-03-30T13:37:50+0000 lvl=info msg="Live Push Gateway initialization" logger=live.push_http 2024-03-30T13:37:51.006 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 13:37:50 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a[44815]: t=2024-03-30T13:37:50+0000 lvl=warn msg="[Deprecated] the datasource provisioning config is outdated. please upgrade" logger=provisioning.datasources filename=/etc/grafana/provisioning/datasources/ceph-dashboard.yml 2024-03-30T13:37:51.006 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 13:37:50 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a[44815]: t=2024-03-30T13:37:50+0000 lvl=info msg="inserting datasource from configuration " logger=provisioning.datasources name=Dashboard1 uid=P43CA22E17D0F9596 2024-03-30T13:37:51.006 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 13:37:50 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a[44815]: t=2024-03-30T13:37:50+0000 lvl=info msg="warming cache for startup" logger=ngalert 2024-03-30T13:37:51.006 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 13:37:50 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a[44815]: t=2024-03-30T13:37:50+0000 lvl=info msg="HTTP Server Listen" logger=http.server address=[::]:3000 protocol=https subUrl= socket= 2024-03-30T13:37:51.006 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 13:37:50 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a[44815]: t=2024-03-30T13:37:50+0000 lvl=info msg="starting MultiOrg Alertmanager" logger=ngalert.multiorg.alertmanager 2024-03-30T13:37:51.072 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:37:50 smithi099 ceph-mon[24912]: pgmap v66: 129 pgs: 64 unknown, 32 creating+peering, 33 active+clean; 579 KiB data, 49 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:37:51.072 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:37:50 smithi099 ceph-mon[24912]: from='mgr.14439 ' entity='mgr.y' 2024-03-30T13:37:51.072 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:37:50 smithi099 ceph-mon[24912]: from='client.? 172.21.15.99:0/3557053015' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "z.rgw.meta","app": "rgw"}]': finished 2024-03-30T13:37:51.072 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:37:50 smithi099 ceph-mon[24912]: osdmap e69: 8 total, 8 up, 8 in 2024-03-30T13:37:51.072 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:37:50 smithi099 ceph-mon[24912]: from='client.? 172.21.15.99:0/3557053015' entity='client.admin' cmd=[{"prefix": "osd pool set", "pool": "z.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]: dispatch 2024-03-30T13:37:51.072 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:37:50 smithi099 ceph-mon[24912]: from='mgr.14439 ' entity='mgr.y' 2024-03-30T13:37:51.072 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:37:50 smithi099 ceph-mon[24912]: from='mgr.14439 172.21.15.99:0/1757456350' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:37:51.072 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:37:50 smithi099 ceph-mon[24912]: from='mgr.14439 172.21.15.99:0/1757456350' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:37:51.072 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:37:50 smithi099 ceph-mon[24912]: from='mgr.14439 ' entity='mgr.y' 2024-03-30T13:37:51.073 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:37:50 smithi099 ceph-mon[29691]: pgmap v66: 129 pgs: 64 unknown, 32 creating+peering, 33 active+clean; 579 KiB data, 49 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:37:51.073 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:37:50 smithi099 ceph-mon[29691]: from='mgr.14439 ' entity='mgr.y' 2024-03-30T13:37:51.073 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:37:50 smithi099 ceph-mon[29691]: from='client.? 172.21.15.99:0/3557053015' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "z.rgw.meta","app": "rgw"}]': finished 2024-03-30T13:37:51.073 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:37:50 smithi099 ceph-mon[29691]: osdmap e69: 8 total, 8 up, 8 in 2024-03-30T13:37:51.073 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:37:50 smithi099 ceph-mon[29691]: from='client.? 172.21.15.99:0/3557053015' entity='client.admin' cmd=[{"prefix": "osd pool set", "pool": "z.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]: dispatch 2024-03-30T13:37:51.073 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:37:50 smithi099 ceph-mon[29691]: from='mgr.14439 ' entity='mgr.y' 2024-03-30T13:37:51.073 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:37:50 smithi099 ceph-mon[29691]: from='mgr.14439 172.21.15.99:0/1757456350' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:37:51.073 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:37:50 smithi099 ceph-mon[29691]: from='mgr.14439 172.21.15.99:0/1757456350' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:37:51.073 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:37:50 smithi099 ceph-mon[29691]: from='mgr.14439 ' entity='mgr.y' 2024-03-30T13:37:51.758 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-03-30T13:37:51.758 INFO:teuthology.orchestra.run.smithi099.stdout: "id": "c225aa3b-9cc4-4bc9-9ff7-94973066d8ea", 2024-03-30T13:37:51.758 INFO:teuthology.orchestra.run.smithi099.stdout: "epoch": 1, 2024-03-30T13:37:51.758 INFO:teuthology.orchestra.run.smithi099.stdout: "predecessor_uuid": "58ad8575-d9f9-48f2-967e-8573b6e54039", 2024-03-30T13:37:51.758 INFO:teuthology.orchestra.run.smithi099.stdout: "sync_status": [], 2024-03-30T13:37:51.758 INFO:teuthology.orchestra.run.smithi099.stdout: "period_map": { 2024-03-30T13:37:51.758 INFO:teuthology.orchestra.run.smithi099.stdout: "id": "c225aa3b-9cc4-4bc9-9ff7-94973066d8ea", 2024-03-30T13:37:51.759 INFO:teuthology.orchestra.run.smithi099.stdout: "zonegroups": [ 2024-03-30T13:37:51.759 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-03-30T13:37:51.759 INFO:teuthology.orchestra.run.smithi099.stdout: "id": "0db24327-f34b-4f88-a44a-55f13e4a2cf0", 2024-03-30T13:37:51.759 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "default", 2024-03-30T13:37:51.759 INFO:teuthology.orchestra.run.smithi099.stdout: "api_name": "default", 2024-03-30T13:37:51.759 INFO:teuthology.orchestra.run.smithi099.stdout: "is_master": "true", 2024-03-30T13:37:51.759 INFO:teuthology.orchestra.run.smithi099.stdout: "endpoints": [], 2024-03-30T13:37:51.759 INFO:teuthology.orchestra.run.smithi099.stdout: "hostnames": [], 2024-03-30T13:37:51.759 INFO:teuthology.orchestra.run.smithi099.stdout: "hostnames_s3website": [], 2024-03-30T13:37:51.759 INFO:teuthology.orchestra.run.smithi099.stdout: "master_zone": "3afd1167-b8b2-4ab6-a71f-22d886e9d5cf", 2024-03-30T13:37:51.759 INFO:teuthology.orchestra.run.smithi099.stdout: "zones": [ 2024-03-30T13:37:51.759 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-03-30T13:37:51.759 INFO:teuthology.orchestra.run.smithi099.stdout: "id": "3afd1167-b8b2-4ab6-a71f-22d886e9d5cf", 2024-03-30T13:37:51.759 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "z", 2024-03-30T13:37:51.759 INFO:teuthology.orchestra.run.smithi099.stdout: "endpoints": [], 2024-03-30T13:37:51.759 INFO:teuthology.orchestra.run.smithi099.stdout: "log_meta": "false", 2024-03-30T13:37:51.760 INFO:teuthology.orchestra.run.smithi099.stdout: "log_data": "false", 2024-03-30T13:37:51.760 INFO:teuthology.orchestra.run.smithi099.stdout: "bucket_index_max_shards": 11, 2024-03-30T13:37:51.760 INFO:teuthology.orchestra.run.smithi099.stdout: "read_only": "false", 2024-03-30T13:37:51.760 INFO:teuthology.orchestra.run.smithi099.stdout: "tier_type": "", 2024-03-30T13:37:51.760 INFO:teuthology.orchestra.run.smithi099.stdout: "sync_from_all": "true", 2024-03-30T13:37:51.760 INFO:teuthology.orchestra.run.smithi099.stdout: "sync_from": [], 2024-03-30T13:37:51.760 INFO:teuthology.orchestra.run.smithi099.stdout: "redirect_zone": "" 2024-03-30T13:37:51.760 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-03-30T13:37:51.760 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-03-30T13:37:51.760 INFO:teuthology.orchestra.run.smithi099.stdout: "placement_targets": [ 2024-03-30T13:37:51.760 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-03-30T13:37:51.760 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "default-placement", 2024-03-30T13:37:51.760 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-03-30T13:37:51.760 INFO:teuthology.orchestra.run.smithi099.stdout: "storage_classes": [ 2024-03-30T13:37:51.760 INFO:teuthology.orchestra.run.smithi099.stdout: "STANDARD" 2024-03-30T13:37:51.761 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-03-30T13:37:51.761 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-03-30T13:37:51.761 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-03-30T13:37:51.761 INFO:teuthology.orchestra.run.smithi099.stdout: "default_placement": "default-placement", 2024-03-30T13:37:51.761 INFO:teuthology.orchestra.run.smithi099.stdout: "realm_id": "8415daa6-f354-4a6d-9b77-a7b63f225e62", 2024-03-30T13:37:51.761 INFO:teuthology.orchestra.run.smithi099.stdout: "sync_policy": { 2024-03-30T13:37:51.761 INFO:teuthology.orchestra.run.smithi099.stdout: "groups": [] 2024-03-30T13:37:51.761 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-03-30T13:37:51.761 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-03-30T13:37:51.761 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-03-30T13:37:51.761 INFO:teuthology.orchestra.run.smithi099.stdout: "short_zone_ids": [ 2024-03-30T13:37:51.761 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-03-30T13:37:51.761 INFO:teuthology.orchestra.run.smithi099.stdout: "key": "3afd1167-b8b2-4ab6-a71f-22d886e9d5cf", 2024-03-30T13:37:51.762 INFO:teuthology.orchestra.run.smithi099.stdout: "val": 444934100 2024-03-30T13:37:51.762 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-03-30T13:37:51.762 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-03-30T13:37:51.762 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:37:51.762 INFO:teuthology.orchestra.run.smithi099.stdout: "master_zonegroup": "0db24327-f34b-4f88-a44a-55f13e4a2cf0", 2024-03-30T13:37:51.762 INFO:teuthology.orchestra.run.smithi099.stdout: "master_zone": "3afd1167-b8b2-4ab6-a71f-22d886e9d5cf", 2024-03-30T13:37:51.762 INFO:teuthology.orchestra.run.smithi099.stdout: "period_config": { 2024-03-30T13:37:51.762 INFO:teuthology.orchestra.run.smithi099.stdout: "bucket_quota": { 2024-03-30T13:37:51.762 INFO:teuthology.orchestra.run.smithi099.stdout: "enabled": false, 2024-03-30T13:37:51.762 INFO:teuthology.orchestra.run.smithi099.stdout: "check_on_raw": false, 2024-03-30T13:37:51.762 INFO:teuthology.orchestra.run.smithi099.stdout: "max_size": -1, 2024-03-30T13:37:51.762 INFO:teuthology.orchestra.run.smithi099.stdout: "max_size_kb": 0, 2024-03-30T13:37:51.762 INFO:teuthology.orchestra.run.smithi099.stdout: "max_objects": -1 2024-03-30T13:37:51.762 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:37:51.763 INFO:teuthology.orchestra.run.smithi099.stdout: "user_quota": { 2024-03-30T13:37:51.763 INFO:teuthology.orchestra.run.smithi099.stdout: "enabled": false, 2024-03-30T13:37:51.763 INFO:teuthology.orchestra.run.smithi099.stdout: "check_on_raw": false, 2024-03-30T13:37:51.763 INFO:teuthology.orchestra.run.smithi099.stdout: "max_size": -1, 2024-03-30T13:37:51.763 INFO:teuthology.orchestra.run.smithi099.stdout: "max_size_kb": 0, 2024-03-30T13:37:51.763 INFO:teuthology.orchestra.run.smithi099.stdout: "max_objects": -1 2024-03-30T13:37:51.763 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:37:51.763 INFO:teuthology.orchestra.run.smithi099.stdout: "user_ratelimit": { 2024-03-30T13:37:51.763 INFO:teuthology.orchestra.run.smithi099.stdout: "max_read_ops": 0, 2024-03-30T13:37:51.763 INFO:teuthology.orchestra.run.smithi099.stdout: "max_write_ops": 0, 2024-03-30T13:37:51.763 INFO:teuthology.orchestra.run.smithi099.stdout: "max_read_bytes": 0, 2024-03-30T13:37:51.763 INFO:teuthology.orchestra.run.smithi099.stdout: "max_write_bytes": 0, 2024-03-30T13:37:51.764 INFO:teuthology.orchestra.run.smithi099.stdout: "enabled": false 2024-03-30T13:37:51.764 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:37:51.764 INFO:teuthology.orchestra.run.smithi099.stdout: "bucket_ratelimit": { 2024-03-30T13:37:51.764 INFO:teuthology.orchestra.run.smithi099.stdout: "max_read_ops": 0, 2024-03-30T13:37:51.764 INFO:teuthology.orchestra.run.smithi099.stdout: "max_write_ops": 0, 2024-03-30T13:37:51.764 INFO:teuthology.orchestra.run.smithi099.stdout: "max_read_bytes": 0, 2024-03-30T13:37:51.764 INFO:teuthology.orchestra.run.smithi099.stdout: "max_write_bytes": 0, 2024-03-30T13:37:51.764 INFO:teuthology.orchestra.run.smithi099.stdout: "enabled": false 2024-03-30T13:37:51.764 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:37:51.764 INFO:teuthology.orchestra.run.smithi099.stdout: "anonymous_ratelimit": { 2024-03-30T13:37:51.764 INFO:teuthology.orchestra.run.smithi099.stdout: "max_read_ops": 0, 2024-03-30T13:37:51.764 INFO:teuthology.orchestra.run.smithi099.stdout: "max_write_ops": 0, 2024-03-30T13:37:51.764 INFO:teuthology.orchestra.run.smithi099.stdout: "max_read_bytes": 0, 2024-03-30T13:37:51.764 INFO:teuthology.orchestra.run.smithi099.stdout: "max_write_bytes": 0, 2024-03-30T13:37:51.765 INFO:teuthology.orchestra.run.smithi099.stdout: "enabled": false 2024-03-30T13:37:51.765 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-03-30T13:37:51.765 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:37:51.765 INFO:teuthology.orchestra.run.smithi099.stdout: "realm_id": "8415daa6-f354-4a6d-9b77-a7b63f225e62", 2024-03-30T13:37:51.765 INFO:teuthology.orchestra.run.smithi099.stdout: "realm_name": "r", 2024-03-30T13:37:51.765 INFO:teuthology.orchestra.run.smithi099.stdout: "realm_epoch": 2 2024-03-30T13:37:51.765 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-03-30T13:37:52.006 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:37:51 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:37:52.006 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:37:51 smithi181 ceph-mon[25762]: Reconfiguring alertmanager.a (dependencies changed)... 2024-03-30T13:37:52.006 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:37:51 smithi181 ceph-mon[25762]: Reconfiguring daemon alertmanager.a on smithi099 2024-03-30T13:37:52.006 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:37:51 smithi181 ceph-mon[25762]: from='client.? 172.21.15.99:0/3557053015' entity='client.admin' cmd='[{"prefix": "osd pool set", "pool": "z.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]': finished 2024-03-30T13:37:52.006 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:37:51 smithi181 ceph-mon[25762]: osdmap e70: 8 total, 8 up, 8 in 2024-03-30T13:37:52.006 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:37:51 smithi181 ceph-mon[25762]: from='client.? 172.21.15.99:0/3557053015' entity='client.admin' cmd=[{"prefix": "osd pool set", "pool": "z.rgw.meta", "var": "pg_num_min", "val": "8"}]: dispatch 2024-03-30T13:37:52.071 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:37:51 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:37:52.071 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:37:51 smithi099 ceph-mon[24912]: Reconfiguring alertmanager.a (dependencies changed)... 2024-03-30T13:37:52.071 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:37:51 smithi099 ceph-mon[24912]: Reconfiguring daemon alertmanager.a on smithi099 2024-03-30T13:37:52.071 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:37:51 smithi099 ceph-mon[24912]: from='client.? 172.21.15.99:0/3557053015' entity='client.admin' cmd='[{"prefix": "osd pool set", "pool": "z.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]': finished 2024-03-30T13:37:52.071 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:37:51 smithi099 ceph-mon[24912]: osdmap e70: 8 total, 8 up, 8 in 2024-03-30T13:37:52.071 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:37:51 smithi099 ceph-mon[24912]: from='client.? 172.21.15.99:0/3557053015' entity='client.admin' cmd=[{"prefix": "osd pool set", "pool": "z.rgw.meta", "var": "pg_num_min", "val": "8"}]: dispatch 2024-03-30T13:37:52.072 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:37:51 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:37:52.072 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:37:51 smithi099 ceph-mon[29691]: Reconfiguring alertmanager.a (dependencies changed)... 2024-03-30T13:37:52.072 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:37:51 smithi099 ceph-mon[29691]: Reconfiguring daemon alertmanager.a on smithi099 2024-03-30T13:37:52.072 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:37:51 smithi099 ceph-mon[29691]: from='client.? 172.21.15.99:0/3557053015' entity='client.admin' cmd='[{"prefix": "osd pool set", "pool": "z.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]': finished 2024-03-30T13:37:52.072 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:37:51 smithi099 ceph-mon[29691]: osdmap e70: 8 total, 8 up, 8 in 2024-03-30T13:37:52.072 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:37:51 smithi099 ceph-mon[29691]: from='client.? 172.21.15.99:0/3557053015' entity='client.admin' cmd=[{"prefix": "osd pool set", "pool": "z.rgw.meta", "var": "pg_num_min", "val": "8"}]: dispatch 2024-03-30T13:37:52.990 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:37:52 smithi099 ceph-mon[24912]: pgmap v69: 129 pgs: 129 active+clean; 579 KiB data, 51 MiB used, 715 GiB / 715 GiB avail; 255 B/s rd, 511 B/s wr, 1 op/s 2024-03-30T13:37:52.990 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:37:52 smithi099 ceph-mon[24912]: from='client.? 172.21.15.99:0/3557053015' entity='client.admin' cmd='[{"prefix": "osd pool set", "pool": "z.rgw.meta", "var": "pg_num_min", "val": "8"}]': finished 2024-03-30T13:37:52.990 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:37:52 smithi099 ceph-mon[24912]: osdmap e71: 8 total, 8 up, 8 in 2024-03-30T13:37:52.990 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:37:52 smithi099 ceph-mon[29691]: pgmap v69: 129 pgs: 129 active+clean; 579 KiB data, 51 MiB used, 715 GiB / 715 GiB avail; 255 B/s rd, 511 B/s wr, 1 op/s 2024-03-30T13:37:52.990 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:37:52 smithi099 ceph-mon[29691]: from='client.? 172.21.15.99:0/3557053015' entity='client.admin' cmd='[{"prefix": "osd pool set", "pool": "z.rgw.meta", "var": "pg_num_min", "val": "8"}]': finished 2024-03-30T13:37:52.990 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:37:52 smithi099 ceph-mon[29691]: osdmap e71: 8 total, 8 up, 8 in 2024-03-30T13:37:53.006 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:37:52 smithi181 ceph-mon[25762]: pgmap v69: 129 pgs: 129 active+clean; 579 KiB data, 51 MiB used, 715 GiB / 715 GiB avail; 255 B/s rd, 511 B/s wr, 1 op/s 2024-03-30T13:37:53.006 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:37:52 smithi181 ceph-mon[25762]: from='client.? 172.21.15.99:0/3557053015' entity='client.admin' cmd='[{"prefix": "osd pool set", "pool": "z.rgw.meta", "var": "pg_num_min", "val": "8"}]': finished 2024-03-30T13:37:53.006 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:37:52 smithi181 ceph-mon[25762]: osdmap e71: 8 total, 8 up, 8 in 2024-03-30T13:37:53.664 DEBUG:teuthology.orchestra.run.smithi099:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 98ebaeb8-ee99-11ee-b647-cb9ed24678a4 -e sha1=4e50bbcdd1630c7760b708f3a5b4d38a121e66cb -- bash -c 'ceph orch apply rgw foo --realm r --zone z --placement=2 --port=8000' 2024-03-30T13:37:54.463 INFO:journalctl@ceph.alertmanager.a.smithi099.stdout:Mar 30 13:37:54 smithi099 systemd[1]: Stopping Ceph alertmanager.a for 98ebaeb8-ee99-11ee-b647-cb9ed24678a4... 2024-03-30T13:37:54.756 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:37:54 smithi181 ceph-mon[25762]: pgmap v71: 129 pgs: 129 active+clean; 579 KiB data, 51 MiB used, 715 GiB / 715 GiB avail; 209 B/s rd, 418 B/s wr, 1 op/s 2024-03-30T13:37:54.837 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:37:54 smithi099 ceph-mon[24912]: pgmap v71: 129 pgs: 129 active+clean; 579 KiB data, 51 MiB used, 715 GiB / 715 GiB avail; 209 B/s rd, 418 B/s wr, 1 op/s 2024-03-30T13:37:54.837 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:37:54 smithi099 ceph-mon[29691]: pgmap v71: 129 pgs: 129 active+clean; 579 KiB data, 51 MiB used, 715 GiB / 715 GiB avail; 209 B/s rd, 418 B/s wr, 1 op/s 2024-03-30T13:37:54.837 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:37:54 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[25141]: 172.21.15.99 - - [30/Mar/2024:13:37:54] "POST /data HTTP/1.1" 200 46 "" "Python-urllib/3.9" 2024-03-30T13:37:55.326 INFO:journalctl@ceph.alertmanager.a.smithi099.stdout:Mar 30 13:37:54 smithi099 bash[51843]: Error: no container with name or ID "ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-alertmanager.a" found: no such container 2024-03-30T13:37:55.327 INFO:journalctl@ceph.alertmanager.a.smithi099.stdout:Mar 30 13:37:55 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-alertmanager-a[49977]: level=info ts=2024-03-30T13:37:55.024Z caller=main.go:557 msg="Received SIGTERM, exiting gracefully..." 2024-03-30T13:37:55.327 INFO:journalctl@ceph.alertmanager.a.smithi099.stdout:Mar 30 13:37:55 smithi099 podman[51937]: 2024-03-30 13:37:55.045110969 +0000 UTC m=+0.145234397 container died fa0c3fad86005730f08f989e05b9b25abb6058376dbb5336bde90ea68d717ca0 (image=quay.io/prometheus/alertmanager:v0.23.0, name=ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-alertmanager-a, maintainer=The Prometheus Authors ) 2024-03-30T13:37:55.587 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:37:55 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[25141]: 172.21.15.181 - - [30/Mar/2024:13:37:55] "POST /data HTTP/1.1" 200 46 "" "Python-urllib/3.9" 2024-03-30T13:37:55.587 INFO:journalctl@ceph.alertmanager.a.smithi099.stdout:Mar 30 13:37:55 smithi099 podman[51937]: 2024-03-30 13:37:55.50007612 +0000 UTC m=+0.600199551 container cleanup fa0c3fad86005730f08f989e05b9b25abb6058376dbb5336bde90ea68d717ca0 (image=quay.io/prometheus/alertmanager:v0.23.0, name=ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-alertmanager-a, maintainer=The Prometheus Authors ) 2024-03-30T13:37:55.587 INFO:journalctl@ceph.alertmanager.a.smithi099.stdout:Mar 30 13:37:55 smithi099 bash[51937]: ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-alertmanager-a 2024-03-30T13:37:55.587 INFO:journalctl@ceph.alertmanager.a.smithi099.stdout:Mar 30 13:37:55 smithi099 bash[51965]: Error: no container with name or ID "ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-alertmanager.a" found: no such container 2024-03-30T13:37:56.004 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:37:55 smithi099 ceph-mon[24912]: from='mgr.14439 ' entity='mgr.y' 2024-03-30T13:37:56.004 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:37:55 smithi099 ceph-mon[24912]: from='mgr.14439 ' entity='mgr.y' 2024-03-30T13:37:56.004 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:37:55 smithi099 ceph-mon[24912]: pgmap v72: 129 pgs: 129 active+clean; 579 KiB data, 51 MiB used, 715 GiB / 715 GiB avail; 200 B/s rd, 400 B/s wr, 1 op/s 2024-03-30T13:37:56.004 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:37:55 smithi099 ceph-mon[24912]: from='mgr.14439 ' entity='mgr.y' 2024-03-30T13:37:56.004 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:37:55 smithi099 ceph-mon[24912]: from='mgr.14439 ' entity='mgr.y' 2024-03-30T13:37:56.004 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:37:55 smithi099 ceph-mon[29691]: from='mgr.14439 ' entity='mgr.y' 2024-03-30T13:37:56.004 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:37:55 smithi099 ceph-mon[29691]: from='mgr.14439 ' entity='mgr.y' 2024-03-30T13:37:56.004 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:37:55 smithi099 ceph-mon[29691]: pgmap v72: 129 pgs: 129 active+clean; 579 KiB data, 51 MiB used, 715 GiB / 715 GiB avail; 200 B/s rd, 400 B/s wr, 1 op/s 2024-03-30T13:37:56.004 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:37:55 smithi099 ceph-mon[29691]: from='mgr.14439 ' entity='mgr.y' 2024-03-30T13:37:56.004 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:37:55 smithi099 ceph-mon[29691]: from='mgr.14439 ' entity='mgr.y' 2024-03-30T13:37:56.006 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:37:55 smithi181 ceph-mon[25762]: from='mgr.14439 ' entity='mgr.y' 2024-03-30T13:37:56.006 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:37:55 smithi181 ceph-mon[25762]: from='mgr.14439 ' entity='mgr.y' 2024-03-30T13:37:56.006 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:37:55 smithi181 ceph-mon[25762]: pgmap v72: 129 pgs: 129 active+clean; 579 KiB data, 51 MiB used, 715 GiB / 715 GiB avail; 200 B/s rd, 400 B/s wr, 1 op/s 2024-03-30T13:37:56.006 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:37:55 smithi181 ceph-mon[25762]: from='mgr.14439 ' entity='mgr.y' 2024-03-30T13:37:56.006 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:37:55 smithi181 ceph-mon[25762]: from='mgr.14439 ' entity='mgr.y' 2024-03-30T13:37:56.574 INFO:journalctl@ceph.alertmanager.a.smithi099.stdout:Mar 30 13:37:56 smithi099 podman[51951]: 2024-03-30 13:37:56.498063121 +0000 UTC m=+1.451919105 container remove fa0c3fad86005730f08f989e05b9b25abb6058376dbb5336bde90ea68d717ca0 (image=quay.io/prometheus/alertmanager:v0.23.0, name=ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-alertmanager-a, maintainer=The Prometheus Authors ) 2024-03-30T13:37:56.574 INFO:journalctl@ceph.alertmanager.a.smithi099.stdout:Mar 30 13:37:56 smithi099 podman[51951]: 2024-03-30 13:37:56.573598773 +0000 UTC m=+1.527454770 volume remove 6588482e0f8f89c3e359d57474a834d090b93145c2d93dad079c8f6558cda2eb 2024-03-30T13:37:56.833 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:37:56 smithi099 ceph-mon[24912]: Health check failed: 1 failed cephadm daemon(s) (CEPHADM_FAILED_DAEMON) 2024-03-30T13:37:56.834 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:37:56 smithi099 ceph-mon[29691]: Health check failed: 1 failed cephadm daemon(s) (CEPHADM_FAILED_DAEMON) 2024-03-30T13:37:56.834 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:37:56 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[25141]: ::ffff:172.21.15.181 - - [30/Mar/2024:13:37:56] "GET /metrics HTTP/1.1" 200 193030 "" "Prometheus/2.33.4" 2024-03-30T13:37:56.834 INFO:journalctl@ceph.alertmanager.a.smithi099.stdout:Mar 30 13:37:56 smithi099 systemd[1]: ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4@alertmanager.a.service: Deactivated successfully. 2024-03-30T13:37:56.834 INFO:journalctl@ceph.alertmanager.a.smithi099.stdout:Mar 30 13:37:56 smithi099 systemd[1]: Stopped Ceph alertmanager.a for 98ebaeb8-ee99-11ee-b647-cb9ed24678a4. 2024-03-30T13:37:56.835 INFO:journalctl@ceph.alertmanager.a.smithi099.stdout:Mar 30 13:37:56 smithi099 systemd[1]: Starting Ceph alertmanager.a for 98ebaeb8-ee99-11ee-b647-cb9ed24678a4... 2024-03-30T13:37:56.865 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:37:56 smithi181 ceph-mon[25762]: Health check failed: 1 failed cephadm daemon(s) (CEPHADM_FAILED_DAEMON) 2024-03-30T13:37:57.078 INFO:teuthology.orchestra.run.smithi099.stdout:Scheduled rgw.foo update... 2024-03-30T13:37:57.086 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:37:56 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[25141]: 172.21.15.181 - - [30/Mar/2024:13:37:56] "POST /data HTTP/1.1" 200 46 "" "Python-urllib/3.9" 2024-03-30T13:37:57.087 INFO:journalctl@ceph.alertmanager.a.smithi099.stdout:Mar 30 13:37:56 smithi099 podman[52078]: 2024-03-30 13:37:56.900130808 +0000 UTC m=+0.025462022 image pull ba2b418f427c0636d654de8757e830c80168e76482bcc46bb2138e569d6c91d4 quay.io/prometheus/alertmanager:v0.23.0 2024-03-30T13:37:57.087 INFO:journalctl@ceph.alertmanager.a.smithi099.stdout:Mar 30 13:37:57 smithi099 podman[52078]: 2024-03-30 13:37:57.008998328 +0000 UTC m=+0.134329521 volume create fe3ae99f89c5c5ed25a1c60ebf92b9d3421ac5f18643bc5cfe0c0d6018ac75e2 2024-03-30T13:37:57.436 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:37:57 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[25141]: 172.21.15.181 - - [30/Mar/2024:13:37:57] "POST /data HTTP/1.1" 200 46 "" "Python-urllib/3.9" 2024-03-30T13:37:57.437 INFO:journalctl@ceph.alertmanager.a.smithi099.stdout:Mar 30 13:37:57 smithi099 podman[52078]: 2024-03-30 13:37:57.092731465 +0000 UTC m=+0.218062659 container create 8804d597845b7260a773e9116473d85637cdc05c922206916b67fb5badd9712a (image=quay.io/prometheus/alertmanager:v0.23.0, name=ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-alertmanager-a, maintainer=The Prometheus Authors ) 2024-03-30T13:37:57.837 INFO:journalctl@ceph.alertmanager.a.smithi099.stdout:Mar 30 13:37:57 smithi099 podman[52078]: 2024-03-30 13:37:57.538340717 +0000 UTC m=+0.663671926 container init 8804d597845b7260a773e9116473d85637cdc05c922206916b67fb5badd9712a (image=quay.io/prometheus/alertmanager:v0.23.0, name=ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-alertmanager-a, maintainer=The Prometheus Authors ) 2024-03-30T13:37:57.837 INFO:journalctl@ceph.alertmanager.a.smithi099.stdout:Mar 30 13:37:57 smithi099 podman[52078]: 2024-03-30 13:37:57.54098679 +0000 UTC m=+0.666317991 container start 8804d597845b7260a773e9116473d85637cdc05c922206916b67fb5badd9712a (image=quay.io/prometheus/alertmanager:v0.23.0, name=ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-alertmanager-a, maintainer=The Prometheus Authors ) 2024-03-30T13:37:57.837 INFO:journalctl@ceph.alertmanager.a.smithi099.stdout:Mar 30 13:37:57 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-alertmanager-a[52107]: level=info ts=2024-03-30T13:37:57.551Z caller=main.go:225 msg="Starting Alertmanager" version="(version=0.23.0, branch=HEAD, revision=61046b17771a57cfd4c4a51be370ab930a4d7d54)" 2024-03-30T13:37:57.837 INFO:journalctl@ceph.alertmanager.a.smithi099.stdout:Mar 30 13:37:57 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-alertmanager-a[52107]: level=info ts=2024-03-30T13:37:57.551Z caller=main.go:226 build_context="(go=go1.16.7, user=root@e21a959be8d2, date=20210825-10:48:55)" 2024-03-30T13:37:57.837 INFO:journalctl@ceph.alertmanager.a.smithi099.stdout:Mar 30 13:37:57 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-alertmanager-a[52107]: level=info ts=2024-03-30T13:37:57.552Z caller=cluster.go:184 component=cluster msg="setting advertise address explicitly" addr=172.21.15.99 port=9094 2024-03-30T13:37:57.837 INFO:journalctl@ceph.alertmanager.a.smithi099.stdout:Mar 30 13:37:57 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-alertmanager-a[52107]: level=info ts=2024-03-30T13:37:57.553Z caller=cluster.go:671 component=cluster msg="Waiting for gossip to settle..." interval=2s 2024-03-30T13:37:57.837 INFO:journalctl@ceph.alertmanager.a.smithi099.stdout:Mar 30 13:37:57 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-alertmanager-a[52107]: level=info ts=2024-03-30T13:37:57.578Z caller=coordinator.go:113 component=configuration msg="Loading configuration file" file=/etc/alertmanager/alertmanager.yml 2024-03-30T13:37:57.837 INFO:journalctl@ceph.alertmanager.a.smithi099.stdout:Mar 30 13:37:57 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-alertmanager-a[52107]: level=info ts=2024-03-30T13:37:57.578Z caller=coordinator.go:126 component=configuration msg="Completed loading of configuration file" file=/etc/alertmanager/alertmanager.yml 2024-03-30T13:37:57.837 INFO:journalctl@ceph.alertmanager.a.smithi099.stdout:Mar 30 13:37:57 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-alertmanager-a[52107]: level=info ts=2024-03-30T13:37:57.580Z caller=main.go:518 msg=Listening address=:9093 2024-03-30T13:37:57.838 INFO:journalctl@ceph.alertmanager.a.smithi099.stdout:Mar 30 13:37:57 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-alertmanager-a[52107]: level=info ts=2024-03-30T13:37:57.580Z caller=tls_config.go:191 msg="TLS is disabled." http2=false 2024-03-30T13:37:57.838 INFO:journalctl@ceph.alertmanager.a.smithi099.stdout:Mar 30 13:37:57 smithi099 bash[52078]: 8804d597845b7260a773e9116473d85637cdc05c922206916b67fb5badd9712a 2024-03-30T13:37:57.838 INFO:journalctl@ceph.alertmanager.a.smithi099.stdout:Mar 30 13:37:57 smithi099 systemd[1]: Started Ceph alertmanager.a for 98ebaeb8-ee99-11ee-b647-cb9ed24678a4. 2024-03-30T13:37:58.006 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:37:57 smithi181 ceph-mon[25762]: pgmap v73: 129 pgs: 129 active+clean; 581 KiB data, 52 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1.3 KiB/s wr, 3 op/s 2024-03-30T13:37:58.006 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:37:57 smithi181 ceph-mon[25762]: from='mgr.14439 ' entity='mgr.y' 2024-03-30T13:37:58.006 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:37:57 smithi181 ceph-mon[25762]: from='mgr.14439 ' entity='mgr.y' 2024-03-30T13:37:58.006 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:37:57 smithi181 ceph-mon[25762]: from='mgr.14439 ' entity='mgr.y' 2024-03-30T13:37:58.006 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:37:57 smithi181 ceph-mon[25762]: from='mgr.14439 ' entity='mgr.y' 2024-03-30T13:37:58.006 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:37:57 smithi181 ceph-mon[25762]: from='mgr.14439 ' entity='mgr.y' 2024-03-30T13:37:58.090 DEBUG:teuthology.orchestra.run.smithi099:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 98ebaeb8-ee99-11ee-b647-cb9ed24678a4 -e sha1=4e50bbcdd1630c7760b708f3a5b4d38a121e66cb -- bash -c 'ceph osd pool create foo' 2024-03-30T13:37:58.144 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:37:57 smithi099 ceph-mon[24912]: pgmap v73: 129 pgs: 129 active+clean; 581 KiB data, 52 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1.3 KiB/s wr, 3 op/s 2024-03-30T13:37:58.144 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:37:57 smithi099 ceph-mon[24912]: from='mgr.14439 ' entity='mgr.y' 2024-03-30T13:37:58.144 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:37:57 smithi099 ceph-mon[24912]: from='mgr.14439 ' entity='mgr.y' 2024-03-30T13:37:58.144 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:37:57 smithi099 ceph-mon[24912]: from='mgr.14439 ' entity='mgr.y' 2024-03-30T13:37:58.144 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:37:57 smithi099 ceph-mon[24912]: from='mgr.14439 ' entity='mgr.y' 2024-03-30T13:37:58.144 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:37:57 smithi099 ceph-mon[24912]: from='mgr.14439 ' entity='mgr.y' 2024-03-30T13:37:58.145 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:37:57 smithi099 ceph-mon[29691]: pgmap v73: 129 pgs: 129 active+clean; 581 KiB data, 52 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1.3 KiB/s wr, 3 op/s 2024-03-30T13:37:58.145 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:37:57 smithi099 ceph-mon[29691]: from='mgr.14439 ' entity='mgr.y' 2024-03-30T13:37:58.145 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:37:57 smithi099 ceph-mon[29691]: from='mgr.14439 ' entity='mgr.y' 2024-03-30T13:37:58.145 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:37:57 smithi099 ceph-mon[29691]: from='mgr.14439 ' entity='mgr.y' 2024-03-30T13:37:58.145 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:37:57 smithi099 ceph-mon[29691]: from='mgr.14439 ' entity='mgr.y' 2024-03-30T13:37:58.145 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:37:57 smithi099 ceph-mon[29691]: from='mgr.14439 ' entity='mgr.y' 2024-03-30T13:37:59.087 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:37:58 smithi099 ceph-mon[29691]: from='client.24583 -' entity='client.admin' cmd=[{"prefix": "orch apply rgw", "svc_id": "foo", "realm": "r", "zone": "z", "placement": "2", "port": 8000, "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T13:37:59.087 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:37:58 smithi099 ceph-mon[29691]: Saving service rgw.foo spec with placement count:2 2024-03-30T13:37:59.087 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:37:58 smithi099 ceph-mon[29691]: pgmap v74: 129 pgs: 129 active+clean; 581 KiB data, 52 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1.1 KiB/s wr, 2 op/s 2024-03-30T13:37:59.087 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:37:58 smithi099 ceph-mon[29691]: pgmap v75: 129 pgs: 129 active+clean; 581 KiB data, 52 MiB used, 715 GiB / 715 GiB avail; 1.3 KiB/s rd, 1.3 KiB/s wr, 3 op/s 2024-03-30T13:37:59.087 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:37:58 smithi099 ceph-mon[29691]: Reconfiguring prometheus.a (dependencies changed)... 2024-03-30T13:37:59.087 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:37:58 smithi099 ceph-mon[29691]: Reconfiguring daemon prometheus.a on smithi181 2024-03-30T13:37:59.087 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:37:58 smithi099 ceph-mon[24912]: from='client.24583 -' entity='client.admin' cmd=[{"prefix": "orch apply rgw", "svc_id": "foo", "realm": "r", "zone": "z", "placement": "2", "port": 8000, "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T13:37:59.087 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:37:58 smithi099 ceph-mon[24912]: Saving service rgw.foo spec with placement count:2 2024-03-30T13:37:59.088 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:37:58 smithi099 ceph-mon[24912]: pgmap v74: 129 pgs: 129 active+clean; 581 KiB data, 52 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1.1 KiB/s wr, 2 op/s 2024-03-30T13:37:59.088 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:37:58 smithi099 ceph-mon[24912]: pgmap v75: 129 pgs: 129 active+clean; 581 KiB data, 52 MiB used, 715 GiB / 715 GiB avail; 1.3 KiB/s rd, 1.3 KiB/s wr, 3 op/s 2024-03-30T13:37:59.088 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:37:58 smithi099 ceph-mon[24912]: Reconfiguring prometheus.a (dependencies changed)... 2024-03-30T13:37:59.088 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:37:58 smithi099 ceph-mon[24912]: Reconfiguring daemon prometheus.a on smithi181 2024-03-30T13:37:59.179 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:37:58 smithi181 ceph-mon[25762]: from='client.24583 -' entity='client.admin' cmd=[{"prefix": "orch apply rgw", "svc_id": "foo", "realm": "r", "zone": "z", "placement": "2", "port": 8000, "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T13:37:59.179 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:37:58 smithi181 ceph-mon[25762]: Saving service rgw.foo spec with placement count:2 2024-03-30T13:37:59.179 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:37:58 smithi181 ceph-mon[25762]: pgmap v74: 129 pgs: 129 active+clean; 581 KiB data, 52 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1.1 KiB/s wr, 2 op/s 2024-03-30T13:37:59.179 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:37:58 smithi181 ceph-mon[25762]: pgmap v75: 129 pgs: 129 active+clean; 581 KiB data, 52 MiB used, 715 GiB / 715 GiB avail; 1.3 KiB/s rd, 1.3 KiB/s wr, 3 op/s 2024-03-30T13:37:59.179 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:37:58 smithi181 ceph-mon[25762]: Reconfiguring prometheus.a (dependencies changed)... 2024-03-30T13:37:59.179 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:37:58 smithi181 ceph-mon[25762]: Reconfiguring daemon prometheus.a on smithi181 2024-03-30T13:37:59.709 INFO:journalctl@ceph.alertmanager.a.smithi099.stdout:Mar 30 13:37:59 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-alertmanager-a[52107]: level=info ts=2024-03-30T13:37:59.554Z caller=cluster.go:696 component=cluster msg="gossip not settled" polls=0 before=0 now=1 elapsed=2.000883982s 2024-03-30T13:37:59.752 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 13:37:59 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-x[27332]: ::ffff:172.21.15.181 - - [30/Mar/2024:13:37:59] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-03-30T13:38:00.006 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:37:59 smithi181 ceph-mon[25762]: from='mgr.14439 172.21.15.99:0/1757456350' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.3", "id": [7, 4]}]: dispatch 2024-03-30T13:38:00.006 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:37:59 smithi181 ceph-mon[25762]: from='mgr.14439 172.21.15.99:0/1757456350' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2024-03-30T13:38:00.006 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:37:59 smithi181 ceph-mon[25762]: from='mgr.14439 ' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.3", "id": [7, 4]}]: dispatch 2024-03-30T13:38:00.006 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:37:59 smithi181 ceph-mon[25762]: from='mgr.14439 172.21.15.99:0/1757456350' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2024-03-30T13:38:00.006 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:37:59 smithi181 ceph-mon[25762]: from='mgr.14439 172.21.15.99:0/1757456350' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2024-03-30T13:38:00.006 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:37:59 smithi181 ceph-mon[25762]: from='mgr.14439 ' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2024-03-30T13:38:00.007 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:37:59 smithi181 ceph-mon[25762]: from='mgr.14439 ' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2024-03-30T13:38:00.007 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:37:59 smithi181 ceph-mon[25762]: from='mgr.14439 ' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2024-03-30T13:38:00.007 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:37:59 smithi181 ceph-mon[25762]: from='mgr.14439 ' entity='mgr.y' 2024-03-30T13:38:00.007 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:37:59 smithi181 ceph-mon[25762]: from='mgr.14439 172.21.15.99:0/1757456350' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-03-30T13:38:00.007 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:37:59 smithi181 ceph-mon[25762]: from='mgr.14439 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-03-30T13:38:00.007 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:37:59 smithi181 ceph-mon[25762]: from='mgr.14439 172.21.15.99:0/1757456350' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-03-30T13:38:00.007 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:37:59 smithi181 ceph-mon[25762]: from='mgr.14439 ' entity='mgr.y' 2024-03-30T13:38:00.007 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:37:59 smithi181 ceph-mon[25762]: from='mgr.14439 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-03-30T13:38:00.087 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:37:59 smithi099 ceph-mon[24912]: from='mgr.14439 172.21.15.99:0/1757456350' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.3", "id": [7, 4]}]: dispatch 2024-03-30T13:38:00.087 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:37:59 smithi099 ceph-mon[24912]: from='mgr.14439 172.21.15.99:0/1757456350' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2024-03-30T13:38:00.087 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:37:59 smithi099 ceph-mon[24912]: from='mgr.14439 ' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.3", "id": [7, 4]}]: dispatch 2024-03-30T13:38:00.087 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:37:59 smithi099 ceph-mon[24912]: from='mgr.14439 172.21.15.99:0/1757456350' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2024-03-30T13:38:00.087 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:37:59 smithi099 ceph-mon[24912]: from='mgr.14439 172.21.15.99:0/1757456350' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2024-03-30T13:38:00.087 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:37:59 smithi099 ceph-mon[24912]: from='mgr.14439 ' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2024-03-30T13:38:00.087 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:37:59 smithi099 ceph-mon[24912]: from='mgr.14439 ' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2024-03-30T13:38:00.087 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:37:59 smithi099 ceph-mon[24912]: from='mgr.14439 ' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2024-03-30T13:38:00.088 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:37:59 smithi099 ceph-mon[24912]: from='mgr.14439 ' entity='mgr.y' 2024-03-30T13:38:00.088 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:37:59 smithi099 ceph-mon[24912]: from='mgr.14439 172.21.15.99:0/1757456350' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-03-30T13:38:00.088 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:37:59 smithi099 ceph-mon[24912]: from='mgr.14439 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-03-30T13:38:00.088 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:37:59 smithi099 ceph-mon[24912]: from='mgr.14439 172.21.15.99:0/1757456350' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-03-30T13:38:00.088 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:37:59 smithi099 ceph-mon[24912]: from='mgr.14439 ' entity='mgr.y' 2024-03-30T13:38:00.088 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:37:59 smithi099 ceph-mon[24912]: from='mgr.14439 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-03-30T13:38:00.088 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:37:59 smithi099 ceph-mon[29691]: from='mgr.14439 172.21.15.99:0/1757456350' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.3", "id": [7, 4]}]: dispatch 2024-03-30T13:38:00.088 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:37:59 smithi099 ceph-mon[29691]: from='mgr.14439 172.21.15.99:0/1757456350' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2024-03-30T13:38:00.088 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:37:59 smithi099 ceph-mon[29691]: from='mgr.14439 ' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.3", "id": [7, 4]}]: dispatch 2024-03-30T13:38:00.088 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:37:59 smithi099 ceph-mon[29691]: from='mgr.14439 172.21.15.99:0/1757456350' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2024-03-30T13:38:00.088 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:37:59 smithi099 ceph-mon[29691]: from='mgr.14439 172.21.15.99:0/1757456350' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2024-03-30T13:38:00.088 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:37:59 smithi099 ceph-mon[29691]: from='mgr.14439 ' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2024-03-30T13:38:00.088 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:37:59 smithi099 ceph-mon[29691]: from='mgr.14439 ' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2024-03-30T13:38:00.089 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:37:59 smithi099 ceph-mon[29691]: from='mgr.14439 ' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2024-03-30T13:38:00.089 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:37:59 smithi099 ceph-mon[29691]: from='mgr.14439 ' entity='mgr.y' 2024-03-30T13:38:00.089 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:37:59 smithi099 ceph-mon[29691]: from='mgr.14439 172.21.15.99:0/1757456350' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-03-30T13:38:00.089 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:37:59 smithi099 ceph-mon[29691]: from='mgr.14439 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-03-30T13:38:00.089 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:37:59 smithi099 ceph-mon[29691]: from='mgr.14439 172.21.15.99:0/1757456350' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-03-30T13:38:00.089 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:37:59 smithi099 ceph-mon[29691]: from='mgr.14439 ' entity='mgr.y' 2024-03-30T13:38:00.089 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:37:59 smithi099 ceph-mon[29691]: from='mgr.14439 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-03-30T13:38:00.757 INFO:journalctl@ceph.prometheus.a.smithi181.stdout:Mar 30 13:38:00 smithi181 systemd[1]: Stopping Ceph prometheus.a for 98ebaeb8-ee99-11ee-b647-cb9ed24678a4... 2024-03-30T13:38:00.757 INFO:journalctl@ceph.prometheus.a.smithi181.stdout:Mar 30 13:38:00 smithi181 bash[45703]: Error: no container with name or ID "ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-prometheus.a" found: no such container 2024-03-30T13:38:00.757 INFO:journalctl@ceph.prometheus.a.smithi181.stdout:Mar 30 13:38:00 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-prometheus-a[43437]: ts=2024-03-30T13:38:00.683Z caller=main.go:775 level=warn msg="Received SIGTERM, exiting gracefully..." 2024-03-30T13:38:00.757 INFO:journalctl@ceph.prometheus.a.smithi181.stdout:Mar 30 13:38:00 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-prometheus-a[43437]: ts=2024-03-30T13:38:00.683Z caller=main.go:798 level=info msg="Stopping scrape discovery manager..." 2024-03-30T13:38:00.757 INFO:journalctl@ceph.prometheus.a.smithi181.stdout:Mar 30 13:38:00 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-prometheus-a[43437]: ts=2024-03-30T13:38:00.683Z caller=main.go:812 level=info msg="Stopping notify discovery manager..." 2024-03-30T13:38:00.757 INFO:journalctl@ceph.prometheus.a.smithi181.stdout:Mar 30 13:38:00 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-prometheus-a[43437]: ts=2024-03-30T13:38:00.683Z caller=main.go:834 level=info msg="Stopping scrape manager..." 2024-03-30T13:38:00.757 INFO:journalctl@ceph.prometheus.a.smithi181.stdout:Mar 30 13:38:00 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-prometheus-a[43437]: ts=2024-03-30T13:38:00.683Z caller=main.go:794 level=info msg="Scrape discovery manager stopped" 2024-03-30T13:38:00.757 INFO:journalctl@ceph.prometheus.a.smithi181.stdout:Mar 30 13:38:00 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-prometheus-a[43437]: ts=2024-03-30T13:38:00.683Z caller=main.go:808 level=info msg="Notify discovery manager stopped" 2024-03-30T13:38:00.757 INFO:journalctl@ceph.prometheus.a.smithi181.stdout:Mar 30 13:38:00 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-prometheus-a[43437]: ts=2024-03-30T13:38:00.684Z caller=manager.go:945 level=info component="rule manager" msg="Stopping rule manager..." 2024-03-30T13:38:00.758 INFO:journalctl@ceph.prometheus.a.smithi181.stdout:Mar 30 13:38:00 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-prometheus-a[43437]: ts=2024-03-30T13:38:00.684Z caller=main.go:828 level=info msg="Scrape manager stopped" 2024-03-30T13:38:00.758 INFO:journalctl@ceph.prometheus.a.smithi181.stdout:Mar 30 13:38:00 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-prometheus-a[43437]: ts=2024-03-30T13:38:00.684Z caller=manager.go:955 level=info component="rule manager" msg="Rule manager stopped" 2024-03-30T13:38:00.758 INFO:journalctl@ceph.prometheus.a.smithi181.stdout:Mar 30 13:38:00 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-prometheus-a[43437]: ts=2024-03-30T13:38:00.684Z caller=notifier.go:600 level=info component=notifier msg="Stopping notification manager..." 2024-03-30T13:38:00.758 INFO:journalctl@ceph.prometheus.a.smithi181.stdout:Mar 30 13:38:00 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-prometheus-a[43437]: ts=2024-03-30T13:38:00.684Z caller=main.go:1054 level=info msg="Notifier manager stopped" 2024-03-30T13:38:00.758 INFO:journalctl@ceph.prometheus.a.smithi181.stdout:Mar 30 13:38:00 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-prometheus-a[43437]: ts=2024-03-30T13:38:00.684Z caller=main.go:1066 level=info msg="See you next time!" 2024-03-30T13:38:00.758 INFO:journalctl@ceph.prometheus.a.smithi181.stdout:Mar 30 13:38:00 smithi181 podman[45713]: 2024-03-30 13:38:00.69415243 +0000 UTC m=+0.107816125 container died ea2c80227becd8812abcb33d6c37ba5d9b4c2b676045b814e42c73ef116d9dac (image=quay.io/prometheus/prometheus:v2.33.4, name=ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-prometheus-a, maintainer=The Prometheus Authors ) 2024-03-30T13:38:00.925 INFO:teuthology.orchestra.run.smithi099.stderr:pool 'foo' created 2024-03-30T13:38:01.229 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:38:00 smithi099 ceph-mon[24912]: pgmap v76: 129 pgs: 129 active+clean; 581 KiB data, 52 MiB used, 715 GiB / 715 GiB avail; 970 B/s rd, 970 B/s wr, 2 op/s 2024-03-30T13:38:01.229 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:38:00 smithi099 ceph-mon[24912]: from='mgr.14439 ' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.3", "id": [7, 4]}]': finished 2024-03-30T13:38:01.229 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:38:00 smithi099 ceph-mon[24912]: from='mgr.14439 ' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]': finished 2024-03-30T13:38:01.229 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:38:00 smithi099 ceph-mon[24912]: from='mgr.14439 ' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]': finished 2024-03-30T13:38:01.230 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:38:00 smithi099 ceph-mon[24912]: from='mgr.14439 ' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]': finished 2024-03-30T13:38:01.230 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:38:00 smithi099 ceph-mon[24912]: osdmap e72: 8 total, 8 up, 8 in 2024-03-30T13:38:01.230 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:38:00 smithi099 ceph-mon[24912]: from='client.? 172.21.15.99:0/3858882788' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "foo"}]: dispatch 2024-03-30T13:38:01.230 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:38:00 smithi099 ceph-mon[29691]: pgmap v76: 129 pgs: 129 active+clean; 581 KiB data, 52 MiB used, 715 GiB / 715 GiB avail; 970 B/s rd, 970 B/s wr, 2 op/s 2024-03-30T13:38:01.230 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:38:00 smithi099 ceph-mon[29691]: from='mgr.14439 ' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.3", "id": [7, 4]}]': finished 2024-03-30T13:38:01.230 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:38:00 smithi099 ceph-mon[29691]: from='mgr.14439 ' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]': finished 2024-03-30T13:38:01.230 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:38:00 smithi099 ceph-mon[29691]: from='mgr.14439 ' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]': finished 2024-03-30T13:38:01.230 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:38:00 smithi099 ceph-mon[29691]: from='mgr.14439 ' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]': finished 2024-03-30T13:38:01.230 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:38:00 smithi099 ceph-mon[29691]: osdmap e72: 8 total, 8 up, 8 in 2024-03-30T13:38:01.230 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:38:00 smithi099 ceph-mon[29691]: from='client.? 172.21.15.99:0/3858882788' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "foo"}]: dispatch 2024-03-30T13:38:01.236 INFO:journalctl@ceph.prometheus.a.smithi181.stdout:Mar 30 13:38:01 smithi181 podman[45713]: 2024-03-30 13:38:01.025467279 +0000 UTC m=+0.439130973 container cleanup ea2c80227becd8812abcb33d6c37ba5d9b4c2b676045b814e42c73ef116d9dac (image=quay.io/prometheus/prometheus:v2.33.4, name=ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-prometheus-a, maintainer=The Prometheus Authors ) 2024-03-30T13:38:01.236 INFO:journalctl@ceph.prometheus.a.smithi181.stdout:Mar 30 13:38:01 smithi181 bash[45713]: ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-prometheus-a 2024-03-30T13:38:01.236 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:38:00 smithi181 ceph-mon[25762]: pgmap v76: 129 pgs: 129 active+clean; 581 KiB data, 52 MiB used, 715 GiB / 715 GiB avail; 970 B/s rd, 970 B/s wr, 2 op/s 2024-03-30T13:38:01.237 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:38:00 smithi181 ceph-mon[25762]: from='mgr.14439 ' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.3", "id": [7, 4]}]': finished 2024-03-30T13:38:01.237 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:38:00 smithi181 ceph-mon[25762]: from='mgr.14439 ' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]': finished 2024-03-30T13:38:01.237 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:38:00 smithi181 ceph-mon[25762]: from='mgr.14439 ' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]': finished 2024-03-30T13:38:01.237 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:38:00 smithi181 ceph-mon[25762]: from='mgr.14439 ' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]': finished 2024-03-30T13:38:01.237 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:38:00 smithi181 ceph-mon[25762]: osdmap e72: 8 total, 8 up, 8 in 2024-03-30T13:38:01.237 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:38:00 smithi181 ceph-mon[25762]: from='client.? 172.21.15.99:0/3858882788' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "foo"}]: dispatch 2024-03-30T13:38:01.491 INFO:journalctl@ceph.prometheus.a.smithi181.stdout:Mar 30 13:38:01 smithi181 podman[45727]: 2024-03-30 13:38:01.235661992 +0000 UTC m=+0.539267302 container remove ea2c80227becd8812abcb33d6c37ba5d9b4c2b676045b814e42c73ef116d9dac (image=quay.io/prometheus/prometheus:v2.33.4, name=ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-prometheus-a, maintainer=The Prometheus Authors ) 2024-03-30T13:38:01.491 INFO:journalctl@ceph.prometheus.a.smithi181.stdout:Mar 30 13:38:01 smithi181 bash[45741]: Error: no container with name or ID "ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-prometheus.a" found: no such container 2024-03-30T13:38:01.491 INFO:journalctl@ceph.prometheus.a.smithi181.stdout:Mar 30 13:38:01 smithi181 systemd[1]: ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4@prometheus.a.service: Deactivated successfully. 2024-03-30T13:38:01.491 INFO:journalctl@ceph.prometheus.a.smithi181.stdout:Mar 30 13:38:01 smithi181 systemd[1]: Stopped Ceph prometheus.a for 98ebaeb8-ee99-11ee-b647-cb9ed24678a4. 2024-03-30T13:38:01.491 INFO:journalctl@ceph.prometheus.a.smithi181.stdout:Mar 30 13:38:01 smithi181 systemd[1]: Starting Ceph prometheus.a for 98ebaeb8-ee99-11ee-b647-cb9ed24678a4... 2024-03-30T13:38:01.638 DEBUG:teuthology.orchestra.run.smithi099:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 98ebaeb8-ee99-11ee-b647-cb9ed24678a4 -e sha1=4e50bbcdd1630c7760b708f3a5b4d38a121e66cb -- bash -c 'rbd pool init foo' 2024-03-30T13:38:01.756 INFO:journalctl@ceph.prometheus.a.smithi181.stdout:Mar 30 13:38:01 smithi181 podman[45813]: 2024-03-30 13:38:01.41502443 +0000 UTC m=+0.018661355 image pull 514e6a882f6e74806a5856468489eeff8d7106095557578da96935e4d0ba4d9d quay.io/prometheus/prometheus:v2.33.4 2024-03-30T13:38:01.756 INFO:journalctl@ceph.prometheus.a.smithi181.stdout:Mar 30 13:38:01 smithi181 podman[45813]: 2024-03-30 13:38:01.661926559 +0000 UTC m=+0.265563464 container create 9fa29bb6babafba019c2e1b9778c544123fcd1f095fcbea7ac951114f3e237e9 (image=quay.io/prometheus/prometheus:v2.33.4, name=ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-prometheus-a, maintainer=The Prometheus Authors ) 2024-03-30T13:38:01.917 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:38:01 smithi099 ceph-mon[24912]: from='client.? 172.21.15.99:0/3858882788' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "foo"}]': finished 2024-03-30T13:38:01.917 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:38:01 smithi099 ceph-mon[24912]: osdmap e73: 8 total, 8 up, 8 in 2024-03-30T13:38:02.115 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:38:01 smithi181 ceph-mon[25762]: from='client.? 172.21.15.99:0/3858882788' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "foo"}]': finished 2024-03-30T13:38:02.115 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:38:01 smithi181 ceph-mon[25762]: osdmap e73: 8 total, 8 up, 8 in 2024-03-30T13:38:02.115 INFO:journalctl@ceph.prometheus.a.smithi181.stdout:Mar 30 13:38:01 smithi181 podman[45813]: 2024-03-30 13:38:01.855765199 +0000 UTC m=+0.459402104 container init 9fa29bb6babafba019c2e1b9778c544123fcd1f095fcbea7ac951114f3e237e9 (image=quay.io/prometheus/prometheus:v2.33.4, name=ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-prometheus-a, maintainer=The Prometheus Authors ) 2024-03-30T13:38:02.115 INFO:journalctl@ceph.prometheus.a.smithi181.stdout:Mar 30 13:38:01 smithi181 podman[45813]: 2024-03-30 13:38:01.858385428 +0000 UTC m=+0.462022343 container start 9fa29bb6babafba019c2e1b9778c544123fcd1f095fcbea7ac951114f3e237e9 (image=quay.io/prometheus/prometheus:v2.33.4, name=ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-prometheus-a, maintainer=The Prometheus Authors ) 2024-03-30T13:38:02.116 INFO:journalctl@ceph.prometheus.a.smithi181.stdout:Mar 30 13:38:01 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-prometheus-a[45828]: ts=2024-03-30T13:38:01.880Z caller=main.go:475 level=info msg="No time or size retention was set so using the default time retention" duration=15d 2024-03-30T13:38:02.116 INFO:journalctl@ceph.prometheus.a.smithi181.stdout:Mar 30 13:38:01 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-prometheus-a[45828]: ts=2024-03-30T13:38:01.880Z caller=main.go:512 level=info msg="Starting Prometheus" version="(version=2.33.4, branch=HEAD, revision=83032011a5d3e6102624fe58241a374a7201fee8)" 2024-03-30T13:38:02.116 INFO:journalctl@ceph.prometheus.a.smithi181.stdout:Mar 30 13:38:01 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-prometheus-a[45828]: ts=2024-03-30T13:38:01.880Z caller=main.go:517 level=info build_context="(go=go1.17.7, user=root@d13bf69e7be8, date=20220222-16:51:28)" 2024-03-30T13:38:02.116 INFO:journalctl@ceph.prometheus.a.smithi181.stdout:Mar 30 13:38:01 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-prometheus-a[45828]: ts=2024-03-30T13:38:01.880Z caller=main.go:518 level=info host_details="(Linux 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 x86_64 smithi181 (none))" 2024-03-30T13:38:02.116 INFO:journalctl@ceph.prometheus.a.smithi181.stdout:Mar 30 13:38:01 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-prometheus-a[45828]: ts=2024-03-30T13:38:01.880Z caller=main.go:519 level=info fd_limits="(soft=1048576, hard=1048576)" 2024-03-30T13:38:02.116 INFO:journalctl@ceph.prometheus.a.smithi181.stdout:Mar 30 13:38:01 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-prometheus-a[45828]: ts=2024-03-30T13:38:01.880Z caller=main.go:520 level=info vm_limits="(soft=unlimited, hard=unlimited)" 2024-03-30T13:38:02.116 INFO:journalctl@ceph.prometheus.a.smithi181.stdout:Mar 30 13:38:01 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-prometheus-a[45828]: ts=2024-03-30T13:38:01.882Z caller=web.go:570 level=info component=web msg="Start listening for connections" address=:9095 2024-03-30T13:38:02.116 INFO:journalctl@ceph.prometheus.a.smithi181.stdout:Mar 30 13:38:01 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-prometheus-a[45828]: ts=2024-03-30T13:38:01.882Z caller=main.go:923 level=info msg="Starting TSDB ..." 2024-03-30T13:38:02.116 INFO:journalctl@ceph.prometheus.a.smithi181.stdout:Mar 30 13:38:01 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-prometheus-a[45828]: ts=2024-03-30T13:38:01.883Z caller=tls_config.go:195 level=info component=web msg="TLS is disabled." http2=false 2024-03-30T13:38:02.116 INFO:journalctl@ceph.prometheus.a.smithi181.stdout:Mar 30 13:38:01 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-prometheus-a[45828]: ts=2024-03-30T13:38:01.885Z caller=head.go:493 level=info component=tsdb msg="Replaying on-disk memory mappable chunks if any" 2024-03-30T13:38:02.116 INFO:journalctl@ceph.prometheus.a.smithi181.stdout:Mar 30 13:38:01 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-prometheus-a[45828]: ts=2024-03-30T13:38:01.885Z caller=head.go:527 level=info component=tsdb msg="On-disk memory mappable chunks replay completed" duration=1.555µs 2024-03-30T13:38:02.117 INFO:journalctl@ceph.prometheus.a.smithi181.stdout:Mar 30 13:38:01 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-prometheus-a[45828]: ts=2024-03-30T13:38:01.885Z caller=head.go:533 level=info component=tsdb msg="Replaying WAL, this may take a while" 2024-03-30T13:38:02.117 INFO:journalctl@ceph.prometheus.a.smithi181.stdout:Mar 30 13:38:01 smithi181 bash[45813]: 9fa29bb6babafba019c2e1b9778c544123fcd1f095fcbea7ac951114f3e237e9 2024-03-30T13:38:02.117 INFO:journalctl@ceph.prometheus.a.smithi181.stdout:Mar 30 13:38:01 smithi181 systemd[1]: Started Ceph prometheus.a for 98ebaeb8-ee99-11ee-b647-cb9ed24678a4. 2024-03-30T13:38:02.117 INFO:journalctl@ceph.prometheus.a.smithi181.stdout:Mar 30 13:38:02 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-prometheus-a[45828]: ts=2024-03-30T13:38:02.114Z caller=head.go:604 level=info component=tsdb msg="WAL segment loaded" segment=0 maxSegment=2 2024-03-30T13:38:02.167 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:38:01 smithi099 ceph-mon[29691]: from='client.? 172.21.15.99:0/3858882788' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "foo"}]': finished 2024-03-30T13:38:02.167 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:38:01 smithi099 ceph-mon[29691]: osdmap e73: 8 total, 8 up, 8 in 2024-03-30T13:38:02.506 INFO:journalctl@ceph.prometheus.a.smithi181.stdout:Mar 30 13:38:02 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-prometheus-a[45828]: ts=2024-03-30T13:38:02.310Z caller=head.go:604 level=info component=tsdb msg="WAL segment loaded" segment=1 maxSegment=2 2024-03-30T13:38:02.506 INFO:journalctl@ceph.prometheus.a.smithi181.stdout:Mar 30 13:38:02 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-prometheus-a[45828]: ts=2024-03-30T13:38:02.310Z caller=head.go:604 level=info component=tsdb msg="WAL segment loaded" segment=2 maxSegment=2 2024-03-30T13:38:02.506 INFO:journalctl@ceph.prometheus.a.smithi181.stdout:Mar 30 13:38:02 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-prometheus-a[45828]: ts=2024-03-30T13:38:02.310Z caller=head.go:610 level=info component=tsdb msg="WAL replay completed" checkpoint_replay_duration=27.721µs wal_replay_duration=425.114614ms total_replay_duration=425.159496ms 2024-03-30T13:38:02.506 INFO:journalctl@ceph.prometheus.a.smithi181.stdout:Mar 30 13:38:02 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-prometheus-a[45828]: ts=2024-03-30T13:38:02.313Z caller=main.go:944 level=info fs_type=XFS_SUPER_MAGIC 2024-03-30T13:38:02.506 INFO:journalctl@ceph.prometheus.a.smithi181.stdout:Mar 30 13:38:02 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-prometheus-a[45828]: ts=2024-03-30T13:38:02.313Z caller=main.go:947 level=info msg="TSDB started" 2024-03-30T13:38:02.506 INFO:journalctl@ceph.prometheus.a.smithi181.stdout:Mar 30 13:38:02 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-prometheus-a[45828]: ts=2024-03-30T13:38:02.313Z caller=main.go:1128 level=info msg="Loading configuration file" filename=/etc/prometheus/prometheus.yml 2024-03-30T13:38:02.506 INFO:journalctl@ceph.prometheus.a.smithi181.stdout:Mar 30 13:38:02 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-prometheus-a[45828]: ts=2024-03-30T13:38:02.329Z caller=main.go:1165 level=info msg="Completed loading of configuration file" filename=/etc/prometheus/prometheus.yml totalDuration=16.572034ms db_storage=620ns remote_storage=1.161µs web_handler=440ns query_engine=850ns scrape=634.396µs scrape_sd=22.997µs notify=194.407µs notify_sd=10.032µs rules=15.417588ms 2024-03-30T13:38:02.507 INFO:journalctl@ceph.prometheus.a.smithi181.stdout:Mar 30 13:38:02 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-prometheus-a[45828]: ts=2024-03-30T13:38:02.329Z caller=main.go:896 level=info msg="Server is ready to receive web requests." 2024-03-30T13:38:03.087 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:38:02 smithi099 ceph-mon[29691]: pgmap v79: 161 pgs: 32 unknown, 4 peering, 125 active+clean; 581 KiB data, 52 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:38:03.087 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:38:02 smithi099 ceph-mon[29691]: osdmap e74: 8 total, 8 up, 8 in 2024-03-30T13:38:03.088 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:38:02 smithi099 ceph-mon[29691]: from='mgr.14439 ' entity='mgr.y' 2024-03-30T13:38:03.088 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:38:02 smithi099 ceph-mon[29691]: from='mgr.14439 172.21.15.99:0/1757456350' entity='mgr.y' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-03-30T13:38:03.088 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:38:02 smithi099 ceph-mon[29691]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-03-30T13:38:03.088 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:38:02 smithi099 ceph-mon[29691]: from='mgr.14439 172.21.15.99:0/1757456350' entity='mgr.y' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://172.21.15.99:9093"}]: dispatch 2024-03-30T13:38:03.088 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:38:02 smithi099 ceph-mon[29691]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://172.21.15.99:9093"}]: dispatch 2024-03-30T13:38:03.088 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:38:02 smithi099 ceph-mon[29691]: from='mgr.14439 ' entity='mgr.y' 2024-03-30T13:38:03.088 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:38:02 smithi099 ceph-mon[29691]: from='mgr.14439 172.21.15.99:0/1757456350' entity='mgr.y' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-03-30T13:38:03.088 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:38:02 smithi099 ceph-mon[29691]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-03-30T13:38:03.088 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:38:02 smithi099 ceph-mon[29691]: from='mgr.14439 172.21.15.99:0/1757456350' entity='mgr.y' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-03-30T13:38:03.088 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:38:02 smithi099 ceph-mon[29691]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-03-30T13:38:03.088 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:38:02 smithi099 ceph-mon[29691]: from='mgr.14439 172.21.15.99:0/1757456350' entity='mgr.y' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://172.21.15.181:3000"}]: dispatch 2024-03-30T13:38:03.088 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:38:02 smithi099 ceph-mon[29691]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://172.21.15.181:3000"}]: dispatch 2024-03-30T13:38:03.088 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:38:02 smithi099 ceph-mon[29691]: from='mgr.14439 ' entity='mgr.y' 2024-03-30T13:38:03.089 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:38:02 smithi099 ceph-mon[29691]: from='mgr.14439 172.21.15.99:0/1757456350' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:38:03.089 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:38:02 smithi099 ceph-mon[29691]: from='mgr.14439 172.21.15.99:0/1757456350' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:38:03.089 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:38:02 smithi099 ceph-mon[29691]: pgmap v81: 161 pgs: 32 unknown, 4 peering, 125 active+clean; 581 KiB data, 52 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:38:03.089 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:38:02 smithi099 ceph-mon[29691]: from='mgr.14439 ' entity='mgr.y' 2024-03-30T13:38:03.089 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:38:02 smithi099 ceph-mon[29691]: from='mgr.14439 ' entity='mgr.y' 2024-03-30T13:38:03.089 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:38:02 smithi099 ceph-mon[29691]: from='mgr.14439 ' entity='mgr.y' 2024-03-30T13:38:03.089 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:38:02 smithi099 ceph-mon[29691]: Saving service rgw.foo spec with placement count:2 2024-03-30T13:38:03.089 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:38:02 smithi099 ceph-mon[29691]: from='mgr.14439 ' entity='mgr.y' 2024-03-30T13:38:03.089 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:38:02 smithi099 ceph-mon[29691]: from='mgr.14439 172.21.15.99:0/1757456350' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.foo.smithi099.fxjbmp", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2024-03-30T13:38:03.089 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:38:02 smithi099 ceph-mon[29691]: from='mgr.14439 ' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.foo.smithi099.fxjbmp", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2024-03-30T13:38:03.089 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:38:02 smithi099 ceph-mon[29691]: from='mgr.14439 ' entity='mgr.y' cmd='[{"prefix": "auth get-or-create", "entity": "client.rgw.foo.smithi099.fxjbmp", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]': finished 2024-03-30T13:38:03.089 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:38:02 smithi099 ceph-mon[29691]: from='mgr.14439 ' entity='mgr.y' 2024-03-30T13:38:03.089 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:38:02 smithi099 ceph-mon[29691]: from='mgr.14439 172.21.15.99:0/1757456350' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:38:03.089 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:38:02 smithi099 ceph-mon[29691]: Deploying daemon rgw.foo.smithi099.fxjbmp on smithi099 2024-03-30T13:38:03.090 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:38:02 smithi099 ceph-mon[24912]: pgmap v79: 161 pgs: 32 unknown, 4 peering, 125 active+clean; 581 KiB data, 52 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:38:03.090 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:38:02 smithi099 ceph-mon[24912]: osdmap e74: 8 total, 8 up, 8 in 2024-03-30T13:38:03.090 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:38:02 smithi099 ceph-mon[24912]: from='mgr.14439 ' entity='mgr.y' 2024-03-30T13:38:03.090 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:38:02 smithi099 ceph-mon[24912]: from='mgr.14439 172.21.15.99:0/1757456350' entity='mgr.y' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-03-30T13:38:03.090 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:38:02 smithi099 ceph-mon[24912]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-03-30T13:38:03.090 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:38:02 smithi099 ceph-mon[24912]: from='mgr.14439 172.21.15.99:0/1757456350' entity='mgr.y' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://172.21.15.99:9093"}]: dispatch 2024-03-30T13:38:03.090 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:38:02 smithi099 ceph-mon[24912]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://172.21.15.99:9093"}]: dispatch 2024-03-30T13:38:03.090 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:38:02 smithi099 ceph-mon[24912]: from='mgr.14439 ' entity='mgr.y' 2024-03-30T13:38:03.090 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:38:02 smithi099 ceph-mon[24912]: from='mgr.14439 172.21.15.99:0/1757456350' entity='mgr.y' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-03-30T13:38:03.091 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:38:02 smithi099 ceph-mon[24912]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-03-30T13:38:03.091 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:38:02 smithi099 ceph-mon[24912]: from='mgr.14439 172.21.15.99:0/1757456350' entity='mgr.y' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-03-30T13:38:03.091 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:38:02 smithi099 ceph-mon[24912]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-03-30T13:38:03.091 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:38:02 smithi099 ceph-mon[24912]: from='mgr.14439 172.21.15.99:0/1757456350' entity='mgr.y' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://172.21.15.181:3000"}]: dispatch 2024-03-30T13:38:03.091 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:38:02 smithi099 ceph-mon[24912]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://172.21.15.181:3000"}]: dispatch 2024-03-30T13:38:03.091 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:38:02 smithi099 ceph-mon[24912]: from='mgr.14439 ' entity='mgr.y' 2024-03-30T13:38:03.091 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:38:02 smithi099 ceph-mon[24912]: from='mgr.14439 172.21.15.99:0/1757456350' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:38:03.091 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:38:02 smithi099 ceph-mon[24912]: from='mgr.14439 172.21.15.99:0/1757456350' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:38:03.091 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:38:02 smithi099 ceph-mon[24912]: pgmap v81: 161 pgs: 32 unknown, 4 peering, 125 active+clean; 581 KiB data, 52 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:38:03.091 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:38:02 smithi099 ceph-mon[24912]: from='mgr.14439 ' entity='mgr.y' 2024-03-30T13:38:03.091 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:38:02 smithi099 ceph-mon[24912]: from='mgr.14439 ' entity='mgr.y' 2024-03-30T13:38:03.091 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:38:02 smithi099 ceph-mon[24912]: from='mgr.14439 ' entity='mgr.y' 2024-03-30T13:38:03.091 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:38:02 smithi099 ceph-mon[24912]: Saving service rgw.foo spec with placement count:2 2024-03-30T13:38:03.092 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:38:02 smithi099 ceph-mon[24912]: from='mgr.14439 ' entity='mgr.y' 2024-03-30T13:38:03.092 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:38:02 smithi099 ceph-mon[24912]: from='mgr.14439 172.21.15.99:0/1757456350' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.foo.smithi099.fxjbmp", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2024-03-30T13:38:03.092 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:38:02 smithi099 ceph-mon[24912]: from='mgr.14439 ' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.foo.smithi099.fxjbmp", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2024-03-30T13:38:03.092 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:38:02 smithi099 ceph-mon[24912]: from='mgr.14439 ' entity='mgr.y' cmd='[{"prefix": "auth get-or-create", "entity": "client.rgw.foo.smithi099.fxjbmp", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]': finished 2024-03-30T13:38:03.092 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:38:02 smithi099 ceph-mon[24912]: from='mgr.14439 ' entity='mgr.y' 2024-03-30T13:38:03.092 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:38:02 smithi099 ceph-mon[24912]: from='mgr.14439 172.21.15.99:0/1757456350' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:38:03.092 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:38:02 smithi099 ceph-mon[24912]: Deploying daemon rgw.foo.smithi099.fxjbmp on smithi099 2024-03-30T13:38:03.256 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:38:02 smithi181 ceph-mon[25762]: pgmap v79: 161 pgs: 32 unknown, 4 peering, 125 active+clean; 581 KiB data, 52 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:38:03.257 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:38:02 smithi181 ceph-mon[25762]: osdmap e74: 8 total, 8 up, 8 in 2024-03-30T13:38:03.257 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:38:02 smithi181 ceph-mon[25762]: from='mgr.14439 ' entity='mgr.y' 2024-03-30T13:38:03.257 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:38:02 smithi181 ceph-mon[25762]: from='mgr.14439 172.21.15.99:0/1757456350' entity='mgr.y' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-03-30T13:38:03.257 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:38:02 smithi181 ceph-mon[25762]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-03-30T13:38:03.257 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:38:02 smithi181 ceph-mon[25762]: from='mgr.14439 172.21.15.99:0/1757456350' entity='mgr.y' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://172.21.15.99:9093"}]: dispatch 2024-03-30T13:38:03.257 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:38:02 smithi181 ceph-mon[25762]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://172.21.15.99:9093"}]: dispatch 2024-03-30T13:38:03.257 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:38:02 smithi181 ceph-mon[25762]: from='mgr.14439 ' entity='mgr.y' 2024-03-30T13:38:03.257 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:38:02 smithi181 ceph-mon[25762]: from='mgr.14439 172.21.15.99:0/1757456350' entity='mgr.y' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-03-30T13:38:03.257 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:38:02 smithi181 ceph-mon[25762]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-03-30T13:38:03.257 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:38:02 smithi181 ceph-mon[25762]: from='mgr.14439 172.21.15.99:0/1757456350' entity='mgr.y' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-03-30T13:38:03.258 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:38:02 smithi181 ceph-mon[25762]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-03-30T13:38:03.258 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:38:02 smithi181 ceph-mon[25762]: from='mgr.14439 172.21.15.99:0/1757456350' entity='mgr.y' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://172.21.15.181:3000"}]: dispatch 2024-03-30T13:38:03.258 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:38:02 smithi181 ceph-mon[25762]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://172.21.15.181:3000"}]: dispatch 2024-03-30T13:38:03.258 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:38:02 smithi181 ceph-mon[25762]: from='mgr.14439 ' entity='mgr.y' 2024-03-30T13:38:03.258 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:38:02 smithi181 ceph-mon[25762]: from='mgr.14439 172.21.15.99:0/1757456350' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:38:03.258 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:38:02 smithi181 ceph-mon[25762]: from='mgr.14439 172.21.15.99:0/1757456350' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:38:03.258 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:38:02 smithi181 ceph-mon[25762]: pgmap v81: 161 pgs: 32 unknown, 4 peering, 125 active+clean; 581 KiB data, 52 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:38:03.258 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:38:02 smithi181 ceph-mon[25762]: from='mgr.14439 ' entity='mgr.y' 2024-03-30T13:38:03.258 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:38:02 smithi181 ceph-mon[25762]: from='mgr.14439 ' entity='mgr.y' 2024-03-30T13:38:03.258 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:38:02 smithi181 ceph-mon[25762]: from='mgr.14439 ' entity='mgr.y' 2024-03-30T13:38:03.258 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:38:02 smithi181 ceph-mon[25762]: Saving service rgw.foo spec with placement count:2 2024-03-30T13:38:03.259 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:38:02 smithi181 ceph-mon[25762]: from='mgr.14439 ' entity='mgr.y' 2024-03-30T13:38:03.259 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:38:02 smithi181 ceph-mon[25762]: from='mgr.14439 172.21.15.99:0/1757456350' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.foo.smithi099.fxjbmp", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2024-03-30T13:38:03.259 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:38:02 smithi181 ceph-mon[25762]: from='mgr.14439 ' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.foo.smithi099.fxjbmp", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2024-03-30T13:38:03.259 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:38:02 smithi181 ceph-mon[25762]: from='mgr.14439 ' entity='mgr.y' cmd='[{"prefix": "auth get-or-create", "entity": "client.rgw.foo.smithi099.fxjbmp", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]': finished 2024-03-30T13:38:03.259 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:38:02 smithi181 ceph-mon[25762]: from='mgr.14439 ' entity='mgr.y' 2024-03-30T13:38:03.259 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:38:02 smithi181 ceph-mon[25762]: from='mgr.14439 172.21.15.99:0/1757456350' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:38:03.259 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:38:02 smithi181 ceph-mon[25762]: Deploying daemon rgw.foo.smithi099.fxjbmp on smithi099 2024-03-30T13:38:04.087 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:38:03 smithi099 ceph-mon[24912]: osdmap e75: 8 total, 8 up, 8 in 2024-03-30T13:38:04.087 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:38:03 smithi099 ceph-mon[24912]: Health check cleared: CEPHADM_FAILED_DAEMON (was: 1 failed cephadm daemon(s)) 2024-03-30T13:38:04.087 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:38:03 smithi099 ceph-mon[24912]: Cluster is now healthy 2024-03-30T13:38:04.087 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:38:03 smithi099 ceph-mon[29691]: osdmap e75: 8 total, 8 up, 8 in 2024-03-30T13:38:04.087 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:38:03 smithi099 ceph-mon[29691]: Health check cleared: CEPHADM_FAILED_DAEMON (was: 1 failed cephadm daemon(s)) 2024-03-30T13:38:04.087 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:38:03 smithi099 ceph-mon[29691]: Cluster is now healthy 2024-03-30T13:38:04.256 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:38:03 smithi181 ceph-mon[25762]: osdmap e75: 8 total, 8 up, 8 in 2024-03-30T13:38:04.256 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:38:03 smithi181 ceph-mon[25762]: Health check cleared: CEPHADM_FAILED_DAEMON (was: 1 failed cephadm daemon(s)) 2024-03-30T13:38:04.256 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:38:03 smithi181 ceph-mon[25762]: Cluster is now healthy 2024-03-30T13:38:05.168 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:38:04 smithi099 ceph-mon[24912]: pgmap v83: 161 pgs: 32 unknown, 4 peering, 125 active+clean; 581 KiB data, 52 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:38:05.168 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:38:04 smithi099 ceph-mon[24912]: from='client.? 172.21.15.99:0/2562514994' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "foo","app": "rbd"}]: dispatch 2024-03-30T13:38:05.169 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:38:04 smithi099 ceph-mon[29691]: pgmap v83: 161 pgs: 32 unknown, 4 peering, 125 active+clean; 581 KiB data, 52 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:38:05.169 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:38:04 smithi099 ceph-mon[29691]: from='client.? 172.21.15.99:0/2562514994' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "foo","app": "rbd"}]: dispatch 2024-03-30T13:38:05.256 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:38:04 smithi181 ceph-mon[25762]: pgmap v83: 161 pgs: 32 unknown, 4 peering, 125 active+clean; 581 KiB data, 52 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:38:05.256 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:38:04 smithi181 ceph-mon[25762]: from='client.? 172.21.15.99:0/2562514994' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "foo","app": "rbd"}]: dispatch 2024-03-30T13:38:06.070 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:38:05 smithi099 ceph-mon[24912]: from='client.? 172.21.15.99:0/2562514994' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "foo","app": "rbd"}]': finished 2024-03-30T13:38:06.071 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:38:05 smithi099 ceph-mon[24912]: osdmap e76: 8 total, 8 up, 8 in 2024-03-30T13:38:06.071 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:38:05 smithi099 ceph-mon[29691]: from='client.? 172.21.15.99:0/2562514994' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "foo","app": "rbd"}]': finished 2024-03-30T13:38:06.071 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:38:05 smithi099 ceph-mon[29691]: osdmap e76: 8 total, 8 up, 8 in 2024-03-30T13:38:06.256 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:38:05 smithi181 ceph-mon[25762]: from='client.? 172.21.15.99:0/2562514994' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "foo","app": "rbd"}]': finished 2024-03-30T13:38:06.256 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:38:05 smithi181 ceph-mon[25762]: osdmap e76: 8 total, 8 up, 8 in 2024-03-30T13:38:07.029 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:38:06 smithi099 ceph-mon[24912]: osdmap e77: 8 total, 8 up, 8 in 2024-03-30T13:38:07.029 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:38:06 smithi099 ceph-mon[24912]: pgmap v86: 161 pgs: 161 active+clean; 581 KiB data, 53 MiB used, 715 GiB / 715 GiB avail; 0 B/s, 0 objects/s recovering 2024-03-30T13:38:07.030 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:38:06 smithi099 ceph-mon[24912]: from='mgr.14439 ' entity='mgr.y' 2024-03-30T13:38:07.030 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:38:06 smithi099 ceph-mon[24912]: from='mgr.14439 172.21.15.99:0/1757456350' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.foo.smithi181.wfqwti", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2024-03-30T13:38:07.030 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:38:06 smithi099 ceph-mon[24912]: from='mgr.14439 ' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.foo.smithi181.wfqwti", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2024-03-30T13:38:07.030 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:38:06 smithi099 ceph-mon[24912]: from='mgr.14439 ' entity='mgr.y' cmd='[{"prefix": "auth get-or-create", "entity": "client.rgw.foo.smithi181.wfqwti", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]': finished 2024-03-30T13:38:07.030 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:38:06 smithi099 ceph-mon[24912]: from='mgr.14439 ' entity='mgr.y' 2024-03-30T13:38:07.030 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:38:06 smithi099 ceph-mon[24912]: from='mgr.14439 172.21.15.99:0/1757456350' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:38:07.030 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:38:06 smithi099 ceph-mon[29691]: osdmap e77: 8 total, 8 up, 8 in 2024-03-30T13:38:07.030 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:38:06 smithi099 ceph-mon[29691]: pgmap v86: 161 pgs: 161 active+clean; 581 KiB data, 53 MiB used, 715 GiB / 715 GiB avail; 0 B/s, 0 objects/s recovering 2024-03-30T13:38:07.030 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:38:06 smithi099 ceph-mon[29691]: from='mgr.14439 ' entity='mgr.y' 2024-03-30T13:38:07.030 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:38:06 smithi099 ceph-mon[29691]: from='mgr.14439 172.21.15.99:0/1757456350' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.foo.smithi181.wfqwti", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2024-03-30T13:38:07.030 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:38:06 smithi099 ceph-mon[29691]: from='mgr.14439 ' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.foo.smithi181.wfqwti", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2024-03-30T13:38:07.031 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:38:06 smithi099 ceph-mon[29691]: from='mgr.14439 ' entity='mgr.y' cmd='[{"prefix": "auth get-or-create", "entity": "client.rgw.foo.smithi181.wfqwti", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]': finished 2024-03-30T13:38:07.031 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:38:06 smithi099 ceph-mon[29691]: from='mgr.14439 ' entity='mgr.y' 2024-03-30T13:38:07.031 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:38:06 smithi099 ceph-mon[29691]: from='mgr.14439 172.21.15.99:0/1757456350' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:38:07.256 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:38:06 smithi181 ceph-mon[25762]: osdmap e77: 8 total, 8 up, 8 in 2024-03-30T13:38:07.256 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:38:06 smithi181 ceph-mon[25762]: pgmap v86: 161 pgs: 161 active+clean; 581 KiB data, 53 MiB used, 715 GiB / 715 GiB avail; 0 B/s, 0 objects/s recovering 2024-03-30T13:38:07.256 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:38:06 smithi181 ceph-mon[25762]: from='mgr.14439 ' entity='mgr.y' 2024-03-30T13:38:07.256 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:38:06 smithi181 ceph-mon[25762]: from='mgr.14439 172.21.15.99:0/1757456350' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.foo.smithi181.wfqwti", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2024-03-30T13:38:07.256 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:38:06 smithi181 ceph-mon[25762]: from='mgr.14439 ' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.foo.smithi181.wfqwti", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2024-03-30T13:38:07.256 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:38:06 smithi181 ceph-mon[25762]: from='mgr.14439 ' entity='mgr.y' cmd='[{"prefix": "auth get-or-create", "entity": "client.rgw.foo.smithi181.wfqwti", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]': finished 2024-03-30T13:38:07.256 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:38:06 smithi181 ceph-mon[25762]: from='mgr.14439 ' entity='mgr.y' 2024-03-30T13:38:07.256 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:38:06 smithi181 ceph-mon[25762]: from='mgr.14439 172.21.15.99:0/1757456350' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:38:07.643 INFO:journalctl@ceph.alertmanager.a.smithi099.stdout:Mar 30 13:38:07 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-alertmanager-a[52107]: level=info ts=2024-03-30T13:38:07.557Z caller=cluster.go:688 component=cluster msg="gossip settled; proceeding" elapsed=10.003550419s 2024-03-30T13:38:07.942 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:38:07 smithi181 ceph-mon[25762]: Deploying daemon rgw.foo.smithi181.wfqwti on smithi181 2024-03-30T13:38:07.942 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:38:07 smithi181 ceph-mon[25762]: osdmap e78: 8 total, 8 up, 8 in 2024-03-30T13:38:08.331 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:38:07 smithi099 ceph-mon[24912]: Deploying daemon rgw.foo.smithi181.wfqwti on smithi181 2024-03-30T13:38:08.332 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:38:07 smithi099 ceph-mon[24912]: osdmap e78: 8 total, 8 up, 8 in 2024-03-30T13:38:08.332 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:38:07 smithi099 ceph-mon[29691]: Deploying daemon rgw.foo.smithi181.wfqwti on smithi181 2024-03-30T13:38:08.332 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:38:07 smithi099 ceph-mon[29691]: osdmap e78: 8 total, 8 up, 8 in 2024-03-30T13:38:08.333 DEBUG:teuthology.orchestra.run.smithi099:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 98ebaeb8-ee99-11ee-b647-cb9ed24678a4 -e sha1=4e50bbcdd1630c7760b708f3a5b4d38a121e66cb -- bash -c 'ceph orch apply iscsi foo u p' 2024-03-30T13:38:09.006 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:38:08 smithi181 ceph-mon[25762]: pgmap v88: 161 pgs: 161 active+clean; 581 KiB data, 53 MiB used, 715 GiB / 715 GiB avail; 0 B/s, 0 objects/s recovering 2024-03-30T13:38:09.079 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:38:08 smithi099 ceph-mon[24912]: pgmap v88: 161 pgs: 161 active+clean; 581 KiB data, 53 MiB used, 715 GiB / 715 GiB avail; 0 B/s, 0 objects/s recovering 2024-03-30T13:38:09.080 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:38:08 smithi099 ceph-mon[29691]: pgmap v88: 161 pgs: 161 active+clean; 581 KiB data, 53 MiB used, 715 GiB / 715 GiB avail; 0 B/s, 0 objects/s recovering 2024-03-30T13:38:09.756 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 13:38:09 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-x[27332]: ::ffff:172.21.15.181 - - [30/Mar/2024:13:38:09] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-03-30T13:38:10.206 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:38:10 smithi099 ceph-mon[24912]: pgmap v89: 161 pgs: 161 active+clean; 581 KiB data, 53 MiB used, 715 GiB / 715 GiB avail; 0 B/s, 0 objects/s recovering 2024-03-30T13:38:10.207 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:38:10 smithi099 ceph-mon[29691]: pgmap v89: 161 pgs: 161 active+clean; 581 KiB data, 53 MiB used, 715 GiB / 715 GiB avail; 0 B/s, 0 objects/s recovering 2024-03-30T13:38:10.414 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:38:10 smithi181 ceph-mon[25762]: pgmap v89: 161 pgs: 161 active+clean; 581 KiB data, 53 MiB used, 715 GiB / 715 GiB avail; 0 B/s, 0 objects/s recovering 2024-03-30T13:38:10.734 INFO:teuthology.orchestra.run.smithi099.stdout:Scheduled iscsi.foo update... 2024-03-30T13:38:11.337 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:38:11 smithi099 ceph-mon[24912]: from='mgr.14439 ' entity='mgr.y' 2024-03-30T13:38:11.337 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:38:11 smithi099 ceph-mon[24912]: from='mgr.14439 172.21.15.99:0/1757456350' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:38:11.337 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:38:11 smithi099 ceph-mon[24912]: from='mgr.14439 172.21.15.99:0/1757456350' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:38:11.337 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:38:11 smithi099 ceph-mon[24912]: Checking dashboard <-> RGW credentials 2024-03-30T13:38:11.337 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:38:11 smithi099 ceph-mon[24912]: from='mgr.14439 ' entity='mgr.y' 2024-03-30T13:38:11.338 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:38:11 smithi099 ceph-mon[24912]: from='mgr.14439 ' entity='mgr.y' 2024-03-30T13:38:11.338 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:38:11 smithi099 ceph-mon[24912]: from='mgr.14439 ' entity='mgr.y' 2024-03-30T13:38:11.338 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:38:11 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:38:11.338 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:38:11 smithi099 ceph-mon[24912]: from='mgr.14439 172.21.15.99:0/1757456350' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:38:11.338 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:38:11 smithi099 ceph-mon[24912]: from='mgr.14439 172.21.15.99:0/1757456350' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:38:11.338 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:38:11 smithi099 ceph-mon[24912]: Checking dashboard <-> RGW credentials 2024-03-30T13:38:11.338 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:38:11 smithi099 ceph-mon[24912]: from='client.14769 -' entity='client.admin' cmd=[{"prefix": "orch apply iscsi", "pool": "foo", "api_user": "u", "api_password": "p", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T13:38:11.338 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:38:11 smithi099 ceph-mon[24912]: Saving service iscsi.foo spec with placement count:1 2024-03-30T13:38:11.338 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:38:11 smithi099 ceph-mon[24912]: from='mgr.14439 ' entity='mgr.y' 2024-03-30T13:38:11.338 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:38:11 smithi099 ceph-mon[24912]: from='mgr.14439 ' entity='mgr.y' 2024-03-30T13:38:11.338 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:38:11 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:38:11.338 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:38:11 smithi099 ceph-mon[24912]: from='mgr.14439 172.21.15.99:0/1757456350' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:38:11.338 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:38:11 smithi099 ceph-mon[24912]: from='mgr.14439 172.21.15.99:0/1757456350' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:38:11.339 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:38:11 smithi099 ceph-mon[24912]: from='mgr.14439 ' entity='mgr.y' 2024-03-30T13:38:11.339 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:38:11 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:38:11.339 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:38:11 smithi099 ceph-mon[29691]: from='mgr.14439 ' entity='mgr.y' 2024-03-30T13:38:11.339 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:38:11 smithi099 ceph-mon[29691]: from='mgr.14439 172.21.15.99:0/1757456350' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:38:11.339 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:38:11 smithi099 ceph-mon[29691]: from='mgr.14439 172.21.15.99:0/1757456350' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:38:11.339 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:38:11 smithi099 ceph-mon[29691]: Checking dashboard <-> RGW credentials 2024-03-30T13:38:11.339 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:38:11 smithi099 ceph-mon[29691]: from='mgr.14439 ' entity='mgr.y' 2024-03-30T13:38:11.339 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:38:11 smithi099 ceph-mon[29691]: from='mgr.14439 ' entity='mgr.y' 2024-03-30T13:38:11.339 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:38:11 smithi099 ceph-mon[29691]: from='mgr.14439 ' entity='mgr.y' 2024-03-30T13:38:11.339 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:38:11 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:38:11.339 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:38:11 smithi099 ceph-mon[29691]: from='mgr.14439 172.21.15.99:0/1757456350' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:38:11.339 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:38:11 smithi099 ceph-mon[29691]: from='mgr.14439 172.21.15.99:0/1757456350' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:38:11.340 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:38:11 smithi099 ceph-mon[29691]: Checking dashboard <-> RGW credentials 2024-03-30T13:38:11.340 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:38:11 smithi099 ceph-mon[29691]: from='client.14769 -' entity='client.admin' cmd=[{"prefix": "orch apply iscsi", "pool": "foo", "api_user": "u", "api_password": "p", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T13:38:11.340 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:38:11 smithi099 ceph-mon[29691]: Saving service iscsi.foo spec with placement count:1 2024-03-30T13:38:11.340 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:38:11 smithi099 ceph-mon[29691]: from='mgr.14439 ' entity='mgr.y' 2024-03-30T13:38:11.340 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:38:11 smithi099 ceph-mon[29691]: from='mgr.14439 ' entity='mgr.y' 2024-03-30T13:38:11.340 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:38:11 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:38:11.340 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:38:11 smithi099 ceph-mon[29691]: from='mgr.14439 172.21.15.99:0/1757456350' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:38:11.340 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:38:11 smithi099 ceph-mon[29691]: from='mgr.14439 172.21.15.99:0/1757456350' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:38:11.340 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:38:11 smithi099 ceph-mon[29691]: from='mgr.14439 ' entity='mgr.y' 2024-03-30T13:38:11.340 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:38:11 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:38:11.511 DEBUG:teuthology.orchestra.run.smithi099:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 98ebaeb8-ee99-11ee-b647-cb9ed24678a4 -e sha1=4e50bbcdd1630c7760b708f3a5b4d38a121e66cb -- bash -c 'sleep 180' 2024-03-30T13:38:11.632 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:38:11 smithi181 ceph-mon[25762]: from='mgr.14439 ' entity='mgr.y' 2024-03-30T13:38:11.632 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:38:11 smithi181 ceph-mon[25762]: from='mgr.14439 172.21.15.99:0/1757456350' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:38:11.632 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:38:11 smithi181 ceph-mon[25762]: from='mgr.14439 172.21.15.99:0/1757456350' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:38:11.632 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:38:11 smithi181 ceph-mon[25762]: Checking dashboard <-> RGW credentials 2024-03-30T13:38:11.632 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:38:11 smithi181 ceph-mon[25762]: from='mgr.14439 ' entity='mgr.y' 2024-03-30T13:38:11.632 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:38:11 smithi181 ceph-mon[25762]: from='mgr.14439 ' entity='mgr.y' 2024-03-30T13:38:11.632 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:38:11 smithi181 ceph-mon[25762]: from='mgr.14439 ' entity='mgr.y' 2024-03-30T13:38:11.632 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:38:11 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:38:11.633 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:38:11 smithi181 ceph-mon[25762]: from='mgr.14439 172.21.15.99:0/1757456350' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:38:11.633 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:38:11 smithi181 ceph-mon[25762]: from='mgr.14439 172.21.15.99:0/1757456350' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:38:11.633 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:38:11 smithi181 ceph-mon[25762]: Checking dashboard <-> RGW credentials 2024-03-30T13:38:11.633 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:38:11 smithi181 ceph-mon[25762]: from='client.14769 -' entity='client.admin' cmd=[{"prefix": "orch apply iscsi", "pool": "foo", "api_user": "u", "api_password": "p", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T13:38:11.633 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:38:11 smithi181 ceph-mon[25762]: Saving service iscsi.foo spec with placement count:1 2024-03-30T13:38:11.633 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:38:11 smithi181 ceph-mon[25762]: from='mgr.14439 ' entity='mgr.y' 2024-03-30T13:38:11.633 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:38:11 smithi181 ceph-mon[25762]: from='mgr.14439 ' entity='mgr.y' 2024-03-30T13:38:11.633 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:38:11 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:38:11.633 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:38:11 smithi181 ceph-mon[25762]: from='mgr.14439 172.21.15.99:0/1757456350' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:38:11.633 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:38:11 smithi181 ceph-mon[25762]: from='mgr.14439 172.21.15.99:0/1757456350' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:38:11.633 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:38:11 smithi181 ceph-mon[25762]: from='mgr.14439 ' entity='mgr.y' 2024-03-30T13:38:11.633 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:38:11 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:38:12.553 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:38:12 smithi181 ceph-mon[25762]: pgmap v90: 161 pgs: 161 active+clean; 584 KiB data, 56 MiB used, 715 GiB / 715 GiB avail; 163 KiB/s rd, 5.1 KiB/s wr, 306 op/s; 0 B/s, 0 objects/s recovering 2024-03-30T13:38:12.586 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:38:12 smithi099 ceph-mon[24912]: pgmap v90: 161 pgs: 161 active+clean; 584 KiB data, 56 MiB used, 715 GiB / 715 GiB avail; 163 KiB/s rd, 5.1 KiB/s wr, 306 op/s; 0 B/s, 0 objects/s recovering 2024-03-30T13:38:12.589 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:38:12 smithi099 ceph-mon[29691]: pgmap v90: 161 pgs: 161 active+clean; 584 KiB data, 56 MiB used, 715 GiB / 715 GiB avail; 163 KiB/s rd, 5.1 KiB/s wr, 306 op/s; 0 B/s, 0 objects/s recovering 2024-03-30T13:38:14.645 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:38:14 smithi181 ceph-mon[25762]: osdmap e79: 8 total, 8 up, 8 in 2024-03-30T13:38:14.645 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:38:14 smithi181 ceph-mon[25762]: pgmap v92: 161 pgs: 161 active+clean; 584 KiB data, 56 MiB used, 715 GiB / 715 GiB avail; 144 KiB/s rd, 4.5 KiB/s wr, 270 op/s 2024-03-30T13:38:14.717 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:38:14 smithi099 ceph-mon[24912]: osdmap e79: 8 total, 8 up, 8 in 2024-03-30T13:38:14.717 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:38:14 smithi099 ceph-mon[24912]: pgmap v92: 161 pgs: 161 active+clean; 584 KiB data, 56 MiB used, 715 GiB / 715 GiB avail; 144 KiB/s rd, 4.5 KiB/s wr, 270 op/s 2024-03-30T13:38:14.717 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:38:14 smithi099 ceph-mon[29691]: osdmap e79: 8 total, 8 up, 8 in 2024-03-30T13:38:14.717 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:38:14 smithi099 ceph-mon[29691]: pgmap v92: 161 pgs: 161 active+clean; 584 KiB data, 56 MiB used, 715 GiB / 715 GiB avail; 144 KiB/s rd, 4.5 KiB/s wr, 270 op/s 2024-03-30T13:38:15.069 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:38:14 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[25141]: 172.21.15.99 - - [30/Mar/2024:13:38:14] "POST /data HTTP/1.1" 200 46 "" "Python-urllib/3.9" 2024-03-30T13:38:15.631 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:38:15 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[25141]: 172.21.15.181 - - [30/Mar/2024:13:38:15] "POST /data HTTP/1.1" 200 46 "" "Python-urllib/3.9" 2024-03-30T13:38:15.756 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:38:15 smithi181 ceph-mon[25762]: from='mgr.14439 ' entity='mgr.y' 2024-03-30T13:38:15.756 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:38:15 smithi181 ceph-mon[25762]: from='mgr.14439 ' entity='mgr.y' 2024-03-30T13:38:15.756 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:38:15 smithi181 ceph-mon[25762]: from='mgr.14439 ' entity='mgr.y' 2024-03-30T13:38:15.756 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:38:15 smithi181 ceph-mon[25762]: from='mgr.14439 ' entity='mgr.y' 2024-03-30T13:38:15.922 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:38:15 smithi099 ceph-mon[24912]: from='mgr.14439 ' entity='mgr.y' 2024-03-30T13:38:15.922 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:38:15 smithi099 ceph-mon[24912]: from='mgr.14439 ' entity='mgr.y' 2024-03-30T13:38:15.922 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:38:15 smithi099 ceph-mon[24912]: from='mgr.14439 ' entity='mgr.y' 2024-03-30T13:38:15.922 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:38:15 smithi099 ceph-mon[24912]: from='mgr.14439 ' entity='mgr.y' 2024-03-30T13:38:15.922 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:38:15 smithi099 ceph-mon[29691]: from='mgr.14439 ' entity='mgr.y' 2024-03-30T13:38:15.923 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:38:15 smithi099 ceph-mon[29691]: from='mgr.14439 ' entity='mgr.y' 2024-03-30T13:38:15.923 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:38:15 smithi099 ceph-mon[29691]: from='mgr.14439 ' entity='mgr.y' 2024-03-30T13:38:15.923 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:38:15 smithi099 ceph-mon[29691]: from='mgr.14439 ' entity='mgr.y' 2024-03-30T13:38:16.843 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:38:16 smithi181 ceph-mon[25762]: pgmap v93: 161 pgs: 161 active+clean; 585 KiB data, 65 MiB used, 715 GiB / 715 GiB avail; 131 KiB/s rd, 4.2 KiB/s wr, 243 op/s 2024-03-30T13:38:17.043 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:38:16 smithi099 ceph-mon[24912]: pgmap v93: 161 pgs: 161 active+clean; 585 KiB data, 65 MiB used, 715 GiB / 715 GiB avail; 131 KiB/s rd, 4.2 KiB/s wr, 243 op/s 2024-03-30T13:38:17.044 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:38:16 smithi099 ceph-mon[29691]: pgmap v93: 161 pgs: 161 active+clean; 585 KiB data, 65 MiB used, 715 GiB / 715 GiB avail; 131 KiB/s rd, 4.2 KiB/s wr, 243 op/s 2024-03-30T13:38:17.044 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:38:16 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[25141]: ::ffff:172.21.15.181 - - [30/Mar/2024:13:38:16] "GET /metrics HTTP/1.1" 200 207352 "" "Prometheus/2.33.4" 2024-03-30T13:38:17.337 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:38:17 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[25141]: 172.21.15.99 - - [30/Mar/2024:13:38:17] "POST /data HTTP/1.1" 200 46 "" "Python-urllib/3.9" 2024-03-30T13:38:18.399 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:38:18 smithi099 ceph-mon[24912]: from='mgr.14439 ' entity='mgr.y' 2024-03-30T13:38:18.399 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:38:18 smithi099 ceph-mon[24912]: pgmap v94: 161 pgs: 161 active+clean; 585 KiB data, 65 MiB used, 715 GiB / 715 GiB avail; 119 KiB/s rd, 3.8 KiB/s wr, 220 op/s 2024-03-30T13:38:18.399 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:38:18 smithi099 ceph-mon[29691]: from='mgr.14439 ' entity='mgr.y' 2024-03-30T13:38:18.400 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:38:18 smithi099 ceph-mon[29691]: pgmap v94: 161 pgs: 161 active+clean; 585 KiB data, 65 MiB used, 715 GiB / 715 GiB avail; 119 KiB/s rd, 3.8 KiB/s wr, 220 op/s 2024-03-30T13:38:18.400 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:38:18 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[25141]: 172.21.15.99 - - [30/Mar/2024:13:38:18] "POST /data HTTP/1.1" 200 46 "" "Python-urllib/3.9" 2024-03-30T13:38:18.400 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:38:18 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[25141]: 172.21.15.99 - - [30/Mar/2024:13:38:18] "POST /data HTTP/1.1" 200 46 "" "Python-urllib/3.9" 2024-03-30T13:38:18.506 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:38:18 smithi181 ceph-mon[25762]: from='mgr.14439 ' entity='mgr.y' 2024-03-30T13:38:18.506 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:38:18 smithi181 ceph-mon[25762]: pgmap v94: 161 pgs: 161 active+clean; 585 KiB data, 65 MiB used, 715 GiB / 715 GiB avail; 119 KiB/s rd, 3.8 KiB/s wr, 220 op/s 2024-03-30T13:38:19.462 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:38:19 smithi181 ceph-mon[25762]: from='mgr.14439 ' entity='mgr.y' 2024-03-30T13:38:19.462 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:38:19 smithi181 ceph-mon[25762]: from='mgr.14439 ' entity='mgr.y' 2024-03-30T13:38:19.462 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:38:19 smithi181 ceph-mon[25762]: from='mgr.14439 ' entity='mgr.y' 2024-03-30T13:38:19.587 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:38:19 smithi099 ceph-mon[29691]: from='mgr.14439 ' entity='mgr.y' 2024-03-30T13:38:19.587 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:38:19 smithi099 ceph-mon[29691]: from='mgr.14439 ' entity='mgr.y' 2024-03-30T13:38:19.587 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:38:19 smithi099 ceph-mon[29691]: from='mgr.14439 ' entity='mgr.y' 2024-03-30T13:38:19.587 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:38:19 smithi099 ceph-mon[24912]: from='mgr.14439 ' entity='mgr.y' 2024-03-30T13:38:19.587 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:38:19 smithi099 ceph-mon[24912]: from='mgr.14439 ' entity='mgr.y' 2024-03-30T13:38:19.587 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:38:19 smithi099 ceph-mon[24912]: from='mgr.14439 ' entity='mgr.y' 2024-03-30T13:38:19.756 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 13:38:19 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-x[27332]: ::ffff:172.21.15.181 - - [30/Mar/2024:13:38:19] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-03-30T13:38:20.506 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:38:20 smithi181 ceph-mon[25762]: pgmap v95: 161 pgs: 161 active+clean; 585 KiB data, 65 MiB used, 715 GiB / 715 GiB avail; 119 KiB/s rd, 3.8 KiB/s wr, 220 op/s 2024-03-30T13:38:20.587 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:38:20 smithi099 ceph-mon[24912]: pgmap v95: 161 pgs: 161 active+clean; 585 KiB data, 65 MiB used, 715 GiB / 715 GiB avail; 119 KiB/s rd, 3.8 KiB/s wr, 220 op/s 2024-03-30T13:38:20.587 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:38:20 smithi099 ceph-mon[29691]: pgmap v95: 161 pgs: 161 active+clean; 585 KiB data, 65 MiB used, 715 GiB / 715 GiB avail; 119 KiB/s rd, 3.8 KiB/s wr, 220 op/s 2024-03-30T13:38:21.337 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:38:20 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[25141]: 172.21.15.181 - - [30/Mar/2024:13:38:20] "POST /data HTTP/1.1" 200 46 "" "Python-urllib/3.9" 2024-03-30T13:38:22.256 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:38:21 smithi181 ceph-mon[25762]: from='mgr.14439 ' entity='mgr.y' 2024-03-30T13:38:22.256 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:38:21 smithi181 ceph-mon[25762]: from='mgr.14439 ' entity='mgr.y' 2024-03-30T13:38:22.256 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:38:21 smithi181 ceph-mon[25762]: from='mgr.14439 172.21.15.99:0/1757456350' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:38:22.256 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:38:21 smithi181 ceph-mon[25762]: from='mgr.14439 172.21.15.99:0/1757456350' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:38:22.256 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:38:21 smithi181 ceph-mon[25762]: from='mgr.14439 ' entity='mgr.y' 2024-03-30T13:38:22.256 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:38:21 smithi181 ceph-mon[25762]: Checking pool "foo" exists for service iscsi.foo 2024-03-30T13:38:22.256 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:38:21 smithi181 ceph-mon[25762]: from='mgr.14439 172.21.15.99:0/1757456350' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.iscsi.foo.smithi099.qyjuvr", "caps": ["mon", "profile rbd, allow command \"osd blocklist\", allow command \"config-key get\" with \"key\" prefix \"iscsi/\"", "mgr", "allow command \"service status\"", "osd", "allow rwx"]}]: dispatch 2024-03-30T13:38:22.256 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:38:21 smithi181 ceph-mon[25762]: from='mgr.14439 ' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.iscsi.foo.smithi099.qyjuvr", "caps": ["mon", "profile rbd, allow command \"osd blocklist\", allow command \"config-key get\" with \"key\" prefix \"iscsi/\"", "mgr", "allow command \"service status\"", "osd", "allow rwx"]}]: dispatch 2024-03-30T13:38:22.256 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:38:21 smithi181 ceph-mon[25762]: from='mgr.14439 ' entity='mgr.y' cmd='[{"prefix": "auth get-or-create", "entity": "client.iscsi.foo.smithi099.qyjuvr", "caps": ["mon", "profile rbd, allow command \"osd blocklist\", allow command \"config-key get\" with \"key\" prefix \"iscsi/\"", "mgr", "allow command \"service status\"", "osd", "allow rwx"]}]': finished 2024-03-30T13:38:22.256 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:38:21 smithi181 ceph-mon[25762]: from='mgr.14439 172.21.15.99:0/1757456350' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:38:22.257 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:38:21 smithi181 ceph-mon[25762]: Deploying daemon iscsi.foo.smithi099.qyjuvr on smithi099 2024-03-30T13:38:22.337 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:38:21 smithi099 ceph-mon[24912]: from='mgr.14439 ' entity='mgr.y' 2024-03-30T13:38:22.337 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:38:21 smithi099 ceph-mon[24912]: from='mgr.14439 ' entity='mgr.y' 2024-03-30T13:38:22.337 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:38:21 smithi099 ceph-mon[24912]: from='mgr.14439 172.21.15.99:0/1757456350' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:38:22.337 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:38:21 smithi099 ceph-mon[24912]: from='mgr.14439 172.21.15.99:0/1757456350' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:38:22.337 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:38:21 smithi099 ceph-mon[24912]: from='mgr.14439 ' entity='mgr.y' 2024-03-30T13:38:22.337 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:38:21 smithi099 ceph-mon[24912]: Checking pool "foo" exists for service iscsi.foo 2024-03-30T13:38:22.337 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:38:21 smithi099 ceph-mon[24912]: from='mgr.14439 172.21.15.99:0/1757456350' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.iscsi.foo.smithi099.qyjuvr", "caps": ["mon", "profile rbd, allow command \"osd blocklist\", allow command \"config-key get\" with \"key\" prefix \"iscsi/\"", "mgr", "allow command \"service status\"", "osd", "allow rwx"]}]: dispatch 2024-03-30T13:38:22.338 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:38:21 smithi099 ceph-mon[24912]: from='mgr.14439 ' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.iscsi.foo.smithi099.qyjuvr", "caps": ["mon", "profile rbd, allow command \"osd blocklist\", allow command \"config-key get\" with \"key\" prefix \"iscsi/\"", "mgr", "allow command \"service status\"", "osd", "allow rwx"]}]: dispatch 2024-03-30T13:38:22.338 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:38:21 smithi099 ceph-mon[24912]: from='mgr.14439 ' entity='mgr.y' cmd='[{"prefix": "auth get-or-create", "entity": "client.iscsi.foo.smithi099.qyjuvr", "caps": ["mon", "profile rbd, allow command \"osd blocklist\", allow command \"config-key get\" with \"key\" prefix \"iscsi/\"", "mgr", "allow command \"service status\"", "osd", "allow rwx"]}]': finished 2024-03-30T13:38:22.338 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:38:21 smithi099 ceph-mon[24912]: from='mgr.14439 172.21.15.99:0/1757456350' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:38:22.338 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:38:21 smithi099 ceph-mon[24912]: Deploying daemon iscsi.foo.smithi099.qyjuvr on smithi099 2024-03-30T13:38:22.338 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:38:21 smithi099 ceph-mon[29691]: from='mgr.14439 ' entity='mgr.y' 2024-03-30T13:38:22.338 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:38:21 smithi099 ceph-mon[29691]: from='mgr.14439 ' entity='mgr.y' 2024-03-30T13:38:22.338 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:38:21 smithi099 ceph-mon[29691]: from='mgr.14439 172.21.15.99:0/1757456350' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:38:22.338 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:38:21 smithi099 ceph-mon[29691]: from='mgr.14439 172.21.15.99:0/1757456350' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:38:22.338 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:38:21 smithi099 ceph-mon[29691]: from='mgr.14439 ' entity='mgr.y' 2024-03-30T13:38:22.338 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:38:21 smithi099 ceph-mon[29691]: Checking pool "foo" exists for service iscsi.foo 2024-03-30T13:38:22.338 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:38:21 smithi099 ceph-mon[29691]: from='mgr.14439 172.21.15.99:0/1757456350' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.iscsi.foo.smithi099.qyjuvr", "caps": ["mon", "profile rbd, allow command \"osd blocklist\", allow command \"config-key get\" with \"key\" prefix \"iscsi/\"", "mgr", "allow command \"service status\"", "osd", "allow rwx"]}]: dispatch 2024-03-30T13:38:22.338 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:38:21 smithi099 ceph-mon[29691]: from='mgr.14439 ' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.iscsi.foo.smithi099.qyjuvr", "caps": ["mon", "profile rbd, allow command \"osd blocklist\", allow command \"config-key get\" with \"key\" prefix \"iscsi/\"", "mgr", "allow command \"service status\"", "osd", "allow rwx"]}]: dispatch 2024-03-30T13:38:22.338 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:38:21 smithi099 ceph-mon[29691]: from='mgr.14439 ' entity='mgr.y' cmd='[{"prefix": "auth get-or-create", "entity": "client.iscsi.foo.smithi099.qyjuvr", "caps": ["mon", "profile rbd, allow command \"osd blocklist\", allow command \"config-key get\" with \"key\" prefix \"iscsi/\"", "mgr", "allow command \"service status\"", "osd", "allow rwx"]}]': finished 2024-03-30T13:38:22.339 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:38:21 smithi099 ceph-mon[29691]: from='mgr.14439 172.21.15.99:0/1757456350' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:38:22.339 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:38:21 smithi099 ceph-mon[29691]: Deploying daemon iscsi.foo.smithi099.qyjuvr on smithi099 2024-03-30T13:38:23.077 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:38:22 smithi099 ceph-mon[24912]: pgmap v96: 161 pgs: 161 active+clean; 585 KiB data, 65 MiB used, 715 GiB / 715 GiB avail; 3.5 KiB/s rd, 204 B/s wr, 3 op/s 2024-03-30T13:38:23.077 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:38:22 smithi099 ceph-mon[29691]: pgmap v96: 161 pgs: 161 active+clean; 585 KiB data, 65 MiB used, 715 GiB / 715 GiB avail; 3.5 KiB/s rd, 204 B/s wr, 3 op/s 2024-03-30T13:38:23.256 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:38:22 smithi181 ceph-mon[25762]: pgmap v96: 161 pgs: 161 active+clean; 585 KiB data, 65 MiB used, 715 GiB / 715 GiB avail; 3.5 KiB/s rd, 204 B/s wr, 3 op/s 2024-03-30T13:38:24.120 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:38:23 smithi099 ceph-mon[24912]: mgrmap e20: y(active, since 2m), standbys: x 2024-03-30T13:38:24.121 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:38:23 smithi099 ceph-mon[29691]: mgrmap e20: y(active, since 2m), standbys: x 2024-03-30T13:38:24.256 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:38:23 smithi181 ceph-mon[25762]: mgrmap e20: y(active, since 2m), standbys: x 2024-03-30T13:38:25.256 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:38:24 smithi181 ceph-mon[25762]: pgmap v97: 161 pgs: 161 active+clean; 585 KiB data, 65 MiB used, 715 GiB / 715 GiB avail; 3.4 KiB/s rd, 196 B/s wr, 3 op/s 2024-03-30T13:38:25.256 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:38:24 smithi181 ceph-mon[25762]: from='mgr.14439 ' entity='mgr.y' 2024-03-30T13:38:25.256 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:38:24 smithi181 ceph-mon[25762]: from='mgr.14439 172.21.15.99:0/1757456350' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:38:25.256 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:38:24 smithi181 ceph-mon[25762]: from='mgr.14439 172.21.15.99:0/1757456350' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:38:25.256 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:38:24 smithi181 ceph-mon[25762]: from='mgr.14439 ' entity='mgr.y' 2024-03-30T13:38:25.256 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:38:24 smithi181 ceph-mon[25762]: from='mgr.14439 172.21.15.99:0/1757456350' entity='mgr.y' cmd=[{"prefix": "dashboard iscsi-gateway-list"}]: dispatch 2024-03-30T13:38:25.257 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:38:24 smithi181 ceph-mon[25762]: from='mgr.14439 172.21.15.99:0/1757456350' entity='mgr.y' cmd=[{"prefix": "dashboard set-iscsi-api-ssl-verification", "value": "true"}]: dispatch 2024-03-30T13:38:25.257 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:38:24 smithi181 ceph-mon[25762]: from='mgr.14439 ' entity='mgr.y' 2024-03-30T13:38:25.257 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:38:24 smithi181 ceph-mon[25762]: from='mgr.14439 172.21.15.99:0/1757456350' entity='mgr.y' cmd=[{"prefix": "dashboard iscsi-gateway-add", "name": "smithi099"}]: dispatch 2024-03-30T13:38:25.257 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:38:24 smithi181 ceph-mon[25762]: from='mgr.14439 ' entity='mgr.y' 2024-03-30T13:38:25.257 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:38:24 smithi181 ceph-mon[25762]: from='mgr.14439 172.21.15.99:0/1757456350' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:38:25.257 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:38:24 smithi181 ceph-mon[25762]: from='mgr.14439 172.21.15.99:0/1757456350' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:38:25.257 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:38:24 smithi181 ceph-mon[25762]: from='mgr.14439 ' entity='mgr.y' 2024-03-30T13:38:25.257 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:38:24 smithi181 ceph-mon[25762]: from='mgr.14439 ' entity='mgr.y' 2024-03-30T13:38:25.257 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:38:24 smithi181 ceph-mon[25762]: from='client.? 172.21.15.99:0/4187392061' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-03-30T13:38:25.301 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:38:24 smithi099 ceph-mon[24912]: pgmap v97: 161 pgs: 161 active+clean; 585 KiB data, 65 MiB used, 715 GiB / 715 GiB avail; 3.4 KiB/s rd, 196 B/s wr, 3 op/s 2024-03-30T13:38:25.301 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:38:24 smithi099 ceph-mon[24912]: from='mgr.14439 ' entity='mgr.y' 2024-03-30T13:38:25.301 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:38:24 smithi099 ceph-mon[24912]: from='mgr.14439 172.21.15.99:0/1757456350' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:38:25.301 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:38:24 smithi099 ceph-mon[24912]: from='mgr.14439 172.21.15.99:0/1757456350' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:38:25.301 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:38:24 smithi099 ceph-mon[24912]: from='mgr.14439 ' entity='mgr.y' 2024-03-30T13:38:25.301 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:38:24 smithi099 ceph-mon[24912]: from='mgr.14439 172.21.15.99:0/1757456350' entity='mgr.y' cmd=[{"prefix": "dashboard iscsi-gateway-list"}]: dispatch 2024-03-30T13:38:25.301 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:38:24 smithi099 ceph-mon[24912]: from='mgr.14439 172.21.15.99:0/1757456350' entity='mgr.y' cmd=[{"prefix": "dashboard set-iscsi-api-ssl-verification", "value": "true"}]: dispatch 2024-03-30T13:38:25.301 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:38:24 smithi099 ceph-mon[24912]: from='mgr.14439 ' entity='mgr.y' 2024-03-30T13:38:25.301 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:38:24 smithi099 ceph-mon[24912]: from='mgr.14439 172.21.15.99:0/1757456350' entity='mgr.y' cmd=[{"prefix": "dashboard iscsi-gateway-add", "name": "smithi099"}]: dispatch 2024-03-30T13:38:25.302 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:38:24 smithi099 ceph-mon[24912]: from='mgr.14439 ' entity='mgr.y' 2024-03-30T13:38:25.302 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:38:24 smithi099 ceph-mon[24912]: from='mgr.14439 172.21.15.99:0/1757456350' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:38:25.302 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:38:24 smithi099 ceph-mon[24912]: from='mgr.14439 172.21.15.99:0/1757456350' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:38:25.302 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:38:24 smithi099 ceph-mon[24912]: from='mgr.14439 ' entity='mgr.y' 2024-03-30T13:38:25.302 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:38:24 smithi099 ceph-mon[24912]: from='mgr.14439 ' entity='mgr.y' 2024-03-30T13:38:25.302 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:38:24 smithi099 ceph-mon[24912]: from='client.? 172.21.15.99:0/4187392061' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-03-30T13:38:25.302 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:38:24 smithi099 ceph-mon[29691]: pgmap v97: 161 pgs: 161 active+clean; 585 KiB data, 65 MiB used, 715 GiB / 715 GiB avail; 3.4 KiB/s rd, 196 B/s wr, 3 op/s 2024-03-30T13:38:25.302 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:38:24 smithi099 ceph-mon[29691]: from='mgr.14439 ' entity='mgr.y' 2024-03-30T13:38:25.302 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:38:24 smithi099 ceph-mon[29691]: from='mgr.14439 172.21.15.99:0/1757456350' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:38:25.302 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:38:24 smithi099 ceph-mon[29691]: from='mgr.14439 172.21.15.99:0/1757456350' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:38:25.302 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:38:24 smithi099 ceph-mon[29691]: from='mgr.14439 ' entity='mgr.y' 2024-03-30T13:38:25.303 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:38:24 smithi099 ceph-mon[29691]: from='mgr.14439 172.21.15.99:0/1757456350' entity='mgr.y' cmd=[{"prefix": "dashboard iscsi-gateway-list"}]: dispatch 2024-03-30T13:38:25.303 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:38:24 smithi099 ceph-mon[29691]: from='mgr.14439 172.21.15.99:0/1757456350' entity='mgr.y' cmd=[{"prefix": "dashboard set-iscsi-api-ssl-verification", "value": "true"}]: dispatch 2024-03-30T13:38:25.303 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:38:24 smithi099 ceph-mon[29691]: from='mgr.14439 ' entity='mgr.y' 2024-03-30T13:38:25.303 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:38:24 smithi099 ceph-mon[29691]: from='mgr.14439 172.21.15.99:0/1757456350' entity='mgr.y' cmd=[{"prefix": "dashboard iscsi-gateway-add", "name": "smithi099"}]: dispatch 2024-03-30T13:38:25.303 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:38:24 smithi099 ceph-mon[29691]: from='mgr.14439 ' entity='mgr.y' 2024-03-30T13:38:25.303 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:38:24 smithi099 ceph-mon[29691]: from='mgr.14439 172.21.15.99:0/1757456350' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:38:25.303 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:38:24 smithi099 ceph-mon[29691]: from='mgr.14439 172.21.15.99:0/1757456350' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:38:25.303 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:38:24 smithi099 ceph-mon[29691]: from='mgr.14439 ' entity='mgr.y' 2024-03-30T13:38:25.303 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:38:24 smithi099 ceph-mon[29691]: from='mgr.14439 ' entity='mgr.y' 2024-03-30T13:38:25.303 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:38:24 smithi099 ceph-mon[29691]: from='client.? 172.21.15.99:0/4187392061' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-03-30T13:38:26.256 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:38:25 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:38:26.256 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:38:25 smithi181 ceph-mon[25762]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard iscsi-gateway-list"}]: dispatch 2024-03-30T13:38:26.256 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:38:25 smithi181 ceph-mon[25762]: Adding iSCSI gateway http://:@172.21.15.99:5000 to Dashboard 2024-03-30T13:38:26.256 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:38:25 smithi181 ceph-mon[25762]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard set-iscsi-api-ssl-verification", "value": "true"}]: dispatch 2024-03-30T13:38:26.256 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:38:25 smithi181 ceph-mon[25762]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard iscsi-gateway-add", "name": "smithi099"}]: dispatch 2024-03-30T13:38:26.256 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:38:25 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:38:26.256 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:38:25 smithi181 ceph-mon[25762]: from='client.? 172.21.15.99:0/3418353273' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.99:0/2227521083"}]: dispatch 2024-03-30T13:38:26.256 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:38:25 smithi181 ceph-mon[25762]: from='client.? ' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.99:0/2227521083"}]: dispatch 2024-03-30T13:38:26.282 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:38:25 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:38:26.282 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:38:25 smithi099 ceph-mon[24912]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard iscsi-gateway-list"}]: dispatch 2024-03-30T13:38:26.282 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:38:25 smithi099 ceph-mon[24912]: Adding iSCSI gateway http://:@172.21.15.99:5000 to Dashboard 2024-03-30T13:38:26.282 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:38:25 smithi099 ceph-mon[24912]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard set-iscsi-api-ssl-verification", "value": "true"}]: dispatch 2024-03-30T13:38:26.282 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:38:25 smithi099 ceph-mon[24912]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard iscsi-gateway-add", "name": "smithi099"}]: dispatch 2024-03-30T13:38:26.282 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:38:25 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:38:26.282 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:38:25 smithi099 ceph-mon[24912]: from='client.? 172.21.15.99:0/3418353273' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.99:0/2227521083"}]: dispatch 2024-03-30T13:38:26.282 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:38:25 smithi099 ceph-mon[24912]: from='client.? ' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.99:0/2227521083"}]: dispatch 2024-03-30T13:38:26.282 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:38:25 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:38:26.283 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:38:25 smithi099 ceph-mon[29691]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard iscsi-gateway-list"}]: dispatch 2024-03-30T13:38:26.283 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:38:25 smithi099 ceph-mon[29691]: Adding iSCSI gateway http://:@172.21.15.99:5000 to Dashboard 2024-03-30T13:38:26.283 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:38:25 smithi099 ceph-mon[29691]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard set-iscsi-api-ssl-verification", "value": "true"}]: dispatch 2024-03-30T13:38:26.283 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:38:25 smithi099 ceph-mon[29691]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard iscsi-gateway-add", "name": "smithi099"}]: dispatch 2024-03-30T13:38:26.283 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:38:25 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:38:26.283 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:38:25 smithi099 ceph-mon[29691]: from='client.? 172.21.15.99:0/3418353273' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.99:0/2227521083"}]: dispatch 2024-03-30T13:38:26.283 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:38:25 smithi099 ceph-mon[29691]: from='client.? ' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.99:0/2227521083"}]: dispatch 2024-03-30T13:38:26.968 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:38:26 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[25141]: ::ffff:172.21.15.181 - - [30/Mar/2024:13:38:26] "GET /metrics HTTP/1.1" 200 207352 "" "Prometheus/2.33.4" 2024-03-30T13:38:27.337 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:38:27 smithi099 ceph-mon[24912]: from='client.? ' entity='client.iscsi.foo.smithi099.qyjuvr' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.99:0/2227521083"}]': finished 2024-03-30T13:38:27.337 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:38:27 smithi099 ceph-mon[24912]: osdmap e80: 8 total, 8 up, 8 in 2024-03-30T13:38:27.337 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:38:27 smithi099 ceph-mon[24912]: pgmap v99: 161 pgs: 161 active+clean; 585 KiB data, 65 MiB used, 715 GiB / 715 GiB avail; 204 B/s rd, 102 B/s wr, 1 op/s 2024-03-30T13:38:27.337 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:38:27 smithi099 ceph-mon[24912]: from='client.? 172.21.15.99:0/2899811059' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.99:0/2680510373"}]: dispatch 2024-03-30T13:38:27.337 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:38:27 smithi099 ceph-mon[29691]: from='client.? ' entity='client.iscsi.foo.smithi099.qyjuvr' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.99:0/2227521083"}]': finished 2024-03-30T13:38:27.337 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:38:27 smithi099 ceph-mon[29691]: osdmap e80: 8 total, 8 up, 8 in 2024-03-30T13:38:27.337 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:38:27 smithi099 ceph-mon[29691]: pgmap v99: 161 pgs: 161 active+clean; 585 KiB data, 65 MiB used, 715 GiB / 715 GiB avail; 204 B/s rd, 102 B/s wr, 1 op/s 2024-03-30T13:38:27.338 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:38:27 smithi099 ceph-mon[29691]: from='client.? 172.21.15.99:0/2899811059' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.99:0/2680510373"}]: dispatch 2024-03-30T13:38:27.506 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:38:27 smithi181 ceph-mon[25762]: from='client.? ' entity='client.iscsi.foo.smithi099.qyjuvr' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.99:0/2227521083"}]': finished 2024-03-30T13:38:27.506 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:38:27 smithi181 ceph-mon[25762]: osdmap e80: 8 total, 8 up, 8 in 2024-03-30T13:38:27.506 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:38:27 smithi181 ceph-mon[25762]: pgmap v99: 161 pgs: 161 active+clean; 585 KiB data, 65 MiB used, 715 GiB / 715 GiB avail; 204 B/s rd, 102 B/s wr, 1 op/s 2024-03-30T13:38:27.506 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:38:27 smithi181 ceph-mon[25762]: from='client.? 172.21.15.99:0/2899811059' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.99:0/2680510373"}]: dispatch 2024-03-30T13:38:28.337 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:38:27 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[25141]: 172.21.15.99 - - [30/Mar/2024:13:38:27] "POST /data HTTP/1.1" 200 46 "" "Python-urllib/3.9" 2024-03-30T13:38:28.337 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:38:28 smithi099 ceph-mon[24912]: from='client.? 172.21.15.99:0/2899811059' entity='client.iscsi.foo.smithi099.qyjuvr' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.99:0/2680510373"}]': finished 2024-03-30T13:38:28.337 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:38:28 smithi099 ceph-mon[24912]: osdmap e81: 8 total, 8 up, 8 in 2024-03-30T13:38:28.337 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:38:28 smithi099 ceph-mon[24912]: from='client.? 172.21.15.99:0/2802295603' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.99:6801/1198750999"}]: dispatch 2024-03-30T13:38:28.337 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:38:28 smithi099 ceph-mon[24912]: from='client.? ' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.99:6801/1198750999"}]: dispatch 2024-03-30T13:38:28.337 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:38:28 smithi099 ceph-mon[24912]: from='mgr.14439 ' entity='mgr.y' 2024-03-30T13:38:28.338 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:38:28 smithi099 ceph-mon[29691]: from='client.? 172.21.15.99:0/2899811059' entity='client.iscsi.foo.smithi099.qyjuvr' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.99:0/2680510373"}]': finished 2024-03-30T13:38:28.338 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:38:28 smithi099 ceph-mon[29691]: osdmap e81: 8 total, 8 up, 8 in 2024-03-30T13:38:28.338 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:38:28 smithi099 ceph-mon[29691]: from='client.? 172.21.15.99:0/2802295603' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.99:6801/1198750999"}]: dispatch 2024-03-30T13:38:28.338 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:38:28 smithi099 ceph-mon[29691]: from='client.? ' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.99:6801/1198750999"}]: dispatch 2024-03-30T13:38:28.338 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:38:28 smithi099 ceph-mon[29691]: from='mgr.14439 ' entity='mgr.y' 2024-03-30T13:38:28.506 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:38:28 smithi181 ceph-mon[25762]: from='client.? 172.21.15.99:0/2899811059' entity='client.iscsi.foo.smithi099.qyjuvr' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.99:0/2680510373"}]': finished 2024-03-30T13:38:28.506 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:38:28 smithi181 ceph-mon[25762]: osdmap e81: 8 total, 8 up, 8 in 2024-03-30T13:38:28.506 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:38:28 smithi181 ceph-mon[25762]: from='client.? 172.21.15.99:0/2802295603' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.99:6801/1198750999"}]: dispatch 2024-03-30T13:38:28.506 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:38:28 smithi181 ceph-mon[25762]: from='client.? ' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.99:6801/1198750999"}]: dispatch 2024-03-30T13:38:28.506 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:38:28 smithi181 ceph-mon[25762]: from='mgr.14439 ' entity='mgr.y' 2024-03-30T13:38:29.337 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:38:29 smithi099 ceph-mon[24912]: pgmap v101: 161 pgs: 161 active+clean; 585 KiB data, 65 MiB used, 715 GiB / 715 GiB avail; 255 B/s rd, 127 B/s wr, 1 op/s 2024-03-30T13:38:29.337 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:38:29 smithi099 ceph-mon[24912]: from='client.? ' entity='client.iscsi.foo.smithi099.qyjuvr' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.99:6801/1198750999"}]': finished 2024-03-30T13:38:29.337 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:38:29 smithi099 ceph-mon[24912]: osdmap e82: 8 total, 8 up, 8 in 2024-03-30T13:38:29.337 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:38:29 smithi099 ceph-mon[24912]: from='client.? 172.21.15.99:0/3546288496' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.99:0/1283915670"}]: dispatch 2024-03-30T13:38:29.337 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:38:29 smithi099 ceph-mon[24912]: from='client.? ' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.99:0/1283915670"}]: dispatch 2024-03-30T13:38:29.337 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:38:29 smithi099 ceph-mon[29691]: pgmap v101: 161 pgs: 161 active+clean; 585 KiB data, 65 MiB used, 715 GiB / 715 GiB avail; 255 B/s rd, 127 B/s wr, 1 op/s 2024-03-30T13:38:29.337 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:38:29 smithi099 ceph-mon[29691]: from='client.? ' entity='client.iscsi.foo.smithi099.qyjuvr' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.99:6801/1198750999"}]': finished 2024-03-30T13:38:29.337 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:38:29 smithi099 ceph-mon[29691]: osdmap e82: 8 total, 8 up, 8 in 2024-03-30T13:38:29.337 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:38:29 smithi099 ceph-mon[29691]: from='client.? 172.21.15.99:0/3546288496' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.99:0/1283915670"}]: dispatch 2024-03-30T13:38:29.337 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:38:29 smithi099 ceph-mon[29691]: from='client.? ' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.99:0/1283915670"}]: dispatch 2024-03-30T13:38:29.462 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:38:29 smithi181 ceph-mon[25762]: pgmap v101: 161 pgs: 161 active+clean; 585 KiB data, 65 MiB used, 715 GiB / 715 GiB avail; 255 B/s rd, 127 B/s wr, 1 op/s 2024-03-30T13:38:29.462 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:38:29 smithi181 ceph-mon[25762]: from='client.? ' entity='client.iscsi.foo.smithi099.qyjuvr' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.99:6801/1198750999"}]': finished 2024-03-30T13:38:29.462 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:38:29 smithi181 ceph-mon[25762]: osdmap e82: 8 total, 8 up, 8 in 2024-03-30T13:38:29.462 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:38:29 smithi181 ceph-mon[25762]: from='client.? 172.21.15.99:0/3546288496' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.99:0/1283915670"}]: dispatch 2024-03-30T13:38:29.462 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:38:29 smithi181 ceph-mon[25762]: from='client.? ' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.99:0/1283915670"}]: dispatch 2024-03-30T13:38:29.756 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 13:38:29 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-x[27332]: ::ffff:172.21.15.181 - - [30/Mar/2024:13:38:29] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-03-30T13:38:30.243 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:38:30 smithi099 ceph-mon[24912]: from='client.? ' entity='client.iscsi.foo.smithi099.qyjuvr' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.99:0/1283915670"}]': finished 2024-03-30T13:38:30.243 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:38:30 smithi099 ceph-mon[24912]: osdmap e83: 8 total, 8 up, 8 in 2024-03-30T13:38:30.244 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:38:30 smithi099 ceph-mon[24912]: from='client.? 172.21.15.99:0/548409515' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.99:0/3435366269"}]: dispatch 2024-03-30T13:38:30.244 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:38:30 smithi099 ceph-mon[24912]: from='client.? ' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.99:0/3435366269"}]: dispatch 2024-03-30T13:38:30.244 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:38:30 smithi099 ceph-mon[29691]: from='client.? ' entity='client.iscsi.foo.smithi099.qyjuvr' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.99:0/1283915670"}]': finished 2024-03-30T13:38:30.244 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:38:30 smithi099 ceph-mon[29691]: osdmap e83: 8 total, 8 up, 8 in 2024-03-30T13:38:30.244 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:38:30 smithi099 ceph-mon[29691]: from='client.? 172.21.15.99:0/548409515' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.99:0/3435366269"}]: dispatch 2024-03-30T13:38:30.244 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:38:30 smithi099 ceph-mon[29691]: from='client.? ' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.99:0/3435366269"}]: dispatch 2024-03-30T13:38:30.506 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:38:30 smithi181 ceph-mon[25762]: from='client.? ' entity='client.iscsi.foo.smithi099.qyjuvr' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.99:0/1283915670"}]': finished 2024-03-30T13:38:30.506 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:38:30 smithi181 ceph-mon[25762]: osdmap e83: 8 total, 8 up, 8 in 2024-03-30T13:38:30.506 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:38:30 smithi181 ceph-mon[25762]: from='client.? 172.21.15.99:0/548409515' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.99:0/3435366269"}]: dispatch 2024-03-30T13:38:30.506 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:38:30 smithi181 ceph-mon[25762]: from='client.? ' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.99:0/3435366269"}]: dispatch 2024-03-30T13:38:30.837 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:38:30 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[25141]: 172.21.15.99 - - [30/Mar/2024:13:38:30] "POST /data HTTP/1.1" 200 46 "" "Python-urllib/3.9" 2024-03-30T13:38:31.337 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:38:31 smithi099 ceph-mon[24912]: pgmap v104: 161 pgs: 161 active+clean; 585 KiB data, 65 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:38:31.337 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:38:31 smithi099 ceph-mon[24912]: from='client.? ' entity='client.iscsi.foo.smithi099.qyjuvr' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.99:0/3435366269"}]': finished 2024-03-30T13:38:31.337 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:38:31 smithi099 ceph-mon[24912]: osdmap e84: 8 total, 8 up, 8 in 2024-03-30T13:38:31.337 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:38:31 smithi099 ceph-mon[24912]: from='client.? 172.21.15.99:0/3022791635' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.99:6800/639013456"}]: dispatch 2024-03-30T13:38:31.337 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:38:31 smithi099 ceph-mon[24912]: from='client.? ' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.99:6800/639013456"}]: dispatch 2024-03-30T13:38:31.337 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:38:31 smithi099 ceph-mon[24912]: from='mgr.14439 ' entity='mgr.y' 2024-03-30T13:38:31.337 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:38:31 smithi099 ceph-mon[24912]: from='mgr.14439 172.21.15.99:0/1757456350' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:38:31.337 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:38:31 smithi099 ceph-mon[24912]: from='mgr.14439 172.21.15.99:0/1757456350' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:38:31.337 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:38:31 smithi099 ceph-mon[24912]: from='mgr.14439 ' entity='mgr.y' 2024-03-30T13:38:31.337 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:38:31 smithi099 ceph-mon[24912]: from='mgr.14439 ' entity='mgr.y' 2024-03-30T13:38:31.338 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:38:31 smithi099 ceph-mon[29691]: pgmap v104: 161 pgs: 161 active+clean; 585 KiB data, 65 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:38:31.338 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:38:31 smithi099 ceph-mon[29691]: from='client.? ' entity='client.iscsi.foo.smithi099.qyjuvr' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.99:0/3435366269"}]': finished 2024-03-30T13:38:31.338 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:38:31 smithi099 ceph-mon[29691]: osdmap e84: 8 total, 8 up, 8 in 2024-03-30T13:38:31.338 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:38:31 smithi099 ceph-mon[29691]: from='client.? 172.21.15.99:0/3022791635' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.99:6800/639013456"}]: dispatch 2024-03-30T13:38:31.338 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:38:31 smithi099 ceph-mon[29691]: from='client.? ' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.99:6800/639013456"}]: dispatch 2024-03-30T13:38:31.338 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:38:31 smithi099 ceph-mon[29691]: from='mgr.14439 ' entity='mgr.y' 2024-03-30T13:38:31.338 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:38:31 smithi099 ceph-mon[29691]: from='mgr.14439 172.21.15.99:0/1757456350' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:38:31.338 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:38:31 smithi099 ceph-mon[29691]: from='mgr.14439 172.21.15.99:0/1757456350' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:38:31.338 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:38:31 smithi099 ceph-mon[29691]: from='mgr.14439 ' entity='mgr.y' 2024-03-30T13:38:31.338 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:38:31 smithi099 ceph-mon[29691]: from='mgr.14439 ' entity='mgr.y' 2024-03-30T13:38:31.506 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:38:31 smithi181 ceph-mon[25762]: pgmap v104: 161 pgs: 161 active+clean; 585 KiB data, 65 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:38:31.506 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:38:31 smithi181 ceph-mon[25762]: from='client.? ' entity='client.iscsi.foo.smithi099.qyjuvr' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.99:0/3435366269"}]': finished 2024-03-30T13:38:31.506 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:38:31 smithi181 ceph-mon[25762]: osdmap e84: 8 total, 8 up, 8 in 2024-03-30T13:38:31.506 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:38:31 smithi181 ceph-mon[25762]: from='client.? 172.21.15.99:0/3022791635' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.99:6800/639013456"}]: dispatch 2024-03-30T13:38:31.506 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:38:31 smithi181 ceph-mon[25762]: from='client.? ' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.99:6800/639013456"}]: dispatch 2024-03-30T13:38:31.506 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:38:31 smithi181 ceph-mon[25762]: from='mgr.14439 ' entity='mgr.y' 2024-03-30T13:38:31.506 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:38:31 smithi181 ceph-mon[25762]: from='mgr.14439 172.21.15.99:0/1757456350' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:38:31.506 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:38:31 smithi181 ceph-mon[25762]: from='mgr.14439 172.21.15.99:0/1757456350' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:38:31.507 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:38:31 smithi181 ceph-mon[25762]: from='mgr.14439 ' entity='mgr.y' 2024-03-30T13:38:31.507 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:38:31 smithi181 ceph-mon[25762]: from='mgr.14439 ' entity='mgr.y' 2024-03-30T13:38:32.337 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:38:32 smithi099 ceph-mon[24912]: from='client.? ' entity='client.iscsi.foo.smithi099.qyjuvr' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.99:6800/639013456"}]': finished 2024-03-30T13:38:32.337 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:38:32 smithi099 ceph-mon[24912]: osdmap e85: 8 total, 8 up, 8 in 2024-03-30T13:38:32.337 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:38:32 smithi099 ceph-mon[24912]: from='client.? 172.21.15.99:0/3168988469' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.99:6801/639013456"}]: dispatch 2024-03-30T13:38:32.337 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:38:32 smithi099 ceph-mon[29691]: from='client.? ' entity='client.iscsi.foo.smithi099.qyjuvr' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.99:6800/639013456"}]': finished 2024-03-30T13:38:32.337 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:38:32 smithi099 ceph-mon[29691]: osdmap e85: 8 total, 8 up, 8 in 2024-03-30T13:38:32.337 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:38:32 smithi099 ceph-mon[29691]: from='client.? 172.21.15.99:0/3168988469' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.99:6801/639013456"}]: dispatch 2024-03-30T13:38:32.506 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:38:32 smithi181 ceph-mon[25762]: from='client.? ' entity='client.iscsi.foo.smithi099.qyjuvr' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.99:6800/639013456"}]': finished 2024-03-30T13:38:32.506 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:38:32 smithi181 ceph-mon[25762]: osdmap e85: 8 total, 8 up, 8 in 2024-03-30T13:38:32.506 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:38:32 smithi181 ceph-mon[25762]: from='client.? 172.21.15.99:0/3168988469' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.99:6801/639013456"}]: dispatch 2024-03-30T13:38:33.337 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:38:33 smithi099 ceph-mon[29691]: pgmap v107: 161 pgs: 161 active+clean; 585 KiB data, 66 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T13:38:33.337 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:38:33 smithi099 ceph-mon[29691]: from='client.? 172.21.15.99:0/3168988469' entity='client.iscsi.foo.smithi099.qyjuvr' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.99:6801/639013456"}]': finished 2024-03-30T13:38:33.337 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:38:33 smithi099 ceph-mon[29691]: osdmap e86: 8 total, 8 up, 8 in 2024-03-30T13:38:33.337 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:38:33 smithi099 ceph-mon[29691]: from='client.? 172.21.15.99:0/1416167400' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.99:0/2902659920"}]: dispatch 2024-03-30T13:38:33.337 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:38:33 smithi099 ceph-mon[29691]: from='client.? ' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.99:0/2902659920"}]: dispatch 2024-03-30T13:38:33.337 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:38:33 smithi099 ceph-mon[24912]: pgmap v107: 161 pgs: 161 active+clean; 585 KiB data, 66 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T13:38:33.337 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:38:33 smithi099 ceph-mon[24912]: from='client.? 172.21.15.99:0/3168988469' entity='client.iscsi.foo.smithi099.qyjuvr' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.99:6801/639013456"}]': finished 2024-03-30T13:38:33.338 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:38:33 smithi099 ceph-mon[24912]: osdmap e86: 8 total, 8 up, 8 in 2024-03-30T13:38:33.338 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:38:33 smithi099 ceph-mon[24912]: from='client.? 172.21.15.99:0/1416167400' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.99:0/2902659920"}]: dispatch 2024-03-30T13:38:33.338 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:38:33 smithi099 ceph-mon[24912]: from='client.? ' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.99:0/2902659920"}]: dispatch 2024-03-30T13:38:33.506 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:38:33 smithi181 ceph-mon[25762]: pgmap v107: 161 pgs: 161 active+clean; 585 KiB data, 66 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T13:38:33.506 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:38:33 smithi181 ceph-mon[25762]: from='client.? 172.21.15.99:0/3168988469' entity='client.iscsi.foo.smithi099.qyjuvr' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.99:6801/639013456"}]': finished 2024-03-30T13:38:33.506 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:38:33 smithi181 ceph-mon[25762]: osdmap e86: 8 total, 8 up, 8 in 2024-03-30T13:38:33.507 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:38:33 smithi181 ceph-mon[25762]: from='client.? 172.21.15.99:0/1416167400' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.99:0/2902659920"}]: dispatch 2024-03-30T13:38:33.507 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:38:33 smithi181 ceph-mon[25762]: from='client.? ' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.99:0/2902659920"}]: dispatch 2024-03-30T13:38:34.337 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:38:34 smithi099 ceph-mon[24912]: from='client.? ' entity='client.iscsi.foo.smithi099.qyjuvr' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.99:0/2902659920"}]': finished 2024-03-30T13:38:34.337 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:38:34 smithi099 ceph-mon[24912]: osdmap e87: 8 total, 8 up, 8 in 2024-03-30T13:38:34.337 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:38:34 smithi099 ceph-mon[24912]: from='client.? 172.21.15.99:0/3962389333' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.99:0/3964022543"}]: dispatch 2024-03-30T13:38:34.337 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:38:34 smithi099 ceph-mon[24912]: pgmap v110: 161 pgs: 161 active+clean; 585 KiB data, 66 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T13:38:34.337 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:38:34 smithi099 ceph-mon[29691]: from='client.? ' entity='client.iscsi.foo.smithi099.qyjuvr' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.99:0/2902659920"}]': finished 2024-03-30T13:38:34.337 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:38:34 smithi099 ceph-mon[29691]: osdmap e87: 8 total, 8 up, 8 in 2024-03-30T13:38:34.337 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:38:34 smithi099 ceph-mon[29691]: from='client.? 172.21.15.99:0/3962389333' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.99:0/3964022543"}]: dispatch 2024-03-30T13:38:34.337 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:38:34 smithi099 ceph-mon[29691]: pgmap v110: 161 pgs: 161 active+clean; 585 KiB data, 66 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T13:38:34.474 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:38:34 smithi181 ceph-mon[25762]: from='client.? ' entity='client.iscsi.foo.smithi099.qyjuvr' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.99:0/2902659920"}]': finished 2024-03-30T13:38:34.474 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:38:34 smithi181 ceph-mon[25762]: osdmap e87: 8 total, 8 up, 8 in 2024-03-30T13:38:34.474 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:38:34 smithi181 ceph-mon[25762]: from='client.? 172.21.15.99:0/3962389333' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.99:0/3964022543"}]: dispatch 2024-03-30T13:38:34.474 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:38:34 smithi181 ceph-mon[25762]: pgmap v110: 161 pgs: 161 active+clean; 585 KiB data, 66 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T13:38:35.197 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:38:35 smithi181 ceph-mon[25762]: from='client.? 172.21.15.99:0/3962389333' entity='client.iscsi.foo.smithi099.qyjuvr' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.99:0/3964022543"}]': finished 2024-03-30T13:38:35.197 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:38:35 smithi181 ceph-mon[25762]: osdmap e88: 8 total, 8 up, 8 in 2024-03-30T13:38:35.197 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:38:35 smithi181 ceph-mon[25762]: from='client.? 172.21.15.99:0/3878962187' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.99:0/3234417163"}]: dispatch 2024-03-30T13:38:35.197 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:38:35 smithi181 ceph-mon[25762]: from='client.14838 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T13:38:35.337 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:38:35 smithi099 ceph-mon[24912]: from='client.? 172.21.15.99:0/3962389333' entity='client.iscsi.foo.smithi099.qyjuvr' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.99:0/3964022543"}]': finished 2024-03-30T13:38:35.337 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:38:35 smithi099 ceph-mon[24912]: osdmap e88: 8 total, 8 up, 8 in 2024-03-30T13:38:35.337 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:38:35 smithi099 ceph-mon[24912]: from='client.? 172.21.15.99:0/3878962187' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.99:0/3234417163"}]: dispatch 2024-03-30T13:38:35.337 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:38:35 smithi099 ceph-mon[24912]: from='client.14838 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T13:38:35.337 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:38:35 smithi099 ceph-mon[29691]: from='client.? 172.21.15.99:0/3962389333' entity='client.iscsi.foo.smithi099.qyjuvr' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.99:0/3964022543"}]': finished 2024-03-30T13:38:35.337 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:38:35 smithi099 ceph-mon[29691]: osdmap e88: 8 total, 8 up, 8 in 2024-03-30T13:38:35.337 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:38:35 smithi099 ceph-mon[29691]: from='client.? 172.21.15.99:0/3878962187' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.99:0/3234417163"}]: dispatch 2024-03-30T13:38:35.337 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:38:35 smithi099 ceph-mon[29691]: from='client.14838 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T13:38:36.256 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:38:36 smithi181 ceph-mon[25762]: from='client.? 172.21.15.99:0/3878962187' entity='client.iscsi.foo.smithi099.qyjuvr' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.99:0/3234417163"}]': finished 2024-03-30T13:38:36.256 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:38:36 smithi181 ceph-mon[25762]: osdmap e89: 8 total, 8 up, 8 in 2024-03-30T13:38:36.256 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:38:36 smithi181 ceph-mon[25762]: from='client.? 172.21.15.99:0/3427562630' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.99:6800/1198750999"}]: dispatch 2024-03-30T13:38:36.256 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:38:36 smithi181 ceph-mon[25762]: pgmap v113: 161 pgs: 161 active+clean; 585 KiB data, 66 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T13:38:36.337 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:38:36 smithi099 ceph-mon[29691]: from='client.? 172.21.15.99:0/3878962187' entity='client.iscsi.foo.smithi099.qyjuvr' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.99:0/3234417163"}]': finished 2024-03-30T13:38:36.337 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:38:36 smithi099 ceph-mon[29691]: osdmap e89: 8 total, 8 up, 8 in 2024-03-30T13:38:36.337 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:38:36 smithi099 ceph-mon[29691]: from='client.? 172.21.15.99:0/3427562630' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.99:6800/1198750999"}]: dispatch 2024-03-30T13:38:36.337 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:38:36 smithi099 ceph-mon[29691]: pgmap v113: 161 pgs: 161 active+clean; 585 KiB data, 66 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T13:38:36.337 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:38:36 smithi099 ceph-mon[24912]: from='client.? 172.21.15.99:0/3878962187' entity='client.iscsi.foo.smithi099.qyjuvr' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.99:0/3234417163"}]': finished 2024-03-30T13:38:36.337 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:38:36 smithi099 ceph-mon[24912]: osdmap e89: 8 total, 8 up, 8 in 2024-03-30T13:38:36.337 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:38:36 smithi099 ceph-mon[24912]: from='client.? 172.21.15.99:0/3427562630' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.99:6800/1198750999"}]: dispatch 2024-03-30T13:38:36.338 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:38:36 smithi099 ceph-mon[24912]: pgmap v113: 161 pgs: 161 active+clean; 585 KiB data, 66 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T13:38:36.338 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:38:36 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[25141]: 172.21.15.181 - - [30/Mar/2024:13:38:36] "POST /data HTTP/1.1" 200 46 "" "Python-urllib/3.9" 2024-03-30T13:38:37.084 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:38:36 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[25141]: ::ffff:172.21.15.181 - - [30/Mar/2024:13:38:36] "GET /metrics HTTP/1.1" 200 208113 "" "Prometheus/2.33.4" 2024-03-30T13:38:37.337 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:38:37 smithi099 ceph-mon[24912]: from='client.? 172.21.15.99:0/3427562630' entity='client.iscsi.foo.smithi099.qyjuvr' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.99:6800/1198750999"}]': finished 2024-03-30T13:38:37.337 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:38:37 smithi099 ceph-mon[24912]: osdmap e90: 8 total, 8 up, 8 in 2024-03-30T13:38:37.337 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:38:37 smithi099 ceph-mon[24912]: from='mgr.14439 ' entity='mgr.y' 2024-03-30T13:38:37.337 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:38:37 smithi099 ceph-mon[24912]: from='mgr.14439 ' entity='mgr.y' 2024-03-30T13:38:37.337 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:38:37 smithi099 ceph-mon[24912]: from='client.? 172.21.15.99:0/1353589239' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.99:0/3448119368"}]: dispatch 2024-03-30T13:38:37.337 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:38:37 smithi099 ceph-mon[29691]: from='client.? 172.21.15.99:0/3427562630' entity='client.iscsi.foo.smithi099.qyjuvr' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.99:6800/1198750999"}]': finished 2024-03-30T13:38:37.337 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:38:37 smithi099 ceph-mon[29691]: osdmap e90: 8 total, 8 up, 8 in 2024-03-30T13:38:37.337 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:38:37 smithi099 ceph-mon[29691]: from='mgr.14439 ' entity='mgr.y' 2024-03-30T13:38:37.337 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:38:37 smithi099 ceph-mon[29691]: from='mgr.14439 ' entity='mgr.y' 2024-03-30T13:38:37.337 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:38:37 smithi099 ceph-mon[29691]: from='client.? 172.21.15.99:0/1353589239' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.99:0/3448119368"}]: dispatch 2024-03-30T13:38:37.506 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:38:37 smithi181 ceph-mon[25762]: from='client.? 172.21.15.99:0/3427562630' entity='client.iscsi.foo.smithi099.qyjuvr' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.99:6800/1198750999"}]': finished 2024-03-30T13:38:37.506 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:38:37 smithi181 ceph-mon[25762]: osdmap e90: 8 total, 8 up, 8 in 2024-03-30T13:38:37.506 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:38:37 smithi181 ceph-mon[25762]: from='mgr.14439 ' entity='mgr.y' 2024-03-30T13:38:37.506 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:38:37 smithi181 ceph-mon[25762]: from='mgr.14439 ' entity='mgr.y' 2024-03-30T13:38:37.506 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:38:37 smithi181 ceph-mon[25762]: from='client.? 172.21.15.99:0/1353589239' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.99:0/3448119368"}]: dispatch 2024-03-30T13:38:38.506 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:38:38 smithi181 ceph-mon[25762]: from='client.? 172.21.15.99:0/1353589239' entity='client.iscsi.foo.smithi099.qyjuvr' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.99:0/3448119368"}]': finished 2024-03-30T13:38:38.506 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:38:38 smithi181 ceph-mon[25762]: osdmap e91: 8 total, 8 up, 8 in 2024-03-30T13:38:38.506 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:38:38 smithi181 ceph-mon[25762]: from='client.? 172.21.15.99:0/2117140780' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.99:6800/4092149076"}]: dispatch 2024-03-30T13:38:38.506 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:38:38 smithi181 ceph-mon[25762]: from='client.? ' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.99:6800/4092149076"}]: dispatch 2024-03-30T13:38:38.506 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:38:38 smithi181 ceph-mon[25762]: pgmap v116: 161 pgs: 161 active+clean; 585 KiB data, 66 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T13:38:38.587 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:38:38 smithi099 ceph-mon[24912]: from='client.? 172.21.15.99:0/1353589239' entity='client.iscsi.foo.smithi099.qyjuvr' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.99:0/3448119368"}]': finished 2024-03-30T13:38:38.587 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:38:38 smithi099 ceph-mon[24912]: osdmap e91: 8 total, 8 up, 8 in 2024-03-30T13:38:38.587 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:38:38 smithi099 ceph-mon[24912]: from='client.? 172.21.15.99:0/2117140780' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.99:6800/4092149076"}]: dispatch 2024-03-30T13:38:38.587 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:38:38 smithi099 ceph-mon[24912]: from='client.? ' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.99:6800/4092149076"}]: dispatch 2024-03-30T13:38:38.587 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:38:38 smithi099 ceph-mon[24912]: pgmap v116: 161 pgs: 161 active+clean; 585 KiB data, 66 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T13:38:38.587 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:38:38 smithi099 ceph-mon[29691]: from='client.? 172.21.15.99:0/1353589239' entity='client.iscsi.foo.smithi099.qyjuvr' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.99:0/3448119368"}]': finished 2024-03-30T13:38:38.587 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:38:38 smithi099 ceph-mon[29691]: osdmap e91: 8 total, 8 up, 8 in 2024-03-30T13:38:38.587 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:38:38 smithi099 ceph-mon[29691]: from='client.? 172.21.15.99:0/2117140780' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.99:6800/4092149076"}]: dispatch 2024-03-30T13:38:38.588 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:38:38 smithi099 ceph-mon[29691]: from='client.? ' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.99:6800/4092149076"}]: dispatch 2024-03-30T13:38:38.588 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:38:38 smithi099 ceph-mon[29691]: pgmap v116: 161 pgs: 161 active+clean; 585 KiB data, 66 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T13:38:39.506 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:38:39 smithi181 ceph-mon[25762]: from='client.? ' entity='client.iscsi.foo.smithi099.qyjuvr' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.99:6800/4092149076"}]': finished 2024-03-30T13:38:39.506 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:38:39 smithi181 ceph-mon[25762]: osdmap e92: 8 total, 8 up, 8 in 2024-03-30T13:38:39.506 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:38:39 smithi181 ceph-mon[25762]: from='client.? 172.21.15.99:0/429004758' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.99:0/3858852026"}]: dispatch 2024-03-30T13:38:39.507 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 13:38:39 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-x[27332]: ::ffff:172.21.15.181 - - [30/Mar/2024:13:38:39] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-03-30T13:38:39.587 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:38:39 smithi099 ceph-mon[24912]: from='client.? ' entity='client.iscsi.foo.smithi099.qyjuvr' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.99:6800/4092149076"}]': finished 2024-03-30T13:38:39.587 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:38:39 smithi099 ceph-mon[24912]: osdmap e92: 8 total, 8 up, 8 in 2024-03-30T13:38:39.587 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:38:39 smithi099 ceph-mon[24912]: from='client.? 172.21.15.99:0/429004758' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.99:0/3858852026"}]: dispatch 2024-03-30T13:38:39.587 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:38:39 smithi099 ceph-mon[29691]: from='client.? ' entity='client.iscsi.foo.smithi099.qyjuvr' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.99:6800/4092149076"}]': finished 2024-03-30T13:38:39.587 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:38:39 smithi099 ceph-mon[29691]: osdmap e92: 8 total, 8 up, 8 in 2024-03-30T13:38:39.587 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:38:39 smithi099 ceph-mon[29691]: from='client.? 172.21.15.99:0/429004758' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.99:0/3858852026"}]: dispatch 2024-03-30T13:38:40.506 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:38:40 smithi181 ceph-mon[25762]: from='client.? 172.21.15.99:0/429004758' entity='client.iscsi.foo.smithi099.qyjuvr' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.99:0/3858852026"}]': finished 2024-03-30T13:38:40.506 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:38:40 smithi181 ceph-mon[25762]: osdmap e93: 8 total, 8 up, 8 in 2024-03-30T13:38:40.506 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:38:40 smithi181 ceph-mon[25762]: from='client.? 172.21.15.99:0/3055914652' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.99:0/2799400391"}]: dispatch 2024-03-30T13:38:40.506 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:38:40 smithi181 ceph-mon[25762]: pgmap v119: 161 pgs: 161 active+clean; 585 KiB data, 66 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:38:40.586 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:38:40 smithi099 ceph-mon[29691]: from='client.? 172.21.15.99:0/429004758' entity='client.iscsi.foo.smithi099.qyjuvr' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.99:0/3858852026"}]': finished 2024-03-30T13:38:40.587 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:38:40 smithi099 ceph-mon[29691]: osdmap e93: 8 total, 8 up, 8 in 2024-03-30T13:38:40.587 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:38:40 smithi099 ceph-mon[29691]: from='client.? 172.21.15.99:0/3055914652' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.99:0/2799400391"}]: dispatch 2024-03-30T13:38:40.587 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:38:40 smithi099 ceph-mon[29691]: pgmap v119: 161 pgs: 161 active+clean; 585 KiB data, 66 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:38:40.587 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:38:40 smithi099 ceph-mon[24912]: from='client.? 172.21.15.99:0/429004758' entity='client.iscsi.foo.smithi099.qyjuvr' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.99:0/3858852026"}]': finished 2024-03-30T13:38:40.587 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:38:40 smithi099 ceph-mon[24912]: osdmap e93: 8 total, 8 up, 8 in 2024-03-30T13:38:40.587 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:38:40 smithi099 ceph-mon[24912]: from='client.? 172.21.15.99:0/3055914652' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.99:0/2799400391"}]: dispatch 2024-03-30T13:38:40.587 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:38:40 smithi099 ceph-mon[24912]: pgmap v119: 161 pgs: 161 active+clean; 585 KiB data, 66 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:38:41.506 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:38:41 smithi181 ceph-mon[25762]: from='client.? 172.21.15.99:0/3055914652' entity='client.iscsi.foo.smithi099.qyjuvr' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.99:0/2799400391"}]': finished 2024-03-30T13:38:41.506 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:38:41 smithi181 ceph-mon[25762]: osdmap e94: 8 total, 8 up, 8 in 2024-03-30T13:38:41.506 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:38:41 smithi181 ceph-mon[25762]: from='client.? 172.21.15.99:0/4246438092' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.99:6801/4092149076"}]: dispatch 2024-03-30T13:38:41.587 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:38:41 smithi099 ceph-mon[29691]: from='client.? 172.21.15.99:0/3055914652' entity='client.iscsi.foo.smithi099.qyjuvr' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.99:0/2799400391"}]': finished 2024-03-30T13:38:41.587 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:38:41 smithi099 ceph-mon[29691]: osdmap e94: 8 total, 8 up, 8 in 2024-03-30T13:38:41.587 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:38:41 smithi099 ceph-mon[29691]: from='client.? 172.21.15.99:0/4246438092' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.99:6801/4092149076"}]: dispatch 2024-03-30T13:38:41.587 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:38:41 smithi099 ceph-mon[24912]: from='client.? 172.21.15.99:0/3055914652' entity='client.iscsi.foo.smithi099.qyjuvr' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.99:0/2799400391"}]': finished 2024-03-30T13:38:41.587 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:38:41 smithi099 ceph-mon[24912]: osdmap e94: 8 total, 8 up, 8 in 2024-03-30T13:38:41.587 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:38:41 smithi099 ceph-mon[24912]: from='client.? 172.21.15.99:0/4246438092' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.99:6801/4092149076"}]: dispatch 2024-03-30T13:38:42.506 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:38:42 smithi181 ceph-mon[25762]: from='client.? 172.21.15.99:0/4246438092' entity='client.iscsi.foo.smithi099.qyjuvr' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.99:6801/4092149076"}]': finished 2024-03-30T13:38:42.506 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:38:42 smithi181 ceph-mon[25762]: osdmap e95: 8 total, 8 up, 8 in 2024-03-30T13:38:42.506 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:38:42 smithi181 ceph-mon[25762]: pgmap v122: 161 pgs: 161 active+clean; 585 KiB data, 67 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T13:38:42.587 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:38:42 smithi099 ceph-mon[29691]: from='client.? 172.21.15.99:0/4246438092' entity='client.iscsi.foo.smithi099.qyjuvr' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.99:6801/4092149076"}]': finished 2024-03-30T13:38:42.587 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:38:42 smithi099 ceph-mon[29691]: osdmap e95: 8 total, 8 up, 8 in 2024-03-30T13:38:42.587 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:38:42 smithi099 ceph-mon[29691]: pgmap v122: 161 pgs: 161 active+clean; 585 KiB data, 67 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T13:38:42.587 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:38:42 smithi099 ceph-mon[24912]: from='client.? 172.21.15.99:0/4246438092' entity='client.iscsi.foo.smithi099.qyjuvr' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.99:6801/4092149076"}]': finished 2024-03-30T13:38:42.587 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:38:42 smithi099 ceph-mon[24912]: osdmap e95: 8 total, 8 up, 8 in 2024-03-30T13:38:42.587 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:38:42 smithi099 ceph-mon[24912]: pgmap v122: 161 pgs: 161 active+clean; 585 KiB data, 67 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T13:38:44.837 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:38:44 smithi099 ceph-mon[24912]: pgmap v123: 161 pgs: 161 active+clean; 585 KiB data, 67 MiB used, 715 GiB / 715 GiB avail; 883 B/s rd, 0 op/s 2024-03-30T13:38:44.837 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:38:44 smithi099 ceph-mon[29691]: pgmap v123: 161 pgs: 161 active+clean; 585 KiB data, 67 MiB used, 715 GiB / 715 GiB avail; 883 B/s rd, 0 op/s 2024-03-30T13:38:45.006 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:38:44 smithi181 ceph-mon[25762]: pgmap v123: 161 pgs: 161 active+clean; 585 KiB data, 67 MiB used, 715 GiB / 715 GiB avail; 883 B/s rd, 0 op/s 2024-03-30T13:38:45.837 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:38:45 smithi099 ceph-mon[24912]: from='client.14838 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T13:38:45.837 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:38:45 smithi099 ceph-mon[29691]: from='client.14838 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T13:38:46.006 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:38:45 smithi181 ceph-mon[25762]: from='client.14838 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T13:38:46.837 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:38:46 smithi099 ceph-mon[24912]: pgmap v124: 161 pgs: 161 active+clean; 585 KiB data, 67 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 1 op/s 2024-03-30T13:38:46.837 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:38:46 smithi099 ceph-mon[29691]: pgmap v124: 161 pgs: 161 active+clean; 585 KiB data, 67 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 1 op/s 2024-03-30T13:38:46.837 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:38:46 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[25141]: ::ffff:172.21.15.181 - - [30/Mar/2024:13:38:46] "GET /metrics HTTP/1.1" 200 208178 "" "Prometheus/2.33.4" 2024-03-30T13:38:46.837 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:38:46 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[25141]: 172.21.15.99 - - [30/Mar/2024:13:38:46] "POST /data HTTP/1.1" 200 46 "" "Python-urllib/3.9" 2024-03-30T13:38:47.005 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:38:46 smithi181 ceph-mon[25762]: pgmap v124: 161 pgs: 161 active+clean; 585 KiB data, 67 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 1 op/s 2024-03-30T13:38:48.087 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:38:47 smithi099 ceph-mon[29691]: from='mgr.14439 ' entity='mgr.y' 2024-03-30T13:38:48.087 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:38:47 smithi099 ceph-mon[29691]: from='mgr.14439 ' entity='mgr.y' 2024-03-30T13:38:48.087 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:38:47 smithi099 ceph-mon[24912]: from='mgr.14439 ' entity='mgr.y' 2024-03-30T13:38:48.087 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:38:47 smithi099 ceph-mon[24912]: from='mgr.14439 ' entity='mgr.y' 2024-03-30T13:38:48.256 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:38:47 smithi181 ceph-mon[25762]: from='mgr.14439 ' entity='mgr.y' 2024-03-30T13:38:48.256 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:38:47 smithi181 ceph-mon[25762]: from='mgr.14439 ' entity='mgr.y' 2024-03-30T13:38:49.087 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:38:48 smithi099 ceph-mon[24912]: pgmap v125: 161 pgs: 161 active+clean; 585 KiB data, 67 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T13:38:49.087 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:38:48 smithi099 ceph-mon[29691]: pgmap v125: 161 pgs: 161 active+clean; 585 KiB data, 67 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T13:38:49.256 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:38:48 smithi181 ceph-mon[25762]: pgmap v125: 161 pgs: 161 active+clean; 585 KiB data, 67 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T13:38:49.756 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 13:38:49 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-x[27332]: ::ffff:172.21.15.181 - - [30/Mar/2024:13:38:49] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-03-30T13:38:50.506 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:38:50 smithi181 ceph-mon[25762]: pgmap v126: 161 pgs: 161 active+clean; 585 KiB data, 67 MiB used, 715 GiB / 715 GiB avail; 1.0 KiB/s rd, 1 op/s 2024-03-30T13:38:50.587 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:38:50 smithi099 ceph-mon[24912]: pgmap v126: 161 pgs: 161 active+clean; 585 KiB data, 67 MiB used, 715 GiB / 715 GiB avail; 1.0 KiB/s rd, 1 op/s 2024-03-30T13:38:50.587 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:38:50 smithi099 ceph-mon[29691]: pgmap v126: 161 pgs: 161 active+clean; 585 KiB data, 67 MiB used, 715 GiB / 715 GiB avail; 1.0 KiB/s rd, 1 op/s 2024-03-30T13:38:52.452 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:38:52 smithi181 ceph-mon[25762]: pgmap v127: 161 pgs: 161 active+clean; 585 KiB data, 67 MiB used, 715 GiB / 715 GiB avail; 950 B/s rd, 0 op/s 2024-03-30T13:38:52.587 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:38:52 smithi099 ceph-mon[24912]: pgmap v127: 161 pgs: 161 active+clean; 585 KiB data, 67 MiB used, 715 GiB / 715 GiB avail; 950 B/s rd, 0 op/s 2024-03-30T13:38:52.587 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:38:52 smithi099 ceph-mon[29691]: pgmap v127: 161 pgs: 161 active+clean; 585 KiB data, 67 MiB used, 715 GiB / 715 GiB avail; 950 B/s rd, 0 op/s 2024-03-30T13:38:54.686 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:38:54 smithi181 ceph-mon[25762]: pgmap v128: 161 pgs: 161 active+clean; 585 KiB data, 67 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T13:38:54.837 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:38:54 smithi099 ceph-mon[24912]: pgmap v128: 161 pgs: 161 active+clean; 585 KiB data, 67 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T13:38:54.837 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:38:54 smithi099 ceph-mon[29691]: pgmap v128: 161 pgs: 161 active+clean; 585 KiB data, 67 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T13:38:56.006 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:38:55 smithi181 ceph-mon[25762]: from='client.14838 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T13:38:56.086 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:38:55 smithi099 ceph-mon[24912]: from='client.14838 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T13:38:56.087 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:38:55 smithi099 ceph-mon[29691]: from='client.14838 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T13:38:56.587 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:38:56 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[25141]: 172.21.15.181 - - [30/Mar/2024:13:38:56] "POST /data HTTP/1.1" 200 46 "" "Python-urllib/3.9" 2024-03-30T13:38:57.006 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:38:56 smithi181 ceph-mon[25762]: pgmap v129: 161 pgs: 161 active+clean; 585 KiB data, 67 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T13:38:57.006 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:38:56 smithi181 ceph-mon[25762]: from='mgr.14439 ' entity='mgr.y' 2024-03-30T13:38:57.006 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:38:56 smithi181 ceph-mon[25762]: from='mgr.14439 ' entity='mgr.y' 2024-03-30T13:38:57.087 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:38:56 smithi099 ceph-mon[24912]: pgmap v129: 161 pgs: 161 active+clean; 585 KiB data, 67 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T13:38:57.087 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:38:56 smithi099 ceph-mon[24912]: from='mgr.14439 ' entity='mgr.y' 2024-03-30T13:38:57.087 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:38:56 smithi099 ceph-mon[24912]: from='mgr.14439 ' entity='mgr.y' 2024-03-30T13:38:57.087 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:38:56 smithi099 ceph-mon[29691]: pgmap v129: 161 pgs: 161 active+clean; 585 KiB data, 67 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T13:38:57.087 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:38:56 smithi099 ceph-mon[29691]: from='mgr.14439 ' entity='mgr.y' 2024-03-30T13:38:57.087 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:38:56 smithi099 ceph-mon[29691]: from='mgr.14439 ' entity='mgr.y' 2024-03-30T13:38:57.087 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:38:56 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[25141]: ::ffff:172.21.15.181 - - [30/Mar/2024:13:38:56] "GET /metrics HTTP/1.1" 200 208178 "" "Prometheus/2.33.4" 2024-03-30T13:38:58.506 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:38:58 smithi181 ceph-mon[25762]: pgmap v130: 161 pgs: 161 active+clean; 585 KiB data, 67 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T13:38:58.587 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:38:58 smithi099 ceph-mon[29691]: pgmap v130: 161 pgs: 161 active+clean; 585 KiB data, 67 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T13:38:58.587 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:38:58 smithi099 ceph-mon[24912]: pgmap v130: 161 pgs: 161 active+clean; 585 KiB data, 67 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T13:38:59.756 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 13:38:59 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-x[27332]: ::ffff:172.21.15.181 - - [30/Mar/2024:13:38:59] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-03-30T13:38:59.756 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:38:59 smithi181 ceph-mon[25762]: from='mgr.14439 172.21.15.99:0/1757456350' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-03-30T13:38:59.756 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:38:59 smithi181 ceph-mon[25762]: from='mgr.14439 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-03-30T13:38:59.757 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:38:59 smithi181 ceph-mon[25762]: from='mgr.14439 172.21.15.99:0/1757456350' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-03-30T13:38:59.757 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:38:59 smithi181 ceph-mon[25762]: from='mgr.14439 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-03-30T13:39:00.087 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:38:59 smithi099 ceph-mon[24912]: from='mgr.14439 172.21.15.99:0/1757456350' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-03-30T13:39:00.087 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:38:59 smithi099 ceph-mon[24912]: from='mgr.14439 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-03-30T13:39:00.087 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:38:59 smithi099 ceph-mon[24912]: from='mgr.14439 172.21.15.99:0/1757456350' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-03-30T13:39:00.087 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:38:59 smithi099 ceph-mon[24912]: from='mgr.14439 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-03-30T13:39:00.087 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:38:59 smithi099 ceph-mon[29691]: from='mgr.14439 172.21.15.99:0/1757456350' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-03-30T13:39:00.087 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:38:59 smithi099 ceph-mon[29691]: from='mgr.14439 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-03-30T13:39:00.087 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:38:59 smithi099 ceph-mon[29691]: from='mgr.14439 172.21.15.99:0/1757456350' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-03-30T13:39:00.087 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:38:59 smithi099 ceph-mon[29691]: from='mgr.14439 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-03-30T13:39:01.006 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:39:00 smithi181 ceph-mon[25762]: pgmap v131: 161 pgs: 161 active+clean; 585 KiB data, 67 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T13:39:01.087 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:39:00 smithi099 ceph-mon[24912]: pgmap v131: 161 pgs: 161 active+clean; 585 KiB data, 67 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T13:39:01.087 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:39:00 smithi099 ceph-mon[29691]: pgmap v131: 161 pgs: 161 active+clean; 585 KiB data, 67 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T13:39:02.506 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:39:02 smithi181 ceph-mon[25762]: pgmap v132: 161 pgs: 161 active+clean; 585 KiB data, 67 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T13:39:02.587 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:39:02 smithi099 ceph-mon[24912]: pgmap v132: 161 pgs: 161 active+clean; 585 KiB data, 67 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T13:39:02.587 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:39:02 smithi099 ceph-mon[29691]: pgmap v132: 161 pgs: 161 active+clean; 585 KiB data, 67 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T13:39:04.888 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:39:04 smithi099 ceph-mon[24912]: pgmap v133: 161 pgs: 161 active+clean; 585 KiB data, 67 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T13:39:04.888 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:39:04 smithi099 ceph-mon[29691]: pgmap v133: 161 pgs: 161 active+clean; 585 KiB data, 67 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T13:39:05.006 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:39:04 smithi181 ceph-mon[25762]: pgmap v133: 161 pgs: 161 active+clean; 585 KiB data, 67 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T13:39:06.006 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:39:05 smithi181 ceph-mon[25762]: from='client.14838 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T13:39:06.086 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:39:05 smithi099 ceph-mon[24912]: from='client.14838 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T13:39:06.087 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:39:05 smithi099 ceph-mon[29691]: from='client.14838 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T13:39:06.870 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:39:06 smithi099 ceph-mon[24912]: pgmap v134: 161 pgs: 161 active+clean; 585 KiB data, 67 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T13:39:06.870 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:39:06 smithi099 ceph-mon[29691]: pgmap v134: 161 pgs: 161 active+clean; 585 KiB data, 67 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T13:39:06.871 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:39:06 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[25141]: ::ffff:172.21.15.181 - - [30/Mar/2024:13:39:06] "GET /metrics HTTP/1.1" 200 208121 "" "Prometheus/2.33.4" 2024-03-30T13:39:06.871 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:39:06 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[25141]: 172.21.15.99 - - [30/Mar/2024:13:39:06] "POST /data HTTP/1.1" 200 46 "" "Python-urllib/3.9" 2024-03-30T13:39:07.006 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:39:06 smithi181 ceph-mon[25762]: pgmap v134: 161 pgs: 161 active+clean; 585 KiB data, 67 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T13:39:08.256 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:39:07 smithi181 ceph-mon[25762]: from='mgr.14439 ' entity='mgr.y' 2024-03-30T13:39:08.256 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:39:07 smithi181 ceph-mon[25762]: from='mgr.14439 ' entity='mgr.y' 2024-03-30T13:39:08.337 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:39:07 smithi099 ceph-mon[24912]: from='mgr.14439 ' entity='mgr.y' 2024-03-30T13:39:08.337 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:39:07 smithi099 ceph-mon[24912]: from='mgr.14439 ' entity='mgr.y' 2024-03-30T13:39:08.337 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:39:07 smithi099 ceph-mon[29691]: from='mgr.14439 ' entity='mgr.y' 2024-03-30T13:39:08.337 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:39:07 smithi099 ceph-mon[29691]: from='mgr.14439 ' entity='mgr.y' 2024-03-30T13:39:09.256 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:39:08 smithi181 ceph-mon[25762]: pgmap v135: 161 pgs: 161 active+clean; 585 KiB data, 67 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T13:39:09.337 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:39:08 smithi099 ceph-mon[24912]: pgmap v135: 161 pgs: 161 active+clean; 585 KiB data, 67 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T13:39:09.337 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:39:08 smithi099 ceph-mon[29691]: pgmap v135: 161 pgs: 161 active+clean; 585 KiB data, 67 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T13:39:09.756 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 13:39:09 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-x[27332]: ::ffff:172.21.15.181 - - [30/Mar/2024:13:39:09] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-03-30T13:39:10.506 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:39:10 smithi181 ceph-mon[25762]: pgmap v136: 161 pgs: 161 active+clean; 585 KiB data, 67 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T13:39:10.586 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:39:10 smithi099 ceph-mon[24912]: pgmap v136: 161 pgs: 161 active+clean; 585 KiB data, 67 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T13:39:10.587 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:39:10 smithi099 ceph-mon[29691]: pgmap v136: 161 pgs: 161 active+clean; 585 KiB data, 67 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T13:39:12.393 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:39:12 smithi181 ceph-mon[25762]: pgmap v137: 161 pgs: 161 active+clean; 585 KiB data, 67 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T13:39:12.587 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:39:12 smithi099 ceph-mon[24912]: pgmap v137: 161 pgs: 161 active+clean; 585 KiB data, 67 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T13:39:12.587 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:39:12 smithi099 ceph-mon[29691]: pgmap v137: 161 pgs: 161 active+clean; 585 KiB data, 67 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T13:39:13.829 INFO:journalctl@ceph.alertmanager.a.smithi099.stdout:Mar 30 13:39:13 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-alertmanager-a[52107]: level=warn ts=2024-03-30T13:39:13.521Z caller=notify.go:724 component=dispatcher receiver=ceph-dashboard integration=webhook[0] msg="Notify attempt failed, will retry later" attempts=1 err="Post \"https://172.21.15.99:8443//api/prometheus_receiver\": x509: cannot validate certificate for 172.21.15.99 because it doesn't contain any IP SANs" 2024-03-30T13:39:13.830 INFO:journalctl@ceph.alertmanager.a.smithi099.stdout:Mar 30 13:39:13 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-alertmanager-a[52107]: level=warn ts=2024-03-30T13:39:13.521Z caller=notify.go:724 component=dispatcher receiver=ceph-dashboard integration=webhook[1] msg="Notify attempt failed, will retry later" attempts=1 err="Post \"https://172.21.15.181:8443/api/prometheus_receiver\": x509: cannot validate certificate for 172.21.15.181 because it doesn't contain any IP SANs" 2024-03-30T13:39:14.756 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:39:14 smithi181 ceph-mon[25762]: pgmap v138: 161 pgs: 161 active+clean; 585 KiB data, 67 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T13:39:14.837 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:39:14 smithi099 ceph-mon[24912]: pgmap v138: 161 pgs: 161 active+clean; 585 KiB data, 67 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T13:39:14.837 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:39:14 smithi099 ceph-mon[29691]: pgmap v138: 161 pgs: 161 active+clean; 585 KiB data, 67 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T13:39:15.755 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:39:15 smithi181 ceph-mon[25762]: from='client.14838 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T13:39:16.087 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:39:15 smithi099 ceph-mon[24912]: from='client.14838 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T13:39:16.087 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:39:15 smithi099 ceph-mon[29691]: from='client.14838 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T13:39:16.750 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:39:16 smithi099 ceph-mon[29691]: pgmap v139: 161 pgs: 161 active+clean; 585 KiB data, 67 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T13:39:16.750 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:39:16 smithi099 ceph-mon[29691]: from='mgr.14439 ' entity='mgr.y' 2024-03-30T13:39:16.751 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:39:16 smithi099 ceph-mon[29691]: from='mgr.14439 ' entity='mgr.y' 2024-03-30T13:39:16.751 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:39:16 smithi099 ceph-mon[24912]: pgmap v139: 161 pgs: 161 active+clean; 585 KiB data, 67 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T13:39:16.751 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:39:16 smithi099 ceph-mon[24912]: from='mgr.14439 ' entity='mgr.y' 2024-03-30T13:39:16.751 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:39:16 smithi099 ceph-mon[24912]: from='mgr.14439 ' entity='mgr.y' 2024-03-30T13:39:16.751 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:39:16 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[25141]: 172.21.15.181 - - [30/Mar/2024:13:39:16] "POST /data HTTP/1.1" 200 46 "" "Python-urllib/3.9" 2024-03-30T13:39:16.756 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:39:16 smithi181 ceph-mon[25762]: pgmap v139: 161 pgs: 161 active+clean; 585 KiB data, 67 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T13:39:16.756 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:39:16 smithi181 ceph-mon[25762]: from='mgr.14439 ' entity='mgr.y' 2024-03-30T13:39:16.756 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:39:16 smithi181 ceph-mon[25762]: from='mgr.14439 ' entity='mgr.y' 2024-03-30T13:39:17.087 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:39:16 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[25141]: ::ffff:172.21.15.181 - - [30/Mar/2024:13:39:16] "GET /metrics HTTP/1.1" 200 208076 "" "Prometheus/2.33.4" 2024-03-30T13:39:18.506 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:39:18 smithi181 ceph-mon[25762]: pgmap v140: 161 pgs: 161 active+clean; 585 KiB data, 67 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T13:39:18.587 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:39:18 smithi099 ceph-mon[29691]: pgmap v140: 161 pgs: 161 active+clean; 585 KiB data, 67 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T13:39:18.587 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:39:18 smithi099 ceph-mon[24912]: pgmap v140: 161 pgs: 161 active+clean; 585 KiB data, 67 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T13:39:19.756 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 13:39:19 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-x[27332]: ::ffff:172.21.15.181 - - [30/Mar/2024:13:39:19] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-03-30T13:39:20.506 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:39:20 smithi181 ceph-mon[25762]: pgmap v141: 161 pgs: 161 active+clean; 585 KiB data, 67 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T13:39:20.586 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:39:20 smithi099 ceph-mon[29691]: pgmap v141: 161 pgs: 161 active+clean; 585 KiB data, 67 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T13:39:20.587 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:39:20 smithi099 ceph-mon[24912]: pgmap v141: 161 pgs: 161 active+clean; 585 KiB data, 67 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T13:39:22.506 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:39:22 smithi181 ceph-mon[25762]: pgmap v142: 161 pgs: 161 active+clean; 585 KiB data, 67 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T13:39:22.587 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:39:22 smithi099 ceph-mon[29691]: pgmap v142: 161 pgs: 161 active+clean; 585 KiB data, 67 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T13:39:22.587 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:39:22 smithi099 ceph-mon[24912]: pgmap v142: 161 pgs: 161 active+clean; 585 KiB data, 67 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T13:39:23.809 INFO:journalctl@ceph.alertmanager.a.smithi099.stdout:Mar 30 13:39:23 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-alertmanager-a[52107]: level=error ts=2024-03-30T13:39:23.507Z caller=dispatch.go:354 component=dispatcher msg="Notify for alerts failed" num_alerts=3 err="ceph-dashboard/webhook[1]: notify retry canceled after 7 attempts: Post \"https://172.21.15.181:8443/api/prometheus_receiver\": x509: cannot validate certificate for 172.21.15.181 because it doesn't contain any IP SANs; ceph-dashboard/webhook[0]: notify retry canceled after 8 attempts: Post \"https://172.21.15.99:8443//api/prometheus_receiver\": x509: cannot validate certificate for 172.21.15.99 because it doesn't contain any IP SANs" 2024-03-30T13:39:23.809 INFO:journalctl@ceph.alertmanager.a.smithi099.stdout:Mar 30 13:39:23 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-alertmanager-a[52107]: level=warn ts=2024-03-30T13:39:23.509Z caller=notify.go:724 component=dispatcher receiver=ceph-dashboard integration=webhook[0] msg="Notify attempt failed, will retry later" attempts=1 err="Post \"https://172.21.15.99:8443//api/prometheus_receiver\": x509: cannot validate certificate for 172.21.15.99 because it doesn't contain any IP SANs" 2024-03-30T13:39:23.810 INFO:journalctl@ceph.alertmanager.a.smithi099.stdout:Mar 30 13:39:23 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-alertmanager-a[52107]: level=warn ts=2024-03-30T13:39:23.509Z caller=notify.go:724 component=dispatcher receiver=ceph-dashboard integration=webhook[1] msg="Notify attempt failed, will retry later" attempts=1 err="Post \"https://172.21.15.181:8443/api/prometheus_receiver\": x509: cannot validate certificate for 172.21.15.181 because it doesn't contain any IP SANs" 2024-03-30T13:39:24.875 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:39:24 smithi099 ceph-mon[24912]: pgmap v143: 161 pgs: 161 active+clean; 585 KiB data, 67 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T13:39:24.876 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:39:24 smithi099 ceph-mon[29691]: pgmap v143: 161 pgs: 161 active+clean; 585 KiB data, 67 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T13:39:25.006 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:39:24 smithi181 ceph-mon[25762]: pgmap v143: 161 pgs: 161 active+clean; 585 KiB data, 67 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T13:39:26.006 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:39:25 smithi181 ceph-mon[25762]: from='client.14838 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T13:39:26.069 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:39:25 smithi099 ceph-mon[24912]: from='client.14838 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T13:39:26.069 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:39:25 smithi099 ceph-mon[29691]: from='client.14838 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T13:39:26.974 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:39:26 smithi099 ceph-mon[24912]: pgmap v144: 161 pgs: 161 active+clean; 585 KiB data, 67 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T13:39:26.975 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:39:26 smithi099 ceph-mon[29691]: pgmap v144: 161 pgs: 161 active+clean; 585 KiB data, 67 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T13:39:26.975 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:39:26 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[25141]: ::ffff:172.21.15.181 - - [30/Mar/2024:13:39:26] "GET /metrics HTTP/1.1" 200 208076 "" "Prometheus/2.33.4" 2024-03-30T13:39:27.006 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:39:26 smithi181 ceph-mon[25762]: pgmap v144: 161 pgs: 161 active+clean; 585 KiB data, 67 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T13:39:27.336 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:39:26 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[25141]: 172.21.15.99 - - [30/Mar/2024:13:39:26] "POST /data HTTP/1.1" 200 46 "" "Python-urllib/3.9" 2024-03-30T13:39:28.256 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:39:27 smithi181 ceph-mon[25762]: from='mgr.14439 ' entity='mgr.y' 2024-03-30T13:39:28.256 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:39:27 smithi181 ceph-mon[25762]: from='mgr.14439 ' entity='mgr.y' 2024-03-30T13:39:28.337 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:39:27 smithi099 ceph-mon[24912]: from='mgr.14439 ' entity='mgr.y' 2024-03-30T13:39:28.337 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:39:27 smithi099 ceph-mon[24912]: from='mgr.14439 ' entity='mgr.y' 2024-03-30T13:39:28.337 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:39:27 smithi099 ceph-mon[29691]: from='mgr.14439 ' entity='mgr.y' 2024-03-30T13:39:28.337 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:39:27 smithi099 ceph-mon[29691]: from='mgr.14439 ' entity='mgr.y' 2024-03-30T13:39:29.256 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:39:28 smithi181 ceph-mon[25762]: pgmap v145: 161 pgs: 161 active+clean; 585 KiB data, 67 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T13:39:29.337 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:39:28 smithi099 ceph-mon[24912]: pgmap v145: 161 pgs: 161 active+clean; 585 KiB data, 67 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T13:39:29.337 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:39:28 smithi099 ceph-mon[29691]: pgmap v145: 161 pgs: 161 active+clean; 585 KiB data, 67 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T13:39:29.756 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 13:39:29 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-x[27332]: ::ffff:172.21.15.181 - - [30/Mar/2024:13:39:29] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-03-30T13:39:30.506 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:39:30 smithi181 ceph-mon[25762]: pgmap v146: 161 pgs: 161 active+clean; 585 KiB data, 67 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T13:39:30.586 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:39:30 smithi099 ceph-mon[24912]: pgmap v146: 161 pgs: 161 active+clean; 585 KiB data, 67 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T13:39:30.587 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:39:30 smithi099 ceph-mon[29691]: pgmap v146: 161 pgs: 161 active+clean; 585 KiB data, 67 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T13:39:31.506 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:39:31 smithi181 ceph-mon[25762]: from='mgr.14439 172.21.15.99:0/1757456350' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:39:31.506 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:39:31 smithi181 ceph-mon[25762]: from='mgr.14439 172.21.15.99:0/1757456350' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:39:31.506 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:39:31 smithi181 ceph-mon[25762]: from='mgr.14439 ' entity='mgr.y' 2024-03-30T13:39:31.587 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:39:31 smithi099 ceph-mon[24912]: from='mgr.14439 172.21.15.99:0/1757456350' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:39:31.587 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:39:31 smithi099 ceph-mon[24912]: from='mgr.14439 172.21.15.99:0/1757456350' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:39:31.587 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:39:31 smithi099 ceph-mon[24912]: from='mgr.14439 ' entity='mgr.y' 2024-03-30T13:39:31.587 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:39:31 smithi099 ceph-mon[29691]: from='mgr.14439 172.21.15.99:0/1757456350' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:39:31.587 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:39:31 smithi099 ceph-mon[29691]: from='mgr.14439 172.21.15.99:0/1757456350' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:39:31.587 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:39:31 smithi099 ceph-mon[29691]: from='mgr.14439 ' entity='mgr.y' 2024-03-30T13:39:32.488 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:39:32 smithi099 ceph-mon[24912]: pgmap v147: 161 pgs: 161 active+clean; 585 KiB data, 67 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T13:39:32.488 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:39:32 smithi099 ceph-mon[29691]: pgmap v147: 161 pgs: 161 active+clean; 585 KiB data, 67 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T13:39:32.506 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:39:32 smithi181 ceph-mon[25762]: pgmap v147: 161 pgs: 161 active+clean; 585 KiB data, 67 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T13:39:33.837 INFO:journalctl@ceph.alertmanager.a.smithi099.stdout:Mar 30 13:39:33 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-alertmanager-a[52107]: level=error ts=2024-03-30T13:39:33.508Z caller=dispatch.go:354 component=dispatcher msg="Notify for alerts failed" num_alerts=3 err="ceph-dashboard/webhook[0]: notify retry canceled after 7 attempts: Post \"https://172.21.15.99:8443//api/prometheus_receiver\": x509: cannot validate certificate for 172.21.15.99 because it doesn't contain any IP SANs; ceph-dashboard/webhook[1]: notify retry canceled after 7 attempts: Post \"https://172.21.15.181:8443/api/prometheus_receiver\": x509: cannot validate certificate for 172.21.15.181 because it doesn't contain any IP SANs" 2024-03-30T13:39:33.837 INFO:journalctl@ceph.alertmanager.a.smithi099.stdout:Mar 30 13:39:33 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-alertmanager-a[52107]: level=warn ts=2024-03-30T13:39:33.509Z caller=notify.go:724 component=dispatcher receiver=ceph-dashboard integration=webhook[0] msg="Notify attempt failed, will retry later" attempts=1 err="Post \"https://172.21.15.99:8443//api/prometheus_receiver\": x509: cannot validate certificate for 172.21.15.99 because it doesn't contain any IP SANs" 2024-03-30T13:39:33.837 INFO:journalctl@ceph.alertmanager.a.smithi099.stdout:Mar 30 13:39:33 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-alertmanager-a[52107]: level=warn ts=2024-03-30T13:39:33.510Z caller=notify.go:724 component=dispatcher receiver=ceph-dashboard integration=webhook[1] msg="Notify attempt failed, will retry later" attempts=1 err="Post \"https://172.21.15.181:8443/api/prometheus_receiver\": x509: cannot validate certificate for 172.21.15.181 because it doesn't contain any IP SANs" 2024-03-30T13:39:34.756 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:39:34 smithi181 ceph-mon[25762]: pgmap v148: 161 pgs: 161 active+clean; 585 KiB data, 67 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T13:39:34.837 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:39:34 smithi099 ceph-mon[24912]: pgmap v148: 161 pgs: 161 active+clean; 585 KiB data, 67 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T13:39:34.837 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:39:34 smithi099 ceph-mon[29691]: pgmap v148: 161 pgs: 161 active+clean; 585 KiB data, 67 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T13:39:35.756 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:39:35 smithi181 ceph-mon[25762]: from='client.14838 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T13:39:36.087 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:39:35 smithi099 ceph-mon[29691]: from='client.14838 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T13:39:36.087 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:39:35 smithi099 ceph-mon[24912]: from='client.14838 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T13:39:36.837 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:39:36 smithi099 ceph-mon[24912]: pgmap v149: 161 pgs: 161 active+clean; 585 KiB data, 67 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T13:39:36.837 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:39:36 smithi099 ceph-mon[24912]: from='mgr.14439 ' entity='mgr.y' 2024-03-30T13:39:36.837 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:39:36 smithi099 ceph-mon[24912]: from='mgr.14439 ' entity='mgr.y' 2024-03-30T13:39:36.838 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:39:36 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[25141]: 172.21.15.181 - - [30/Mar/2024:13:39:36] "POST /data HTTP/1.1" 200 46 "" "Python-urllib/3.9" 2024-03-30T13:39:36.838 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:39:36 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[25141]: ::ffff:172.21.15.181 - - [30/Mar/2024:13:39:36] "GET /metrics HTTP/1.1" 200 208077 "" "Prometheus/2.33.4" 2024-03-30T13:39:36.838 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:39:36 smithi099 ceph-mon[29691]: pgmap v149: 161 pgs: 161 active+clean; 585 KiB data, 67 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T13:39:36.838 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:39:36 smithi099 ceph-mon[29691]: from='mgr.14439 ' entity='mgr.y' 2024-03-30T13:39:36.838 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:39:36 smithi099 ceph-mon[29691]: from='mgr.14439 ' entity='mgr.y' 2024-03-30T13:39:36.859 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:39:36 smithi181 ceph-mon[25762]: pgmap v149: 161 pgs: 161 active+clean; 585 KiB data, 67 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T13:39:36.859 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:39:36 smithi181 ceph-mon[25762]: from='mgr.14439 ' entity='mgr.y' 2024-03-30T13:39:36.859 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:39:36 smithi181 ceph-mon[25762]: from='mgr.14439 ' entity='mgr.y' 2024-03-30T13:39:38.506 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:39:38 smithi181 ceph-mon[25762]: pgmap v150: 161 pgs: 161 active+clean; 585 KiB data, 67 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T13:39:38.587 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:39:38 smithi099 ceph-mon[24912]: pgmap v150: 161 pgs: 161 active+clean; 585 KiB data, 67 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T13:39:38.587 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:39:38 smithi099 ceph-mon[29691]: pgmap v150: 161 pgs: 161 active+clean; 585 KiB data, 67 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T13:39:39.756 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 13:39:39 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-x[27332]: ::ffff:172.21.15.181 - - [30/Mar/2024:13:39:39] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-03-30T13:39:40.506 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:39:40 smithi181 ceph-mon[25762]: pgmap v151: 161 pgs: 161 active+clean; 585 KiB data, 67 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T13:39:40.587 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:39:40 smithi099 ceph-mon[24912]: pgmap v151: 161 pgs: 161 active+clean; 585 KiB data, 67 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T13:39:40.587 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:39:40 smithi099 ceph-mon[29691]: pgmap v151: 161 pgs: 161 active+clean; 585 KiB data, 67 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T13:39:42.506 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:39:42 smithi181 ceph-mon[25762]: pgmap v152: 161 pgs: 161 active+clean; 585 KiB data, 67 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T13:39:42.539 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:39:42 smithi099 ceph-mon[24912]: pgmap v152: 161 pgs: 161 active+clean; 585 KiB data, 67 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T13:39:42.539 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:39:42 smithi099 ceph-mon[29691]: pgmap v152: 161 pgs: 161 active+clean; 585 KiB data, 67 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T13:39:43.785 INFO:journalctl@ceph.alertmanager.a.smithi099.stdout:Mar 30 13:39:43 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-alertmanager-a[52107]: level=error ts=2024-03-30T13:39:43.508Z caller=dispatch.go:354 component=dispatcher msg="Notify for alerts failed" num_alerts=3 err="ceph-dashboard/webhook[0]: notify retry canceled after 8 attempts: Post \"https://172.21.15.99:8443//api/prometheus_receiver\": x509: cannot validate certificate for 172.21.15.99 because it doesn't contain any IP SANs; ceph-dashboard/webhook[1]: notify retry canceled after 8 attempts: Post \"https://172.21.15.181:8443/api/prometheus_receiver\": x509: cannot validate certificate for 172.21.15.181 because it doesn't contain any IP SANs" 2024-03-30T13:39:43.785 INFO:journalctl@ceph.alertmanager.a.smithi099.stdout:Mar 30 13:39:43 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-alertmanager-a[52107]: level=warn ts=2024-03-30T13:39:43.510Z caller=notify.go:724 component=dispatcher receiver=ceph-dashboard integration=webhook[1] msg="Notify attempt failed, will retry later" attempts=1 err="Post \"https://172.21.15.181:8443/api/prometheus_receiver\": x509: cannot validate certificate for 172.21.15.181 because it doesn't contain any IP SANs" 2024-03-30T13:39:43.785 INFO:journalctl@ceph.alertmanager.a.smithi099.stdout:Mar 30 13:39:43 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-alertmanager-a[52107]: level=warn ts=2024-03-30T13:39:43.510Z caller=notify.go:724 component=dispatcher receiver=ceph-dashboard integration=webhook[0] msg="Notify attempt failed, will retry later" attempts=1 err="Post \"https://172.21.15.99:8443//api/prometheus_receiver\": x509: cannot validate certificate for 172.21.15.99 because it doesn't contain any IP SANs" 2024-03-30T13:39:44.756 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:39:44 smithi181 ceph-mon[25762]: pgmap v153: 161 pgs: 161 active+clean; 585 KiB data, 67 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T13:39:44.789 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:39:44 smithi099 ceph-mon[24912]: pgmap v153: 161 pgs: 161 active+clean; 585 KiB data, 67 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T13:39:44.789 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:39:44 smithi099 ceph-mon[29691]: pgmap v153: 161 pgs: 161 active+clean; 585 KiB data, 67 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T13:39:45.837 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:39:45 smithi099 ceph-mon[24912]: from='client.14838 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T13:39:45.837 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:39:45 smithi099 ceph-mon[29691]: from='client.14838 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T13:39:46.006 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:39:45 smithi181 ceph-mon[25762]: from='client.14838 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T13:39:46.837 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:39:46 smithi099 ceph-mon[24912]: pgmap v154: 161 pgs: 161 active+clean; 585 KiB data, 67 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T13:39:46.837 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:39:46 smithi099 ceph-mon[29691]: pgmap v154: 161 pgs: 161 active+clean; 585 KiB data, 67 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T13:39:46.837 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:39:46 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[25141]: ::ffff:172.21.15.181 - - [30/Mar/2024:13:39:46] "GET /metrics HTTP/1.1" 200 208080 "" "Prometheus/2.33.4" 2024-03-30T13:39:47.006 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:39:46 smithi181 ceph-mon[25762]: pgmap v154: 161 pgs: 161 active+clean; 585 KiB data, 67 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T13:39:47.337 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:39:47 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[25141]: 172.21.15.99 - - [30/Mar/2024:13:39:47] "POST /data HTTP/1.1" 200 46 "" "Python-urllib/3.9" 2024-03-30T13:39:48.337 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:39:48 smithi099 ceph-mon[24912]: from='mgr.14439 ' entity='mgr.y' 2024-03-30T13:39:48.337 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:39:48 smithi099 ceph-mon[24912]: from='mgr.14439 ' entity='mgr.y' 2024-03-30T13:39:48.337 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:39:48 smithi099 ceph-mon[24912]: pgmap v155: 161 pgs: 161 active+clean; 585 KiB data, 67 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T13:39:48.337 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:39:48 smithi099 ceph-mon[29691]: from='mgr.14439 ' entity='mgr.y' 2024-03-30T13:39:48.337 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:39:48 smithi099 ceph-mon[29691]: from='mgr.14439 ' entity='mgr.y' 2024-03-30T13:39:48.337 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:39:48 smithi099 ceph-mon[29691]: pgmap v155: 161 pgs: 161 active+clean; 585 KiB data, 67 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T13:39:48.506 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:39:48 smithi181 ceph-mon[25762]: from='mgr.14439 ' entity='mgr.y' 2024-03-30T13:39:48.506 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:39:48 smithi181 ceph-mon[25762]: from='mgr.14439 ' entity='mgr.y' 2024-03-30T13:39:48.506 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:39:48 smithi181 ceph-mon[25762]: pgmap v155: 161 pgs: 161 active+clean; 585 KiB data, 67 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T13:39:49.756 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 13:39:49 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-x[27332]: ::ffff:172.21.15.181 - - [30/Mar/2024:13:39:49] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-03-30T13:39:50.506 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:39:50 smithi181 ceph-mon[25762]: pgmap v156: 161 pgs: 161 active+clean; 585 KiB data, 67 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T13:39:50.587 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:39:50 smithi099 ceph-mon[24912]: pgmap v156: 161 pgs: 161 active+clean; 585 KiB data, 67 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T13:39:50.587 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:39:50 smithi099 ceph-mon[29691]: pgmap v156: 161 pgs: 161 active+clean; 585 KiB data, 67 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T13:39:52.506 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:39:52 smithi181 ceph-mon[25762]: pgmap v157: 161 pgs: 161 active+clean; 585 KiB data, 67 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T13:39:52.587 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:39:52 smithi099 ceph-mon[24912]: pgmap v157: 161 pgs: 161 active+clean; 585 KiB data, 67 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T13:39:52.587 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:39:52 smithi099 ceph-mon[29691]: pgmap v157: 161 pgs: 161 active+clean; 585 KiB data, 67 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T13:39:53.837 INFO:journalctl@ceph.alertmanager.a.smithi099.stdout:Mar 30 13:39:53 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-alertmanager-a[52107]: level=error ts=2024-03-30T13:39:53.508Z caller=dispatch.go:354 component=dispatcher msg="Notify for alerts failed" num_alerts=3 err="ceph-dashboard/webhook[1]: notify retry canceled after 7 attempts: Post \"https://172.21.15.181:8443/api/prometheus_receiver\": x509: cannot validate certificate for 172.21.15.181 because it doesn't contain any IP SANs; ceph-dashboard/webhook[0]: notify retry canceled after 7 attempts: Post \"https://172.21.15.99:8443//api/prometheus_receiver\": x509: cannot validate certificate for 172.21.15.99 because it doesn't contain any IP SANs" 2024-03-30T13:39:53.837 INFO:journalctl@ceph.alertmanager.a.smithi099.stdout:Mar 30 13:39:53 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-alertmanager-a[52107]: level=warn ts=2024-03-30T13:39:53.510Z caller=notify.go:724 component=dispatcher receiver=ceph-dashboard integration=webhook[0] msg="Notify attempt failed, will retry later" attempts=1 err="Post \"https://172.21.15.99:8443//api/prometheus_receiver\": x509: cannot validate certificate for 172.21.15.99 because it doesn't contain any IP SANs" 2024-03-30T13:39:53.837 INFO:journalctl@ceph.alertmanager.a.smithi099.stdout:Mar 30 13:39:53 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-alertmanager-a[52107]: level=warn ts=2024-03-30T13:39:53.510Z caller=notify.go:724 component=dispatcher receiver=ceph-dashboard integration=webhook[1] msg="Notify attempt failed, will retry later" attempts=1 err="Post \"https://172.21.15.181:8443/api/prometheus_receiver\": x509: cannot validate certificate for 172.21.15.181 because it doesn't contain any IP SANs" 2024-03-30T13:39:54.836 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:39:54 smithi099 ceph-mon[24912]: pgmap v158: 161 pgs: 161 active+clean; 585 KiB data, 67 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T13:39:54.837 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:39:54 smithi099 ceph-mon[29691]: pgmap v158: 161 pgs: 161 active+clean; 585 KiB data, 67 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T13:39:54.989 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:39:54 smithi181 ceph-mon[25762]: pgmap v158: 161 pgs: 161 active+clean; 585 KiB data, 67 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T13:39:56.006 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:39:55 smithi181 ceph-mon[25762]: from='client.14838 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T13:39:56.087 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:39:55 smithi099 ceph-mon[24912]: from='client.14838 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T13:39:56.087 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:39:55 smithi099 ceph-mon[29691]: from='client.14838 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T13:39:57.006 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:39:56 smithi181 ceph-mon[25762]: pgmap v159: 161 pgs: 161 active+clean; 585 KiB data, 67 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T13:39:57.087 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:39:56 smithi099 ceph-mon[24912]: pgmap v159: 161 pgs: 161 active+clean; 585 KiB data, 67 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T13:39:57.087 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:39:56 smithi099 ceph-mon[29691]: pgmap v159: 161 pgs: 161 active+clean; 585 KiB data, 67 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T13:39:57.087 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:39:56 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[25141]: 172.21.15.181 - - [30/Mar/2024:13:39:56] "POST /data HTTP/1.1" 200 46 "" "Python-urllib/3.9" 2024-03-30T13:39:57.087 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:39:56 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[25141]: ::ffff:172.21.15.181 - - [30/Mar/2024:13:39:56] "GET /metrics HTTP/1.1" 200 208080 "" "Prometheus/2.33.4" 2024-03-30T13:39:58.006 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:39:57 smithi181 ceph-mon[25762]: from='mgr.14439 ' entity='mgr.y' 2024-03-30T13:39:58.006 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:39:57 smithi181 ceph-mon[25762]: from='mgr.14439 ' entity='mgr.y' 2024-03-30T13:39:58.087 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:39:57 smithi099 ceph-mon[24912]: from='mgr.14439 ' entity='mgr.y' 2024-03-30T13:39:58.087 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:39:57 smithi099 ceph-mon[24912]: from='mgr.14439 ' entity='mgr.y' 2024-03-30T13:39:58.087 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:39:57 smithi099 ceph-mon[29691]: from='mgr.14439 ' entity='mgr.y' 2024-03-30T13:39:58.087 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:39:57 smithi099 ceph-mon[29691]: from='mgr.14439 ' entity='mgr.y' 2024-03-30T13:39:59.006 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:39:58 smithi181 ceph-mon[25762]: pgmap v160: 161 pgs: 161 active+clean; 585 KiB data, 67 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T13:39:59.086 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:39:58 smithi099 ceph-mon[24912]: pgmap v160: 161 pgs: 161 active+clean; 585 KiB data, 67 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T13:39:59.087 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:39:58 smithi099 ceph-mon[29691]: pgmap v160: 161 pgs: 161 active+clean; 585 KiB data, 67 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T13:39:59.715 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 13:39:59 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-x[27332]: ::ffff:172.21.15.181 - - [30/Mar/2024:13:39:59] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-03-30T13:40:00.006 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:39:59 smithi181 ceph-mon[25762]: from='mgr.14439 172.21.15.99:0/1757456350' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-03-30T13:40:00.006 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:39:59 smithi181 ceph-mon[25762]: from='mgr.14439 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-03-30T13:40:00.006 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:39:59 smithi181 ceph-mon[25762]: from='mgr.14439 172.21.15.99:0/1757456350' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-03-30T13:40:00.006 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:39:59 smithi181 ceph-mon[25762]: from='mgr.14439 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-03-30T13:40:00.087 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:39:59 smithi099 ceph-mon[24912]: from='mgr.14439 172.21.15.99:0/1757456350' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-03-30T13:40:00.087 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:39:59 smithi099 ceph-mon[24912]: from='mgr.14439 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-03-30T13:40:00.087 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:39:59 smithi099 ceph-mon[24912]: from='mgr.14439 172.21.15.99:0/1757456350' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-03-30T13:40:00.087 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:39:59 smithi099 ceph-mon[24912]: from='mgr.14439 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-03-30T13:40:00.087 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:39:59 smithi099 ceph-mon[29691]: from='mgr.14439 172.21.15.99:0/1757456350' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-03-30T13:40:00.087 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:39:59 smithi099 ceph-mon[29691]: from='mgr.14439 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-03-30T13:40:00.087 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:39:59 smithi099 ceph-mon[29691]: from='mgr.14439 172.21.15.99:0/1757456350' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-03-30T13:40:00.087 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:39:59 smithi099 ceph-mon[29691]: from='mgr.14439 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-03-30T13:40:01.006 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:40:00 smithi181 ceph-mon[25762]: overall HEALTH_OK 2024-03-30T13:40:01.006 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:40:00 smithi181 ceph-mon[25762]: pgmap v161: 161 pgs: 161 active+clean; 585 KiB data, 67 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T13:40:01.087 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:40:00 smithi099 ceph-mon[24912]: overall HEALTH_OK 2024-03-30T13:40:01.087 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:40:00 smithi099 ceph-mon[24912]: pgmap v161: 161 pgs: 161 active+clean; 585 KiB data, 67 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T13:40:01.087 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:40:00 smithi099 ceph-mon[29691]: overall HEALTH_OK 2024-03-30T13:40:01.087 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:40:00 smithi099 ceph-mon[29691]: pgmap v161: 161 pgs: 161 active+clean; 585 KiB data, 67 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T13:40:02.506 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:40:02 smithi181 ceph-mon[25762]: pgmap v162: 161 pgs: 161 active+clean; 585 KiB data, 67 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T13:40:02.586 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:40:02 smithi099 ceph-mon[24912]: pgmap v162: 161 pgs: 161 active+clean; 585 KiB data, 67 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T13:40:02.587 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:40:02 smithi099 ceph-mon[29691]: pgmap v162: 161 pgs: 161 active+clean; 585 KiB data, 67 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T13:40:03.837 INFO:journalctl@ceph.alertmanager.a.smithi099.stdout:Mar 30 13:40:03 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-alertmanager-a[52107]: level=error ts=2024-03-30T13:40:03.509Z caller=dispatch.go:354 component=dispatcher msg="Notify for alerts failed" num_alerts=3 err="ceph-dashboard/webhook[1]: notify retry canceled after 7 attempts: Post \"https://172.21.15.181:8443/api/prometheus_receiver\": x509: cannot validate certificate for 172.21.15.181 because it doesn't contain any IP SANs; ceph-dashboard/webhook[0]: notify retry canceled after 7 attempts: Post \"https://172.21.15.99:8443//api/prometheus_receiver\": x509: cannot validate certificate for 172.21.15.99 because it doesn't contain any IP SANs" 2024-03-30T13:40:03.837 INFO:journalctl@ceph.alertmanager.a.smithi099.stdout:Mar 30 13:40:03 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-alertmanager-a[52107]: level=warn ts=2024-03-30T13:40:03.511Z caller=notify.go:724 component=dispatcher receiver=ceph-dashboard integration=webhook[1] msg="Notify attempt failed, will retry later" attempts=1 err="Post \"https://172.21.15.181:8443/api/prometheus_receiver\": x509: cannot validate certificate for 172.21.15.181 because it doesn't contain any IP SANs" 2024-03-30T13:40:03.837 INFO:journalctl@ceph.alertmanager.a.smithi099.stdout:Mar 30 13:40:03 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-alertmanager-a[52107]: level=warn ts=2024-03-30T13:40:03.511Z caller=notify.go:724 component=dispatcher receiver=ceph-dashboard integration=webhook[0] msg="Notify attempt failed, will retry later" attempts=1 err="Post \"https://172.21.15.99:8443//api/prometheus_receiver\": x509: cannot validate certificate for 172.21.15.99 because it doesn't contain any IP SANs" 2024-03-30T13:40:04.765 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:40:04 smithi099 ceph-mon[24912]: pgmap v163: 161 pgs: 161 active+clean; 585 KiB data, 67 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T13:40:04.766 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:40:04 smithi099 ceph-mon[29691]: pgmap v163: 161 pgs: 161 active+clean; 585 KiB data, 67 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T13:40:05.006 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:40:04 smithi181 ceph-mon[25762]: pgmap v163: 161 pgs: 161 active+clean; 585 KiB data, 67 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T13:40:05.985 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:40:05 smithi099 ceph-mon[24912]: from='client.14838 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T13:40:05.985 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:40:05 smithi099 ceph-mon[29691]: from='client.14838 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T13:40:06.006 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:40:05 smithi181 ceph-mon[25762]: from='client.14838 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T13:40:06.999 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:40:06 smithi099 ceph-mon[24912]: pgmap v164: 161 pgs: 161 active+clean; 585 KiB data, 67 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T13:40:06.999 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:40:06 smithi099 ceph-mon[29691]: pgmap v164: 161 pgs: 161 active+clean; 585 KiB data, 67 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T13:40:06.999 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:40:06 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[25141]: ::ffff:172.21.15.181 - - [30/Mar/2024:13:40:06] "GET /metrics HTTP/1.1" 200 208099 "" "Prometheus/2.33.4" 2024-03-30T13:40:07.006 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:40:06 smithi181 ceph-mon[25762]: pgmap v164: 161 pgs: 161 active+clean; 585 KiB data, 67 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T13:40:07.337 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:40:07 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[25141]: 172.21.15.99 - - [30/Mar/2024:13:40:07] "POST /data HTTP/1.1" 200 46 "" "Python-urllib/3.9" 2024-03-30T13:40:08.506 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:40:08 smithi181 ceph-mon[25762]: from='mgr.14439 ' entity='mgr.y' 2024-03-30T13:40:08.506 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:40:08 smithi181 ceph-mon[25762]: from='mgr.14439 ' entity='mgr.y' 2024-03-30T13:40:08.506 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:40:08 smithi181 ceph-mon[25762]: pgmap v165: 161 pgs: 161 active+clean; 585 KiB data, 67 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T13:40:08.587 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:40:08 smithi099 ceph-mon[24912]: from='mgr.14439 ' entity='mgr.y' 2024-03-30T13:40:08.587 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:40:08 smithi099 ceph-mon[24912]: from='mgr.14439 ' entity='mgr.y' 2024-03-30T13:40:08.587 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:40:08 smithi099 ceph-mon[24912]: pgmap v165: 161 pgs: 161 active+clean; 585 KiB data, 67 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T13:40:08.587 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:40:08 smithi099 ceph-mon[29691]: from='mgr.14439 ' entity='mgr.y' 2024-03-30T13:40:08.587 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:40:08 smithi099 ceph-mon[29691]: from='mgr.14439 ' entity='mgr.y' 2024-03-30T13:40:08.587 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:40:08 smithi099 ceph-mon[29691]: pgmap v165: 161 pgs: 161 active+clean; 585 KiB data, 67 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T13:40:09.756 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 13:40:09 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-x[27332]: ::ffff:172.21.15.181 - - [30/Mar/2024:13:40:09] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-03-30T13:40:10.506 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:40:10 smithi181 ceph-mon[25762]: pgmap v166: 161 pgs: 161 active+clean; 585 KiB data, 67 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T13:40:10.587 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:40:10 smithi099 ceph-mon[24912]: pgmap v166: 161 pgs: 161 active+clean; 585 KiB data, 67 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T13:40:10.587 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:40:10 smithi099 ceph-mon[29691]: pgmap v166: 161 pgs: 161 active+clean; 585 KiB data, 67 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T13:40:12.506 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:40:12 smithi181 ceph-mon[25762]: pgmap v167: 161 pgs: 161 active+clean; 585 KiB data, 67 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T13:40:12.587 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:40:12 smithi099 ceph-mon[24912]: pgmap v167: 161 pgs: 161 active+clean; 585 KiB data, 67 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T13:40:12.587 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:40:12 smithi099 ceph-mon[29691]: pgmap v167: 161 pgs: 161 active+clean; 585 KiB data, 67 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T13:40:13.837 INFO:journalctl@ceph.alertmanager.a.smithi099.stdout:Mar 30 13:40:13 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-alertmanager-a[52107]: level=error ts=2024-03-30T13:40:13.510Z caller=dispatch.go:354 component=dispatcher msg="Notify for alerts failed" num_alerts=3 err="ceph-dashboard/webhook[1]: notify retry canceled after 7 attempts: Post \"https://172.21.15.181:8443/api/prometheus_receiver\": x509: cannot validate certificate for 172.21.15.181 because it doesn't contain any IP SANs; ceph-dashboard/webhook[0]: notify retry canceled after 8 attempts: Post \"https://172.21.15.99:8443//api/prometheus_receiver\": x509: cannot validate certificate for 172.21.15.99 because it doesn't contain any IP SANs" 2024-03-30T13:40:13.837 INFO:journalctl@ceph.alertmanager.a.smithi099.stdout:Mar 30 13:40:13 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-alertmanager-a[52107]: level=warn ts=2024-03-30T13:40:13.512Z caller=notify.go:724 component=dispatcher receiver=ceph-dashboard integration=webhook[0] msg="Notify attempt failed, will retry later" attempts=1 err="Post \"https://172.21.15.99:8443//api/prometheus_receiver\": x509: cannot validate certificate for 172.21.15.99 because it doesn't contain any IP SANs" 2024-03-30T13:40:13.837 INFO:journalctl@ceph.alertmanager.a.smithi099.stdout:Mar 30 13:40:13 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-alertmanager-a[52107]: level=warn ts=2024-03-30T13:40:13.512Z caller=notify.go:724 component=dispatcher receiver=ceph-dashboard integration=webhook[1] msg="Notify attempt failed, will retry later" attempts=1 err="Post \"https://172.21.15.181:8443/api/prometheus_receiver\": x509: cannot validate certificate for 172.21.15.181 because it doesn't contain any IP SANs" 2024-03-30T13:40:14.837 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:40:14 smithi099 ceph-mon[24912]: pgmap v168: 161 pgs: 161 active+clean; 585 KiB data, 67 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T13:40:14.837 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:40:14 smithi099 ceph-mon[29691]: pgmap v168: 161 pgs: 161 active+clean; 585 KiB data, 67 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T13:40:15.006 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:40:14 smithi181 ceph-mon[25762]: pgmap v168: 161 pgs: 161 active+clean; 585 KiB data, 67 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T13:40:15.938 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:40:15 smithi181 ceph-mon[25762]: from='client.14838 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T13:40:16.087 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:40:15 smithi099 ceph-mon[24912]: from='client.14838 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T13:40:16.087 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:40:15 smithi099 ceph-mon[29691]: from='client.14838 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T13:40:16.741 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:40:16 smithi181 ceph-mon[25762]: pgmap v169: 161 pgs: 161 active+clean; 585 KiB data, 67 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T13:40:17.078 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:40:16 smithi099 ceph-mon[24912]: pgmap v169: 161 pgs: 161 active+clean; 585 KiB data, 67 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T13:40:17.079 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:40:16 smithi099 ceph-mon[29691]: pgmap v169: 161 pgs: 161 active+clean; 585 KiB data, 67 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T13:40:17.079 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:40:16 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[25141]: 172.21.15.181 - - [30/Mar/2024:13:40:16] "POST /data HTTP/1.1" 200 46 "" "Python-urllib/3.9" 2024-03-30T13:40:17.079 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:40:16 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[25141]: ::ffff:172.21.15.181 - - [30/Mar/2024:13:40:16] "GET /metrics HTTP/1.1" 200 208101 "" "Prometheus/2.33.4" 2024-03-30T13:40:18.006 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:40:17 smithi181 ceph-mon[25762]: from='mgr.14439 ' entity='mgr.y' 2024-03-30T13:40:18.006 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:40:17 smithi181 ceph-mon[25762]: from='mgr.14439 ' entity='mgr.y' 2024-03-30T13:40:18.087 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:40:17 smithi099 ceph-mon[24912]: from='mgr.14439 ' entity='mgr.y' 2024-03-30T13:40:18.087 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:40:17 smithi099 ceph-mon[24912]: from='mgr.14439 ' entity='mgr.y' 2024-03-30T13:40:18.087 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:40:17 smithi099 ceph-mon[29691]: from='mgr.14439 ' entity='mgr.y' 2024-03-30T13:40:18.087 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:40:17 smithi099 ceph-mon[29691]: from='mgr.14439 ' entity='mgr.y' 2024-03-30T13:40:19.006 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:40:18 smithi181 ceph-mon[25762]: pgmap v170: 161 pgs: 161 active+clean; 585 KiB data, 67 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T13:40:19.087 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:40:18 smithi099 ceph-mon[24912]: pgmap v170: 161 pgs: 161 active+clean; 585 KiB data, 67 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T13:40:19.087 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:40:18 smithi099 ceph-mon[29691]: pgmap v170: 161 pgs: 161 active+clean; 585 KiB data, 67 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T13:40:19.756 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 13:40:19 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-x[27332]: ::ffff:172.21.15.181 - - [30/Mar/2024:13:40:19] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-03-30T13:40:20.506 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:40:20 smithi181 ceph-mon[25762]: pgmap v171: 161 pgs: 161 active+clean; 585 KiB data, 67 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T13:40:20.587 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:40:20 smithi099 ceph-mon[24912]: pgmap v171: 161 pgs: 161 active+clean; 585 KiB data, 67 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T13:40:20.587 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:40:20 smithi099 ceph-mon[29691]: pgmap v171: 161 pgs: 161 active+clean; 585 KiB data, 67 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T13:40:22.506 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:40:22 smithi181 ceph-mon[25762]: pgmap v172: 161 pgs: 161 active+clean; 585 KiB data, 67 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T13:40:22.587 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:40:22 smithi099 ceph-mon[24912]: pgmap v172: 161 pgs: 161 active+clean; 585 KiB data, 67 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T13:40:22.587 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:40:22 smithi099 ceph-mon[29691]: pgmap v172: 161 pgs: 161 active+clean; 585 KiB data, 67 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T13:40:23.837 INFO:journalctl@ceph.alertmanager.a.smithi099.stdout:Mar 30 13:40:23 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-alertmanager-a[52107]: level=error ts=2024-03-30T13:40:23.511Z caller=dispatch.go:354 component=dispatcher msg="Notify for alerts failed" num_alerts=3 err="ceph-dashboard/webhook[1]: notify retry canceled after 8 attempts: Post \"https://172.21.15.181:8443/api/prometheus_receiver\": x509: cannot validate certificate for 172.21.15.181 because it doesn't contain any IP SANs; ceph-dashboard/webhook[0]: notify retry canceled after 8 attempts: Post \"https://172.21.15.99:8443//api/prometheus_receiver\": x509: cannot validate certificate for 172.21.15.99 because it doesn't contain any IP SANs" 2024-03-30T13:40:23.837 INFO:journalctl@ceph.alertmanager.a.smithi099.stdout:Mar 30 13:40:23 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-alertmanager-a[52107]: level=warn ts=2024-03-30T13:40:23.514Z caller=notify.go:724 component=dispatcher receiver=ceph-dashboard integration=webhook[0] msg="Notify attempt failed, will retry later" attempts=1 err="Post \"https://172.21.15.99:8443//api/prometheus_receiver\": x509: cannot validate certificate for 172.21.15.99 because it doesn't contain any IP SANs" 2024-03-30T13:40:23.837 INFO:journalctl@ceph.alertmanager.a.smithi099.stdout:Mar 30 13:40:23 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-alertmanager-a[52107]: level=warn ts=2024-03-30T13:40:23.514Z caller=notify.go:724 component=dispatcher receiver=ceph-dashboard integration=webhook[1] msg="Notify attempt failed, will retry later" attempts=1 err="Post \"https://172.21.15.181:8443/api/prometheus_receiver\": x509: cannot validate certificate for 172.21.15.181 because it doesn't contain any IP SANs" 2024-03-30T13:40:24.837 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:40:24 smithi099 ceph-mon[24912]: pgmap v173: 161 pgs: 161 active+clean; 585 KiB data, 67 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T13:40:24.837 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:40:24 smithi099 ceph-mon[29691]: pgmap v173: 161 pgs: 161 active+clean; 585 KiB data, 67 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T13:40:25.006 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:40:24 smithi181 ceph-mon[25762]: pgmap v173: 161 pgs: 161 active+clean; 585 KiB data, 67 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T13:40:25.920 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:40:25 smithi099 ceph-mon[24912]: from='client.14838 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T13:40:25.920 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:40:25 smithi099 ceph-mon[29691]: from='client.14838 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T13:40:26.006 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:40:25 smithi181 ceph-mon[25762]: from='client.14838 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T13:40:26.750 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:40:26 smithi099 ceph-mon[29691]: pgmap v174: 161 pgs: 161 active+clean; 585 KiB data, 67 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T13:40:26.751 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:40:26 smithi099 ceph-mon[24912]: pgmap v174: 161 pgs: 161 active+clean; 585 KiB data, 67 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T13:40:27.006 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:40:26 smithi181 ceph-mon[25762]: pgmap v174: 161 pgs: 161 active+clean; 585 KiB data, 67 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T13:40:27.046 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:40:26 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[25141]: ::ffff:172.21.15.181 - - [30/Mar/2024:13:40:26] "GET /metrics HTTP/1.1" 200 208101 "" "Prometheus/2.33.4" 2024-03-30T13:40:27.337 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:40:27 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[25141]: 172.21.15.99 - - [30/Mar/2024:13:40:27] "POST /data HTTP/1.1" 200 46 "" "Python-urllib/3.9" 2024-03-30T13:40:28.586 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:40:28 smithi099 ceph-mon[24912]: from='mgr.14439 ' entity='mgr.y' 2024-03-30T13:40:28.587 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:40:28 smithi099 ceph-mon[24912]: from='mgr.14439 ' entity='mgr.y' 2024-03-30T13:40:28.587 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:40:28 smithi099 ceph-mon[24912]: pgmap v175: 161 pgs: 161 active+clean; 585 KiB data, 67 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T13:40:28.587 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:40:28 smithi099 ceph-mon[29691]: from='mgr.14439 ' entity='mgr.y' 2024-03-30T13:40:28.587 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:40:28 smithi099 ceph-mon[29691]: from='mgr.14439 ' entity='mgr.y' 2024-03-30T13:40:28.587 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:40:28 smithi099 ceph-mon[29691]: pgmap v175: 161 pgs: 161 active+clean; 585 KiB data, 67 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T13:40:28.756 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:40:28 smithi181 ceph-mon[25762]: from='mgr.14439 ' entity='mgr.y' 2024-03-30T13:40:28.756 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:40:28 smithi181 ceph-mon[25762]: from='mgr.14439 ' entity='mgr.y' 2024-03-30T13:40:28.756 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:40:28 smithi181 ceph-mon[25762]: pgmap v175: 161 pgs: 161 active+clean; 585 KiB data, 67 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T13:40:29.756 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 13:40:29 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-x[27332]: ::ffff:172.21.15.181 - - [30/Mar/2024:13:40:29] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-03-30T13:40:30.506 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:40:30 smithi181 ceph-mon[25762]: pgmap v176: 161 pgs: 161 active+clean; 585 KiB data, 67 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T13:40:30.587 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:40:30 smithi099 ceph-mon[24912]: pgmap v176: 161 pgs: 161 active+clean; 585 KiB data, 67 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T13:40:30.587 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:40:30 smithi099 ceph-mon[29691]: pgmap v176: 161 pgs: 161 active+clean; 585 KiB data, 67 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T13:40:31.506 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:40:31 smithi181 ceph-mon[25762]: from='mgr.14439 172.21.15.99:0/1757456350' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:40:31.506 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:40:31 smithi181 ceph-mon[25762]: from='mgr.14439 172.21.15.99:0/1757456350' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:40:31.506 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:40:31 smithi181 ceph-mon[25762]: from='mgr.14439 ' entity='mgr.y' 2024-03-30T13:40:31.587 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:40:31 smithi099 ceph-mon[29691]: from='mgr.14439 172.21.15.99:0/1757456350' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:40:31.587 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:40:31 smithi099 ceph-mon[29691]: from='mgr.14439 172.21.15.99:0/1757456350' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:40:31.587 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:40:31 smithi099 ceph-mon[29691]: from='mgr.14439 ' entity='mgr.y' 2024-03-30T13:40:31.587 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:40:31 smithi099 ceph-mon[24912]: from='mgr.14439 172.21.15.99:0/1757456350' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:40:31.587 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:40:31 smithi099 ceph-mon[24912]: from='mgr.14439 172.21.15.99:0/1757456350' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:40:31.587 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:40:31 smithi099 ceph-mon[24912]: from='mgr.14439 ' entity='mgr.y' 2024-03-30T13:40:32.256 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:40:32 smithi181 ceph-mon[25762]: pgmap v177: 161 pgs: 161 active+clean; 585 KiB data, 67 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T13:40:32.487 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:40:32 smithi099 ceph-mon[24912]: pgmap v177: 161 pgs: 161 active+clean; 585 KiB data, 67 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T13:40:32.488 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:40:32 smithi099 ceph-mon[29691]: pgmap v177: 161 pgs: 161 active+clean; 585 KiB data, 67 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T13:40:33.837 INFO:journalctl@ceph.alertmanager.a.smithi099.stdout:Mar 30 13:40:33 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-alertmanager-a[52107]: level=error ts=2024-03-30T13:40:33.512Z caller=dispatch.go:354 component=dispatcher msg="Notify for alerts failed" num_alerts=3 err="ceph-dashboard/webhook[0]: notify retry canceled after 7 attempts: Post \"https://172.21.15.99:8443//api/prometheus_receiver\": x509: cannot validate certificate for 172.21.15.99 because it doesn't contain any IP SANs; ceph-dashboard/webhook[1]: notify retry canceled after 8 attempts: Post \"https://172.21.15.181:8443/api/prometheus_receiver\": x509: cannot validate certificate for 172.21.15.181 because it doesn't contain any IP SANs" 2024-03-30T13:40:33.837 INFO:journalctl@ceph.alertmanager.a.smithi099.stdout:Mar 30 13:40:33 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-alertmanager-a[52107]: level=warn ts=2024-03-30T13:40:33.513Z caller=notify.go:724 component=dispatcher receiver=ceph-dashboard integration=webhook[0] msg="Notify attempt failed, will retry later" attempts=1 err="Post \"https://172.21.15.99:8443//api/prometheus_receiver\": x509: cannot validate certificate for 172.21.15.99 because it doesn't contain any IP SANs" 2024-03-30T13:40:33.838 INFO:journalctl@ceph.alertmanager.a.smithi099.stdout:Mar 30 13:40:33 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-alertmanager-a[52107]: level=warn ts=2024-03-30T13:40:33.514Z caller=notify.go:724 component=dispatcher receiver=ceph-dashboard integration=webhook[1] msg="Notify attempt failed, will retry later" attempts=1 err="Post \"https://172.21.15.181:8443/api/prometheus_receiver\": x509: cannot validate certificate for 172.21.15.181 because it doesn't contain any IP SANs" 2024-03-30T13:40:34.837 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:40:34 smithi099 ceph-mon[24912]: pgmap v178: 161 pgs: 161 active+clean; 585 KiB data, 67 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T13:40:34.837 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:40:34 smithi099 ceph-mon[29691]: pgmap v178: 161 pgs: 161 active+clean; 585 KiB data, 67 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T13:40:35.006 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:40:34 smithi181 ceph-mon[25762]: pgmap v178: 161 pgs: 161 active+clean; 585 KiB data, 67 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T13:40:36.006 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:40:35 smithi181 ceph-mon[25762]: from='client.14838 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T13:40:36.086 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:40:35 smithi099 ceph-mon[24912]: from='client.14838 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T13:40:36.087 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:40:35 smithi099 ceph-mon[29691]: from='client.14838 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T13:40:36.991 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:40:36 smithi181 ceph-mon[25762]: pgmap v179: 161 pgs: 161 active+clean; 585 KiB data, 67 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T13:40:37.087 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:40:36 smithi099 ceph-mon[24912]: pgmap v179: 161 pgs: 161 active+clean; 585 KiB data, 67 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T13:40:37.087 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:40:36 smithi099 ceph-mon[29691]: pgmap v179: 161 pgs: 161 active+clean; 585 KiB data, 67 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T13:40:37.087 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:40:36 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[25141]: ::ffff:172.21.15.181 - - [30/Mar/2024:13:40:36] "GET /metrics HTTP/1.1" 200 208102 "" "Prometheus/2.33.4" 2024-03-30T13:40:37.087 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:40:36 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[25141]: 172.21.15.181 - - [30/Mar/2024:13:40:36] "POST /data HTTP/1.1" 200 46 "" "Python-urllib/3.9" 2024-03-30T13:40:38.102 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:40:37 smithi181 ceph-mon[25762]: from='mgr.14439 ' entity='mgr.y' 2024-03-30T13:40:38.102 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:40:37 smithi181 ceph-mon[25762]: from='mgr.14439 ' entity='mgr.y' 2024-03-30T13:40:38.337 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:40:37 smithi099 ceph-mon[24912]: from='mgr.14439 ' entity='mgr.y' 2024-03-30T13:40:38.337 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:40:37 smithi099 ceph-mon[24912]: from='mgr.14439 ' entity='mgr.y' 2024-03-30T13:40:38.337 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:40:37 smithi099 ceph-mon[29691]: from='mgr.14439 ' entity='mgr.y' 2024-03-30T13:40:38.337 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:40:37 smithi099 ceph-mon[29691]: from='mgr.14439 ' entity='mgr.y' 2024-03-30T13:40:39.233 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:40:38 smithi181 ceph-mon[25762]: pgmap v180: 161 pgs: 161 active+clean; 585 KiB data, 67 MiB used, 715 GiB / 715 GiB avail; 767 B/s rd, 0 op/s 2024-03-30T13:40:39.337 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:40:38 smithi099 ceph-mon[24912]: pgmap v180: 161 pgs: 161 active+clean; 585 KiB data, 67 MiB used, 715 GiB / 715 GiB avail; 767 B/s rd, 0 op/s 2024-03-30T13:40:39.337 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:40:38 smithi099 ceph-mon[29691]: pgmap v180: 161 pgs: 161 active+clean; 585 KiB data, 67 MiB used, 715 GiB / 715 GiB avail; 767 B/s rd, 0 op/s 2024-03-30T13:40:39.503 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 13:40:39 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-x[27332]: ::ffff:172.21.15.181 - - [30/Mar/2024:13:40:39] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-03-30T13:40:40.256 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:40:40 smithi181 ceph-mon[25762]: pgmap v181: 161 pgs: 161 active+clean; 585 KiB data, 67 MiB used, 715 GiB / 715 GiB avail; 767 B/s rd, 0 op/s 2024-03-30T13:40:40.587 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:40:40 smithi099 ceph-mon[24912]: pgmap v181: 161 pgs: 161 active+clean; 585 KiB data, 67 MiB used, 715 GiB / 715 GiB avail; 767 B/s rd, 0 op/s 2024-03-30T13:40:40.587 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:40:40 smithi099 ceph-mon[29691]: pgmap v181: 161 pgs: 161 active+clean; 585 KiB data, 67 MiB used, 715 GiB / 715 GiB avail; 767 B/s rd, 0 op/s 2024-03-30T13:40:42.506 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:40:42 smithi181 ceph-mon[25762]: pgmap v182: 161 pgs: 161 active+clean; 585 KiB data, 67 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T13:40:42.587 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:40:42 smithi099 ceph-mon[24912]: pgmap v182: 161 pgs: 161 active+clean; 585 KiB data, 67 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T13:40:42.587 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:40:42 smithi099 ceph-mon[29691]: pgmap v182: 161 pgs: 161 active+clean; 585 KiB data, 67 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T13:40:43.837 INFO:journalctl@ceph.alertmanager.a.smithi099.stdout:Mar 30 13:40:43 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-alertmanager-a[52107]: level=error ts=2024-03-30T13:40:43.512Z caller=dispatch.go:354 component=dispatcher msg="Notify for alerts failed" num_alerts=3 err="ceph-dashboard/webhook[1]: notify retry canceled after 7 attempts: Post \"https://172.21.15.181:8443/api/prometheus_receiver\": x509: cannot validate certificate for 172.21.15.181 because it doesn't contain any IP SANs; ceph-dashboard/webhook[0]: notify retry canceled after 7 attempts: Post \"https://172.21.15.99:8443//api/prometheus_receiver\": x509: cannot validate certificate for 172.21.15.99 because it doesn't contain any IP SANs" 2024-03-30T13:40:43.837 INFO:journalctl@ceph.alertmanager.a.smithi099.stdout:Mar 30 13:40:43 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-alertmanager-a[52107]: level=warn ts=2024-03-30T13:40:43.514Z caller=notify.go:724 component=dispatcher receiver=ceph-dashboard integration=webhook[0] msg="Notify attempt failed, will retry later" attempts=1 err="Post \"https://172.21.15.99:8443//api/prometheus_receiver\": x509: cannot validate certificate for 172.21.15.99 because it doesn't contain any IP SANs" 2024-03-30T13:40:43.837 INFO:journalctl@ceph.alertmanager.a.smithi099.stdout:Mar 30 13:40:43 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-alertmanager-a[52107]: level=warn ts=2024-03-30T13:40:43.514Z caller=notify.go:724 component=dispatcher receiver=ceph-dashboard integration=webhook[1] msg="Notify attempt failed, will retry later" attempts=1 err="Post \"https://172.21.15.181:8443/api/prometheus_receiver\": x509: cannot validate certificate for 172.21.15.181 because it doesn't contain any IP SANs" 2024-03-30T13:40:44.836 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:40:44 smithi099 ceph-mon[24912]: pgmap v183: 161 pgs: 161 active+clean; 585 KiB data, 67 MiB used, 715 GiB / 715 GiB avail; 767 B/s rd, 0 op/s 2024-03-30T13:40:44.837 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:40:44 smithi099 ceph-mon[29691]: pgmap v183: 161 pgs: 161 active+clean; 585 KiB data, 67 MiB used, 715 GiB / 715 GiB avail; 767 B/s rd, 0 op/s 2024-03-30T13:40:45.006 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:40:44 smithi181 ceph-mon[25762]: pgmap v183: 161 pgs: 161 active+clean; 585 KiB data, 67 MiB used, 715 GiB / 715 GiB avail; 767 B/s rd, 0 op/s 2024-03-30T13:40:46.006 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:40:45 smithi181 ceph-mon[25762]: from='client.14838 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T13:40:46.087 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:40:45 smithi099 ceph-mon[24912]: from='client.14838 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T13:40:46.087 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:40:45 smithi099 ceph-mon[29691]: from='client.14838 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T13:40:46.874 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:40:46 smithi099 ceph-mon[24912]: pgmap v184: 161 pgs: 161 active+clean; 585 KiB data, 67 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T13:40:46.875 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:40:46 smithi099 ceph-mon[29691]: pgmap v184: 161 pgs: 161 active+clean; 585 KiB data, 67 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T13:40:46.875 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:40:46 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[25141]: ::ffff:172.21.15.181 - - [30/Mar/2024:13:40:46] "GET /metrics HTTP/1.1" 200 208081 "" "Prometheus/2.33.4" 2024-03-30T13:40:47.006 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:40:46 smithi181 ceph-mon[25762]: pgmap v184: 161 pgs: 161 active+clean; 585 KiB data, 67 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T13:40:47.755 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:40:47 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[25141]: 172.21.15.99 - - [30/Mar/2024:13:40:47] "POST /data HTTP/1.1" 200 46 "" "Python-urllib/3.9" 2024-03-30T13:40:48.756 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:40:48 smithi181 ceph-mon[25762]: from='mgr.14439 ' entity='mgr.y' 2024-03-30T13:40:48.756 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:40:48 smithi181 ceph-mon[25762]: from='mgr.14439 ' entity='mgr.y' 2024-03-30T13:40:48.756 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:40:48 smithi181 ceph-mon[25762]: pgmap v185: 161 pgs: 161 active+clean; 585 KiB data, 67 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T13:40:48.837 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:40:48 smithi099 ceph-mon[24912]: from='mgr.14439 ' entity='mgr.y' 2024-03-30T13:40:48.837 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:40:48 smithi099 ceph-mon[24912]: from='mgr.14439 ' entity='mgr.y' 2024-03-30T13:40:48.837 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:40:48 smithi099 ceph-mon[24912]: pgmap v185: 161 pgs: 161 active+clean; 585 KiB data, 67 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T13:40:48.837 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:40:48 smithi099 ceph-mon[29691]: from='mgr.14439 ' entity='mgr.y' 2024-03-30T13:40:48.838 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:40:48 smithi099 ceph-mon[29691]: from='mgr.14439 ' entity='mgr.y' 2024-03-30T13:40:48.838 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:40:48 smithi099 ceph-mon[29691]: pgmap v185: 161 pgs: 161 active+clean; 585 KiB data, 67 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T13:40:49.756 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 13:40:49 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-x[27332]: ::ffff:172.21.15.181 - - [30/Mar/2024:13:40:49] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-03-30T13:40:50.337 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:40:50 smithi099 ceph-mon[24912]: pgmap v186: 161 pgs: 161 active+clean; 585 KiB data, 67 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T13:40:50.337 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:40:50 smithi099 ceph-mon[29691]: pgmap v186: 161 pgs: 161 active+clean; 585 KiB data, 67 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T13:40:50.506 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:40:50 smithi181 ceph-mon[25762]: pgmap v186: 161 pgs: 161 active+clean; 585 KiB data, 67 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T13:40:52.506 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:40:52 smithi181 ceph-mon[25762]: pgmap v187: 161 pgs: 161 active+clean; 585 KiB data, 67 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T13:40:52.587 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:40:52 smithi099 ceph-mon[24912]: pgmap v187: 161 pgs: 161 active+clean; 585 KiB data, 67 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T13:40:52.587 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:40:52 smithi099 ceph-mon[29691]: pgmap v187: 161 pgs: 161 active+clean; 585 KiB data, 67 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T13:40:53.837 INFO:journalctl@ceph.alertmanager.a.smithi099.stdout:Mar 30 13:40:53 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-alertmanager-a[52107]: level=error ts=2024-03-30T13:40:53.513Z caller=dispatch.go:354 component=dispatcher msg="Notify for alerts failed" num_alerts=3 err="ceph-dashboard/webhook[0]: notify retry canceled after 7 attempts: Post \"https://172.21.15.99:8443//api/prometheus_receiver\": x509: cannot validate certificate for 172.21.15.99 because it doesn't contain any IP SANs; ceph-dashboard/webhook[1]: notify retry canceled after 7 attempts: Post \"https://172.21.15.181:8443/api/prometheus_receiver\": x509: cannot validate certificate for 172.21.15.181 because it doesn't contain any IP SANs" 2024-03-30T13:40:53.837 INFO:journalctl@ceph.alertmanager.a.smithi099.stdout:Mar 30 13:40:53 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-alertmanager-a[52107]: level=warn ts=2024-03-30T13:40:53.515Z caller=notify.go:724 component=dispatcher receiver=ceph-dashboard integration=webhook[1] msg="Notify attempt failed, will retry later" attempts=1 err="Post \"https://172.21.15.181:8443/api/prometheus_receiver\": x509: cannot validate certificate for 172.21.15.181 because it doesn't contain any IP SANs" 2024-03-30T13:40:53.837 INFO:journalctl@ceph.alertmanager.a.smithi099.stdout:Mar 30 13:40:53 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-alertmanager-a[52107]: level=warn ts=2024-03-30T13:40:53.515Z caller=notify.go:724 component=dispatcher receiver=ceph-dashboard integration=webhook[0] msg="Notify attempt failed, will retry later" attempts=1 err="Post \"https://172.21.15.99:8443//api/prometheus_receiver\": x509: cannot validate certificate for 172.21.15.99 because it doesn't contain any IP SANs" 2024-03-30T13:40:54.837 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:40:54 smithi099 ceph-mon[24912]: pgmap v188: 161 pgs: 161 active+clean; 585 KiB data, 67 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T13:40:54.837 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:40:54 smithi099 ceph-mon[29691]: pgmap v188: 161 pgs: 161 active+clean; 585 KiB data, 67 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T13:40:55.006 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:40:54 smithi181 ceph-mon[25762]: pgmap v188: 161 pgs: 161 active+clean; 585 KiB data, 67 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T13:40:56.006 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:40:55 smithi181 ceph-mon[25762]: from='client.14838 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T13:40:56.087 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:40:55 smithi099 ceph-mon[24912]: from='client.14838 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T13:40:56.087 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:40:55 smithi099 ceph-mon[29691]: from='client.14838 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T13:40:56.960 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:40:56 smithi099 ceph-mon[24912]: pgmap v189: 161 pgs: 161 active+clean; 585 KiB data, 67 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T13:40:56.960 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:40:56 smithi099 ceph-mon[29691]: pgmap v189: 161 pgs: 161 active+clean; 585 KiB data, 67 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T13:40:56.960 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:40:56 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[25141]: ::ffff:172.21.15.181 - - [30/Mar/2024:13:40:56] "GET /metrics HTTP/1.1" 200 208081 "" "Prometheus/2.33.4" 2024-03-30T13:40:56.960 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:40:56 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[25141]: 172.21.15.181 - - [30/Mar/2024:13:40:56] "POST /data HTTP/1.1" 200 46 "" "Python-urllib/3.9" 2024-03-30T13:40:56.961 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:40:56 smithi181 ceph-mon[25762]: pgmap v189: 161 pgs: 161 active+clean; 585 KiB data, 67 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T13:40:58.218 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:40:57 smithi181 ceph-mon[25762]: from='mgr.14439 ' entity='mgr.y' 2024-03-30T13:40:58.219 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:40:57 smithi181 ceph-mon[25762]: from='mgr.14439 ' entity='mgr.y' 2024-03-30T13:40:58.337 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:40:57 smithi099 ceph-mon[24912]: from='mgr.14439 ' entity='mgr.y' 2024-03-30T13:40:58.337 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:40:57 smithi099 ceph-mon[24912]: from='mgr.14439 ' entity='mgr.y' 2024-03-30T13:40:58.337 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:40:57 smithi099 ceph-mon[29691]: from='mgr.14439 ' entity='mgr.y' 2024-03-30T13:40:58.337 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:40:57 smithi099 ceph-mon[29691]: from='mgr.14439 ' entity='mgr.y' 2024-03-30T13:40:59.256 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:40:58 smithi181 ceph-mon[25762]: pgmap v190: 161 pgs: 161 active+clean; 585 KiB data, 67 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T13:40:59.337 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:40:58 smithi099 ceph-mon[24912]: pgmap v190: 161 pgs: 161 active+clean; 585 KiB data, 67 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T13:40:59.337 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:40:58 smithi099 ceph-mon[29691]: pgmap v190: 161 pgs: 161 active+clean; 585 KiB data, 67 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T13:40:59.750 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 13:40:59 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-x[27332]: ::ffff:172.21.15.181 - - [30/Mar/2024:13:40:59] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-03-30T13:41:00.006 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:40:59 smithi181 ceph-mon[25762]: from='mgr.14439 172.21.15.99:0/1757456350' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-03-30T13:41:00.006 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:40:59 smithi181 ceph-mon[25762]: from='mgr.14439 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-03-30T13:41:00.006 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:40:59 smithi181 ceph-mon[25762]: from='mgr.14439 172.21.15.99:0/1757456350' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-03-30T13:41:00.006 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:40:59 smithi181 ceph-mon[25762]: from='mgr.14439 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-03-30T13:41:00.337 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:40:59 smithi099 ceph-mon[24912]: from='mgr.14439 172.21.15.99:0/1757456350' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-03-30T13:41:00.337 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:40:59 smithi099 ceph-mon[24912]: from='mgr.14439 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-03-30T13:41:00.337 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:40:59 smithi099 ceph-mon[24912]: from='mgr.14439 172.21.15.99:0/1757456350' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-03-30T13:41:00.337 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:40:59 smithi099 ceph-mon[24912]: from='mgr.14439 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-03-30T13:41:00.337 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:40:59 smithi099 ceph-mon[29691]: from='mgr.14439 172.21.15.99:0/1757456350' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-03-30T13:41:00.337 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:40:59 smithi099 ceph-mon[29691]: from='mgr.14439 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-03-30T13:41:00.337 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:40:59 smithi099 ceph-mon[29691]: from='mgr.14439 172.21.15.99:0/1757456350' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-03-30T13:41:00.337 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:40:59 smithi099 ceph-mon[29691]: from='mgr.14439 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-03-30T13:41:01.256 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:41:00 smithi181 ceph-mon[25762]: pgmap v191: 161 pgs: 161 active+clean; 585 KiB data, 67 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T13:41:01.337 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:41:00 smithi099 ceph-mon[24912]: pgmap v191: 161 pgs: 161 active+clean; 585 KiB data, 67 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T13:41:01.337 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:41:00 smithi099 ceph-mon[29691]: pgmap v191: 161 pgs: 161 active+clean; 585 KiB data, 67 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T13:41:02.506 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:41:02 smithi181 ceph-mon[25762]: pgmap v192: 161 pgs: 161 active+clean; 585 KiB data, 67 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T13:41:02.587 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:41:02 smithi099 ceph-mon[29691]: pgmap v192: 161 pgs: 161 active+clean; 585 KiB data, 67 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T13:41:02.587 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:41:02 smithi099 ceph-mon[24912]: pgmap v192: 161 pgs: 161 active+clean; 585 KiB data, 67 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T13:41:03.837 INFO:journalctl@ceph.alertmanager.a.smithi099.stdout:Mar 30 13:41:03 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-alertmanager-a[52107]: level=error ts=2024-03-30T13:41:03.514Z caller=dispatch.go:354 component=dispatcher msg="Notify for alerts failed" num_alerts=3 err="ceph-dashboard/webhook[0]: notify retry canceled after 7 attempts: Post \"https://172.21.15.99:8443//api/prometheus_receiver\": x509: cannot validate certificate for 172.21.15.99 because it doesn't contain any IP SANs; ceph-dashboard/webhook[1]: notify retry canceled after 8 attempts: Post \"https://172.21.15.181:8443/api/prometheus_receiver\": x509: cannot validate certificate for 172.21.15.181 because it doesn't contain any IP SANs" 2024-03-30T13:41:03.837 INFO:journalctl@ceph.alertmanager.a.smithi099.stdout:Mar 30 13:41:03 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-alertmanager-a[52107]: level=warn ts=2024-03-30T13:41:03.516Z caller=notify.go:724 component=dispatcher receiver=ceph-dashboard integration=webhook[0] msg="Notify attempt failed, will retry later" attempts=1 err="Post \"https://172.21.15.99:8443//api/prometheus_receiver\": x509: cannot validate certificate for 172.21.15.99 because it doesn't contain any IP SANs" 2024-03-30T13:41:03.837 INFO:journalctl@ceph.alertmanager.a.smithi099.stdout:Mar 30 13:41:03 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-alertmanager-a[52107]: level=warn ts=2024-03-30T13:41:03.516Z caller=notify.go:724 component=dispatcher receiver=ceph-dashboard integration=webhook[1] msg="Notify attempt failed, will retry later" attempts=1 err="Post \"https://172.21.15.181:8443/api/prometheus_receiver\": x509: cannot validate certificate for 172.21.15.181 because it doesn't contain any IP SANs" 2024-03-30T13:41:04.837 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:41:04 smithi099 ceph-mon[24912]: pgmap v193: 161 pgs: 161 active+clean; 585 KiB data, 67 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T13:41:04.837 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:41:04 smithi099 ceph-mon[29691]: pgmap v193: 161 pgs: 161 active+clean; 585 KiB data, 67 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T13:41:05.006 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:41:04 smithi181 ceph-mon[25762]: pgmap v193: 161 pgs: 161 active+clean; 585 KiB data, 67 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T13:41:05.888 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:41:05 smithi099 ceph-mon[24912]: from='client.14838 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T13:41:05.888 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:41:05 smithi099 ceph-mon[29691]: from='client.14838 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T13:41:06.006 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:41:05 smithi181 ceph-mon[25762]: from='client.14838 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T13:41:06.879 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:41:06 smithi099 ceph-mon[24912]: pgmap v194: 161 pgs: 161 active+clean; 585 KiB data, 67 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T13:41:06.879 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:41:06 smithi099 ceph-mon[29691]: pgmap v194: 161 pgs: 161 active+clean; 585 KiB data, 67 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T13:41:06.879 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:41:06 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[25141]: ::ffff:172.21.15.181 - - [30/Mar/2024:13:41:06] "GET /metrics HTTP/1.1" 200 208040 "" "Prometheus/2.33.4" 2024-03-30T13:41:07.006 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:41:06 smithi181 ceph-mon[25762]: pgmap v194: 161 pgs: 161 active+clean; 585 KiB data, 67 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T13:41:07.762 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:41:07 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[25141]: 172.21.15.99 - - [30/Mar/2024:13:41:07] "POST /data HTTP/1.1" 200 46 "" "Python-urllib/3.9" 2024-03-30T13:41:08.587 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:41:08 smithi099 ceph-mon[29691]: from='mgr.14439 ' entity='mgr.y' 2024-03-30T13:41:08.587 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:41:08 smithi099 ceph-mon[29691]: from='mgr.14439 ' entity='mgr.y' 2024-03-30T13:41:08.587 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:41:08 smithi099 ceph-mon[29691]: pgmap v195: 161 pgs: 161 active+clean; 585 KiB data, 67 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T13:41:08.587 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:41:08 smithi099 ceph-mon[24912]: from='mgr.14439 ' entity='mgr.y' 2024-03-30T13:41:08.587 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:41:08 smithi099 ceph-mon[24912]: from='mgr.14439 ' entity='mgr.y' 2024-03-30T13:41:08.587 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:41:08 smithi099 ceph-mon[24912]: pgmap v195: 161 pgs: 161 active+clean; 585 KiB data, 67 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T13:41:08.756 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:41:08 smithi181 ceph-mon[25762]: from='mgr.14439 ' entity='mgr.y' 2024-03-30T13:41:08.756 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:41:08 smithi181 ceph-mon[25762]: from='mgr.14439 ' entity='mgr.y' 2024-03-30T13:41:08.756 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:41:08 smithi181 ceph-mon[25762]: pgmap v195: 161 pgs: 161 active+clean; 585 KiB data, 67 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T13:41:09.756 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 13:41:09 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-x[27332]: ::ffff:172.21.15.181 - - [30/Mar/2024:13:41:09] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-03-30T13:41:10.506 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:41:10 smithi181 ceph-mon[25762]: pgmap v196: 161 pgs: 161 active+clean; 585 KiB data, 67 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T13:41:10.587 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:41:10 smithi099 ceph-mon[24912]: pgmap v196: 161 pgs: 161 active+clean; 585 KiB data, 67 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T13:41:10.587 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:41:10 smithi099 ceph-mon[29691]: pgmap v196: 161 pgs: 161 active+clean; 585 KiB data, 67 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T13:41:12.506 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:41:12 smithi181 ceph-mon[25762]: pgmap v197: 161 pgs: 161 active+clean; 585 KiB data, 67 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T13:41:12.587 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:41:12 smithi099 ceph-mon[24912]: pgmap v197: 161 pgs: 161 active+clean; 585 KiB data, 67 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T13:41:12.587 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:41:12 smithi099 ceph-mon[29691]: pgmap v197: 161 pgs: 161 active+clean; 585 KiB data, 67 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T13:41:13.837 INFO:journalctl@ceph.alertmanager.a.smithi099.stdout:Mar 30 13:41:13 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-alertmanager-a[52107]: level=error ts=2024-03-30T13:41:13.515Z caller=dispatch.go:354 component=dispatcher msg="Notify for alerts failed" num_alerts=3 err="ceph-dashboard/webhook[0]: notify retry canceled after 7 attempts: Post \"https://172.21.15.99:8443//api/prometheus_receiver\": x509: cannot validate certificate for 172.21.15.99 because it doesn't contain any IP SANs; ceph-dashboard/webhook[1]: notify retry canceled after 7 attempts: Post \"https://172.21.15.181:8443/api/prometheus_receiver\": x509: cannot validate certificate for 172.21.15.181 because it doesn't contain any IP SANs" 2024-03-30T13:41:13.837 INFO:journalctl@ceph.alertmanager.a.smithi099.stdout:Mar 30 13:41:13 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-alertmanager-a[52107]: level=warn ts=2024-03-30T13:41:13.517Z caller=notify.go:724 component=dispatcher receiver=ceph-dashboard integration=webhook[0] msg="Notify attempt failed, will retry later" attempts=1 err="Post \"https://172.21.15.99:8443//api/prometheus_receiver\": x509: cannot validate certificate for 172.21.15.99 because it doesn't contain any IP SANs" 2024-03-30T13:41:13.837 INFO:journalctl@ceph.alertmanager.a.smithi099.stdout:Mar 30 13:41:13 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-alertmanager-a[52107]: level=warn ts=2024-03-30T13:41:13.517Z caller=notify.go:724 component=dispatcher receiver=ceph-dashboard integration=webhook[1] msg="Notify attempt failed, will retry later" attempts=1 err="Post \"https://172.21.15.181:8443/api/prometheus_receiver\": x509: cannot validate certificate for 172.21.15.181 because it doesn't contain any IP SANs" 2024-03-30T13:41:14.837 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:41:14 smithi099 ceph-mon[24912]: pgmap v198: 161 pgs: 161 active+clean; 585 KiB data, 67 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T13:41:14.837 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:41:14 smithi099 ceph-mon[29691]: pgmap v198: 161 pgs: 161 active+clean; 585 KiB data, 67 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T13:41:15.006 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:41:14 smithi181 ceph-mon[25762]: pgmap v198: 161 pgs: 161 active+clean; 585 KiB data, 67 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T13:41:15.474 DEBUG:teuthology.orchestra.run.smithi099:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 98ebaeb8-ee99-11ee-b647-cb9ed24678a4 -e sha1=4e50bbcdd1630c7760b708f3a5b4d38a121e66cb -- bash -c 'ceph config set mon mon_warn_on_insecure_global_id_reclaim false --force' 2024-03-30T13:41:15.792 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:41:15 smithi099 ceph-mon[24912]: from='client.14838 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T13:41:15.792 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:41:15 smithi099 ceph-mon[29691]: from='client.14838 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T13:41:16.006 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:41:15 smithi181 ceph-mon[25762]: from='client.14838 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T13:41:16.751 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:41:16 smithi099 ceph-mon[24912]: pgmap v199: 161 pgs: 161 active+clean; 585 KiB data, 67 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T13:41:16.751 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:41:16 smithi099 ceph-mon[29691]: pgmap v199: 161 pgs: 161 active+clean; 585 KiB data, 67 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T13:41:17.006 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:41:16 smithi181 ceph-mon[25762]: pgmap v199: 161 pgs: 161 active+clean; 585 KiB data, 67 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T13:41:17.065 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:41:16 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[25141]: ::ffff:172.21.15.181 - - [30/Mar/2024:13:41:16] "GET /metrics HTTP/1.1" 200 208047 "" "Prometheus/2.33.4" 2024-03-30T13:41:17.065 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:41:17 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[25141]: 172.21.15.181 - - [30/Mar/2024:13:41:17] "POST /data HTTP/1.1" 200 46 "" "Python-urllib/3.9" 2024-03-30T13:41:18.134 DEBUG:teuthology.orchestra.run.smithi099:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 98ebaeb8-ee99-11ee-b647-cb9ed24678a4 -e sha1=4e50bbcdd1630c7760b708f3a5b4d38a121e66cb -- bash -c 'ceph config set mon mon_warn_on_insecure_global_id_reclaim_allowed false --force' 2024-03-30T13:41:18.163 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:41:18 smithi181 ceph-mon[25762]: from='mgr.14439 ' entity='mgr.y' 2024-03-30T13:41:18.163 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:41:18 smithi181 ceph-mon[25762]: from='mgr.14439 ' entity='mgr.y' 2024-03-30T13:41:18.337 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:41:18 smithi099 ceph-mon[29691]: from='mgr.14439 ' entity='mgr.y' 2024-03-30T13:41:18.337 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:41:18 smithi099 ceph-mon[29691]: from='mgr.14439 ' entity='mgr.y' 2024-03-30T13:41:18.337 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:41:18 smithi099 ceph-mon[24912]: from='mgr.14439 ' entity='mgr.y' 2024-03-30T13:41:18.337 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:41:18 smithi099 ceph-mon[24912]: from='mgr.14439 ' entity='mgr.y' 2024-03-30T13:41:19.182 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:41:19 smithi181 ceph-mon[25762]: pgmap v200: 161 pgs: 161 active+clean; 585 KiB data, 67 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T13:41:19.337 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:41:19 smithi099 ceph-mon[24912]: pgmap v200: 161 pgs: 161 active+clean; 585 KiB data, 67 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T13:41:19.337 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:41:19 smithi099 ceph-mon[29691]: pgmap v200: 161 pgs: 161 active+clean; 585 KiB data, 67 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T13:41:19.756 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 13:41:19 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-x[27332]: ::ffff:172.21.15.181 - - [30/Mar/2024:13:41:19] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-03-30T13:41:20.256 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:41:20 smithi181 ceph-mon[25762]: pgmap v201: 161 pgs: 161 active+clean; 585 KiB data, 67 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T13:41:20.458 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:41:20 smithi099 ceph-mon[24912]: pgmap v201: 161 pgs: 161 active+clean; 585 KiB data, 67 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T13:41:20.458 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:41:20 smithi099 ceph-mon[29691]: pgmap v201: 161 pgs: 161 active+clean; 585 KiB data, 67 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T13:41:20.799 DEBUG:teuthology.orchestra.run.smithi099:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 98ebaeb8-ee99-11ee-b647-cb9ed24678a4 -e sha1=4e50bbcdd1630c7760b708f3a5b4d38a121e66cb -- bash -c 'ceph config set global log_to_journald false --force' 2024-03-30T13:41:22.434 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:41:22 smithi099 ceph-mon[24912]: pgmap v202: 161 pgs: 161 active+clean; 585 KiB data, 67 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T13:41:22.435 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:41:22 smithi099 ceph-mon[29691]: pgmap v202: 161 pgs: 161 active+clean; 585 KiB data, 67 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T13:41:22.506 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:41:22 smithi181 ceph-mon[25762]: pgmap v202: 161 pgs: 161 active+clean; 585 KiB data, 67 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T13:41:23.547 DEBUG:teuthology.orchestra.run.smithi099:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 98ebaeb8-ee99-11ee-b647-cb9ed24678a4 -e sha1=4e50bbcdd1630c7760b708f3a5b4d38a121e66cb -- bash -c 'ceph orch ps' 2024-03-30T13:41:23.837 INFO:journalctl@ceph.alertmanager.a.smithi099.stdout:Mar 30 13:41:23 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-alertmanager-a[52107]: level=error ts=2024-03-30T13:41:23.516Z caller=dispatch.go:354 component=dispatcher msg="Notify for alerts failed" num_alerts=3 err="ceph-dashboard/webhook[0]: notify retry canceled after 8 attempts: Post \"https://172.21.15.99:8443//api/prometheus_receiver\": x509: cannot validate certificate for 172.21.15.99 because it doesn't contain any IP SANs; ceph-dashboard/webhook[1]: notify retry canceled after 8 attempts: Post \"https://172.21.15.181:8443/api/prometheus_receiver\": x509: cannot validate certificate for 172.21.15.181 because it doesn't contain any IP SANs" 2024-03-30T13:41:23.837 INFO:journalctl@ceph.alertmanager.a.smithi099.stdout:Mar 30 13:41:23 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-alertmanager-a[52107]: level=warn ts=2024-03-30T13:41:23.518Z caller=notify.go:724 component=dispatcher receiver=ceph-dashboard integration=webhook[1] msg="Notify attempt failed, will retry later" attempts=1 err="Post \"https://172.21.15.181:8443/api/prometheus_receiver\": x509: cannot validate certificate for 172.21.15.181 because it doesn't contain any IP SANs" 2024-03-30T13:41:23.837 INFO:journalctl@ceph.alertmanager.a.smithi099.stdout:Mar 30 13:41:23 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-alertmanager-a[52107]: level=warn ts=2024-03-30T13:41:23.518Z caller=notify.go:724 component=dispatcher receiver=ceph-dashboard integration=webhook[0] msg="Notify attempt failed, will retry later" attempts=1 err="Post \"https://172.21.15.99:8443//api/prometheus_receiver\": x509: cannot validate certificate for 172.21.15.99 because it doesn't contain any IP SANs" 2024-03-30T13:41:24.837 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:41:24 smithi099 ceph-mon[24912]: pgmap v203: 161 pgs: 161 active+clean; 585 KiB data, 67 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T13:41:24.837 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:41:24 smithi099 ceph-mon[29691]: pgmap v203: 161 pgs: 161 active+clean; 585 KiB data, 67 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T13:41:25.006 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:41:24 smithi181 ceph-mon[25762]: pgmap v203: 161 pgs: 161 active+clean; 585 KiB data, 67 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T13:41:25.680 INFO:teuthology.orchestra.run.smithi099.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-03-30T13:41:25.680 INFO:teuthology.orchestra.run.smithi099.stdout:agent.smithi099 smithi099 running 18s ago 9m - - 2024-03-30T13:41:25.680 INFO:teuthology.orchestra.run.smithi099.stdout:agent.smithi181 smithi181 running 8s ago 9m - - 2024-03-30T13:41:25.681 INFO:teuthology.orchestra.run.smithi099.stdout:alertmanager.a smithi099 *:9093,9094 running (3m) 18s ago 3m 26.9M - ba2b418f427c 8804d597845b 2024-03-30T13:41:25.681 INFO:teuthology.orchestra.run.smithi099.stdout:grafana.a smithi181 *:3000 running (3m) 8s ago 3m 56.6M - 8.3.5 dad864ee21e9 084559d00328 2024-03-30T13:41:25.681 INFO:teuthology.orchestra.run.smithi099.stdout:iscsi.foo.smithi099.qyjuvr smithi099 running (3m) 18s ago 3m 48.6M - 3.5 e1d6a67b021e b426fa245c2a 2024-03-30T13:41:25.681 INFO:teuthology.orchestra.run.smithi099.stdout:mgr.x smithi181 *:8443 running (8m) 8s ago 8m 412M - 17.2.0 e1d6a67b021e c3667b1b85f3 2024-03-30T13:41:25.681 INFO:teuthology.orchestra.run.smithi099.stdout:mgr.y smithi099 *:9283 running (10m) 18s ago 10m 468M - 17.2.0 e1d6a67b021e db3430cee99a 2024-03-30T13:41:25.681 INFO:teuthology.orchestra.run.smithi099.stdout:mon.a smithi099 running (10m) 18s ago 10m 54.2M 2048M 17.2.0 e1d6a67b021e af06ebb19fd8 2024-03-30T13:41:25.681 INFO:teuthology.orchestra.run.smithi099.stdout:mon.b smithi181 running (9m) 8s ago 9m 41.7M 2048M 17.2.0 e1d6a67b021e e678a2a25c90 2024-03-30T13:41:25.681 INFO:teuthology.orchestra.run.smithi099.stdout:mon.c smithi099 running (9m) 18s ago 9m 39.0M 2048M 17.2.0 e1d6a67b021e 0f1e98917718 2024-03-30T13:41:25.681 INFO:teuthology.orchestra.run.smithi099.stdout:node-exporter.a smithi099 *:9100 running (5m) 18s ago 4m 16.9M - 1dbe0e931976 ad756dd8c3f9 2024-03-30T13:41:25.681 INFO:teuthology.orchestra.run.smithi099.stdout:node-exporter.b smithi181 *:9100 running (4m) 8s ago 4m 14.3M - 1dbe0e931976 5a3d4484d23a 2024-03-30T13:41:25.681 INFO:teuthology.orchestra.run.smithi099.stdout:osd.0 smithi099 running (8m) 18s ago 8m 49.4M 4096M 17.2.0 e1d6a67b021e 3158ee1b0c67 2024-03-30T13:41:25.681 INFO:teuthology.orchestra.run.smithi099.stdout:osd.1 smithi099 running (8m) 18s ago 8m 52.5M 4096M 17.2.0 e1d6a67b021e c4af0fd7071a 2024-03-30T13:41:25.681 INFO:teuthology.orchestra.run.smithi099.stdout:osd.2 smithi099 running (7m) 18s ago 7m 45.8M 4096M 17.2.0 e1d6a67b021e 8e4e805a7e20 2024-03-30T13:41:25.681 INFO:teuthology.orchestra.run.smithi099.stdout:osd.3 smithi099 running (7m) 18s ago 7m 48.2M 4096M 17.2.0 e1d6a67b021e 718812bcf065 2024-03-30T13:41:25.682 INFO:teuthology.orchestra.run.smithi099.stdout:osd.4 smithi181 running (7m) 8s ago 7m 48.1M 4096M 17.2.0 e1d6a67b021e 5e205434e973 2024-03-30T13:41:25.682 INFO:teuthology.orchestra.run.smithi099.stdout:osd.5 smithi181 running (6m) 8s ago 6m 46.6M 4096M 17.2.0 e1d6a67b021e e330c920f152 2024-03-30T13:41:25.682 INFO:teuthology.orchestra.run.smithi099.stdout:osd.6 smithi181 running (6m) 8s ago 6m 45.4M 4096M 17.2.0 e1d6a67b021e 81d889ea213d 2024-03-30T13:41:25.682 INFO:teuthology.orchestra.run.smithi099.stdout:osd.7 smithi181 running (5m) 8s ago 5m 47.2M 4096M 17.2.0 e1d6a67b021e c08b1839dd7e 2024-03-30T13:41:25.682 INFO:teuthology.orchestra.run.smithi099.stdout:prometheus.a smithi181 *:9095 running (3m) 8s ago 5m 67.2M - 514e6a882f6e 9fa29bb6baba 2024-03-30T13:41:25.682 INFO:teuthology.orchestra.run.smithi099.stdout:rgw.foo.smithi099.fxjbmp smithi099 *:8000 running (3m) 18s ago 3m 70.0M - 17.2.0 e1d6a67b021e 400b28b3f650 2024-03-30T13:41:25.682 INFO:teuthology.orchestra.run.smithi099.stdout:rgw.foo.smithi181.wfqwti smithi181 *:8000 running (3m) 8s ago 3m 69.6M - 17.2.0 e1d6a67b021e 97e1b130f9d4 2024-03-30T13:41:25.837 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:41:25 smithi099 ceph-mon[24912]: from='client.14838 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T13:41:25.837 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:41:25 smithi099 ceph-mon[29691]: from='client.14838 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T13:41:26.006 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:41:25 smithi181 ceph-mon[25762]: from='client.14838 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T13:41:26.415 DEBUG:teuthology.orchestra.run.smithi099:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 98ebaeb8-ee99-11ee-b647-cb9ed24678a4 -e sha1=4e50bbcdd1630c7760b708f3a5b4d38a121e66cb -- bash -c 'ceph versions' 2024-03-30T13:41:26.736 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:41:26 smithi099 ceph-mon[24912]: from='client.24859 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T13:41:26.736 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:41:26 smithi099 ceph-mon[24912]: pgmap v204: 161 pgs: 161 active+clean; 585 KiB data, 67 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T13:41:26.736 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:41:26 smithi099 ceph-mon[29691]: from='client.24859 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T13:41:26.736 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:41:26 smithi099 ceph-mon[29691]: pgmap v204: 161 pgs: 161 active+clean; 585 KiB data, 67 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T13:41:27.006 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:41:26 smithi181 ceph-mon[25762]: from='client.24859 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T13:41:27.006 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:41:26 smithi181 ceph-mon[25762]: pgmap v204: 161 pgs: 161 active+clean; 585 KiB data, 67 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T13:41:27.068 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:41:26 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[25141]: ::ffff:172.21.15.181 - - [30/Mar/2024:13:41:26] "GET /metrics HTTP/1.1" 200 208047 "" "Prometheus/2.33.4" 2024-03-30T13:41:27.747 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:41:27 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[25141]: 172.21.15.99 - - [30/Mar/2024:13:41:27] "POST /data HTTP/1.1" 200 46 "" "Python-urllib/3.9" 2024-03-30T13:41:28.837 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:41:28 smithi099 ceph-mon[24912]: from='mgr.14439 ' entity='mgr.y' 2024-03-30T13:41:28.837 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:41:28 smithi099 ceph-mon[24912]: from='mgr.14439 ' entity='mgr.y' 2024-03-30T13:41:28.837 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:41:28 smithi099 ceph-mon[24912]: pgmap v205: 161 pgs: 161 active+clean; 585 KiB data, 67 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T13:41:28.838 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:41:28 smithi099 ceph-mon[29691]: from='mgr.14439 ' entity='mgr.y' 2024-03-30T13:41:28.838 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:41:28 smithi099 ceph-mon[29691]: from='mgr.14439 ' entity='mgr.y' 2024-03-30T13:41:28.838 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:41:28 smithi099 ceph-mon[29691]: pgmap v205: 161 pgs: 161 active+clean; 585 KiB data, 67 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T13:41:29.006 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:41:28 smithi181 ceph-mon[25762]: from='mgr.14439 ' entity='mgr.y' 2024-03-30T13:41:29.006 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:41:28 smithi181 ceph-mon[25762]: from='mgr.14439 ' entity='mgr.y' 2024-03-30T13:41:29.006 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:41:28 smithi181 ceph-mon[25762]: pgmap v205: 161 pgs: 161 active+clean; 585 KiB data, 67 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T13:41:29.756 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 13:41:29 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-x[27332]: ::ffff:172.21.15.181 - - [30/Mar/2024:13:41:29] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-03-30T13:41:30.164 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-03-30T13:41:30.164 INFO:teuthology.orchestra.run.smithi099.stdout: "mon": { 2024-03-30T13:41:30.164 INFO:teuthology.orchestra.run.smithi099.stdout: "ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)": 3 2024-03-30T13:41:30.164 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:41:30.164 INFO:teuthology.orchestra.run.smithi099.stdout: "mgr": { 2024-03-30T13:41:30.164 INFO:teuthology.orchestra.run.smithi099.stdout: "ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)": 2 2024-03-30T13:41:30.164 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:41:30.164 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": { 2024-03-30T13:41:30.164 INFO:teuthology.orchestra.run.smithi099.stdout: "ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)": 8 2024-03-30T13:41:30.164 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:41:30.164 INFO:teuthology.orchestra.run.smithi099.stdout: "mds": {}, 2024-03-30T13:41:30.165 INFO:teuthology.orchestra.run.smithi099.stdout: "rgw": { 2024-03-30T13:41:30.165 INFO:teuthology.orchestra.run.smithi099.stdout: "ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)": 2 2024-03-30T13:41:30.165 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:41:30.165 INFO:teuthology.orchestra.run.smithi099.stdout: "overall": { 2024-03-30T13:41:30.165 INFO:teuthology.orchestra.run.smithi099.stdout: "ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)": 15 2024-03-30T13:41:30.165 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-03-30T13:41:30.165 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-03-30T13:41:30.165 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:41:30 smithi099 ceph-mon[24912]: pgmap v206: 161 pgs: 161 active+clean; 585 KiB data, 67 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T13:41:30.165 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:41:30 smithi099 ceph-mon[29691]: pgmap v206: 161 pgs: 161 active+clean; 585 KiB data, 67 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T13:41:30.506 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:41:30 smithi181 ceph-mon[25762]: pgmap v206: 161 pgs: 161 active+clean; 585 KiB data, 67 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T13:41:31.467 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:41:31 smithi099 ceph-mon[29691]: from='client.? 172.21.15.99:0/2432333784' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:41:31.467 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:41:31 smithi099 ceph-mon[29691]: from='mgr.14439 172.21.15.99:0/1757456350' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:41:31.467 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:41:31 smithi099 ceph-mon[29691]: from='mgr.14439 172.21.15.99:0/1757456350' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:41:31.467 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:41:31 smithi099 ceph-mon[24912]: from='client.? 172.21.15.99:0/2432333784' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:41:31.467 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:41:31 smithi099 ceph-mon[24912]: from='mgr.14439 172.21.15.99:0/1757456350' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:41:31.467 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:41:31 smithi099 ceph-mon[24912]: from='mgr.14439 172.21.15.99:0/1757456350' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:41:31.506 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:41:31 smithi181 ceph-mon[25762]: from='client.? 172.21.15.99:0/2432333784' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:41:31.506 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:41:31 smithi181 ceph-mon[25762]: from='mgr.14439 172.21.15.99:0/1757456350' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:41:31.506 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:41:31 smithi181 ceph-mon[25762]: from='mgr.14439 172.21.15.99:0/1757456350' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:41:31.604 DEBUG:teuthology.orchestra.run.smithi099:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 98ebaeb8-ee99-11ee-b647-cb9ed24678a4 -e sha1=4e50bbcdd1630c7760b708f3a5b4d38a121e66cb -- bash -c 'ceph -s' 2024-03-30T13:41:32.931 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:41:32 smithi099 ceph-mon[24912]: from='mgr.14439 ' entity='mgr.y' 2024-03-30T13:41:32.932 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:41:32 smithi099 ceph-mon[24912]: from='mgr.14439 ' entity='mgr.y' 2024-03-30T13:41:32.932 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:41:32 smithi099 ceph-mon[24912]: pgmap v207: 161 pgs: 161 active+clean; 585 KiB data, 67 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T13:41:32.932 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:41:32 smithi099 ceph-mon[29691]: from='mgr.14439 ' entity='mgr.y' 2024-03-30T13:41:32.932 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:41:32 smithi099 ceph-mon[29691]: from='mgr.14439 ' entity='mgr.y' 2024-03-30T13:41:32.932 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:41:32 smithi099 ceph-mon[29691]: pgmap v207: 161 pgs: 161 active+clean; 585 KiB data, 67 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T13:41:33.006 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:41:32 smithi181 ceph-mon[25762]: from='mgr.14439 ' entity='mgr.y' 2024-03-30T13:41:33.006 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:41:32 smithi181 ceph-mon[25762]: from='mgr.14439 ' entity='mgr.y' 2024-03-30T13:41:33.006 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:41:32 smithi181 ceph-mon[25762]: pgmap v207: 161 pgs: 161 active+clean; 585 KiB data, 67 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T13:41:33.629 INFO:teuthology.orchestra.run.smithi099.stdout: cluster: 2024-03-30T13:41:33.629 INFO:teuthology.orchestra.run.smithi099.stdout: id: 98ebaeb8-ee99-11ee-b647-cb9ed24678a4 2024-03-30T13:41:33.629 INFO:teuthology.orchestra.run.smithi099.stdout: health: HEALTH_OK 2024-03-30T13:41:33.629 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-03-30T13:41:33.629 INFO:teuthology.orchestra.run.smithi099.stdout: services: 2024-03-30T13:41:33.629 INFO:teuthology.orchestra.run.smithi099.stdout: mon: 3 daemons, quorum a,c,b (age 9m) 2024-03-30T13:41:33.629 INFO:teuthology.orchestra.run.smithi099.stdout: mgr: y(active, since 5m), standbys: x 2024-03-30T13:41:33.629 INFO:teuthology.orchestra.run.smithi099.stdout: osd: 8 osds: 8 up (since 5m), 8 in (since 6m) 2024-03-30T13:41:33.629 INFO:teuthology.orchestra.run.smithi099.stdout: rgw: 2 daemons active (2 hosts, 1 zones) 2024-03-30T13:41:33.629 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-03-30T13:41:33.630 INFO:teuthology.orchestra.run.smithi099.stdout: data: 2024-03-30T13:41:33.630 INFO:teuthology.orchestra.run.smithi099.stdout: pools: 6 pools, 161 pgs 2024-03-30T13:41:33.630 INFO:teuthology.orchestra.run.smithi099.stdout: objects: 209 objects, 585 KiB 2024-03-30T13:41:33.630 INFO:teuthology.orchestra.run.smithi099.stdout: usage: 67 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:41:33.630 INFO:teuthology.orchestra.run.smithi099.stdout: pgs: 161 active+clean 2024-03-30T13:41:33.630 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-03-30T13:41:33.630 INFO:teuthology.orchestra.run.smithi099.stdout: io: 2024-03-30T13:41:33.630 INFO:teuthology.orchestra.run.smithi099.stdout: client: 1.2 KiB/s rd, 1 op/s rd, 0 op/s wr 2024-03-30T13:41:33.630 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-03-30T13:41:33.837 INFO:journalctl@ceph.alertmanager.a.smithi099.stdout:Mar 30 13:41:33 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-alertmanager-a[52107]: level=error ts=2024-03-30T13:41:33.517Z caller=dispatch.go:354 component=dispatcher msg="Notify for alerts failed" num_alerts=3 err="ceph-dashboard/webhook[0]: notify retry canceled after 7 attempts: Post \"https://172.21.15.99:8443//api/prometheus_receiver\": x509: cannot validate certificate for 172.21.15.99 because it doesn't contain any IP SANs; ceph-dashboard/webhook[1]: notify retry canceled after 7 attempts: Post \"https://172.21.15.181:8443/api/prometheus_receiver\": x509: cannot validate certificate for 172.21.15.181 because it doesn't contain any IP SANs" 2024-03-30T13:41:33.837 INFO:journalctl@ceph.alertmanager.a.smithi099.stdout:Mar 30 13:41:33 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-alertmanager-a[52107]: level=warn ts=2024-03-30T13:41:33.519Z caller=notify.go:724 component=dispatcher receiver=ceph-dashboard integration=webhook[0] msg="Notify attempt failed, will retry later" attempts=1 err="Post \"https://172.21.15.99:8443//api/prometheus_receiver\": x509: cannot validate certificate for 172.21.15.99 because it doesn't contain any IP SANs" 2024-03-30T13:41:33.837 INFO:journalctl@ceph.alertmanager.a.smithi099.stdout:Mar 30 13:41:33 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-alertmanager-a[52107]: level=warn ts=2024-03-30T13:41:33.519Z caller=notify.go:724 component=dispatcher receiver=ceph-dashboard integration=webhook[1] msg="Notify attempt failed, will retry later" attempts=1 err="Post \"https://172.21.15.181:8443/api/prometheus_receiver\": x509: cannot validate certificate for 172.21.15.181 because it doesn't contain any IP SANs" 2024-03-30T13:41:34.417 DEBUG:teuthology.orchestra.run.smithi099:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 98ebaeb8-ee99-11ee-b647-cb9ed24678a4 -e sha1=4e50bbcdd1630c7760b708f3a5b4d38a121e66cb -- bash -c 'ceph orch ls' 2024-03-30T13:41:34.725 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:41:34 smithi099 ceph-mon[24912]: from='client.? 172.21.15.99:0/1013646960' entity='client.admin' cmd=[{"prefix": "status"}]: dispatch 2024-03-30T13:41:34.725 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:41:34 smithi099 ceph-mon[24912]: pgmap v208: 161 pgs: 161 active+clean; 585 KiB data, 67 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T13:41:34.726 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:41:34 smithi099 ceph-mon[29691]: from='client.? 172.21.15.99:0/1013646960' entity='client.admin' cmd=[{"prefix": "status"}]: dispatch 2024-03-30T13:41:34.726 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:41:34 smithi099 ceph-mon[29691]: pgmap v208: 161 pgs: 161 active+clean; 585 KiB data, 67 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T13:41:35.006 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:41:34 smithi181 ceph-mon[25762]: from='client.? 172.21.15.99:0/1013646960' entity='client.admin' cmd=[{"prefix": "status"}]: dispatch 2024-03-30T13:41:35.006 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:41:34 smithi181 ceph-mon[25762]: pgmap v208: 161 pgs: 161 active+clean; 585 KiB data, 67 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T13:41:35.940 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:41:35 smithi099 ceph-mon[24912]: from='client.14838 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T13:41:35.940 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:41:35 smithi099 ceph-mon[29691]: from='client.14838 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T13:41:36.006 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:41:35 smithi181 ceph-mon[25762]: from='client.14838 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T13:41:36.491 INFO:teuthology.orchestra.run.smithi099.stdout:NAME PORTS RUNNING REFRESHED AGE PLACEMENT 2024-03-30T13:41:36.491 INFO:teuthology.orchestra.run.smithi099.stdout:agent 2/2 19s ago 5m * 2024-03-30T13:41:36.491 INFO:teuthology.orchestra.run.smithi099.stdout:alertmanager ?:9093,9094 1/1 8s ago 5m smithi099=a;count:1 2024-03-30T13:41:36.491 INFO:teuthology.orchestra.run.smithi099.stdout:grafana ?:3000 1/1 19s ago 5m smithi181=a;count:1 2024-03-30T13:41:36.491 INFO:teuthology.orchestra.run.smithi099.stdout:iscsi.foo 1/1 8s ago 3m count:1 2024-03-30T13:41:36.491 INFO:teuthology.orchestra.run.smithi099.stdout:mgr 2/2 19s ago 9m smithi099=y;smithi181=x;count:2 2024-03-30T13:41:36.491 INFO:teuthology.orchestra.run.smithi099.stdout:mon 3/3 19s ago 9m smithi099:172.21.15.99=a;smithi099:[v2:172.21.15.99:3301,v1:172.21.15.99:6790]=c;smithi181:172.21.15.181=b;count:3 2024-03-30T13:41:36.491 INFO:teuthology.orchestra.run.smithi099.stdout:node-exporter ?:9100 2/2 19s ago 5m smithi099=a;smithi181=b;count:2 2024-03-30T13:41:36.491 INFO:teuthology.orchestra.run.smithi099.stdout:osd 8 19s ago - 2024-03-30T13:41:36.491 INFO:teuthology.orchestra.run.smithi099.stdout:prometheus ?:9095 1/1 19s ago 5m smithi181=a;count:1 2024-03-30T13:41:36.492 INFO:teuthology.orchestra.run.smithi099.stdout:rgw.foo ?:8000 2/2 19s ago 3m count:2 2024-03-30T13:41:36.750 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:41:36 smithi099 ceph-mon[24912]: pgmap v209: 161 pgs: 161 active+clean; 585 KiB data, 67 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T13:41:36.751 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:41:36 smithi099 ceph-mon[29691]: pgmap v209: 161 pgs: 161 active+clean; 585 KiB data, 67 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T13:41:37.006 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:41:36 smithi181 ceph-mon[25762]: pgmap v209: 161 pgs: 161 active+clean; 585 KiB data, 67 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T13:41:37.086 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:41:36 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[25141]: ::ffff:172.21.15.181 - - [30/Mar/2024:13:41:36] "GET /metrics HTTP/1.1" 200 208041 "" "Prometheus/2.33.4" 2024-03-30T13:41:37.330 DEBUG:teuthology.orchestra.run.smithi099:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 98ebaeb8-ee99-11ee-b647-cb9ed24678a4 -e sha1=4e50bbcdd1630c7760b708f3a5b4d38a121e66cb -- bash -c 'ceph orch daemon redeploy "mgr.$(ceph mgr dump -f json | jq .standbys | jq .[] | jq -r .name)" --image quay.ceph.io/ceph-ci/ceph:$sha1' 2024-03-30T13:41:37.587 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:41:37 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[25141]: 172.21.15.181 - - [30/Mar/2024:13:41:37] "POST /data HTTP/1.1" 200 46 "" "Python-urllib/3.9" 2024-03-30T13:41:37.892 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:41:37 smithi099 ceph-mon[24912]: from='client.24877 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T13:41:37.893 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:41:37 smithi099 ceph-mon[24912]: from='mgr.14439 ' entity='mgr.y' 2024-03-30T13:41:37.893 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:41:37 smithi099 ceph-mon[24912]: from='mgr.14439 ' entity='mgr.y' 2024-03-30T13:41:37.893 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:41:37 smithi099 ceph-mon[29691]: from='client.24877 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T13:41:37.893 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:41:37 smithi099 ceph-mon[29691]: from='mgr.14439 ' entity='mgr.y' 2024-03-30T13:41:37.893 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:41:37 smithi099 ceph-mon[29691]: from='mgr.14439 ' entity='mgr.y' 2024-03-30T13:41:38.006 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:41:37 smithi181 ceph-mon[25762]: from='client.24877 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T13:41:38.006 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:41:37 smithi181 ceph-mon[25762]: from='mgr.14439 ' entity='mgr.y' 2024-03-30T13:41:38.006 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:41:37 smithi181 ceph-mon[25762]: from='mgr.14439 ' entity='mgr.y' 2024-03-30T13:41:38.912 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:41:38 smithi099 ceph-mon[24912]: pgmap v210: 161 pgs: 161 active+clean; 585 KiB data, 67 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T13:41:38.912 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:41:38 smithi099 ceph-mon[29691]: pgmap v210: 161 pgs: 161 active+clean; 585 KiB data, 67 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T13:41:38.913 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:41:38 smithi181 ceph-mon[25762]: pgmap v210: 161 pgs: 161 active+clean; 585 KiB data, 67 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T13:41:39.756 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:41:39 smithi181 ceph-mon[25762]: from='client.? 172.21.15.99:0/2054593528' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-03-30T13:41:39.756 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 13:41:39 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-x[27332]: ::ffff:172.21.15.181 - - [30/Mar/2024:13:41:39] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-03-30T13:41:39.785 INFO:teuthology.orchestra.run.smithi099.stdout:Scheduled to redeploy mgr.x on host 'smithi181' 2024-03-30T13:41:40.086 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:41:39 smithi099 ceph-mon[24912]: from='client.? 172.21.15.99:0/2054593528' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-03-30T13:41:40.087 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:41:39 smithi099 ceph-mon[29691]: from='client.? 172.21.15.99:0/2054593528' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-03-30T13:41:40.505 DEBUG:teuthology.orchestra.run.smithi099:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 98ebaeb8-ee99-11ee-b647-cb9ed24678a4 -e sha1=4e50bbcdd1630c7760b708f3a5b4d38a121e66cb -- bash -c 'ceph orch ps --refresh' 2024-03-30T13:41:41.034 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:41:40 smithi099 ceph-mon[24912]: from='client.14997 -' entity='client.admin' cmd=[{"prefix": "orch daemon redeploy", "name": "mgr.x", "image": "quay.ceph.io/ceph-ci/ceph:4e50bbcdd1630c7760b708f3a5b4d38a121e66cb", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T13:41:41.034 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:41:40 smithi099 ceph-mon[24912]: from='mgr.14439 ' entity='mgr.y' 2024-03-30T13:41:41.034 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:41:40 smithi099 ceph-mon[24912]: Schedule redeploy daemon mgr.x 2024-03-30T13:41:41.035 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:41:40 smithi099 ceph-mon[24912]: from='mgr.14439 172.21.15.99:0/1757456350' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:41:41.035 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:41:40 smithi099 ceph-mon[24912]: from='mgr.14439 172.21.15.99:0/1757456350' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:41:41.035 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:41:40 smithi099 ceph-mon[24912]: from='mgr.14439 ' entity='mgr.y' 2024-03-30T13:41:41.035 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:41:40 smithi099 ceph-mon[24912]: from='mgr.14439 172.21.15.99:0/1757456350' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-03-30T13:41:41.035 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:41:40 smithi099 ceph-mon[24912]: from='mgr.14439 ' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-03-30T13:41:41.035 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:41:40 smithi099 ceph-mon[24912]: from='mgr.14439 172.21.15.99:0/1757456350' entity='mgr.y' cmd=[{"prefix": "mgr services"}]: dispatch 2024-03-30T13:41:41.035 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:41:40 smithi099 ceph-mon[24912]: from='mgr.14439 172.21.15.99:0/1757456350' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:41:41.035 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:41:40 smithi099 ceph-mon[24912]: Deploying daemon mgr.x on smithi181 2024-03-30T13:41:41.035 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:41:40 smithi099 ceph-mon[24912]: pgmap v211: 161 pgs: 161 active+clean; 585 KiB data, 67 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T13:41:41.035 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:41:40 smithi099 ceph-mon[29691]: from='client.14997 -' entity='client.admin' cmd=[{"prefix": "orch daemon redeploy", "name": "mgr.x", "image": "quay.ceph.io/ceph-ci/ceph:4e50bbcdd1630c7760b708f3a5b4d38a121e66cb", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T13:41:41.036 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:41:40 smithi099 ceph-mon[29691]: from='mgr.14439 ' entity='mgr.y' 2024-03-30T13:41:41.036 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:41:40 smithi099 ceph-mon[29691]: Schedule redeploy daemon mgr.x 2024-03-30T13:41:41.036 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:41:40 smithi099 ceph-mon[29691]: from='mgr.14439 172.21.15.99:0/1757456350' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:41:41.036 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:41:40 smithi099 ceph-mon[29691]: from='mgr.14439 172.21.15.99:0/1757456350' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:41:41.036 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:41:40 smithi099 ceph-mon[29691]: from='mgr.14439 ' entity='mgr.y' 2024-03-30T13:41:41.036 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:41:40 smithi099 ceph-mon[29691]: from='mgr.14439 172.21.15.99:0/1757456350' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-03-30T13:41:41.036 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:41:40 smithi099 ceph-mon[29691]: from='mgr.14439 ' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-03-30T13:41:41.036 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:41:40 smithi099 ceph-mon[29691]: from='mgr.14439 172.21.15.99:0/1757456350' entity='mgr.y' cmd=[{"prefix": "mgr services"}]: dispatch 2024-03-30T13:41:41.036 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:41:40 smithi099 ceph-mon[29691]: from='mgr.14439 172.21.15.99:0/1757456350' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:41:41.036 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:41:40 smithi099 ceph-mon[29691]: Deploying daemon mgr.x on smithi181 2024-03-30T13:41:41.036 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:41:40 smithi099 ceph-mon[29691]: pgmap v211: 161 pgs: 161 active+clean; 585 KiB data, 67 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T13:41:41.238 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:41:40 smithi181 ceph-mon[25762]: from='client.14997 -' entity='client.admin' cmd=[{"prefix": "orch daemon redeploy", "name": "mgr.x", "image": "quay.ceph.io/ceph-ci/ceph:4e50bbcdd1630c7760b708f3a5b4d38a121e66cb", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T13:41:41.238 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:41:40 smithi181 ceph-mon[25762]: from='mgr.14439 ' entity='mgr.y' 2024-03-30T13:41:41.238 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:41:40 smithi181 ceph-mon[25762]: Schedule redeploy daemon mgr.x 2024-03-30T13:41:41.239 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:41:40 smithi181 ceph-mon[25762]: from='mgr.14439 172.21.15.99:0/1757456350' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:41:41.239 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:41:40 smithi181 ceph-mon[25762]: from='mgr.14439 172.21.15.99:0/1757456350' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:41:41.239 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:41:40 smithi181 ceph-mon[25762]: from='mgr.14439 ' entity='mgr.y' 2024-03-30T13:41:41.239 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:41:40 smithi181 ceph-mon[25762]: from='mgr.14439 172.21.15.99:0/1757456350' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-03-30T13:41:41.239 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:41:40 smithi181 ceph-mon[25762]: from='mgr.14439 ' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-03-30T13:41:41.239 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:41:40 smithi181 ceph-mon[25762]: from='mgr.14439 172.21.15.99:0/1757456350' entity='mgr.y' cmd=[{"prefix": "mgr services"}]: dispatch 2024-03-30T13:41:41.239 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:41:40 smithi181 ceph-mon[25762]: from='mgr.14439 172.21.15.99:0/1757456350' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:41:41.239 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:41:40 smithi181 ceph-mon[25762]: Deploying daemon mgr.x on smithi181 2024-03-30T13:41:41.239 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:41:40 smithi181 ceph-mon[25762]: pgmap v211: 161 pgs: 161 active+clean; 585 KiB data, 67 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T13:41:42.179 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:41:42 smithi099 ceph-mon[24912]: pgmap v212: 161 pgs: 161 active+clean; 585 KiB data, 67 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T13:41:42.180 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:41:42 smithi099 ceph-mon[29691]: pgmap v212: 161 pgs: 161 active+clean; 585 KiB data, 67 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T13:41:42.506 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:41:42 smithi181 ceph-mon[25762]: pgmap v212: 161 pgs: 161 active+clean; 585 KiB data, 67 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T13:41:42.563 INFO:teuthology.orchestra.run.smithi099.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-03-30T13:41:42.563 INFO:teuthology.orchestra.run.smithi099.stdout:agent.smithi099 smithi099 running 14s ago 10m - - 2024-03-30T13:41:42.563 INFO:teuthology.orchestra.run.smithi099.stdout:agent.smithi181 smithi181 running 5s ago 9m - - 2024-03-30T13:41:42.563 INFO:teuthology.orchestra.run.smithi099.stdout:alertmanager.a smithi099 *:9093,9094 running (3m) 14s ago 4m 26.6M - ba2b418f427c 8804d597845b 2024-03-30T13:41:42.563 INFO:teuthology.orchestra.run.smithi099.stdout:grafana.a smithi181 *:3000 running (3m) 5s ago 3m 56.6M - 8.3.5 dad864ee21e9 084559d00328 2024-03-30T13:41:42.563 INFO:teuthology.orchestra.run.smithi099.stdout:iscsi.foo.smithi099.qyjuvr smithi099 running (3m) 14s ago 3m 48.7M - 3.5 e1d6a67b021e b426fa245c2a 2024-03-30T13:41:42.564 INFO:teuthology.orchestra.run.smithi099.stdout:mgr.x smithi181 *:8443 running (9m) 5s ago 9m 412M - 17.2.0 e1d6a67b021e c3667b1b85f3 2024-03-30T13:41:42.564 INFO:teuthology.orchestra.run.smithi099.stdout:mgr.y smithi099 *:9283 running (10m) 14s ago 10m 468M - 17.2.0 e1d6a67b021e db3430cee99a 2024-03-30T13:41:42.564 INFO:teuthology.orchestra.run.smithi099.stdout:mon.a smithi099 running (10m) 14s ago 10m 54.7M 2048M 17.2.0 e1d6a67b021e af06ebb19fd8 2024-03-30T13:41:42.564 INFO:teuthology.orchestra.run.smithi099.stdout:mon.b smithi181 running (9m) 5s ago 9m 41.7M 2048M 17.2.0 e1d6a67b021e e678a2a25c90 2024-03-30T13:41:42.564 INFO:teuthology.orchestra.run.smithi099.stdout:mon.c smithi099 running (9m) 14s ago 9m 39.7M 2048M 17.2.0 e1d6a67b021e 0f1e98917718 2024-03-30T13:41:42.564 INFO:teuthology.orchestra.run.smithi099.stdout:node-exporter.a smithi099 *:9100 running (5m) 14s ago 5m 17.0M - 1dbe0e931976 ad756dd8c3f9 2024-03-30T13:41:42.564 INFO:teuthology.orchestra.run.smithi099.stdout:node-exporter.b smithi181 *:9100 running (5m) 5s ago 5m 15.0M - 1dbe0e931976 5a3d4484d23a 2024-03-30T13:41:42.564 INFO:teuthology.orchestra.run.smithi099.stdout:osd.0 smithi099 running (8m) 14s ago 8m 49.6M 4096M 17.2.0 e1d6a67b021e 3158ee1b0c67 2024-03-30T13:41:42.564 INFO:teuthology.orchestra.run.smithi099.stdout:osd.1 smithi099 running (8m) 14s ago 8m 52.6M 4096M 17.2.0 e1d6a67b021e c4af0fd7071a 2024-03-30T13:41:42.564 INFO:teuthology.orchestra.run.smithi099.stdout:osd.2 smithi099 running (8m) 14s ago 8m 45.9M 4096M 17.2.0 e1d6a67b021e 8e4e805a7e20 2024-03-30T13:41:42.564 INFO:teuthology.orchestra.run.smithi099.stdout:osd.3 smithi099 running (7m) 14s ago 7m 48.4M 4096M 17.2.0 e1d6a67b021e 718812bcf065 2024-03-30T13:41:42.564 INFO:teuthology.orchestra.run.smithi099.stdout:osd.4 smithi181 running (7m) 5s ago 7m 48.3M 4096M 17.2.0 e1d6a67b021e 5e205434e973 2024-03-30T13:41:42.564 INFO:teuthology.orchestra.run.smithi099.stdout:osd.5 smithi181 running (6m) 5s ago 6m 46.8M 4096M 17.2.0 e1d6a67b021e e330c920f152 2024-03-30T13:41:42.564 INFO:teuthology.orchestra.run.smithi099.stdout:osd.6 smithi181 running (6m) 5s ago 6m 45.5M 4096M 17.2.0 e1d6a67b021e 81d889ea213d 2024-03-30T13:41:42.565 INFO:teuthology.orchestra.run.smithi099.stdout:osd.7 smithi181 running (6m) 5s ago 6m 47.4M 4096M 17.2.0 e1d6a67b021e c08b1839dd7e 2024-03-30T13:41:42.565 INFO:teuthology.orchestra.run.smithi099.stdout:prometheus.a smithi181 *:9095 running (3m) 5s ago 5m 67.2M - 514e6a882f6e 9fa29bb6baba 2024-03-30T13:41:42.565 INFO:teuthology.orchestra.run.smithi099.stdout:rgw.foo.smithi099.fxjbmp smithi099 *:8000 running (3m) 14s ago 3m 70.1M - 17.2.0 e1d6a67b021e 400b28b3f650 2024-03-30T13:41:42.565 INFO:teuthology.orchestra.run.smithi099.stdout:rgw.foo.smithi181.wfqwti smithi181 *:8000 running (3m) 5s ago 3m 69.6M - 17.2.0 e1d6a67b021e 97e1b130f9d4 2024-03-30T13:41:43.337 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:41:43 smithi099 ceph-mon[24912]: from='client.24895 -' entity='client.admin' cmd=[{"prefix": "orch ps", "refresh": true, "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T13:41:43.337 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:41:43 smithi099 ceph-mon[29691]: from='client.24895 -' entity='client.admin' cmd=[{"prefix": "orch ps", "refresh": true, "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T13:41:43.354 DEBUG:teuthology.orchestra.run.smithi099:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 98ebaeb8-ee99-11ee-b647-cb9ed24678a4 -e sha1=4e50bbcdd1630c7760b708f3a5b4d38a121e66cb -- bash -c 'sleep 180' 2024-03-30T13:41:43.430 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:41:43 smithi181 ceph-mon[25762]: from='client.24895 -' entity='client.admin' cmd=[{"prefix": "orch ps", "refresh": true, "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T13:41:43.663 INFO:journalctl@ceph.alertmanager.a.smithi099.stdout:Mar 30 13:41:43 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-alertmanager-a[52107]: level=error ts=2024-03-30T13:41:43.518Z caller=dispatch.go:354 component=dispatcher msg="Notify for alerts failed" num_alerts=3 err="ceph-dashboard/webhook[1]: notify retry canceled after 8 attempts: Post \"https://172.21.15.181:8443/api/prometheus_receiver\": x509: cannot validate certificate for 172.21.15.181 because it doesn't contain any IP SANs; ceph-dashboard/webhook[0]: notify retry canceled after 8 attempts: Post \"https://172.21.15.99:8443//api/prometheus_receiver\": x509: cannot validate certificate for 172.21.15.99 because it doesn't contain any IP SANs" 2024-03-30T13:41:43.663 INFO:journalctl@ceph.alertmanager.a.smithi099.stdout:Mar 30 13:41:43 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-alertmanager-a[52107]: level=warn ts=2024-03-30T13:41:43.520Z caller=notify.go:724 component=dispatcher receiver=ceph-dashboard integration=webhook[0] msg="Notify attempt failed, will retry later" attempts=1 err="Post \"https://172.21.15.99:8443//api/prometheus_receiver\": x509: cannot validate certificate for 172.21.15.99 because it doesn't contain any IP SANs" 2024-03-30T13:41:43.663 INFO:journalctl@ceph.alertmanager.a.smithi099.stdout:Mar 30 13:41:43 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-alertmanager-a[52107]: level=warn ts=2024-03-30T13:41:43.520Z caller=notify.go:724 component=dispatcher receiver=ceph-dashboard integration=webhook[1] msg="Notify attempt failed, will retry later" attempts=1 err="Post \"https://172.21.15.181:8443/api/prometheus_receiver\": x509: cannot validate certificate for 172.21.15.181 because it doesn't contain any IP SANs" 2024-03-30T13:41:44.870 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:41:44 smithi099 ceph-mon[29691]: pgmap v213: 161 pgs: 161 active+clean; 585 KiB data, 67 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T13:41:44.871 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:41:44 smithi099 ceph-mon[24912]: pgmap v213: 161 pgs: 161 active+clean; 585 KiB data, 67 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T13:41:45.006 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:41:44 smithi181 ceph-mon[25762]: pgmap v213: 161 pgs: 161 active+clean; 585 KiB data, 67 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T13:41:46.006 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:41:45 smithi181 ceph-mon[25762]: from='client.14838 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T13:41:46.087 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:41:45 smithi099 ceph-mon[24912]: from='client.14838 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T13:41:46.087 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:41:45 smithi099 ceph-mon[29691]: from='client.14838 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T13:41:47.006 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:41:46 smithi181 ceph-mon[25762]: pgmap v214: 161 pgs: 161 active+clean; 585 KiB data, 67 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T13:41:47.087 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:41:46 smithi099 ceph-mon[24912]: pgmap v214: 161 pgs: 161 active+clean; 585 KiB data, 67 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T13:41:47.087 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:41:46 smithi099 ceph-mon[29691]: pgmap v214: 161 pgs: 161 active+clean; 585 KiB data, 67 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T13:41:47.088 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:41:46 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[25141]: ::ffff:172.21.15.181 - - [30/Mar/2024:13:41:46] "GET /metrics HTTP/1.1" 200 208044 "" "Prometheus/2.33.4" 2024-03-30T13:41:48.087 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:41:47 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[25141]: 172.21.15.99 - - [30/Mar/2024:13:41:47] "POST /data HTTP/1.1" 200 46 "" "Python-urllib/3.9" 2024-03-30T13:41:48.837 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:41:48 smithi099 ceph-mon[24912]: from='mgr.14439 ' entity='mgr.y' 2024-03-30T13:41:48.837 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:41:48 smithi099 ceph-mon[24912]: from='mgr.14439 ' entity='mgr.y' 2024-03-30T13:41:48.837 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:41:48 smithi099 ceph-mon[24912]: pgmap v215: 161 pgs: 161 active+clean; 585 KiB data, 67 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T13:41:48.837 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:41:48 smithi099 ceph-mon[29691]: from='mgr.14439 ' entity='mgr.y' 2024-03-30T13:41:48.838 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:41:48 smithi099 ceph-mon[29691]: from='mgr.14439 ' entity='mgr.y' 2024-03-30T13:41:48.838 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:41:48 smithi099 ceph-mon[29691]: pgmap v215: 161 pgs: 161 active+clean; 585 KiB data, 67 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T13:41:49.006 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:41:48 smithi181 ceph-mon[25762]: from='mgr.14439 ' entity='mgr.y' 2024-03-30T13:41:49.006 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:41:48 smithi181 ceph-mon[25762]: from='mgr.14439 ' entity='mgr.y' 2024-03-30T13:41:49.006 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:41:48 smithi181 ceph-mon[25762]: pgmap v215: 161 pgs: 161 active+clean; 585 KiB data, 67 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T13:41:49.756 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 13:41:49 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-x[27332]: ::ffff:172.21.15.181 - - [30/Mar/2024:13:41:49] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-03-30T13:41:50.506 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:41:50 smithi181 ceph-mon[25762]: pgmap v216: 161 pgs: 161 active+clean; 585 KiB data, 67 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T13:41:50.587 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:41:50 smithi099 ceph-mon[24912]: pgmap v216: 161 pgs: 161 active+clean; 585 KiB data, 67 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T13:41:50.587 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:41:50 smithi099 ceph-mon[29691]: pgmap v216: 161 pgs: 161 active+clean; 585 KiB data, 67 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T13:41:52.506 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:41:52 smithi181 ceph-mon[25762]: pgmap v217: 161 pgs: 161 active+clean; 585 KiB data, 67 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T13:41:52.587 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:41:52 smithi099 ceph-mon[24912]: pgmap v217: 161 pgs: 161 active+clean; 585 KiB data, 67 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T13:41:52.588 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:41:52 smithi099 ceph-mon[29691]: pgmap v217: 161 pgs: 161 active+clean; 585 KiB data, 67 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T13:41:53.837 INFO:journalctl@ceph.alertmanager.a.smithi099.stdout:Mar 30 13:41:53 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-alertmanager-a[52107]: level=error ts=2024-03-30T13:41:53.519Z caller=dispatch.go:354 component=dispatcher msg="Notify for alerts failed" num_alerts=3 err="ceph-dashboard/webhook[0]: notify retry canceled after 8 attempts: Post \"https://172.21.15.99:8443//api/prometheus_receiver\": x509: cannot validate certificate for 172.21.15.99 because it doesn't contain any IP SANs; ceph-dashboard/webhook[1]: notify retry canceled after 8 attempts: Post \"https://172.21.15.181:8443/api/prometheus_receiver\": x509: cannot validate certificate for 172.21.15.181 because it doesn't contain any IP SANs" 2024-03-30T13:41:53.837 INFO:journalctl@ceph.alertmanager.a.smithi099.stdout:Mar 30 13:41:53 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-alertmanager-a[52107]: level=warn ts=2024-03-30T13:41:53.520Z caller=notify.go:724 component=dispatcher receiver=ceph-dashboard integration=webhook[0] msg="Notify attempt failed, will retry later" attempts=1 err="Post \"https://172.21.15.99:8443//api/prometheus_receiver\": x509: cannot validate certificate for 172.21.15.99 because it doesn't contain any IP SANs" 2024-03-30T13:41:53.837 INFO:journalctl@ceph.alertmanager.a.smithi099.stdout:Mar 30 13:41:53 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-alertmanager-a[52107]: level=warn ts=2024-03-30T13:41:53.521Z caller=notify.go:724 component=dispatcher receiver=ceph-dashboard integration=webhook[1] msg="Notify attempt failed, will retry later" attempts=1 err="Post \"https://172.21.15.181:8443/api/prometheus_receiver\": x509: cannot validate certificate for 172.21.15.181 because it doesn't contain any IP SANs" 2024-03-30T13:41:54.837 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:41:54 smithi099 ceph-mon[24912]: pgmap v218: 161 pgs: 161 active+clean; 585 KiB data, 67 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T13:41:54.837 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:41:54 smithi099 ceph-mon[29691]: pgmap v218: 161 pgs: 161 active+clean; 585 KiB data, 67 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T13:41:55.006 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:41:54 smithi181 ceph-mon[25762]: pgmap v218: 161 pgs: 161 active+clean; 585 KiB data, 67 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T13:41:56.006 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:41:55 smithi181 ceph-mon[25762]: from='client.14838 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T13:41:56.087 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:41:55 smithi099 ceph-mon[24912]: from='client.14838 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T13:41:56.087 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:41:55 smithi099 ceph-mon[29691]: from='client.14838 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T13:41:57.006 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:41:56 smithi181 ceph-mon[25762]: pgmap v219: 161 pgs: 161 active+clean; 585 KiB data, 67 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T13:41:57.087 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:41:56 smithi099 ceph-mon[24912]: pgmap v219: 161 pgs: 161 active+clean; 585 KiB data, 67 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T13:41:57.087 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:41:56 smithi099 ceph-mon[29691]: pgmap v219: 161 pgs: 161 active+clean; 585 KiB data, 67 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T13:41:57.087 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:41:56 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[25141]: ::ffff:172.21.15.181 - - [30/Mar/2024:13:41:56] "GET /metrics HTTP/1.1" 200 208044 "" "Prometheus/2.33.4" 2024-03-30T13:41:57.587 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:41:57 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[25141]: 172.21.15.181 - - [30/Mar/2024:13:41:57] "POST /data HTTP/1.1" 200 46 "" "Python-urllib/3.9" 2024-03-30T13:41:58.270 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:41:58 smithi181 ceph-mon[25762]: from='mgr.14439 ' entity='mgr.y' 2024-03-30T13:41:58.270 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:41:58 smithi181 ceph-mon[25762]: from='mgr.14439 ' entity='mgr.y' 2024-03-30T13:41:58.587 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:41:58 smithi099 ceph-mon[24912]: from='mgr.14439 ' entity='mgr.y' 2024-03-30T13:41:58.587 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:41:58 smithi099 ceph-mon[24912]: from='mgr.14439 ' entity='mgr.y' 2024-03-30T13:41:58.587 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:41:58 smithi099 ceph-mon[24912]: pgmap v220: 161 pgs: 161 active+clean; 585 KiB data, 67 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T13:41:58.587 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:41:58 smithi099 ceph-mon[29691]: from='mgr.14439 ' entity='mgr.y' 2024-03-30T13:41:58.587 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:41:58 smithi099 ceph-mon[29691]: from='mgr.14439 ' entity='mgr.y' 2024-03-30T13:41:58.587 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:41:58 smithi099 ceph-mon[29691]: pgmap v220: 161 pgs: 161 active+clean; 585 KiB data, 67 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T13:41:58.756 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:41:58 smithi181 ceph-mon[25762]: pgmap v220: 161 pgs: 161 active+clean; 585 KiB data, 67 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T13:41:59.720 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 13:41:59 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-x[27332]: ::ffff:172.21.15.181 - - [30/Mar/2024:13:41:59] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-03-30T13:41:59.987 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:41:59 smithi181 ceph-mon[25762]: from='mgr.14439 172.21.15.99:0/1757456350' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-03-30T13:41:59.987 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:41:59 smithi181 ceph-mon[25762]: from='mgr.14439 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-03-30T13:41:59.988 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:41:59 smithi181 ceph-mon[25762]: from='mgr.14439 172.21.15.99:0/1757456350' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-03-30T13:41:59.988 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:41:59 smithi181 ceph-mon[25762]: from='mgr.14439 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-03-30T13:42:00.087 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:41:59 smithi099 ceph-mon[24912]: from='mgr.14439 172.21.15.99:0/1757456350' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-03-30T13:42:00.087 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:41:59 smithi099 ceph-mon[24912]: from='mgr.14439 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-03-30T13:42:00.087 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:41:59 smithi099 ceph-mon[24912]: from='mgr.14439 172.21.15.99:0/1757456350' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-03-30T13:42:00.087 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:41:59 smithi099 ceph-mon[24912]: from='mgr.14439 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-03-30T13:42:00.087 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:41:59 smithi099 ceph-mon[29691]: from='mgr.14439 172.21.15.99:0/1757456350' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-03-30T13:42:00.087 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:41:59 smithi099 ceph-mon[29691]: from='mgr.14439 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-03-30T13:42:00.087 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:41:59 smithi099 ceph-mon[29691]: from='mgr.14439 172.21.15.99:0/1757456350' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-03-30T13:42:00.088 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:41:59 smithi099 ceph-mon[29691]: from='mgr.14439 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-03-30T13:42:01.006 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:42:00 smithi181 ceph-mon[25762]: pgmap v221: 161 pgs: 161 active+clean; 585 KiB data, 67 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T13:42:01.087 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:42:00 smithi099 ceph-mon[24912]: pgmap v221: 161 pgs: 161 active+clean; 585 KiB data, 67 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T13:42:01.087 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:42:00 smithi099 ceph-mon[29691]: pgmap v221: 161 pgs: 161 active+clean; 585 KiB data, 67 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T13:42:02.506 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:42:02 smithi181 ceph-mon[25762]: pgmap v222: 161 pgs: 161 active+clean; 585 KiB data, 67 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T13:42:02.587 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:42:02 smithi099 ceph-mon[24912]: pgmap v222: 161 pgs: 161 active+clean; 585 KiB data, 67 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T13:42:02.587 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:42:02 smithi099 ceph-mon[29691]: pgmap v222: 161 pgs: 161 active+clean; 585 KiB data, 67 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T13:42:03.837 INFO:journalctl@ceph.alertmanager.a.smithi099.stdout:Mar 30 13:42:03 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-alertmanager-a[52107]: level=error ts=2024-03-30T13:42:03.519Z caller=dispatch.go:354 component=dispatcher msg="Notify for alerts failed" num_alerts=3 err="ceph-dashboard/webhook[1]: notify retry canceled after 7 attempts: Post \"https://172.21.15.181:8443/api/prometheus_receiver\": x509: cannot validate certificate for 172.21.15.181 because it doesn't contain any IP SANs; ceph-dashboard/webhook[0]: notify retry canceled after 7 attempts: Post \"https://172.21.15.99:8443//api/prometheus_receiver\": x509: cannot validate certificate for 172.21.15.99 because it doesn't contain any IP SANs" 2024-03-30T13:42:03.837 INFO:journalctl@ceph.alertmanager.a.smithi099.stdout:Mar 30 13:42:03 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-alertmanager-a[52107]: level=warn ts=2024-03-30T13:42:03.520Z caller=notify.go:724 component=dispatcher receiver=ceph-dashboard integration=webhook[0] msg="Notify attempt failed, will retry later" attempts=1 err="Post \"https://172.21.15.99:8443//api/prometheus_receiver\": x509: cannot validate certificate for 172.21.15.99 because it doesn't contain any IP SANs" 2024-03-30T13:42:03.837 INFO:journalctl@ceph.alertmanager.a.smithi099.stdout:Mar 30 13:42:03 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-alertmanager-a[52107]: level=warn ts=2024-03-30T13:42:03.521Z caller=notify.go:724 component=dispatcher receiver=ceph-dashboard integration=webhook[1] msg="Notify attempt failed, will retry later" attempts=1 err="Post \"https://172.21.15.181:8443/api/prometheus_receiver\": x509: cannot validate certificate for 172.21.15.181 because it doesn't contain any IP SANs" 2024-03-30T13:42:04.837 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:42:04 smithi099 ceph-mon[29691]: pgmap v223: 161 pgs: 161 active+clean; 585 KiB data, 67 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T13:42:04.837 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:42:04 smithi099 ceph-mon[24912]: pgmap v223: 161 pgs: 161 active+clean; 585 KiB data, 67 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T13:42:05.006 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:42:04 smithi181 ceph-mon[25762]: pgmap v223: 161 pgs: 161 active+clean; 585 KiB data, 67 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T13:42:06.006 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:42:05 smithi181 ceph-mon[25762]: from='client.14838 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T13:42:06.087 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:42:05 smithi099 ceph-mon[29691]: from='client.14838 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T13:42:06.087 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:42:05 smithi099 ceph-mon[24912]: from='client.14838 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T13:42:06.974 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:42:06 smithi099 ceph-mon[24912]: pgmap v224: 161 pgs: 161 active+clean; 585 KiB data, 67 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T13:42:06.974 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:42:06 smithi099 ceph-mon[29691]: pgmap v224: 161 pgs: 161 active+clean; 585 KiB data, 67 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T13:42:06.974 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:42:06 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[25141]: ::ffff:172.21.15.181 - - [30/Mar/2024:13:42:06] "GET /metrics HTTP/1.1" 200 208041 "" "Prometheus/2.33.4" 2024-03-30T13:42:07.006 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:42:06 smithi181 ceph-mon[25762]: pgmap v224: 161 pgs: 161 active+clean; 585 KiB data, 67 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T13:42:08.087 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:42:07 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[25141]: 172.21.15.99 - - [30/Mar/2024:13:42:07] "POST /data HTTP/1.1" 200 46 "" "Python-urllib/3.9" 2024-03-30T13:42:09.087 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:42:08 smithi099 ceph-mon[29691]: from='mgr.14439 ' entity='mgr.y' 2024-03-30T13:42:09.087 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:42:08 smithi099 ceph-mon[29691]: from='mgr.14439 ' entity='mgr.y' 2024-03-30T13:42:09.088 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:42:08 smithi099 ceph-mon[29691]: pgmap v225: 161 pgs: 161 active+clean; 585 KiB data, 67 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T13:42:09.088 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:42:08 smithi099 ceph-mon[24912]: from='mgr.14439 ' entity='mgr.y' 2024-03-30T13:42:09.088 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:42:08 smithi099 ceph-mon[24912]: from='mgr.14439 ' entity='mgr.y' 2024-03-30T13:42:09.088 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:42:08 smithi099 ceph-mon[24912]: pgmap v225: 161 pgs: 161 active+clean; 585 KiB data, 67 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T13:42:09.256 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:42:08 smithi181 ceph-mon[25762]: from='mgr.14439 ' entity='mgr.y' 2024-03-30T13:42:09.256 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:42:08 smithi181 ceph-mon[25762]: from='mgr.14439 ' entity='mgr.y' 2024-03-30T13:42:09.256 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:42:08 smithi181 ceph-mon[25762]: pgmap v225: 161 pgs: 161 active+clean; 585 KiB data, 67 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T13:42:09.756 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 13:42:09 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-x[27332]: ::ffff:172.21.15.181 - - [30/Mar/2024:13:42:09] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-03-30T13:42:10.506 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:42:10 smithi181 ceph-mon[25762]: pgmap v226: 161 pgs: 161 active+clean; 585 KiB data, 67 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T13:42:10.587 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:42:10 smithi099 ceph-mon[24912]: pgmap v226: 161 pgs: 161 active+clean; 585 KiB data, 67 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T13:42:10.587 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:42:10 smithi099 ceph-mon[29691]: pgmap v226: 161 pgs: 161 active+clean; 585 KiB data, 67 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T13:42:12.506 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:42:12 smithi181 ceph-mon[25762]: pgmap v227: 161 pgs: 161 active+clean; 585 KiB data, 67 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T13:42:12.587 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:42:12 smithi099 ceph-mon[24912]: pgmap v227: 161 pgs: 161 active+clean; 585 KiB data, 67 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T13:42:12.587 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:42:12 smithi099 ceph-mon[29691]: pgmap v227: 161 pgs: 161 active+clean; 585 KiB data, 67 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T13:42:13.837 INFO:journalctl@ceph.alertmanager.a.smithi099.stdout:Mar 30 13:42:13 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-alertmanager-a[52107]: level=error ts=2024-03-30T13:42:13.519Z caller=dispatch.go:354 component=dispatcher msg="Notify for alerts failed" num_alerts=3 err="ceph-dashboard/webhook[1]: notify retry canceled after 7 attempts: Post \"https://172.21.15.181:8443/api/prometheus_receiver\": x509: cannot validate certificate for 172.21.15.181 because it doesn't contain any IP SANs; ceph-dashboard/webhook[0]: notify retry canceled after 8 attempts: Post \"https://172.21.15.99:8443//api/prometheus_receiver\": x509: cannot validate certificate for 172.21.15.99 because it doesn't contain any IP SANs" 2024-03-30T13:42:13.837 INFO:journalctl@ceph.alertmanager.a.smithi099.stdout:Mar 30 13:42:13 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-alertmanager-a[52107]: level=warn ts=2024-03-30T13:42:13.521Z caller=notify.go:724 component=dispatcher receiver=ceph-dashboard integration=webhook[1] msg="Notify attempt failed, will retry later" attempts=1 err="Post \"https://172.21.15.181:8443/api/prometheus_receiver\": x509: cannot validate certificate for 172.21.15.181 because it doesn't contain any IP SANs" 2024-03-30T13:42:13.837 INFO:journalctl@ceph.alertmanager.a.smithi099.stdout:Mar 30 13:42:13 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-alertmanager-a[52107]: level=warn ts=2024-03-30T13:42:13.521Z caller=notify.go:724 component=dispatcher receiver=ceph-dashboard integration=webhook[0] msg="Notify attempt failed, will retry later" attempts=1 err="Post \"https://172.21.15.99:8443//api/prometheus_receiver\": x509: cannot validate certificate for 172.21.15.99 because it doesn't contain any IP SANs" 2024-03-30T13:42:14.837 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:42:14 smithi099 ceph-mon[24912]: pgmap v228: 161 pgs: 161 active+clean; 585 KiB data, 67 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T13:42:14.837 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:42:14 smithi099 ceph-mon[29691]: pgmap v228: 161 pgs: 161 active+clean; 585 KiB data, 67 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T13:42:15.006 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:42:14 smithi181 ceph-mon[25762]: pgmap v228: 161 pgs: 161 active+clean; 585 KiB data, 67 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T13:42:16.006 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:42:15 smithi181 ceph-mon[25762]: from='client.14838 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T13:42:16.087 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:42:15 smithi099 ceph-mon[24912]: from='client.14838 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T13:42:16.087 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:42:15 smithi099 ceph-mon[29691]: from='client.14838 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T13:42:16.813 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:42:16 smithi181 ceph-mon[25762]: pgmap v229: 161 pgs: 161 active+clean; 585 KiB data, 67 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T13:42:17.087 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:42:16 smithi099 ceph-mon[24912]: pgmap v229: 161 pgs: 161 active+clean; 585 KiB data, 67 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T13:42:17.087 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:42:16 smithi099 ceph-mon[29691]: pgmap v229: 161 pgs: 161 active+clean; 585 KiB data, 67 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T13:42:17.087 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:42:16 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[25141]: ::ffff:172.21.15.181 - - [30/Mar/2024:13:42:16] "GET /metrics HTTP/1.1" 200 208032 "" "Prometheus/2.33.4" 2024-03-30T13:42:17.837 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:42:17 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[25141]: 172.21.15.181 - - [30/Mar/2024:13:42:17] "POST /data HTTP/1.1" 200 46 "" "Python-urllib/3.9" 2024-03-30T13:42:18.006 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 13:42:17 smithi181 systemd[1]: Stopping Ceph mgr.x for 98ebaeb8-ee99-11ee-b647-cb9ed24678a4... 2024-03-30T13:42:18.006 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 13:42:17 smithi181 bash[50049]: Error: no container with name or ID "ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr.x" found: no such container 2024-03-30T13:42:18.355 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 13:42:18 smithi181 podman[50062]: 2024-03-30 13:42:18.032980303 +0000 UTC m=+0.134478488 container died c3667b1b85f3fd0be7d1d77020a57249328f60d2a05d4f32490050f01a312b9b (image=quay.io/ceph/ceph@sha256:12a0a4f43413fd97a14a3d47a3451b2d2df50020835bb93db666209f3f77617a, name=ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-x, GIT_COMMIT=b613db0f44179c0940781c1c7fe04e1acb7093ac, version=8, io.k8s.description=The Universal Base Image is designed and engineered to be the base layer for all of your containerized applications, middleware and utilities. This base image is freely redistributable, but Red Hat only supports Red Hat technologies through subscriptions for Red Hat products. This image is maintained by Red Hat and updated regularly., io.buildah.version=1.19.8, vcs-ref=f1ee6e37554363ec55e0035aba1a693d3627fdeb, com.redhat.license_terms=https://centos.org/legal/licensing-policy/, io.openshift.tags=base centos centos-stream, GIT_CLEAN=True, distribution-scope=public, io.openshift.expose-services=, release=754, url=https://access.redhat.com/containers/#/registry.access.redhat.com/ubi8/images/8.6-754, vendor=Red Hat, Inc., maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, com.redhat.component=centos-stream-container, GIT_REPO=https://github.com/ceph/ceph-container.git, io.k8s.display-name=CentOS Stream 8, ceph=True, vcs-type=git, RELEASE=HEAD, summary=Provides a CentOS Stream container based on the Red Hat Universal Base Image, build-date=2022-05-03T08:36:31.336870, description=CentOS Stream is a continuously delivered distro that tracks just ahead of Red Hat Enterprise Linux development. This image takes the Red Hat UBI and layers on content from CentOS Stream, architecture=x86_64, CEPH_POINT_RELEASE=-17.2.0, name=centos-stream, com.redhat.build-host=cpt-1002.osbs.prod.upshift.rdu2.redhat.com) 2024-03-30T13:42:18.587 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:42:18 smithi099 ceph-mon[24912]: from='mgr.14439 ' entity='mgr.y' 2024-03-30T13:42:18.587 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:42:18 smithi099 ceph-mon[24912]: from='mgr.14439 ' entity='mgr.y' 2024-03-30T13:42:18.587 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:42:18 smithi099 ceph-mon[24912]: pgmap v230: 161 pgs: 161 active+clean; 585 KiB data, 67 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T13:42:18.587 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:42:18 smithi099 ceph-mon[29691]: from='mgr.14439 ' entity='mgr.y' 2024-03-30T13:42:18.587 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:42:18 smithi099 ceph-mon[29691]: from='mgr.14439 ' entity='mgr.y' 2024-03-30T13:42:18.588 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:42:18 smithi099 ceph-mon[29691]: pgmap v230: 161 pgs: 161 active+clean; 585 KiB data, 67 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T13:42:18.588 INFO:journalctl@ceph.alertmanager.a.smithi099.stdout:Mar 30 13:42:18 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-alertmanager-a[52107]: level=warn ts=2024-03-30T13:42:18.329Z caller=notify.go:724 component=dispatcher receiver=ceph-dashboard integration=webhook[1] msg="Notify attempt failed, will retry later" attempts=5 err="Post \"https://172.21.15.181:8443/api/prometheus_receiver\": dial tcp 172.21.15.181:8443: connect: connection refused" 2024-03-30T13:42:18.605 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:42:18 smithi181 ceph-mon[25762]: from='mgr.14439 ' entity='mgr.y' 2024-03-30T13:42:18.606 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:42:18 smithi181 ceph-mon[25762]: from='mgr.14439 ' entity='mgr.y' 2024-03-30T13:42:18.606 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:42:18 smithi181 ceph-mon[25762]: pgmap v230: 161 pgs: 161 active+clean; 585 KiB data, 67 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T13:42:18.606 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 13:42:18 smithi181 podman[50062]: 2024-03-30 13:42:18.353963493 +0000 UTC m=+0.455461673 container cleanup c3667b1b85f3fd0be7d1d77020a57249328f60d2a05d4f32490050f01a312b9b (image=quay.io/ceph/ceph@sha256:12a0a4f43413fd97a14a3d47a3451b2d2df50020835bb93db666209f3f77617a, name=ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-x, io.k8s.description=The Universal Base Image is designed and engineered to be the base layer for all of your containerized applications, middleware and utilities. This base image is freely redistributable, but Red Hat only supports Red Hat technologies through subscriptions for Red Hat products. This image is maintained by Red Hat and updated regularly., maintainer=Guillaume Abrioux , GIT_COMMIT=b613db0f44179c0940781c1c7fe04e1acb7093ac, distribution-scope=public, io.buildah.version=1.19.8, vcs-ref=f1ee6e37554363ec55e0035aba1a693d3627fdeb, io.openshift.tags=base centos centos-stream, version=8, com.redhat.license_terms=https://centos.org/legal/licensing-policy/, name=centos-stream, GIT_CLEAN=True, build-date=2022-05-03T08:36:31.336870, summary=Provides a CentOS Stream container based on the Red Hat Universal Base Image, description=CentOS Stream is a continuously delivered distro that tracks just ahead of Red Hat Enterprise Linux development. This image takes the Red Hat UBI and layers on content from CentOS Stream, vcs-type=git, architecture=x86_64, com.redhat.component=centos-stream-container, GIT_REPO=https://github.com/ceph/ceph-container.git, ceph=True, vendor=Red Hat, Inc., url=https://access.redhat.com/containers/#/registry.access.redhat.com/ubi8/images/8.6-754, io.k8s.display-name=CentOS Stream 8, com.redhat.build-host=cpt-1002.osbs.prod.upshift.rdu2.redhat.com, GIT_BRANCH=HEAD, RELEASE=HEAD, io.openshift.expose-services=, release=754, CEPH_POINT_RELEASE=-17.2.0) 2024-03-30T13:42:18.606 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 13:42:18 smithi181 bash[50062]: ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-x 2024-03-30T13:42:18.606 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 13:42:18 smithi181 podman[50076]: 2024-03-30 13:42:18.555753903 +0000 UTC m=+0.516764874 container remove c3667b1b85f3fd0be7d1d77020a57249328f60d2a05d4f32490050f01a312b9b (image=quay.io/ceph/ceph@sha256:12a0a4f43413fd97a14a3d47a3451b2d2df50020835bb93db666209f3f77617a, name=ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-x, io.k8s.description=The Universal Base Image is designed and engineered to be the base layer for all of your containerized applications, middleware and utilities. This base image is freely redistributable, but Red Hat only supports Red Hat technologies through subscriptions for Red Hat products. This image is maintained by Red Hat and updated regularly., vcs-type=git, maintainer=Guillaume Abrioux , com.redhat.build-host=cpt-1002.osbs.prod.upshift.rdu2.redhat.com, distribution-scope=public, io.buildah.version=1.19.8, GIT_COMMIT=b613db0f44179c0940781c1c7fe04e1acb7093ac, release=754, version=8, com.redhat.component=centos-stream-container, vcs-ref=f1ee6e37554363ec55e0035aba1a693d3627fdeb, description=CentOS Stream is a continuously delivered distro that tracks just ahead of Red Hat Enterprise Linux development. This image takes the Red Hat UBI and layers on content from CentOS Stream, url=https://access.redhat.com/containers/#/registry.access.redhat.com/ubi8/images/8.6-754, name=centos-stream, com.redhat.license_terms=https://centos.org/legal/licensing-policy/, RELEASE=HEAD, CEPH_POINT_RELEASE=-17.2.0, io.k8s.display-name=CentOS Stream 8, ceph=True, summary=Provides a CentOS Stream container based on the Red Hat Universal Base Image, vendor=Red Hat, Inc., GIT_BRANCH=HEAD, GIT_REPO=https://github.com/ceph/ceph-container.git, architecture=x86_64, GIT_CLEAN=True, io.openshift.expose-services=, build-date=2022-05-03T08:36:31.336870, io.openshift.tags=base centos centos-stream) 2024-03-30T13:42:18.606 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 13:42:18 smithi181 systemd[1]: ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4@mgr.x.service: Main process exited, code=exited, status=143/n/a 2024-03-30T13:42:18.606 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 13:42:18 smithi181 bash[50090]: Error: no container with name or ID "ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr.x" found: no such container 2024-03-30T13:42:19.006 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 13:42:18 smithi181 systemd[1]: ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4@mgr.x.service: Failed with result 'exit-code'. 2024-03-30T13:42:19.007 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 13:42:18 smithi181 systemd[1]: Stopped Ceph mgr.x for 98ebaeb8-ee99-11ee-b647-cb9ed24678a4. 2024-03-30T13:42:19.007 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 13:42:18 smithi181 systemd[1]: ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4@mgr.x.service: Consumed 17.234s CPU time. 2024-03-30T13:42:19.007 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 13:42:18 smithi181 systemd[1]: Starting Ceph mgr.x for 98ebaeb8-ee99-11ee-b647-cb9ed24678a4... 2024-03-30T13:42:19.327 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 13:42:19 smithi181 podman[50196]: 2024-03-30 13:42:18.95609678 +0000 UTC m=+0.018058769 image pull b0c4478f1d83795df4d538bf108aee5fac57194348fb16dcdbb3115f3e2fe95e quay.ceph.io/ceph-ci/ceph:4e50bbcdd1630c7760b708f3a5b4d38a121e66cb 2024-03-30T13:42:19.327 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 13:42:19 smithi181 podman[50196]: 2024-03-30 13:42:19.090237248 +0000 UTC m=+0.152199249 container create f3d971ab3b104661aa80c18cc9630ec1442c388f9776aa016a0530e8746eb85c (image=quay.ceph.io/ceph-ci/ceph:4e50bbcdd1630c7760b708f3a5b4d38a121e66cb, name=ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-x, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.build-date=20240326, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, GIT_CLEAN=True, RELEASE=squid-4e50bbc, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0) 2024-03-30T13:42:19.327 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 13:42:19 smithi181 podman[50196]: 2024-03-30 13:42:19.326094982 +0000 UTC m=+0.388056953 container init f3d971ab3b104661aa80c18cc9630ec1442c388f9776aa016a0530e8746eb85c (image=quay.ceph.io/ceph-ci/ceph:4e50bbcdd1630c7760b708f3a5b4d38a121e66cb, name=ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-x, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.build-date=20240326, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, ceph=True, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, RELEASE=squid-4e50bbc, org.label-schema.schema-version=1.0) 2024-03-30T13:42:19.628 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 13:42:19 smithi181 podman[50196]: 2024-03-30 13:42:19.328967429 +0000 UTC m=+0.390929394 container start f3d971ab3b104661aa80c18cc9630ec1442c388f9776aa016a0530e8746eb85c (image=quay.ceph.io/ceph-ci/ceph:4e50bbcdd1630c7760b708f3a5b4d38a121e66cb, name=ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-x, org.label-schema.build-date=20240326, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, RELEASE=squid-4e50bbc, org.label-schema.license=GPLv2) 2024-03-30T13:42:19.628 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 13:42:19 smithi181 ceph-mgr[50215]: -- 172.21.15.181:0/2360758439 <== mon.2 v2:172.21.15.181:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5571f12c05a0 con 0x5571f1294c00 2024-03-30T13:42:19.628 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 13:42:19 smithi181 bash[50196]: f3d971ab3b104661aa80c18cc9630ec1442c388f9776aa016a0530e8746eb85c 2024-03-30T13:42:19.628 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 13:42:19 smithi181 systemd[1]: Started Ceph mgr.x for 98ebaeb8-ee99-11ee-b647-cb9ed24678a4. 2024-03-30T13:42:20.256 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 13:42:19 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-x[50211]: 2024-03-30T13:42:19.905+0000 7f38ac53b200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-03-30T13:42:20.256 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 13:42:20 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-x[50211]: 2024-03-30T13:42:20.004+0000 7f38ac53b200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-03-30T13:42:20.756 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:42:20 smithi181 ceph-mon[25762]: from='mgr.14439 ' entity='mgr.y' 2024-03-30T13:42:20.756 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:42:20 smithi181 ceph-mon[25762]: from='mgr.14439 ' entity='mgr.y' 2024-03-30T13:42:20.756 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:42:20 smithi181 ceph-mon[25762]: from='mgr.14439 172.21.15.99:0/1757456350' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:42:20.756 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:42:20 smithi181 ceph-mon[25762]: from='mgr.14439 172.21.15.99:0/1757456350' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:42:20.757 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:42:20 smithi181 ceph-mon[25762]: from='mgr.14439 ' entity='mgr.y' 2024-03-30T13:42:20.757 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:42:20 smithi181 ceph-mon[25762]: from='mgr.14439 ' entity='mgr.y' 2024-03-30T13:42:20.757 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:42:20 smithi181 ceph-mon[25762]: pgmap v231: 161 pgs: 161 active+clean; 585 KiB data, 67 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T13:42:20.757 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 13:42:20 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-x[50211]: 2024-03-30T13:42:20.693+0000 7f38ac53b200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-03-30T13:42:20.837 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:42:20 smithi099 ceph-mon[24912]: from='mgr.14439 ' entity='mgr.y' 2024-03-30T13:42:20.837 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:42:20 smithi099 ceph-mon[24912]: from='mgr.14439 ' entity='mgr.y' 2024-03-30T13:42:20.837 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:42:20 smithi099 ceph-mon[24912]: from='mgr.14439 172.21.15.99:0/1757456350' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:42:20.837 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:42:20 smithi099 ceph-mon[24912]: from='mgr.14439 172.21.15.99:0/1757456350' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:42:20.837 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:42:20 smithi099 ceph-mon[24912]: from='mgr.14439 ' entity='mgr.y' 2024-03-30T13:42:20.837 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:42:20 smithi099 ceph-mon[24912]: from='mgr.14439 ' entity='mgr.y' 2024-03-30T13:42:20.838 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:42:20 smithi099 ceph-mon[24912]: pgmap v231: 161 pgs: 161 active+clean; 585 KiB data, 67 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T13:42:20.838 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:42:20 smithi099 ceph-mon[29691]: from='mgr.14439 ' entity='mgr.y' 2024-03-30T13:42:20.838 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:42:20 smithi099 ceph-mon[29691]: from='mgr.14439 ' entity='mgr.y' 2024-03-30T13:42:20.838 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:42:20 smithi099 ceph-mon[29691]: from='mgr.14439 172.21.15.99:0/1757456350' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:42:20.838 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:42:20 smithi099 ceph-mon[29691]: from='mgr.14439 172.21.15.99:0/1757456350' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:42:20.838 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:42:20 smithi099 ceph-mon[29691]: from='mgr.14439 ' entity='mgr.y' 2024-03-30T13:42:20.838 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:42:20 smithi099 ceph-mon[29691]: from='mgr.14439 ' entity='mgr.y' 2024-03-30T13:42:20.838 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:42:20 smithi099 ceph-mon[29691]: pgmap v231: 161 pgs: 161 active+clean; 585 KiB data, 67 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T13:42:21.042 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 13:42:20 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-x[50211]: 2024-03-30T13:42:20.789+0000 7f38ac53b200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-03-30T13:42:21.042 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 13:42:20 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-x[50211]: 2024-03-30T13:42:20.938+0000 7f38ac53b200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-03-30T13:42:21.398 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 13:42:21 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-x[50211]: 2024-03-30T13:42:21.040+0000 7f38ac53b200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-03-30T13:42:21.398 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 13:42:21 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-x[50211]: 2024-03-30T13:42:21.127+0000 7f38ac53b200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-03-30T13:42:21.688 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 13:42:21 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-x[50211]: 2024-03-30T13:42:21.396+0000 7f38ac53b200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-03-30T13:42:21.688 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 13:42:21 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-x[50211]: 2024-03-30T13:42:21.505+0000 7f38ac53b200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-03-30T13:42:21.688 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 13:42:21 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-x[50211]: 2024-03-30T13:42:21.591+0000 7f38ac53b200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-03-30T13:42:21.688 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 13:42:21 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-x[50211]: 2024-03-30T13:42:21.686+0000 7f38ac53b200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-03-30T13:42:22.006 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 13:42:21 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-x[50211]: 2024-03-30T13:42:21.865+0000 7f38ac53b200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-03-30T13:42:22.506 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:42:22 smithi181 ceph-mon[25762]: pgmap v232: 161 pgs: 161 active+clean; 585 KiB data, 67 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T13:42:22.587 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:42:22 smithi099 ceph-mon[24912]: pgmap v232: 161 pgs: 161 active+clean; 585 KiB data, 67 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T13:42:22.587 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:42:22 smithi099 ceph-mon[29691]: pgmap v232: 161 pgs: 161 active+clean; 585 KiB data, 67 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T13:42:23.256 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 13:42:22 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-x[50211]: 2024-03-30T13:42:22.836+0000 7f38ac53b200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-03-30T13:42:23.256 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 13:42:22 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-x[50211]: 2024-03-30T13:42:22.967+0000 7f38ac53b200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-03-30T13:42:23.593 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 13:42:23 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-x[50211]: 2024-03-30T13:42:23.305+0000 7f38ac53b200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-03-30T13:42:23.593 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 13:42:23 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-x[50211]: 2024-03-30T13:42:23.394+0000 7f38ac53b200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-03-30T13:42:23.594 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 13:42:23 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-x[50211]: 2024-03-30T13:42:23.592+0000 7f38ac53b200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-03-30T13:42:23.837 INFO:journalctl@ceph.alertmanager.a.smithi099.stdout:Mar 30 13:42:23 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-alertmanager-a[52107]: level=error ts=2024-03-30T13:42:23.519Z caller=dispatch.go:354 component=dispatcher msg="Notify for alerts failed" num_alerts=3 err="ceph-dashboard/webhook[1]: notify retry canceled after 7 attempts: Post \"https://172.21.15.181:8443/api/prometheus_receiver\": dial tcp 172.21.15.181:8443: connect: connection refused; ceph-dashboard/webhook[0]: notify retry canceled after 8 attempts: Post \"https://172.21.15.99:8443//api/prometheus_receiver\": x509: cannot validate certificate for 172.21.15.99 because it doesn't contain any IP SANs" 2024-03-30T13:42:23.837 INFO:journalctl@ceph.alertmanager.a.smithi099.stdout:Mar 30 13:42:23 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-alertmanager-a[52107]: level=warn ts=2024-03-30T13:42:23.520Z caller=notify.go:724 component=dispatcher receiver=ceph-dashboard integration=webhook[1] msg="Notify attempt failed, will retry later" attempts=1 err="Post \"https://172.21.15.181:8443/api/prometheus_receiver\": dial tcp 172.21.15.181:8443: connect: connection refused" 2024-03-30T13:42:23.837 INFO:journalctl@ceph.alertmanager.a.smithi099.stdout:Mar 30 13:42:23 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-alertmanager-a[52107]: level=warn ts=2024-03-30T13:42:23.521Z caller=notify.go:724 component=dispatcher receiver=ceph-dashboard integration=webhook[0] msg="Notify attempt failed, will retry later" attempts=1 err="Post \"https://172.21.15.99:8443//api/prometheus_receiver\": x509: cannot validate certificate for 172.21.15.99 because it doesn't contain any IP SANs" 2024-03-30T13:42:24.006 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 13:42:23 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-x[50211]: 2024-03-30T13:42:23.779+0000 7f38ac53b200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-03-30T13:42:24.333 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 13:42:24 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-x[50211]: 2024-03-30T13:42:24.069+0000 7f38ac53b200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-03-30T13:42:24.333 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 13:42:24 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-x[50211]: 2024-03-30T13:42:24.331+0000 7f38ac53b200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-03-30T13:42:24.634 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 13:42:24 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-x[50211]: 2024-03-30T13:42:24.570+0000 7f38ac53b200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-03-30T13:42:25.006 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:42:24 smithi181 ceph-mon[25762]: pgmap v233: 161 pgs: 161 active+clean; 585 KiB data, 67 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T13:42:25.087 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:42:24 smithi099 ceph-mon[24912]: pgmap v233: 161 pgs: 161 active+clean; 585 KiB data, 67 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T13:42:25.087 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:42:24 smithi099 ceph-mon[29691]: pgmap v233: 161 pgs: 161 active+clean; 585 KiB data, 67 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T13:42:25.636 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 13:42:25 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-x[50211]: 2024-03-30T13:42:25.383+0000 7f38ac53b200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-03-30T13:42:25.961 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:42:25 smithi181 ceph-mon[25762]: from='client.14838 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T13:42:26.087 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:42:25 smithi099 ceph-mon[24912]: from='client.14838 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T13:42:26.087 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:42:25 smithi099 ceph-mon[29691]: from='client.14838 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T13:42:26.256 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 13:42:25 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-x[50211]: 2024-03-30T13:42:25.959+0000 7f38ac53b200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-03-30T13:42:26.256 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 13:42:26 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-x[50211]: 2024-03-30T13:42:26.061+0000 7f38ac53b200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-03-30T13:42:26.644 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 13:42:26 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-x[50211]: 2024-03-30T13:42:26.283+0000 7f38ac53b200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-03-30T13:42:26.644 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 13:42:26 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-x[50211]: [30/Mar/2024:13:42:26] ENGINE Bus STARTING 2024-03-30T13:42:26.644 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 13:42:26 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-x[50211]: CherryPy Checker: 2024-03-30T13:42:26.644 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 13:42:26 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-x[50211]: The Application mounted at '' has an empty config. 2024-03-30T13:42:26.644 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 13:42:26 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-x[50211]: 2024-03-30T13:42:26.644 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 13:42:26 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-x[50211]: [30/Mar/2024:13:42:26] ENGINE Serving on http://:::9283 2024-03-30T13:42:26.644 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 13:42:26 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-x[50211]: [30/Mar/2024:13:42:26] ENGINE Bus STARTED 2024-03-30T13:42:27.006 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:42:26 smithi181 ceph-mon[25762]: pgmap v234: 161 pgs: 161 active+clean; 585 KiB data, 67 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T13:42:27.006 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:42:26 smithi181 ceph-mon[25762]: Standby manager daemon x restarted 2024-03-30T13:42:27.006 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:42:26 smithi181 ceph-mon[25762]: Standby manager daemon x started 2024-03-30T13:42:27.006 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:42:26 smithi181 ceph-mon[25762]: from='mgr.? 172.21.15.181:0/2892154077' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/crt"}]: dispatch 2024-03-30T13:42:27.006 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:42:26 smithi181 ceph-mon[25762]: from='mgr.? 172.21.15.181:0/2892154077' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-03-30T13:42:27.006 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:42:26 smithi181 ceph-mon[25762]: from='mgr.? 172.21.15.181:0/2892154077' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/key"}]: dispatch 2024-03-30T13:42:27.006 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:42:26 smithi181 ceph-mon[25762]: from='mgr.? 172.21.15.181:0/2892154077' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-03-30T13:42:27.087 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:42:26 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[25141]: ::ffff:172.21.15.181 - - [30/Mar/2024:13:42:26] "GET /metrics HTTP/1.1" 200 208032 "" "Prometheus/2.33.4" 2024-03-30T13:42:27.087 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:42:26 smithi099 ceph-mon[24912]: pgmap v234: 161 pgs: 161 active+clean; 585 KiB data, 67 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T13:42:27.087 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:42:26 smithi099 ceph-mon[24912]: Standby manager daemon x restarted 2024-03-30T13:42:27.087 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:42:26 smithi099 ceph-mon[24912]: Standby manager daemon x started 2024-03-30T13:42:27.087 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:42:26 smithi099 ceph-mon[24912]: from='mgr.? 172.21.15.181:0/2892154077' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/crt"}]: dispatch 2024-03-30T13:42:27.088 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:42:26 smithi099 ceph-mon[24912]: from='mgr.? 172.21.15.181:0/2892154077' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-03-30T13:42:27.088 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:42:26 smithi099 ceph-mon[24912]: from='mgr.? 172.21.15.181:0/2892154077' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/key"}]: dispatch 2024-03-30T13:42:27.088 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:42:26 smithi099 ceph-mon[24912]: from='mgr.? 172.21.15.181:0/2892154077' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-03-30T13:42:27.088 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:42:26 smithi099 ceph-mon[29691]: pgmap v234: 161 pgs: 161 active+clean; 585 KiB data, 67 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T13:42:27.088 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:42:26 smithi099 ceph-mon[29691]: Standby manager daemon x restarted 2024-03-30T13:42:27.088 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:42:26 smithi099 ceph-mon[29691]: Standby manager daemon x started 2024-03-30T13:42:27.088 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:42:26 smithi099 ceph-mon[29691]: from='mgr.? 172.21.15.181:0/2892154077' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/crt"}]: dispatch 2024-03-30T13:42:27.088 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:42:26 smithi099 ceph-mon[29691]: from='mgr.? 172.21.15.181:0/2892154077' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-03-30T13:42:27.088 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:42:26 smithi099 ceph-mon[29691]: from='mgr.? 172.21.15.181:0/2892154077' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/key"}]: dispatch 2024-03-30T13:42:27.088 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:42:26 smithi099 ceph-mon[29691]: from='mgr.? 172.21.15.181:0/2892154077' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-03-30T13:42:27.837 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:42:27 smithi099 ceph-mon[24912]: mgrmap e21: y(active, since 6m), standbys: x 2024-03-30T13:42:27.837 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:42:27 smithi099 ceph-mon[29691]: mgrmap e21: y(active, since 6m), standbys: x 2024-03-30T13:42:27.837 INFO:journalctl@ceph.alertmanager.a.smithi099.stdout:Mar 30 13:42:27 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-alertmanager-a[52107]: level=warn ts=2024-03-30T13:42:27.465Z caller=notify.go:724 component=dispatcher receiver=ceph-dashboard integration=webhook[1] msg="Notify attempt failed, will retry later" attempts=5 err="Post \"https://172.21.15.181:8443/api/prometheus_receiver\": x509: cannot validate certificate for 172.21.15.181 because it doesn't contain any IP SANs" 2024-03-30T13:42:28.006 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:42:27 smithi181 ceph-mon[25762]: mgrmap e21: y(active, since 6m), standbys: x 2024-03-30T13:42:28.173 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:42:27 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[25141]: 172.21.15.99 - - [30/Mar/2024:13:42:27] "POST /data HTTP/1.1" 200 46 "" "Python-urllib/3.9" 2024-03-30T13:42:29.189 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:42:28 smithi099 ceph-mon[29691]: from='mgr.14439 ' entity='mgr.y' 2024-03-30T13:42:29.189 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:42:28 smithi099 ceph-mon[29691]: from='mgr.14439 ' entity='mgr.y' 2024-03-30T13:42:29.189 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:42:28 smithi099 ceph-mon[29691]: pgmap v235: 161 pgs: 161 active+clean; 585 KiB data, 67 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T13:42:29.189 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:42:28 smithi099 ceph-mon[24912]: from='mgr.14439 ' entity='mgr.y' 2024-03-30T13:42:29.189 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:42:28 smithi099 ceph-mon[24912]: from='mgr.14439 ' entity='mgr.y' 2024-03-30T13:42:29.189 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:42:28 smithi099 ceph-mon[24912]: pgmap v235: 161 pgs: 161 active+clean; 585 KiB data, 67 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T13:42:29.256 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:42:28 smithi181 ceph-mon[25762]: from='mgr.14439 ' entity='mgr.y' 2024-03-30T13:42:29.256 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:42:28 smithi181 ceph-mon[25762]: from='mgr.14439 ' entity='mgr.y' 2024-03-30T13:42:29.256 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:42:28 smithi181 ceph-mon[25762]: pgmap v235: 161 pgs: 161 active+clean; 585 KiB data, 67 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T13:42:29.756 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 13:42:29 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-x[50211]: ::ffff:172.21.15.181 - - [30/Mar/2024:13:42:29] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-03-30T13:42:30.506 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:42:30 smithi181 ceph-mon[25762]: pgmap v236: 161 pgs: 161 active+clean; 585 KiB data, 67 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T13:42:30.587 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:42:30 smithi099 ceph-mon[24912]: pgmap v236: 161 pgs: 161 active+clean; 585 KiB data, 67 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T13:42:30.587 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:42:30 smithi099 ceph-mon[29691]: pgmap v236: 161 pgs: 161 active+clean; 585 KiB data, 67 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T13:42:32.411 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:42:32 smithi181 ceph-mon[25762]: pgmap v237: 161 pgs: 161 active+clean; 585 KiB data, 67 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T13:42:32.587 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:42:32 smithi099 ceph-mon[24912]: pgmap v237: 161 pgs: 161 active+clean; 585 KiB data, 67 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T13:42:32.587 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:42:32 smithi099 ceph-mon[29691]: pgmap v237: 161 pgs: 161 active+clean; 585 KiB data, 67 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T13:42:33.837 INFO:journalctl@ceph.alertmanager.a.smithi099.stdout:Mar 30 13:42:33 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-alertmanager-a[52107]: level=error ts=2024-03-30T13:42:33.521Z caller=dispatch.go:354 component=dispatcher msg="Notify for alerts failed" num_alerts=3 err="ceph-dashboard/webhook[0]: notify retry canceled after 7 attempts: Post \"https://172.21.15.99:8443//api/prometheus_receiver\": x509: cannot validate certificate for 172.21.15.99 because it doesn't contain any IP SANs; ceph-dashboard/webhook[1]: notify retry canceled after 8 attempts: Post \"https://172.21.15.181:8443/api/prometheus_receiver\": x509: cannot validate certificate for 172.21.15.181 because it doesn't contain any IP SANs" 2024-03-30T13:42:33.837 INFO:journalctl@ceph.alertmanager.a.smithi099.stdout:Mar 30 13:42:33 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-alertmanager-a[52107]: level=warn ts=2024-03-30T13:42:33.522Z caller=notify.go:724 component=dispatcher receiver=ceph-dashboard integration=webhook[0] msg="Notify attempt failed, will retry later" attempts=1 err="Post \"https://172.21.15.99:8443//api/prometheus_receiver\": x509: cannot validate certificate for 172.21.15.99 because it doesn't contain any IP SANs" 2024-03-30T13:42:33.837 INFO:journalctl@ceph.alertmanager.a.smithi099.stdout:Mar 30 13:42:33 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-alertmanager-a[52107]: level=warn ts=2024-03-30T13:42:33.522Z caller=notify.go:724 component=dispatcher receiver=ceph-dashboard integration=webhook[1] msg="Notify attempt failed, will retry later" attempts=1 err="Post \"https://172.21.15.181:8443/api/prometheus_receiver\": x509: cannot validate certificate for 172.21.15.181 because it doesn't contain any IP SANs" 2024-03-30T13:42:34.778 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:42:34 smithi181 ceph-mon[25762]: pgmap v238: 161 pgs: 161 active+clean; 585 KiB data, 67 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T13:42:34.837 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:42:34 smithi099 ceph-mon[24912]: pgmap v238: 161 pgs: 161 active+clean; 585 KiB data, 67 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T13:42:34.837 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:42:34 smithi099 ceph-mon[29691]: pgmap v238: 161 pgs: 161 active+clean; 585 KiB data, 67 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T13:42:35.756 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:42:35 smithi181 ceph-mon[25762]: from='client.14838 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T13:42:36.087 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:42:35 smithi099 ceph-mon[24912]: from='client.14838 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T13:42:36.087 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:42:35 smithi099 ceph-mon[29691]: from='client.14838 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T13:42:37.006 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:42:36 smithi181 ceph-mon[25762]: pgmap v239: 161 pgs: 161 active+clean; 585 KiB data, 67 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T13:42:37.087 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:42:36 smithi099 ceph-mon[24912]: pgmap v239: 161 pgs: 161 active+clean; 585 KiB data, 67 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T13:42:37.087 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:42:36 smithi099 ceph-mon[29691]: pgmap v239: 161 pgs: 161 active+clean; 585 KiB data, 67 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T13:42:37.087 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:42:36 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[25141]: ::ffff:172.21.15.181 - - [30/Mar/2024:13:42:36] "GET /metrics HTTP/1.1" 200 208037 "" "Prometheus/2.33.4" 2024-03-30T13:42:37.837 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:42:37 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[25141]: 172.21.15.181 - - [30/Mar/2024:13:42:37] "POST /data HTTP/1.1" 200 46 "" "Python-urllib/3.9" 2024-03-30T13:42:38.756 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:42:38 smithi181 ceph-mon[25762]: from='mgr.14439 ' entity='mgr.y' 2024-03-30T13:42:38.756 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:42:38 smithi181 ceph-mon[25762]: from='mgr.14439 ' entity='mgr.y' 2024-03-30T13:42:38.756 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:42:38 smithi181 ceph-mon[25762]: pgmap v240: 161 pgs: 161 active+clean; 585 KiB data, 67 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T13:42:38.837 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:42:38 smithi099 ceph-mon[24912]: from='mgr.14439 ' entity='mgr.y' 2024-03-30T13:42:38.837 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:42:38 smithi099 ceph-mon[24912]: from='mgr.14439 ' entity='mgr.y' 2024-03-30T13:42:38.837 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:42:38 smithi099 ceph-mon[24912]: pgmap v240: 161 pgs: 161 active+clean; 585 KiB data, 67 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T13:42:38.838 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:42:38 smithi099 ceph-mon[29691]: from='mgr.14439 ' entity='mgr.y' 2024-03-30T13:42:38.838 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:42:38 smithi099 ceph-mon[29691]: from='mgr.14439 ' entity='mgr.y' 2024-03-30T13:42:38.838 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:42:38 smithi099 ceph-mon[29691]: pgmap v240: 161 pgs: 161 active+clean; 585 KiB data, 67 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T13:42:39.756 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 13:42:39 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-x[50211]: ::ffff:172.21.15.181 - - [30/Mar/2024:13:42:39] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-03-30T13:42:40.506 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:42:40 smithi181 ceph-mon[25762]: pgmap v241: 161 pgs: 161 active+clean; 585 KiB data, 67 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T13:42:40.587 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:42:40 smithi099 ceph-mon[24912]: pgmap v241: 161 pgs: 161 active+clean; 585 KiB data, 67 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T13:42:40.587 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:42:40 smithi099 ceph-mon[29691]: pgmap v241: 161 pgs: 161 active+clean; 585 KiB data, 67 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T13:42:42.506 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:42:42 smithi181 ceph-mon[25762]: pgmap v242: 161 pgs: 161 active+clean; 585 KiB data, 67 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T13:42:42.587 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:42:42 smithi099 ceph-mon[24912]: pgmap v242: 161 pgs: 161 active+clean; 585 KiB data, 67 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T13:42:42.587 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:42:42 smithi099 ceph-mon[29691]: pgmap v242: 161 pgs: 161 active+clean; 585 KiB data, 67 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T13:42:43.837 INFO:journalctl@ceph.alertmanager.a.smithi099.stdout:Mar 30 13:42:43 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-alertmanager-a[52107]: level=error ts=2024-03-30T13:42:43.522Z caller=dispatch.go:354 component=dispatcher msg="Notify for alerts failed" num_alerts=3 err="ceph-dashboard/webhook[0]: notify retry canceled after 8 attempts: Post \"https://172.21.15.99:8443//api/prometheus_receiver\": x509: cannot validate certificate for 172.21.15.99 because it doesn't contain any IP SANs; ceph-dashboard/webhook[1]: notify retry canceled after 7 attempts: Post \"https://172.21.15.181:8443/api/prometheus_receiver\": x509: cannot validate certificate for 172.21.15.181 because it doesn't contain any IP SANs" 2024-03-30T13:42:43.837 INFO:journalctl@ceph.alertmanager.a.smithi099.stdout:Mar 30 13:42:43 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-alertmanager-a[52107]: level=warn ts=2024-03-30T13:42:43.523Z caller=notify.go:724 component=dispatcher receiver=ceph-dashboard integration=webhook[0] msg="Notify attempt failed, will retry later" attempts=1 err="Post \"https://172.21.15.99:8443//api/prometheus_receiver\": x509: cannot validate certificate for 172.21.15.99 because it doesn't contain any IP SANs" 2024-03-30T13:42:43.837 INFO:journalctl@ceph.alertmanager.a.smithi099.stdout:Mar 30 13:42:43 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-alertmanager-a[52107]: level=warn ts=2024-03-30T13:42:43.524Z caller=notify.go:724 component=dispatcher receiver=ceph-dashboard integration=webhook[1] msg="Notify attempt failed, will retry later" attempts=1 err="Post \"https://172.21.15.181:8443/api/prometheus_receiver\": x509: cannot validate certificate for 172.21.15.181 because it doesn't contain any IP SANs" 2024-03-30T13:42:44.837 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:42:44 smithi099 ceph-mon[24912]: pgmap v243: 161 pgs: 161 active+clean; 585 KiB data, 67 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T13:42:44.837 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:42:44 smithi099 ceph-mon[29691]: pgmap v243: 161 pgs: 161 active+clean; 585 KiB data, 67 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T13:42:45.006 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:42:44 smithi181 ceph-mon[25762]: pgmap v243: 161 pgs: 161 active+clean; 585 KiB data, 67 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T13:42:46.006 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:42:45 smithi181 ceph-mon[25762]: from='client.14838 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T13:42:46.087 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:42:45 smithi099 ceph-mon[24912]: from='client.14838 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T13:42:46.087 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:42:45 smithi099 ceph-mon[29691]: from='client.14838 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T13:42:46.756 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:42:46 smithi181 ceph-mon[25762]: pgmap v244: 161 pgs: 161 active+clean; 585 KiB data, 67 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T13:42:47.087 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:42:46 smithi099 ceph-mon[29691]: pgmap v244: 161 pgs: 161 active+clean; 585 KiB data, 67 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T13:42:47.087 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:42:46 smithi099 ceph-mon[24912]: pgmap v244: 161 pgs: 161 active+clean; 585 KiB data, 67 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T13:42:47.087 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:42:46 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[25141]: ::ffff:172.21.15.181 - - [30/Mar/2024:13:42:46] "GET /metrics HTTP/1.1" 200 208046 "" "Prometheus/2.33.4" 2024-03-30T13:42:48.337 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:42:47 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[25141]: 172.21.15.99 - - [30/Mar/2024:13:42:47] "POST /data HTTP/1.1" 200 46 "" "Python-urllib/3.9" 2024-03-30T13:42:49.232 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:42:48 smithi181 ceph-mon[25762]: from='mgr.14439 ' entity='mgr.y' 2024-03-30T13:42:49.233 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:42:48 smithi181 ceph-mon[25762]: from='mgr.14439 ' entity='mgr.y' 2024-03-30T13:42:49.233 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:42:48 smithi181 ceph-mon[25762]: pgmap v245: 161 pgs: 161 active+clean; 585 KiB data, 67 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T13:42:49.239 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:42:49 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[25141]: 172.21.15.181 - - [30/Mar/2024:13:42:49] "POST /data HTTP/1.1" 200 46 "" "Python-urllib/3.9" 2024-03-30T13:42:49.239 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:42:48 smithi099 ceph-mon[29691]: from='mgr.14439 ' entity='mgr.y' 2024-03-30T13:42:49.239 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:42:48 smithi099 ceph-mon[29691]: from='mgr.14439 ' entity='mgr.y' 2024-03-30T13:42:49.239 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:42:48 smithi099 ceph-mon[29691]: pgmap v245: 161 pgs: 161 active+clean; 585 KiB data, 67 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T13:42:49.239 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:42:48 smithi099 ceph-mon[24912]: from='mgr.14439 ' entity='mgr.y' 2024-03-30T13:42:49.239 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:42:48 smithi099 ceph-mon[24912]: from='mgr.14439 ' entity='mgr.y' 2024-03-30T13:42:49.239 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:42:48 smithi099 ceph-mon[24912]: pgmap v245: 161 pgs: 161 active+clean; 585 KiB data, 67 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T13:42:49.506 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 13:42:49 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-x[50211]: ::ffff:172.21.15.181 - - [30/Mar/2024:13:42:49] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-03-30T13:42:50.440 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:42:50 smithi099 ceph-mon[29691]: from='mgr.14439 ' entity='mgr.y' 2024-03-30T13:42:50.440 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:42:50 smithi099 ceph-mon[29691]: from='mgr.14439 ' entity='mgr.y' 2024-03-30T13:42:50.440 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:42:50 smithi099 ceph-mon[29691]: pgmap v246: 161 pgs: 161 active+clean; 585 KiB data, 67 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T13:42:50.441 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:42:50 smithi099 ceph-mon[24912]: from='mgr.14439 ' entity='mgr.y' 2024-03-30T13:42:50.441 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:42:50 smithi099 ceph-mon[24912]: from='mgr.14439 ' entity='mgr.y' 2024-03-30T13:42:50.441 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:42:50 smithi099 ceph-mon[24912]: pgmap v246: 161 pgs: 161 active+clean; 585 KiB data, 67 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T13:42:50.506 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:42:50 smithi181 ceph-mon[25762]: from='mgr.14439 ' entity='mgr.y' 2024-03-30T13:42:50.506 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:42:50 smithi181 ceph-mon[25762]: from='mgr.14439 ' entity='mgr.y' 2024-03-30T13:42:50.506 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:42:50 smithi181 ceph-mon[25762]: pgmap v246: 161 pgs: 161 active+clean; 585 KiB data, 67 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T13:42:52.337 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:42:52 smithi099 ceph-mon[24912]: pgmap v247: 161 pgs: 161 active+clean; 585 KiB data, 67 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T13:42:52.337 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:42:52 smithi099 ceph-mon[29691]: pgmap v247: 161 pgs: 161 active+clean; 585 KiB data, 67 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T13:42:52.506 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:42:52 smithi181 ceph-mon[25762]: pgmap v247: 161 pgs: 161 active+clean; 585 KiB data, 67 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T13:42:53.837 INFO:journalctl@ceph.alertmanager.a.smithi099.stdout:Mar 30 13:42:53 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-alertmanager-a[52107]: level=error ts=2024-03-30T13:42:53.523Z caller=dispatch.go:354 component=dispatcher msg="Notify for alerts failed" num_alerts=3 err="ceph-dashboard/webhook[0]: notify retry canceled after 8 attempts: Post \"https://172.21.15.99:8443//api/prometheus_receiver\": x509: cannot validate certificate for 172.21.15.99 because it doesn't contain any IP SANs; ceph-dashboard/webhook[1]: notify retry canceled after 7 attempts: Post \"https://172.21.15.181:8443/api/prometheus_receiver\": x509: cannot validate certificate for 172.21.15.181 because it doesn't contain any IP SANs" 2024-03-30T13:42:53.837 INFO:journalctl@ceph.alertmanager.a.smithi099.stdout:Mar 30 13:42:53 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-alertmanager-a[52107]: level=warn ts=2024-03-30T13:42:53.524Z caller=notify.go:724 component=dispatcher receiver=ceph-dashboard integration=webhook[0] msg="Notify attempt failed, will retry later" attempts=1 err="Post \"https://172.21.15.99:8443//api/prometheus_receiver\": x509: cannot validate certificate for 172.21.15.99 because it doesn't contain any IP SANs" 2024-03-30T13:42:53.838 INFO:journalctl@ceph.alertmanager.a.smithi099.stdout:Mar 30 13:42:53 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-alertmanager-a[52107]: level=warn ts=2024-03-30T13:42:53.525Z caller=notify.go:724 component=dispatcher receiver=ceph-dashboard integration=webhook[1] msg="Notify attempt failed, will retry later" attempts=1 err="Post \"https://172.21.15.181:8443/api/prometheus_receiver\": x509: cannot validate certificate for 172.21.15.181 because it doesn't contain any IP SANs" 2024-03-30T13:42:55.006 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:42:54 smithi181 ceph-mon[25762]: pgmap v248: 161 pgs: 161 active+clean; 585 KiB data, 67 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T13:42:55.087 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:42:54 smithi099 ceph-mon[29691]: pgmap v248: 161 pgs: 161 active+clean; 585 KiB data, 67 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T13:42:55.087 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:42:54 smithi099 ceph-mon[24912]: pgmap v248: 161 pgs: 161 active+clean; 585 KiB data, 67 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T13:42:56.006 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:42:55 smithi181 ceph-mon[25762]: from='client.14838 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T13:42:56.087 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:42:55 smithi099 ceph-mon[24912]: from='client.14838 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T13:42:56.087 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:42:55 smithi099 ceph-mon[29691]: from='client.14838 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T13:42:57.006 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:42:56 smithi181 ceph-mon[25762]: pgmap v249: 161 pgs: 161 active+clean; 585 KiB data, 67 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T13:42:57.087 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:42:56 smithi099 ceph-mon[29691]: pgmap v249: 161 pgs: 161 active+clean; 585 KiB data, 67 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T13:42:57.087 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:42:56 smithi099 ceph-mon[24912]: pgmap v249: 161 pgs: 161 active+clean; 585 KiB data, 67 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T13:42:57.087 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:42:56 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[25141]: ::ffff:172.21.15.181 - - [30/Mar/2024:13:42:56] "GET /metrics HTTP/1.1" 200 208046 "" "Prometheus/2.33.4" 2024-03-30T13:42:58.506 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:42:58 smithi181 ceph-mon[25762]: pgmap v250: 161 pgs: 161 active+clean; 585 KiB data, 67 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T13:42:58.587 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:42:58 smithi099 ceph-mon[29691]: pgmap v250: 161 pgs: 161 active+clean; 585 KiB data, 67 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T13:42:58.587 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:42:58 smithi099 ceph-mon[24912]: pgmap v250: 161 pgs: 161 active+clean; 585 KiB data, 67 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T13:42:59.725 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 13:42:59 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-x[50211]: ::ffff:172.21.15.181 - - [30/Mar/2024:13:42:59] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-03-30T13:43:00.006 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:42:59 smithi181 ceph-mon[25762]: from='mgr.14439 172.21.15.99:0/1757456350' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-03-30T13:43:00.006 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:42:59 smithi181 ceph-mon[25762]: from='mgr.14439 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-03-30T13:43:00.006 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:42:59 smithi181 ceph-mon[25762]: from='mgr.14439 172.21.15.99:0/1757456350' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-03-30T13:43:00.006 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:42:59 smithi181 ceph-mon[25762]: from='mgr.14439 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-03-30T13:43:00.087 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:42:59 smithi099 ceph-mon[24912]: from='mgr.14439 172.21.15.99:0/1757456350' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-03-30T13:43:00.087 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:42:59 smithi099 ceph-mon[24912]: from='mgr.14439 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-03-30T13:43:00.087 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:42:59 smithi099 ceph-mon[24912]: from='mgr.14439 172.21.15.99:0/1757456350' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-03-30T13:43:00.087 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:42:59 smithi099 ceph-mon[24912]: from='mgr.14439 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-03-30T13:43:00.087 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:42:59 smithi099 ceph-mon[29691]: from='mgr.14439 172.21.15.99:0/1757456350' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-03-30T13:43:00.087 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:42:59 smithi099 ceph-mon[29691]: from='mgr.14439 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-03-30T13:43:00.088 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:42:59 smithi099 ceph-mon[29691]: from='mgr.14439 172.21.15.99:0/1757456350' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-03-30T13:43:00.088 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:42:59 smithi099 ceph-mon[29691]: from='mgr.14439 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-03-30T13:43:02.006 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:43:01 smithi181 ceph-mon[25762]: pgmap v251: 161 pgs: 161 active+clean; 585 KiB data, 67 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T13:43:02.087 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:43:01 smithi099 ceph-mon[24912]: pgmap v251: 161 pgs: 161 active+clean; 585 KiB data, 67 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T13:43:02.087 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:43:01 smithi099 ceph-mon[29691]: pgmap v251: 161 pgs: 161 active+clean; 585 KiB data, 67 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T13:43:03.837 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:43:03 smithi099 ceph-mon[29691]: pgmap v252: 161 pgs: 161 active+clean; 585 KiB data, 67 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T13:43:03.837 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:43:03 smithi099 ceph-mon[24912]: pgmap v252: 161 pgs: 161 active+clean; 585 KiB data, 67 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T13:43:03.837 INFO:journalctl@ceph.alertmanager.a.smithi099.stdout:Mar 30 13:43:03 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-alertmanager-a[52107]: level=error ts=2024-03-30T13:43:03.523Z caller=dispatch.go:354 component=dispatcher msg="Notify for alerts failed" num_alerts=3 err="ceph-dashboard/webhook[0]: notify retry canceled after 7 attempts: Post \"https://172.21.15.99:8443//api/prometheus_receiver\": x509: cannot validate certificate for 172.21.15.99 because it doesn't contain any IP SANs; ceph-dashboard/webhook[1]: notify retry canceled after 7 attempts: Post \"https://172.21.15.181:8443/api/prometheus_receiver\": x509: cannot validate certificate for 172.21.15.181 because it doesn't contain any IP SANs" 2024-03-30T13:43:03.837 INFO:journalctl@ceph.alertmanager.a.smithi099.stdout:Mar 30 13:43:03 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-alertmanager-a[52107]: level=warn ts=2024-03-30T13:43:03.525Z caller=notify.go:724 component=dispatcher receiver=ceph-dashboard integration=webhook[0] msg="Notify attempt failed, will retry later" attempts=1 err="Post \"https://172.21.15.99:8443//api/prometheus_receiver\": x509: cannot validate certificate for 172.21.15.99 because it doesn't contain any IP SANs" 2024-03-30T13:43:03.837 INFO:journalctl@ceph.alertmanager.a.smithi099.stdout:Mar 30 13:43:03 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-alertmanager-a[52107]: level=warn ts=2024-03-30T13:43:03.526Z caller=notify.go:724 component=dispatcher receiver=ceph-dashboard integration=webhook[1] msg="Notify attempt failed, will retry later" attempts=1 err="Post \"https://172.21.15.181:8443/api/prometheus_receiver\": x509: cannot validate certificate for 172.21.15.181 because it doesn't contain any IP SANs" 2024-03-30T13:43:03.856 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:43:03 smithi181 ceph-mon[25762]: pgmap v252: 161 pgs: 161 active+clean; 585 KiB data, 67 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T13:43:04.837 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:43:04 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[25141]: 172.21.15.181 - - [30/Mar/2024:13:43:04] "POST /data HTTP/1.1" 200 46 "" "Python-urllib/3.9" 2024-03-30T13:43:05.756 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:43:05 smithi181 ceph-mon[25762]: pgmap v253: 161 pgs: 161 active+clean; 585 KiB data, 67 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T13:43:05.756 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:43:05 smithi181 ceph-mon[25762]: from='mgr.14439 ' entity='mgr.y' 2024-03-30T13:43:05.756 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:43:05 smithi181 ceph-mon[25762]: from='mgr.14439 ' entity='mgr.y' 2024-03-30T13:43:05.756 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:43:05 smithi181 ceph-mon[25762]: from='client.14838 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T13:43:05.837 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:43:05 smithi099 ceph-mon[24912]: pgmap v253: 161 pgs: 161 active+clean; 585 KiB data, 67 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T13:43:05.837 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:43:05 smithi099 ceph-mon[24912]: from='mgr.14439 ' entity='mgr.y' 2024-03-30T13:43:05.837 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:43:05 smithi099 ceph-mon[24912]: from='mgr.14439 ' entity='mgr.y' 2024-03-30T13:43:05.837 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:43:05 smithi099 ceph-mon[24912]: from='client.14838 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T13:43:05.837 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:43:05 smithi099 ceph-mon[29691]: pgmap v253: 161 pgs: 161 active+clean; 585 KiB data, 67 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T13:43:05.837 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:43:05 smithi099 ceph-mon[29691]: from='mgr.14439 ' entity='mgr.y' 2024-03-30T13:43:05.837 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:43:05 smithi099 ceph-mon[29691]: from='mgr.14439 ' entity='mgr.y' 2024-03-30T13:43:05.837 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:43:05 smithi099 ceph-mon[29691]: from='client.14838 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T13:43:07.087 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:43:06 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[25141]: ::ffff:172.21.15.181 - - [30/Mar/2024:13:43:06] "GET /metrics HTTP/1.1" 200 208044 "" "Prometheus/2.33.4" 2024-03-30T13:43:07.756 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:43:07 smithi181 ceph-mon[25762]: pgmap v254: 161 pgs: 161 active+clean; 585 KiB data, 67 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T13:43:07.837 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:43:07 smithi099 ceph-mon[24912]: pgmap v254: 161 pgs: 161 active+clean; 585 KiB data, 67 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T13:43:07.837 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:43:07 smithi099 ceph-mon[29691]: pgmap v254: 161 pgs: 161 active+clean; 585 KiB data, 67 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T13:43:08.587 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:43:08 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[25141]: 172.21.15.99 - - [30/Mar/2024:13:43:08] "POST /data HTTP/1.1" 200 46 "" "Python-urllib/3.9" 2024-03-30T13:43:09.337 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:43:09 smithi099 ceph-mon[24912]: from='mgr.14439 ' entity='mgr.y' 2024-03-30T13:43:09.337 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:43:09 smithi099 ceph-mon[24912]: from='mgr.14439 ' entity='mgr.y' 2024-03-30T13:43:09.337 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:43:09 smithi099 ceph-mon[29691]: from='mgr.14439 ' entity='mgr.y' 2024-03-30T13:43:09.337 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:43:09 smithi099 ceph-mon[29691]: from='mgr.14439 ' entity='mgr.y' 2024-03-30T13:43:09.462 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:43:09 smithi181 ceph-mon[25762]: from='mgr.14439 ' entity='mgr.y' 2024-03-30T13:43:09.462 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:43:09 smithi181 ceph-mon[25762]: from='mgr.14439 ' entity='mgr.y' 2024-03-30T13:43:09.756 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 13:43:09 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-x[50211]: ::ffff:172.21.15.181 - - [30/Mar/2024:13:43:09] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-03-30T13:43:10.382 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:43:10 smithi099 ceph-mon[29691]: pgmap v255: 161 pgs: 161 active+clean; 585 KiB data, 67 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T13:43:10.382 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:43:10 smithi099 ceph-mon[24912]: pgmap v255: 161 pgs: 161 active+clean; 585 KiB data, 67 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T13:43:10.506 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:43:10 smithi181 ceph-mon[25762]: pgmap v255: 161 pgs: 161 active+clean; 585 KiB data, 67 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T13:43:11.443 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:43:11 smithi099 ceph-mon[24912]: pgmap v256: 161 pgs: 161 active+clean; 585 KiB data, 67 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T13:43:11.443 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:43:11 smithi099 ceph-mon[29691]: pgmap v256: 161 pgs: 161 active+clean; 585 KiB data, 67 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T13:43:11.506 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:43:11 smithi181 ceph-mon[25762]: pgmap v256: 161 pgs: 161 active+clean; 585 KiB data, 67 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T13:43:13.337 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:43:13 smithi099 ceph-mon[24912]: pgmap v257: 161 pgs: 161 active+clean; 585 KiB data, 67 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T13:43:13.337 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:43:13 smithi099 ceph-mon[29691]: pgmap v257: 161 pgs: 161 active+clean; 585 KiB data, 67 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T13:43:13.506 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:43:13 smithi181 ceph-mon[25762]: pgmap v257: 161 pgs: 161 active+clean; 585 KiB data, 67 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T13:43:13.837 INFO:journalctl@ceph.alertmanager.a.smithi099.stdout:Mar 30 13:43:13 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-alertmanager-a[52107]: level=error ts=2024-03-30T13:43:13.524Z caller=dispatch.go:354 component=dispatcher msg="Notify for alerts failed" num_alerts=3 err="ceph-dashboard/webhook[1]: notify retry canceled after 7 attempts: Post \"https://172.21.15.181:8443/api/prometheus_receiver\": x509: cannot validate certificate for 172.21.15.181 because it doesn't contain any IP SANs; ceph-dashboard/webhook[0]: notify retry canceled after 8 attempts: Post \"https://172.21.15.99:8443//api/prometheus_receiver\": x509: cannot validate certificate for 172.21.15.99 because it doesn't contain any IP SANs" 2024-03-30T13:43:13.837 INFO:journalctl@ceph.alertmanager.a.smithi099.stdout:Mar 30 13:43:13 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-alertmanager-a[52107]: level=warn ts=2024-03-30T13:43:13.526Z caller=notify.go:724 component=dispatcher receiver=ceph-dashboard integration=webhook[0] msg="Notify attempt failed, will retry later" attempts=1 err="Post \"https://172.21.15.99:8443//api/prometheus_receiver\": x509: cannot validate certificate for 172.21.15.99 because it doesn't contain any IP SANs" 2024-03-30T13:43:13.837 INFO:journalctl@ceph.alertmanager.a.smithi099.stdout:Mar 30 13:43:13 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-alertmanager-a[52107]: level=warn ts=2024-03-30T13:43:13.526Z caller=notify.go:724 component=dispatcher receiver=ceph-dashboard integration=webhook[1] msg="Notify attempt failed, will retry later" attempts=1 err="Post \"https://172.21.15.181:8443/api/prometheus_receiver\": x509: cannot validate certificate for 172.21.15.181 because it doesn't contain any IP SANs" 2024-03-30T13:43:16.006 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:43:15 smithi181 ceph-mon[25762]: pgmap v258: 161 pgs: 161 active+clean; 585 KiB data, 67 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T13:43:16.006 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:43:15 smithi181 ceph-mon[25762]: from='client.14838 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T13:43:16.087 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:43:15 smithi099 ceph-mon[24912]: pgmap v258: 161 pgs: 161 active+clean; 585 KiB data, 67 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T13:43:16.087 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:43:15 smithi099 ceph-mon[24912]: from='client.14838 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T13:43:16.087 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:43:15 smithi099 ceph-mon[29691]: pgmap v258: 161 pgs: 161 active+clean; 585 KiB data, 67 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T13:43:16.087 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:43:15 smithi099 ceph-mon[29691]: from='client.14838 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T13:43:17.087 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:43:16 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[25141]: ::ffff:172.21.15.181 - - [30/Mar/2024:13:43:16] "GET /metrics HTTP/1.1" 200 208043 "" "Prometheus/2.33.4" 2024-03-30T13:43:18.006 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:43:17 smithi181 ceph-mon[25762]: pgmap v259: 161 pgs: 161 active+clean; 585 KiB data, 67 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T13:43:18.087 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:43:17 smithi099 ceph-mon[29691]: pgmap v259: 161 pgs: 161 active+clean; 585 KiB data, 67 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T13:43:18.087 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:43:17 smithi099 ceph-mon[24912]: pgmap v259: 161 pgs: 161 active+clean; 585 KiB data, 67 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T13:43:19.756 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:43:19 smithi181 ceph-mon[25762]: pgmap v260: 161 pgs: 161 active+clean; 585 KiB data, 67 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T13:43:19.756 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 13:43:19 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-x[50211]: ::ffff:172.21.15.181 - - [30/Mar/2024:13:43:19] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-03-30T13:43:20.087 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:43:19 smithi099 ceph-mon[29691]: pgmap v260: 161 pgs: 161 active+clean; 585 KiB data, 67 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T13:43:20.087 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:43:19 smithi099 ceph-mon[24912]: pgmap v260: 161 pgs: 161 active+clean; 585 KiB data, 67 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T13:43:21.006 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:43:20 smithi181 ceph-mon[25762]: from='mgr.14439 172.21.15.99:0/1757456350' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:43:21.006 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:43:20 smithi181 ceph-mon[25762]: from='mgr.14439 172.21.15.99:0/1757456350' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:43:21.006 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:43:20 smithi181 ceph-mon[25762]: from='mgr.14439 ' entity='mgr.y' 2024-03-30T13:43:21.087 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:43:20 smithi099 ceph-mon[24912]: from='mgr.14439 172.21.15.99:0/1757456350' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:43:21.087 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:43:20 smithi099 ceph-mon[24912]: from='mgr.14439 172.21.15.99:0/1757456350' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:43:21.087 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:43:20 smithi099 ceph-mon[24912]: from='mgr.14439 ' entity='mgr.y' 2024-03-30T13:43:21.087 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:43:20 smithi099 ceph-mon[29691]: from='mgr.14439 172.21.15.99:0/1757456350' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:43:21.087 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:43:20 smithi099 ceph-mon[29691]: from='mgr.14439 172.21.15.99:0/1757456350' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:43:21.087 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:43:20 smithi099 ceph-mon[29691]: from='mgr.14439 ' entity='mgr.y' 2024-03-30T13:43:22.087 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:43:21 smithi099 ceph-mon[24912]: pgmap v261: 161 pgs: 161 active+clean; 585 KiB data, 67 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T13:43:22.087 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:43:21 smithi099 ceph-mon[29691]: pgmap v261: 161 pgs: 161 active+clean; 585 KiB data, 67 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T13:43:22.256 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:43:21 smithi181 ceph-mon[25762]: pgmap v261: 161 pgs: 161 active+clean; 585 KiB data, 67 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T13:43:23.835 INFO:journalctl@ceph.alertmanager.a.smithi099.stdout:Mar 30 13:43:23 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-alertmanager-a[52107]: level=error ts=2024-03-30T13:43:23.525Z caller=dispatch.go:354 component=dispatcher msg="Notify for alerts failed" num_alerts=3 err="ceph-dashboard/webhook[0]: notify retry canceled after 8 attempts: Post \"https://172.21.15.99:8443//api/prometheus_receiver\": x509: cannot validate certificate for 172.21.15.99 because it doesn't contain any IP SANs; ceph-dashboard/webhook[1]: notify retry canceled after 8 attempts: Post \"https://172.21.15.181:8443/api/prometheus_receiver\": x509: cannot validate certificate for 172.21.15.181 because it doesn't contain any IP SANs" 2024-03-30T13:43:23.836 INFO:journalctl@ceph.alertmanager.a.smithi099.stdout:Mar 30 13:43:23 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-alertmanager-a[52107]: level=warn ts=2024-03-30T13:43:23.527Z caller=notify.go:724 component=dispatcher receiver=ceph-dashboard integration=webhook[0] msg="Notify attempt failed, will retry later" attempts=1 err="Post \"https://172.21.15.99:8443//api/prometheus_receiver\": x509: cannot validate certificate for 172.21.15.99 because it doesn't contain any IP SANs" 2024-03-30T13:43:23.836 INFO:journalctl@ceph.alertmanager.a.smithi099.stdout:Mar 30 13:43:23 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-alertmanager-a[52107]: level=warn ts=2024-03-30T13:43:23.527Z caller=notify.go:724 component=dispatcher receiver=ceph-dashboard integration=webhook[1] msg="Notify attempt failed, will retry later" attempts=1 err="Post \"https://172.21.15.181:8443/api/prometheus_receiver\": x509: cannot validate certificate for 172.21.15.181 because it doesn't contain any IP SANs" 2024-03-30T13:43:24.087 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:43:23 smithi099 ceph-mon[24912]: pgmap v262: 161 pgs: 161 active+clean; 585 KiB data, 67 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T13:43:24.087 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:43:23 smithi099 ceph-mon[29691]: pgmap v262: 161 pgs: 161 active+clean; 585 KiB data, 67 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T13:43:24.256 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:43:23 smithi181 ceph-mon[25762]: pgmap v262: 161 pgs: 161 active+clean; 585 KiB data, 67 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T13:43:24.837 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:43:24 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[25141]: 172.21.15.181 - - [30/Mar/2024:13:43:24] "POST /data HTTP/1.1" 200 46 "" "Python-urllib/3.9" 2024-03-30T13:43:25.837 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:43:25 smithi099 ceph-mon[24912]: pgmap v263: 161 pgs: 161 active+clean; 585 KiB data, 67 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T13:43:25.837 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:43:25 smithi099 ceph-mon[24912]: from='mgr.14439 ' entity='mgr.y' 2024-03-30T13:43:25.837 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:43:25 smithi099 ceph-mon[24912]: from='mgr.14439 ' entity='mgr.y' 2024-03-30T13:43:25.837 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:43:25 smithi099 ceph-mon[24912]: from='client.14838 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T13:43:25.837 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:43:25 smithi099 ceph-mon[29691]: pgmap v263: 161 pgs: 161 active+clean; 585 KiB data, 67 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T13:43:25.837 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:43:25 smithi099 ceph-mon[29691]: from='mgr.14439 ' entity='mgr.y' 2024-03-30T13:43:25.837 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:43:25 smithi099 ceph-mon[29691]: from='mgr.14439 ' entity='mgr.y' 2024-03-30T13:43:25.838 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:43:25 smithi099 ceph-mon[29691]: from='client.14838 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T13:43:26.006 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:43:25 smithi181 ceph-mon[25762]: pgmap v263: 161 pgs: 161 active+clean; 585 KiB data, 67 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T13:43:26.006 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:43:25 smithi181 ceph-mon[25762]: from='mgr.14439 ' entity='mgr.y' 2024-03-30T13:43:26.006 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:43:25 smithi181 ceph-mon[25762]: from='mgr.14439 ' entity='mgr.y' 2024-03-30T13:43:26.006 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:43:25 smithi181 ceph-mon[25762]: from='client.14838 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T13:43:27.087 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:43:26 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[25141]: ::ffff:172.21.15.181 - - [30/Mar/2024:13:43:26] "GET /metrics HTTP/1.1" 200 208043 "" "Prometheus/2.33.4" 2024-03-30T13:43:27.837 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:43:27 smithi099 ceph-mon[24912]: pgmap v264: 161 pgs: 161 active+clean; 585 KiB data, 67 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T13:43:27.837 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:43:27 smithi099 ceph-mon[29691]: pgmap v264: 161 pgs: 161 active+clean; 585 KiB data, 67 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T13:43:28.006 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:43:27 smithi181 ceph-mon[25762]: pgmap v264: 161 pgs: 161 active+clean; 585 KiB data, 67 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T13:43:28.587 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:43:28 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[25141]: 172.21.15.99 - - [30/Mar/2024:13:43:28] "POST /data HTTP/1.1" 200 46 "" "Python-urllib/3.9" 2024-03-30T13:43:29.462 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:43:29 smithi181 ceph-mon[25762]: pgmap v265: 161 pgs: 161 active+clean; 585 KiB data, 67 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T13:43:29.462 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:43:29 smithi181 ceph-mon[25762]: from='mgr.14439 ' entity='mgr.y' 2024-03-30T13:43:29.462 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:43:29 smithi181 ceph-mon[25762]: from='mgr.14439 ' entity='mgr.y' 2024-03-30T13:43:29.587 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:43:29 smithi099 ceph-mon[24912]: pgmap v265: 161 pgs: 161 active+clean; 585 KiB data, 67 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T13:43:29.587 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:43:29 smithi099 ceph-mon[24912]: from='mgr.14439 ' entity='mgr.y' 2024-03-30T13:43:29.587 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:43:29 smithi099 ceph-mon[24912]: from='mgr.14439 ' entity='mgr.y' 2024-03-30T13:43:29.587 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:43:29 smithi099 ceph-mon[29691]: pgmap v265: 161 pgs: 161 active+clean; 585 KiB data, 67 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T13:43:29.587 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:43:29 smithi099 ceph-mon[29691]: from='mgr.14439 ' entity='mgr.y' 2024-03-30T13:43:29.587 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:43:29 smithi099 ceph-mon[29691]: from='mgr.14439 ' entity='mgr.y' 2024-03-30T13:43:29.756 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 13:43:29 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-x[50211]: ::ffff:172.21.15.181 - - [30/Mar/2024:13:43:29] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-03-30T13:43:31.495 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:43:31 smithi099 ceph-mon[24912]: pgmap v266: 161 pgs: 161 active+clean; 585 KiB data, 67 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T13:43:31.496 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:43:31 smithi099 ceph-mon[29691]: pgmap v266: 161 pgs: 161 active+clean; 585 KiB data, 67 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T13:43:31.506 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:43:31 smithi181 ceph-mon[25762]: pgmap v266: 161 pgs: 161 active+clean; 585 KiB data, 67 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T13:43:33.506 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:43:33 smithi181 ceph-mon[25762]: pgmap v267: 161 pgs: 161 active+clean; 585 KiB data, 67 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T13:43:33.527 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:43:33 smithi099 ceph-mon[24912]: pgmap v267: 161 pgs: 161 active+clean; 585 KiB data, 67 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T13:43:33.528 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:43:33 smithi099 ceph-mon[29691]: pgmap v267: 161 pgs: 161 active+clean; 585 KiB data, 67 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T13:43:33.837 INFO:journalctl@ceph.alertmanager.a.smithi099.stdout:Mar 30 13:43:33 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-alertmanager-a[52107]: level=error ts=2024-03-30T13:43:33.526Z caller=dispatch.go:354 component=dispatcher msg="Notify for alerts failed" num_alerts=3 err="ceph-dashboard/webhook[0]: notify retry canceled after 7 attempts: Post \"https://172.21.15.99:8443//api/prometheus_receiver\": x509: cannot validate certificate for 172.21.15.99 because it doesn't contain any IP SANs; ceph-dashboard/webhook[1]: notify retry canceled after 8 attempts: Post \"https://172.21.15.181:8443/api/prometheus_receiver\": x509: cannot validate certificate for 172.21.15.181 because it doesn't contain any IP SANs" 2024-03-30T13:43:33.837 INFO:journalctl@ceph.alertmanager.a.smithi099.stdout:Mar 30 13:43:33 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-alertmanager-a[52107]: level=warn ts=2024-03-30T13:43:33.528Z caller=notify.go:724 component=dispatcher receiver=ceph-dashboard integration=webhook[1] msg="Notify attempt failed, will retry later" attempts=1 err="Post \"https://172.21.15.181:8443/api/prometheus_receiver\": x509: cannot validate certificate for 172.21.15.181 because it doesn't contain any IP SANs" 2024-03-30T13:43:33.837 INFO:journalctl@ceph.alertmanager.a.smithi099.stdout:Mar 30 13:43:33 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-alertmanager-a[52107]: level=warn ts=2024-03-30T13:43:33.528Z caller=notify.go:724 component=dispatcher receiver=ceph-dashboard integration=webhook[0] msg="Notify attempt failed, will retry later" attempts=1 err="Post \"https://172.21.15.99:8443//api/prometheus_receiver\": x509: cannot validate certificate for 172.21.15.99 because it doesn't contain any IP SANs" 2024-03-30T13:43:36.006 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:43:35 smithi181 ceph-mon[25762]: pgmap v268: 161 pgs: 161 active+clean; 585 KiB data, 67 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T13:43:36.006 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:43:35 smithi181 ceph-mon[25762]: from='client.14838 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T13:43:36.087 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:43:35 smithi099 ceph-mon[24912]: pgmap v268: 161 pgs: 161 active+clean; 585 KiB data, 67 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T13:43:36.087 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:43:35 smithi099 ceph-mon[24912]: from='client.14838 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T13:43:36.087 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:43:35 smithi099 ceph-mon[29691]: pgmap v268: 161 pgs: 161 active+clean; 585 KiB data, 67 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T13:43:36.087 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:43:35 smithi099 ceph-mon[29691]: from='client.14838 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T13:43:37.087 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:43:36 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[25141]: ::ffff:172.21.15.181 - - [30/Mar/2024:13:43:36] "GET /metrics HTTP/1.1" 200 208040 "" "Prometheus/2.33.4" 2024-03-30T13:43:38.006 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:43:37 smithi181 ceph-mon[25762]: pgmap v269: 161 pgs: 161 active+clean; 585 KiB data, 67 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T13:43:38.087 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:43:37 smithi099 ceph-mon[24912]: pgmap v269: 161 pgs: 161 active+clean; 585 KiB data, 67 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T13:43:38.087 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:43:37 smithi099 ceph-mon[29691]: pgmap v269: 161 pgs: 161 active+clean; 585 KiB data, 67 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T13:43:39.756 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:43:39 smithi181 ceph-mon[25762]: pgmap v270: 161 pgs: 161 active+clean; 585 KiB data, 67 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T13:43:39.756 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 13:43:39 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-x[50211]: ::ffff:172.21.15.181 - - [30/Mar/2024:13:43:39] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-03-30T13:43:40.087 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:43:39 smithi099 ceph-mon[29691]: pgmap v270: 161 pgs: 161 active+clean; 585 KiB data, 67 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T13:43:40.087 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:43:39 smithi099 ceph-mon[24912]: pgmap v270: 161 pgs: 161 active+clean; 585 KiB data, 67 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T13:43:42.006 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:43:41 smithi181 ceph-mon[25762]: pgmap v271: 161 pgs: 161 active+clean; 585 KiB data, 67 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T13:43:42.087 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:43:41 smithi099 ceph-mon[24912]: pgmap v271: 161 pgs: 161 active+clean; 585 KiB data, 67 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T13:43:42.087 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:43:41 smithi099 ceph-mon[29691]: pgmap v271: 161 pgs: 161 active+clean; 585 KiB data, 67 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T13:43:43.837 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:43:43 smithi099 ceph-mon[24912]: pgmap v272: 161 pgs: 161 active+clean; 585 KiB data, 67 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T13:43:43.838 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:43:43 smithi099 ceph-mon[29691]: pgmap v272: 161 pgs: 161 active+clean; 585 KiB data, 67 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T13:43:43.838 INFO:journalctl@ceph.alertmanager.a.smithi099.stdout:Mar 30 13:43:43 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-alertmanager-a[52107]: level=error ts=2024-03-30T13:43:43.526Z caller=dispatch.go:354 component=dispatcher msg="Notify for alerts failed" num_alerts=3 err="ceph-dashboard/webhook[1]: notify retry canceled after 7 attempts: Post \"https://172.21.15.181:8443/api/prometheus_receiver\": x509: cannot validate certificate for 172.21.15.181 because it doesn't contain any IP SANs; ceph-dashboard/webhook[0]: notify retry canceled after 8 attempts: Post \"https://172.21.15.99:8443//api/prometheus_receiver\": x509: cannot validate certificate for 172.21.15.99 because it doesn't contain any IP SANs" 2024-03-30T13:43:43.838 INFO:journalctl@ceph.alertmanager.a.smithi099.stdout:Mar 30 13:43:43 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-alertmanager-a[52107]: level=warn ts=2024-03-30T13:43:43.528Z caller=notify.go:724 component=dispatcher receiver=ceph-dashboard integration=webhook[0] msg="Notify attempt failed, will retry later" attempts=1 err="Post \"https://172.21.15.99:8443//api/prometheus_receiver\": x509: cannot validate certificate for 172.21.15.99 because it doesn't contain any IP SANs" 2024-03-30T13:43:43.838 INFO:journalctl@ceph.alertmanager.a.smithi099.stdout:Mar 30 13:43:43 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-alertmanager-a[52107]: level=warn ts=2024-03-30T13:43:43.528Z caller=notify.go:724 component=dispatcher receiver=ceph-dashboard integration=webhook[1] msg="Notify attempt failed, will retry later" attempts=1 err="Post \"https://172.21.15.181:8443/api/prometheus_receiver\": x509: cannot validate certificate for 172.21.15.181 because it doesn't contain any IP SANs" 2024-03-30T13:43:44.006 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:43:43 smithi181 ceph-mon[25762]: pgmap v272: 161 pgs: 161 active+clean; 585 KiB data, 67 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T13:43:44.837 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:43:44 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[25141]: 172.21.15.181 - - [30/Mar/2024:13:43:44] "POST /data HTTP/1.1" 200 46 "" "Python-urllib/3.9" 2024-03-30T13:43:46.007 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:43:45 smithi181 ceph-mon[25762]: pgmap v273: 161 pgs: 161 active+clean; 585 KiB data, 67 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T13:43:46.007 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:43:45 smithi181 ceph-mon[25762]: from='mgr.14439 ' entity='mgr.y' 2024-03-30T13:43:46.007 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:43:45 smithi181 ceph-mon[25762]: from='mgr.14439 ' entity='mgr.y' 2024-03-30T13:43:46.007 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:43:45 smithi181 ceph-mon[25762]: from='client.14838 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T13:43:46.087 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:43:45 smithi099 ceph-mon[29691]: pgmap v273: 161 pgs: 161 active+clean; 585 KiB data, 67 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T13:43:46.087 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:43:45 smithi099 ceph-mon[29691]: from='mgr.14439 ' entity='mgr.y' 2024-03-30T13:43:46.087 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:43:45 smithi099 ceph-mon[29691]: from='mgr.14439 ' entity='mgr.y' 2024-03-30T13:43:46.087 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:43:45 smithi099 ceph-mon[29691]: from='client.14838 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T13:43:46.088 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:43:45 smithi099 ceph-mon[24912]: pgmap v273: 161 pgs: 161 active+clean; 585 KiB data, 67 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T13:43:46.088 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:43:45 smithi099 ceph-mon[24912]: from='mgr.14439 ' entity='mgr.y' 2024-03-30T13:43:46.088 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:43:45 smithi099 ceph-mon[24912]: from='mgr.14439 ' entity='mgr.y' 2024-03-30T13:43:46.088 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:43:45 smithi099 ceph-mon[24912]: from='client.14838 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T13:43:47.087 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:43:46 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[25141]: ::ffff:172.21.15.181 - - [30/Mar/2024:13:43:46] "GET /metrics HTTP/1.1" 200 208045 "" "Prometheus/2.33.4" 2024-03-30T13:43:48.006 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:43:47 smithi181 ceph-mon[25762]: pgmap v274: 161 pgs: 161 active+clean; 585 KiB data, 67 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T13:43:48.087 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:43:47 smithi099 ceph-mon[24912]: pgmap v274: 161 pgs: 161 active+clean; 585 KiB data, 67 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T13:43:48.087 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:43:47 smithi099 ceph-mon[29691]: pgmap v274: 161 pgs: 161 active+clean; 585 KiB data, 67 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T13:43:48.587 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:43:48 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[25141]: 172.21.15.99 - - [30/Mar/2024:13:43:48] "POST /data HTTP/1.1" 200 46 "" "Python-urllib/3.9" 2024-03-30T13:43:49.587 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:43:49 smithi099 ceph-mon[29691]: pgmap v275: 161 pgs: 161 active+clean; 585 KiB data, 67 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T13:43:49.587 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:43:49 smithi099 ceph-mon[29691]: from='mgr.14439 ' entity='mgr.y' 2024-03-30T13:43:49.587 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:43:49 smithi099 ceph-mon[29691]: from='mgr.14439 ' entity='mgr.y' 2024-03-30T13:43:49.587 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:43:49 smithi099 ceph-mon[24912]: pgmap v275: 161 pgs: 161 active+clean; 585 KiB data, 67 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T13:43:49.587 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:43:49 smithi099 ceph-mon[24912]: from='mgr.14439 ' entity='mgr.y' 2024-03-30T13:43:49.587 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:43:49 smithi099 ceph-mon[24912]: from='mgr.14439 ' entity='mgr.y' 2024-03-30T13:43:49.756 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:43:49 smithi181 ceph-mon[25762]: pgmap v275: 161 pgs: 161 active+clean; 585 KiB data, 67 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T13:43:49.756 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:43:49 smithi181 ceph-mon[25762]: from='mgr.14439 ' entity='mgr.y' 2024-03-30T13:43:49.756 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:43:49 smithi181 ceph-mon[25762]: from='mgr.14439 ' entity='mgr.y' 2024-03-30T13:43:49.756 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 13:43:49 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-x[50211]: ::ffff:172.21.15.181 - - [30/Mar/2024:13:43:49] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-03-30T13:43:51.442 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:43:51 smithi099 ceph-mon[24912]: pgmap v276: 161 pgs: 161 active+clean; 585 KiB data, 67 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T13:43:51.442 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:43:51 smithi099 ceph-mon[29691]: pgmap v276: 161 pgs: 161 active+clean; 585 KiB data, 67 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T13:43:51.756 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:43:51 smithi181 ceph-mon[25762]: pgmap v276: 161 pgs: 161 active+clean; 585 KiB data, 67 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T13:43:53.528 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:43:53 smithi099 ceph-mon[24912]: pgmap v277: 161 pgs: 161 active+clean; 585 KiB data, 67 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T13:43:53.528 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:43:53 smithi099 ceph-mon[29691]: pgmap v277: 161 pgs: 161 active+clean; 585 KiB data, 67 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T13:43:53.756 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:43:53 smithi181 ceph-mon[25762]: pgmap v277: 161 pgs: 161 active+clean; 585 KiB data, 67 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T13:43:53.837 INFO:journalctl@ceph.alertmanager.a.smithi099.stdout:Mar 30 13:43:53 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-alertmanager-a[52107]: level=error ts=2024-03-30T13:43:53.527Z caller=dispatch.go:354 component=dispatcher msg="Notify for alerts failed" num_alerts=3 err="ceph-dashboard/webhook[1]: notify retry canceled after 7 attempts: Post \"https://172.21.15.181:8443/api/prometheus_receiver\": x509: cannot validate certificate for 172.21.15.181 because it doesn't contain any IP SANs; ceph-dashboard/webhook[0]: notify retry canceled after 7 attempts: Post \"https://172.21.15.99:8443//api/prometheus_receiver\": x509: cannot validate certificate for 172.21.15.99 because it doesn't contain any IP SANs" 2024-03-30T13:43:53.837 INFO:journalctl@ceph.alertmanager.a.smithi099.stdout:Mar 30 13:43:53 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-alertmanager-a[52107]: level=warn ts=2024-03-30T13:43:53.528Z caller=notify.go:724 component=dispatcher receiver=ceph-dashboard integration=webhook[0] msg="Notify attempt failed, will retry later" attempts=1 err="Post \"https://172.21.15.99:8443//api/prometheus_receiver\": x509: cannot validate certificate for 172.21.15.99 because it doesn't contain any IP SANs" 2024-03-30T13:43:53.837 INFO:journalctl@ceph.alertmanager.a.smithi099.stdout:Mar 30 13:43:53 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-alertmanager-a[52107]: level=warn ts=2024-03-30T13:43:53.529Z caller=notify.go:724 component=dispatcher receiver=ceph-dashboard integration=webhook[1] msg="Notify attempt failed, will retry later" attempts=1 err="Post \"https://172.21.15.181:8443/api/prometheus_receiver\": x509: cannot validate certificate for 172.21.15.181 because it doesn't contain any IP SANs" 2024-03-30T13:43:55.756 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:43:55 smithi181 ceph-mon[25762]: pgmap v278: 161 pgs: 161 active+clean; 585 KiB data, 67 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T13:43:55.756 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:43:55 smithi181 ceph-mon[25762]: from='client.14838 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T13:43:56.087 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:43:55 smithi099 ceph-mon[24912]: pgmap v278: 161 pgs: 161 active+clean; 585 KiB data, 67 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T13:43:56.087 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:43:55 smithi099 ceph-mon[24912]: from='client.14838 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T13:43:56.087 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:43:55 smithi099 ceph-mon[29691]: pgmap v278: 161 pgs: 161 active+clean; 585 KiB data, 67 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T13:43:56.087 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:43:55 smithi099 ceph-mon[29691]: from='client.14838 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T13:43:57.087 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:43:56 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[25141]: ::ffff:172.21.15.181 - - [30/Mar/2024:13:43:56] "GET /metrics HTTP/1.1" 200 208045 "" "Prometheus/2.33.4" 2024-03-30T13:43:58.006 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:43:57 smithi181 ceph-mon[25762]: pgmap v279: 161 pgs: 161 active+clean; 585 KiB data, 67 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T13:43:58.087 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:43:57 smithi099 ceph-mon[24912]: pgmap v279: 161 pgs: 161 active+clean; 585 KiB data, 67 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T13:43:58.087 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:43:57 smithi099 ceph-mon[29691]: pgmap v279: 161 pgs: 161 active+clean; 585 KiB data, 67 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T13:43:59.756 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 13:43:59 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-x[50211]: ::ffff:172.21.15.181 - - [30/Mar/2024:13:43:59] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-03-30T13:43:59.756 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:43:59 smithi181 ceph-mon[25762]: pgmap v280: 161 pgs: 161 active+clean; 585 KiB data, 67 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T13:44:00.087 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:43:59 smithi099 ceph-mon[24912]: pgmap v280: 161 pgs: 161 active+clean; 585 KiB data, 67 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T13:44:00.087 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:43:59 smithi099 ceph-mon[29691]: pgmap v280: 161 pgs: 161 active+clean; 585 KiB data, 67 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T13:44:01.006 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:44:00 smithi181 ceph-mon[25762]: from='mgr.14439 172.21.15.99:0/1757456350' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-03-30T13:44:01.006 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:44:00 smithi181 ceph-mon[25762]: from='mgr.14439 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-03-30T13:44:01.006 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:44:00 smithi181 ceph-mon[25762]: from='mgr.14439 172.21.15.99:0/1757456350' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-03-30T13:44:01.006 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:44:00 smithi181 ceph-mon[25762]: from='mgr.14439 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-03-30T13:44:01.087 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:44:00 smithi099 ceph-mon[24912]: from='mgr.14439 172.21.15.99:0/1757456350' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-03-30T13:44:01.087 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:44:00 smithi099 ceph-mon[24912]: from='mgr.14439 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-03-30T13:44:01.087 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:44:00 smithi099 ceph-mon[24912]: from='mgr.14439 172.21.15.99:0/1757456350' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-03-30T13:44:01.087 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:44:00 smithi099 ceph-mon[24912]: from='mgr.14439 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-03-30T13:44:01.087 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:44:00 smithi099 ceph-mon[29691]: from='mgr.14439 172.21.15.99:0/1757456350' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-03-30T13:44:01.088 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:44:00 smithi099 ceph-mon[29691]: from='mgr.14439 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-03-30T13:44:01.088 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:44:00 smithi099 ceph-mon[29691]: from='mgr.14439 172.21.15.99:0/1757456350' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-03-30T13:44:01.088 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:44:00 smithi099 ceph-mon[29691]: from='mgr.14439 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-03-30T13:44:02.006 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:44:01 smithi181 ceph-mon[25762]: pgmap v281: 161 pgs: 161 active+clean; 585 KiB data, 67 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T13:44:02.087 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:44:01 smithi099 ceph-mon[24912]: pgmap v281: 161 pgs: 161 active+clean; 585 KiB data, 67 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T13:44:02.087 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:44:01 smithi099 ceph-mon[29691]: pgmap v281: 161 pgs: 161 active+clean; 585 KiB data, 67 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T13:44:03.837 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:44:03 smithi099 ceph-mon[24912]: pgmap v282: 161 pgs: 161 active+clean; 585 KiB data, 67 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T13:44:03.837 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:44:03 smithi099 ceph-mon[29691]: pgmap v282: 161 pgs: 161 active+clean; 585 KiB data, 67 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T13:44:03.837 INFO:journalctl@ceph.alertmanager.a.smithi099.stdout:Mar 30 13:44:03 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-alertmanager-a[52107]: level=error ts=2024-03-30T13:44:03.528Z caller=dispatch.go:354 component=dispatcher msg="Notify for alerts failed" num_alerts=3 err="ceph-dashboard/webhook[0]: notify retry canceled after 8 attempts: Post \"https://172.21.15.99:8443//api/prometheus_receiver\": x509: cannot validate certificate for 172.21.15.99 because it doesn't contain any IP SANs; ceph-dashboard/webhook[1]: notify retry canceled after 8 attempts: Post \"https://172.21.15.181:8443/api/prometheus_receiver\": x509: cannot validate certificate for 172.21.15.181 because it doesn't contain any IP SANs" 2024-03-30T13:44:03.837 INFO:journalctl@ceph.alertmanager.a.smithi099.stdout:Mar 30 13:44:03 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-alertmanager-a[52107]: level=warn ts=2024-03-30T13:44:03.530Z caller=notify.go:724 component=dispatcher receiver=ceph-dashboard integration=webhook[0] msg="Notify attempt failed, will retry later" attempts=1 err="Post \"https://172.21.15.99:8443//api/prometheus_receiver\": x509: cannot validate certificate for 172.21.15.99 because it doesn't contain any IP SANs" 2024-03-30T13:44:03.838 INFO:journalctl@ceph.alertmanager.a.smithi099.stdout:Mar 30 13:44:03 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-alertmanager-a[52107]: level=warn ts=2024-03-30T13:44:03.530Z caller=notify.go:724 component=dispatcher receiver=ceph-dashboard integration=webhook[1] msg="Notify attempt failed, will retry later" attempts=1 err="Post \"https://172.21.15.181:8443/api/prometheus_receiver\": x509: cannot validate certificate for 172.21.15.181 because it doesn't contain any IP SANs" 2024-03-30T13:44:04.006 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:44:03 smithi181 ceph-mon[25762]: pgmap v282: 161 pgs: 161 active+clean; 585 KiB data, 67 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T13:44:05.087 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:44:04 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[25141]: 172.21.15.181 - - [30/Mar/2024:13:44:04] "POST /data HTTP/1.1" 200 46 "" "Python-urllib/3.9" 2024-03-30T13:44:06.006 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:44:05 smithi181 ceph-mon[25762]: pgmap v283: 161 pgs: 161 active+clean; 585 KiB data, 67 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T13:44:06.006 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:44:05 smithi181 ceph-mon[25762]: from='client.14838 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T13:44:06.006 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:44:05 smithi181 ceph-mon[25762]: from='mgr.14439 ' entity='mgr.y' 2024-03-30T13:44:06.006 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:44:05 smithi181 ceph-mon[25762]: from='mgr.14439 ' entity='mgr.y' 2024-03-30T13:44:06.009 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:44:05 smithi099 ceph-mon[24912]: pgmap v283: 161 pgs: 161 active+clean; 585 KiB data, 67 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T13:44:06.009 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:44:05 smithi099 ceph-mon[24912]: from='client.14838 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T13:44:06.009 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:44:05 smithi099 ceph-mon[24912]: from='mgr.14439 ' entity='mgr.y' 2024-03-30T13:44:06.009 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:44:05 smithi099 ceph-mon[24912]: from='mgr.14439 ' entity='mgr.y' 2024-03-30T13:44:06.009 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:44:05 smithi099 ceph-mon[29691]: pgmap v283: 161 pgs: 161 active+clean; 585 KiB data, 67 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T13:44:06.009 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:44:05 smithi099 ceph-mon[29691]: from='client.14838 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T13:44:06.009 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:44:05 smithi099 ceph-mon[29691]: from='mgr.14439 ' entity='mgr.y' 2024-03-30T13:44:06.009 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:44:05 smithi099 ceph-mon[29691]: from='mgr.14439 ' entity='mgr.y' 2024-03-30T13:44:07.087 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:44:06 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[25141]: ::ffff:172.21.15.181 - - [30/Mar/2024:13:44:06] "GET /metrics HTTP/1.1" 200 208049 "" "Prometheus/2.33.4" 2024-03-30T13:44:08.006 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:44:07 smithi181 ceph-mon[25762]: pgmap v284: 161 pgs: 161 active+clean; 585 KiB data, 67 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T13:44:08.087 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:44:07 smithi099 ceph-mon[24912]: pgmap v284: 161 pgs: 161 active+clean; 585 KiB data, 67 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T13:44:08.087 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:44:07 smithi099 ceph-mon[29691]: pgmap v284: 161 pgs: 161 active+clean; 585 KiB data, 67 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T13:44:08.839 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:44:08 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[25141]: 172.21.15.99 - - [30/Mar/2024:13:44:08] "POST /data HTTP/1.1" 200 46 "" "Python-urllib/3.9" 2024-03-30T13:44:09.756 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 13:44:09 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-x[50211]: ::ffff:172.21.15.181 - - [30/Mar/2024:13:44:09] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-03-30T13:44:09.756 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:44:09 smithi181 ceph-mon[25762]: pgmap v285: 161 pgs: 161 active+clean; 585 KiB data, 67 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T13:44:09.756 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:44:09 smithi181 ceph-mon[25762]: from='mgr.14439 ' entity='mgr.y' 2024-03-30T13:44:09.756 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:44:09 smithi181 ceph-mon[25762]: from='mgr.14439 ' entity='mgr.y' 2024-03-30T13:44:09.837 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:44:09 smithi099 ceph-mon[24912]: pgmap v285: 161 pgs: 161 active+clean; 585 KiB data, 67 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T13:44:09.837 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:44:09 smithi099 ceph-mon[24912]: from='mgr.14439 ' entity='mgr.y' 2024-03-30T13:44:09.837 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:44:09 smithi099 ceph-mon[24912]: from='mgr.14439 ' entity='mgr.y' 2024-03-30T13:44:09.838 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:44:09 smithi099 ceph-mon[29691]: pgmap v285: 161 pgs: 161 active+clean; 585 KiB data, 67 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T13:44:09.838 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:44:09 smithi099 ceph-mon[29691]: from='mgr.14439 ' entity='mgr.y' 2024-03-30T13:44:09.838 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:44:09 smithi099 ceph-mon[29691]: from='mgr.14439 ' entity='mgr.y' 2024-03-30T13:44:11.756 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:44:11 smithi181 ceph-mon[25762]: pgmap v286: 161 pgs: 161 active+clean; 585 KiB data, 67 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T13:44:11.837 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:44:11 smithi099 ceph-mon[24912]: pgmap v286: 161 pgs: 161 active+clean; 585 KiB data, 67 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T13:44:11.837 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:44:11 smithi099 ceph-mon[29691]: pgmap v286: 161 pgs: 161 active+clean; 585 KiB data, 67 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T13:44:13.654 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:44:13 smithi099 ceph-mon[24912]: pgmap v287: 161 pgs: 161 active+clean; 585 KiB data, 67 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T13:44:13.654 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:44:13 smithi099 ceph-mon[29691]: pgmap v287: 161 pgs: 161 active+clean; 585 KiB data, 67 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T13:44:13.655 INFO:journalctl@ceph.alertmanager.a.smithi099.stdout:Mar 30 13:44:13 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-alertmanager-a[52107]: level=error ts=2024-03-30T13:44:13.529Z caller=dispatch.go:354 component=dispatcher msg="Notify for alerts failed" num_alerts=3 err="ceph-dashboard/webhook[0]: notify retry canceled after 7 attempts: Post \"https://172.21.15.99:8443//api/prometheus_receiver\": x509: cannot validate certificate for 172.21.15.99 because it doesn't contain any IP SANs; ceph-dashboard/webhook[1]: notify retry canceled after 7 attempts: Post \"https://172.21.15.181:8443/api/prometheus_receiver\": x509: cannot validate certificate for 172.21.15.181 because it doesn't contain any IP SANs" 2024-03-30T13:44:13.655 INFO:journalctl@ceph.alertmanager.a.smithi099.stdout:Mar 30 13:44:13 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-alertmanager-a[52107]: level=warn ts=2024-03-30T13:44:13.531Z caller=notify.go:724 component=dispatcher receiver=ceph-dashboard integration=webhook[1] msg="Notify attempt failed, will retry later" attempts=1 err="Post \"https://172.21.15.181:8443/api/prometheus_receiver\": x509: cannot validate certificate for 172.21.15.181 because it doesn't contain any IP SANs" 2024-03-30T13:44:13.655 INFO:journalctl@ceph.alertmanager.a.smithi099.stdout:Mar 30 13:44:13 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-alertmanager-a[52107]: level=warn ts=2024-03-30T13:44:13.531Z caller=notify.go:724 component=dispatcher receiver=ceph-dashboard integration=webhook[0] msg="Notify attempt failed, will retry later" attempts=1 err="Post \"https://172.21.15.99:8443//api/prometheus_receiver\": x509: cannot validate certificate for 172.21.15.99 because it doesn't contain any IP SANs" 2024-03-30T13:44:13.758 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:44:13 smithi181 ceph-mon[25762]: pgmap v287: 161 pgs: 161 active+clean; 585 KiB data, 67 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T13:44:16.006 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:44:15 smithi181 ceph-mon[25762]: pgmap v288: 161 pgs: 161 active+clean; 585 KiB data, 67 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T13:44:16.007 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:44:15 smithi181 ceph-mon[25762]: from='client.14838 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T13:44:16.087 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:44:15 smithi099 ceph-mon[24912]: pgmap v288: 161 pgs: 161 active+clean; 585 KiB data, 67 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T13:44:16.087 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:44:15 smithi099 ceph-mon[24912]: from='client.14838 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T13:44:16.088 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:44:15 smithi099 ceph-mon[29691]: pgmap v288: 161 pgs: 161 active+clean; 585 KiB data, 67 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T13:44:16.088 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:44:15 smithi099 ceph-mon[29691]: from='client.14838 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T13:44:17.087 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:44:16 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[25141]: ::ffff:172.21.15.181 - - [30/Mar/2024:13:44:16] "GET /metrics HTTP/1.1" 200 208049 "" "Prometheus/2.33.4" 2024-03-30T13:44:18.006 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:44:17 smithi181 ceph-mon[25762]: pgmap v289: 161 pgs: 161 active+clean; 585 KiB data, 67 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T13:44:18.087 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:44:17 smithi099 ceph-mon[24912]: pgmap v289: 161 pgs: 161 active+clean; 585 KiB data, 67 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T13:44:18.087 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:44:17 smithi099 ceph-mon[29691]: pgmap v289: 161 pgs: 161 active+clean; 585 KiB data, 67 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T13:44:19.756 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:44:19 smithi181 ceph-mon[25762]: pgmap v290: 161 pgs: 161 active+clean; 585 KiB data, 67 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T13:44:19.756 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 13:44:19 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-x[50211]: ::ffff:172.21.15.181 - - [30/Mar/2024:13:44:19] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-03-30T13:44:20.087 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:44:19 smithi099 ceph-mon[24912]: pgmap v290: 161 pgs: 161 active+clean; 585 KiB data, 67 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T13:44:20.087 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:44:19 smithi099 ceph-mon[29691]: pgmap v290: 161 pgs: 161 active+clean; 585 KiB data, 67 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T13:44:21.006 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:44:20 smithi181 ceph-mon[25762]: from='mgr.14439 172.21.15.99:0/1757456350' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:44:21.006 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:44:20 smithi181 ceph-mon[25762]: from='mgr.14439 172.21.15.99:0/1757456350' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:44:21.006 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:44:20 smithi181 ceph-mon[25762]: from='mgr.14439 ' entity='mgr.y' 2024-03-30T13:44:21.087 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:44:20 smithi099 ceph-mon[24912]: from='mgr.14439 172.21.15.99:0/1757456350' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:44:21.087 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:44:20 smithi099 ceph-mon[24912]: from='mgr.14439 172.21.15.99:0/1757456350' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:44:21.087 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:44:20 smithi099 ceph-mon[24912]: from='mgr.14439 ' entity='mgr.y' 2024-03-30T13:44:21.087 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:44:20 smithi099 ceph-mon[29691]: from='mgr.14439 172.21.15.99:0/1757456350' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:44:21.087 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:44:20 smithi099 ceph-mon[29691]: from='mgr.14439 172.21.15.99:0/1757456350' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:44:21.087 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:44:20 smithi099 ceph-mon[29691]: from='mgr.14439 ' entity='mgr.y' 2024-03-30T13:44:22.256 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:44:21 smithi181 ceph-mon[25762]: pgmap v291: 161 pgs: 161 active+clean; 585 KiB data, 67 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T13:44:22.337 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:44:21 smithi099 ceph-mon[24912]: pgmap v291: 161 pgs: 161 active+clean; 585 KiB data, 67 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T13:44:22.337 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:44:21 smithi099 ceph-mon[29691]: pgmap v291: 161 pgs: 161 active+clean; 585 KiB data, 67 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T13:44:23.837 INFO:journalctl@ceph.alertmanager.a.smithi099.stdout:Mar 30 13:44:23 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-alertmanager-a[52107]: level=error ts=2024-03-30T13:44:23.530Z caller=dispatch.go:354 component=dispatcher msg="Notify for alerts failed" num_alerts=3 err="ceph-dashboard/webhook[1]: notify retry canceled after 7 attempts: Post \"https://172.21.15.181:8443/api/prometheus_receiver\": x509: cannot validate certificate for 172.21.15.181 because it doesn't contain any IP SANs; ceph-dashboard/webhook[0]: notify retry canceled after 8 attempts: Post \"https://172.21.15.99:8443//api/prometheus_receiver\": x509: cannot validate certificate for 172.21.15.99 because it doesn't contain any IP SANs" 2024-03-30T13:44:23.837 INFO:journalctl@ceph.alertmanager.a.smithi099.stdout:Mar 30 13:44:23 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-alertmanager-a[52107]: level=warn ts=2024-03-30T13:44:23.531Z caller=notify.go:724 component=dispatcher receiver=ceph-dashboard integration=webhook[0] msg="Notify attempt failed, will retry later" attempts=1 err="Post \"https://172.21.15.99:8443//api/prometheus_receiver\": x509: cannot validate certificate for 172.21.15.99 because it doesn't contain any IP SANs" 2024-03-30T13:44:23.837 INFO:journalctl@ceph.alertmanager.a.smithi099.stdout:Mar 30 13:44:23 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-alertmanager-a[52107]: level=warn ts=2024-03-30T13:44:23.532Z caller=notify.go:724 component=dispatcher receiver=ceph-dashboard integration=webhook[1] msg="Notify attempt failed, will retry later" attempts=1 err="Post \"https://172.21.15.181:8443/api/prometheus_receiver\": x509: cannot validate certificate for 172.21.15.181 because it doesn't contain any IP SANs" 2024-03-30T13:44:24.006 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:44:23 smithi181 ceph-mon[25762]: pgmap v292: 161 pgs: 161 active+clean; 585 KiB data, 67 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T13:44:24.289 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:44:23 smithi099 ceph-mon[24912]: pgmap v292: 161 pgs: 161 active+clean; 585 KiB data, 67 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T13:44:24.289 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:44:23 smithi099 ceph-mon[29691]: pgmap v292: 161 pgs: 161 active+clean; 585 KiB data, 67 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T13:44:25.087 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:44:24 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[25141]: 172.21.15.181 - - [30/Mar/2024:13:44:24] "POST /data HTTP/1.1" 200 46 "" "Python-urllib/3.9" 2024-03-30T13:44:26.131 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:44:25 smithi181 ceph-mon[25762]: pgmap v293: 161 pgs: 161 active+clean; 585 KiB data, 67 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T13:44:26.131 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:44:25 smithi181 ceph-mon[25762]: from='client.14838 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T13:44:26.131 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:44:25 smithi181 ceph-mon[25762]: from='mgr.14439 ' entity='mgr.y' 2024-03-30T13:44:26.131 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:44:25 smithi181 ceph-mon[25762]: from='mgr.14439 ' entity='mgr.y' 2024-03-30T13:44:26.337 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:44:25 smithi099 ceph-mon[24912]: pgmap v293: 161 pgs: 161 active+clean; 585 KiB data, 67 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T13:44:26.337 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:44:25 smithi099 ceph-mon[24912]: from='client.14838 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T13:44:26.337 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:44:25 smithi099 ceph-mon[24912]: from='mgr.14439 ' entity='mgr.y' 2024-03-30T13:44:26.337 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:44:25 smithi099 ceph-mon[24912]: from='mgr.14439 ' entity='mgr.y' 2024-03-30T13:44:26.338 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:44:25 smithi099 ceph-mon[29691]: pgmap v293: 161 pgs: 161 active+clean; 585 KiB data, 67 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T13:44:26.338 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:44:25 smithi099 ceph-mon[29691]: from='client.14838 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T13:44:26.338 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:44:25 smithi099 ceph-mon[29691]: from='mgr.14439 ' entity='mgr.y' 2024-03-30T13:44:26.338 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:44:25 smithi099 ceph-mon[29691]: from='mgr.14439 ' entity='mgr.y' 2024-03-30T13:44:27.087 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:44:26 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[25141]: ::ffff:172.21.15.181 - - [30/Mar/2024:13:44:26] "GET /metrics HTTP/1.1" 200 208049 "" "Prometheus/2.33.4" 2024-03-30T13:44:28.256 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:44:27 smithi181 ceph-mon[25762]: pgmap v294: 161 pgs: 161 active+clean; 585 KiB data, 67 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T13:44:28.337 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:44:27 smithi099 ceph-mon[24912]: pgmap v294: 161 pgs: 161 active+clean; 585 KiB data, 67 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T13:44:28.337 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:44:27 smithi099 ceph-mon[29691]: pgmap v294: 161 pgs: 161 active+clean; 585 KiB data, 67 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T13:44:28.837 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:44:28 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[25141]: 172.21.15.99 - - [30/Mar/2024:13:44:28] "POST /data HTTP/1.1" 200 46 "" "Python-urllib/3.9" 2024-03-30T13:44:29.756 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 13:44:29 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-x[50211]: ::ffff:172.21.15.181 - - [30/Mar/2024:13:44:29] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-03-30T13:44:29.756 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:44:29 smithi181 ceph-mon[25762]: pgmap v295: 161 pgs: 161 active+clean; 585 KiB data, 67 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T13:44:29.756 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:44:29 smithi181 ceph-mon[25762]: from='mgr.14439 ' entity='mgr.y' 2024-03-30T13:44:29.757 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:44:29 smithi181 ceph-mon[25762]: from='mgr.14439 ' entity='mgr.y' 2024-03-30T13:44:29.837 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:44:29 smithi099 ceph-mon[24912]: pgmap v295: 161 pgs: 161 active+clean; 585 KiB data, 67 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T13:44:29.837 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:44:29 smithi099 ceph-mon[24912]: from='mgr.14439 ' entity='mgr.y' 2024-03-30T13:44:29.837 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:44:29 smithi099 ceph-mon[24912]: from='mgr.14439 ' entity='mgr.y' 2024-03-30T13:44:29.837 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:44:29 smithi099 ceph-mon[29691]: pgmap v295: 161 pgs: 161 active+clean; 585 KiB data, 67 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T13:44:29.837 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:44:29 smithi099 ceph-mon[29691]: from='mgr.14439 ' entity='mgr.y' 2024-03-30T13:44:29.837 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:44:29 smithi099 ceph-mon[29691]: from='mgr.14439 ' entity='mgr.y' 2024-03-30T13:44:31.837 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:44:31 smithi099 ceph-mon[24912]: pgmap v296: 161 pgs: 161 active+clean; 585 KiB data, 67 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T13:44:31.837 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:44:31 smithi099 ceph-mon[29691]: pgmap v296: 161 pgs: 161 active+clean; 585 KiB data, 67 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T13:44:32.006 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:44:31 smithi181 ceph-mon[25762]: pgmap v296: 161 pgs: 161 active+clean; 585 KiB data, 67 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T13:44:33.837 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:44:33 smithi099 ceph-mon[24912]: pgmap v297: 161 pgs: 161 active+clean; 585 KiB data, 67 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T13:44:33.838 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:44:33 smithi099 ceph-mon[29691]: pgmap v297: 161 pgs: 161 active+clean; 585 KiB data, 67 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T13:44:33.838 INFO:journalctl@ceph.alertmanager.a.smithi099.stdout:Mar 30 13:44:33 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-alertmanager-a[52107]: level=error ts=2024-03-30T13:44:33.531Z caller=dispatch.go:354 component=dispatcher msg="Notify for alerts failed" num_alerts=3 err="ceph-dashboard/webhook[0]: notify retry canceled after 7 attempts: Post \"https://172.21.15.99:8443//api/prometheus_receiver\": x509: cannot validate certificate for 172.21.15.99 because it doesn't contain any IP SANs; ceph-dashboard/webhook[1]: notify retry canceled after 7 attempts: Post \"https://172.21.15.181:8443/api/prometheus_receiver\": x509: cannot validate certificate for 172.21.15.181 because it doesn't contain any IP SANs" 2024-03-30T13:44:33.838 INFO:journalctl@ceph.alertmanager.a.smithi099.stdout:Mar 30 13:44:33 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-alertmanager-a[52107]: level=warn ts=2024-03-30T13:44:33.533Z caller=notify.go:724 component=dispatcher receiver=ceph-dashboard integration=webhook[1] msg="Notify attempt failed, will retry later" attempts=1 err="Post \"https://172.21.15.181:8443/api/prometheus_receiver\": x509: cannot validate certificate for 172.21.15.181 because it doesn't contain any IP SANs" 2024-03-30T13:44:33.838 INFO:journalctl@ceph.alertmanager.a.smithi099.stdout:Mar 30 13:44:33 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-alertmanager-a[52107]: level=warn ts=2024-03-30T13:44:33.533Z caller=notify.go:724 component=dispatcher receiver=ceph-dashboard integration=webhook[0] msg="Notify attempt failed, will retry later" attempts=1 err="Post \"https://172.21.15.99:8443//api/prometheus_receiver\": x509: cannot validate certificate for 172.21.15.99 because it doesn't contain any IP SANs" 2024-03-30T13:44:34.006 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:44:33 smithi181 ceph-mon[25762]: pgmap v297: 161 pgs: 161 active+clean; 585 KiB data, 67 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T13:44:35.714 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:44:35 smithi099 ceph-mon[24912]: pgmap v298: 161 pgs: 161 active+clean; 585 KiB data, 67 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T13:44:35.714 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:44:35 smithi099 ceph-mon[24912]: from='client.14838 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T13:44:35.714 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:44:35 smithi099 ceph-mon[29691]: pgmap v298: 161 pgs: 161 active+clean; 585 KiB data, 67 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T13:44:35.714 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:44:35 smithi099 ceph-mon[29691]: from='client.14838 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T13:44:36.006 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:44:35 smithi181 ceph-mon[25762]: pgmap v298: 161 pgs: 161 active+clean; 585 KiB data, 67 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T13:44:36.006 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:44:35 smithi181 ceph-mon[25762]: from='client.14838 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T13:44:37.087 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:44:36 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[25141]: ::ffff:172.21.15.181 - - [30/Mar/2024:13:44:36] "GET /metrics HTTP/1.1" 200 208049 "" "Prometheus/2.33.4" 2024-03-30T13:44:38.006 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:44:37 smithi181 ceph-mon[25762]: pgmap v299: 161 pgs: 161 active+clean; 585 KiB data, 67 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T13:44:38.087 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:44:37 smithi099 ceph-mon[24912]: pgmap v299: 161 pgs: 161 active+clean; 585 KiB data, 67 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T13:44:38.087 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:44:37 smithi099 ceph-mon[29691]: pgmap v299: 161 pgs: 161 active+clean; 585 KiB data, 67 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T13:44:39.756 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:44:39 smithi181 ceph-mon[25762]: pgmap v300: 161 pgs: 161 active+clean; 585 KiB data, 67 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T13:44:39.756 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 13:44:39 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-x[50211]: ::ffff:172.21.15.181 - - [30/Mar/2024:13:44:39] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-03-30T13:44:40.087 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:44:39 smithi099 ceph-mon[24912]: pgmap v300: 161 pgs: 161 active+clean; 585 KiB data, 67 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T13:44:40.087 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:44:39 smithi099 ceph-mon[29691]: pgmap v300: 161 pgs: 161 active+clean; 585 KiB data, 67 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T13:44:42.006 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:44:41 smithi181 ceph-mon[25762]: pgmap v301: 161 pgs: 161 active+clean; 585 KiB data, 67 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T13:44:42.087 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:44:41 smithi099 ceph-mon[24912]: pgmap v301: 161 pgs: 161 active+clean; 585 KiB data, 67 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T13:44:42.087 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:44:41 smithi099 ceph-mon[29691]: pgmap v301: 161 pgs: 161 active+clean; 585 KiB data, 67 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T13:44:43.837 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:44:43 smithi099 ceph-mon[24912]: pgmap v302: 161 pgs: 161 active+clean; 585 KiB data, 67 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T13:44:43.837 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:44:43 smithi099 ceph-mon[29691]: pgmap v302: 161 pgs: 161 active+clean; 585 KiB data, 67 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T13:44:43.838 INFO:journalctl@ceph.alertmanager.a.smithi099.stdout:Mar 30 13:44:43 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-alertmanager-a[52107]: level=error ts=2024-03-30T13:44:43.532Z caller=dispatch.go:354 component=dispatcher msg="Notify for alerts failed" num_alerts=3 err="ceph-dashboard/webhook[0]: notify retry canceled after 7 attempts: Post \"https://172.21.15.99:8443//api/prometheus_receiver\": x509: cannot validate certificate for 172.21.15.99 because it doesn't contain any IP SANs; ceph-dashboard/webhook[1]: notify retry canceled after 8 attempts: Post \"https://172.21.15.181:8443/api/prometheus_receiver\": x509: cannot validate certificate for 172.21.15.181 because it doesn't contain any IP SANs" 2024-03-30T13:44:43.838 INFO:journalctl@ceph.alertmanager.a.smithi099.stdout:Mar 30 13:44:43 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-alertmanager-a[52107]: level=warn ts=2024-03-30T13:44:43.534Z caller=notify.go:724 component=dispatcher receiver=ceph-dashboard integration=webhook[0] msg="Notify attempt failed, will retry later" attempts=1 err="Post \"https://172.21.15.99:8443//api/prometheus_receiver\": x509: cannot validate certificate for 172.21.15.99 because it doesn't contain any IP SANs" 2024-03-30T13:44:43.838 INFO:journalctl@ceph.alertmanager.a.smithi099.stdout:Mar 30 13:44:43 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-alertmanager-a[52107]: level=warn ts=2024-03-30T13:44:43.534Z caller=notify.go:724 component=dispatcher receiver=ceph-dashboard integration=webhook[1] msg="Notify attempt failed, will retry later" attempts=1 err="Post \"https://172.21.15.181:8443/api/prometheus_receiver\": x509: cannot validate certificate for 172.21.15.181 because it doesn't contain any IP SANs" 2024-03-30T13:44:44.006 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:44:43 smithi181 ceph-mon[25762]: pgmap v302: 161 pgs: 161 active+clean; 585 KiB data, 67 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T13:44:45.259 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:44:44 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[25141]: 172.21.15.181 - - [30/Mar/2024:13:44:44] "POST /data HTTP/1.1" 200 46 "" "Python-urllib/3.9" 2024-03-30T13:44:45.638 DEBUG:teuthology.orchestra.run.smithi099:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 98ebaeb8-ee99-11ee-b647-cb9ed24678a4 -e sha1=4e50bbcdd1630c7760b708f3a5b4d38a121e66cb -- bash -c 'ceph orch ps' 2024-03-30T13:44:46.066 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:44:45 smithi181 ceph-mon[25762]: pgmap v303: 161 pgs: 161 active+clean; 585 KiB data, 67 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T13:44:46.066 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:44:45 smithi181 ceph-mon[25762]: from='client.14838 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T13:44:46.066 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:44:45 smithi181 ceph-mon[25762]: from='mgr.14439 ' entity='mgr.y' 2024-03-30T13:44:46.066 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:44:45 smithi181 ceph-mon[25762]: from='mgr.14439 ' entity='mgr.y' 2024-03-30T13:44:46.279 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:44:45 smithi099 ceph-mon[24912]: pgmap v303: 161 pgs: 161 active+clean; 585 KiB data, 67 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T13:44:46.279 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:44:45 smithi099 ceph-mon[24912]: from='client.14838 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T13:44:46.279 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:44:45 smithi099 ceph-mon[24912]: from='mgr.14439 ' entity='mgr.y' 2024-03-30T13:44:46.280 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:44:45 smithi099 ceph-mon[24912]: from='mgr.14439 ' entity='mgr.y' 2024-03-30T13:44:46.280 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:44:45 smithi099 ceph-mon[29691]: pgmap v303: 161 pgs: 161 active+clean; 585 KiB data, 67 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T13:44:46.280 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:44:45 smithi099 ceph-mon[29691]: from='client.14838 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T13:44:46.280 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:44:45 smithi099 ceph-mon[29691]: from='mgr.14439 ' entity='mgr.y' 2024-03-30T13:44:46.280 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:44:45 smithi099 ceph-mon[29691]: from='mgr.14439 ' entity='mgr.y' 2024-03-30T13:44:46.899 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:44:46 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[25141]: ::ffff:172.21.15.181 - - [30/Mar/2024:13:44:46] "GET /metrics HTTP/1.1" 200 208045 "" "Prometheus/2.33.4" 2024-03-30T13:44:47.551 INFO:teuthology.orchestra.run.smithi099.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-03-30T13:44:47.552 INFO:teuthology.orchestra.run.smithi099.stdout:agent.smithi099 smithi099 running 19s ago 13m - - 2024-03-30T13:44:47.552 INFO:teuthology.orchestra.run.smithi099.stdout:agent.smithi181 smithi181 running 2s ago 12m - - 2024-03-30T13:44:47.552 INFO:teuthology.orchestra.run.smithi099.stdout:alertmanager.a smithi099 *:9093,9094 running (6m) 19s ago 7m 26.3M - ba2b418f427c 8804d597845b 2024-03-30T13:44:47.552 INFO:teuthology.orchestra.run.smithi099.stdout:grafana.a smithi181 *:3000 running (6m) 2s ago 6m 56.8M - 8.3.5 dad864ee21e9 084559d00328 2024-03-30T13:44:47.552 INFO:teuthology.orchestra.run.smithi099.stdout:iscsi.foo.smithi099.qyjuvr smithi099 running (6m) 19s ago 6m 49.3M - 3.5 e1d6a67b021e b426fa245c2a 2024-03-30T13:44:47.552 INFO:teuthology.orchestra.run.smithi099.stdout:mgr.x smithi181 *:8443,9283 running (2m) 2s ago 12m 451M - 19.0.0-1967-g4e50bbcd b0c4478f1d83 f3d971ab3b10 2024-03-30T13:44:47.552 INFO:teuthology.orchestra.run.smithi099.stdout:mgr.y smithi099 *:9283 running (13m) 19s ago 13m 473M - 17.2.0 e1d6a67b021e db3430cee99a 2024-03-30T13:44:47.552 INFO:teuthology.orchestra.run.smithi099.stdout:mon.a smithi099 running (13m) 19s ago 14m 56.9M 2048M 17.2.0 e1d6a67b021e af06ebb19fd8 2024-03-30T13:44:47.552 INFO:teuthology.orchestra.run.smithi099.stdout:mon.b smithi181 running (12m) 2s ago 12m 44.6M 2048M 17.2.0 e1d6a67b021e e678a2a25c90 2024-03-30T13:44:47.552 INFO:teuthology.orchestra.run.smithi099.stdout:mon.c smithi099 running (12m) 19s ago 12m 44.8M 2048M 17.2.0 e1d6a67b021e 0f1e98917718 2024-03-30T13:44:47.553 INFO:teuthology.orchestra.run.smithi099.stdout:node-exporter.a smithi099 *:9100 running (8m) 19s ago 8m 17.0M - 1dbe0e931976 ad756dd8c3f9 2024-03-30T13:44:47.553 INFO:teuthology.orchestra.run.smithi099.stdout:node-exporter.b smithi181 *:9100 running (8m) 2s ago 8m 16.8M - 1dbe0e931976 5a3d4484d23a 2024-03-30T13:44:47.553 INFO:teuthology.orchestra.run.smithi099.stdout:osd.0 smithi099 running (11m) 19s ago 11m 50.8M 4096M 17.2.0 e1d6a67b021e 3158ee1b0c67 2024-03-30T13:44:47.553 INFO:teuthology.orchestra.run.smithi099.stdout:osd.1 smithi099 running (11m) 19s ago 11m 53.7M 4096M 17.2.0 e1d6a67b021e c4af0fd7071a 2024-03-30T13:44:47.553 INFO:teuthology.orchestra.run.smithi099.stdout:osd.2 smithi099 running (11m) 19s ago 11m 47.0M 4096M 17.2.0 e1d6a67b021e 8e4e805a7e20 2024-03-30T13:44:47.553 INFO:teuthology.orchestra.run.smithi099.stdout:osd.3 smithi099 running (10m) 19s ago 10m 50.0M 4096M 17.2.0 e1d6a67b021e 718812bcf065 2024-03-30T13:44:47.553 INFO:teuthology.orchestra.run.smithi099.stdout:osd.4 smithi181 running (10m) 2s ago 10m 49.9M 4096M 17.2.0 e1d6a67b021e 5e205434e973 2024-03-30T13:44:47.553 INFO:teuthology.orchestra.run.smithi099.stdout:osd.5 smithi181 running (10m) 2s ago 10m 48.3M 4096M 17.2.0 e1d6a67b021e e330c920f152 2024-03-30T13:44:47.553 INFO:teuthology.orchestra.run.smithi099.stdout:osd.6 smithi181 running (9m) 2s ago 9m 46.7M 4096M 17.2.0 e1d6a67b021e 81d889ea213d 2024-03-30T13:44:47.553 INFO:teuthology.orchestra.run.smithi099.stdout:osd.7 smithi181 running (9m) 2s ago 9m 48.5M 4096M 17.2.0 e1d6a67b021e c08b1839dd7e 2024-03-30T13:44:47.553 INFO:teuthology.orchestra.run.smithi099.stdout:prometheus.a smithi181 *:9095 running (6m) 2s ago 8m 69.5M - 514e6a882f6e 9fa29bb6baba 2024-03-30T13:44:47.553 INFO:teuthology.orchestra.run.smithi099.stdout:rgw.foo.smithi099.fxjbmp smithi099 *:8000 running (6m) 19s ago 6m 70.9M - 17.2.0 e1d6a67b021e 400b28b3f650 2024-03-30T13:44:47.553 INFO:teuthology.orchestra.run.smithi099.stdout:rgw.foo.smithi181.wfqwti smithi181 *:8000 running (6m) 2s ago 6m 70.6M - 17.2.0 e1d6a67b021e 97e1b130f9d4 2024-03-30T13:44:48.190 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:44:47 smithi099 ceph-mon[24912]: pgmap v304: 161 pgs: 161 active+clean; 585 KiB data, 67 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T13:44:48.191 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:44:47 smithi099 ceph-mon[29691]: pgmap v304: 161 pgs: 161 active+clean; 585 KiB data, 67 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T13:44:48.213 DEBUG:teuthology.orchestra.run.smithi099:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 98ebaeb8-ee99-11ee-b647-cb9ed24678a4 -e sha1=4e50bbcdd1630c7760b708f3a5b4d38a121e66cb -- bash -c 'ceph versions' 2024-03-30T13:44:48.256 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:44:47 smithi181 ceph-mon[25762]: pgmap v304: 161 pgs: 161 active+clean; 585 KiB data, 67 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T13:44:48.812 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:44:48 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[25141]: 172.21.15.99 - - [30/Mar/2024:13:44:48] "POST /data HTTP/1.1" 200 46 "" "Python-urllib/3.9" 2024-03-30T13:44:49.087 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:44:48 smithi099 ceph-mon[24912]: from='client.15012 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T13:44:49.087 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:44:48 smithi099 ceph-mon[24912]: from='mgr.14439 ' entity='mgr.y' 2024-03-30T13:44:49.087 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:44:48 smithi099 ceph-mon[24912]: from='mgr.14439 ' entity='mgr.y' 2024-03-30T13:44:49.087 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:44:48 smithi099 ceph-mon[29691]: from='client.15012 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T13:44:49.088 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:44:48 smithi099 ceph-mon[29691]: from='mgr.14439 ' entity='mgr.y' 2024-03-30T13:44:49.088 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:44:48 smithi099 ceph-mon[29691]: from='mgr.14439 ' entity='mgr.y' 2024-03-30T13:44:49.256 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:44:48 smithi181 ceph-mon[25762]: from='client.15012 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T13:44:49.256 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:44:48 smithi181 ceph-mon[25762]: from='mgr.14439 ' entity='mgr.y' 2024-03-30T13:44:49.256 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:44:48 smithi181 ceph-mon[25762]: from='mgr.14439 ' entity='mgr.y' 2024-03-30T13:44:49.756 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 13:44:49 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-x[50211]: ::ffff:172.21.15.181 - - [30/Mar/2024:13:44:49] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-03-30T13:44:50.256 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:44:49 smithi181 ceph-mon[25762]: pgmap v305: 161 pgs: 161 active+clean; 585 KiB data, 67 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T13:44:50.337 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:44:49 smithi099 ceph-mon[24912]: pgmap v305: 161 pgs: 161 active+clean; 585 KiB data, 67 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T13:44:50.337 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:44:49 smithi099 ceph-mon[29691]: pgmap v305: 161 pgs: 161 active+clean; 585 KiB data, 67 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T13:44:50.337 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-03-30T13:44:50.338 INFO:teuthology.orchestra.run.smithi099.stdout: "mon": { 2024-03-30T13:44:50.338 INFO:teuthology.orchestra.run.smithi099.stdout: "ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)": 3 2024-03-30T13:44:50.338 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:44:50.338 INFO:teuthology.orchestra.run.smithi099.stdout: "mgr": { 2024-03-30T13:44:50.338 INFO:teuthology.orchestra.run.smithi099.stdout: "ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)": 1, 2024-03-30T13:44:50.338 INFO:teuthology.orchestra.run.smithi099.stdout: "ceph version 19.0.0-1967-g4e50bbcd (4e50bbcdd1630c7760b708f3a5b4d38a121e66cb) squid (dev)": 1 2024-03-30T13:44:50.338 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:44:50.338 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": { 2024-03-30T13:44:50.338 INFO:teuthology.orchestra.run.smithi099.stdout: "ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)": 8 2024-03-30T13:44:50.338 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:44:50.338 INFO:teuthology.orchestra.run.smithi099.stdout: "mds": {}, 2024-03-30T13:44:50.338 INFO:teuthology.orchestra.run.smithi099.stdout: "rgw": { 2024-03-30T13:44:50.338 INFO:teuthology.orchestra.run.smithi099.stdout: "ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)": 2 2024-03-30T13:44:50.339 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:44:50.339 INFO:teuthology.orchestra.run.smithi099.stdout: "overall": { 2024-03-30T13:44:50.339 INFO:teuthology.orchestra.run.smithi099.stdout: "ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)": 14, 2024-03-30T13:44:50.339 INFO:teuthology.orchestra.run.smithi099.stdout: "ceph version 19.0.0-1967-g4e50bbcd (4e50bbcdd1630c7760b708f3a5b4d38a121e66cb) squid (dev)": 1 2024-03-30T13:44:50.339 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-03-30T13:44:50.339 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-03-30T13:44:51.017 DEBUG:teuthology.orchestra.run.smithi099:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 98ebaeb8-ee99-11ee-b647-cb9ed24678a4 -e sha1=4e50bbcdd1630c7760b708f3a5b4d38a121e66cb -- bash -c 'ceph -s' 2024-03-30T13:44:51.256 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:44:50 smithi181 ceph-mon[25762]: from='client.? 172.21.15.99:0/3652884894' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:44:51.324 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:44:50 smithi099 ceph-mon[24912]: from='client.? 172.21.15.99:0/3652884894' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:44:51.324 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:44:50 smithi099 ceph-mon[29691]: from='client.? 172.21.15.99:0/3652884894' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:44:52.249 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:44:51 smithi099 ceph-mon[24912]: pgmap v306: 161 pgs: 161 active+clean; 585 KiB data, 67 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T13:44:52.250 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:44:51 smithi099 ceph-mon[29691]: pgmap v306: 161 pgs: 161 active+clean; 585 KiB data, 67 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T13:44:52.256 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:44:51 smithi181 ceph-mon[25762]: pgmap v306: 161 pgs: 161 active+clean; 585 KiB data, 67 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T13:44:52.944 INFO:teuthology.orchestra.run.smithi099.stdout: cluster: 2024-03-30T13:44:52.944 INFO:teuthology.orchestra.run.smithi099.stdout: id: 98ebaeb8-ee99-11ee-b647-cb9ed24678a4 2024-03-30T13:44:52.944 INFO:teuthology.orchestra.run.smithi099.stdout: health: HEALTH_OK 2024-03-30T13:44:52.944 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-03-30T13:44:52.944 INFO:teuthology.orchestra.run.smithi099.stdout: services: 2024-03-30T13:44:52.944 INFO:teuthology.orchestra.run.smithi099.stdout: mon: 3 daemons, quorum a,c,b (age 12m) 2024-03-30T13:44:52.944 INFO:teuthology.orchestra.run.smithi099.stdout: mgr: y(active, since 8m), standbys: x 2024-03-30T13:44:52.945 INFO:teuthology.orchestra.run.smithi099.stdout: osd: 8 osds: 8 up (since 9m), 8 in (since 9m) 2024-03-30T13:44:52.945 INFO:teuthology.orchestra.run.smithi099.stdout: rgw: 2 daemons active (2 hosts, 1 zones) 2024-03-30T13:44:52.945 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-03-30T13:44:52.945 INFO:teuthology.orchestra.run.smithi099.stdout: data: 2024-03-30T13:44:52.945 INFO:teuthology.orchestra.run.smithi099.stdout: pools: 6 pools, 161 pgs 2024-03-30T13:44:52.945 INFO:teuthology.orchestra.run.smithi099.stdout: objects: 209 objects, 585 KiB 2024-03-30T13:44:52.945 INFO:teuthology.orchestra.run.smithi099.stdout: usage: 67 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:44:52.945 INFO:teuthology.orchestra.run.smithi099.stdout: pgs: 161 active+clean 2024-03-30T13:44:52.945 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-03-30T13:44:52.945 INFO:teuthology.orchestra.run.smithi099.stdout: io: 2024-03-30T13:44:52.945 INFO:teuthology.orchestra.run.smithi099.stdout: client: 853 B/s rd, 0 op/s rd, 0 op/s wr 2024-03-30T13:44:52.945 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-03-30T13:44:53.256 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:44:52 smithi181 ceph-mon[25762]: from='client.? 172.21.15.99:0/3225315345' entity='client.admin' cmd=[{"prefix": "status"}]: dispatch 2024-03-30T13:44:53.316 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:44:52 smithi099 ceph-mon[24912]: from='client.? 172.21.15.99:0/3225315345' entity='client.admin' cmd=[{"prefix": "status"}]: dispatch 2024-03-30T13:44:53.316 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:44:52 smithi099 ceph-mon[29691]: from='client.? 172.21.15.99:0/3225315345' entity='client.admin' cmd=[{"prefix": "status"}]: dispatch 2024-03-30T13:44:53.587 INFO:journalctl@ceph.alertmanager.a.smithi099.stdout:Mar 30 13:44:53 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-alertmanager-a[52107]: level=error ts=2024-03-30T13:44:53.532Z caller=dispatch.go:354 component=dispatcher msg="Notify for alerts failed" num_alerts=3 err="ceph-dashboard/webhook[1]: notify retry canceled after 7 attempts: Post \"https://172.21.15.181:8443/api/prometheus_receiver\": x509: cannot validate certificate for 172.21.15.181 because it doesn't contain any IP SANs; ceph-dashboard/webhook[0]: notify retry canceled after 8 attempts: Post \"https://172.21.15.99:8443//api/prometheus_receiver\": x509: cannot validate certificate for 172.21.15.99 because it doesn't contain any IP SANs" 2024-03-30T13:44:53.587 INFO:journalctl@ceph.alertmanager.a.smithi099.stdout:Mar 30 13:44:53 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-alertmanager-a[52107]: level=warn ts=2024-03-30T13:44:53.535Z caller=notify.go:724 component=dispatcher receiver=ceph-dashboard integration=webhook[0] msg="Notify attempt failed, will retry later" attempts=1 err="Post \"https://172.21.15.99:8443//api/prometheus_receiver\": x509: cannot validate certificate for 172.21.15.99 because it doesn't contain any IP SANs" 2024-03-30T13:44:53.587 INFO:journalctl@ceph.alertmanager.a.smithi099.stdout:Mar 30 13:44:53 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-alertmanager-a[52107]: level=warn ts=2024-03-30T13:44:53.535Z caller=notify.go:724 component=dispatcher receiver=ceph-dashboard integration=webhook[1] msg="Notify attempt failed, will retry later" attempts=1 err="Post \"https://172.21.15.181:8443/api/prometheus_receiver\": x509: cannot validate certificate for 172.21.15.181 because it doesn't contain any IP SANs" 2024-03-30T13:44:53.639 DEBUG:teuthology.orchestra.run.smithi099:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 98ebaeb8-ee99-11ee-b647-cb9ed24678a4 -e sha1=4e50bbcdd1630c7760b708f3a5b4d38a121e66cb -- bash -c 'ceph health detail' 2024-03-30T13:44:54.256 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:44:53 smithi181 ceph-mon[25762]: pgmap v307: 161 pgs: 161 active+clean; 585 KiB data, 67 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T13:44:54.337 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:44:53 smithi099 ceph-mon[24912]: pgmap v307: 161 pgs: 161 active+clean; 585 KiB data, 67 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T13:44:54.337 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:44:53 smithi099 ceph-mon[29691]: pgmap v307: 161 pgs: 161 active+clean; 585 KiB data, 67 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T13:44:56.244 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:44:55 smithi099 ceph-mon[24912]: pgmap v308: 161 pgs: 161 active+clean; 585 KiB data, 67 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T13:44:56.244 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:44:55 smithi099 ceph-mon[24912]: from='client.14838 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T13:44:56.244 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:44:55 smithi099 ceph-mon[29691]: pgmap v308: 161 pgs: 161 active+clean; 585 KiB data, 67 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T13:44:56.245 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:44:55 smithi099 ceph-mon[29691]: from='client.14838 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T13:44:56.256 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:44:55 smithi181 ceph-mon[25762]: pgmap v308: 161 pgs: 161 active+clean; 585 KiB data, 67 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T13:44:56.256 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:44:55 smithi181 ceph-mon[25762]: from='client.14838 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T13:44:56.837 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:44:56 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[25141]: ::ffff:172.21.15.181 - - [30/Mar/2024:13:44:56] "GET /metrics HTTP/1.1" 200 208045 "" "Prometheus/2.33.4" 2024-03-30T13:44:57.670 INFO:teuthology.orchestra.run.smithi099.stdout:HEALTH_OK 2024-03-30T13:44:58.256 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:44:57 smithi181 ceph-mon[25762]: pgmap v309: 161 pgs: 161 active+clean; 585 KiB data, 67 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T13:44:58.256 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:44:57 smithi181 ceph-mon[25762]: from='client.? 172.21.15.99:0/1119639615' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-03-30T13:44:58.323 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:44:57 smithi099 ceph-mon[24912]: pgmap v309: 161 pgs: 161 active+clean; 585 KiB data, 67 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T13:44:58.323 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:44:57 smithi099 ceph-mon[24912]: from='client.? 172.21.15.99:0/1119639615' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-03-30T13:44:58.323 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:44:57 smithi099 ceph-mon[29691]: pgmap v309: 161 pgs: 161 active+clean; 585 KiB data, 67 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T13:44:58.323 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:44:57 smithi099 ceph-mon[29691]: from='client.? 172.21.15.99:0/1119639615' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-03-30T13:44:58.347 DEBUG:teuthology.orchestra.run.smithi099:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 98ebaeb8-ee99-11ee-b647-cb9ed24678a4 -e sha1=4e50bbcdd1630c7760b708f3a5b4d38a121e66cb -- bash -c 'ceph versions | jq -e '"'"'.mgr | length == 2'"'"'' 2024-03-30T13:44:59.756 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 13:44:59 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-x[50211]: ::ffff:172.21.15.181 - - [30/Mar/2024:13:44:59] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-03-30T13:45:00.256 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:44:59 smithi181 ceph-mon[25762]: pgmap v310: 161 pgs: 161 active+clean; 585 KiB data, 67 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T13:45:00.256 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:44:59 smithi181 ceph-mon[25762]: from='mgr.14439 172.21.15.99:0/1757456350' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-03-30T13:45:00.256 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:44:59 smithi181 ceph-mon[25762]: from='mgr.14439 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-03-30T13:45:00.256 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:44:59 smithi181 ceph-mon[25762]: from='mgr.14439 172.21.15.99:0/1757456350' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-03-30T13:45:00.257 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:44:59 smithi181 ceph-mon[25762]: from='mgr.14439 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-03-30T13:45:00.337 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:44:59 smithi099 ceph-mon[29691]: pgmap v310: 161 pgs: 161 active+clean; 585 KiB data, 67 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T13:45:00.337 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:44:59 smithi099 ceph-mon[29691]: from='mgr.14439 172.21.15.99:0/1757456350' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-03-30T13:45:00.337 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:44:59 smithi099 ceph-mon[29691]: from='mgr.14439 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-03-30T13:45:00.337 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:44:59 smithi099 ceph-mon[29691]: from='mgr.14439 172.21.15.99:0/1757456350' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-03-30T13:45:00.337 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:44:59 smithi099 ceph-mon[29691]: from='mgr.14439 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-03-30T13:45:00.338 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:44:59 smithi099 ceph-mon[24912]: pgmap v310: 161 pgs: 161 active+clean; 585 KiB data, 67 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T13:45:00.338 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:44:59 smithi099 ceph-mon[24912]: from='mgr.14439 172.21.15.99:0/1757456350' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-03-30T13:45:00.338 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:44:59 smithi099 ceph-mon[24912]: from='mgr.14439 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-03-30T13:45:00.338 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:44:59 smithi099 ceph-mon[24912]: from='mgr.14439 172.21.15.99:0/1757456350' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-03-30T13:45:00.338 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:44:59 smithi099 ceph-mon[24912]: from='mgr.14439 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-03-30T13:45:00.430 INFO:teuthology.orchestra.run.smithi099.stdout:true 2024-03-30T13:45:01.070 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:45:00 smithi099 ceph-mon[24912]: from='client.? 172.21.15.99:0/3792648098' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:45:01.071 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:45:00 smithi099 ceph-mon[29691]: from='client.? 172.21.15.99:0/3792648098' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:45:01.094 DEBUG:teuthology.orchestra.run.smithi099:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 98ebaeb8-ee99-11ee-b647-cb9ed24678a4 -e sha1=4e50bbcdd1630c7760b708f3a5b4d38a121e66cb -- bash -c 'ceph mgr fail' 2024-03-30T13:45:01.256 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:45:00 smithi181 ceph-mon[25762]: from='client.? 172.21.15.99:0/3792648098' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:45:02.256 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:45:01 smithi181 ceph-mon[25762]: pgmap v311: 161 pgs: 161 active+clean; 585 KiB data, 67 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T13:45:02.337 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:45:01 smithi099 ceph-mon[24912]: pgmap v311: 161 pgs: 161 active+clean; 585 KiB data, 67 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T13:45:02.337 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:45:01 smithi099 ceph-mon[29691]: pgmap v311: 161 pgs: 161 active+clean; 585 KiB data, 67 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T13:45:03.837 INFO:journalctl@ceph.alertmanager.a.smithi099.stdout:Mar 30 13:45:03 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-alertmanager-a[52107]: level=error ts=2024-03-30T13:45:03.533Z caller=dispatch.go:354 component=dispatcher msg="Notify for alerts failed" num_alerts=3 err="ceph-dashboard/webhook[1]: notify retry canceled after 7 attempts: Post \"https://172.21.15.181:8443/api/prometheus_receiver\": x509: cannot validate certificate for 172.21.15.181 because it doesn't contain any IP SANs; ceph-dashboard/webhook[0]: notify retry canceled after 8 attempts: Post \"https://172.21.15.99:8443//api/prometheus_receiver\": x509: cannot validate certificate for 172.21.15.99 because it doesn't contain any IP SANs" 2024-03-30T13:45:03.837 INFO:journalctl@ceph.alertmanager.a.smithi099.stdout:Mar 30 13:45:03 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-alertmanager-a[52107]: level=warn ts=2024-03-30T13:45:03.535Z caller=notify.go:724 component=dispatcher receiver=ceph-dashboard integration=webhook[0] msg="Notify attempt failed, will retry later" attempts=1 err="Post \"https://172.21.15.99:8443//api/prometheus_receiver\": x509: cannot validate certificate for 172.21.15.99 because it doesn't contain any IP SANs" 2024-03-30T13:45:03.837 INFO:journalctl@ceph.alertmanager.a.smithi099.stdout:Mar 30 13:45:03 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-alertmanager-a[52107]: level=warn ts=2024-03-30T13:45:03.536Z caller=notify.go:724 component=dispatcher receiver=ceph-dashboard integration=webhook[1] msg="Notify attempt failed, will retry later" attempts=1 err="Post \"https://172.21.15.181:8443/api/prometheus_receiver\": x509: cannot validate certificate for 172.21.15.181 because it doesn't contain any IP SANs" 2024-03-30T13:45:04.248 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:45:03 smithi099 ceph-mon[24912]: pgmap v312: 161 pgs: 161 active+clean; 585 KiB data, 67 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T13:45:04.248 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:45:03 smithi099 ceph-mon[24912]: from='client.? 172.21.15.99:0/2763315794' entity='client.admin' cmd=[{"prefix": "mgr fail"}]: dispatch 2024-03-30T13:45:04.248 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:45:03 smithi099 ceph-mon[24912]: from='client.? ' entity='client.admin' cmd=[{"prefix": "mgr fail"}]: dispatch 2024-03-30T13:45:04.248 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:45:03 smithi099 ceph-mon[24912]: osdmap e96: 8 total, 8 up, 8 in 2024-03-30T13:45:04.248 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:45:03 smithi099 ceph-mon[29691]: pgmap v312: 161 pgs: 161 active+clean; 585 KiB data, 67 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T13:45:04.248 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:45:03 smithi099 ceph-mon[29691]: from='client.? 172.21.15.99:0/2763315794' entity='client.admin' cmd=[{"prefix": "mgr fail"}]: dispatch 2024-03-30T13:45:04.249 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:45:03 smithi099 ceph-mon[29691]: from='client.? ' entity='client.admin' cmd=[{"prefix": "mgr fail"}]: dispatch 2024-03-30T13:45:04.249 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:45:03 smithi099 ceph-mon[29691]: osdmap e96: 8 total, 8 up, 8 in 2024-03-30T13:45:04.249 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:45:04 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[25141]: 2024-03-30T13:45:04.005+0000 7f937f564700 -1 mgr handle_mgr_map I was active but no longer amignoring --setuser ceph since I am not root 2024-03-30T13:45:04.249 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:45:04 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[25141]: ignoring --setgroup ceph since I am not root 2024-03-30T13:45:04.249 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:45:04 smithi099 ceph-mgr[25145]: -- 172.21.15.99:0/3457160473 <== mon.0 v2:172.21.15.99:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55b813d06340 con 0x55b813cde800 2024-03-30T13:45:04.256 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:45:03 smithi181 ceph-mon[25762]: pgmap v312: 161 pgs: 161 active+clean; 585 KiB data, 67 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T13:45:04.256 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:45:03 smithi181 ceph-mon[25762]: from='client.? 172.21.15.99:0/2763315794' entity='client.admin' cmd=[{"prefix": "mgr fail"}]: dispatch 2024-03-30T13:45:04.256 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:45:03 smithi181 ceph-mon[25762]: from='client.? ' entity='client.admin' cmd=[{"prefix": "mgr fail"}]: dispatch 2024-03-30T13:45:04.256 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:45:03 smithi181 ceph-mon[25762]: osdmap e96: 8 total, 8 up, 8 in 2024-03-30T13:45:04.257 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 13:45:04 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-x[50211]: [30/Mar/2024:13:45:04] ENGINE Bus STOPPING 2024-03-30T13:45:04.257 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 13:45:04 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-x[50211]: [30/Mar/2024:13:45:04] ENGINE HTTP Server cherrypy._cpwsgi_server.CPWSGIServer(('::', 9283)) shut down 2024-03-30T13:45:04.257 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 13:45:04 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-x[50211]: [30/Mar/2024:13:45:04] ENGINE Bus STOPPED 2024-03-30T13:45:04.257 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 13:45:04 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-x[50211]: [30/Mar/2024:13:45:04] ENGINE Bus STARTING 2024-03-30T13:45:04.257 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 13:45:04 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-x[50211]: [30/Mar/2024:13:45:04] ENGINE Serving on http://:::9283 2024-03-30T13:45:04.257 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 13:45:04 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-x[50211]: [30/Mar/2024:13:45:04] ENGINE Bus STARTED 2024-03-30T13:45:04.790 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:45:04 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[25141]: 2024-03-30T13:45:04.529+0000 7f6a49564000 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-03-30T13:45:04.790 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:45:04 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[25141]: 2024-03-30T13:45:04.622+0000 7f6a49564000 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-03-30T13:45:04.790 INFO:journalctl@ceph.alertmanager.a.smithi099.stdout:Mar 30 13:45:04 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-alertmanager-a[52107]: level=warn ts=2024-03-30T13:45:04.616Z caller=notify.go:724 component=dispatcher receiver=ceph-dashboard integration=webhook[0] msg="Notify attempt failed, will retry later" attempts=3 err="Post \"https://172.21.15.99:8443//api/prometheus_receiver\": dial tcp 172.21.15.99:8443: connect: connection refused" 2024-03-30T13:45:04.792 DEBUG:teuthology.orchestra.run.smithi099:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 98ebaeb8-ee99-11ee-b647-cb9ed24678a4 -e sha1=4e50bbcdd1630c7760b708f3a5b4d38a121e66cb -- bash -c 'sleep 180' 2024-03-30T13:45:05.087 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:45:05 smithi099 ceph-mon[24912]: from='client.? ' entity='client.admin' cmd='[{"prefix": "mgr fail"}]': finished 2024-03-30T13:45:05.087 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:45:05 smithi099 ceph-mon[24912]: mgrmap e22: x(active, starting, since 0.990616s) 2024-03-30T13:45:05.087 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:45:05 smithi099 ceph-mon[24912]: from='mgr.24746 172.21.15.181:0/2892154077' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-03-30T13:45:05.087 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:45:05 smithi099 ceph-mon[24912]: from='mgr.24746 172.21.15.181:0/2892154077' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-30T13:45:05.088 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:45:05 smithi099 ceph-mon[24912]: from='mgr.24746 172.21.15.181:0/2892154077' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-30T13:45:05.088 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:45:05 smithi099 ceph-mon[24912]: from='mgr.24746 172.21.15.181:0/2892154077' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-03-30T13:45:05.088 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:45:05 smithi099 ceph-mon[24912]: from='mgr.24746 172.21.15.181:0/2892154077' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-03-30T13:45:05.088 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:45:05 smithi099 ceph-mon[24912]: from='mgr.24746 172.21.15.181:0/2892154077' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-03-30T13:45:05.088 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:45:05 smithi099 ceph-mon[24912]: from='mgr.24746 172.21.15.181:0/2892154077' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-03-30T13:45:05.088 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:45:05 smithi099 ceph-mon[24912]: from='mgr.24746 172.21.15.181:0/2892154077' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-03-30T13:45:05.088 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:45:05 smithi099 ceph-mon[24912]: from='mgr.24746 172.21.15.181:0/2892154077' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-03-30T13:45:05.088 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:45:05 smithi099 ceph-mon[24912]: from='mgr.24746 172.21.15.181:0/2892154077' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-03-30T13:45:05.088 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:45:05 smithi099 ceph-mon[24912]: from='mgr.24746 172.21.15.181:0/2892154077' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-03-30T13:45:05.088 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:45:05 smithi099 ceph-mon[24912]: from='mgr.24746 172.21.15.181:0/2892154077' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-03-30T13:45:05.088 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:45:05 smithi099 ceph-mon[24912]: from='mgr.24746 172.21.15.181:0/2892154077' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-03-30T13:45:05.088 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:45:05 smithi099 ceph-mon[24912]: from='mgr.24746 172.21.15.181:0/2892154077' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-03-30T13:45:05.088 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:45:05 smithi099 ceph-mon[24912]: from='mgr.24746 172.21.15.181:0/2892154077' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-03-30T13:45:05.088 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:45:05 smithi099 ceph-mon[24912]: Manager daemon x is now available 2024-03-30T13:45:05.089 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:45:05 smithi099 ceph-mon[24912]: from='mgr.24746 ' entity='mgr.x' 2024-03-30T13:45:05.089 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:45:05 smithi099 ceph-mon[24912]: Queued rgw.foo for migration 2024-03-30T13:45:05.089 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:45:05 smithi099 ceph-mon[24912]: No Migration is needed for rgw spec: {'placement': {'count': 2}, 'service_id': 'foo', 'service_name': 'rgw.foo', 'service_type': 'rgw', 'spec': {'rgw_frontend_port': 8000, 'rgw_realm': 'r', 'rgw_zone': 'z'}} 2024-03-30T13:45:05.089 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:45:05 smithi099 ceph-mon[24912]: from='mgr.24746 ' entity='mgr.x' 2024-03-30T13:45:05.089 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:45:05 smithi099 ceph-mon[24912]: from='mgr.24746 ' entity='mgr.x' 2024-03-30T13:45:05.089 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:45:05 smithi099 ceph-mon[24912]: from='mgr.24746 172.21.15.181:0/2892154077' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi181", "name": "osd_memory_target"}]: dispatch 2024-03-30T13:45:05.089 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:45:05 smithi099 ceph-mon[24912]: from='mgr.24746 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi181", "name": "osd_memory_target"}]: dispatch 2024-03-30T13:45:05.089 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:45:05 smithi099 ceph-mon[24912]: from='mgr.24746 172.21.15.181:0/2892154077' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi099", "name": "osd_memory_target"}]: dispatch 2024-03-30T13:45:05.089 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:45:05 smithi099 ceph-mon[24912]: from='mgr.24746 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi099", "name": "osd_memory_target"}]: dispatch 2024-03-30T13:45:05.089 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:45:05 smithi099 ceph-mon[24912]: from='mgr.24746 172.21.15.181:0/2892154077' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:45:05.089 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:45:05 smithi099 ceph-mon[29691]: from='client.? ' entity='client.admin' cmd='[{"prefix": "mgr fail"}]': finished 2024-03-30T13:45:05.090 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:45:05 smithi099 ceph-mon[29691]: mgrmap e22: x(active, starting, since 0.990616s) 2024-03-30T13:45:05.090 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:45:05 smithi099 ceph-mon[29691]: from='mgr.24746 172.21.15.181:0/2892154077' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-03-30T13:45:05.090 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:45:05 smithi099 ceph-mon[29691]: from='mgr.24746 172.21.15.181:0/2892154077' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-30T13:45:05.090 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:45:05 smithi099 ceph-mon[29691]: from='mgr.24746 172.21.15.181:0/2892154077' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-30T13:45:05.090 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:45:05 smithi099 ceph-mon[29691]: from='mgr.24746 172.21.15.181:0/2892154077' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-03-30T13:45:05.090 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:45:05 smithi099 ceph-mon[29691]: from='mgr.24746 172.21.15.181:0/2892154077' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-03-30T13:45:05.091 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:45:05 smithi099 ceph-mon[29691]: from='mgr.24746 172.21.15.181:0/2892154077' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-03-30T13:45:05.091 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:45:05 smithi099 ceph-mon[29691]: from='mgr.24746 172.21.15.181:0/2892154077' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-03-30T13:45:05.091 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:45:05 smithi099 ceph-mon[29691]: from='mgr.24746 172.21.15.181:0/2892154077' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-03-30T13:45:05.091 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:45:05 smithi099 ceph-mon[29691]: from='mgr.24746 172.21.15.181:0/2892154077' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-03-30T13:45:05.091 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:45:05 smithi099 ceph-mon[29691]: from='mgr.24746 172.21.15.181:0/2892154077' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-03-30T13:45:05.091 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:45:05 smithi099 ceph-mon[29691]: from='mgr.24746 172.21.15.181:0/2892154077' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-03-30T13:45:05.091 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:45:05 smithi099 ceph-mon[29691]: from='mgr.24746 172.21.15.181:0/2892154077' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-03-30T13:45:05.091 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:45:05 smithi099 ceph-mon[29691]: from='mgr.24746 172.21.15.181:0/2892154077' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-03-30T13:45:05.092 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:45:05 smithi099 ceph-mon[29691]: from='mgr.24746 172.21.15.181:0/2892154077' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-03-30T13:45:05.092 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:45:05 smithi099 ceph-mon[29691]: from='mgr.24746 172.21.15.181:0/2892154077' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-03-30T13:45:05.092 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:45:05 smithi099 ceph-mon[29691]: Manager daemon x is now available 2024-03-30T13:45:05.092 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:45:05 smithi099 ceph-mon[29691]: from='mgr.24746 ' entity='mgr.x' 2024-03-30T13:45:05.092 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:45:05 smithi099 ceph-mon[29691]: Queued rgw.foo for migration 2024-03-30T13:45:05.092 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:45:05 smithi099 ceph-mon[29691]: No Migration is needed for rgw spec: {'placement': {'count': 2}, 'service_id': 'foo', 'service_name': 'rgw.foo', 'service_type': 'rgw', 'spec': {'rgw_frontend_port': 8000, 'rgw_realm': 'r', 'rgw_zone': 'z'}} 2024-03-30T13:45:05.092 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:45:05 smithi099 ceph-mon[29691]: from='mgr.24746 ' entity='mgr.x' 2024-03-30T13:45:05.092 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:45:05 smithi099 ceph-mon[29691]: from='mgr.24746 ' entity='mgr.x' 2024-03-30T13:45:05.092 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:45:05 smithi099 ceph-mon[29691]: from='mgr.24746 172.21.15.181:0/2892154077' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi181", "name": "osd_memory_target"}]: dispatch 2024-03-30T13:45:05.092 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:45:05 smithi099 ceph-mon[29691]: from='mgr.24746 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi181", "name": "osd_memory_target"}]: dispatch 2024-03-30T13:45:05.092 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:45:05 smithi099 ceph-mon[29691]: from='mgr.24746 172.21.15.181:0/2892154077' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi099", "name": "osd_memory_target"}]: dispatch 2024-03-30T13:45:05.092 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:45:05 smithi099 ceph-mon[29691]: from='mgr.24746 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi099", "name": "osd_memory_target"}]: dispatch 2024-03-30T13:45:05.092 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:45:05 smithi099 ceph-mon[29691]: from='mgr.24746 172.21.15.181:0/2892154077' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:45:05.093 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:45:05 smithi099 ceph-mon[24912]: from='mgr.24746 172.21.15.181:0/2892154077' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:45:05.093 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:45:05 smithi099 ceph-mon[24912]: Updating smithi099:/etc/ceph/ceph.conf 2024-03-30T13:45:05.093 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:45:05 smithi099 ceph-mon[24912]: Updating smithi181:/etc/ceph/ceph.conf 2024-03-30T13:45:05.093 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:45:05 smithi099 ceph-mon[24912]: from='mgr.24746 172.21.15.181:0/2892154077' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T13:45:05.093 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:45:05 smithi099 ceph-mon[24912]: from='mgr.24746 172.21.15.181:0/2892154077' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-03-30T13:45:05.093 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:45:05 smithi099 ceph-mon[24912]: from='mgr.24746 ' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-03-30T13:45:05.093 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:45:05 smithi099 ceph-mon[24912]: from='mgr.24746 172.21.15.181:0/2892154077' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-03-30T13:45:05.093 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:45:05 smithi099 ceph-mon[24912]: from='mgr.24746 ' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-03-30T13:45:05.094 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:45:05 smithi099 ceph-mon[29691]: from='mgr.24746 172.21.15.181:0/2892154077' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:45:05.094 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:45:05 smithi099 ceph-mon[29691]: Updating smithi099:/etc/ceph/ceph.conf 2024-03-30T13:45:05.094 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:45:05 smithi099 ceph-mon[29691]: Updating smithi181:/etc/ceph/ceph.conf 2024-03-30T13:45:05.094 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:45:05 smithi099 ceph-mon[29691]: from='mgr.24746 172.21.15.181:0/2892154077' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T13:45:05.094 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:45:05 smithi099 ceph-mon[29691]: from='mgr.24746 172.21.15.181:0/2892154077' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-03-30T13:45:05.094 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:45:05 smithi099 ceph-mon[29691]: from='mgr.24746 ' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-03-30T13:45:05.094 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:45:05 smithi099 ceph-mon[29691]: from='mgr.24746 172.21.15.181:0/2892154077' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-03-30T13:45:05.094 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:45:05 smithi099 ceph-mon[29691]: from='mgr.24746 ' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-03-30T13:45:05.366 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:45:05 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[25141]: 2024-03-30T13:45:05.271+0000 7f6a49564000 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-03-30T13:45:05.506 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:45:05 smithi181 ceph-mon[25762]: from='client.? ' entity='client.admin' cmd='[{"prefix": "mgr fail"}]': finished 2024-03-30T13:45:05.506 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:45:05 smithi181 ceph-mon[25762]: mgrmap e22: x(active, starting, since 0.990616s) 2024-03-30T13:45:05.507 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:45:05 smithi181 ceph-mon[25762]: from='mgr.24746 172.21.15.181:0/2892154077' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-03-30T13:45:05.507 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:45:05 smithi181 ceph-mon[25762]: from='mgr.24746 172.21.15.181:0/2892154077' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-30T13:45:05.507 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:45:05 smithi181 ceph-mon[25762]: from='mgr.24746 172.21.15.181:0/2892154077' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-30T13:45:05.507 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:45:05 smithi181 ceph-mon[25762]: from='mgr.24746 172.21.15.181:0/2892154077' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-03-30T13:45:05.507 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:45:05 smithi181 ceph-mon[25762]: from='mgr.24746 172.21.15.181:0/2892154077' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-03-30T13:45:05.507 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:45:05 smithi181 ceph-mon[25762]: from='mgr.24746 172.21.15.181:0/2892154077' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-03-30T13:45:05.507 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:45:05 smithi181 ceph-mon[25762]: from='mgr.24746 172.21.15.181:0/2892154077' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-03-30T13:45:05.507 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:45:05 smithi181 ceph-mon[25762]: from='mgr.24746 172.21.15.181:0/2892154077' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-03-30T13:45:05.507 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:45:05 smithi181 ceph-mon[25762]: from='mgr.24746 172.21.15.181:0/2892154077' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-03-30T13:45:05.507 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:45:05 smithi181 ceph-mon[25762]: from='mgr.24746 172.21.15.181:0/2892154077' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-03-30T13:45:05.507 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:45:05 smithi181 ceph-mon[25762]: from='mgr.24746 172.21.15.181:0/2892154077' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-03-30T13:45:05.507 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:45:05 smithi181 ceph-mon[25762]: from='mgr.24746 172.21.15.181:0/2892154077' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-03-30T13:45:05.507 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:45:05 smithi181 ceph-mon[25762]: from='mgr.24746 172.21.15.181:0/2892154077' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-03-30T13:45:05.507 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:45:05 smithi181 ceph-mon[25762]: from='mgr.24746 172.21.15.181:0/2892154077' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-03-30T13:45:05.508 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:45:05 smithi181 ceph-mon[25762]: from='mgr.24746 172.21.15.181:0/2892154077' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-03-30T13:45:05.508 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:45:05 smithi181 ceph-mon[25762]: Manager daemon x is now available 2024-03-30T13:45:05.508 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:45:05 smithi181 ceph-mon[25762]: from='mgr.24746 ' entity='mgr.x' 2024-03-30T13:45:05.508 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:45:05 smithi181 ceph-mon[25762]: Queued rgw.foo for migration 2024-03-30T13:45:05.508 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:45:05 smithi181 ceph-mon[25762]: No Migration is needed for rgw spec: {'placement': {'count': 2}, 'service_id': 'foo', 'service_name': 'rgw.foo', 'service_type': 'rgw', 'spec': {'rgw_frontend_port': 8000, 'rgw_realm': 'r', 'rgw_zone': 'z'}} 2024-03-30T13:45:05.508 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:45:05 smithi181 ceph-mon[25762]: from='mgr.24746 ' entity='mgr.x' 2024-03-30T13:45:05.508 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:45:05 smithi181 ceph-mon[25762]: from='mgr.24746 ' entity='mgr.x' 2024-03-30T13:45:05.508 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:45:05 smithi181 ceph-mon[25762]: from='mgr.24746 172.21.15.181:0/2892154077' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi181", "name": "osd_memory_target"}]: dispatch 2024-03-30T13:45:05.508 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:45:05 smithi181 ceph-mon[25762]: from='mgr.24746 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi181", "name": "osd_memory_target"}]: dispatch 2024-03-30T13:45:05.508 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:45:05 smithi181 ceph-mon[25762]: from='mgr.24746 172.21.15.181:0/2892154077' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi099", "name": "osd_memory_target"}]: dispatch 2024-03-30T13:45:05.508 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:45:05 smithi181 ceph-mon[25762]: from='mgr.24746 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi099", "name": "osd_memory_target"}]: dispatch 2024-03-30T13:45:05.508 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:45:05 smithi181 ceph-mon[25762]: from='mgr.24746 172.21.15.181:0/2892154077' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:45:05.508 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:45:05 smithi181 ceph-mon[25762]: from='mgr.24746 172.21.15.181:0/2892154077' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:45:05.508 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:45:05 smithi181 ceph-mon[25762]: Updating smithi099:/etc/ceph/ceph.conf 2024-03-30T13:45:05.509 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:45:05 smithi181 ceph-mon[25762]: Updating smithi181:/etc/ceph/ceph.conf 2024-03-30T13:45:05.509 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:45:05 smithi181 ceph-mon[25762]: from='mgr.24746 172.21.15.181:0/2892154077' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T13:45:05.509 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:45:05 smithi181 ceph-mon[25762]: from='mgr.24746 172.21.15.181:0/2892154077' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-03-30T13:45:05.509 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:45:05 smithi181 ceph-mon[25762]: from='mgr.24746 ' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-03-30T13:45:05.509 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:45:05 smithi181 ceph-mon[25762]: from='mgr.24746 172.21.15.181:0/2892154077' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-03-30T13:45:05.509 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:45:05 smithi181 ceph-mon[25762]: from='mgr.24746 ' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-03-30T13:45:05.620 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:45:05 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[25141]: 2024-03-30T13:45:05.370+0000 7f6a49564000 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-03-30T13:45:05.620 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:45:05 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[25141]: 2024-03-30T13:45:05.457+0000 7f6a49564000 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-03-30T13:45:05.620 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:45:05 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[25141]: 2024-03-30T13:45:05.618+0000 7f6a49564000 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-03-30T13:45:05.905 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:45:05 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[25141]: 2024-03-30T13:45:05.703+0000 7f6a49564000 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-03-30T13:45:05.906 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:45:05 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[25141]: 2024-03-30T13:45:05.818+0000 7f6a49564000 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-03-30T13:45:06.162 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:45:05 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[25141]: 2024-03-30T13:45:05.904+0000 7f6a49564000 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-03-30T13:45:06.162 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:45:06 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[25141]: 2024-03-30T13:45:06.073+0000 7f6a49564000 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-03-30T13:45:06.162 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:45:06 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[25141]: 2024-03-30T13:45:06.160+0000 7f6a49564000 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-03-30T13:45:06.162 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:45:06 smithi099 ceph-mon[29691]: Updating smithi181:/var/lib/ceph/98ebaeb8-ee99-11ee-b647-cb9ed24678a4/config/ceph.conf 2024-03-30T13:45:06.162 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:45:06 smithi099 ceph-mon[29691]: Updating smithi099:/var/lib/ceph/98ebaeb8-ee99-11ee-b647-cb9ed24678a4/config/ceph.conf 2024-03-30T13:45:06.162 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:45:06 smithi099 ceph-mon[29691]: Updating smithi181:/etc/ceph/ceph.client.admin.keyring 2024-03-30T13:45:06.162 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:45:06 smithi099 ceph-mon[29691]: Updating smithi099:/etc/ceph/ceph.client.admin.keyring 2024-03-30T13:45:06.163 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:45:06 smithi099 ceph-mon[29691]: mgrmap e23: x(active, since 1.99996s) 2024-03-30T13:45:06.163 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:45:06 smithi099 ceph-mon[29691]: from='client.14838 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T13:45:06.163 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:45:06 smithi099 ceph-mon[29691]: pgmap v3: 161 pgs: 161 active+clean; 585 KiB data, 68 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:45:06.163 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:45:06 smithi099 ceph-mon[29691]: Updating smithi181:/var/lib/ceph/98ebaeb8-ee99-11ee-b647-cb9ed24678a4/config/ceph.client.admin.keyring 2024-03-30T13:45:06.163 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:45:06 smithi099 ceph-mon[29691]: Updating smithi099:/var/lib/ceph/98ebaeb8-ee99-11ee-b647-cb9ed24678a4/config/ceph.client.admin.keyring 2024-03-30T13:45:06.163 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:45:06 smithi099 ceph-mon[29691]: from='mgr.24746 ' entity='mgr.x' 2024-03-30T13:45:06.163 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:45:06 smithi099 ceph-mon[29691]: from='mgr.24746 ' entity='mgr.x' 2024-03-30T13:45:06.163 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:45:06 smithi099 ceph-mon[29691]: from='mgr.24746 ' entity='mgr.x' 2024-03-30T13:45:06.163 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:45:06 smithi099 ceph-mon[29691]: from='mgr.24746 ' entity='mgr.x' 2024-03-30T13:45:06.163 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:45:06 smithi099 ceph-mon[29691]: from='mgr.24746 ' entity='mgr.x' 2024-03-30T13:45:06.163 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:45:06 smithi099 ceph-mon[29691]: from='mgr.24746 ' entity='mgr.x' 2024-03-30T13:45:06.163 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:45:06 smithi099 ceph-mon[29691]: from='mgr.24746 ' entity='mgr.x' 2024-03-30T13:45:06.163 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:45:06 smithi099 ceph-mon[29691]: from='mgr.24746 ' entity='mgr.x' 2024-03-30T13:45:06.163 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:45:06 smithi099 ceph-mon[29691]: from='mgr.24746 ' entity='mgr.x' 2024-03-30T13:45:06.163 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:45:06 smithi099 ceph-mon[29691]: from='mgr.24746 ' entity='mgr.x' 2024-03-30T13:45:06.164 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:45:06 smithi099 ceph-mon[29691]: from='mgr.24746 ' entity='mgr.x' 2024-03-30T13:45:06.164 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:45:06 smithi099 ceph-mon[24912]: Updating smithi181:/var/lib/ceph/98ebaeb8-ee99-11ee-b647-cb9ed24678a4/config/ceph.conf 2024-03-30T13:45:06.164 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:45:06 smithi099 ceph-mon[24912]: Updating smithi099:/var/lib/ceph/98ebaeb8-ee99-11ee-b647-cb9ed24678a4/config/ceph.conf 2024-03-30T13:45:06.164 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:45:06 smithi099 ceph-mon[24912]: Updating smithi181:/etc/ceph/ceph.client.admin.keyring 2024-03-30T13:45:06.164 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:45:06 smithi099 ceph-mon[24912]: Updating smithi099:/etc/ceph/ceph.client.admin.keyring 2024-03-30T13:45:06.164 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:45:06 smithi099 ceph-mon[24912]: mgrmap e23: x(active, since 1.99996s) 2024-03-30T13:45:06.164 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:45:06 smithi099 ceph-mon[24912]: from='client.14838 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T13:45:06.164 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:45:06 smithi099 ceph-mon[24912]: pgmap v3: 161 pgs: 161 active+clean; 585 KiB data, 68 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:45:06.164 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:45:06 smithi099 ceph-mon[24912]: Updating smithi181:/var/lib/ceph/98ebaeb8-ee99-11ee-b647-cb9ed24678a4/config/ceph.client.admin.keyring 2024-03-30T13:45:06.164 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:45:06 smithi099 ceph-mon[24912]: Updating smithi099:/var/lib/ceph/98ebaeb8-ee99-11ee-b647-cb9ed24678a4/config/ceph.client.admin.keyring 2024-03-30T13:45:06.164 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:45:06 smithi099 ceph-mon[24912]: from='mgr.24746 ' entity='mgr.x' 2024-03-30T13:45:06.164 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:45:06 smithi099 ceph-mon[24912]: from='mgr.24746 ' entity='mgr.x' 2024-03-30T13:45:06.165 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:45:06 smithi099 ceph-mon[24912]: from='mgr.24746 ' entity='mgr.x' 2024-03-30T13:45:06.165 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:45:06 smithi099 ceph-mon[24912]: from='mgr.24746 ' entity='mgr.x' 2024-03-30T13:45:06.165 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:45:06 smithi099 ceph-mon[24912]: from='mgr.24746 ' entity='mgr.x' 2024-03-30T13:45:06.165 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:45:06 smithi099 ceph-mon[24912]: from='mgr.24746 ' entity='mgr.x' 2024-03-30T13:45:06.165 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:45:06 smithi099 ceph-mon[24912]: from='mgr.24746 ' entity='mgr.x' 2024-03-30T13:45:06.165 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:45:06 smithi099 ceph-mon[24912]: from='mgr.24746 ' entity='mgr.x' 2024-03-30T13:45:06.165 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:45:06 smithi099 ceph-mon[24912]: from='mgr.24746 ' entity='mgr.x' 2024-03-30T13:45:06.165 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:45:06 smithi099 ceph-mon[24912]: from='mgr.24746 ' entity='mgr.x' 2024-03-30T13:45:06.165 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:45:06 smithi099 ceph-mon[24912]: from='mgr.24746 ' entity='mgr.x' 2024-03-30T13:45:06.256 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:45:06 smithi181 ceph-mon[25762]: Updating smithi181:/var/lib/ceph/98ebaeb8-ee99-11ee-b647-cb9ed24678a4/config/ceph.conf 2024-03-30T13:45:06.257 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:45:06 smithi181 ceph-mon[25762]: Updating smithi099:/var/lib/ceph/98ebaeb8-ee99-11ee-b647-cb9ed24678a4/config/ceph.conf 2024-03-30T13:45:06.257 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:45:06 smithi181 ceph-mon[25762]: Updating smithi181:/etc/ceph/ceph.client.admin.keyring 2024-03-30T13:45:06.257 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:45:06 smithi181 ceph-mon[25762]: Updating smithi099:/etc/ceph/ceph.client.admin.keyring 2024-03-30T13:45:06.257 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:45:06 smithi181 ceph-mon[25762]: mgrmap e23: x(active, since 1.99996s) 2024-03-30T13:45:06.257 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:45:06 smithi181 ceph-mon[25762]: from='client.14838 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T13:45:06.257 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:45:06 smithi181 ceph-mon[25762]: pgmap v3: 161 pgs: 161 active+clean; 585 KiB data, 68 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:45:06.257 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:45:06 smithi181 ceph-mon[25762]: Updating smithi181:/var/lib/ceph/98ebaeb8-ee99-11ee-b647-cb9ed24678a4/config/ceph.client.admin.keyring 2024-03-30T13:45:06.257 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:45:06 smithi181 ceph-mon[25762]: Updating smithi099:/var/lib/ceph/98ebaeb8-ee99-11ee-b647-cb9ed24678a4/config/ceph.client.admin.keyring 2024-03-30T13:45:06.257 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:45:06 smithi181 ceph-mon[25762]: from='mgr.24746 ' entity='mgr.x' 2024-03-30T13:45:06.257 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:45:06 smithi181 ceph-mon[25762]: from='mgr.24746 ' entity='mgr.x' 2024-03-30T13:45:06.257 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:45:06 smithi181 ceph-mon[25762]: from='mgr.24746 ' entity='mgr.x' 2024-03-30T13:45:06.257 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:45:06 smithi181 ceph-mon[25762]: from='mgr.24746 ' entity='mgr.x' 2024-03-30T13:45:06.257 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:45:06 smithi181 ceph-mon[25762]: from='mgr.24746 ' entity='mgr.x' 2024-03-30T13:45:06.257 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:45:06 smithi181 ceph-mon[25762]: from='mgr.24746 ' entity='mgr.x' 2024-03-30T13:45:06.258 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:45:06 smithi181 ceph-mon[25762]: from='mgr.24746 ' entity='mgr.x' 2024-03-30T13:45:06.258 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:45:06 smithi181 ceph-mon[25762]: from='mgr.24746 ' entity='mgr.x' 2024-03-30T13:45:06.258 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:45:06 smithi181 ceph-mon[25762]: from='mgr.24746 ' entity='mgr.x' 2024-03-30T13:45:06.258 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:45:06 smithi181 ceph-mon[25762]: from='mgr.24746 ' entity='mgr.x' 2024-03-30T13:45:06.258 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:45:06 smithi181 ceph-mon[25762]: from='mgr.24746 ' entity='mgr.x' 2024-03-30T13:45:07.087 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:45:07 smithi099 ceph-mon[29691]: Delaying applying agent spec until cephadm endpoint root cert created 2024-03-30T13:45:07.087 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:45:07 smithi099 ceph-mon[29691]: Reconfiguring node-exporter.a (dependencies changed)... 2024-03-30T13:45:07.087 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:45:07 smithi099 ceph-mon[29691]: Reconfiguring daemon node-exporter.a on smithi099 2024-03-30T13:45:07.087 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:45:07 smithi099 ceph-mon[29691]: Deploying cephadm binary to smithi099 2024-03-30T13:45:07.087 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:45:07 smithi099 ceph-mon[29691]: pgmap v4: 161 pgs: 161 active+clean; 585 KiB data, 68 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:45:07.087 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:45:07 smithi099 ceph-mon[24912]: Delaying applying agent spec until cephadm endpoint root cert created 2024-03-30T13:45:07.087 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:45:07 smithi099 ceph-mon[24912]: Reconfiguring node-exporter.a (dependencies changed)... 2024-03-30T13:45:07.088 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:45:07 smithi099 ceph-mon[24912]: Reconfiguring daemon node-exporter.a on smithi099 2024-03-30T13:45:07.088 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:45:07 smithi099 ceph-mon[24912]: Deploying cephadm binary to smithi099 2024-03-30T13:45:07.088 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:45:07 smithi099 ceph-mon[24912]: pgmap v4: 161 pgs: 161 active+clean; 585 KiB data, 68 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:45:07.147 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:45:07 smithi181 ceph-mon[25762]: Delaying applying agent spec until cephadm endpoint root cert created 2024-03-30T13:45:07.148 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:45:07 smithi181 ceph-mon[25762]: Reconfiguring node-exporter.a (dependencies changed)... 2024-03-30T13:45:07.148 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:45:07 smithi181 ceph-mon[25762]: Reconfiguring daemon node-exporter.a on smithi099 2024-03-30T13:45:07.148 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:45:07 smithi181 ceph-mon[25762]: Deploying cephadm binary to smithi099 2024-03-30T13:45:07.148 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:45:07 smithi181 ceph-mon[25762]: pgmap v4: 161 pgs: 161 active+clean; 585 KiB data, 68 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:45:07.534 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:45:07 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[25141]: 2024-03-30T13:45:07.209+0000 7f6a49564000 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-03-30T13:45:07.534 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:45:07 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[25141]: 2024-03-30T13:45:07.339+0000 7f6a49564000 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-03-30T13:45:07.534 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:45:07 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[25141]: 2024-03-30T13:45:07.532+0000 7f6a49564000 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-03-30T13:45:07.837 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:45:07 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[25141]: 2024-03-30T13:45:07.620+0000 7f6a49564000 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-03-30T13:45:07.837 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:45:07 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[25141]: 2024-03-30T13:45:07.757+0000 7f6a49564000 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-03-30T13:45:08.256 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:45:08 smithi181 ceph-mon[25762]: [30/Mar/2024:13:45:06] ENGINE Bus STARTING 2024-03-30T13:45:08.256 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:45:08 smithi181 ceph-mon[25762]: [30/Mar/2024:13:45:06] ENGINE Serving on http://172.21.15.181:8765 2024-03-30T13:45:08.256 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:45:08 smithi181 ceph-mon[25762]: [30/Mar/2024:13:45:06] ENGINE Serving on https://172.21.15.181:7150 2024-03-30T13:45:08.256 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:45:08 smithi181 ceph-mon[25762]: [30/Mar/2024:13:45:06] ENGINE Bus STARTED 2024-03-30T13:45:08.256 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:45:08 smithi181 ceph-mon[25762]: mgrmap e24: x(active, since 4s) 2024-03-30T13:45:08.321 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:45:08 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[25141]: 2024-03-30T13:45:08.085+0000 7f6a49564000 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-03-30T13:45:08.321 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:45:08 smithi099 ceph-mon[29691]: [30/Mar/2024:13:45:06] ENGINE Bus STARTING 2024-03-30T13:45:08.321 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:45:08 smithi099 ceph-mon[29691]: [30/Mar/2024:13:45:06] ENGINE Serving on http://172.21.15.181:8765 2024-03-30T13:45:08.321 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:45:08 smithi099 ceph-mon[29691]: [30/Mar/2024:13:45:06] ENGINE Serving on https://172.21.15.181:7150 2024-03-30T13:45:08.321 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:45:08 smithi099 ceph-mon[29691]: [30/Mar/2024:13:45:06] ENGINE Bus STARTED 2024-03-30T13:45:08.321 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:45:08 smithi099 ceph-mon[29691]: mgrmap e24: x(active, since 4s) 2024-03-30T13:45:08.322 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:45:08 smithi099 ceph-mon[24912]: [30/Mar/2024:13:45:06] ENGINE Bus STARTING 2024-03-30T13:45:08.322 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:45:08 smithi099 ceph-mon[24912]: [30/Mar/2024:13:45:06] ENGINE Serving on http://172.21.15.181:8765 2024-03-30T13:45:08.322 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:45:08 smithi099 ceph-mon[24912]: [30/Mar/2024:13:45:06] ENGINE Serving on https://172.21.15.181:7150 2024-03-30T13:45:08.322 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:45:08 smithi099 ceph-mon[24912]: [30/Mar/2024:13:45:06] ENGINE Bus STARTED 2024-03-30T13:45:08.322 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:45:08 smithi099 ceph-mon[24912]: mgrmap e24: x(active, since 4s) 2024-03-30T13:45:08.582 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:45:08 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[25141]: 2024-03-30T13:45:08.319+0000 7f6a49564000 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-03-30T13:45:08.582 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:45:08 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[25141]: 2024-03-30T13:45:08.411+0000 7f6a49564000 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-03-30T13:45:08.837 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:45:08 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[25141]: 2024-03-30T13:45:08.596+0000 7f6a49564000 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-03-30T13:45:08.837 INFO:journalctl@ceph.node-exporter.a.smithi099.stdout:Mar 30 13:45:08 smithi099 systemd[1]: Stopping Ceph node-exporter.a for 98ebaeb8-ee99-11ee-b647-cb9ed24678a4... 2024-03-30T13:45:08.838 INFO:journalctl@ceph.node-exporter.a.smithi099.stdout:Mar 30 13:45:08 smithi099 bash[63766]: Error: no container with name or ID "ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-node-exporter.a" found: no such container 2024-03-30T13:45:08.838 INFO:journalctl@ceph.node-exporter.a.smithi099.stdout:Mar 30 13:45:08 smithi099 podman[63777]: 2024-03-30 13:45:08.75309431 +0000 UTC m=+0.138215268 container died ad756dd8c3f9d4a77fe080331c99db18358a30037602413befd82919f17ed4f8 (image=quay.io/prometheus/node-exporter:v1.3.1, name=ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-node-exporter-a, maintainer=The Prometheus Authors ) 2024-03-30T13:45:09.301 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:45:09 smithi099 ceph-mon[24912]: pgmap v5: 161 pgs: 161 active+clean; 585 KiB data, 68 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:45:09.301 INFO:journalctl@ceph.node-exporter.a.smithi099.stdout:Mar 30 13:45:09 smithi099 podman[63777]: 2024-03-30 13:45:09.258642893 +0000 UTC m=+0.643763847 container cleanup ad756dd8c3f9d4a77fe080331c99db18358a30037602413befd82919f17ed4f8 (image=quay.io/prometheus/node-exporter:v1.3.1, name=ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-node-exporter-a, maintainer=The Prometheus Authors ) 2024-03-30T13:45:09.301 INFO:journalctl@ceph.node-exporter.a.smithi099.stdout:Mar 30 13:45:09 smithi099 bash[63777]: ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-node-exporter-a 2024-03-30T13:45:09.302 INFO:journalctl@ceph.node-exporter.a.smithi099.stdout:Mar 30 13:45:09 smithi099 bash[63831]: Error: no container with name or ID "ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-node-exporter.a" found: no such container 2024-03-30T13:45:09.302 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:45:09 smithi099 ceph-mon[29691]: pgmap v5: 161 pgs: 161 active+clean; 585 KiB data, 68 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:45:09.462 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:45:09 smithi181 ceph-mon[25762]: pgmap v5: 161 pgs: 161 active+clean; 585 KiB data, 68 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:45:09.745 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:45:09 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[25141]: 2024-03-30T13:45:09.596+0000 7f6a49564000 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-03-30T13:45:09.745 INFO:journalctl@ceph.node-exporter.a.smithi099.stdout:Mar 30 13:45:09 smithi099 podman[63814]: 2024-03-30 13:45:09.476773082 +0000 UTC m=+0.727758185 container remove ad756dd8c3f9d4a77fe080331c99db18358a30037602413befd82919f17ed4f8 (image=quay.io/prometheus/node-exporter:v1.3.1, name=ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-node-exporter-a, maintainer=The Prometheus Authors ) 2024-03-30T13:45:09.745 INFO:journalctl@ceph.node-exporter.a.smithi099.stdout:Mar 30 13:45:09 smithi099 systemd[1]: ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4@node-exporter.a.service: Main process exited, code=exited, status=143/n/a 2024-03-30T13:45:09.745 INFO:journalctl@ceph.node-exporter.a.smithi099.stdout:Mar 30 13:45:09 smithi099 systemd[1]: ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4@node-exporter.a.service: Failed with result 'exit-code'. 2024-03-30T13:45:09.746 INFO:journalctl@ceph.node-exporter.a.smithi099.stdout:Mar 30 13:45:09 smithi099 systemd[1]: Stopped Ceph node-exporter.a for 98ebaeb8-ee99-11ee-b647-cb9ed24678a4. 2024-03-30T13:45:09.746 INFO:journalctl@ceph.node-exporter.a.smithi099.stdout:Mar 30 13:45:09 smithi099 systemd[1]: ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4@node-exporter.a.service: Consumed 4.170s CPU time. 2024-03-30T13:45:09.746 INFO:journalctl@ceph.node-exporter.a.smithi099.stdout:Mar 30 13:45:09 smithi099 systemd[1]: Starting Ceph node-exporter.a for 98ebaeb8-ee99-11ee-b647-cb9ed24678a4... 2024-03-30T13:45:09.746 INFO:journalctl@ceph.node-exporter.a.smithi099.stdout:Mar 30 13:45:09 smithi099 podman[63904]: 2024-03-30 13:45:09.619608333 +0000 UTC m=+0.017611227 image pull 1dbe0e931976487e20e5cfb272087e08a9779c88fd5e9617ed7042dd9751ec26 quay.io/prometheus/node-exporter:v1.3.1 2024-03-30T13:45:09.746 INFO:journalctl@ceph.node-exporter.a.smithi099.stdout:Mar 30 13:45:09 smithi099 podman[63904]: 2024-03-30 13:45:09.744461073 +0000 UTC m=+0.142464228 container create 76284405d5f5397efde08e77ed0b49e35917a3dbe4443d0caf881f577e11822e (image=quay.io/prometheus/node-exporter:v1.3.1, name=ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-node-exporter-a, maintainer=The Prometheus Authors ) 2024-03-30T13:45:09.756 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 13:45:09 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-x[50211]: ::ffff:172.21.15.181 - - [30/Mar/2024:13:45:09] "GET /metrics HTTP/1.1" 200 34977 "" "Prometheus/2.33.4" 2024-03-30T13:45:10.007 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:45:09 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[25141]: 2024-03-30T13:45:09.904+0000 7f6a49564000 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-03-30T13:45:10.007 INFO:journalctl@ceph.node-exporter.a.smithi099.stdout:Mar 30 13:45:09 smithi099 podman[63904]: 2024-03-30 13:45:09.930830438 +0000 UTC m=+0.328833323 container init 76284405d5f5397efde08e77ed0b49e35917a3dbe4443d0caf881f577e11822e (image=quay.io/prometheus/node-exporter:v1.3.1, name=ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-node-exporter-a, maintainer=The Prometheus Authors ) 2024-03-30T13:45:10.008 INFO:journalctl@ceph.node-exporter.a.smithi099.stdout:Mar 30 13:45:09 smithi099 podman[63904]: 2024-03-30 13:45:09.934289997 +0000 UTC m=+0.332292876 container start 76284405d5f5397efde08e77ed0b49e35917a3dbe4443d0caf881f577e11822e (image=quay.io/prometheus/node-exporter:v1.3.1, name=ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-node-exporter-a, maintainer=The Prometheus Authors ) 2024-03-30T13:45:10.008 INFO:journalctl@ceph.node-exporter.a.smithi099.stdout:Mar 30 13:45:09 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-node-exporter-a[63921]: ts=2024-03-30T13:45:09.938Z caller=node_exporter.go:182 level=info msg="Starting node_exporter" version="(version=1.3.1, branch=HEAD, revision=a2321e7b940ddcff26873612bccdf7cd4c42b6b6)" 2024-03-30T13:45:10.008 INFO:journalctl@ceph.node-exporter.a.smithi099.stdout:Mar 30 13:45:09 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-node-exporter-a[63921]: ts=2024-03-30T13:45:09.938Z caller=node_exporter.go:183 level=info msg="Build context" build_context="(go=go1.17.3, user=root@243aafa5525c, date=20211205-11:09:49)" 2024-03-30T13:45:10.008 INFO:journalctl@ceph.node-exporter.a.smithi099.stdout:Mar 30 13:45:09 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-node-exporter-a[63921]: ts=2024-03-30T13:45:09.939Z caller=filesystem_common.go:111 level=info collector=filesystem msg="Parsed flag --collector.filesystem.mount-points-exclude" flag=^/(dev|proc|run/credentials/.+|sys|var/lib/docker/.+)($|/) 2024-03-30T13:45:10.008 INFO:journalctl@ceph.node-exporter.a.smithi099.stdout:Mar 30 13:45:09 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-node-exporter-a[63921]: ts=2024-03-30T13:45:09.939Z caller=filesystem_common.go:113 level=info collector=filesystem msg="Parsed flag --collector.filesystem.fs-types-exclude" flag=^(autofs|binfmt_misc|bpf|cgroup2?|configfs|debugfs|devpts|devtmpfs|fusectl|hugetlbfs|iso9660|mqueue|nsfs|overlay|proc|procfs|pstore|rpc_pipefs|securityfs|selinuxfs|squashfs|sysfs|tracefs)$ 2024-03-30T13:45:10.008 INFO:journalctl@ceph.node-exporter.a.smithi099.stdout:Mar 30 13:45:09 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-node-exporter-a[63921]: ts=2024-03-30T13:45:09.940Z caller=node_exporter.go:108 level=info msg="Enabled collectors" 2024-03-30T13:45:10.008 INFO:journalctl@ceph.node-exporter.a.smithi099.stdout:Mar 30 13:45:09 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-node-exporter-a[63921]: ts=2024-03-30T13:45:09.940Z caller=node_exporter.go:115 level=info collector=arp 2024-03-30T13:45:10.008 INFO:journalctl@ceph.node-exporter.a.smithi099.stdout:Mar 30 13:45:09 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-node-exporter-a[63921]: ts=2024-03-30T13:45:09.940Z caller=node_exporter.go:115 level=info collector=bcache 2024-03-30T13:45:10.008 INFO:journalctl@ceph.node-exporter.a.smithi099.stdout:Mar 30 13:45:09 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-node-exporter-a[63921]: ts=2024-03-30T13:45:09.940Z caller=node_exporter.go:115 level=info collector=bonding 2024-03-30T13:45:10.008 INFO:journalctl@ceph.node-exporter.a.smithi099.stdout:Mar 30 13:45:09 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-node-exporter-a[63921]: ts=2024-03-30T13:45:09.940Z caller=node_exporter.go:115 level=info collector=btrfs 2024-03-30T13:45:10.008 INFO:journalctl@ceph.node-exporter.a.smithi099.stdout:Mar 30 13:45:09 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-node-exporter-a[63921]: ts=2024-03-30T13:45:09.940Z caller=node_exporter.go:115 level=info collector=conntrack 2024-03-30T13:45:10.008 INFO:journalctl@ceph.node-exporter.a.smithi099.stdout:Mar 30 13:45:09 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-node-exporter-a[63921]: ts=2024-03-30T13:45:09.940Z caller=node_exporter.go:115 level=info collector=cpu 2024-03-30T13:45:10.008 INFO:journalctl@ceph.node-exporter.a.smithi099.stdout:Mar 30 13:45:09 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-node-exporter-a[63921]: ts=2024-03-30T13:45:09.940Z caller=node_exporter.go:115 level=info collector=cpufreq 2024-03-30T13:45:10.009 INFO:journalctl@ceph.node-exporter.a.smithi099.stdout:Mar 30 13:45:09 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-node-exporter-a[63921]: ts=2024-03-30T13:45:09.940Z caller=node_exporter.go:115 level=info collector=diskstats 2024-03-30T13:45:10.009 INFO:journalctl@ceph.node-exporter.a.smithi099.stdout:Mar 30 13:45:09 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-node-exporter-a[63921]: ts=2024-03-30T13:45:09.940Z caller=node_exporter.go:115 level=info collector=dmi 2024-03-30T13:45:10.009 INFO:journalctl@ceph.node-exporter.a.smithi099.stdout:Mar 30 13:45:09 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-node-exporter-a[63921]: ts=2024-03-30T13:45:09.940Z caller=node_exporter.go:115 level=info collector=edac 2024-03-30T13:45:10.009 INFO:journalctl@ceph.node-exporter.a.smithi099.stdout:Mar 30 13:45:09 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-node-exporter-a[63921]: ts=2024-03-30T13:45:09.940Z caller=node_exporter.go:115 level=info collector=entropy 2024-03-30T13:45:10.009 INFO:journalctl@ceph.node-exporter.a.smithi099.stdout:Mar 30 13:45:09 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-node-exporter-a[63921]: ts=2024-03-30T13:45:09.940Z caller=node_exporter.go:115 level=info collector=fibrechannel 2024-03-30T13:45:10.009 INFO:journalctl@ceph.node-exporter.a.smithi099.stdout:Mar 30 13:45:09 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-node-exporter-a[63921]: ts=2024-03-30T13:45:09.940Z caller=node_exporter.go:115 level=info collector=filefd 2024-03-30T13:45:10.009 INFO:journalctl@ceph.node-exporter.a.smithi099.stdout:Mar 30 13:45:09 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-node-exporter-a[63921]: ts=2024-03-30T13:45:09.940Z caller=node_exporter.go:115 level=info collector=filesystem 2024-03-30T13:45:10.009 INFO:journalctl@ceph.node-exporter.a.smithi099.stdout:Mar 30 13:45:09 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-node-exporter-a[63921]: ts=2024-03-30T13:45:09.940Z caller=node_exporter.go:115 level=info collector=hwmon 2024-03-30T13:45:10.010 INFO:journalctl@ceph.node-exporter.a.smithi099.stdout:Mar 30 13:45:09 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-node-exporter-a[63921]: ts=2024-03-30T13:45:09.940Z caller=node_exporter.go:115 level=info collector=infiniband 2024-03-30T13:45:10.010 INFO:journalctl@ceph.node-exporter.a.smithi099.stdout:Mar 30 13:45:09 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-node-exporter-a[63921]: ts=2024-03-30T13:45:09.940Z caller=node_exporter.go:115 level=info collector=ipvs 2024-03-30T13:45:10.010 INFO:journalctl@ceph.node-exporter.a.smithi099.stdout:Mar 30 13:45:09 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-node-exporter-a[63921]: ts=2024-03-30T13:45:09.940Z caller=node_exporter.go:115 level=info collector=loadavg 2024-03-30T13:45:10.010 INFO:journalctl@ceph.node-exporter.a.smithi099.stdout:Mar 30 13:45:09 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-node-exporter-a[63921]: ts=2024-03-30T13:45:09.940Z caller=node_exporter.go:115 level=info collector=mdadm 2024-03-30T13:45:10.010 INFO:journalctl@ceph.node-exporter.a.smithi099.stdout:Mar 30 13:45:09 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-node-exporter-a[63921]: ts=2024-03-30T13:45:09.940Z caller=node_exporter.go:115 level=info collector=meminfo 2024-03-30T13:45:10.010 INFO:journalctl@ceph.node-exporter.a.smithi099.stdout:Mar 30 13:45:09 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-node-exporter-a[63921]: ts=2024-03-30T13:45:09.940Z caller=node_exporter.go:115 level=info collector=netclass 2024-03-30T13:45:10.010 INFO:journalctl@ceph.node-exporter.a.smithi099.stdout:Mar 30 13:45:09 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-node-exporter-a[63921]: ts=2024-03-30T13:45:09.940Z caller=node_exporter.go:115 level=info collector=netdev 2024-03-30T13:45:10.010 INFO:journalctl@ceph.node-exporter.a.smithi099.stdout:Mar 30 13:45:09 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-node-exporter-a[63921]: ts=2024-03-30T13:45:09.940Z caller=node_exporter.go:115 level=info collector=netstat 2024-03-30T13:45:10.010 INFO:journalctl@ceph.node-exporter.a.smithi099.stdout:Mar 30 13:45:09 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-node-exporter-a[63921]: ts=2024-03-30T13:45:09.940Z caller=node_exporter.go:115 level=info collector=nfs 2024-03-30T13:45:10.010 INFO:journalctl@ceph.node-exporter.a.smithi099.stdout:Mar 30 13:45:09 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-node-exporter-a[63921]: ts=2024-03-30T13:45:09.940Z caller=node_exporter.go:115 level=info collector=nfsd 2024-03-30T13:45:10.010 INFO:journalctl@ceph.node-exporter.a.smithi099.stdout:Mar 30 13:45:09 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-node-exporter-a[63921]: ts=2024-03-30T13:45:09.940Z caller=node_exporter.go:115 level=info collector=nvme 2024-03-30T13:45:10.010 INFO:journalctl@ceph.node-exporter.a.smithi099.stdout:Mar 30 13:45:09 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-node-exporter-a[63921]: ts=2024-03-30T13:45:09.940Z caller=node_exporter.go:115 level=info collector=os 2024-03-30T13:45:10.010 INFO:journalctl@ceph.node-exporter.a.smithi099.stdout:Mar 30 13:45:09 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-node-exporter-a[63921]: ts=2024-03-30T13:45:09.940Z caller=node_exporter.go:115 level=info collector=powersupplyclass 2024-03-30T13:45:10.010 INFO:journalctl@ceph.node-exporter.a.smithi099.stdout:Mar 30 13:45:09 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-node-exporter-a[63921]: ts=2024-03-30T13:45:09.940Z caller=node_exporter.go:115 level=info collector=pressure 2024-03-30T13:45:10.011 INFO:journalctl@ceph.node-exporter.a.smithi099.stdout:Mar 30 13:45:09 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-node-exporter-a[63921]: ts=2024-03-30T13:45:09.940Z caller=node_exporter.go:115 level=info collector=rapl 2024-03-30T13:45:10.011 INFO:journalctl@ceph.node-exporter.a.smithi099.stdout:Mar 30 13:45:09 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-node-exporter-a[63921]: ts=2024-03-30T13:45:09.940Z caller=node_exporter.go:115 level=info collector=schedstat 2024-03-30T13:45:10.011 INFO:journalctl@ceph.node-exporter.a.smithi099.stdout:Mar 30 13:45:09 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-node-exporter-a[63921]: ts=2024-03-30T13:45:09.940Z caller=node_exporter.go:115 level=info collector=sockstat 2024-03-30T13:45:10.011 INFO:journalctl@ceph.node-exporter.a.smithi099.stdout:Mar 30 13:45:09 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-node-exporter-a[63921]: ts=2024-03-30T13:45:09.940Z caller=node_exporter.go:115 level=info collector=softnet 2024-03-30T13:45:10.011 INFO:journalctl@ceph.node-exporter.a.smithi099.stdout:Mar 30 13:45:09 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-node-exporter-a[63921]: ts=2024-03-30T13:45:09.940Z caller=node_exporter.go:115 level=info collector=stat 2024-03-30T13:45:10.011 INFO:journalctl@ceph.node-exporter.a.smithi099.stdout:Mar 30 13:45:09 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-node-exporter-a[63921]: ts=2024-03-30T13:45:09.940Z caller=node_exporter.go:115 level=info collector=tapestats 2024-03-30T13:45:10.011 INFO:journalctl@ceph.node-exporter.a.smithi099.stdout:Mar 30 13:45:09 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-node-exporter-a[63921]: ts=2024-03-30T13:45:09.940Z caller=node_exporter.go:115 level=info collector=textfile 2024-03-30T13:45:10.011 INFO:journalctl@ceph.node-exporter.a.smithi099.stdout:Mar 30 13:45:09 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-node-exporter-a[63921]: ts=2024-03-30T13:45:09.940Z caller=node_exporter.go:115 level=info collector=thermal_zone 2024-03-30T13:45:10.011 INFO:journalctl@ceph.node-exporter.a.smithi099.stdout:Mar 30 13:45:09 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-node-exporter-a[63921]: ts=2024-03-30T13:45:09.940Z caller=node_exporter.go:115 level=info collector=time 2024-03-30T13:45:10.011 INFO:journalctl@ceph.node-exporter.a.smithi099.stdout:Mar 30 13:45:09 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-node-exporter-a[63921]: ts=2024-03-30T13:45:09.940Z caller=node_exporter.go:115 level=info collector=udp_queues 2024-03-30T13:45:10.011 INFO:journalctl@ceph.node-exporter.a.smithi099.stdout:Mar 30 13:45:09 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-node-exporter-a[63921]: ts=2024-03-30T13:45:09.940Z caller=node_exporter.go:115 level=info collector=uname 2024-03-30T13:45:10.011 INFO:journalctl@ceph.node-exporter.a.smithi099.stdout:Mar 30 13:45:09 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-node-exporter-a[63921]: ts=2024-03-30T13:45:09.940Z caller=node_exporter.go:115 level=info collector=vmstat 2024-03-30T13:45:10.011 INFO:journalctl@ceph.node-exporter.a.smithi099.stdout:Mar 30 13:45:09 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-node-exporter-a[63921]: ts=2024-03-30T13:45:09.940Z caller=node_exporter.go:115 level=info collector=xfs 2024-03-30T13:45:10.011 INFO:journalctl@ceph.node-exporter.a.smithi099.stdout:Mar 30 13:45:09 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-node-exporter-a[63921]: ts=2024-03-30T13:45:09.940Z caller=node_exporter.go:115 level=info collector=zfs 2024-03-30T13:45:10.012 INFO:journalctl@ceph.node-exporter.a.smithi099.stdout:Mar 30 13:45:09 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-node-exporter-a[63921]: ts=2024-03-30T13:45:09.940Z caller=node_exporter.go:199 level=info msg="Listening on" address=:9100 2024-03-30T13:45:10.012 INFO:journalctl@ceph.node-exporter.a.smithi099.stdout:Mar 30 13:45:09 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-node-exporter-a[63921]: ts=2024-03-30T13:45:09.940Z caller=tls_config.go:195 level=info msg="TLS is disabled." http2=false 2024-03-30T13:45:10.276 INFO:journalctl@ceph.node-exporter.a.smithi099.stdout:Mar 30 13:45:10 smithi099 bash[63904]: 76284405d5f5397efde08e77ed0b49e35917a3dbe4443d0caf881f577e11822e 2024-03-30T13:45:10.276 INFO:journalctl@ceph.node-exporter.a.smithi099.stdout:Mar 30 13:45:10 smithi099 systemd[1]: Started Ceph node-exporter.a for 98ebaeb8-ee99-11ee-b647-cb9ed24678a4. 2024-03-30T13:45:10.276 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:45:10 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[25141]: 2024-03-30T13:45:10.005+0000 7f6a49564000 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-03-30T13:45:10.276 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:45:10 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[25141]: 2024-03-30T13:45:10.166+0000 7f6a49564000 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-03-30T13:45:10.276 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:45:10 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[25141]: [30/Mar/2024:13:45:10] ENGINE Bus STARTING 2024-03-30T13:45:10.276 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:45:10 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[25141]: CherryPy Checker: 2024-03-30T13:45:10.276 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:45:10 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[25141]: The Application mounted at '' has an empty config. 2024-03-30T13:45:10.276 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:45:10 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[25141]: 2024-03-30T13:45:10.277 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:45:10 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[25141]: [30/Mar/2024:13:45:10] ENGINE Serving on http://:::9283 2024-03-30T13:45:10.532 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:45:10 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[25141]: [30/Mar/2024:13:45:10] ENGINE Bus STARTED 2024-03-30T13:45:10.532 INFO:journalctl@ceph.alertmanager.a.smithi099.stdout:Mar 30 13:45:10 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-alertmanager-a[52107]: level=warn ts=2024-03-30T13:45:10.339Z caller=notify.go:724 component=dispatcher receiver=ceph-dashboard integration=webhook[0] msg="Notify attempt failed, will retry later" attempts=6 err="Post \"https://172.21.15.99:8443//api/prometheus_receiver\": x509: cannot validate certificate for 172.21.15.99 because it doesn't contain any IP SANs" 2024-03-30T13:45:11.314 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:45:11 smithi099 ceph-mon[29691]: pgmap v6: 161 pgs: 161 active+clean; 585 KiB data, 68 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:45:11.314 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:45:11 smithi099 ceph-mon[29691]: from='mgr.24746 ' entity='mgr.x' 2024-03-30T13:45:11.314 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:45:11 smithi099 ceph-mon[29691]: from='mgr.24746 ' entity='mgr.x' 2024-03-30T13:45:11.314 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:45:11 smithi099 ceph-mon[29691]: from='mgr.24746 ' entity='mgr.x' 2024-03-30T13:45:11.314 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:45:11 smithi099 ceph-mon[29691]: from='mgr.24746 ' entity='mgr.x' 2024-03-30T13:45:11.314 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:45:11 smithi099 ceph-mon[29691]: Reconfiguring alertmanager.a (dependencies changed)... 2024-03-30T13:45:11.315 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:45:11 smithi099 ceph-mon[29691]: Reconfiguring daemon alertmanager.a on smithi099 2024-03-30T13:45:11.315 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:45:11 smithi099 ceph-mon[29691]: Standby manager daemon y started 2024-03-30T13:45:11.315 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:45:11 smithi099 ceph-mon[29691]: from='mgr.? 172.21.15.99:0/2177193235' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-03-30T13:45:11.315 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:45:11 smithi099 ceph-mon[29691]: from='mgr.? 172.21.15.99:0/2177193235' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-03-30T13:45:11.315 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:45:11 smithi099 ceph-mon[29691]: from='mgr.? 172.21.15.99:0/2177193235' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-03-30T13:45:11.315 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:45:11 smithi099 ceph-mon[29691]: from='mgr.? 172.21.15.99:0/2177193235' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-03-30T13:45:11.315 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:45:11 smithi099 ceph-mon[24912]: pgmap v6: 161 pgs: 161 active+clean; 585 KiB data, 68 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:45:11.315 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:45:11 smithi099 ceph-mon[24912]: from='mgr.24746 ' entity='mgr.x' 2024-03-30T13:45:11.315 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:45:11 smithi099 ceph-mon[24912]: from='mgr.24746 ' entity='mgr.x' 2024-03-30T13:45:11.315 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:45:11 smithi099 ceph-mon[24912]: from='mgr.24746 ' entity='mgr.x' 2024-03-30T13:45:11.315 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:45:11 smithi099 ceph-mon[24912]: from='mgr.24746 ' entity='mgr.x' 2024-03-30T13:45:11.315 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:45:11 smithi099 ceph-mon[24912]: Reconfiguring alertmanager.a (dependencies changed)... 2024-03-30T13:45:11.316 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:45:11 smithi099 ceph-mon[24912]: Reconfiguring daemon alertmanager.a on smithi099 2024-03-30T13:45:11.316 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:45:11 smithi099 ceph-mon[24912]: Standby manager daemon y started 2024-03-30T13:45:11.316 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:45:11 smithi099 ceph-mon[24912]: from='mgr.? 172.21.15.99:0/2177193235' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-03-30T13:45:11.316 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:45:11 smithi099 ceph-mon[24912]: from='mgr.? 172.21.15.99:0/2177193235' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-03-30T13:45:11.316 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:45:11 smithi099 ceph-mon[24912]: from='mgr.? 172.21.15.99:0/2177193235' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-03-30T13:45:11.316 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:45:11 smithi099 ceph-mon[24912]: from='mgr.? 172.21.15.99:0/2177193235' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-03-30T13:45:11.506 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:45:11 smithi181 ceph-mon[25762]: pgmap v6: 161 pgs: 161 active+clean; 585 KiB data, 68 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:45:11.506 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:45:11 smithi181 ceph-mon[25762]: from='mgr.24746 ' entity='mgr.x' 2024-03-30T13:45:11.506 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:45:11 smithi181 ceph-mon[25762]: from='mgr.24746 ' entity='mgr.x' 2024-03-30T13:45:11.506 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:45:11 smithi181 ceph-mon[25762]: from='mgr.24746 ' entity='mgr.x' 2024-03-30T13:45:11.506 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:45:11 smithi181 ceph-mon[25762]: from='mgr.24746 ' entity='mgr.x' 2024-03-30T13:45:11.507 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:45:11 smithi181 ceph-mon[25762]: Reconfiguring alertmanager.a (dependencies changed)... 2024-03-30T13:45:11.507 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:45:11 smithi181 ceph-mon[25762]: Reconfiguring daemon alertmanager.a on smithi099 2024-03-30T13:45:11.507 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:45:11 smithi181 ceph-mon[25762]: Standby manager daemon y started 2024-03-30T13:45:11.507 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:45:11 smithi181 ceph-mon[25762]: from='mgr.? 172.21.15.99:0/2177193235' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-03-30T13:45:11.507 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:45:11 smithi181 ceph-mon[25762]: from='mgr.? 172.21.15.99:0/2177193235' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-03-30T13:45:11.507 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:45:11 smithi181 ceph-mon[25762]: from='mgr.? 172.21.15.99:0/2177193235' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-03-30T13:45:11.507 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:45:11 smithi181 ceph-mon[25762]: from='mgr.? 172.21.15.99:0/2177193235' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-03-30T13:45:12.337 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:45:12 smithi099 ceph-mon[24912]: mgrmap e25: x(active, since 8s), standbys: y 2024-03-30T13:45:12.337 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:45:12 smithi099 ceph-mon[24912]: from='mgr.24746 172.21.15.181:0/2892154077' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-03-30T13:45:12.337 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:45:12 smithi099 ceph-mon[29691]: mgrmap e25: x(active, since 8s), standbys: y 2024-03-30T13:45:12.337 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:45:12 smithi099 ceph-mon[29691]: from='mgr.24746 172.21.15.181:0/2892154077' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-03-30T13:45:12.506 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:45:12 smithi181 ceph-mon[25762]: mgrmap e25: x(active, since 8s), standbys: y 2024-03-30T13:45:12.506 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:45:12 smithi181 ceph-mon[25762]: from='mgr.24746 172.21.15.181:0/2892154077' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-03-30T13:45:13.337 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:45:13 smithi099 ceph-mon[24912]: pgmap v7: 161 pgs: 161 active+clean; 585 KiB data, 68 MiB used, 715 GiB / 715 GiB avail; 30 KiB/s rd, 0 B/s wr, 17 op/s 2024-03-30T13:45:13.337 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:45:13 smithi099 ceph-mon[29691]: pgmap v7: 161 pgs: 161 active+clean; 585 KiB data, 68 MiB used, 715 GiB / 715 GiB avail; 30 KiB/s rd, 0 B/s wr, 17 op/s 2024-03-30T13:45:13.407 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:45:13 smithi181 ceph-mon[25762]: pgmap v7: 161 pgs: 161 active+clean; 585 KiB data, 68 MiB used, 715 GiB / 715 GiB avail; 30 KiB/s rd, 0 B/s wr, 17 op/s 2024-03-30T13:45:13.762 INFO:journalctl@ceph.alertmanager.a.smithi099.stdout:Mar 30 13:45:13 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-alertmanager-a[52107]: level=error ts=2024-03-30T13:45:13.534Z caller=dispatch.go:354 component=dispatcher msg="Notify for alerts failed" num_alerts=3 err="ceph-dashboard/webhook[1]: notify retry canceled after 7 attempts: Post \"https://172.21.15.181:8443/api/prometheus_receiver\": x509: cannot validate certificate for 172.21.15.181 because it doesn't contain any IP SANs; ceph-dashboard/webhook[0]: notify retry canceled after 8 attempts: Post \"https://172.21.15.99:8443//api/prometheus_receiver\": x509: cannot validate certificate for 172.21.15.99 because it doesn't contain any IP SANs" 2024-03-30T13:45:13.762 INFO:journalctl@ceph.alertmanager.a.smithi099.stdout:Mar 30 13:45:13 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-alertmanager-a[52107]: level=warn ts=2024-03-30T13:45:13.536Z caller=notify.go:724 component=dispatcher receiver=ceph-dashboard integration=webhook[0] msg="Notify attempt failed, will retry later" attempts=1 err="Post \"https://172.21.15.99:8443//api/prometheus_receiver\": x509: cannot validate certificate for 172.21.15.99 because it doesn't contain any IP SANs" 2024-03-30T13:45:13.762 INFO:journalctl@ceph.alertmanager.a.smithi099.stdout:Mar 30 13:45:13 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-alertmanager-a[52107]: level=warn ts=2024-03-30T13:45:13.536Z caller=notify.go:724 component=dispatcher receiver=ceph-dashboard integration=webhook[1] msg="Notify attempt failed, will retry later" attempts=1 err="Post \"https://172.21.15.181:8443/api/prometheus_receiver\": x509: cannot validate certificate for 172.21.15.181 because it doesn't contain any IP SANs" 2024-03-30T13:45:15.006 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:45:14 smithi181 ceph-mon[25762]: pgmap v8: 161 pgs: 161 active+clean; 585 KiB data, 68 MiB used, 715 GiB / 715 GiB avail; 23 KiB/s rd, 0 B/s wr, 13 op/s 2024-03-30T13:45:15.029 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:45:14 smithi099 ceph-mon[24912]: pgmap v8: 161 pgs: 161 active+clean; 585 KiB data, 68 MiB used, 715 GiB / 715 GiB avail; 23 KiB/s rd, 0 B/s wr, 13 op/s 2024-03-30T13:45:15.029 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:45:14 smithi099 ceph-mon[29691]: pgmap v8: 161 pgs: 161 active+clean; 585 KiB data, 68 MiB used, 715 GiB / 715 GiB avail; 23 KiB/s rd, 0 B/s wr, 13 op/s 2024-03-30T13:45:15.736 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:45:15 smithi099 ceph-mon[24912]: from='client.14838 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T13:45:15.736 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:45:15 smithi099 ceph-mon[29691]: from='client.14838 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T13:45:16.006 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:45:15 smithi181 ceph-mon[25762]: from='client.14838 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T13:45:16.750 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:45:16 smithi099 ceph-mon[24912]: pgmap v9: 161 pgs: 161 active+clean; 585 KiB data, 68 MiB used, 715 GiB / 715 GiB avail; 20 KiB/s rd, 0 B/s wr, 11 op/s 2024-03-30T13:45:16.751 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:45:16 smithi099 ceph-mon[29691]: pgmap v9: 161 pgs: 161 active+clean; 585 KiB data, 68 MiB used, 715 GiB / 715 GiB avail; 20 KiB/s rd, 0 B/s wr, 11 op/s 2024-03-30T13:45:17.006 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:45:16 smithi181 ceph-mon[25762]: pgmap v9: 161 pgs: 161 active+clean; 585 KiB data, 68 MiB used, 715 GiB / 715 GiB avail; 20 KiB/s rd, 0 B/s wr, 11 op/s 2024-03-30T13:45:17.087 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:45:16 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[25141]: ::ffff:172.21.15.181 - - [30/Mar/2024:13:45:16] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-03-30T13:45:19.339 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:45:19 smithi099 ceph-mon[24912]: pgmap v10: 161 pgs: 161 active+clean; 585 KiB data, 68 MiB used, 715 GiB / 715 GiB avail; 18 KiB/s rd, 0 B/s wr, 10 op/s 2024-03-30T13:45:19.339 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:45:19 smithi099 ceph-mon[29691]: pgmap v10: 161 pgs: 161 active+clean; 585 KiB data, 68 MiB used, 715 GiB / 715 GiB avail; 18 KiB/s rd, 0 B/s wr, 10 op/s 2024-03-30T13:45:19.462 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:45:19 smithi181 ceph-mon[25762]: pgmap v10: 161 pgs: 161 active+clean; 585 KiB data, 68 MiB used, 715 GiB / 715 GiB avail; 18 KiB/s rd, 0 B/s wr, 10 op/s 2024-03-30T13:45:19.756 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 13:45:19 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-x[50211]: ::ffff:172.21.15.181 - - [30/Mar/2024:13:45:19] "GET /metrics HTTP/1.1" 200 37970 "" "Prometheus/2.33.4" 2024-03-30T13:45:19.966 INFO:journalctl@ceph.alertmanager.a.smithi099.stdout:Mar 30 13:45:19 smithi099 systemd[1]: Stopping Ceph alertmanager.a for 98ebaeb8-ee99-11ee-b647-cb9ed24678a4... 2024-03-30T13:45:19.966 INFO:journalctl@ceph.alertmanager.a.smithi099.stdout:Mar 30 13:45:19 smithi099 bash[64762]: Error: no container with name or ID "ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-alertmanager.a" found: no such container 2024-03-30T13:45:20.301 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:45:20 smithi099 ceph-mon[24912]: from='mgr.24746 172.21.15.181:0/2892154077' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T13:45:20.301 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:45:20 smithi099 ceph-mon[29691]: from='mgr.24746 172.21.15.181:0/2892154077' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T13:45:20.301 INFO:journalctl@ceph.alertmanager.a.smithi099.stdout:Mar 30 13:45:19 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-alertmanager-a[52107]: level=info ts=2024-03-30T13:45:19.964Z caller=main.go:557 msg="Received SIGTERM, exiting gracefully..." 2024-03-30T13:45:20.301 INFO:journalctl@ceph.alertmanager.a.smithi099.stdout:Mar 30 13:45:19 smithi099 podman[64774]: 2024-03-30 13:45:19.995209776 +0000 UTC m=+0.151380423 container died 8804d597845b7260a773e9116473d85637cdc05c922206916b67fb5badd9712a (image=quay.io/prometheus/alertmanager:v0.23.0, name=ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-alertmanager-a, maintainer=The Prometheus Authors ) 2024-03-30T13:45:20.506 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:45:20 smithi181 ceph-mon[25762]: from='mgr.24746 172.21.15.181:0/2892154077' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T13:45:20.587 INFO:journalctl@ceph.alertmanager.a.smithi099.stdout:Mar 30 13:45:20 smithi099 podman[64774]: 2024-03-30 13:45:20.398969872 +0000 UTC m=+0.555140517 container cleanup 8804d597845b7260a773e9116473d85637cdc05c922206916b67fb5badd9712a (image=quay.io/prometheus/alertmanager:v0.23.0, name=ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-alertmanager-a, maintainer=The Prometheus Authors ) 2024-03-30T13:45:20.587 INFO:journalctl@ceph.alertmanager.a.smithi099.stdout:Mar 30 13:45:20 smithi099 bash[64774]: ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-alertmanager-a 2024-03-30T13:45:20.587 INFO:journalctl@ceph.alertmanager.a.smithi099.stdout:Mar 30 13:45:20 smithi099 bash[64803]: Error: no container with name or ID "ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-alertmanager.a" found: no such container 2024-03-30T13:45:21.010 INFO:journalctl@ceph.alertmanager.a.smithi099.stdout:Mar 30 13:45:20 smithi099 podman[64788]: 2024-03-30 13:45:20.675113232 +0000 UTC m=+0.677176325 container remove 8804d597845b7260a773e9116473d85637cdc05c922206916b67fb5badd9712a (image=quay.io/prometheus/alertmanager:v0.23.0, name=ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-alertmanager-a, maintainer=The Prometheus Authors ) 2024-03-30T13:45:21.010 INFO:journalctl@ceph.alertmanager.a.smithi099.stdout:Mar 30 13:45:20 smithi099 podman[64788]: 2024-03-30 13:45:20.76754248 +0000 UTC m=+0.769605540 volume remove fe3ae99f89c5c5ed25a1c60ebf92b9d3421ac5f18643bc5cfe0c0d6018ac75e2 2024-03-30T13:45:21.010 INFO:journalctl@ceph.alertmanager.a.smithi099.stdout:Mar 30 13:45:20 smithi099 systemd[1]: ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4@alertmanager.a.service: Deactivated successfully. 2024-03-30T13:45:21.011 INFO:journalctl@ceph.alertmanager.a.smithi099.stdout:Mar 30 13:45:20 smithi099 systemd[1]: Stopped Ceph alertmanager.a for 98ebaeb8-ee99-11ee-b647-cb9ed24678a4. 2024-03-30T13:45:21.011 INFO:journalctl@ceph.alertmanager.a.smithi099.stdout:Mar 30 13:45:20 smithi099 systemd[1]: ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4@alertmanager.a.service: Consumed 1.275s CPU time. 2024-03-30T13:45:21.011 INFO:journalctl@ceph.alertmanager.a.smithi099.stdout:Mar 30 13:45:20 smithi099 systemd[1]: Starting Ceph alertmanager.a for 98ebaeb8-ee99-11ee-b647-cb9ed24678a4... 2024-03-30T13:45:21.317 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:45:21 smithi099 ceph-mon[24912]: pgmap v11: 161 pgs: 161 active+clean; 585 KiB data, 68 MiB used, 715 GiB / 715 GiB avail; 18 KiB/s rd, 0 B/s wr, 10 op/s 2024-03-30T13:45:21.318 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:45:21 smithi099 ceph-mon[29691]: pgmap v11: 161 pgs: 161 active+clean; 585 KiB data, 68 MiB used, 715 GiB / 715 GiB avail; 18 KiB/s rd, 0 B/s wr, 10 op/s 2024-03-30T13:45:21.318 INFO:journalctl@ceph.alertmanager.a.smithi099.stdout:Mar 30 13:45:21 smithi099 podman[64870]: 2024-03-30 13:45:20.912261744 +0000 UTC m=+0.017925809 image pull ba2b418f427c0636d654de8757e830c80168e76482bcc46bb2138e569d6c91d4 quay.io/prometheus/alertmanager:v0.23.0 2024-03-30T13:45:21.318 INFO:journalctl@ceph.alertmanager.a.smithi099.stdout:Mar 30 13:45:21 smithi099 podman[64870]: 2024-03-30 13:45:21.037516469 +0000 UTC m=+0.143180525 volume create a69ea3e29dff3bf62093177be1e23c2a2898dd76fb4aea4f72c8a0eb571c5831 2024-03-30T13:45:21.318 INFO:journalctl@ceph.alertmanager.a.smithi099.stdout:Mar 30 13:45:21 smithi099 podman[64870]: 2024-03-30 13:45:21.136226194 +0000 UTC m=+0.241890288 container create 0f1be38010273360865e2c9876a2c2bb85c27dd134d31fb3b7f242c57b8da619 (image=quay.io/prometheus/alertmanager:v0.23.0, name=ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-alertmanager-a, maintainer=The Prometheus Authors ) 2024-03-30T13:45:21.506 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:45:21 smithi181 ceph-mon[25762]: pgmap v11: 161 pgs: 161 active+clean; 585 KiB data, 68 MiB used, 715 GiB / 715 GiB avail; 18 KiB/s rd, 0 B/s wr, 10 op/s 2024-03-30T13:45:21.587 INFO:journalctl@ceph.alertmanager.a.smithi099.stdout:Mar 30 13:45:21 smithi099 podman[64870]: 2024-03-30 13:45:21.439555874 +0000 UTC m=+0.545219927 container init 0f1be38010273360865e2c9876a2c2bb85c27dd134d31fb3b7f242c57b8da619 (image=quay.io/prometheus/alertmanager:v0.23.0, name=ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-alertmanager-a, maintainer=The Prometheus Authors ) 2024-03-30T13:45:21.587 INFO:journalctl@ceph.alertmanager.a.smithi099.stdout:Mar 30 13:45:21 smithi099 podman[64870]: 2024-03-30 13:45:21.442176223 +0000 UTC m=+0.547840276 container start 0f1be38010273360865e2c9876a2c2bb85c27dd134d31fb3b7f242c57b8da619 (image=quay.io/prometheus/alertmanager:v0.23.0, name=ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-alertmanager-a, maintainer=The Prometheus Authors ) 2024-03-30T13:45:21.587 INFO:journalctl@ceph.alertmanager.a.smithi099.stdout:Mar 30 13:45:21 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-alertmanager-a[64884]: level=info ts=2024-03-30T13:45:21.452Z caller=main.go:225 msg="Starting Alertmanager" version="(version=0.23.0, branch=HEAD, revision=61046b17771a57cfd4c4a51be370ab930a4d7d54)" 2024-03-30T13:45:21.588 INFO:journalctl@ceph.alertmanager.a.smithi099.stdout:Mar 30 13:45:21 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-alertmanager-a[64884]: level=info ts=2024-03-30T13:45:21.452Z caller=main.go:226 build_context="(go=go1.16.7, user=root@e21a959be8d2, date=20210825-10:48:55)" 2024-03-30T13:45:21.588 INFO:journalctl@ceph.alertmanager.a.smithi099.stdout:Mar 30 13:45:21 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-alertmanager-a[64884]: level=info ts=2024-03-30T13:45:21.453Z caller=cluster.go:184 component=cluster msg="setting advertise address explicitly" addr=172.21.15.99 port=9094 2024-03-30T13:45:21.588 INFO:journalctl@ceph.alertmanager.a.smithi099.stdout:Mar 30 13:45:21 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-alertmanager-a[64884]: level=info ts=2024-03-30T13:45:21.454Z caller=cluster.go:671 component=cluster msg="Waiting for gossip to settle..." interval=2s 2024-03-30T13:45:21.588 INFO:journalctl@ceph.alertmanager.a.smithi099.stdout:Mar 30 13:45:21 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-alertmanager-a[64884]: level=info ts=2024-03-30T13:45:21.480Z caller=coordinator.go:113 component=configuration msg="Loading configuration file" file=/etc/alertmanager/alertmanager.yml 2024-03-30T13:45:21.588 INFO:journalctl@ceph.alertmanager.a.smithi099.stdout:Mar 30 13:45:21 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-alertmanager-a[64884]: level=info ts=2024-03-30T13:45:21.480Z caller=coordinator.go:126 component=configuration msg="Completed loading of configuration file" file=/etc/alertmanager/alertmanager.yml 2024-03-30T13:45:21.588 INFO:journalctl@ceph.alertmanager.a.smithi099.stdout:Mar 30 13:45:21 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-alertmanager-a[64884]: level=info ts=2024-03-30T13:45:21.482Z caller=main.go:518 msg=Listening address=:9093 2024-03-30T13:45:21.588 INFO:journalctl@ceph.alertmanager.a.smithi099.stdout:Mar 30 13:45:21 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-alertmanager-a[64884]: level=info ts=2024-03-30T13:45:21.482Z caller=tls_config.go:191 msg="TLS is disabled." http2=false 2024-03-30T13:45:21.588 INFO:journalctl@ceph.alertmanager.a.smithi099.stdout:Mar 30 13:45:21 smithi099 bash[64870]: 0f1be38010273360865e2c9876a2c2bb85c27dd134d31fb3b7f242c57b8da619 2024-03-30T13:45:21.588 INFO:journalctl@ceph.alertmanager.a.smithi099.stdout:Mar 30 13:45:21 smithi099 systemd[1]: Started Ceph alertmanager.a for 98ebaeb8-ee99-11ee-b647-cb9ed24678a4. 2024-03-30T13:45:22.577 INFO:journalctl@ceph.prometheus.a.smithi181.stdout:Mar 30 13:45:22 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-prometheus-a[45828]: ts=2024-03-30T13:45:22.314Z caller=manager.go:609 level=warn component="rule manager" group=pools msg="Evaluating rule failed" rule="alert: CephPoolGrowthWarning\nexpr: (predict_linear(ceph_pool_percent_used[2d], 3600 * 24 * 5) * on(pool_id) group_right()\n ceph_pool_metadata) >= 95\nlabels:\n oid: 1.3.6.1.4.1.50495.1.2.1.9.2\n severity: warning\n type: ceph_default\nannotations:\n description: |\n Pool '{{ $labels.name }}' will be full in less than 5 days assuming the average fill-up rate of the past 48 hours.\n summary: Pool growth rate may soon exceed it's capacity\n" err="found duplicate series for the match group {pool_id=\"1\"} on the left hand-side of the operation: [{instance=\"172.21.15.99:9283\", job=\"ceph\", pool_id=\"1\"}, {instance=\"172.21.15.181:9283\", job=\"ceph\", pool_id=\"1\"}];many-to-many matching not allowed: matching labels must be unique on one side" 2024-03-30T13:45:22.837 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:45:22 smithi099 ceph-mon[29691]: from='mgr.24746 ' entity='mgr.x' 2024-03-30T13:45:22.837 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:45:22 smithi099 ceph-mon[29691]: from='mgr.24746 ' entity='mgr.x' 2024-03-30T13:45:22.837 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:45:22 smithi099 ceph-mon[29691]: Reconfiguring iscsi.foo.smithi099.qyjuvr (dependencies changed)... 2024-03-30T13:45:22.837 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:45:22 smithi099 ceph-mon[29691]: from='mgr.24746 172.21.15.181:0/2892154077' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.iscsi.foo.smithi099.qyjuvr", "caps": ["mon", "profile rbd, allow command \"osd blocklist\", allow command \"config-key get\" with \"key\" prefix \"iscsi/\"", "mgr", "allow command \"service status\"", "osd", "allow rwx"]}]: dispatch 2024-03-30T13:45:22.838 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:45:22 smithi099 ceph-mon[29691]: from='mgr.24746 ' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.iscsi.foo.smithi099.qyjuvr", "caps": ["mon", "profile rbd, allow command \"osd blocklist\", allow command \"config-key get\" with \"key\" prefix \"iscsi/\"", "mgr", "allow command \"service status\"", "osd", "allow rwx"]}]: dispatch 2024-03-30T13:45:22.838 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:45:22 smithi099 ceph-mon[29691]: from='mgr.24746 172.21.15.181:0/2892154077' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:45:22.838 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:45:22 smithi099 ceph-mon[29691]: Reconfiguring daemon iscsi.foo.smithi099.qyjuvr on smithi099 2024-03-30T13:45:22.838 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:45:22 smithi099 ceph-mon[29691]: pgmap v12: 161 pgs: 161 active+clean; 585 KiB data, 68 MiB used, 715 GiB / 715 GiB avail; 18 KiB/s rd, 0 B/s wr, 10 op/s 2024-03-30T13:45:22.838 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:45:22 smithi099 ceph-mon[24912]: from='mgr.24746 ' entity='mgr.x' 2024-03-30T13:45:22.838 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:45:22 smithi099 ceph-mon[24912]: from='mgr.24746 ' entity='mgr.x' 2024-03-30T13:45:22.838 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:45:22 smithi099 ceph-mon[24912]: Reconfiguring iscsi.foo.smithi099.qyjuvr (dependencies changed)... 2024-03-30T13:45:22.838 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:45:22 smithi099 ceph-mon[24912]: from='mgr.24746 172.21.15.181:0/2892154077' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.iscsi.foo.smithi099.qyjuvr", "caps": ["mon", "profile rbd, allow command \"osd blocklist\", allow command \"config-key get\" with \"key\" prefix \"iscsi/\"", "mgr", "allow command \"service status\"", "osd", "allow rwx"]}]: dispatch 2024-03-30T13:45:22.838 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:45:22 smithi099 ceph-mon[24912]: from='mgr.24746 ' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.iscsi.foo.smithi099.qyjuvr", "caps": ["mon", "profile rbd, allow command \"osd blocklist\", allow command \"config-key get\" with \"key\" prefix \"iscsi/\"", "mgr", "allow command \"service status\"", "osd", "allow rwx"]}]: dispatch 2024-03-30T13:45:22.838 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:45:22 smithi099 ceph-mon[24912]: from='mgr.24746 172.21.15.181:0/2892154077' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:45:22.839 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:45:22 smithi099 ceph-mon[24912]: Reconfiguring daemon iscsi.foo.smithi099.qyjuvr on smithi099 2024-03-30T13:45:22.839 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:45:22 smithi099 ceph-mon[24912]: pgmap v12: 161 pgs: 161 active+clean; 585 KiB data, 68 MiB used, 715 GiB / 715 GiB avail; 18 KiB/s rd, 0 B/s wr, 10 op/s 2024-03-30T13:45:23.006 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:45:22 smithi181 ceph-mon[25762]: from='mgr.24746 ' entity='mgr.x' 2024-03-30T13:45:23.006 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:45:22 smithi181 ceph-mon[25762]: from='mgr.24746 ' entity='mgr.x' 2024-03-30T13:45:23.006 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:45:22 smithi181 ceph-mon[25762]: Reconfiguring iscsi.foo.smithi099.qyjuvr (dependencies changed)... 2024-03-30T13:45:23.006 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:45:22 smithi181 ceph-mon[25762]: from='mgr.24746 172.21.15.181:0/2892154077' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.iscsi.foo.smithi099.qyjuvr", "caps": ["mon", "profile rbd, allow command \"osd blocklist\", allow command \"config-key get\" with \"key\" prefix \"iscsi/\"", "mgr", "allow command \"service status\"", "osd", "allow rwx"]}]: dispatch 2024-03-30T13:45:23.006 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:45:22 smithi181 ceph-mon[25762]: from='mgr.24746 ' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.iscsi.foo.smithi099.qyjuvr", "caps": ["mon", "profile rbd, allow command \"osd blocklist\", allow command \"config-key get\" with \"key\" prefix \"iscsi/\"", "mgr", "allow command \"service status\"", "osd", "allow rwx"]}]: dispatch 2024-03-30T13:45:23.007 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:45:22 smithi181 ceph-mon[25762]: from='mgr.24746 172.21.15.181:0/2892154077' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:45:23.007 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:45:22 smithi181 ceph-mon[25762]: Reconfiguring daemon iscsi.foo.smithi099.qyjuvr on smithi099 2024-03-30T13:45:23.007 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:45:22 smithi181 ceph-mon[25762]: pgmap v12: 161 pgs: 161 active+clean; 585 KiB data, 68 MiB used, 715 GiB / 715 GiB avail; 18 KiB/s rd, 0 B/s wr, 10 op/s 2024-03-30T13:45:23.562 INFO:journalctl@ceph.alertmanager.a.smithi099.stdout:Mar 30 13:45:23 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-alertmanager-a[64884]: level=info ts=2024-03-30T13:45:23.455Z caller=cluster.go:696 component=cluster msg="gossip not settled" polls=0 before=0 now=1 elapsed=2.000836399s 2024-03-30T13:45:24.837 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:45:24 smithi099 ceph-mon[29691]: pgmap v13: 161 pgs: 161 active+clean; 585 KiB data, 68 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T13:45:24.837 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:45:24 smithi099 ceph-mon[24912]: pgmap v13: 161 pgs: 161 active+clean; 585 KiB data, 68 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T13:45:25.006 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:45:24 smithi181 ceph-mon[25762]: pgmap v13: 161 pgs: 161 active+clean; 585 KiB data, 68 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T13:45:26.837 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:45:26 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[25141]: ::ffff:172.21.15.181 - - [30/Mar/2024:13:45:26] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-03-30T13:45:27.159 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:45:27 smithi181 ceph-mon[25762]: pgmap v14: 161 pgs: 161 active+clean; 585 KiB data, 68 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T13:45:27.180 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:45:27 smithi099 ceph-mon[29691]: pgmap v14: 161 pgs: 161 active+clean; 585 KiB data, 68 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T13:45:27.181 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:45:27 smithi099 ceph-mon[24912]: pgmap v14: 161 pgs: 161 active+clean; 585 KiB data, 68 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T13:45:28.756 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:45:28 smithi181 ceph-mon[25762]: from='mgr.24746 ' entity='mgr.x' 2024-03-30T13:45:28.756 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:45:28 smithi181 ceph-mon[25762]: from='mgr.24746 ' entity='mgr.x' 2024-03-30T13:45:28.756 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:45:28 smithi181 ceph-mon[25762]: from='mgr.24746 172.21.15.181:0/2892154077' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.agent.smithi181", "caps": []}]: dispatch 2024-03-30T13:45:28.756 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:45:28 smithi181 ceph-mon[25762]: from='mgr.24746 ' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.agent.smithi181", "caps": []}]: dispatch 2024-03-30T13:45:28.756 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:45:28 smithi181 ceph-mon[25762]: Reconfiguring daemon agent.smithi181 on smithi181 2024-03-30T13:45:28.757 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:45:28 smithi181 ceph-mon[25762]: Deploying cephadm binary to smithi181 2024-03-30T13:45:28.757 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:45:28 smithi181 ceph-mon[25762]: from='client.? 172.21.15.99:0/2591594225' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-03-30T13:45:28.757 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:45:28 smithi181 ceph-mon[25762]: pgmap v15: 161 pgs: 161 active+clean; 585 KiB data, 68 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T13:45:28.757 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:45:28 smithi181 ceph-mon[25762]: from='client.? 172.21.15.99:0/2619141519' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.99:0/1556138711"}]: dispatch 2024-03-30T13:45:28.757 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:45:28 smithi181 ceph-mon[25762]: from='client.? ' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.99:0/1556138711"}]: dispatch 2024-03-30T13:45:28.837 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:45:28 smithi099 ceph-mon[24912]: from='mgr.24746 ' entity='mgr.x' 2024-03-30T13:45:28.837 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:45:28 smithi099 ceph-mon[24912]: from='mgr.24746 ' entity='mgr.x' 2024-03-30T13:45:28.837 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:45:28 smithi099 ceph-mon[24912]: from='mgr.24746 172.21.15.181:0/2892154077' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.agent.smithi181", "caps": []}]: dispatch 2024-03-30T13:45:28.837 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:45:28 smithi099 ceph-mon[24912]: from='mgr.24746 ' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.agent.smithi181", "caps": []}]: dispatch 2024-03-30T13:45:28.838 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:45:28 smithi099 ceph-mon[24912]: Reconfiguring daemon agent.smithi181 on smithi181 2024-03-30T13:45:28.838 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:45:28 smithi099 ceph-mon[24912]: Deploying cephadm binary to smithi181 2024-03-30T13:45:28.838 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:45:28 smithi099 ceph-mon[24912]: from='client.? 172.21.15.99:0/2591594225' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-03-30T13:45:28.838 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:45:28 smithi099 ceph-mon[24912]: pgmap v15: 161 pgs: 161 active+clean; 585 KiB data, 68 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T13:45:28.838 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:45:28 smithi099 ceph-mon[24912]: from='client.? 172.21.15.99:0/2619141519' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.99:0/1556138711"}]: dispatch 2024-03-30T13:45:28.838 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:45:28 smithi099 ceph-mon[24912]: from='client.? ' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.99:0/1556138711"}]: dispatch 2024-03-30T13:45:28.838 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:45:28 smithi099 ceph-mon[29691]: from='mgr.24746 ' entity='mgr.x' 2024-03-30T13:45:28.838 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:45:28 smithi099 ceph-mon[29691]: from='mgr.24746 ' entity='mgr.x' 2024-03-30T13:45:28.839 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:45:28 smithi099 ceph-mon[29691]: from='mgr.24746 172.21.15.181:0/2892154077' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.agent.smithi181", "caps": []}]: dispatch 2024-03-30T13:45:28.839 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:45:28 smithi099 ceph-mon[29691]: from='mgr.24746 ' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.agent.smithi181", "caps": []}]: dispatch 2024-03-30T13:45:28.839 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:45:28 smithi099 ceph-mon[29691]: Reconfiguring daemon agent.smithi181 on smithi181 2024-03-30T13:45:28.839 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:45:28 smithi099 ceph-mon[29691]: Deploying cephadm binary to smithi181 2024-03-30T13:45:28.839 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:45:28 smithi099 ceph-mon[29691]: from='client.? 172.21.15.99:0/2591594225' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-03-30T13:45:28.839 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:45:28 smithi099 ceph-mon[29691]: pgmap v15: 161 pgs: 161 active+clean; 585 KiB data, 68 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T13:45:28.839 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:45:28 smithi099 ceph-mon[29691]: from='client.? 172.21.15.99:0/2619141519' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.99:0/1556138711"}]: dispatch 2024-03-30T13:45:28.839 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:45:28 smithi099 ceph-mon[29691]: from='client.? ' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.99:0/1556138711"}]: dispatch 2024-03-30T13:45:29.555 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:45:29 smithi181 ceph-mon[25762]: from='client.? ' entity='client.iscsi.foo.smithi099.qyjuvr' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.99:0/1556138711"}]': finished 2024-03-30T13:45:29.837 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:45:29 smithi099 ceph-mon[24912]: from='client.? ' entity='client.iscsi.foo.smithi099.qyjuvr' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.99:0/1556138711"}]': finished 2024-03-30T13:45:29.837 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:45:29 smithi099 ceph-mon[24912]: osdmap e97: 8 total, 8 up, 8 in 2024-03-30T13:45:29.837 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:45:29 smithi099 ceph-mon[24912]: from='client.? 172.21.15.99:0/1349789102' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.99:0/1421105802"}]: dispatch 2024-03-30T13:45:29.837 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:45:29 smithi099 ceph-mon[24912]: from='client.? ' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.99:0/1421105802"}]: dispatch 2024-03-30T13:45:29.837 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:45:29 smithi099 ceph-mon[29691]: from='client.? ' entity='client.iscsi.foo.smithi099.qyjuvr' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.99:0/1556138711"}]': finished 2024-03-30T13:45:29.837 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:45:29 smithi099 ceph-mon[29691]: osdmap e97: 8 total, 8 up, 8 in 2024-03-30T13:45:29.837 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:45:29 smithi099 ceph-mon[29691]: from='client.? 172.21.15.99:0/1349789102' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.99:0/1421105802"}]: dispatch 2024-03-30T13:45:29.838 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:45:29 smithi099 ceph-mon[29691]: from='client.? ' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.99:0/1421105802"}]: dispatch 2024-03-30T13:45:29.875 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:45:29 smithi181 ceph-mon[25762]: osdmap e97: 8 total, 8 up, 8 in 2024-03-30T13:45:29.875 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:45:29 smithi181 ceph-mon[25762]: from='client.? 172.21.15.99:0/1349789102' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.99:0/1421105802"}]: dispatch 2024-03-30T13:45:29.875 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:45:29 smithi181 ceph-mon[25762]: from='client.? ' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.99:0/1421105802"}]: dispatch 2024-03-30T13:45:29.875 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 13:45:29 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-x[50211]: ::ffff:172.21.15.181 - - [30/Mar/2024:13:45:29] "GET /metrics HTTP/1.1" 200 37970 "" "Prometheus/2.33.4" 2024-03-30T13:45:30.990 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:45:30 smithi181 ceph-mon[25762]: from='client.? ' entity='client.iscsi.foo.smithi099.qyjuvr' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.99:0/1421105802"}]': finished 2024-03-30T13:45:30.990 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:45:30 smithi181 ceph-mon[25762]: osdmap e98: 8 total, 8 up, 8 in 2024-03-30T13:45:30.990 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:45:30 smithi181 ceph-mon[25762]: from='client.? 172.21.15.99:0/4174826379' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.99:0/1422060755"}]: dispatch 2024-03-30T13:45:30.990 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:45:30 smithi181 ceph-mon[25762]: pgmap v18: 161 pgs: 161 active+clean; 585 KiB data, 68 MiB used, 715 GiB / 715 GiB avail; 639 B/s rd, 0 op/s 2024-03-30T13:45:31.087 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:45:30 smithi099 ceph-mon[24912]: from='client.? ' entity='client.iscsi.foo.smithi099.qyjuvr' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.99:0/1421105802"}]': finished 2024-03-30T13:45:31.087 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:45:30 smithi099 ceph-mon[24912]: osdmap e98: 8 total, 8 up, 8 in 2024-03-30T13:45:31.087 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:45:30 smithi099 ceph-mon[24912]: from='client.? 172.21.15.99:0/4174826379' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.99:0/1422060755"}]: dispatch 2024-03-30T13:45:31.087 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:45:30 smithi099 ceph-mon[24912]: pgmap v18: 161 pgs: 161 active+clean; 585 KiB data, 68 MiB used, 715 GiB / 715 GiB avail; 639 B/s rd, 0 op/s 2024-03-30T13:45:31.087 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:45:30 smithi099 ceph-mon[29691]: from='client.? ' entity='client.iscsi.foo.smithi099.qyjuvr' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.99:0/1421105802"}]': finished 2024-03-30T13:45:31.087 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:45:30 smithi099 ceph-mon[29691]: osdmap e98: 8 total, 8 up, 8 in 2024-03-30T13:45:31.087 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:45:30 smithi099 ceph-mon[29691]: from='client.? 172.21.15.99:0/4174826379' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.99:0/1422060755"}]: dispatch 2024-03-30T13:45:31.087 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:45:30 smithi099 ceph-mon[29691]: pgmap v18: 161 pgs: 161 active+clean; 585 KiB data, 68 MiB used, 715 GiB / 715 GiB avail; 639 B/s rd, 0 op/s 2024-03-30T13:45:31.837 INFO:journalctl@ceph.alertmanager.a.smithi099.stdout:Mar 30 13:45:31 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-alertmanager-a[64884]: level=info ts=2024-03-30T13:45:31.457Z caller=cluster.go:688 component=cluster msg="gossip settled; proceeding" elapsed=10.002911549s 2024-03-30T13:45:31.837 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:45:31 smithi099 ceph-mon[24912]: from='client.? 172.21.15.99:0/4174826379' entity='client.iscsi.foo.smithi099.qyjuvr' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.99:0/1422060755"}]': finished 2024-03-30T13:45:31.837 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:45:31 smithi099 ceph-mon[24912]: osdmap e99: 8 total, 8 up, 8 in 2024-03-30T13:45:31.837 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:45:31 smithi099 ceph-mon[24912]: from='mgr.24746 ' entity='mgr.x' 2024-03-30T13:45:31.838 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:45:31 smithi099 ceph-mon[24912]: from='mgr.24746 ' entity='mgr.x' 2024-03-30T13:45:31.838 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:45:31 smithi099 ceph-mon[24912]: from='mgr.24746 ' entity='mgr.x' 2024-03-30T13:45:31.838 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:45:31 smithi099 ceph-mon[24912]: Reconfiguring prometheus.a (dependencies changed)... 2024-03-30T13:45:31.838 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:45:31 smithi099 ceph-mon[24912]: from='client.? 172.21.15.99:0/502607741' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.99:0/1053708127"}]: dispatch 2024-03-30T13:45:31.838 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:45:31 smithi099 ceph-mon[24912]: Reconfiguring daemon prometheus.a on smithi181 2024-03-30T13:45:31.838 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:45:31 smithi099 ceph-mon[29691]: from='client.? 172.21.15.99:0/4174826379' entity='client.iscsi.foo.smithi099.qyjuvr' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.99:0/1422060755"}]': finished 2024-03-30T13:45:31.838 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:45:31 smithi099 ceph-mon[29691]: osdmap e99: 8 total, 8 up, 8 in 2024-03-30T13:45:31.838 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:45:31 smithi099 ceph-mon[29691]: from='mgr.24746 ' entity='mgr.x' 2024-03-30T13:45:31.838 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:45:31 smithi099 ceph-mon[29691]: from='mgr.24746 ' entity='mgr.x' 2024-03-30T13:45:31.838 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:45:31 smithi099 ceph-mon[29691]: from='mgr.24746 ' entity='mgr.x' 2024-03-30T13:45:31.838 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:45:31 smithi099 ceph-mon[29691]: Reconfiguring prometheus.a (dependencies changed)... 2024-03-30T13:45:31.839 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:45:31 smithi099 ceph-mon[29691]: from='client.? 172.21.15.99:0/502607741' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.99:0/1053708127"}]: dispatch 2024-03-30T13:45:31.839 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:45:31 smithi099 ceph-mon[29691]: Reconfiguring daemon prometheus.a on smithi181 2024-03-30T13:45:32.006 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:45:31 smithi181 ceph-mon[25762]: from='client.? 172.21.15.99:0/4174826379' entity='client.iscsi.foo.smithi099.qyjuvr' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.99:0/1422060755"}]': finished 2024-03-30T13:45:32.006 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:45:31 smithi181 ceph-mon[25762]: osdmap e99: 8 total, 8 up, 8 in 2024-03-30T13:45:32.006 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:45:31 smithi181 ceph-mon[25762]: from='mgr.24746 ' entity='mgr.x' 2024-03-30T13:45:32.006 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:45:31 smithi181 ceph-mon[25762]: from='mgr.24746 ' entity='mgr.x' 2024-03-30T13:45:32.006 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:45:31 smithi181 ceph-mon[25762]: from='mgr.24746 ' entity='mgr.x' 2024-03-30T13:45:32.006 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:45:31 smithi181 ceph-mon[25762]: Reconfiguring prometheus.a (dependencies changed)... 2024-03-30T13:45:32.007 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:45:31 smithi181 ceph-mon[25762]: from='client.? 172.21.15.99:0/502607741' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.99:0/1053708127"}]: dispatch 2024-03-30T13:45:32.007 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:45:31 smithi181 ceph-mon[25762]: Reconfiguring daemon prometheus.a on smithi181 2024-03-30T13:45:32.506 INFO:journalctl@ceph.prometheus.a.smithi181.stdout:Mar 30 13:45:32 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-prometheus-a[45828]: ts=2024-03-30T13:45:32.314Z caller=manager.go:609 level=warn component="rule manager" group=pools msg="Evaluating rule failed" rule="alert: CephPoolGrowthWarning\nexpr: (predict_linear(ceph_pool_percent_used[2d], 3600 * 24 * 5) * on(pool_id) group_right()\n ceph_pool_metadata) >= 95\nlabels:\n oid: 1.3.6.1.4.1.50495.1.2.1.9.2\n severity: warning\n type: ceph_default\nannotations:\n description: |\n Pool '{{ $labels.name }}' will be full in less than 5 days assuming the average fill-up rate of the past 48 hours.\n summary: Pool growth rate may soon exceed it's capacity\n" err="found duplicate series for the match group {pool_id=\"1\"} on the left hand-side of the operation: [{instance=\"172.21.15.99:9283\", job=\"ceph\", pool_id=\"1\"}, {instance=\"172.21.15.181:9283\", job=\"ceph\", pool_id=\"1\"}];many-to-many matching not allowed: matching labels must be unique on one side" 2024-03-30T13:45:33.006 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:45:32 smithi181 ceph-mon[25762]: from='client.? 172.21.15.99:0/502607741' entity='client.iscsi.foo.smithi099.qyjuvr' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.99:0/1053708127"}]': finished 2024-03-30T13:45:33.006 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:45:32 smithi181 ceph-mon[25762]: osdmap e100: 8 total, 8 up, 8 in 2024-03-30T13:45:33.006 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:45:32 smithi181 ceph-mon[25762]: pgmap v21: 161 pgs: 161 active+clean; 585 KiB data, 68 MiB used, 715 GiB / 715 GiB avail; 767 B/s rd, 0 op/s 2024-03-30T13:45:33.007 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:45:32 smithi181 ceph-mon[25762]: from='client.? 172.21.15.99:0/3888086833' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.99:6801/995392081"}]: dispatch 2024-03-30T13:45:33.236 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:45:32 smithi099 ceph-mon[24912]: from='client.? 172.21.15.99:0/502607741' entity='client.iscsi.foo.smithi099.qyjuvr' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.99:0/1053708127"}]': finished 2024-03-30T13:45:33.237 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:45:32 smithi099 ceph-mon[24912]: osdmap e100: 8 total, 8 up, 8 in 2024-03-30T13:45:33.237 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:45:32 smithi099 ceph-mon[24912]: pgmap v21: 161 pgs: 161 active+clean; 585 KiB data, 68 MiB used, 715 GiB / 715 GiB avail; 767 B/s rd, 0 op/s 2024-03-30T13:45:33.237 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:45:32 smithi099 ceph-mon[24912]: from='client.? 172.21.15.99:0/3888086833' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.99:6801/995392081"}]: dispatch 2024-03-30T13:45:33.237 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:45:32 smithi099 ceph-mon[29691]: from='client.? 172.21.15.99:0/502607741' entity='client.iscsi.foo.smithi099.qyjuvr' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.99:0/1053708127"}]': finished 2024-03-30T13:45:33.238 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:45:32 smithi099 ceph-mon[29691]: osdmap e100: 8 total, 8 up, 8 in 2024-03-30T13:45:33.238 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:45:32 smithi099 ceph-mon[29691]: pgmap v21: 161 pgs: 161 active+clean; 585 KiB data, 68 MiB used, 715 GiB / 715 GiB avail; 767 B/s rd, 0 op/s 2024-03-30T13:45:33.238 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:45:32 smithi099 ceph-mon[29691]: from='client.? 172.21.15.99:0/3888086833' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.99:6801/995392081"}]: dispatch 2024-03-30T13:45:33.996 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:45:33 smithi099 ceph-mon[24912]: from='client.? 172.21.15.99:0/3888086833' entity='client.iscsi.foo.smithi099.qyjuvr' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.99:6801/995392081"}]': finished 2024-03-30T13:45:33.996 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:45:33 smithi099 ceph-mon[24912]: osdmap e101: 8 total, 8 up, 8 in 2024-03-30T13:45:33.996 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:45:33 smithi099 ceph-mon[24912]: from='client.? 172.21.15.99:0/1123787804' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.99:6800/995392081"}]: dispatch 2024-03-30T13:45:33.996 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:45:33 smithi099 ceph-mon[29691]: from='client.? 172.21.15.99:0/3888086833' entity='client.iscsi.foo.smithi099.qyjuvr' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.99:6801/995392081"}]': finished 2024-03-30T13:45:33.997 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:45:33 smithi099 ceph-mon[29691]: osdmap e101: 8 total, 8 up, 8 in 2024-03-30T13:45:33.997 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:45:33 smithi099 ceph-mon[29691]: from='client.? 172.21.15.99:0/1123787804' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.99:6800/995392081"}]: dispatch 2024-03-30T13:45:34.256 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:45:33 smithi181 ceph-mon[25762]: from='client.? 172.21.15.99:0/3888086833' entity='client.iscsi.foo.smithi099.qyjuvr' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.99:6801/995392081"}]': finished 2024-03-30T13:45:34.256 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:45:33 smithi181 ceph-mon[25762]: osdmap e101: 8 total, 8 up, 8 in 2024-03-30T13:45:34.256 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:45:33 smithi181 ceph-mon[25762]: from='client.? 172.21.15.99:0/1123787804' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.99:6800/995392081"}]: dispatch 2024-03-30T13:45:35.006 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:45:34 smithi181 ceph-mon[25762]: from='client.? 172.21.15.99:0/1123787804' entity='client.iscsi.foo.smithi099.qyjuvr' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.99:6800/995392081"}]': finished 2024-03-30T13:45:35.006 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:45:34 smithi181 ceph-mon[25762]: osdmap e102: 8 total, 8 up, 8 in 2024-03-30T13:45:35.006 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:45:34 smithi181 ceph-mon[25762]: pgmap v24: 161 pgs: 161 active+clean; 585 KiB data, 68 MiB used, 715 GiB / 715 GiB avail; 767 B/s rd, 0 op/s 2024-03-30T13:45:35.006 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:45:34 smithi181 ceph-mon[25762]: from='mgr.24746 172.21.15.181:0/2892154077' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T13:45:35.006 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:45:34 smithi181 ceph-mon[25762]: from='client.? 172.21.15.99:0/849586290' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.99:0/1477857569"}]: dispatch 2024-03-30T13:45:35.143 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:45:34 smithi099 ceph-mon[24912]: from='client.? 172.21.15.99:0/1123787804' entity='client.iscsi.foo.smithi099.qyjuvr' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.99:6800/995392081"}]': finished 2024-03-30T13:45:35.143 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:45:34 smithi099 ceph-mon[24912]: osdmap e102: 8 total, 8 up, 8 in 2024-03-30T13:45:35.144 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:45:34 smithi099 ceph-mon[24912]: pgmap v24: 161 pgs: 161 active+clean; 585 KiB data, 68 MiB used, 715 GiB / 715 GiB avail; 767 B/s rd, 0 op/s 2024-03-30T13:45:35.144 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:45:34 smithi099 ceph-mon[24912]: from='mgr.24746 172.21.15.181:0/2892154077' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T13:45:35.144 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:45:34 smithi099 ceph-mon[24912]: from='client.? 172.21.15.99:0/849586290' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.99:0/1477857569"}]: dispatch 2024-03-30T13:45:35.144 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:45:34 smithi099 ceph-mon[29691]: from='client.? 172.21.15.99:0/1123787804' entity='client.iscsi.foo.smithi099.qyjuvr' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.99:6800/995392081"}]': finished 2024-03-30T13:45:35.144 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:45:34 smithi099 ceph-mon[29691]: osdmap e102: 8 total, 8 up, 8 in 2024-03-30T13:45:35.144 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:45:34 smithi099 ceph-mon[29691]: pgmap v24: 161 pgs: 161 active+clean; 585 KiB data, 68 MiB used, 715 GiB / 715 GiB avail; 767 B/s rd, 0 op/s 2024-03-30T13:45:35.145 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:45:34 smithi099 ceph-mon[29691]: from='mgr.24746 172.21.15.181:0/2892154077' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T13:45:35.145 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:45:34 smithi099 ceph-mon[29691]: from='client.? 172.21.15.99:0/849586290' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.99:0/1477857569"}]: dispatch 2024-03-30T13:45:36.087 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:45:35 smithi099 ceph-mon[24912]: from='client.? 172.21.15.99:0/849586290' entity='client.iscsi.foo.smithi099.qyjuvr' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.99:0/1477857569"}]': finished 2024-03-30T13:45:36.087 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:45:35 smithi099 ceph-mon[24912]: osdmap e103: 8 total, 8 up, 8 in 2024-03-30T13:45:36.087 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:45:35 smithi099 ceph-mon[29691]: from='client.? 172.21.15.99:0/849586290' entity='client.iscsi.foo.smithi099.qyjuvr' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.99:0/1477857569"}]': finished 2024-03-30T13:45:36.087 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:45:35 smithi099 ceph-mon[29691]: osdmap e103: 8 total, 8 up, 8 in 2024-03-30T13:45:36.256 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:45:35 smithi181 ceph-mon[25762]: from='client.? 172.21.15.99:0/849586290' entity='client.iscsi.foo.smithi099.qyjuvr' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.99:0/1477857569"}]': finished 2024-03-30T13:45:36.256 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:45:35 smithi181 ceph-mon[25762]: osdmap e103: 8 total, 8 up, 8 in 2024-03-30T13:45:36.896 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:45:36 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[25141]: ::ffff:172.21.15.181 - - [30/Mar/2024:13:45:36] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-03-30T13:45:37.191 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:45:36 smithi181 ceph-mon[25762]: pgmap v26: 161 pgs: 161 active+clean; 585 KiB data, 69 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T13:45:37.337 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:45:36 smithi099 ceph-mon[29691]: pgmap v26: 161 pgs: 161 active+clean; 585 KiB data, 69 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T13:45:37.337 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:45:36 smithi099 ceph-mon[24912]: pgmap v26: 161 pgs: 161 active+clean; 585 KiB data, 69 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T13:45:39.337 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:45:39 smithi099 ceph-mon[24912]: from='client.24806 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T13:45:39.337 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:45:39 smithi099 ceph-mon[24912]: pgmap v27: 161 pgs: 161 active+clean; 585 KiB data, 69 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T13:45:39.337 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:45:39 smithi099 ceph-mon[29691]: from='client.24806 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T13:45:39.337 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:45:39 smithi099 ceph-mon[29691]: pgmap v27: 161 pgs: 161 active+clean; 585 KiB data, 69 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T13:45:39.462 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:45:39 smithi181 ceph-mon[25762]: from='client.24806 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T13:45:39.462 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:45:39 smithi181 ceph-mon[25762]: pgmap v27: 161 pgs: 161 active+clean; 585 KiB data, 69 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T13:45:39.756 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 13:45:39 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-x[50211]: ::ffff:172.21.15.181 - - [30/Mar/2024:13:45:39] "GET /metrics HTTP/1.1" 200 37972 "" "Prometheus/2.33.4" 2024-03-30T13:45:41.337 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:45:41 smithi099 ceph-mon[24912]: pgmap v28: 161 pgs: 161 active+clean; 585 KiB data, 69 MiB used, 715 GiB / 715 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-03-30T13:45:41.338 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:45:41 smithi099 ceph-mon[29691]: pgmap v28: 161 pgs: 161 active+clean; 585 KiB data, 69 MiB used, 715 GiB / 715 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-03-30T13:45:41.396 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:45:41 smithi181 ceph-mon[25762]: pgmap v28: 161 pgs: 161 active+clean; 585 KiB data, 69 MiB used, 715 GiB / 715 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-03-30T13:45:42.528 INFO:journalctl@ceph.prometheus.a.smithi181.stdout:Mar 30 13:45:42 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-prometheus-a[45828]: ts=2024-03-30T13:45:42.314Z caller=manager.go:609 level=warn component="rule manager" group=pools msg="Evaluating rule failed" rule="alert: CephPoolGrowthWarning\nexpr: (predict_linear(ceph_pool_percent_used[2d], 3600 * 24 * 5) * on(pool_id) group_right()\n ceph_pool_metadata) >= 95\nlabels:\n oid: 1.3.6.1.4.1.50495.1.2.1.9.2\n severity: warning\n type: ceph_default\nannotations:\n description: |\n Pool '{{ $labels.name }}' will be full in less than 5 days assuming the average fill-up rate of the past 48 hours.\n summary: Pool growth rate may soon exceed it's capacity\n" err="found duplicate series for the match group {pool_id=\"1\"} on the left hand-side of the operation: [{instance=\"172.21.15.99:9283\", job=\"ceph\", pool_id=\"1\"}, {instance=\"172.21.15.181:9283\", job=\"ceph\", pool_id=\"1\"}];many-to-many matching not allowed: matching labels must be unique on one side" 2024-03-30T13:45:43.337 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:45:43 smithi099 ceph-mon[29691]: pgmap v29: 161 pgs: 161 active+clean; 585 KiB data, 69 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T13:45:43.337 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:45:43 smithi099 ceph-mon[24912]: pgmap v29: 161 pgs: 161 active+clean; 585 KiB data, 69 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T13:45:43.506 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:45:43 smithi181 ceph-mon[25762]: pgmap v29: 161 pgs: 161 active+clean; 585 KiB data, 69 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T13:45:43.923 INFO:journalctl@ceph.prometheus.a.smithi181.stdout:Mar 30 13:45:43 smithi181 systemd[1]: Stopping Ceph prometheus.a for 98ebaeb8-ee99-11ee-b647-cb9ed24678a4... 2024-03-30T13:45:43.923 INFO:journalctl@ceph.prometheus.a.smithi181.stdout:Mar 30 13:45:43 smithi181 bash[55258]: Error: no container with name or ID "ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-prometheus.a" found: no such container 2024-03-30T13:45:44.248 INFO:journalctl@ceph.prometheus.a.smithi181.stdout:Mar 30 13:45:43 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-prometheus-a[45828]: ts=2024-03-30T13:45:43.921Z caller=main.go:775 level=warn msg="Received SIGTERM, exiting gracefully..." 2024-03-30T13:45:44.248 INFO:journalctl@ceph.prometheus.a.smithi181.stdout:Mar 30 13:45:43 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-prometheus-a[45828]: ts=2024-03-30T13:45:43.922Z caller=main.go:798 level=info msg="Stopping scrape discovery manager..." 2024-03-30T13:45:44.249 INFO:journalctl@ceph.prometheus.a.smithi181.stdout:Mar 30 13:45:43 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-prometheus-a[45828]: ts=2024-03-30T13:45:43.922Z caller=main.go:812 level=info msg="Stopping notify discovery manager..." 2024-03-30T13:45:44.249 INFO:journalctl@ceph.prometheus.a.smithi181.stdout:Mar 30 13:45:43 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-prometheus-a[45828]: ts=2024-03-30T13:45:43.922Z caller=main.go:834 level=info msg="Stopping scrape manager..." 2024-03-30T13:45:44.249 INFO:journalctl@ceph.prometheus.a.smithi181.stdout:Mar 30 13:45:43 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-prometheus-a[45828]: ts=2024-03-30T13:45:43.922Z caller=main.go:794 level=info msg="Scrape discovery manager stopped" 2024-03-30T13:45:44.249 INFO:journalctl@ceph.prometheus.a.smithi181.stdout:Mar 30 13:45:43 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-prometheus-a[45828]: ts=2024-03-30T13:45:43.922Z caller=main.go:808 level=info msg="Notify discovery manager stopped" 2024-03-30T13:45:44.249 INFO:journalctl@ceph.prometheus.a.smithi181.stdout:Mar 30 13:45:43 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-prometheus-a[45828]: ts=2024-03-30T13:45:43.922Z caller=manager.go:945 level=info component="rule manager" msg="Stopping rule manager..." 2024-03-30T13:45:44.249 INFO:journalctl@ceph.prometheus.a.smithi181.stdout:Mar 30 13:45:43 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-prometheus-a[45828]: ts=2024-03-30T13:45:43.922Z caller=main.go:828 level=info msg="Scrape manager stopped" 2024-03-30T13:45:44.249 INFO:journalctl@ceph.prometheus.a.smithi181.stdout:Mar 30 13:45:43 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-prometheus-a[45828]: ts=2024-03-30T13:45:43.922Z caller=manager.go:955 level=info component="rule manager" msg="Rule manager stopped" 2024-03-30T13:45:44.250 INFO:journalctl@ceph.prometheus.a.smithi181.stdout:Mar 30 13:45:43 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-prometheus-a[45828]: ts=2024-03-30T13:45:43.922Z caller=notifier.go:600 level=info component=notifier msg="Stopping notification manager..." 2024-03-30T13:45:44.250 INFO:journalctl@ceph.prometheus.a.smithi181.stdout:Mar 30 13:45:43 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-prometheus-a[45828]: ts=2024-03-30T13:45:43.922Z caller=main.go:1054 level=info msg="Notifier manager stopped" 2024-03-30T13:45:44.250 INFO:journalctl@ceph.prometheus.a.smithi181.stdout:Mar 30 13:45:43 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-prometheus-a[45828]: ts=2024-03-30T13:45:43.922Z caller=main.go:1066 level=info msg="See you next time!" 2024-03-30T13:45:44.250 INFO:journalctl@ceph.prometheus.a.smithi181.stdout:Mar 30 13:45:43 smithi181 podman[55272]: 2024-03-30 13:45:43.932194038 +0000 UTC m=+0.110508584 container died 9fa29bb6babafba019c2e1b9778c544123fcd1f095fcbea7ac951114f3e237e9 (image=quay.io/prometheus/prometheus:v2.33.4, name=ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-prometheus-a, maintainer=The Prometheus Authors ) 2024-03-30T13:45:44.250 INFO:journalctl@ceph.prometheus.a.smithi181.stdout:Mar 30 13:45:44 smithi181 podman[55272]: 2024-03-30 13:45:44.246511433 +0000 UTC m=+0.424825975 container cleanup 9fa29bb6babafba019c2e1b9778c544123fcd1f095fcbea7ac951114f3e237e9 (image=quay.io/prometheus/prometheus:v2.33.4, name=ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-prometheus-a, maintainer=The Prometheus Authors ) 2024-03-30T13:45:44.250 INFO:journalctl@ceph.prometheus.a.smithi181.stdout:Mar 30 13:45:44 smithi181 bash[55272]: ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-prometheus-a 2024-03-30T13:45:44.499 INFO:journalctl@ceph.prometheus.a.smithi181.stdout:Mar 30 13:45:44 smithi181 bash[55301]: Error: no container with name or ID "ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-prometheus.a" found: no such container 2024-03-30T13:45:44.757 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:45:44 smithi181 ceph-mon[25762]: pgmap v30: 161 pgs: 161 active+clean; 585 KiB data, 69 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-03-30T13:45:44.757 INFO:journalctl@ceph.prometheus.a.smithi181.stdout:Mar 30 13:45:44 smithi181 podman[55286]: 2024-03-30 13:45:44.498059539 +0000 UTC m=+0.568106049 container remove 9fa29bb6babafba019c2e1b9778c544123fcd1f095fcbea7ac951114f3e237e9 (image=quay.io/prometheus/prometheus:v2.33.4, name=ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-prometheus-a, maintainer=The Prometheus Authors ) 2024-03-30T13:45:44.757 INFO:journalctl@ceph.prometheus.a.smithi181.stdout:Mar 30 13:45:44 smithi181 systemd[1]: ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4@prometheus.a.service: Deactivated successfully. 2024-03-30T13:45:44.757 INFO:journalctl@ceph.prometheus.a.smithi181.stdout:Mar 30 13:45:44 smithi181 systemd[1]: Stopped Ceph prometheus.a for 98ebaeb8-ee99-11ee-b647-cb9ed24678a4. 2024-03-30T13:45:44.758 INFO:journalctl@ceph.prometheus.a.smithi181.stdout:Mar 30 13:45:44 smithi181 systemd[1]: ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4@prometheus.a.service: Consumed 1.894s CPU time. 2024-03-30T13:45:44.758 INFO:journalctl@ceph.prometheus.a.smithi181.stdout:Mar 30 13:45:44 smithi181 systemd[1]: Starting Ceph prometheus.a for 98ebaeb8-ee99-11ee-b647-cb9ed24678a4... 2024-03-30T13:45:44.758 INFO:journalctl@ceph.prometheus.a.smithi181.stdout:Mar 30 13:45:44 smithi181 podman[55377]: 2024-03-30 13:45:44.621028111 +0000 UTC m=+0.018788755 image pull 514e6a882f6e74806a5856468489eeff8d7106095557578da96935e4d0ba4d9d quay.io/prometheus/prometheus:v2.33.4 2024-03-30T13:45:44.758 INFO:journalctl@ceph.prometheus.a.smithi181.stdout:Mar 30 13:45:44 smithi181 podman[55377]: 2024-03-30 13:45:44.740750839 +0000 UTC m=+0.138511463 container create fe9273415d72a017487fa57e684aa4d26f83bda6121c833f9e3ebf9816087c5c (image=quay.io/prometheus/prometheus:v2.33.4, name=ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-prometheus-a, maintainer=The Prometheus Authors ) 2024-03-30T13:45:45.087 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:45:44 smithi099 ceph-mon[29691]: pgmap v30: 161 pgs: 161 active+clean; 585 KiB data, 69 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-03-30T13:45:45.087 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:45:44 smithi099 ceph-mon[24912]: pgmap v30: 161 pgs: 161 active+clean; 585 KiB data, 69 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-03-30T13:45:45.224 INFO:journalctl@ceph.prometheus.a.smithi181.stdout:Mar 30 13:45:44 smithi181 podman[55377]: 2024-03-30 13:45:44.993816629 +0000 UTC m=+0.391577254 container init fe9273415d72a017487fa57e684aa4d26f83bda6121c833f9e3ebf9816087c5c (image=quay.io/prometheus/prometheus:v2.33.4, name=ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-prometheus-a, maintainer=The Prometheus Authors ) 2024-03-30T13:45:45.224 INFO:journalctl@ceph.prometheus.a.smithi181.stdout:Mar 30 13:45:44 smithi181 podman[55377]: 2024-03-30 13:45:44.997077302 +0000 UTC m=+0.394837928 container start fe9273415d72a017487fa57e684aa4d26f83bda6121c833f9e3ebf9816087c5c (image=quay.io/prometheus/prometheus:v2.33.4, name=ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-prometheus-a, maintainer=The Prometheus Authors ) 2024-03-30T13:45:45.224 INFO:journalctl@ceph.prometheus.a.smithi181.stdout:Mar 30 13:45:45 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-prometheus-a[55395]: ts=2024-03-30T13:45:45.021Z caller=main.go:475 level=info msg="No time or size retention was set so using the default time retention" duration=15d 2024-03-30T13:45:45.224 INFO:journalctl@ceph.prometheus.a.smithi181.stdout:Mar 30 13:45:45 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-prometheus-a[55395]: ts=2024-03-30T13:45:45.021Z caller=main.go:512 level=info msg="Starting Prometheus" version="(version=2.33.4, branch=HEAD, revision=83032011a5d3e6102624fe58241a374a7201fee8)" 2024-03-30T13:45:45.224 INFO:journalctl@ceph.prometheus.a.smithi181.stdout:Mar 30 13:45:45 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-prometheus-a[55395]: ts=2024-03-30T13:45:45.021Z caller=main.go:517 level=info build_context="(go=go1.17.7, user=root@d13bf69e7be8, date=20220222-16:51:28)" 2024-03-30T13:45:45.224 INFO:journalctl@ceph.prometheus.a.smithi181.stdout:Mar 30 13:45:45 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-prometheus-a[55395]: ts=2024-03-30T13:45:45.021Z caller=main.go:518 level=info host_details="(Linux 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 x86_64 smithi181 (none))" 2024-03-30T13:45:45.224 INFO:journalctl@ceph.prometheus.a.smithi181.stdout:Mar 30 13:45:45 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-prometheus-a[55395]: ts=2024-03-30T13:45:45.021Z caller=main.go:519 level=info fd_limits="(soft=1048576, hard=1048576)" 2024-03-30T13:45:45.225 INFO:journalctl@ceph.prometheus.a.smithi181.stdout:Mar 30 13:45:45 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-prometheus-a[55395]: ts=2024-03-30T13:45:45.021Z caller=main.go:520 level=info vm_limits="(soft=unlimited, hard=unlimited)" 2024-03-30T13:45:45.225 INFO:journalctl@ceph.prometheus.a.smithi181.stdout:Mar 30 13:45:45 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-prometheus-a[55395]: ts=2024-03-30T13:45:45.023Z caller=web.go:570 level=info component=web msg="Start listening for connections" address=:9095 2024-03-30T13:45:45.225 INFO:journalctl@ceph.prometheus.a.smithi181.stdout:Mar 30 13:45:45 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-prometheus-a[55395]: ts=2024-03-30T13:45:45.023Z caller=main.go:923 level=info msg="Starting TSDB ..." 2024-03-30T13:45:45.225 INFO:journalctl@ceph.prometheus.a.smithi181.stdout:Mar 30 13:45:45 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-prometheus-a[55395]: ts=2024-03-30T13:45:45.024Z caller=tls_config.go:195 level=info component=web msg="TLS is disabled." http2=false 2024-03-30T13:45:45.225 INFO:journalctl@ceph.prometheus.a.smithi181.stdout:Mar 30 13:45:45 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-prometheus-a[55395]: ts=2024-03-30T13:45:45.025Z caller=head.go:493 level=info component=tsdb msg="Replaying on-disk memory mappable chunks if any" 2024-03-30T13:45:45.225 INFO:journalctl@ceph.prometheus.a.smithi181.stdout:Mar 30 13:45:45 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-prometheus-a[55395]: ts=2024-03-30T13:45:45.025Z caller=head.go:527 level=info component=tsdb msg="On-disk memory mappable chunks replay completed" duration=2.341µs 2024-03-30T13:45:45.225 INFO:journalctl@ceph.prometheus.a.smithi181.stdout:Mar 30 13:45:45 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-prometheus-a[55395]: ts=2024-03-30T13:45:45.025Z caller=head.go:533 level=info component=tsdb msg="Replaying WAL, this may take a while" 2024-03-30T13:45:45.225 INFO:journalctl@ceph.prometheus.a.smithi181.stdout:Mar 30 13:45:45 smithi181 bash[55377]: fe9273415d72a017487fa57e684aa4d26f83bda6121c833f9e3ebf9816087c5c 2024-03-30T13:45:45.225 INFO:journalctl@ceph.prometheus.a.smithi181.stdout:Mar 30 13:45:45 smithi181 systemd[1]: Started Ceph prometheus.a for 98ebaeb8-ee99-11ee-b647-cb9ed24678a4. 2024-03-30T13:45:45.225 INFO:journalctl@ceph.prometheus.a.smithi181.stdout:Mar 30 13:45:45 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-prometheus-a[55395]: ts=2024-03-30T13:45:45.222Z caller=head.go:604 level=info component=tsdb msg="WAL segment loaded" segment=0 maxSegment=3 2024-03-30T13:45:45.476 INFO:journalctl@ceph.prometheus.a.smithi181.stdout:Mar 30 13:45:45 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-prometheus-a[55395]: ts=2024-03-30T13:45:45.392Z caller=head.go:604 level=info component=tsdb msg="WAL segment loaded" segment=1 maxSegment=3 2024-03-30T13:45:45.756 INFO:journalctl@ceph.prometheus.a.smithi181.stdout:Mar 30 13:45:45 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-prometheus-a[55395]: ts=2024-03-30T13:45:45.475Z caller=head.go:604 level=info component=tsdb msg="WAL segment loaded" segment=2 maxSegment=3 2024-03-30T13:45:45.756 INFO:journalctl@ceph.prometheus.a.smithi181.stdout:Mar 30 13:45:45 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-prometheus-a[55395]: ts=2024-03-30T13:45:45.475Z caller=head.go:604 level=info component=tsdb msg="WAL segment loaded" segment=3 maxSegment=3 2024-03-30T13:45:45.756 INFO:journalctl@ceph.prometheus.a.smithi181.stdout:Mar 30 13:45:45 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-prometheus-a[55395]: ts=2024-03-30T13:45:45.475Z caller=head.go:610 level=info component=tsdb msg="WAL replay completed" checkpoint_replay_duration=50.723µs wal_replay_duration=449.637146ms total_replay_duration=449.710703ms 2024-03-30T13:45:45.756 INFO:journalctl@ceph.prometheus.a.smithi181.stdout:Mar 30 13:45:45 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-prometheus-a[55395]: ts=2024-03-30T13:45:45.479Z caller=main.go:944 level=info fs_type=XFS_SUPER_MAGIC 2024-03-30T13:45:45.756 INFO:journalctl@ceph.prometheus.a.smithi181.stdout:Mar 30 13:45:45 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-prometheus-a[55395]: ts=2024-03-30T13:45:45.479Z caller=main.go:947 level=info msg="TSDB started" 2024-03-30T13:45:45.757 INFO:journalctl@ceph.prometheus.a.smithi181.stdout:Mar 30 13:45:45 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-prometheus-a[55395]: ts=2024-03-30T13:45:45.479Z caller=main.go:1128 level=info msg="Loading configuration file" filename=/etc/prometheus/prometheus.yml 2024-03-30T13:45:45.757 INFO:journalctl@ceph.prometheus.a.smithi181.stdout:Mar 30 13:45:45 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-prometheus-a[55395]: ts=2024-03-30T13:45:45.497Z caller=main.go:1165 level=info msg="Completed loading of configuration file" filename=/etc/prometheus/prometheus.yml totalDuration=17.568786ms db_storage=635ns remote_storage=1.24µs web_handler=452ns query_engine=686ns scrape=398.454µs scrape_sd=96.909µs notify=10.32µs notify_sd=8.459µs rules=16.798606ms 2024-03-30T13:45:45.757 INFO:journalctl@ceph.prometheus.a.smithi181.stdout:Mar 30 13:45:45 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-prometheus-a[55395]: ts=2024-03-30T13:45:45.497Z caller=main.go:896 level=info msg="Server is ready to receive web requests." 2024-03-30T13:45:46.506 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:45:46 smithi181 ceph-mon[25762]: from='mgr.24746 ' entity='mgr.x' 2024-03-30T13:45:46.506 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:45:46 smithi181 ceph-mon[25762]: from='mgr.24746 ' entity='mgr.x' 2024-03-30T13:45:46.506 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:45:46 smithi181 ceph-mon[25762]: Reconfiguring node-exporter.b (dependencies changed)... 2024-03-30T13:45:46.506 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:45:46 smithi181 ceph-mon[25762]: Reconfiguring daemon node-exporter.b on smithi181 2024-03-30T13:45:46.587 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:45:46 smithi099 ceph-mon[29691]: from='mgr.24746 ' entity='mgr.x' 2024-03-30T13:45:46.587 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:45:46 smithi099 ceph-mon[29691]: from='mgr.24746 ' entity='mgr.x' 2024-03-30T13:45:46.587 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:45:46 smithi099 ceph-mon[29691]: Reconfiguring node-exporter.b (dependencies changed)... 2024-03-30T13:45:46.588 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:45:46 smithi099 ceph-mon[29691]: Reconfiguring daemon node-exporter.b on smithi181 2024-03-30T13:45:46.588 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:45:46 smithi099 ceph-mon[24912]: from='mgr.24746 ' entity='mgr.x' 2024-03-30T13:45:46.588 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:45:46 smithi099 ceph-mon[24912]: from='mgr.24746 ' entity='mgr.x' 2024-03-30T13:45:46.588 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:45:46 smithi099 ceph-mon[24912]: Reconfiguring node-exporter.b (dependencies changed)... 2024-03-30T13:45:46.588 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:45:46 smithi099 ceph-mon[24912]: Reconfiguring daemon node-exporter.b on smithi181 2024-03-30T13:45:47.506 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:45:47 smithi181 ceph-mon[25762]: pgmap v31: 161 pgs: 161 active+clean; 585 KiB data, 69 MiB used, 715 GiB / 715 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-03-30T13:45:47.537 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:45:47 smithi099 ceph-mon[24912]: pgmap v31: 161 pgs: 161 active+clean; 585 KiB data, 69 MiB used, 715 GiB / 715 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-03-30T13:45:47.538 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:45:47 smithi099 ceph-mon[29691]: pgmap v31: 161 pgs: 161 active+clean; 585 KiB data, 69 MiB used, 715 GiB / 715 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-03-30T13:45:48.161 INFO:journalctl@ceph.node-exporter.b.smithi181.stdout:Mar 30 13:45:48 smithi181 systemd[1]: Stopping Ceph node-exporter.b for 98ebaeb8-ee99-11ee-b647-cb9ed24678a4... 2024-03-30T13:45:48.161 INFO:journalctl@ceph.node-exporter.b.smithi181.stdout:Mar 30 13:45:48 smithi181 bash[55599]: Error: no container with name or ID "ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-node-exporter.b" found: no such container 2024-03-30T13:45:48.460 INFO:journalctl@ceph.node-exporter.b.smithi181.stdout:Mar 30 13:45:48 smithi181 podman[55612]: 2024-03-30 13:45:48.160460231 +0000 UTC m=+0.128014913 container died 5a3d4484d23a114b9e6a4bb34b1da3c8bed605c9a43d15b7d5148755c54ff44f (image=quay.io/prometheus/node-exporter:v1.3.1, name=ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-node-exporter-b, maintainer=The Prometheus Authors ) 2024-03-30T13:45:48.752 INFO:journalctl@ceph.node-exporter.b.smithi181.stdout:Mar 30 13:45:48 smithi181 podman[55612]: 2024-03-30 13:45:48.53385902 +0000 UTC m=+0.501413701 container cleanup 5a3d4484d23a114b9e6a4bb34b1da3c8bed605c9a43d15b7d5148755c54ff44f (image=quay.io/prometheus/node-exporter:v1.3.1, name=ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-node-exporter-b, maintainer=The Prometheus Authors ) 2024-03-30T13:45:48.752 INFO:journalctl@ceph.node-exporter.b.smithi181.stdout:Mar 30 13:45:48 smithi181 bash[55612]: ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-node-exporter-b 2024-03-30T13:45:48.752 INFO:journalctl@ceph.node-exporter.b.smithi181.stdout:Mar 30 13:45:48 smithi181 bash[55638]: Error: no container with name or ID "ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-node-exporter.b" found: no such container 2024-03-30T13:45:49.006 INFO:journalctl@ceph.node-exporter.b.smithi181.stdout:Mar 30 13:45:48 smithi181 podman[55626]: 2024-03-30 13:45:48.751452135 +0000 UTC m=+0.595230344 container remove 5a3d4484d23a114b9e6a4bb34b1da3c8bed605c9a43d15b7d5148755c54ff44f (image=quay.io/prometheus/node-exporter:v1.3.1, name=ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-node-exporter-b, maintainer=The Prometheus Authors ) 2024-03-30T13:45:49.006 INFO:journalctl@ceph.node-exporter.b.smithi181.stdout:Mar 30 13:45:48 smithi181 systemd[1]: ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4@node-exporter.b.service: Main process exited, code=exited, status=143/n/a 2024-03-30T13:45:49.007 INFO:journalctl@ceph.node-exporter.b.smithi181.stdout:Mar 30 13:45:48 smithi181 systemd[1]: ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4@node-exporter.b.service: Failed with result 'exit-code'. 2024-03-30T13:45:49.007 INFO:journalctl@ceph.node-exporter.b.smithi181.stdout:Mar 30 13:45:48 smithi181 systemd[1]: Stopped Ceph node-exporter.b for 98ebaeb8-ee99-11ee-b647-cb9ed24678a4. 2024-03-30T13:45:49.007 INFO:journalctl@ceph.node-exporter.b.smithi181.stdout:Mar 30 13:45:48 smithi181 systemd[1]: ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4@node-exporter.b.service: Consumed 4.270s CPU time. 2024-03-30T13:45:49.007 INFO:journalctl@ceph.node-exporter.b.smithi181.stdout:Mar 30 13:45:48 smithi181 systemd[1]: Starting Ceph node-exporter.b for 98ebaeb8-ee99-11ee-b647-cb9ed24678a4... 2024-03-30T13:45:49.007 INFO:journalctl@ceph.node-exporter.b.smithi181.stdout:Mar 30 13:45:48 smithi181 podman[55706]: 2024-03-30 13:45:48.881704374 +0000 UTC m=+0.017576835 image pull 1dbe0e931976487e20e5cfb272087e08a9779c88fd5e9617ed7042dd9751ec26 quay.io/prometheus/node-exporter:v1.3.1 2024-03-30T13:45:49.007 INFO:journalctl@ceph.node-exporter.b.smithi181.stdout:Mar 30 13:45:48 smithi181 podman[55706]: 2024-03-30 13:45:48.985637497 +0000 UTC m=+0.121509925 container create 90245951476f44ada0b3ceef289c2b657f2166a0275e2de3fefbb70880ab3a0b (image=quay.io/prometheus/node-exporter:v1.3.1, name=ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-node-exporter-b, maintainer=The Prometheus Authors ) 2024-03-30T13:45:49.506 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:45:49 smithi181 ceph-mon[25762]: from='client.24806 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T13:45:49.506 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:45:49 smithi181 ceph-mon[25762]: pgmap v32: 161 pgs: 161 active+clean; 585 KiB data, 69 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T13:45:49.506 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:45:49 smithi181 ceph-mon[25762]: from='mgr.24746 172.21.15.181:0/2892154077' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T13:45:49.507 INFO:journalctl@ceph.node-exporter.b.smithi181.stdout:Mar 30 13:45:49 smithi181 podman[55706]: 2024-03-30 13:45:49.213510009 +0000 UTC m=+0.349382437 container init 90245951476f44ada0b3ceef289c2b657f2166a0275e2de3fefbb70880ab3a0b (image=quay.io/prometheus/node-exporter:v1.3.1, name=ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-node-exporter-b, maintainer=The Prometheus Authors ) 2024-03-30T13:45:49.507 INFO:journalctl@ceph.node-exporter.b.smithi181.stdout:Mar 30 13:45:49 smithi181 podman[55706]: 2024-03-30 13:45:49.216341282 +0000 UTC m=+0.352213721 container start 90245951476f44ada0b3ceef289c2b657f2166a0275e2de3fefbb70880ab3a0b (image=quay.io/prometheus/node-exporter:v1.3.1, name=ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-node-exporter-b, maintainer=The Prometheus Authors ) 2024-03-30T13:45:49.507 INFO:journalctl@ceph.node-exporter.b.smithi181.stdout:Mar 30 13:45:49 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-node-exporter-b[55720]: ts=2024-03-30T13:45:49.219Z caller=node_exporter.go:182 level=info msg="Starting node_exporter" version="(version=1.3.1, branch=HEAD, revision=a2321e7b940ddcff26873612bccdf7cd4c42b6b6)" 2024-03-30T13:45:49.507 INFO:journalctl@ceph.node-exporter.b.smithi181.stdout:Mar 30 13:45:49 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-node-exporter-b[55720]: ts=2024-03-30T13:45:49.219Z caller=node_exporter.go:183 level=info msg="Build context" build_context="(go=go1.17.3, user=root@243aafa5525c, date=20211205-11:09:49)" 2024-03-30T13:45:49.507 INFO:journalctl@ceph.node-exporter.b.smithi181.stdout:Mar 30 13:45:49 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-node-exporter-b[55720]: ts=2024-03-30T13:45:49.220Z caller=filesystem_common.go:111 level=info collector=filesystem msg="Parsed flag --collector.filesystem.mount-points-exclude" flag=^/(dev|proc|run/credentials/.+|sys|var/lib/docker/.+)($|/) 2024-03-30T13:45:49.507 INFO:journalctl@ceph.node-exporter.b.smithi181.stdout:Mar 30 13:45:49 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-node-exporter-b[55720]: ts=2024-03-30T13:45:49.220Z caller=filesystem_common.go:113 level=info collector=filesystem msg="Parsed flag --collector.filesystem.fs-types-exclude" flag=^(autofs|binfmt_misc|bpf|cgroup2?|configfs|debugfs|devpts|devtmpfs|fusectl|hugetlbfs|iso9660|mqueue|nsfs|overlay|proc|procfs|pstore|rpc_pipefs|securityfs|selinuxfs|squashfs|sysfs|tracefs)$ 2024-03-30T13:45:49.507 INFO:journalctl@ceph.node-exporter.b.smithi181.stdout:Mar 30 13:45:49 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-node-exporter-b[55720]: ts=2024-03-30T13:45:49.220Z caller=node_exporter.go:108 level=info msg="Enabled collectors" 2024-03-30T13:45:49.507 INFO:journalctl@ceph.node-exporter.b.smithi181.stdout:Mar 30 13:45:49 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-node-exporter-b[55720]: ts=2024-03-30T13:45:49.220Z caller=node_exporter.go:115 level=info collector=arp 2024-03-30T13:45:49.507 INFO:journalctl@ceph.node-exporter.b.smithi181.stdout:Mar 30 13:45:49 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-node-exporter-b[55720]: ts=2024-03-30T13:45:49.220Z caller=node_exporter.go:115 level=info collector=bcache 2024-03-30T13:45:49.507 INFO:journalctl@ceph.node-exporter.b.smithi181.stdout:Mar 30 13:45:49 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-node-exporter-b[55720]: ts=2024-03-30T13:45:49.220Z caller=node_exporter.go:115 level=info collector=bonding 2024-03-30T13:45:49.507 INFO:journalctl@ceph.node-exporter.b.smithi181.stdout:Mar 30 13:45:49 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-node-exporter-b[55720]: ts=2024-03-30T13:45:49.220Z caller=node_exporter.go:115 level=info collector=btrfs 2024-03-30T13:45:49.507 INFO:journalctl@ceph.node-exporter.b.smithi181.stdout:Mar 30 13:45:49 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-node-exporter-b[55720]: ts=2024-03-30T13:45:49.220Z caller=node_exporter.go:115 level=info collector=conntrack 2024-03-30T13:45:49.507 INFO:journalctl@ceph.node-exporter.b.smithi181.stdout:Mar 30 13:45:49 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-node-exporter-b[55720]: ts=2024-03-30T13:45:49.220Z caller=node_exporter.go:115 level=info collector=cpu 2024-03-30T13:45:49.508 INFO:journalctl@ceph.node-exporter.b.smithi181.stdout:Mar 30 13:45:49 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-node-exporter-b[55720]: ts=2024-03-30T13:45:49.220Z caller=node_exporter.go:115 level=info collector=cpufreq 2024-03-30T13:45:49.508 INFO:journalctl@ceph.node-exporter.b.smithi181.stdout:Mar 30 13:45:49 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-node-exporter-b[55720]: ts=2024-03-30T13:45:49.220Z caller=node_exporter.go:115 level=info collector=diskstats 2024-03-30T13:45:49.508 INFO:journalctl@ceph.node-exporter.b.smithi181.stdout:Mar 30 13:45:49 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-node-exporter-b[55720]: ts=2024-03-30T13:45:49.220Z caller=node_exporter.go:115 level=info collector=dmi 2024-03-30T13:45:49.508 INFO:journalctl@ceph.node-exporter.b.smithi181.stdout:Mar 30 13:45:49 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-node-exporter-b[55720]: ts=2024-03-30T13:45:49.220Z caller=node_exporter.go:115 level=info collector=edac 2024-03-30T13:45:49.508 INFO:journalctl@ceph.node-exporter.b.smithi181.stdout:Mar 30 13:45:49 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-node-exporter-b[55720]: ts=2024-03-30T13:45:49.220Z caller=node_exporter.go:115 level=info collector=entropy 2024-03-30T13:45:49.508 INFO:journalctl@ceph.node-exporter.b.smithi181.stdout:Mar 30 13:45:49 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-node-exporter-b[55720]: ts=2024-03-30T13:45:49.220Z caller=node_exporter.go:115 level=info collector=fibrechannel 2024-03-30T13:45:49.508 INFO:journalctl@ceph.node-exporter.b.smithi181.stdout:Mar 30 13:45:49 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-node-exporter-b[55720]: ts=2024-03-30T13:45:49.220Z caller=node_exporter.go:115 level=info collector=filefd 2024-03-30T13:45:49.509 INFO:journalctl@ceph.node-exporter.b.smithi181.stdout:Mar 30 13:45:49 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-node-exporter-b[55720]: ts=2024-03-30T13:45:49.220Z caller=node_exporter.go:115 level=info collector=filesystem 2024-03-30T13:45:49.509 INFO:journalctl@ceph.node-exporter.b.smithi181.stdout:Mar 30 13:45:49 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-node-exporter-b[55720]: ts=2024-03-30T13:45:49.220Z caller=node_exporter.go:115 level=info collector=hwmon 2024-03-30T13:45:49.509 INFO:journalctl@ceph.node-exporter.b.smithi181.stdout:Mar 30 13:45:49 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-node-exporter-b[55720]: ts=2024-03-30T13:45:49.220Z caller=node_exporter.go:115 level=info collector=infiniband 2024-03-30T13:45:49.509 INFO:journalctl@ceph.node-exporter.b.smithi181.stdout:Mar 30 13:45:49 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-node-exporter-b[55720]: ts=2024-03-30T13:45:49.220Z caller=node_exporter.go:115 level=info collector=ipvs 2024-03-30T13:45:49.509 INFO:journalctl@ceph.node-exporter.b.smithi181.stdout:Mar 30 13:45:49 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-node-exporter-b[55720]: ts=2024-03-30T13:45:49.220Z caller=node_exporter.go:115 level=info collector=loadavg 2024-03-30T13:45:49.509 INFO:journalctl@ceph.node-exporter.b.smithi181.stdout:Mar 30 13:45:49 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-node-exporter-b[55720]: ts=2024-03-30T13:45:49.220Z caller=node_exporter.go:115 level=info collector=mdadm 2024-03-30T13:45:49.509 INFO:journalctl@ceph.node-exporter.b.smithi181.stdout:Mar 30 13:45:49 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-node-exporter-b[55720]: ts=2024-03-30T13:45:49.220Z caller=node_exporter.go:115 level=info collector=meminfo 2024-03-30T13:45:49.509 INFO:journalctl@ceph.node-exporter.b.smithi181.stdout:Mar 30 13:45:49 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-node-exporter-b[55720]: ts=2024-03-30T13:45:49.220Z caller=node_exporter.go:115 level=info collector=netclass 2024-03-30T13:45:49.509 INFO:journalctl@ceph.node-exporter.b.smithi181.stdout:Mar 30 13:45:49 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-node-exporter-b[55720]: ts=2024-03-30T13:45:49.220Z caller=node_exporter.go:115 level=info collector=netdev 2024-03-30T13:45:49.509 INFO:journalctl@ceph.node-exporter.b.smithi181.stdout:Mar 30 13:45:49 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-node-exporter-b[55720]: ts=2024-03-30T13:45:49.220Z caller=node_exporter.go:115 level=info collector=netstat 2024-03-30T13:45:49.509 INFO:journalctl@ceph.node-exporter.b.smithi181.stdout:Mar 30 13:45:49 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-node-exporter-b[55720]: ts=2024-03-30T13:45:49.220Z caller=node_exporter.go:115 level=info collector=nfs 2024-03-30T13:45:49.509 INFO:journalctl@ceph.node-exporter.b.smithi181.stdout:Mar 30 13:45:49 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-node-exporter-b[55720]: ts=2024-03-30T13:45:49.220Z caller=node_exporter.go:115 level=info collector=nfsd 2024-03-30T13:45:49.509 INFO:journalctl@ceph.node-exporter.b.smithi181.stdout:Mar 30 13:45:49 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-node-exporter-b[55720]: ts=2024-03-30T13:45:49.220Z caller=node_exporter.go:115 level=info collector=nvme 2024-03-30T13:45:49.509 INFO:journalctl@ceph.node-exporter.b.smithi181.stdout:Mar 30 13:45:49 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-node-exporter-b[55720]: ts=2024-03-30T13:45:49.220Z caller=node_exporter.go:115 level=info collector=os 2024-03-30T13:45:49.510 INFO:journalctl@ceph.node-exporter.b.smithi181.stdout:Mar 30 13:45:49 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-node-exporter-b[55720]: ts=2024-03-30T13:45:49.220Z caller=node_exporter.go:115 level=info collector=powersupplyclass 2024-03-30T13:45:49.510 INFO:journalctl@ceph.node-exporter.b.smithi181.stdout:Mar 30 13:45:49 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-node-exporter-b[55720]: ts=2024-03-30T13:45:49.220Z caller=node_exporter.go:115 level=info collector=pressure 2024-03-30T13:45:49.510 INFO:journalctl@ceph.node-exporter.b.smithi181.stdout:Mar 30 13:45:49 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-node-exporter-b[55720]: ts=2024-03-30T13:45:49.220Z caller=node_exporter.go:115 level=info collector=rapl 2024-03-30T13:45:49.510 INFO:journalctl@ceph.node-exporter.b.smithi181.stdout:Mar 30 13:45:49 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-node-exporter-b[55720]: ts=2024-03-30T13:45:49.220Z caller=node_exporter.go:115 level=info collector=schedstat 2024-03-30T13:45:49.510 INFO:journalctl@ceph.node-exporter.b.smithi181.stdout:Mar 30 13:45:49 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-node-exporter-b[55720]: ts=2024-03-30T13:45:49.220Z caller=node_exporter.go:115 level=info collector=sockstat 2024-03-30T13:45:49.510 INFO:journalctl@ceph.node-exporter.b.smithi181.stdout:Mar 30 13:45:49 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-node-exporter-b[55720]: ts=2024-03-30T13:45:49.220Z caller=node_exporter.go:115 level=info collector=softnet 2024-03-30T13:45:49.510 INFO:journalctl@ceph.node-exporter.b.smithi181.stdout:Mar 30 13:45:49 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-node-exporter-b[55720]: ts=2024-03-30T13:45:49.220Z caller=node_exporter.go:115 level=info collector=stat 2024-03-30T13:45:49.510 INFO:journalctl@ceph.node-exporter.b.smithi181.stdout:Mar 30 13:45:49 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-node-exporter-b[55720]: ts=2024-03-30T13:45:49.220Z caller=node_exporter.go:115 level=info collector=tapestats 2024-03-30T13:45:49.510 INFO:journalctl@ceph.node-exporter.b.smithi181.stdout:Mar 30 13:45:49 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-node-exporter-b[55720]: ts=2024-03-30T13:45:49.220Z caller=node_exporter.go:115 level=info collector=textfile 2024-03-30T13:45:49.510 INFO:journalctl@ceph.node-exporter.b.smithi181.stdout:Mar 30 13:45:49 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-node-exporter-b[55720]: ts=2024-03-30T13:45:49.220Z caller=node_exporter.go:115 level=info collector=thermal_zone 2024-03-30T13:45:49.510 INFO:journalctl@ceph.node-exporter.b.smithi181.stdout:Mar 30 13:45:49 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-node-exporter-b[55720]: ts=2024-03-30T13:45:49.220Z caller=node_exporter.go:115 level=info collector=time 2024-03-30T13:45:49.510 INFO:journalctl@ceph.node-exporter.b.smithi181.stdout:Mar 30 13:45:49 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-node-exporter-b[55720]: ts=2024-03-30T13:45:49.220Z caller=node_exporter.go:115 level=info collector=udp_queues 2024-03-30T13:45:49.510 INFO:journalctl@ceph.node-exporter.b.smithi181.stdout:Mar 30 13:45:49 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-node-exporter-b[55720]: ts=2024-03-30T13:45:49.220Z caller=node_exporter.go:115 level=info collector=uname 2024-03-30T13:45:49.510 INFO:journalctl@ceph.node-exporter.b.smithi181.stdout:Mar 30 13:45:49 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-node-exporter-b[55720]: ts=2024-03-30T13:45:49.221Z caller=node_exporter.go:115 level=info collector=vmstat 2024-03-30T13:45:49.511 INFO:journalctl@ceph.node-exporter.b.smithi181.stdout:Mar 30 13:45:49 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-node-exporter-b[55720]: ts=2024-03-30T13:45:49.221Z caller=node_exporter.go:115 level=info collector=xfs 2024-03-30T13:45:49.511 INFO:journalctl@ceph.node-exporter.b.smithi181.stdout:Mar 30 13:45:49 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-node-exporter-b[55720]: ts=2024-03-30T13:45:49.221Z caller=node_exporter.go:115 level=info collector=zfs 2024-03-30T13:45:49.511 INFO:journalctl@ceph.node-exporter.b.smithi181.stdout:Mar 30 13:45:49 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-node-exporter-b[55720]: ts=2024-03-30T13:45:49.221Z caller=node_exporter.go:199 level=info msg="Listening on" address=:9100 2024-03-30T13:45:49.511 INFO:journalctl@ceph.node-exporter.b.smithi181.stdout:Mar 30 13:45:49 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-node-exporter-b[55720]: ts=2024-03-30T13:45:49.221Z caller=tls_config.go:195 level=info msg="TLS is disabled." http2=false 2024-03-30T13:45:49.511 INFO:journalctl@ceph.node-exporter.b.smithi181.stdout:Mar 30 13:45:49 smithi181 bash[55706]: 90245951476f44ada0b3ceef289c2b657f2166a0275e2de3fefbb70880ab3a0b 2024-03-30T13:45:49.511 INFO:journalctl@ceph.node-exporter.b.smithi181.stdout:Mar 30 13:45:49 smithi181 systemd[1]: Started Ceph node-exporter.b for 98ebaeb8-ee99-11ee-b647-cb9ed24678a4. 2024-03-30T13:45:49.587 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:45:49 smithi099 ceph-mon[24912]: from='client.24806 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T13:45:49.587 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:45:49 smithi099 ceph-mon[24912]: pgmap v32: 161 pgs: 161 active+clean; 585 KiB data, 69 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T13:45:49.587 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:45:49 smithi099 ceph-mon[24912]: from='mgr.24746 172.21.15.181:0/2892154077' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T13:45:49.588 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:45:49 smithi099 ceph-mon[29691]: from='client.24806 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T13:45:49.588 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:45:49 smithi099 ceph-mon[29691]: pgmap v32: 161 pgs: 161 active+clean; 585 KiB data, 69 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T13:45:49.588 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:45:49 smithi099 ceph-mon[29691]: from='mgr.24746 172.21.15.181:0/2892154077' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T13:45:50.587 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:45:50 smithi099 ceph-mon[24912]: from='mgr.24746 ' entity='mgr.x' 2024-03-30T13:45:50.587 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:45:50 smithi099 ceph-mon[24912]: from='mgr.24746 ' entity='mgr.x' 2024-03-30T13:45:50.587 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:45:50 smithi099 ceph-mon[24912]: Reconfiguring grafana.a (dependencies changed)... 2024-03-30T13:45:50.587 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:45:50 smithi099 ceph-mon[24912]: Regenerating cephadm self-signed grafana TLS certificates 2024-03-30T13:45:50.587 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:45:50 smithi099 ceph-mon[24912]: from='mgr.24746 ' entity='mgr.x' 2024-03-30T13:45:50.587 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:45:50 smithi099 ceph-mon[24912]: from='mgr.24746 ' entity='mgr.x' 2024-03-30T13:45:50.587 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:45:50 smithi099 ceph-mon[24912]: from='mgr.24746 172.21.15.181:0/2892154077' entity='mgr.x' cmd=[{"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"}]: dispatch 2024-03-30T13:45:50.588 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:45:50 smithi099 ceph-mon[29691]: from='mgr.24746 ' entity='mgr.x' 2024-03-30T13:45:50.588 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:45:50 smithi099 ceph-mon[29691]: from='mgr.24746 ' entity='mgr.x' 2024-03-30T13:45:50.588 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:45:50 smithi099 ceph-mon[29691]: Reconfiguring grafana.a (dependencies changed)... 2024-03-30T13:45:50.588 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:45:50 smithi099 ceph-mon[29691]: Regenerating cephadm self-signed grafana TLS certificates 2024-03-30T13:45:50.588 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:45:50 smithi099 ceph-mon[29691]: from='mgr.24746 ' entity='mgr.x' 2024-03-30T13:45:50.588 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:45:50 smithi099 ceph-mon[29691]: from='mgr.24746 ' entity='mgr.x' 2024-03-30T13:45:50.588 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:45:50 smithi099 ceph-mon[29691]: from='mgr.24746 172.21.15.181:0/2892154077' entity='mgr.x' cmd=[{"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"}]: dispatch 2024-03-30T13:45:50.756 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:45:50 smithi181 ceph-mon[25762]: from='mgr.24746 ' entity='mgr.x' 2024-03-30T13:45:50.756 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:45:50 smithi181 ceph-mon[25762]: from='mgr.24746 ' entity='mgr.x' 2024-03-30T13:45:50.756 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:45:50 smithi181 ceph-mon[25762]: Reconfiguring grafana.a (dependencies changed)... 2024-03-30T13:45:50.756 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:45:50 smithi181 ceph-mon[25762]: Regenerating cephadm self-signed grafana TLS certificates 2024-03-30T13:45:50.756 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:45:50 smithi181 ceph-mon[25762]: from='mgr.24746 ' entity='mgr.x' 2024-03-30T13:45:50.757 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:45:50 smithi181 ceph-mon[25762]: from='mgr.24746 ' entity='mgr.x' 2024-03-30T13:45:50.757 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:45:50 smithi181 ceph-mon[25762]: from='mgr.24746 172.21.15.181:0/2892154077' entity='mgr.x' cmd=[{"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"}]: dispatch 2024-03-30T13:45:51.587 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:45:51 smithi099 ceph-mon[24912]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"}]: dispatch 2024-03-30T13:45:51.587 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:45:51 smithi099 ceph-mon[24912]: Reconfiguring daemon grafana.a on smithi181 2024-03-30T13:45:51.587 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:45:51 smithi099 ceph-mon[24912]: pgmap v33: 161 pgs: 161 active+clean; 585 KiB data, 69 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T13:45:51.587 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:45:51 smithi099 ceph-mon[29691]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"}]: dispatch 2024-03-30T13:45:51.587 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:45:51 smithi099 ceph-mon[29691]: Reconfiguring daemon grafana.a on smithi181 2024-03-30T13:45:51.587 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:45:51 smithi099 ceph-mon[29691]: pgmap v33: 161 pgs: 161 active+clean; 585 KiB data, 69 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T13:45:51.756 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:45:51 smithi181 ceph-mon[25762]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"}]: dispatch 2024-03-30T13:45:51.756 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:45:51 smithi181 ceph-mon[25762]: Reconfiguring daemon grafana.a on smithi181 2024-03-30T13:45:51.756 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:45:51 smithi181 ceph-mon[25762]: pgmap v33: 161 pgs: 161 active+clean; 585 KiB data, 69 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T13:45:53.587 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:45:53 smithi099 ceph-mon[24912]: pgmap v34: 161 pgs: 161 active+clean; 585 KiB data, 69 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T13:45:53.587 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:45:53 smithi099 ceph-mon[29691]: pgmap v34: 161 pgs: 161 active+clean; 585 KiB data, 69 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T13:45:53.627 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:45:53 smithi181 ceph-mon[25762]: pgmap v34: 161 pgs: 161 active+clean; 585 KiB data, 69 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T13:45:55.006 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:45:54 smithi181 ceph-mon[25762]: pgmap v35: 161 pgs: 161 active+clean; 585 KiB data, 69 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T13:45:55.087 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:45:54 smithi099 ceph-mon[24912]: pgmap v35: 161 pgs: 161 active+clean; 585 KiB data, 69 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T13:45:55.087 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:45:54 smithi099 ceph-mon[29691]: pgmap v35: 161 pgs: 161 active+clean; 585 KiB data, 69 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T13:45:57.258 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:45:57 smithi181 ceph-mon[25762]: pgmap v36: 161 pgs: 161 active+clean; 585 KiB data, 69 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T13:45:57.337 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:45:57 smithi099 ceph-mon[24912]: pgmap v36: 161 pgs: 161 active+clean; 585 KiB data, 69 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T13:45:57.337 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:45:57 smithi099 ceph-mon[29691]: pgmap v36: 161 pgs: 161 active+clean; 585 KiB data, 69 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T13:45:57.686 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 13:45:57 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-x[50211]: ::ffff:172.21.15.181 - - [30/Mar/2024:13:45:57] "GET /metrics HTTP/1.1" 200 37965 "" "Prometheus/2.33.4" 2024-03-30T13:45:58.896 INFO:journalctl@ceph.prometheus.a.smithi181.stdout:Mar 30 13:45:58 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-prometheus-a[55395]: ts=2024-03-30T13:45:58.660Z caller=manager.go:609 level=warn component="rule manager" group=osd msg="Evaluating rule failed" rule="alert: CephOSDFlapping\nexpr: (rate(ceph_osd_up[5m]) * on(ceph_daemon) group_left(hostname) ceph_osd_metadata)\n * 60 > 1\nlabels:\n oid: 1.3.6.1.4.1.50495.1.2.1.4.4\n severity: warning\n type: ceph_default\nannotations:\n description: OSD {{ $labels.ceph_daemon }} on {{ $labels.hostname }} was marked\n down and back up {{ $value | humanize }} times once a minute for 5 minutes. This\n may indicate a network issue (latency, packet loss, MTU mismatch) on the cluster\n network, or the public network if no cluster network is deployed. Check the network\n stats on the listed host(s).\n documentation: https://docs.ceph.com/en/latest/rados/troubleshooting/troubleshooting-osd#flapping-osds\n summary: Network issues are causing OSDs to flap (mark each other down)\n" err="found duplicate series for the match group {ceph_daemon=\"osd.0\"} on the right hand-side of the operation: [{__name__=\"ceph_osd_metadata\", ceph_daemon=\"osd.0\", ceph_version=\"ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)\", cluster_addr=\"172.21.15.99\", device_class=\"ssd\", hostname=\"smithi099\", instance=\"smithi181:9283\", job=\"ceph\", objectstore=\"bluestore\", public_addr=\"172.21.15.99\"}, {__name__=\"ceph_osd_metadata\", ceph_daemon=\"osd.0\", ceph_version=\"ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)\", cluster_addr=\"172.21.15.99\", device_class=\"ssd\", hostname=\"smithi099\", instance=\"172.21.15.181:9283\", job=\"ceph\", objectstore=\"bluestore\", public_addr=\"172.21.15.99\"}];many-to-many matching not allowed: matching labels must be unique on one side" 2024-03-30T13:45:59.219 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:45:59 smithi181 ceph-mon[25762]: from='client.24806 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T13:45:59.219 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:45:59 smithi181 ceph-mon[25762]: pgmap v37: 161 pgs: 161 active+clean; 585 KiB data, 69 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T13:45:59.337 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:45:59 smithi099 ceph-mon[24912]: from='client.24806 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T13:45:59.337 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:45:59 smithi099 ceph-mon[24912]: pgmap v37: 161 pgs: 161 active+clean; 585 KiB data, 69 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T13:45:59.337 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:45:59 smithi099 ceph-mon[29691]: from='client.24806 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T13:45:59.337 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:45:59 smithi099 ceph-mon[29691]: pgmap v37: 161 pgs: 161 active+clean; 585 KiB data, 69 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T13:46:00.989 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 13:46:00 smithi181 systemd[1]: Stopping Ceph grafana.a for 98ebaeb8-ee99-11ee-b647-cb9ed24678a4... 2024-03-30T13:46:00.990 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 13:46:00 smithi181 bash[56346]: Error: no container with name or ID "ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana.a" found: no such container 2024-03-30T13:46:01.256 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:46:01 smithi181 ceph-mon[25762]: pgmap v38: 161 pgs: 161 active+clean; 585 KiB data, 69 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T13:46:01.256 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 13:46:00 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a[44815]: t=2024-03-30T13:46:00+0000 lvl=info msg="Shutdown started" logger=server reason="System signal: terminated" 2024-03-30T13:46:01.257 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 13:46:00 smithi181 podman[56374]: 2024-03-30 13:46:00.998446276 +0000 UTC m=+0.400601801 container died 084559d0032875674dc1160d184b442de5ccc83e0cf6edf5296b78d9007e071c (image=quay.io/ceph/ceph-grafana:8.3.5, name=ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a, com.redhat.build-host=cpt-1002.osbs.prod.upshift.rdu2.redhat.com, description=Ceph Grafana Container, maintainer=Paul Cuzner , io.openshift.expose-services=, summary=Grafana Container configured for Ceph mgr/dashboard integration, vcs-ref=3aadd00326f3dd6cfe65ee31017ab98915fddb56, distribution-scope=public, release=236.1648460182, vcs-type=git, vendor=Red Hat, Inc., com.redhat.component=ubi8-container, com.redhat.license_terms=https://www.redhat.com/en/about/red-hat-end-user-license-agreements#UBI, io.k8s.display-name=Red Hat Universal Base Image 8, io.buildah.version=1.24.2, url=https://access.redhat.com/containers/#/registry.access.redhat.com/ubi8/images/8.5-236.1648460182, name=ubi8, version=8.5, build-date=2022-03-28T10:36:18.413762, io.k8s.description=The Universal Base Image is designed and engineered to be the base layer for all of your containerized applications, middleware and utilities. This base image is freely redistributable, but Red Hat only supports Red Hat technologies through subscriptions for Red Hat products. This image is maintained by Red Hat and updated regularly., io.openshift.tags=base rhel8, architecture=x86_64) 2024-03-30T13:46:01.337 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:46:01 smithi099 ceph-mon[24912]: pgmap v38: 161 pgs: 161 active+clean; 585 KiB data, 69 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T13:46:01.337 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:46:01 smithi099 ceph-mon[29691]: pgmap v38: 161 pgs: 161 active+clean; 585 KiB data, 69 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T13:46:01.648 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 13:46:01 smithi181 podman[56374]: 2024-03-30 13:46:01.388040654 +0000 UTC m=+0.790196179 container cleanup 084559d0032875674dc1160d184b442de5ccc83e0cf6edf5296b78d9007e071c (image=quay.io/ceph/ceph-grafana:8.3.5, name=ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a, vcs-ref=3aadd00326f3dd6cfe65ee31017ab98915fddb56, build-date=2022-03-28T10:36:18.413762, io.buildah.version=1.24.2, name=ubi8, release=236.1648460182, com.redhat.build-host=cpt-1002.osbs.prod.upshift.rdu2.redhat.com, description=Ceph Grafana Container, io.k8s.description=The Universal Base Image is designed and engineered to be the base layer for all of your containerized applications, middleware and utilities. This base image is freely redistributable, but Red Hat only supports Red Hat technologies through subscriptions for Red Hat products. This image is maintained by Red Hat and updated regularly., vcs-type=git, vendor=Red Hat, Inc., com.redhat.component=ubi8-container, distribution-scope=public, url=https://access.redhat.com/containers/#/registry.access.redhat.com/ubi8/images/8.5-236.1648460182, architecture=x86_64, com.redhat.license_terms=https://www.redhat.com/en/about/red-hat-end-user-license-agreements#UBI, summary=Grafana Container configured for Ceph mgr/dashboard integration, io.k8s.display-name=Red Hat Universal Base Image 8, io.openshift.tags=base rhel8, version=8.5, io.openshift.expose-services=, maintainer=Paul Cuzner ) 2024-03-30T13:46:01.649 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 13:46:01 smithi181 bash[56374]: ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a 2024-03-30T13:46:01.649 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 13:46:01 smithi181 bash[56422]: Error: no container with name or ID "ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana.a" found: no such container 2024-03-30T13:46:01.966 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 13:46:01 smithi181 podman[56408]: 2024-03-30 13:46:01.647666371 +0000 UTC m=+0.649595453 container remove 084559d0032875674dc1160d184b442de5ccc83e0cf6edf5296b78d9007e071c (image=quay.io/ceph/ceph-grafana:8.3.5, name=ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a, architecture=x86_64, name=ubi8, release=236.1648460182, vendor=Red Hat, Inc., com.redhat.component=ubi8-container, maintainer=Paul Cuzner , version=8.5, io.buildah.version=1.24.2, vcs-ref=3aadd00326f3dd6cfe65ee31017ab98915fddb56, description=Ceph Grafana Container, io.k8s.description=The Universal Base Image is designed and engineered to be the base layer for all of your containerized applications, middleware and utilities. This base image is freely redistributable, but Red Hat only supports Red Hat technologies through subscriptions for Red Hat products. This image is maintained by Red Hat and updated regularly., summary=Grafana Container configured for Ceph mgr/dashboard integration, distribution-scope=public, io.k8s.display-name=Red Hat Universal Base Image 8, com.redhat.license_terms=https://www.redhat.com/en/about/red-hat-end-user-license-agreements#UBI, build-date=2022-03-28T10:36:18.413762, io.openshift.expose-services=, url=https://access.redhat.com/containers/#/registry.access.redhat.com/ubi8/images/8.5-236.1648460182, com.redhat.build-host=cpt-1002.osbs.prod.upshift.rdu2.redhat.com, io.openshift.tags=base rhel8, vcs-type=git) 2024-03-30T13:46:01.966 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 13:46:01 smithi181 systemd[1]: ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4@grafana.a.service: Deactivated successfully. 2024-03-30T13:46:01.966 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 13:46:01 smithi181 systemd[1]: Stopped Ceph grafana.a for 98ebaeb8-ee99-11ee-b647-cb9ed24678a4. 2024-03-30T13:46:01.967 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 13:46:01 smithi181 systemd[1]: ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4@grafana.a.service: Consumed 3.259s CPU time. 2024-03-30T13:46:01.967 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 13:46:01 smithi181 systemd[1]: Starting Ceph grafana.a for 98ebaeb8-ee99-11ee-b647-cb9ed24678a4... 2024-03-30T13:46:02.881 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 13:46:02 smithi181 podman[56574]: 2024-03-30 13:46:02.427493742 +0000 UTC m=+0.018847179 image pull dad864ee21e98e69f4029d1e417aa085001566be0d322fbc75bc6f29b0050c01 quay.io/ceph/ceph-grafana:8.3.5 2024-03-30T13:46:02.882 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 13:46:02 smithi181 podman[56574]: 2024-03-30 13:46:02.52803499 +0000 UTC m=+0.119388473 container create 19828adb768b4f8db838909f57543ac8e88616b04c5cb31697c89f0e9a575b71 (image=quay.io/ceph/ceph-grafana:8.3.5, name=ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a, io.buildah.version=1.24.2, vcs-ref=3aadd00326f3dd6cfe65ee31017ab98915fddb56, release=236.1648460182, com.redhat.component=ubi8-container, distribution-scope=public, com.redhat.license_terms=https://www.redhat.com/en/about/red-hat-end-user-license-agreements#UBI, description=Ceph Grafana Container, url=https://access.redhat.com/containers/#/registry.access.redhat.com/ubi8/images/8.5-236.1648460182, architecture=x86_64, vcs-type=git, vendor=Red Hat, Inc., com.redhat.build-host=cpt-1002.osbs.prod.upshift.rdu2.redhat.com, version=8.5, summary=Grafana Container configured for Ceph mgr/dashboard integration, io.k8s.display-name=Red Hat Universal Base Image 8, io.openshift.expose-services=, io.openshift.tags=base rhel8, io.k8s.description=The Universal Base Image is designed and engineered to be the base layer for all of your containerized applications, middleware and utilities. This base image is freely redistributable, but Red Hat only supports Red Hat technologies through subscriptions for Red Hat products. This image is maintained by Red Hat and updated regularly., name=ubi8, build-date=2022-03-28T10:36:18.413762, maintainer=Paul Cuzner ) 2024-03-30T13:46:03.158 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:46:03 smithi181 ceph-mon[25762]: pgmap v39: 161 pgs: 161 active+clean; 585 KiB data, 69 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T13:46:03.159 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 13:46:02 smithi181 podman[56574]: 2024-03-30 13:46:02.982652119 +0000 UTC m=+0.574005556 container init 19828adb768b4f8db838909f57543ac8e88616b04c5cb31697c89f0e9a575b71 (image=quay.io/ceph/ceph-grafana:8.3.5, name=ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a, io.openshift.expose-services=, vendor=Red Hat, Inc., url=https://access.redhat.com/containers/#/registry.access.redhat.com/ubi8/images/8.5-236.1648460182, architecture=x86_64, summary=Grafana Container configured for Ceph mgr/dashboard integration, version=8.5, io.k8s.description=The Universal Base Image is designed and engineered to be the base layer for all of your containerized applications, middleware and utilities. This base image is freely redistributable, but Red Hat only supports Red Hat technologies through subscriptions for Red Hat products. This image is maintained by Red Hat and updated regularly., description=Ceph Grafana Container, build-date=2022-03-28T10:36:18.413762, io.buildah.version=1.24.2, vcs-ref=3aadd00326f3dd6cfe65ee31017ab98915fddb56, com.redhat.build-host=cpt-1002.osbs.prod.upshift.rdu2.redhat.com, com.redhat.license_terms=https://www.redhat.com/en/about/red-hat-end-user-license-agreements#UBI, release=236.1648460182, distribution-scope=public, com.redhat.component=ubi8-container, io.k8s.display-name=Red Hat Universal Base Image 8, vcs-type=git, io.openshift.tags=base rhel8, maintainer=Paul Cuzner , name=ubi8) 2024-03-30T13:46:03.159 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 13:46:02 smithi181 podman[56574]: 2024-03-30 13:46:02.985520611 +0000 UTC m=+0.576874057 container start 19828adb768b4f8db838909f57543ac8e88616b04c5cb31697c89f0e9a575b71 (image=quay.io/ceph/ceph-grafana:8.3.5, name=ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a, summary=Grafana Container configured for Ceph mgr/dashboard integration, io.k8s.display-name=Red Hat Universal Base Image 8, vendor=Red Hat, Inc., io.buildah.version=1.24.2, com.redhat.build-host=cpt-1002.osbs.prod.upshift.rdu2.redhat.com, maintainer=Paul Cuzner , name=ubi8, version=8.5, io.k8s.description=The Universal Base Image is designed and engineered to be the base layer for all of your containerized applications, middleware and utilities. This base image is freely redistributable, but Red Hat only supports Red Hat technologies through subscriptions for Red Hat products. This image is maintained by Red Hat and updated regularly., build-date=2022-03-28T10:36:18.413762, architecture=x86_64, com.redhat.license_terms=https://www.redhat.com/en/about/red-hat-end-user-license-agreements#UBI, vcs-type=git, url=https://access.redhat.com/containers/#/registry.access.redhat.com/ubi8/images/8.5-236.1648460182, release=236.1648460182, distribution-scope=public, com.redhat.component=ubi8-container, io.openshift.expose-services=, description=Ceph Grafana Container, io.openshift.tags=base rhel8, vcs-ref=3aadd00326f3dd6cfe65ee31017ab98915fddb56) 2024-03-30T13:46:03.159 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 13:46:03 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a[56606]: Failed to start grafana. error: failed to create log directory "/usr/share/grafana/data/log": mkdir /usr/share/grafana/data: permission denied 2024-03-30T13:46:03.159 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 13:46:03 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a[56606]: failed to create log directory "/usr/share/grafana/data/log": mkdir /usr/share/grafana/data: permission denied 2024-03-30T13:46:03.159 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 13:46:03 smithi181 bash[56574]: 19828adb768b4f8db838909f57543ac8e88616b04c5cb31697c89f0e9a575b71 2024-03-30T13:46:03.418 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 13:46:03 smithi181 systemd[1]: Started Ceph grafana.a for 98ebaeb8-ee99-11ee-b647-cb9ed24678a4. 2024-03-30T13:46:03.419 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 13:46:03 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-x[50211]: [30/Mar/2024:13:46:03] ENGINE Bus STOPPING 2024-03-30T13:46:03.419 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 13:46:03 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-x[50211]: [30/Mar/2024:13:46:03] ENGINE HTTP Server cherrypy._cpwsgi_server.CPWSGIServer(('::', 9283)) shut down 2024-03-30T13:46:03.419 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 13:46:03 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-x[50211]: [30/Mar/2024:13:46:03] ENGINE Bus STOPPED 2024-03-30T13:46:03.419 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 13:46:03 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-x[50211]: [30/Mar/2024:13:46:03] ENGINE Bus STARTING 2024-03-30T13:46:03.419 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 13:46:03 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-x[50211]: [30/Mar/2024:13:46:03] ENGINE Serving on http://:::9283 2024-03-30T13:46:03.419 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 13:46:03 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-x[50211]: [30/Mar/2024:13:46:03] ENGINE Bus STARTED 2024-03-30T13:46:03.419 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 13:46:03 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-x[50211]: [30/Mar/2024:13:46:03] ENGINE Bus STOPPING 2024-03-30T13:46:03.419 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 13:46:03 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-x[50211]: [30/Mar/2024:13:46:03] ENGINE HTTP Server cherrypy._cpwsgi_server.CPWSGIServer(('::', 9283)) shut down 2024-03-30T13:46:03.420 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 13:46:03 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-x[50211]: [30/Mar/2024:13:46:03] ENGINE Bus STOPPED 2024-03-30T13:46:03.420 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 13:46:03 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-x[50211]: [30/Mar/2024:13:46:03] ENGINE Bus STARTING 2024-03-30T13:46:03.587 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:46:03 smithi099 ceph-mon[24912]: pgmap v39: 161 pgs: 161 active+clean; 585 KiB data, 69 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T13:46:03.587 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:46:03 smithi099 ceph-mon[29691]: pgmap v39: 161 pgs: 161 active+clean; 585 KiB data, 69 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T13:46:03.756 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 13:46:03 smithi181 podman[56642]: 2024-03-30 13:46:03.495963048 +0000 UTC m=+0.477372777 container died 19828adb768b4f8db838909f57543ac8e88616b04c5cb31697c89f0e9a575b71 (image=quay.io/ceph/ceph-grafana:8.3.5, name=ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a, vcs-type=git, build-date=2022-03-28T10:36:18.413762, release=236.1648460182, name=ubi8, io.openshift.tags=base rhel8, com.redhat.component=ubi8-container, distribution-scope=public, io.buildah.version=1.24.2, version=8.5, architecture=x86_64, maintainer=Paul Cuzner , description=Ceph Grafana Container, com.redhat.build-host=cpt-1002.osbs.prod.upshift.rdu2.redhat.com, io.k8s.description=The Universal Base Image is designed and engineered to be the base layer for all of your containerized applications, middleware and utilities. This base image is freely redistributable, but Red Hat only supports Red Hat technologies through subscriptions for Red Hat products. This image is maintained by Red Hat and updated regularly., io.openshift.expose-services=, io.k8s.display-name=Red Hat Universal Base Image 8, summary=Grafana Container configured for Ceph mgr/dashboard integration, vcs-ref=3aadd00326f3dd6cfe65ee31017ab98915fddb56, vendor=Red Hat, Inc., com.redhat.license_terms=https://www.redhat.com/en/about/red-hat-end-user-license-agreements#UBI, url=https://access.redhat.com/containers/#/registry.access.redhat.com/ubi8/images/8.5-236.1648460182) 2024-03-30T13:46:03.757 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 13:46:03 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-x[50211]: [30/Mar/2024:13:46:03] ENGINE Serving on http://:::9283 2024-03-30T13:46:03.757 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 13:46:03 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-x[50211]: [30/Mar/2024:13:46:03] ENGINE Bus STARTED 2024-03-30T13:46:03.757 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 13:46:03 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-x[50211]: [30/Mar/2024:13:46:03] ENGINE Bus STOPPING 2024-03-30T13:46:03.757 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 13:46:03 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-x[50211]: [30/Mar/2024:13:46:03] ENGINE HTTP Server cherrypy._cpwsgi_server.CPWSGIServer(('::', 9283)) shut down 2024-03-30T13:46:03.757 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 13:46:03 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-x[50211]: [30/Mar/2024:13:46:03] ENGINE Bus STOPPED 2024-03-30T13:46:03.757 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 13:46:03 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-x[50211]: [30/Mar/2024:13:46:03] ENGINE Bus STARTING 2024-03-30T13:46:03.757 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 13:46:03 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-x[50211]: [30/Mar/2024:13:46:03] ENGINE Serving on http://:::9283 2024-03-30T13:46:03.757 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 13:46:03 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-x[50211]: [30/Mar/2024:13:46:03] ENGINE Bus STARTED 2024-03-30T13:46:04.376 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 13:46:04 smithi181 podman[56642]: 2024-03-30 13:46:04.081359795 +0000 UTC m=+1.062769512 container remove 19828adb768b4f8db838909f57543ac8e88616b04c5cb31697c89f0e9a575b71 (image=quay.io/ceph/ceph-grafana:8.3.5, name=ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a, release=236.1648460182, io.k8s.display-name=Red Hat Universal Base Image 8, io.openshift.tags=base rhel8, vcs-type=git, version=8.5, com.redhat.component=ubi8-container, io.openshift.expose-services=, distribution-scope=public, io.buildah.version=1.24.2, name=ubi8, description=Ceph Grafana Container, vendor=Red Hat, Inc., build-date=2022-03-28T10:36:18.413762, com.redhat.license_terms=https://www.redhat.com/en/about/red-hat-end-user-license-agreements#UBI, io.k8s.description=The Universal Base Image is designed and engineered to be the base layer for all of your containerized applications, middleware and utilities. This base image is freely redistributable, but Red Hat only supports Red Hat technologies through subscriptions for Red Hat products. This image is maintained by Red Hat and updated regularly., maintainer=Paul Cuzner , com.redhat.build-host=cpt-1002.osbs.prod.upshift.rdu2.redhat.com, vcs-ref=3aadd00326f3dd6cfe65ee31017ab98915fddb56, architecture=x86_64, summary=Grafana Container configured for Ceph mgr/dashboard integration, url=https://access.redhat.com/containers/#/registry.access.redhat.com/ubi8/images/8.5-236.1648460182) 2024-03-30T13:46:04.376 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 13:46:04 smithi181 systemd[1]: ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4@grafana.a.service: Main process exited, code=exited, status=1/FAILURE 2024-03-30T13:46:04.376 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 13:46:04 smithi181 systemd[1]: ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4@grafana.a.service: Failed with result 'exit-code'. 2024-03-30T13:46:04.377 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:46:04 smithi181 ceph-mon[25762]: from='mgr.24746 ' entity='mgr.x' 2024-03-30T13:46:04.377 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:46:04 smithi181 ceph-mon[25762]: from='mgr.24746 ' entity='mgr.x' 2024-03-30T13:46:04.377 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:46:04 smithi181 ceph-mon[25762]: from='mgr.24746 172.21.15.181:0/2892154077' entity='mgr.x' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-03-30T13:46:04.377 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:46:04 smithi181 ceph-mon[25762]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-03-30T13:46:04.377 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:46:04 smithi181 ceph-mon[25762]: from='mgr.24746 172.21.15.181:0/2892154077' entity='mgr.x' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi099.front.sepia.ceph.com:9093"}]: dispatch 2024-03-30T13:46:04.377 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:46:04 smithi181 ceph-mon[25762]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi099.front.sepia.ceph.com:9093"}]: dispatch 2024-03-30T13:46:04.378 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:46:04 smithi181 ceph-mon[25762]: from='mgr.24746 ' entity='mgr.x' 2024-03-30T13:46:04.378 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:46:04 smithi181 ceph-mon[25762]: from='mgr.24746 172.21.15.181:0/2892154077' entity='mgr.x' cmd=[{"prefix": "dashboard iscsi-gateway-list"}]: dispatch 2024-03-30T13:46:04.378 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:46:04 smithi181 ceph-mon[25762]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard iscsi-gateway-list"}]: dispatch 2024-03-30T13:46:04.378 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:46:04 smithi181 ceph-mon[25762]: from='mgr.24746 ' entity='mgr.x' 2024-03-30T13:46:04.378 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:46:04 smithi181 ceph-mon[25762]: Adding iSCSI gateway http://:@172.21.15.99:5000 to Dashboard 2024-03-30T13:46:04.378 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:46:04 smithi181 ceph-mon[25762]: from='mgr.24746 172.21.15.181:0/2892154077' entity='mgr.x' cmd=[{"prefix": "dashboard set-iscsi-api-ssl-verification", "value": "true"}]: dispatch 2024-03-30T13:46:04.378 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:46:04 smithi181 ceph-mon[25762]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard set-iscsi-api-ssl-verification", "value": "true"}]: dispatch 2024-03-30T13:46:04.378 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:46:04 smithi181 ceph-mon[25762]: from='mgr.24746 172.21.15.181:0/2892154077' entity='mgr.x' cmd=[{"prefix": "dashboard iscsi-gateway-add", "name": "smithi099"}]: dispatch 2024-03-30T13:46:04.378 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:46:04 smithi181 ceph-mon[25762]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard iscsi-gateway-add", "name": "smithi099"}]: dispatch 2024-03-30T13:46:04.378 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:46:04 smithi181 ceph-mon[25762]: from='mgr.24746 ' entity='mgr.x' 2024-03-30T13:46:04.378 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:46:04 smithi181 ceph-mon[25762]: from='mgr.24746 172.21.15.181:0/2892154077' entity='mgr.x' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-03-30T13:46:04.378 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:46:04 smithi181 ceph-mon[25762]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-03-30T13:46:04.378 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:46:04 smithi181 ceph-mon[25762]: from='mgr.24746 172.21.15.181:0/2892154077' entity='mgr.x' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi181.front.sepia.ceph.com:9095"}]: dispatch 2024-03-30T13:46:04.379 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:46:04 smithi181 ceph-mon[25762]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi181.front.sepia.ceph.com:9095"}]: dispatch 2024-03-30T13:46:04.379 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:46:04 smithi181 ceph-mon[25762]: from='mgr.24746 ' entity='mgr.x' 2024-03-30T13:46:04.379 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:46:04 smithi181 ceph-mon[25762]: from='mgr.24746 172.21.15.181:0/2892154077' entity='mgr.x' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-03-30T13:46:04.379 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:46:04 smithi181 ceph-mon[25762]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-03-30T13:46:04.379 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:46:04 smithi181 ceph-mon[25762]: from='mgr.24746 172.21.15.181:0/2892154077' entity='mgr.x' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi181.front.sepia.ceph.com:3000"}]: dispatch 2024-03-30T13:46:04.379 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:46:04 smithi181 ceph-mon[25762]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi181.front.sepia.ceph.com:3000"}]: dispatch 2024-03-30T13:46:04.379 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:46:04 smithi181 ceph-mon[25762]: from='mgr.24746 ' entity='mgr.x' 2024-03-30T13:46:04.379 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:46:04 smithi181 ceph-mon[25762]: from='mgr.24746 172.21.15.181:0/2892154077' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.agent.smithi181", "caps": []}]: dispatch 2024-03-30T13:46:04.379 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:46:04 smithi181 ceph-mon[25762]: from='mgr.24746 172.21.15.181:0/2892154077' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.agent.smithi099", "caps": []}]: dispatch 2024-03-30T13:46:04.379 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:46:04 smithi181 ceph-mon[25762]: from='mgr.24746 ' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.agent.smithi181", "caps": []}]: dispatch 2024-03-30T13:46:04.379 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:46:04 smithi181 ceph-mon[25762]: from='mgr.24746 ' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.agent.smithi099", "caps": []}]: dispatch 2024-03-30T13:46:04.379 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:46:04 smithi181 ceph-mon[25762]: from='mgr.24746 172.21.15.181:0/2892154077' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T13:46:04.587 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:46:04 smithi099 ceph-mon[24912]: from='mgr.24746 ' entity='mgr.x' 2024-03-30T13:46:04.588 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:46:04 smithi099 ceph-mon[24912]: from='mgr.24746 ' entity='mgr.x' 2024-03-30T13:46:04.588 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:46:04 smithi099 ceph-mon[24912]: from='mgr.24746 172.21.15.181:0/2892154077' entity='mgr.x' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-03-30T13:46:04.588 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:46:04 smithi099 ceph-mon[24912]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-03-30T13:46:04.588 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:46:04 smithi099 ceph-mon[24912]: from='mgr.24746 172.21.15.181:0/2892154077' entity='mgr.x' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi099.front.sepia.ceph.com:9093"}]: dispatch 2024-03-30T13:46:04.588 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:46:04 smithi099 ceph-mon[24912]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi099.front.sepia.ceph.com:9093"}]: dispatch 2024-03-30T13:46:04.588 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:46:04 smithi099 ceph-mon[24912]: from='mgr.24746 ' entity='mgr.x' 2024-03-30T13:46:04.588 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:46:04 smithi099 ceph-mon[24912]: from='mgr.24746 172.21.15.181:0/2892154077' entity='mgr.x' cmd=[{"prefix": "dashboard iscsi-gateway-list"}]: dispatch 2024-03-30T13:46:04.588 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:46:04 smithi099 ceph-mon[24912]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard iscsi-gateway-list"}]: dispatch 2024-03-30T13:46:04.588 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:46:04 smithi099 ceph-mon[24912]: from='mgr.24746 ' entity='mgr.x' 2024-03-30T13:46:04.588 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:46:04 smithi099 ceph-mon[24912]: Adding iSCSI gateway http://:@172.21.15.99:5000 to Dashboard 2024-03-30T13:46:04.588 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:46:04 smithi099 ceph-mon[24912]: from='mgr.24746 172.21.15.181:0/2892154077' entity='mgr.x' cmd=[{"prefix": "dashboard set-iscsi-api-ssl-verification", "value": "true"}]: dispatch 2024-03-30T13:46:04.588 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:46:04 smithi099 ceph-mon[24912]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard set-iscsi-api-ssl-verification", "value": "true"}]: dispatch 2024-03-30T13:46:04.588 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:46:04 smithi099 ceph-mon[24912]: from='mgr.24746 172.21.15.181:0/2892154077' entity='mgr.x' cmd=[{"prefix": "dashboard iscsi-gateway-add", "name": "smithi099"}]: dispatch 2024-03-30T13:46:04.588 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:46:04 smithi099 ceph-mon[24912]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard iscsi-gateway-add", "name": "smithi099"}]: dispatch 2024-03-30T13:46:04.589 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:46:04 smithi099 ceph-mon[24912]: from='mgr.24746 ' entity='mgr.x' 2024-03-30T13:46:04.589 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:46:04 smithi099 ceph-mon[24912]: from='mgr.24746 172.21.15.181:0/2892154077' entity='mgr.x' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-03-30T13:46:04.589 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:46:04 smithi099 ceph-mon[24912]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-03-30T13:46:04.589 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:46:04 smithi099 ceph-mon[24912]: from='mgr.24746 172.21.15.181:0/2892154077' entity='mgr.x' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi181.front.sepia.ceph.com:9095"}]: dispatch 2024-03-30T13:46:04.589 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:46:04 smithi099 ceph-mon[24912]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi181.front.sepia.ceph.com:9095"}]: dispatch 2024-03-30T13:46:04.589 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:46:04 smithi099 ceph-mon[24912]: from='mgr.24746 ' entity='mgr.x' 2024-03-30T13:46:04.589 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:46:04 smithi099 ceph-mon[24912]: from='mgr.24746 172.21.15.181:0/2892154077' entity='mgr.x' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-03-30T13:46:04.589 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:46:04 smithi099 ceph-mon[24912]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-03-30T13:46:04.589 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:46:04 smithi099 ceph-mon[24912]: from='mgr.24746 172.21.15.181:0/2892154077' entity='mgr.x' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi181.front.sepia.ceph.com:3000"}]: dispatch 2024-03-30T13:46:04.589 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:46:04 smithi099 ceph-mon[24912]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi181.front.sepia.ceph.com:3000"}]: dispatch 2024-03-30T13:46:04.589 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:46:04 smithi099 ceph-mon[24912]: from='mgr.24746 ' entity='mgr.x' 2024-03-30T13:46:04.589 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:46:04 smithi099 ceph-mon[24912]: from='mgr.24746 172.21.15.181:0/2892154077' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.agent.smithi181", "caps": []}]: dispatch 2024-03-30T13:46:04.589 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:46:04 smithi099 ceph-mon[24912]: from='mgr.24746 172.21.15.181:0/2892154077' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.agent.smithi099", "caps": []}]: dispatch 2024-03-30T13:46:04.589 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:46:04 smithi099 ceph-mon[24912]: from='mgr.24746 ' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.agent.smithi181", "caps": []}]: dispatch 2024-03-30T13:46:04.590 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:46:04 smithi099 ceph-mon[24912]: from='mgr.24746 ' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.agent.smithi099", "caps": []}]: dispatch 2024-03-30T13:46:04.590 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:46:04 smithi099 ceph-mon[24912]: from='mgr.24746 172.21.15.181:0/2892154077' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T13:46:04.590 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:46:04 smithi099 ceph-mon[29691]: from='mgr.24746 ' entity='mgr.x' 2024-03-30T13:46:04.590 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:46:04 smithi099 ceph-mon[29691]: from='mgr.24746 ' entity='mgr.x' 2024-03-30T13:46:04.590 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:46:04 smithi099 ceph-mon[29691]: from='mgr.24746 172.21.15.181:0/2892154077' entity='mgr.x' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-03-30T13:46:04.590 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:46:04 smithi099 ceph-mon[29691]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-03-30T13:46:04.590 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:46:04 smithi099 ceph-mon[29691]: from='mgr.24746 172.21.15.181:0/2892154077' entity='mgr.x' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi099.front.sepia.ceph.com:9093"}]: dispatch 2024-03-30T13:46:04.590 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:46:04 smithi099 ceph-mon[29691]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi099.front.sepia.ceph.com:9093"}]: dispatch 2024-03-30T13:46:04.591 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:46:04 smithi099 ceph-mon[29691]: from='mgr.24746 ' entity='mgr.x' 2024-03-30T13:46:04.591 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:46:04 smithi099 ceph-mon[29691]: from='mgr.24746 172.21.15.181:0/2892154077' entity='mgr.x' cmd=[{"prefix": "dashboard iscsi-gateway-list"}]: dispatch 2024-03-30T13:46:04.591 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:46:04 smithi099 ceph-mon[29691]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard iscsi-gateway-list"}]: dispatch 2024-03-30T13:46:04.591 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:46:04 smithi099 ceph-mon[29691]: from='mgr.24746 ' entity='mgr.x' 2024-03-30T13:46:04.591 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:46:04 smithi099 ceph-mon[29691]: Adding iSCSI gateway http://:@172.21.15.99:5000 to Dashboard 2024-03-30T13:46:04.591 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:46:04 smithi099 ceph-mon[29691]: from='mgr.24746 172.21.15.181:0/2892154077' entity='mgr.x' cmd=[{"prefix": "dashboard set-iscsi-api-ssl-verification", "value": "true"}]: dispatch 2024-03-30T13:46:04.591 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:46:04 smithi099 ceph-mon[29691]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard set-iscsi-api-ssl-verification", "value": "true"}]: dispatch 2024-03-30T13:46:04.591 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:46:04 smithi099 ceph-mon[29691]: from='mgr.24746 172.21.15.181:0/2892154077' entity='mgr.x' cmd=[{"prefix": "dashboard iscsi-gateway-add", "name": "smithi099"}]: dispatch 2024-03-30T13:46:04.591 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:46:04 smithi099 ceph-mon[29691]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard iscsi-gateway-add", "name": "smithi099"}]: dispatch 2024-03-30T13:46:04.591 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:46:04 smithi099 ceph-mon[29691]: from='mgr.24746 ' entity='mgr.x' 2024-03-30T13:46:04.591 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:46:04 smithi099 ceph-mon[29691]: from='mgr.24746 172.21.15.181:0/2892154077' entity='mgr.x' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-03-30T13:46:04.591 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:46:04 smithi099 ceph-mon[29691]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-03-30T13:46:04.591 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:46:04 smithi099 ceph-mon[29691]: from='mgr.24746 172.21.15.181:0/2892154077' entity='mgr.x' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi181.front.sepia.ceph.com:9095"}]: dispatch 2024-03-30T13:46:04.591 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:46:04 smithi099 ceph-mon[29691]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi181.front.sepia.ceph.com:9095"}]: dispatch 2024-03-30T13:46:04.591 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:46:04 smithi099 ceph-mon[29691]: from='mgr.24746 ' entity='mgr.x' 2024-03-30T13:46:04.592 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:46:04 smithi099 ceph-mon[29691]: from='mgr.24746 172.21.15.181:0/2892154077' entity='mgr.x' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-03-30T13:46:04.592 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:46:04 smithi099 ceph-mon[29691]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-03-30T13:46:04.592 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:46:04 smithi099 ceph-mon[29691]: from='mgr.24746 172.21.15.181:0/2892154077' entity='mgr.x' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi181.front.sepia.ceph.com:3000"}]: dispatch 2024-03-30T13:46:04.592 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:46:04 smithi099 ceph-mon[29691]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi181.front.sepia.ceph.com:3000"}]: dispatch 2024-03-30T13:46:04.592 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:46:04 smithi099 ceph-mon[29691]: from='mgr.24746 ' entity='mgr.x' 2024-03-30T13:46:04.592 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:46:04 smithi099 ceph-mon[29691]: from='mgr.24746 172.21.15.181:0/2892154077' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.agent.smithi181", "caps": []}]: dispatch 2024-03-30T13:46:04.592 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:46:04 smithi099 ceph-mon[29691]: from='mgr.24746 172.21.15.181:0/2892154077' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.agent.smithi099", "caps": []}]: dispatch 2024-03-30T13:46:04.592 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:46:04 smithi099 ceph-mon[29691]: from='mgr.24746 ' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.agent.smithi181", "caps": []}]: dispatch 2024-03-30T13:46:04.592 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:46:04 smithi099 ceph-mon[29691]: from='mgr.24746 ' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.agent.smithi099", "caps": []}]: dispatch 2024-03-30T13:46:04.592 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:46:04 smithi099 ceph-mon[29691]: from='mgr.24746 172.21.15.181:0/2892154077' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T13:46:05.406 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:46:05 smithi099 ceph-mon[24912]: pgmap v40: 161 pgs: 161 active+clean; 585 KiB data, 69 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T13:46:05.406 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:46:05 smithi099 ceph-mon[24912]: Deploying daemon agent.smithi181 on smithi181 2024-03-30T13:46:05.406 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:46:05 smithi099 ceph-mon[29691]: pgmap v40: 161 pgs: 161 active+clean; 585 KiB data, 69 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T13:46:05.406 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:46:05 smithi099 ceph-mon[29691]: Deploying daemon agent.smithi181 on smithi181 2024-03-30T13:46:05.507 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:46:05 smithi181 ceph-mon[25762]: pgmap v40: 161 pgs: 161 active+clean; 585 KiB data, 69 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T13:46:05.507 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:46:05 smithi181 ceph-mon[25762]: Deploying daemon agent.smithi181 on smithi181 2024-03-30T13:46:06.223 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:46:06 smithi181 ceph-mon[25762]: Reconfiguring daemon agent.smithi099 on smithi099 2024-03-30T13:46:06.224 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:46:06 smithi181 ceph-mon[25762]: from='mgr.24746 ' entity='mgr.x' 2024-03-30T13:46:06.224 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:46:06 smithi181 ceph-mon[25762]: from='mgr.24746 ' entity='mgr.x' 2024-03-30T13:46:06.490 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:46:06 smithi099 ceph-mon[24912]: Reconfiguring daemon agent.smithi099 on smithi099 2024-03-30T13:46:06.490 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:46:06 smithi099 ceph-mon[24912]: from='mgr.24746 ' entity='mgr.x' 2024-03-30T13:46:06.490 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:46:06 smithi099 ceph-mon[24912]: from='mgr.24746 ' entity='mgr.x' 2024-03-30T13:46:06.491 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:46:06 smithi099 ceph-mon[29691]: Reconfiguring daemon agent.smithi099 on smithi099 2024-03-30T13:46:06.491 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:46:06 smithi099 ceph-mon[29691]: from='mgr.24746 ' entity='mgr.x' 2024-03-30T13:46:06.491 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:46:06 smithi099 ceph-mon[29691]: from='mgr.24746 ' entity='mgr.x' 2024-03-30T13:46:07.496 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:46:07 smithi099 ceph-mon[24912]: pgmap v41: 161 pgs: 161 active+clean; 585 KiB data, 69 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T13:46:07.496 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:46:07 smithi099 ceph-mon[24912]: from='mgr.24746 ' entity='mgr.x' 2024-03-30T13:46:07.497 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:46:07 smithi099 ceph-mon[29691]: pgmap v41: 161 pgs: 161 active+clean; 585 KiB data, 69 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T13:46:07.497 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:46:07 smithi099 ceph-mon[29691]: from='mgr.24746 ' entity='mgr.x' 2024-03-30T13:46:07.506 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:46:07 smithi181 ceph-mon[25762]: pgmap v41: 161 pgs: 161 active+clean; 585 KiB data, 69 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T13:46:07.506 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:46:07 smithi181 ceph-mon[25762]: from='mgr.24746 ' entity='mgr.x' 2024-03-30T13:46:07.878 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 13:46:07 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-x[50211]: ::ffff:172.21.15.181 - - [30/Mar/2024:13:46:07] "GET /metrics HTTP/1.1" 200 37966 "" "Prometheus/2.33.4" 2024-03-30T13:46:08.756 INFO:journalctl@ceph.prometheus.a.smithi181.stdout:Mar 30 13:46:08 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-prometheus-a[55395]: ts=2024-03-30T13:46:08.660Z caller=manager.go:609 level=warn component="rule manager" group=osd msg="Evaluating rule failed" rule="alert: CephOSDFlapping\nexpr: (rate(ceph_osd_up[5m]) * on(ceph_daemon) group_left(hostname) ceph_osd_metadata)\n * 60 > 1\nlabels:\n oid: 1.3.6.1.4.1.50495.1.2.1.4.4\n severity: warning\n type: ceph_default\nannotations:\n description: OSD {{ $labels.ceph_daemon }} on {{ $labels.hostname }} was marked\n down and back up {{ $value | humanize }} times once a minute for 5 minutes. This\n may indicate a network issue (latency, packet loss, MTU mismatch) on the cluster\n network, or the public network if no cluster network is deployed. Check the network\n stats on the listed host(s).\n documentation: https://docs.ceph.com/en/latest/rados/troubleshooting/troubleshooting-osd#flapping-osds\n summary: Network issues are causing OSDs to flap (mark each other down)\n" err="found duplicate series for the match group {ceph_daemon=\"osd.0\"} on the right hand-side of the operation: [{__name__=\"ceph_osd_metadata\", ceph_daemon=\"osd.0\", ceph_version=\"ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)\", cluster_addr=\"172.21.15.99\", device_class=\"ssd\", hostname=\"smithi099\", instance=\"smithi181:9283\", job=\"ceph\", objectstore=\"bluestore\", public_addr=\"172.21.15.99\"}, {__name__=\"ceph_osd_metadata\", ceph_daemon=\"osd.0\", ceph_version=\"ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)\", cluster_addr=\"172.21.15.99\", device_class=\"ssd\", hostname=\"smithi099\", instance=\"172.21.15.181:9283\", job=\"ceph\", objectstore=\"bluestore\", public_addr=\"172.21.15.99\"}];many-to-many matching not allowed: matching labels must be unique on one side" 2024-03-30T13:46:09.388 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:46:09 smithi181 ceph-mon[25762]: from='client.24806 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T13:46:09.388 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:46:09 smithi181 ceph-mon[25762]: pgmap v42: 161 pgs: 161 active+clean; 585 KiB data, 69 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T13:46:09.587 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:46:09 smithi099 ceph-mon[24912]: from='client.24806 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T13:46:09.587 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:46:09 smithi099 ceph-mon[24912]: pgmap v42: 161 pgs: 161 active+clean; 585 KiB data, 69 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T13:46:09.587 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:46:09 smithi099 ceph-mon[29691]: from='client.24806 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T13:46:09.587 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:46:09 smithi099 ceph-mon[29691]: pgmap v42: 161 pgs: 161 active+clean; 585 KiB data, 69 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T13:46:10.705 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:46:10 smithi099 ceph-mon[24912]: from='mgr.24746 ' entity='mgr.x' 2024-03-30T13:46:10.705 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:46:10 smithi099 ceph-mon[29691]: from='mgr.24746 ' entity='mgr.x' 2024-03-30T13:46:10.709 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:46:10 smithi181 ceph-mon[25762]: from='mgr.24746 ' entity='mgr.x' 2024-03-30T13:46:11.506 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:46:11 smithi181 ceph-mon[25762]: pgmap v43: 161 pgs: 161 active+clean; 585 KiB data, 69 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T13:46:11.702 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:46:11 smithi099 ceph-mon[24912]: pgmap v43: 161 pgs: 161 active+clean; 585 KiB data, 69 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T13:46:11.703 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:46:11 smithi099 ceph-mon[29691]: pgmap v43: 161 pgs: 161 active+clean; 585 KiB data, 69 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T13:46:13.157 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:46:12 smithi181 ceph-mon[25762]: from='mgr.24746 ' entity='mgr.x' 2024-03-30T13:46:13.158 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:46:12 smithi181 ceph-mon[25762]: from='mgr.24746 ' entity='mgr.x' 2024-03-30T13:46:13.158 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:46:12 smithi181 ceph-mon[25762]: pgmap v44: 161 pgs: 161 active+clean; 585 KiB data, 69 MiB used, 715 GiB / 715 GiB avail; 861 B/s rd, 0 op/s 2024-03-30T13:46:13.158 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:46:12 smithi181 ceph-mon[25762]: from='mgr.24746 ' entity='mgr.x' 2024-03-30T13:46:13.213 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:46:12 smithi099 ceph-mon[24912]: from='mgr.24746 ' entity='mgr.x' 2024-03-30T13:46:13.213 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:46:12 smithi099 ceph-mon[24912]: from='mgr.24746 ' entity='mgr.x' 2024-03-30T13:46:13.213 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:46:12 smithi099 ceph-mon[24912]: pgmap v44: 161 pgs: 161 active+clean; 585 KiB data, 69 MiB used, 715 GiB / 715 GiB avail; 861 B/s rd, 0 op/s 2024-03-30T13:46:13.213 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:46:12 smithi099 ceph-mon[24912]: from='mgr.24746 ' entity='mgr.x' 2024-03-30T13:46:13.213 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:46:12 smithi099 ceph-mon[29691]: from='mgr.24746 ' entity='mgr.x' 2024-03-30T13:46:13.213 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:46:12 smithi099 ceph-mon[29691]: from='mgr.24746 ' entity='mgr.x' 2024-03-30T13:46:13.214 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:46:12 smithi099 ceph-mon[29691]: pgmap v44: 161 pgs: 161 active+clean; 585 KiB data, 69 MiB used, 715 GiB / 715 GiB avail; 861 B/s rd, 0 op/s 2024-03-30T13:46:13.214 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:46:12 smithi099 ceph-mon[29691]: from='mgr.24746 ' entity='mgr.x' 2024-03-30T13:46:14.256 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:46:13 smithi181 ceph-mon[25762]: Health check failed: 1 failed cephadm daemon(s) (CEPHADM_FAILED_DAEMON) 2024-03-30T13:46:14.256 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:46:13 smithi181 ceph-mon[25762]: from='mgr.24746 ' entity='mgr.x' 2024-03-30T13:46:14.256 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:46:13 smithi181 ceph-mon[25762]: from='mgr.24746 ' entity='mgr.x' 2024-03-30T13:46:14.337 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:46:13 smithi099 ceph-mon[24912]: Health check failed: 1 failed cephadm daemon(s) (CEPHADM_FAILED_DAEMON) 2024-03-30T13:46:14.337 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:46:13 smithi099 ceph-mon[24912]: from='mgr.24746 ' entity='mgr.x' 2024-03-30T13:46:14.337 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:46:13 smithi099 ceph-mon[24912]: from='mgr.24746 ' entity='mgr.x' 2024-03-30T13:46:14.337 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:46:13 smithi099 ceph-mon[29691]: Health check failed: 1 failed cephadm daemon(s) (CEPHADM_FAILED_DAEMON) 2024-03-30T13:46:14.337 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:46:13 smithi099 ceph-mon[29691]: from='mgr.24746 ' entity='mgr.x' 2024-03-30T13:46:14.337 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:46:13 smithi099 ceph-mon[29691]: from='mgr.24746 ' entity='mgr.x' 2024-03-30T13:46:14.582 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 13:46:14 smithi181 systemd[1]: ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4@grafana.a.service: Scheduled restart job, restart counter is at 1. 2024-03-30T13:46:14.582 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 13:46:14 smithi181 systemd[1]: Stopped Ceph grafana.a for 98ebaeb8-ee99-11ee-b647-cb9ed24678a4. 2024-03-30T13:46:14.582 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 13:46:14 smithi181 systemd[1]: Starting Ceph grafana.a for 98ebaeb8-ee99-11ee-b647-cb9ed24678a4... 2024-03-30T13:46:14.582 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 13:46:14 smithi181 podman[57792]: 2024-03-30 13:46:14.481153234 +0000 UTC m=+0.109300182 container create c1dc446d9f98810a91b5c28083bf616e9d67ead4cb4fd3a02c01888e33aad664 (image=quay.io/ceph/ceph-grafana:8.3.5, name=ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a, io.k8s.display-name=Red Hat Universal Base Image 8, description=Ceph Grafana Container, summary=Grafana Container configured for Ceph mgr/dashboard integration, io.buildah.version=1.24.2, io.k8s.description=The Universal Base Image is designed and engineered to be the base layer for all of your containerized applications, middleware and utilities. This base image is freely redistributable, but Red Hat only supports Red Hat technologies through subscriptions for Red Hat products. This image is maintained by Red Hat and updated regularly., com.redhat.component=ubi8-container, name=ubi8, vcs-type=git, io.openshift.tags=base rhel8, release=236.1648460182, maintainer=Paul Cuzner , architecture=x86_64, io.openshift.expose-services=, vendor=Red Hat, Inc., version=8.5, com.redhat.license_terms=https://www.redhat.com/en/about/red-hat-end-user-license-agreements#UBI, distribution-scope=public, build-date=2022-03-28T10:36:18.413762, vcs-ref=3aadd00326f3dd6cfe65ee31017ab98915fddb56, url=https://access.redhat.com/containers/#/registry.access.redhat.com/ubi8/images/8.5-236.1648460182, com.redhat.build-host=cpt-1002.osbs.prod.upshift.rdu2.redhat.com) 2024-03-30T13:46:14.582 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 13:46:14 smithi181 podman[57792]: 2024-03-30 13:46:14.389158784 +0000 UTC m=+0.017305745 image pull dad864ee21e98e69f4029d1e417aa085001566be0d322fbc75bc6f29b0050c01 quay.io/ceph/ceph-grafana:8.3.5 2024-03-30T13:46:15.006 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:46:14 smithi181 ceph-mon[25762]: pgmap v45: 161 pgs: 161 active+clean; 585 KiB data, 69 MiB used, 715 GiB / 715 GiB avail; 861 B/s rd, 0 op/s 2024-03-30T13:46:15.006 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:46:14 smithi181 ceph-mon[25762]: from='mgr.24746 ' entity='mgr.x' 2024-03-30T13:46:15.006 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:46:14 smithi181 ceph-mon[25762]: from='mgr.24746 ' entity='mgr.x' 2024-03-30T13:46:15.006 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:46:14 smithi181 ceph-mon[25762]: from='mgr.24746 172.21.15.181:0/2892154077' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:46:15.007 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:46:14 smithi181 ceph-mon[25762]: from='mgr.24746 172.21.15.181:0/2892154077' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:46:15.007 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:46:14 smithi181 ceph-mon[25762]: from='mgr.24746 ' entity='mgr.x' 2024-03-30T13:46:15.007 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:46:14 smithi181 ceph-mon[25762]: from='mgr.24746 ' entity='mgr.x' 2024-03-30T13:46:15.007 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:46:14 smithi181 ceph-mon[25762]: from='mgr.24746 172.21.15.181:0/2892154077' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.agent.smithi099", "caps": []}]: dispatch 2024-03-30T13:46:15.007 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:46:14 smithi181 ceph-mon[25762]: from='mgr.24746 ' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.agent.smithi099", "caps": []}]: dispatch 2024-03-30T13:46:15.007 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 13:46:14 smithi181 podman[57792]: 2024-03-30 13:46:14.683433553 +0000 UTC m=+0.311580493 container init c1dc446d9f98810a91b5c28083bf616e9d67ead4cb4fd3a02c01888e33aad664 (image=quay.io/ceph/ceph-grafana:8.3.5, name=ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a, distribution-scope=public, architecture=x86_64, name=ubi8, description=Ceph Grafana Container, summary=Grafana Container configured for Ceph mgr/dashboard integration, build-date=2022-03-28T10:36:18.413762, url=https://access.redhat.com/containers/#/registry.access.redhat.com/ubi8/images/8.5-236.1648460182, release=236.1648460182, com.redhat.build-host=cpt-1002.osbs.prod.upshift.rdu2.redhat.com, com.redhat.license_terms=https://www.redhat.com/en/about/red-hat-end-user-license-agreements#UBI, io.k8s.display-name=Red Hat Universal Base Image 8, io.buildah.version=1.24.2, vcs-ref=3aadd00326f3dd6cfe65ee31017ab98915fddb56, io.openshift.tags=base rhel8, io.k8s.description=The Universal Base Image is designed and engineered to be the base layer for all of your containerized applications, middleware and utilities. This base image is freely redistributable, but Red Hat only supports Red Hat technologies through subscriptions for Red Hat products. This image is maintained by Red Hat and updated regularly., maintainer=Paul Cuzner , vendor=Red Hat, Inc., version=8.5, vcs-type=git, io.openshift.expose-services=, com.redhat.component=ubi8-container) 2024-03-30T13:46:15.007 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 13:46:14 smithi181 podman[57792]: 2024-03-30 13:46:14.686045367 +0000 UTC m=+0.314192310 container start c1dc446d9f98810a91b5c28083bf616e9d67ead4cb4fd3a02c01888e33aad664 (image=quay.io/ceph/ceph-grafana:8.3.5, name=ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a, com.redhat.license_terms=https://www.redhat.com/en/about/red-hat-end-user-license-agreements#UBI, io.openshift.tags=base rhel8, io.k8s.description=The Universal Base Image is designed and engineered to be the base layer for all of your containerized applications, middleware and utilities. This base image is freely redistributable, but Red Hat only supports Red Hat technologies through subscriptions for Red Hat products. This image is maintained by Red Hat and updated regularly., release=236.1648460182, com.redhat.component=ubi8-container, maintainer=Paul Cuzner , io.openshift.expose-services=, url=https://access.redhat.com/containers/#/registry.access.redhat.com/ubi8/images/8.5-236.1648460182, name=ubi8, architecture=x86_64, build-date=2022-03-28T10:36:18.413762, vendor=Red Hat, Inc., version=8.5, vcs-type=git, description=Ceph Grafana Container, distribution-scope=public, io.k8s.display-name=Red Hat Universal Base Image 8, summary=Grafana Container configured for Ceph mgr/dashboard integration, vcs-ref=3aadd00326f3dd6cfe65ee31017ab98915fddb56, io.buildah.version=1.24.2, com.redhat.build-host=cpt-1002.osbs.prod.upshift.rdu2.redhat.com) 2024-03-30T13:46:15.007 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 13:46:14 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a[57806]: Failed to start grafana. error: failed to create log directory "/usr/share/grafana/data/log": mkdir /usr/share/grafana/data: permission denied 2024-03-30T13:46:15.007 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 13:46:14 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a[57806]: failed to create log directory "/usr/share/grafana/data/log": mkdir /usr/share/grafana/data: permission denied 2024-03-30T13:46:15.007 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 13:46:14 smithi181 bash[57792]: c1dc446d9f98810a91b5c28083bf616e9d67ead4cb4fd3a02c01888e33aad664 2024-03-30T13:46:15.007 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 13:46:14 smithi181 systemd[1]: Started Ceph grafana.a for 98ebaeb8-ee99-11ee-b647-cb9ed24678a4. 2024-03-30T13:46:15.007 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 13:46:14 smithi181 podman[57823]: 2024-03-30 13:46:14.770906236 +0000 UTC m=+0.051997831 container died c1dc446d9f98810a91b5c28083bf616e9d67ead4cb4fd3a02c01888e33aad664 (image=quay.io/ceph/ceph-grafana:8.3.5, name=ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a, summary=Grafana Container configured for Ceph mgr/dashboard integration, build-date=2022-03-28T10:36:18.413762, description=Ceph Grafana Container, vendor=Red Hat, Inc., io.buildah.version=1.24.2, com.redhat.license_terms=https://www.redhat.com/en/about/red-hat-end-user-license-agreements#UBI, io.openshift.tags=base rhel8, io.k8s.display-name=Red Hat Universal Base Image 8, maintainer=Paul Cuzner , distribution-scope=public, architecture=x86_64, io.openshift.expose-services=, name=ubi8, url=https://access.redhat.com/containers/#/registry.access.redhat.com/ubi8/images/8.5-236.1648460182, vcs-type=git, io.k8s.description=The Universal Base Image is designed and engineered to be the base layer for all of your containerized applications, middleware and utilities. This base image is freely redistributable, but Red Hat only supports Red Hat technologies through subscriptions for Red Hat products. This image is maintained by Red Hat and updated regularly., com.redhat.build-host=cpt-1002.osbs.prod.upshift.rdu2.redhat.com, com.redhat.component=ubi8-container, vcs-ref=3aadd00326f3dd6cfe65ee31017ab98915fddb56, version=8.5, release=236.1648460182) 2024-03-30T13:46:15.337 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:46:14 smithi099 ceph-mon[29691]: pgmap v45: 161 pgs: 161 active+clean; 585 KiB data, 69 MiB used, 715 GiB / 715 GiB avail; 861 B/s rd, 0 op/s 2024-03-30T13:46:15.337 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:46:14 smithi099 ceph-mon[29691]: from='mgr.24746 ' entity='mgr.x' 2024-03-30T13:46:15.337 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:46:14 smithi099 ceph-mon[29691]: from='mgr.24746 ' entity='mgr.x' 2024-03-30T13:46:15.337 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:46:14 smithi099 ceph-mon[29691]: from='mgr.24746 172.21.15.181:0/2892154077' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:46:15.337 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:46:14 smithi099 ceph-mon[29691]: from='mgr.24746 172.21.15.181:0/2892154077' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:46:15.337 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:46:14 smithi099 ceph-mon[29691]: from='mgr.24746 ' entity='mgr.x' 2024-03-30T13:46:15.337 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:46:14 smithi099 ceph-mon[29691]: from='mgr.24746 ' entity='mgr.x' 2024-03-30T13:46:15.337 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:46:14 smithi099 ceph-mon[29691]: from='mgr.24746 172.21.15.181:0/2892154077' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.agent.smithi099", "caps": []}]: dispatch 2024-03-30T13:46:15.338 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:46:14 smithi099 ceph-mon[29691]: from='mgr.24746 ' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.agent.smithi099", "caps": []}]: dispatch 2024-03-30T13:46:15.338 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:46:14 smithi099 ceph-mon[24912]: pgmap v45: 161 pgs: 161 active+clean; 585 KiB data, 69 MiB used, 715 GiB / 715 GiB avail; 861 B/s rd, 0 op/s 2024-03-30T13:46:15.338 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:46:14 smithi099 ceph-mon[24912]: from='mgr.24746 ' entity='mgr.x' 2024-03-30T13:46:15.338 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:46:14 smithi099 ceph-mon[24912]: from='mgr.24746 ' entity='mgr.x' 2024-03-30T13:46:15.338 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:46:14 smithi099 ceph-mon[24912]: from='mgr.24746 172.21.15.181:0/2892154077' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:46:15.338 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:46:14 smithi099 ceph-mon[24912]: from='mgr.24746 172.21.15.181:0/2892154077' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:46:15.338 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:46:14 smithi099 ceph-mon[24912]: from='mgr.24746 ' entity='mgr.x' 2024-03-30T13:46:15.338 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:46:14 smithi099 ceph-mon[24912]: from='mgr.24746 ' entity='mgr.x' 2024-03-30T13:46:15.338 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:46:14 smithi099 ceph-mon[24912]: from='mgr.24746 172.21.15.181:0/2892154077' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.agent.smithi099", "caps": []}]: dispatch 2024-03-30T13:46:15.338 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:46:14 smithi099 ceph-mon[24912]: from='mgr.24746 ' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.agent.smithi099", "caps": []}]: dispatch 2024-03-30T13:46:15.756 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 13:46:15 smithi181 podman[57823]: 2024-03-30 13:46:15.320719765 +0000 UTC m=+0.601811362 container remove c1dc446d9f98810a91b5c28083bf616e9d67ead4cb4fd3a02c01888e33aad664 (image=quay.io/ceph/ceph-grafana:8.3.5, name=ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a, name=ubi8, build-date=2022-03-28T10:36:18.413762, com.redhat.component=ubi8-container, maintainer=Paul Cuzner , distribution-scope=public, io.openshift.expose-services=, vcs-ref=3aadd00326f3dd6cfe65ee31017ab98915fddb56, io.openshift.tags=base rhel8, version=8.5, com.redhat.license_terms=https://www.redhat.com/en/about/red-hat-end-user-license-agreements#UBI, io.k8s.display-name=Red Hat Universal Base Image 8, io.buildah.version=1.24.2, io.k8s.description=The Universal Base Image is designed and engineered to be the base layer for all of your containerized applications, middleware and utilities. This base image is freely redistributable, but Red Hat only supports Red Hat technologies through subscriptions for Red Hat products. This image is maintained by Red Hat and updated regularly., description=Ceph Grafana Container, vcs-type=git, summary=Grafana Container configured for Ceph mgr/dashboard integration, architecture=x86_64, com.redhat.build-host=cpt-1002.osbs.prod.upshift.rdu2.redhat.com, release=236.1648460182, url=https://access.redhat.com/containers/#/registry.access.redhat.com/ubi8/images/8.5-236.1648460182, vendor=Red Hat, Inc.) 2024-03-30T13:46:15.756 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 13:46:15 smithi181 systemd[1]: ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4@grafana.a.service: Main process exited, code=exited, status=1/FAILURE 2024-03-30T13:46:15.756 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 13:46:15 smithi181 systemd[1]: ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4@grafana.a.service: Failed with result 'exit-code'. 2024-03-30T13:46:16.252 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:46:15 smithi099 ceph-mon[29691]: pgmap v46: 161 pgs: 161 active+clean; 585 KiB data, 69 MiB used, 715 GiB / 715 GiB avail; 956 B/s rd, 0 op/s 2024-03-30T13:46:16.252 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:46:15 smithi099 ceph-mon[29691]: pgmap v47: 161 pgs: 161 active+clean; 585 KiB data, 69 MiB used, 715 GiB / 715 GiB avail; 588 B/s rd, 0 op/s 2024-03-30T13:46:16.252 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:46:15 smithi099 ceph-mon[29691]: pgmap v48: 161 pgs: 161 active+clean; 585 KiB data, 69 MiB used, 715 GiB / 715 GiB avail; 763 B/s rd, 0 op/s 2024-03-30T13:46:16.252 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:46:15 smithi099 ceph-mon[29691]: Health check failed: 1 Cephadm Agent(s) are not reporting. Hosts may be offline (CEPHADM_AGENT_DOWN) 2024-03-30T13:46:16.253 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:46:15 smithi099 ceph-mon[24912]: pgmap v46: 161 pgs: 161 active+clean; 585 KiB data, 69 MiB used, 715 GiB / 715 GiB avail; 956 B/s rd, 0 op/s 2024-03-30T13:46:16.253 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:46:15 smithi099 ceph-mon[24912]: pgmap v47: 161 pgs: 161 active+clean; 585 KiB data, 69 MiB used, 715 GiB / 715 GiB avail; 588 B/s rd, 0 op/s 2024-03-30T13:46:16.253 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:46:15 smithi099 ceph-mon[24912]: pgmap v48: 161 pgs: 161 active+clean; 585 KiB data, 69 MiB used, 715 GiB / 715 GiB avail; 763 B/s rd, 0 op/s 2024-03-30T13:46:16.253 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:46:15 smithi099 ceph-mon[24912]: Health check failed: 1 Cephadm Agent(s) are not reporting. Hosts may be offline (CEPHADM_AGENT_DOWN) 2024-03-30T13:46:16.256 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:46:15 smithi181 ceph-mon[25762]: pgmap v46: 161 pgs: 161 active+clean; 585 KiB data, 69 MiB used, 715 GiB / 715 GiB avail; 956 B/s rd, 0 op/s 2024-03-30T13:46:16.256 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:46:15 smithi181 ceph-mon[25762]: pgmap v47: 161 pgs: 161 active+clean; 585 KiB data, 69 MiB used, 715 GiB / 715 GiB avail; 588 B/s rd, 0 op/s 2024-03-30T13:46:16.256 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:46:15 smithi181 ceph-mon[25762]: pgmap v48: 161 pgs: 161 active+clean; 585 KiB data, 69 MiB used, 715 GiB / 715 GiB avail; 763 B/s rd, 0 op/s 2024-03-30T13:46:16.256 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:46:15 smithi181 ceph-mon[25762]: Health check failed: 1 Cephadm Agent(s) are not reporting. Hosts may be offline (CEPHADM_AGENT_DOWN) 2024-03-30T13:46:17.187 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:46:16 smithi099 ceph-mon[24912]: Deploying daemon agent.smithi099 on smithi099 2024-03-30T13:46:17.187 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:46:16 smithi099 ceph-mon[24912]: from='mgr.24746 ' entity='mgr.x' 2024-03-30T13:46:17.188 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:46:16 smithi099 ceph-mon[24912]: from='mgr.24746 172.21.15.181:0/2892154077' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:46:17.188 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:46:16 smithi099 ceph-mon[24912]: from='mgr.24746 172.21.15.181:0/2892154077' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:46:17.188 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:46:16 smithi099 ceph-mon[24912]: from='mgr.24746 ' entity='mgr.x' 2024-03-30T13:46:17.188 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:46:16 smithi099 ceph-mon[29691]: Deploying daemon agent.smithi099 on smithi099 2024-03-30T13:46:17.188 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:46:16 smithi099 ceph-mon[29691]: from='mgr.24746 ' entity='mgr.x' 2024-03-30T13:46:17.188 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:46:16 smithi099 ceph-mon[29691]: from='mgr.24746 172.21.15.181:0/2892154077' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:46:17.188 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:46:16 smithi099 ceph-mon[29691]: from='mgr.24746 172.21.15.181:0/2892154077' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:46:17.188 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:46:16 smithi099 ceph-mon[29691]: from='mgr.24746 ' entity='mgr.x' 2024-03-30T13:46:17.256 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:46:16 smithi181 ceph-mon[25762]: Deploying daemon agent.smithi099 on smithi099 2024-03-30T13:46:17.256 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:46:16 smithi181 ceph-mon[25762]: from='mgr.24746 ' entity='mgr.x' 2024-03-30T13:46:17.256 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:46:16 smithi181 ceph-mon[25762]: from='mgr.24746 172.21.15.181:0/2892154077' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:46:17.256 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:46:16 smithi181 ceph-mon[25762]: from='mgr.24746 172.21.15.181:0/2892154077' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:46:17.256 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:46:16 smithi181 ceph-mon[25762]: from='mgr.24746 ' entity='mgr.x' 2024-03-30T13:46:17.922 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 13:46:17 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-x[50211]: ::ffff:172.21.15.181 - - [30/Mar/2024:13:46:17] "GET /metrics HTTP/1.1" 200 37966 "" "Prometheus/2.33.4" 2024-03-30T13:46:18.161 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:46:17 smithi099 ceph-mon[29691]: pgmap v49: 161 pgs: 161 active+clean; 585 KiB data, 69 MiB used, 715 GiB / 715 GiB avail; 763 B/s rd, 0 op/s 2024-03-30T13:46:18.161 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:46:17 smithi099 ceph-mon[29691]: pgmap v50: 161 pgs: 161 active+clean; 585 KiB data, 69 MiB used, 715 GiB / 715 GiB avail; 1.0 KiB/s rd, 1 op/s 2024-03-30T13:46:18.161 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:46:17 smithi099 ceph-mon[29691]: pgmap v51: 161 pgs: 161 active+clean; 585 KiB data, 69 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-03-30T13:46:18.161 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:46:17 smithi099 ceph-mon[29691]: pgmap v52: 161 pgs: 161 active+clean; 585 KiB data, 69 MiB used, 715 GiB / 715 GiB avail; 2.4 KiB/s rd, 2 op/s 2024-03-30T13:46:18.161 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:46:17 smithi099 ceph-mon[29691]: Health check cleared: CEPHADM_AGENT_DOWN (was: 1 Cephadm Agent(s) are not reporting. Hosts may be offline) 2024-03-30T13:46:18.161 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:46:17 smithi099 ceph-mon[29691]: from='mgr.24746 ' entity='mgr.x' 2024-03-30T13:46:18.161 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:46:17 smithi099 ceph-mon[24912]: pgmap v49: 161 pgs: 161 active+clean; 585 KiB data, 69 MiB used, 715 GiB / 715 GiB avail; 763 B/s rd, 0 op/s 2024-03-30T13:46:18.161 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:46:17 smithi099 ceph-mon[24912]: pgmap v50: 161 pgs: 161 active+clean; 585 KiB data, 69 MiB used, 715 GiB / 715 GiB avail; 1.0 KiB/s rd, 1 op/s 2024-03-30T13:46:18.161 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:46:17 smithi099 ceph-mon[24912]: pgmap v51: 161 pgs: 161 active+clean; 585 KiB data, 69 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-03-30T13:46:18.161 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:46:17 smithi099 ceph-mon[24912]: pgmap v52: 161 pgs: 161 active+clean; 585 KiB data, 69 MiB used, 715 GiB / 715 GiB avail; 2.4 KiB/s rd, 2 op/s 2024-03-30T13:46:18.161 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:46:17 smithi099 ceph-mon[24912]: Health check cleared: CEPHADM_AGENT_DOWN (was: 1 Cephadm Agent(s) are not reporting. Hosts may be offline) 2024-03-30T13:46:18.161 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:46:17 smithi099 ceph-mon[24912]: from='mgr.24746 ' entity='mgr.x' 2024-03-30T13:46:18.256 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:46:17 smithi181 ceph-mon[25762]: pgmap v49: 161 pgs: 161 active+clean; 585 KiB data, 69 MiB used, 715 GiB / 715 GiB avail; 763 B/s rd, 0 op/s 2024-03-30T13:46:18.256 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:46:17 smithi181 ceph-mon[25762]: pgmap v50: 161 pgs: 161 active+clean; 585 KiB data, 69 MiB used, 715 GiB / 715 GiB avail; 1.0 KiB/s rd, 1 op/s 2024-03-30T13:46:18.256 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:46:17 smithi181 ceph-mon[25762]: pgmap v51: 161 pgs: 161 active+clean; 585 KiB data, 69 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-03-30T13:46:18.256 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:46:17 smithi181 ceph-mon[25762]: pgmap v52: 161 pgs: 161 active+clean; 585 KiB data, 69 MiB used, 715 GiB / 715 GiB avail; 2.4 KiB/s rd, 2 op/s 2024-03-30T13:46:18.256 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:46:17 smithi181 ceph-mon[25762]: Health check cleared: CEPHADM_AGENT_DOWN (was: 1 Cephadm Agent(s) are not reporting. Hosts may be offline) 2024-03-30T13:46:18.256 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:46:17 smithi181 ceph-mon[25762]: from='mgr.24746 ' entity='mgr.x' 2024-03-30T13:46:18.925 INFO:journalctl@ceph.prometheus.a.smithi181.stdout:Mar 30 13:46:18 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-prometheus-a[55395]: ts=2024-03-30T13:46:18.660Z caller=manager.go:609 level=warn component="rule manager" group=osd msg="Evaluating rule failed" rule="alert: CephOSDFlapping\nexpr: (rate(ceph_osd_up[5m]) * on(ceph_daemon) group_left(hostname) ceph_osd_metadata)\n * 60 > 1\nlabels:\n oid: 1.3.6.1.4.1.50495.1.2.1.4.4\n severity: warning\n type: ceph_default\nannotations:\n description: OSD {{ $labels.ceph_daemon }} on {{ $labels.hostname }} was marked\n down and back up {{ $value | humanize }} times once a minute for 5 minutes. This\n may indicate a network issue (latency, packet loss, MTU mismatch) on the cluster\n network, or the public network if no cluster network is deployed. Check the network\n stats on the listed host(s).\n documentation: https://docs.ceph.com/en/latest/rados/troubleshooting/troubleshooting-osd#flapping-osds\n summary: Network issues are causing OSDs to flap (mark each other down)\n" err="found duplicate series for the match group {ceph_daemon=\"osd.0\"} on the right hand-side of the operation: [{__name__=\"ceph_osd_metadata\", ceph_daemon=\"osd.0\", ceph_version=\"ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)\", cluster_addr=\"172.21.15.99\", device_class=\"ssd\", hostname=\"smithi099\", instance=\"smithi181:9283\", job=\"ceph\", objectstore=\"bluestore\", public_addr=\"172.21.15.99\"}, {__name__=\"ceph_osd_metadata\", ceph_daemon=\"osd.0\", ceph_version=\"ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)\", cluster_addr=\"172.21.15.99\", device_class=\"ssd\", hostname=\"smithi099\", instance=\"172.21.15.181:9283\", job=\"ceph\", objectstore=\"bluestore\", public_addr=\"172.21.15.99\"}];many-to-many matching not allowed: matching labels must be unique on one side" 2024-03-30T13:46:19.084 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:46:18 smithi099 ceph-mon[24912]: from='client.24806 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T13:46:19.084 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:46:18 smithi099 ceph-mon[29691]: from='client.24806 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T13:46:19.256 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:46:18 smithi181 ceph-mon[25762]: from='client.24806 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T13:46:20.337 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:46:20 smithi099 ceph-mon[24912]: pgmap v53: 161 pgs: 161 active+clean; 585 KiB data, 69 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T13:46:20.337 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:46:20 smithi099 ceph-mon[24912]: from='mgr.24746 ' entity='mgr.x' 2024-03-30T13:46:20.337 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:46:20 smithi099 ceph-mon[24912]: from='mgr.24746 172.21.15.181:0/2892154077' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T13:46:20.338 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:46:20 smithi099 ceph-mon[29691]: pgmap v53: 161 pgs: 161 active+clean; 585 KiB data, 69 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T13:46:20.338 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:46:20 smithi099 ceph-mon[29691]: from='mgr.24746 ' entity='mgr.x' 2024-03-30T13:46:20.338 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:46:20 smithi099 ceph-mon[29691]: from='mgr.24746 172.21.15.181:0/2892154077' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T13:46:20.506 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:46:20 smithi181 ceph-mon[25762]: pgmap v53: 161 pgs: 161 active+clean; 585 KiB data, 69 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T13:46:20.506 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:46:20 smithi181 ceph-mon[25762]: from='mgr.24746 ' entity='mgr.x' 2024-03-30T13:46:20.506 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:46:20 smithi181 ceph-mon[25762]: from='mgr.24746 172.21.15.181:0/2892154077' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T13:46:22.256 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:46:21 smithi181 ceph-mon[25762]: pgmap v54: 161 pgs: 161 active+clean; 585 KiB data, 69 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-03-30T13:46:22.256 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:46:21 smithi181 ceph-mon[25762]: from='mgr.24746 ' entity='mgr.x' 2024-03-30T13:46:22.337 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:46:21 smithi099 ceph-mon[24912]: pgmap v54: 161 pgs: 161 active+clean; 585 KiB data, 69 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-03-30T13:46:22.337 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:46:21 smithi099 ceph-mon[24912]: from='mgr.24746 ' entity='mgr.x' 2024-03-30T13:46:22.337 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:46:21 smithi099 ceph-mon[29691]: pgmap v54: 161 pgs: 161 active+clean; 585 KiB data, 69 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-03-30T13:46:22.338 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:46:21 smithi099 ceph-mon[29691]: from='mgr.24746 ' entity='mgr.x' 2024-03-30T13:46:24.256 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:46:23 smithi181 ceph-mon[25762]: pgmap v55: 161 pgs: 161 active+clean; 585 KiB data, 69 MiB used, 715 GiB / 715 GiB avail; 845 B/s rd, 0 op/s 2024-03-30T13:46:24.256 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:46:23 smithi181 ceph-mon[25762]: from='mgr.24746 ' entity='mgr.x' 2024-03-30T13:46:24.256 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:46:23 smithi181 ceph-mon[25762]: from='mgr.24746 ' entity='mgr.x' 2024-03-30T13:46:24.256 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:46:23 smithi181 ceph-mon[25762]: pgmap v56: 161 pgs: 161 active+clean; 585 KiB data, 69 MiB used, 715 GiB / 715 GiB avail; 838 B/s rd, 0 op/s 2024-03-30T13:46:24.256 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:46:23 smithi181 ceph-mon[25762]: pgmap v57: 161 pgs: 161 active+clean; 585 KiB data, 69 MiB used, 715 GiB / 715 GiB avail; 838 B/s rd, 0 op/s 2024-03-30T13:46:24.257 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:46:23 smithi181 ceph-mon[25762]: from='mgr.24746 ' entity='mgr.x' 2024-03-30T13:46:24.337 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:46:23 smithi099 ceph-mon[24912]: pgmap v55: 161 pgs: 161 active+clean; 585 KiB data, 69 MiB used, 715 GiB / 715 GiB avail; 845 B/s rd, 0 op/s 2024-03-30T13:46:24.337 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:46:23 smithi099 ceph-mon[24912]: from='mgr.24746 ' entity='mgr.x' 2024-03-30T13:46:24.338 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:46:23 smithi099 ceph-mon[24912]: from='mgr.24746 ' entity='mgr.x' 2024-03-30T13:46:24.338 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:46:23 smithi099 ceph-mon[24912]: pgmap v56: 161 pgs: 161 active+clean; 585 KiB data, 69 MiB used, 715 GiB / 715 GiB avail; 838 B/s rd, 0 op/s 2024-03-30T13:46:24.338 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:46:23 smithi099 ceph-mon[24912]: pgmap v57: 161 pgs: 161 active+clean; 585 KiB data, 69 MiB used, 715 GiB / 715 GiB avail; 838 B/s rd, 0 op/s 2024-03-30T13:46:24.338 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:46:23 smithi099 ceph-mon[24912]: from='mgr.24746 ' entity='mgr.x' 2024-03-30T13:46:24.338 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:46:23 smithi099 ceph-mon[29691]: pgmap v55: 161 pgs: 161 active+clean; 585 KiB data, 69 MiB used, 715 GiB / 715 GiB avail; 845 B/s rd, 0 op/s 2024-03-30T13:46:24.338 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:46:23 smithi099 ceph-mon[29691]: from='mgr.24746 ' entity='mgr.x' 2024-03-30T13:46:24.338 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:46:23 smithi099 ceph-mon[29691]: from='mgr.24746 ' entity='mgr.x' 2024-03-30T13:46:24.338 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:46:23 smithi099 ceph-mon[29691]: pgmap v56: 161 pgs: 161 active+clean; 585 KiB data, 69 MiB used, 715 GiB / 715 GiB avail; 838 B/s rd, 0 op/s 2024-03-30T13:46:24.338 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:46:23 smithi099 ceph-mon[29691]: pgmap v57: 161 pgs: 161 active+clean; 585 KiB data, 69 MiB used, 715 GiB / 715 GiB avail; 838 B/s rd, 0 op/s 2024-03-30T13:46:24.338 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:46:23 smithi099 ceph-mon[29691]: from='mgr.24746 ' entity='mgr.x' 2024-03-30T13:46:25.954 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 13:46:25 smithi181 systemd[1]: ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4@grafana.a.service: Scheduled restart job, restart counter is at 2. 2024-03-30T13:46:25.954 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 13:46:25 smithi181 systemd[1]: Stopped Ceph grafana.a for 98ebaeb8-ee99-11ee-b647-cb9ed24678a4. 2024-03-30T13:46:25.954 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 13:46:25 smithi181 systemd[1]: Starting Ceph grafana.a for 98ebaeb8-ee99-11ee-b647-cb9ed24678a4... 2024-03-30T13:46:25.954 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 13:46:25 smithi181 podman[57960]: 2024-03-30 13:46:25.643315771 +0000 UTC m=+0.017088403 image pull dad864ee21e98e69f4029d1e417aa085001566be0d322fbc75bc6f29b0050c01 quay.io/ceph/ceph-grafana:8.3.5 2024-03-30T13:46:26.256 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:46:25 smithi181 ceph-mon[25762]: pgmap v58: 161 pgs: 161 active+clean; 585 KiB data, 69 MiB used, 715 GiB / 715 GiB avail; 631 B/s rd, 0 op/s 2024-03-30T13:46:26.337 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:46:25 smithi099 ceph-mon[24912]: pgmap v58: 161 pgs: 161 active+clean; 585 KiB data, 69 MiB used, 715 GiB / 715 GiB avail; 631 B/s rd, 0 op/s 2024-03-30T13:46:26.337 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:46:25 smithi099 ceph-mon[29691]: pgmap v58: 161 pgs: 161 active+clean; 585 KiB data, 69 MiB used, 715 GiB / 715 GiB avail; 631 B/s rd, 0 op/s 2024-03-30T13:46:27.006 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 13:46:26 smithi181 podman[57960]: 2024-03-30 13:46:26.717653502 +0000 UTC m=+1.091426139 container create c157dc0bbb42c0ef5f65147742324924b1c2950fafe7c47a8f22d7553e80f11a (image=quay.io/ceph/ceph-grafana:8.3.5, name=ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a, build-date=2022-03-28T10:36:18.413762, io.buildah.version=1.24.2, architecture=x86_64, io.openshift.expose-services=, vcs-ref=3aadd00326f3dd6cfe65ee31017ab98915fddb56, com.redhat.license_terms=https://www.redhat.com/en/about/red-hat-end-user-license-agreements#UBI, io.k8s.description=The Universal Base Image is designed and engineered to be the base layer for all of your containerized applications, middleware and utilities. This base image is freely redistributable, but Red Hat only supports Red Hat technologies through subscriptions for Red Hat products. This image is maintained by Red Hat and updated regularly., maintainer=Paul Cuzner , description=Ceph Grafana Container, com.redhat.build-host=cpt-1002.osbs.prod.upshift.rdu2.redhat.com, com.redhat.component=ubi8-container, summary=Grafana Container configured for Ceph mgr/dashboard integration, io.openshift.tags=base rhel8, name=ubi8, io.k8s.display-name=Red Hat Universal Base Image 8, url=https://access.redhat.com/containers/#/registry.access.redhat.com/ubi8/images/8.5-236.1648460182, vcs-type=git, distribution-scope=public, vendor=Red Hat, Inc., release=236.1648460182, version=8.5) 2024-03-30T13:46:27.006 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 13:46:26 smithi181 podman[57960]: 2024-03-30 13:46:26.920013668 +0000 UTC m=+1.293786316 container init c157dc0bbb42c0ef5f65147742324924b1c2950fafe7c47a8f22d7553e80f11a (image=quay.io/ceph/ceph-grafana:8.3.5, name=ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a, description=Ceph Grafana Container, io.buildah.version=1.24.2, distribution-scope=public, url=https://access.redhat.com/containers/#/registry.access.redhat.com/ubi8/images/8.5-236.1648460182, architecture=x86_64, com.redhat.component=ubi8-container, vendor=Red Hat, Inc., build-date=2022-03-28T10:36:18.413762, vcs-type=git, io.k8s.description=The Universal Base Image is designed and engineered to be the base layer for all of your containerized applications, middleware and utilities. This base image is freely redistributable, but Red Hat only supports Red Hat technologies through subscriptions for Red Hat products. This image is maintained by Red Hat and updated regularly., vcs-ref=3aadd00326f3dd6cfe65ee31017ab98915fddb56, com.redhat.license_terms=https://www.redhat.com/en/about/red-hat-end-user-license-agreements#UBI, version=8.5, io.k8s.display-name=Red Hat Universal Base Image 8, maintainer=Paul Cuzner , name=ubi8, summary=Grafana Container configured for Ceph mgr/dashboard integration, com.redhat.build-host=cpt-1002.osbs.prod.upshift.rdu2.redhat.com, io.openshift.expose-services=, io.openshift.tags=base rhel8, release=236.1648460182) 2024-03-30T13:46:27.006 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 13:46:26 smithi181 podman[57960]: 2024-03-30 13:46:26.922607888 +0000 UTC m=+1.296380522 container start c157dc0bbb42c0ef5f65147742324924b1c2950fafe7c47a8f22d7553e80f11a (image=quay.io/ceph/ceph-grafana:8.3.5, name=ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a, url=https://access.redhat.com/containers/#/registry.access.redhat.com/ubi8/images/8.5-236.1648460182, name=ubi8, description=Ceph Grafana Container, io.k8s.display-name=Red Hat Universal Base Image 8, vcs-ref=3aadd00326f3dd6cfe65ee31017ab98915fddb56, summary=Grafana Container configured for Ceph mgr/dashboard integration, io.k8s.description=The Universal Base Image is designed and engineered to be the base layer for all of your containerized applications, middleware and utilities. This base image is freely redistributable, but Red Hat only supports Red Hat technologies through subscriptions for Red Hat products. This image is maintained by Red Hat and updated regularly., com.redhat.build-host=cpt-1002.osbs.prod.upshift.rdu2.redhat.com, io.openshift.expose-services=, io.openshift.tags=base rhel8, release=236.1648460182, vcs-type=git, maintainer=Paul Cuzner , architecture=x86_64, com.redhat.component=ubi8-container, vendor=Red Hat, Inc., version=8.5, build-date=2022-03-28T10:36:18.413762, com.redhat.license_terms=https://www.redhat.com/en/about/red-hat-end-user-license-agreements#UBI, io.buildah.version=1.24.2, distribution-scope=public) 2024-03-30T13:46:27.007 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 13:46:26 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a[57985]: Failed to start grafana. error: failed to create log directory "/usr/share/grafana/data/log": mkdir /usr/share/grafana/data: permission denied 2024-03-30T13:46:27.007 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 13:46:26 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a[57985]: failed to create log directory "/usr/share/grafana/data/log": mkdir /usr/share/grafana/data: permission denied 2024-03-30T13:46:27.506 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 13:46:27 smithi181 bash[57960]: c157dc0bbb42c0ef5f65147742324924b1c2950fafe7c47a8f22d7553e80f11a 2024-03-30T13:46:27.506 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 13:46:27 smithi181 systemd[1]: Started Ceph grafana.a for 98ebaeb8-ee99-11ee-b647-cb9ed24678a4. 2024-03-30T13:46:27.843 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 13:46:27 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-x[50211]: ::ffff:172.21.15.181 - - [30/Mar/2024:13:46:27] "GET /metrics HTTP/1.1" 200 37963 "" "Prometheus/2.33.4" 2024-03-30T13:46:27.843 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 13:46:27 smithi181 podman[58006]: 2024-03-30 13:46:27.682545388 +0000 UTC m=+0.725412308 container remove c157dc0bbb42c0ef5f65147742324924b1c2950fafe7c47a8f22d7553e80f11a (image=quay.io/ceph/ceph-grafana:8.3.5, name=ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a, version=8.5, com.redhat.component=ubi8-container, description=Ceph Grafana Container, architecture=x86_64, vcs-ref=3aadd00326f3dd6cfe65ee31017ab98915fddb56, summary=Grafana Container configured for Ceph mgr/dashboard integration, distribution-scope=public, io.buildah.version=1.24.2, name=ubi8, io.k8s.description=The Universal Base Image is designed and engineered to be the base layer for all of your containerized applications, middleware and utilities. This base image is freely redistributable, but Red Hat only supports Red Hat technologies through subscriptions for Red Hat products. This image is maintained by Red Hat and updated regularly., maintainer=Paul Cuzner , vcs-type=git, url=https://access.redhat.com/containers/#/registry.access.redhat.com/ubi8/images/8.5-236.1648460182, vendor=Red Hat, Inc., io.k8s.display-name=Red Hat Universal Base Image 8, com.redhat.build-host=cpt-1002.osbs.prod.upshift.rdu2.redhat.com, io.openshift.expose-services=, build-date=2022-03-28T10:36:18.413762, release=236.1648460182, com.redhat.license_terms=https://www.redhat.com/en/about/red-hat-end-user-license-agreements#UBI, io.openshift.tags=base rhel8) 2024-03-30T13:46:27.843 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 13:46:27 smithi181 systemd[1]: ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4@grafana.a.service: Main process exited, code=exited, status=1/FAILURE 2024-03-30T13:46:27.843 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 13:46:27 smithi181 systemd[1]: ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4@grafana.a.service: Failed with result 'exit-code'. 2024-03-30T13:46:28.145 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:46:27 smithi181 ceph-mon[25762]: pgmap v59: 161 pgs: 161 active+clean; 585 KiB data, 69 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T13:46:28.337 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:46:27 smithi099 ceph-mon[24912]: pgmap v59: 161 pgs: 161 active+clean; 585 KiB data, 69 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T13:46:28.337 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:46:27 smithi099 ceph-mon[29691]: pgmap v59: 161 pgs: 161 active+clean; 585 KiB data, 69 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T13:46:28.924 INFO:journalctl@ceph.prometheus.a.smithi181.stdout:Mar 30 13:46:28 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-prometheus-a[55395]: ts=2024-03-30T13:46:28.660Z caller=manager.go:609 level=warn component="rule manager" group=osd msg="Evaluating rule failed" rule="alert: CephOSDFlapping\nexpr: (rate(ceph_osd_up[5m]) * on(ceph_daemon) group_left(hostname) ceph_osd_metadata)\n * 60 > 1\nlabels:\n oid: 1.3.6.1.4.1.50495.1.2.1.4.4\n severity: warning\n type: ceph_default\nannotations:\n description: OSD {{ $labels.ceph_daemon }} on {{ $labels.hostname }} was marked\n down and back up {{ $value | humanize }} times once a minute for 5 minutes. This\n may indicate a network issue (latency, packet loss, MTU mismatch) on the cluster\n network, or the public network if no cluster network is deployed. Check the network\n stats on the listed host(s).\n documentation: https://docs.ceph.com/en/latest/rados/troubleshooting/troubleshooting-osd#flapping-osds\n summary: Network issues are causing OSDs to flap (mark each other down)\n" err="found duplicate series for the match group {ceph_daemon=\"osd.0\"} on the right hand-side of the operation: [{__name__=\"ceph_osd_metadata\", ceph_daemon=\"osd.0\", ceph_version=\"ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)\", cluster_addr=\"172.21.15.99\", device_class=\"ssd\", hostname=\"smithi099\", instance=\"smithi181:9283\", job=\"ceph\", objectstore=\"bluestore\", public_addr=\"172.21.15.99\"}, {__name__=\"ceph_osd_metadata\", ceph_daemon=\"osd.0\", ceph_version=\"ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)\", cluster_addr=\"172.21.15.99\", device_class=\"ssd\", hostname=\"smithi099\", instance=\"172.21.15.181:9283\", job=\"ceph\", objectstore=\"bluestore\", public_addr=\"172.21.15.99\"}];many-to-many matching not allowed: matching labels must be unique on one side" 2024-03-30T13:46:29.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:46:28 smithi181 ceph-mon[25762]: from='client.24806 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T13:46:29.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:46:28 smithi181 ceph-mon[25762]: from='mgr.24746 ' entity='mgr.x' 2024-03-30T13:46:29.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:46:28 smithi181 ceph-mon[25762]: from='mgr.24746 ' entity='mgr.x' 2024-03-30T13:46:29.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:46:28 smithi181 ceph-mon[25762]: from='mgr.24746 ' entity='mgr.x' 2024-03-30T13:46:29.337 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:46:28 smithi099 ceph-mon[24912]: from='client.24806 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T13:46:29.337 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:46:28 smithi099 ceph-mon[24912]: from='mgr.24746 ' entity='mgr.x' 2024-03-30T13:46:29.337 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:46:28 smithi099 ceph-mon[24912]: from='mgr.24746 ' entity='mgr.x' 2024-03-30T13:46:29.337 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:46:28 smithi099 ceph-mon[24912]: from='mgr.24746 ' entity='mgr.x' 2024-03-30T13:46:29.337 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:46:28 smithi099 ceph-mon[29691]: from='client.24806 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T13:46:29.338 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:46:28 smithi099 ceph-mon[29691]: from='mgr.24746 ' entity='mgr.x' 2024-03-30T13:46:29.338 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:46:28 smithi099 ceph-mon[29691]: from='mgr.24746 ' entity='mgr.x' 2024-03-30T13:46:29.338 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:46:28 smithi099 ceph-mon[29691]: from='mgr.24746 ' entity='mgr.x' 2024-03-30T13:46:30.107 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:46:29 smithi181 ceph-mon[25762]: pgmap v60: 161 pgs: 161 active+clean; 585 KiB data, 69 MiB used, 715 GiB / 715 GiB avail; 650 B/s rd, 0 op/s 2024-03-30T13:46:30.107 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:46:29 smithi181 ceph-mon[25762]: pgmap v61: 161 pgs: 161 active+clean; 585 KiB data, 69 MiB used, 715 GiB / 715 GiB avail; 872 B/s rd, 0 op/s 2024-03-30T13:46:30.337 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:46:29 smithi099 ceph-mon[24912]: pgmap v60: 161 pgs: 161 active+clean; 585 KiB data, 69 MiB used, 715 GiB / 715 GiB avail; 650 B/s rd, 0 op/s 2024-03-30T13:46:30.337 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:46:29 smithi099 ceph-mon[24912]: pgmap v61: 161 pgs: 161 active+clean; 585 KiB data, 69 MiB used, 715 GiB / 715 GiB avail; 872 B/s rd, 0 op/s 2024-03-30T13:46:30.337 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:46:29 smithi099 ceph-mon[29691]: pgmap v60: 161 pgs: 161 active+clean; 585 KiB data, 69 MiB used, 715 GiB / 715 GiB avail; 650 B/s rd, 0 op/s 2024-03-30T13:46:30.337 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:46:29 smithi099 ceph-mon[29691]: pgmap v61: 161 pgs: 161 active+clean; 585 KiB data, 69 MiB used, 715 GiB / 715 GiB avail; 872 B/s rd, 0 op/s 2024-03-30T13:46:32.256 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:46:31 smithi181 ceph-mon[25762]: pgmap v62: 161 pgs: 161 active+clean; 585 KiB data, 69 MiB used, 715 GiB / 715 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-03-30T13:46:32.337 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:46:31 smithi099 ceph-mon[24912]: pgmap v62: 161 pgs: 161 active+clean; 585 KiB data, 69 MiB used, 715 GiB / 715 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-03-30T13:46:32.337 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:46:31 smithi099 ceph-mon[29691]: pgmap v62: 161 pgs: 161 active+clean; 585 KiB data, 69 MiB used, 715 GiB / 715 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-03-30T13:46:34.256 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:46:33 smithi181 ceph-mon[25762]: pgmap v63: 161 pgs: 161 active+clean; 585 KiB data, 69 MiB used, 715 GiB / 715 GiB avail; 1.0 KiB/s rd, 1 op/s 2024-03-30T13:46:34.337 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:46:33 smithi099 ceph-mon[24912]: pgmap v63: 161 pgs: 161 active+clean; 585 KiB data, 69 MiB used, 715 GiB / 715 GiB avail; 1.0 KiB/s rd, 1 op/s 2024-03-30T13:46:34.337 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:46:33 smithi099 ceph-mon[29691]: pgmap v63: 161 pgs: 161 active+clean; 585 KiB data, 69 MiB used, 715 GiB / 715 GiB avail; 1.0 KiB/s rd, 1 op/s 2024-03-30T13:46:35.256 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:46:34 smithi181 ceph-mon[25762]: from='mgr.24746 172.21.15.181:0/2892154077' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T13:46:35.285 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:46:34 smithi099 ceph-mon[24912]: from='mgr.24746 172.21.15.181:0/2892154077' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T13:46:35.286 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:46:34 smithi099 ceph-mon[29691]: from='mgr.24746 172.21.15.181:0/2892154077' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T13:46:36.256 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:46:35 smithi181 ceph-mon[25762]: pgmap v64: 161 pgs: 161 active+clean; 585 KiB data, 69 MiB used, 715 GiB / 715 GiB avail; 1.0 KiB/s rd, 1 op/s 2024-03-30T13:46:36.337 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:46:35 smithi099 ceph-mon[24912]: pgmap v64: 161 pgs: 161 active+clean; 585 KiB data, 69 MiB used, 715 GiB / 715 GiB avail; 1.0 KiB/s rd, 1 op/s 2024-03-30T13:46:36.337 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:46:35 smithi099 ceph-mon[29691]: pgmap v64: 161 pgs: 161 active+clean; 585 KiB data, 69 MiB used, 715 GiB / 715 GiB avail; 1.0 KiB/s rd, 1 op/s 2024-03-30T13:46:37.976 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 13:46:37 smithi181 systemd[1]: ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4@grafana.a.service: Scheduled restart job, restart counter is at 3. 2024-03-30T13:46:37.976 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 13:46:37 smithi181 systemd[1]: Stopped Ceph grafana.a for 98ebaeb8-ee99-11ee-b647-cb9ed24678a4. 2024-03-30T13:46:37.976 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 13:46:37 smithi181 systemd[1]: Starting Ceph grafana.a for 98ebaeb8-ee99-11ee-b647-cb9ed24678a4... 2024-03-30T13:46:37.976 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 13:46:37 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-x[50211]: ::ffff:172.21.15.181 - - [30/Mar/2024:13:46:37] "GET /metrics HTTP/1.1" 200 37963 "" "Prometheus/2.33.4" 2024-03-30T13:46:38.148 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:46:37 smithi099 ceph-mon[24912]: pgmap v65: 161 pgs: 161 active+clean; 585 KiB data, 69 MiB used, 715 GiB / 715 GiB avail; 1.0 KiB/s rd, 1 op/s 2024-03-30T13:46:38.148 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:46:37 smithi099 ceph-mon[29691]: pgmap v65: 161 pgs: 161 active+clean; 585 KiB data, 69 MiB used, 715 GiB / 715 GiB avail; 1.0 KiB/s rd, 1 op/s 2024-03-30T13:46:38.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:46:37 smithi181 ceph-mon[25762]: pgmap v65: 161 pgs: 161 active+clean; 585 KiB data, 69 MiB used, 715 GiB / 715 GiB avail; 1.0 KiB/s rd, 1 op/s 2024-03-30T13:46:38.251 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 13:46:37 smithi181 podman[58270]: 2024-03-30 13:46:37.899726913 +0000 UTC m=+0.017990517 image pull dad864ee21e98e69f4029d1e417aa085001566be0d322fbc75bc6f29b0050c01 quay.io/ceph/ceph-grafana:8.3.5 2024-03-30T13:46:38.252 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 13:46:38 smithi181 podman[58270]: 2024-03-30 13:46:38.023201644 +0000 UTC m=+0.141465229 container create 4b3a19b968ae0fc0c28f99b9ba2869c06ab8eff754788397acf256a1c792dfa3 (image=quay.io/ceph/ceph-grafana:8.3.5, name=ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a, url=https://access.redhat.com/containers/#/registry.access.redhat.com/ubi8/images/8.5-236.1648460182, io.k8s.display-name=Red Hat Universal Base Image 8, summary=Grafana Container configured for Ceph mgr/dashboard integration, io.openshift.tags=base rhel8, build-date=2022-03-28T10:36:18.413762, name=ubi8, vendor=Red Hat, Inc., maintainer=Paul Cuzner , vcs-ref=3aadd00326f3dd6cfe65ee31017ab98915fddb56, com.redhat.license_terms=https://www.redhat.com/en/about/red-hat-end-user-license-agreements#UBI, vcs-type=git, distribution-scope=public, io.openshift.expose-services=, io.k8s.description=The Universal Base Image is designed and engineered to be the base layer for all of your containerized applications, middleware and utilities. This base image is freely redistributable, but Red Hat only supports Red Hat technologies through subscriptions for Red Hat products. This image is maintained by Red Hat and updated regularly., description=Ceph Grafana Container, release=236.1648460182, com.redhat.build-host=cpt-1002.osbs.prod.upshift.rdu2.redhat.com, version=8.5, io.buildah.version=1.24.2, com.redhat.component=ubi8-container, architecture=x86_64) 2024-03-30T13:46:38.506 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 13:46:38 smithi181 podman[58270]: 2024-03-30 13:46:38.250592767 +0000 UTC m=+0.368856360 container init 4b3a19b968ae0fc0c28f99b9ba2869c06ab8eff754788397acf256a1c792dfa3 (image=quay.io/ceph/ceph-grafana:8.3.5, name=ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a, url=https://access.redhat.com/containers/#/registry.access.redhat.com/ubi8/images/8.5-236.1648460182, maintainer=Paul Cuzner , com.redhat.license_terms=https://www.redhat.com/en/about/red-hat-end-user-license-agreements#UBI, io.openshift.expose-services=, release=236.1648460182, build-date=2022-03-28T10:36:18.413762, vcs-type=git, version=8.5, name=ubi8, distribution-scope=public, io.k8s.description=The Universal Base Image is designed and engineered to be the base layer for all of your containerized applications, middleware and utilities. This base image is freely redistributable, but Red Hat only supports Red Hat technologies through subscriptions for Red Hat products. This image is maintained by Red Hat and updated regularly., com.redhat.build-host=cpt-1002.osbs.prod.upshift.rdu2.redhat.com, description=Ceph Grafana Container, io.openshift.tags=base rhel8, io.k8s.display-name=Red Hat Universal Base Image 8, io.buildah.version=1.24.2, architecture=x86_64, vendor=Red Hat, Inc., com.redhat.component=ubi8-container, vcs-ref=3aadd00326f3dd6cfe65ee31017ab98915fddb56, summary=Grafana Container configured for Ceph mgr/dashboard integration) 2024-03-30T13:46:38.507 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 13:46:38 smithi181 podman[58270]: 2024-03-30 13:46:38.253537051 +0000 UTC m=+0.371800645 container start 4b3a19b968ae0fc0c28f99b9ba2869c06ab8eff754788397acf256a1c792dfa3 (image=quay.io/ceph/ceph-grafana:8.3.5, name=ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a, vendor=Red Hat, Inc., com.redhat.build-host=cpt-1002.osbs.prod.upshift.rdu2.redhat.com, release=236.1648460182, maintainer=Paul Cuzner , com.redhat.license_terms=https://www.redhat.com/en/about/red-hat-end-user-license-agreements#UBI, architecture=x86_64, io.openshift.expose-services=, url=https://access.redhat.com/containers/#/registry.access.redhat.com/ubi8/images/8.5-236.1648460182, vcs-type=git, io.k8s.display-name=Red Hat Universal Base Image 8, version=8.5, summary=Grafana Container configured for Ceph mgr/dashboard integration, io.buildah.version=1.24.2, io.k8s.description=The Universal Base Image is designed and engineered to be the base layer for all of your containerized applications, middleware and utilities. This base image is freely redistributable, but Red Hat only supports Red Hat technologies through subscriptions for Red Hat products. This image is maintained by Red Hat and updated regularly., vcs-ref=3aadd00326f3dd6cfe65ee31017ab98915fddb56, io.openshift.tags=base rhel8, distribution-scope=public, description=Ceph Grafana Container, build-date=2022-03-28T10:36:18.413762, name=ubi8, com.redhat.component=ubi8-container) 2024-03-30T13:46:38.507 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 13:46:38 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a[58285]: Failed to start grafana. error: failed to create log directory "/usr/share/grafana/data/log": mkdir /usr/share/grafana/data: permission denied 2024-03-30T13:46:38.507 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 13:46:38 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a[58285]: failed to create log directory "/usr/share/grafana/data/log": mkdir /usr/share/grafana/data: permission denied 2024-03-30T13:46:38.507 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 13:46:38 smithi181 bash[58270]: 4b3a19b968ae0fc0c28f99b9ba2869c06ab8eff754788397acf256a1c792dfa3 2024-03-30T13:46:38.507 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 13:46:38 smithi181 systemd[1]: Started Ceph grafana.a for 98ebaeb8-ee99-11ee-b647-cb9ed24678a4. 2024-03-30T13:46:38.507 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 13:46:38 smithi181 podman[58302]: 2024-03-30 13:46:38.386347645 +0000 UTC m=+0.097511523 container died 4b3a19b968ae0fc0c28f99b9ba2869c06ab8eff754788397acf256a1c792dfa3 (image=quay.io/ceph/ceph-grafana:8.3.5, name=ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a, summary=Grafana Container configured for Ceph mgr/dashboard integration, vendor=Red Hat, Inc., vcs-ref=3aadd00326f3dd6cfe65ee31017ab98915fddb56, version=8.5, com.redhat.component=ubi8-container, distribution-scope=public, io.k8s.description=The Universal Base Image is designed and engineered to be the base layer for all of your containerized applications, middleware and utilities. This base image is freely redistributable, but Red Hat only supports Red Hat technologies through subscriptions for Red Hat products. This image is maintained by Red Hat and updated regularly., io.openshift.expose-services=, url=https://access.redhat.com/containers/#/registry.access.redhat.com/ubi8/images/8.5-236.1648460182, build-date=2022-03-28T10:36:18.413762, io.k8s.display-name=Red Hat Universal Base Image 8, maintainer=Paul Cuzner , name=ubi8, vcs-type=git, architecture=x86_64, io.buildah.version=1.24.2, com.redhat.license_terms=https://www.redhat.com/en/about/red-hat-end-user-license-agreements#UBI, com.redhat.build-host=cpt-1002.osbs.prod.upshift.rdu2.redhat.com, release=236.1648460182, description=Ceph Grafana Container, io.openshift.tags=base rhel8) 2024-03-30T13:46:38.963 INFO:journalctl@ceph.prometheus.a.smithi181.stdout:Mar 30 13:46:38 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-prometheus-a[55395]: ts=2024-03-30T13:46:38.660Z caller=manager.go:609 level=warn component="rule manager" group=osd msg="Evaluating rule failed" rule="alert: CephOSDFlapping\nexpr: (rate(ceph_osd_up[5m]) * on(ceph_daemon) group_left(hostname) ceph_osd_metadata)\n * 60 > 1\nlabels:\n oid: 1.3.6.1.4.1.50495.1.2.1.4.4\n severity: warning\n type: ceph_default\nannotations:\n description: OSD {{ $labels.ceph_daemon }} on {{ $labels.hostname }} was marked\n down and back up {{ $value | humanize }} times once a minute for 5 minutes. This\n may indicate a network issue (latency, packet loss, MTU mismatch) on the cluster\n network, or the public network if no cluster network is deployed. Check the network\n stats on the listed host(s).\n documentation: https://docs.ceph.com/en/latest/rados/troubleshooting/troubleshooting-osd#flapping-osds\n summary: Network issues are causing OSDs to flap (mark each other down)\n" err="found duplicate series for the match group {ceph_daemon=\"osd.0\"} on the right hand-side of the operation: [{__name__=\"ceph_osd_metadata\", ceph_daemon=\"osd.0\", ceph_version=\"ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)\", cluster_addr=\"172.21.15.99\", device_class=\"ssd\", hostname=\"smithi099\", instance=\"smithi181:9283\", job=\"ceph\", objectstore=\"bluestore\", public_addr=\"172.21.15.99\"}, {__name__=\"ceph_osd_metadata\", ceph_daemon=\"osd.0\", ceph_version=\"ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)\", cluster_addr=\"172.21.15.99\", device_class=\"ssd\", hostname=\"smithi099\", instance=\"172.21.15.181:9283\", job=\"ceph\", objectstore=\"bluestore\", public_addr=\"172.21.15.99\"}];many-to-many matching not allowed: matching labels must be unique on one side" 2024-03-30T13:46:39.256 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:46:39 smithi181 ceph-mon[25762]: from='client.24806 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T13:46:39.256 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:46:39 smithi181 ceph-mon[25762]: from='mgr.24746 ' entity='mgr.x' 2024-03-30T13:46:39.256 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:46:39 smithi181 ceph-mon[25762]: from='mgr.24746 ' entity='mgr.x' 2024-03-30T13:46:39.256 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:46:39 smithi181 ceph-mon[25762]: pgmap v66: 161 pgs: 161 active+clean; 585 KiB data, 69 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-03-30T13:46:39.256 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:46:39 smithi181 ceph-mon[25762]: pgmap v67: 161 pgs: 161 active+clean; 585 KiB data, 69 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-03-30T13:46:39.256 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:46:39 smithi181 ceph-mon[25762]: from='mgr.24746 ' entity='mgr.x' 2024-03-30T13:46:39.257 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 13:46:38 smithi181 podman[58302]: 2024-03-30 13:46:38.962926441 +0000 UTC m=+0.674090319 container remove 4b3a19b968ae0fc0c28f99b9ba2869c06ab8eff754788397acf256a1c792dfa3 (image=quay.io/ceph/ceph-grafana:8.3.5, name=ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a, io.openshift.tags=base rhel8, vcs-ref=3aadd00326f3dd6cfe65ee31017ab98915fddb56, distribution-scope=public, name=ubi8, summary=Grafana Container configured for Ceph mgr/dashboard integration, url=https://access.redhat.com/containers/#/registry.access.redhat.com/ubi8/images/8.5-236.1648460182, vendor=Red Hat, Inc., version=8.5, release=236.1648460182, build-date=2022-03-28T10:36:18.413762, vcs-type=git, architecture=x86_64, io.openshift.expose-services=, description=Ceph Grafana Container, com.redhat.component=ubi8-container, io.buildah.version=1.24.2, maintainer=Paul Cuzner , com.redhat.license_terms=https://www.redhat.com/en/about/red-hat-end-user-license-agreements#UBI, com.redhat.build-host=cpt-1002.osbs.prod.upshift.rdu2.redhat.com, io.k8s.description=The Universal Base Image is designed and engineered to be the base layer for all of your containerized applications, middleware and utilities. This base image is freely redistributable, but Red Hat only supports Red Hat technologies through subscriptions for Red Hat products. This image is maintained by Red Hat and updated regularly., io.k8s.display-name=Red Hat Universal Base Image 8) 2024-03-30T13:46:39.257 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 13:46:38 smithi181 systemd[1]: ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4@grafana.a.service: Main process exited, code=exited, status=1/FAILURE 2024-03-30T13:46:39.257 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 13:46:38 smithi181 systemd[1]: ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4@grafana.a.service: Failed with result 'exit-code'. 2024-03-30T13:46:39.460 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:46:39 smithi099 ceph-mon[24912]: from='client.24806 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T13:46:39.460 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:46:39 smithi099 ceph-mon[24912]: from='mgr.24746 ' entity='mgr.x' 2024-03-30T13:46:39.460 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:46:39 smithi099 ceph-mon[24912]: from='mgr.24746 ' entity='mgr.x' 2024-03-30T13:46:39.460 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:46:39 smithi099 ceph-mon[24912]: pgmap v66: 161 pgs: 161 active+clean; 585 KiB data, 69 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-03-30T13:46:39.460 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:46:39 smithi099 ceph-mon[24912]: pgmap v67: 161 pgs: 161 active+clean; 585 KiB data, 69 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-03-30T13:46:39.461 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:46:39 smithi099 ceph-mon[24912]: from='mgr.24746 ' entity='mgr.x' 2024-03-30T13:46:39.461 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:46:39 smithi099 ceph-mon[29691]: from='client.24806 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T13:46:39.461 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:46:39 smithi099 ceph-mon[29691]: from='mgr.24746 ' entity='mgr.x' 2024-03-30T13:46:39.461 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:46:39 smithi099 ceph-mon[29691]: from='mgr.24746 ' entity='mgr.x' 2024-03-30T13:46:39.461 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:46:39 smithi099 ceph-mon[29691]: pgmap v66: 161 pgs: 161 active+clean; 585 KiB data, 69 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-03-30T13:46:39.461 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:46:39 smithi099 ceph-mon[29691]: pgmap v67: 161 pgs: 161 active+clean; 585 KiB data, 69 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-03-30T13:46:39.461 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:46:39 smithi099 ceph-mon[29691]: from='mgr.24746 ' entity='mgr.x' 2024-03-30T13:46:41.506 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:46:41 smithi181 ceph-mon[25762]: pgmap v68: 161 pgs: 161 active+clean; 585 KiB data, 69 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-03-30T13:46:41.587 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:46:41 smithi099 ceph-mon[24912]: pgmap v68: 161 pgs: 161 active+clean; 585 KiB data, 69 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-03-30T13:46:41.587 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:46:41 smithi099 ceph-mon[29691]: pgmap v68: 161 pgs: 161 active+clean; 585 KiB data, 69 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-03-30T13:46:43.506 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:46:43 smithi181 ceph-mon[25762]: pgmap v69: 161 pgs: 161 active+clean; 585 KiB data, 69 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-03-30T13:46:43.587 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:46:43 smithi099 ceph-mon[24912]: pgmap v69: 161 pgs: 161 active+clean; 585 KiB data, 69 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-03-30T13:46:43.587 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:46:43 smithi099 ceph-mon[29691]: pgmap v69: 161 pgs: 161 active+clean; 585 KiB data, 69 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-03-30T13:46:45.006 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:46:44 smithi181 ceph-mon[25762]: pgmap v70: 161 pgs: 161 active+clean; 585 KiB data, 69 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-03-30T13:46:45.087 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:46:44 smithi099 ceph-mon[24912]: pgmap v70: 161 pgs: 161 active+clean; 585 KiB data, 69 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-03-30T13:46:45.087 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:46:44 smithi099 ceph-mon[29691]: pgmap v70: 161 pgs: 161 active+clean; 585 KiB data, 69 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-03-30T13:46:47.506 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:46:47 smithi181 ceph-mon[25762]: pgmap v71: 161 pgs: 161 active+clean; 585 KiB data, 69 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-03-30T13:46:47.587 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:46:47 smithi099 ceph-mon[24912]: pgmap v71: 161 pgs: 161 active+clean; 585 KiB data, 69 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-03-30T13:46:47.587 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:46:47 smithi099 ceph-mon[29691]: pgmap v71: 161 pgs: 161 active+clean; 585 KiB data, 69 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-03-30T13:46:48.006 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 13:46:47 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-x[50211]: ::ffff:172.21.15.181 - - [30/Mar/2024:13:46:47] "GET /metrics HTTP/1.1" 200 37963 "" "Prometheus/2.33.4" 2024-03-30T13:46:48.756 INFO:journalctl@ceph.prometheus.a.smithi181.stdout:Mar 30 13:46:48 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-prometheus-a[55395]: ts=2024-03-30T13:46:48.660Z caller=manager.go:609 level=warn component="rule manager" group=osd msg="Evaluating rule failed" rule="alert: CephOSDFlapping\nexpr: (rate(ceph_osd_up[5m]) * on(ceph_daemon) group_left(hostname) ceph_osd_metadata)\n * 60 > 1\nlabels:\n oid: 1.3.6.1.4.1.50495.1.2.1.4.4\n severity: warning\n type: ceph_default\nannotations:\n description: OSD {{ $labels.ceph_daemon }} on {{ $labels.hostname }} was marked\n down and back up {{ $value | humanize }} times once a minute for 5 minutes. This\n may indicate a network issue (latency, packet loss, MTU mismatch) on the cluster\n network, or the public network if no cluster network is deployed. Check the network\n stats on the listed host(s).\n documentation: https://docs.ceph.com/en/latest/rados/troubleshooting/troubleshooting-osd#flapping-osds\n summary: Network issues are causing OSDs to flap (mark each other down)\n" err="found duplicate series for the match group {ceph_daemon=\"osd.0\"} on the right hand-side of the operation: [{__name__=\"ceph_osd_metadata\", ceph_daemon=\"osd.0\", ceph_version=\"ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)\", cluster_addr=\"172.21.15.99\", device_class=\"ssd\", hostname=\"smithi099\", instance=\"smithi181:9283\", job=\"ceph\", objectstore=\"bluestore\", public_addr=\"172.21.15.99\"}, {__name__=\"ceph_osd_metadata\", ceph_daemon=\"osd.0\", ceph_version=\"ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)\", cluster_addr=\"172.21.15.99\", device_class=\"ssd\", hostname=\"smithi099\", instance=\"172.21.15.181:9283\", job=\"ceph\", objectstore=\"bluestore\", public_addr=\"172.21.15.99\"}];many-to-many matching not allowed: matching labels must be unique on one side" 2024-03-30T13:46:49.128 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 13:46:49 smithi181 systemd[1]: ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4@grafana.a.service: Scheduled restart job, restart counter is at 4. 2024-03-30T13:46:49.128 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 13:46:49 smithi181 systemd[1]: Stopped Ceph grafana.a for 98ebaeb8-ee99-11ee-b647-cb9ed24678a4. 2024-03-30T13:46:49.129 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 13:46:49 smithi181 systemd[1]: Starting Ceph grafana.a for 98ebaeb8-ee99-11ee-b647-cb9ed24678a4... 2024-03-30T13:46:49.487 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:46:49 smithi181 ceph-mon[25762]: from='client.24806 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T13:46:49.488 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:46:49 smithi181 ceph-mon[25762]: pgmap v72: 161 pgs: 161 active+clean; 585 KiB data, 69 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-03-30T13:46:49.488 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:46:49 smithi181 ceph-mon[25762]: from='mgr.24746 ' entity='mgr.x' 2024-03-30T13:46:49.488 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:46:49 smithi181 ceph-mon[25762]: from='mgr.24746 ' entity='mgr.x' 2024-03-30T13:46:49.488 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:46:49 smithi181 ceph-mon[25762]: from='mgr.24746 ' entity='mgr.x' 2024-03-30T13:46:49.488 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:46:49 smithi181 ceph-mon[25762]: from='mgr.24746 172.21.15.181:0/2892154077' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T13:46:49.587 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:46:49 smithi099 ceph-mon[29691]: from='client.24806 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T13:46:49.587 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:46:49 smithi099 ceph-mon[29691]: pgmap v72: 161 pgs: 161 active+clean; 585 KiB data, 69 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-03-30T13:46:49.587 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:46:49 smithi099 ceph-mon[29691]: from='mgr.24746 ' entity='mgr.x' 2024-03-30T13:46:49.587 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:46:49 smithi099 ceph-mon[29691]: from='mgr.24746 ' entity='mgr.x' 2024-03-30T13:46:49.587 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:46:49 smithi099 ceph-mon[29691]: from='mgr.24746 ' entity='mgr.x' 2024-03-30T13:46:49.588 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:46:49 smithi099 ceph-mon[29691]: from='mgr.24746 172.21.15.181:0/2892154077' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T13:46:49.588 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:46:49 smithi099 ceph-mon[24912]: from='client.24806 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T13:46:49.588 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:46:49 smithi099 ceph-mon[24912]: pgmap v72: 161 pgs: 161 active+clean; 585 KiB data, 69 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-03-30T13:46:49.588 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:46:49 smithi099 ceph-mon[24912]: from='mgr.24746 ' entity='mgr.x' 2024-03-30T13:46:49.588 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:46:49 smithi099 ceph-mon[24912]: from='mgr.24746 ' entity='mgr.x' 2024-03-30T13:46:49.588 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:46:49 smithi099 ceph-mon[24912]: from='mgr.24746 ' entity='mgr.x' 2024-03-30T13:46:49.588 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:46:49 smithi099 ceph-mon[24912]: from='mgr.24746 172.21.15.181:0/2892154077' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T13:46:49.756 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 13:46:49 smithi181 podman[58529]: 2024-03-30 13:46:49.56895282 +0000 UTC m=+0.018495412 image pull dad864ee21e98e69f4029d1e417aa085001566be0d322fbc75bc6f29b0050c01 quay.io/ceph/ceph-grafana:8.3.5 2024-03-30T13:46:50.048 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 13:46:49 smithi181 podman[58529]: 2024-03-30 13:46:49.907306723 +0000 UTC m=+0.356849302 container create 0408452bb9a0a3bde2541a8683e6c2a7c4b40958fa07363721270c72fc3a3663 (image=quay.io/ceph/ceph-grafana:8.3.5, name=ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a, com.redhat.build-host=cpt-1002.osbs.prod.upshift.rdu2.redhat.com, com.redhat.license_terms=https://www.redhat.com/en/about/red-hat-end-user-license-agreements#UBI, summary=Grafana Container configured for Ceph mgr/dashboard integration, io.k8s.display-name=Red Hat Universal Base Image 8, io.openshift.tags=base rhel8, release=236.1648460182, vcs-type=git, com.redhat.component=ubi8-container, distribution-scope=public, architecture=x86_64, vcs-ref=3aadd00326f3dd6cfe65ee31017ab98915fddb56, name=ubi8, io.k8s.description=The Universal Base Image is designed and engineered to be the base layer for all of your containerized applications, middleware and utilities. This base image is freely redistributable, but Red Hat only supports Red Hat technologies through subscriptions for Red Hat products. This image is maintained by Red Hat and updated regularly., io.openshift.expose-services=, vendor=Red Hat, Inc., description=Ceph Grafana Container, url=https://access.redhat.com/containers/#/registry.access.redhat.com/ubi8/images/8.5-236.1648460182, io.buildah.version=1.24.2, build-date=2022-03-28T10:36:18.413762, version=8.5, maintainer=Paul Cuzner ) 2024-03-30T13:46:50.437 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:46:50 smithi181 ceph-mon[25762]: pgmap v73: 161 pgs: 161 active+clean; 585 KiB data, 69 MiB used, 715 GiB / 715 GiB avail; 959 B/s rd, 0 op/s 2024-03-30T13:46:50.437 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:46:50 smithi181 ceph-mon[25762]: pgmap v74: 161 pgs: 161 active+clean; 585 KiB data, 69 MiB used, 715 GiB / 715 GiB avail; 590 B/s rd, 0 op/s 2024-03-30T13:46:50.438 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 13:46:50 smithi181 podman[58529]: 2024-03-30 13:46:50.252438984 +0000 UTC m=+0.701981565 container init 0408452bb9a0a3bde2541a8683e6c2a7c4b40958fa07363721270c72fc3a3663 (image=quay.io/ceph/ceph-grafana:8.3.5, name=ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a, vcs-type=git, version=8.5, com.redhat.build-host=cpt-1002.osbs.prod.upshift.rdu2.redhat.com, description=Ceph Grafana Container, io.openshift.tags=base rhel8, summary=Grafana Container configured for Ceph mgr/dashboard integration, release=236.1648460182, com.redhat.license_terms=https://www.redhat.com/en/about/red-hat-end-user-license-agreements#UBI, maintainer=Paul Cuzner , build-date=2022-03-28T10:36:18.413762, io.openshift.expose-services=, com.redhat.component=ubi8-container, vendor=Red Hat, Inc., io.k8s.display-name=Red Hat Universal Base Image 8, url=https://access.redhat.com/containers/#/registry.access.redhat.com/ubi8/images/8.5-236.1648460182, architecture=x86_64, io.k8s.description=The Universal Base Image is designed and engineered to be the base layer for all of your containerized applications, middleware and utilities. This base image is freely redistributable, but Red Hat only supports Red Hat technologies through subscriptions for Red Hat products. This image is maintained by Red Hat and updated regularly., distribution-scope=public, vcs-ref=3aadd00326f3dd6cfe65ee31017ab98915fddb56, name=ubi8, io.buildah.version=1.24.2) 2024-03-30T13:46:50.438 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 13:46:50 smithi181 podman[58529]: 2024-03-30 13:46:50.255032257 +0000 UTC m=+0.704574837 container start 0408452bb9a0a3bde2541a8683e6c2a7c4b40958fa07363721270c72fc3a3663 (image=quay.io/ceph/ceph-grafana:8.3.5, name=ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a, architecture=x86_64, version=8.5, maintainer=Paul Cuzner , description=Ceph Grafana Container, summary=Grafana Container configured for Ceph mgr/dashboard integration, io.buildah.version=1.24.2, io.openshift.tags=base rhel8, name=ubi8, com.redhat.license_terms=https://www.redhat.com/en/about/red-hat-end-user-license-agreements#UBI, vcs-ref=3aadd00326f3dd6cfe65ee31017ab98915fddb56, vcs-type=git, vendor=Red Hat, Inc., com.redhat.build-host=cpt-1002.osbs.prod.upshift.rdu2.redhat.com, io.openshift.expose-services=, distribution-scope=public, url=https://access.redhat.com/containers/#/registry.access.redhat.com/ubi8/images/8.5-236.1648460182, io.k8s.description=The Universal Base Image is designed and engineered to be the base layer for all of your containerized applications, middleware and utilities. This base image is freely redistributable, but Red Hat only supports Red Hat technologies through subscriptions for Red Hat products. This image is maintained by Red Hat and updated regularly., build-date=2022-03-28T10:36:18.413762, release=236.1648460182, io.k8s.display-name=Red Hat Universal Base Image 8, com.redhat.component=ubi8-container) 2024-03-30T13:46:50.438 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 13:46:50 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a[58553]: Failed to start grafana. error: failed to create log directory "/usr/share/grafana/data/log": mkdir /usr/share/grafana/data: permission denied 2024-03-30T13:46:50.438 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 13:46:50 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a[58553]: failed to create log directory "/usr/share/grafana/data/log": mkdir /usr/share/grafana/data: permission denied 2024-03-30T13:46:50.438 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 13:46:50 smithi181 bash[58529]: 0408452bb9a0a3bde2541a8683e6c2a7c4b40958fa07363721270c72fc3a3663 2024-03-30T13:46:50.438 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 13:46:50 smithi181 systemd[1]: Started Ceph grafana.a for 98ebaeb8-ee99-11ee-b647-cb9ed24678a4. 2024-03-30T13:46:50.587 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:46:50 smithi099 ceph-mon[24912]: pgmap v73: 161 pgs: 161 active+clean; 585 KiB data, 69 MiB used, 715 GiB / 715 GiB avail; 959 B/s rd, 0 op/s 2024-03-30T13:46:50.587 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:46:50 smithi099 ceph-mon[24912]: pgmap v74: 161 pgs: 161 active+clean; 585 KiB data, 69 MiB used, 715 GiB / 715 GiB avail; 590 B/s rd, 0 op/s 2024-03-30T13:46:50.587 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:46:50 smithi099 ceph-mon[29691]: pgmap v73: 161 pgs: 161 active+clean; 585 KiB data, 69 MiB used, 715 GiB / 715 GiB avail; 959 B/s rd, 0 op/s 2024-03-30T13:46:50.587 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:46:50 smithi099 ceph-mon[29691]: pgmap v74: 161 pgs: 161 active+clean; 585 KiB data, 69 MiB used, 715 GiB / 715 GiB avail; 590 B/s rd, 0 op/s 2024-03-30T13:46:50.756 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 13:46:50 smithi181 podman[58571]: 2024-03-30 13:46:50.490024103 +0000 UTC m=+0.199325966 container died 0408452bb9a0a3bde2541a8683e6c2a7c4b40958fa07363721270c72fc3a3663 (image=quay.io/ceph/ceph-grafana:8.3.5, name=ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a, name=ubi8, description=Ceph Grafana Container, io.openshift.expose-services=, release=236.1648460182, vendor=Red Hat, Inc., maintainer=Paul Cuzner , com.redhat.license_terms=https://www.redhat.com/en/about/red-hat-end-user-license-agreements#UBI, io.openshift.tags=base rhel8, com.redhat.build-host=cpt-1002.osbs.prod.upshift.rdu2.redhat.com, io.k8s.display-name=Red Hat Universal Base Image 8, distribution-scope=public, io.buildah.version=1.24.2, io.k8s.description=The Universal Base Image is designed and engineered to be the base layer for all of your containerized applications, middleware and utilities. This base image is freely redistributable, but Red Hat only supports Red Hat technologies through subscriptions for Red Hat products. This image is maintained by Red Hat and updated regularly., vcs-type=git, architecture=x86_64, url=https://access.redhat.com/containers/#/registry.access.redhat.com/ubi8/images/8.5-236.1648460182, build-date=2022-03-28T10:36:18.413762, vcs-ref=3aadd00326f3dd6cfe65ee31017ab98915fddb56, com.redhat.component=ubi8-container, version=8.5, summary=Grafana Container configured for Ceph mgr/dashboard integration) 2024-03-30T13:46:51.378 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 13:46:51 smithi181 podman[58571]: 2024-03-30 13:46:51.048714086 +0000 UTC m=+0.758015943 container remove 0408452bb9a0a3bde2541a8683e6c2a7c4b40958fa07363721270c72fc3a3663 (image=quay.io/ceph/ceph-grafana:8.3.5, name=ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a, com.redhat.component=ubi8-container, url=https://access.redhat.com/containers/#/registry.access.redhat.com/ubi8/images/8.5-236.1648460182, build-date=2022-03-28T10:36:18.413762, description=Ceph Grafana Container, name=ubi8, io.k8s.description=The Universal Base Image is designed and engineered to be the base layer for all of your containerized applications, middleware and utilities. This base image is freely redistributable, but Red Hat only supports Red Hat technologies through subscriptions for Red Hat products. This image is maintained by Red Hat and updated regularly., io.openshift.expose-services=, vendor=Red Hat, Inc., io.k8s.display-name=Red Hat Universal Base Image 8, com.redhat.license_terms=https://www.redhat.com/en/about/red-hat-end-user-license-agreements#UBI, summary=Grafana Container configured for Ceph mgr/dashboard integration, version=8.5, io.buildah.version=1.24.2, maintainer=Paul Cuzner , release=236.1648460182, io.openshift.tags=base rhel8, vcs-ref=3aadd00326f3dd6cfe65ee31017ab98915fddb56, architecture=x86_64, com.redhat.build-host=cpt-1002.osbs.prod.upshift.rdu2.redhat.com, distribution-scope=public, vcs-type=git) 2024-03-30T13:46:51.378 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 13:46:51 smithi181 systemd[1]: ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4@grafana.a.service: Main process exited, code=exited, status=1/FAILURE 2024-03-30T13:46:51.378 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 13:46:51 smithi181 systemd[1]: ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4@grafana.a.service: Failed with result 'exit-code'. 2024-03-30T13:46:52.506 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:46:52 smithi181 ceph-mon[25762]: pgmap v75: 161 pgs: 161 active+clean; 585 KiB data, 69 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T13:46:52.587 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:46:52 smithi099 ceph-mon[29691]: pgmap v75: 161 pgs: 161 active+clean; 585 KiB data, 69 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T13:46:52.588 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:46:52 smithi099 ceph-mon[24912]: pgmap v75: 161 pgs: 161 active+clean; 585 KiB data, 69 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T13:46:54.506 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:46:54 smithi181 ceph-mon[25762]: pgmap v76: 161 pgs: 161 active+clean; 585 KiB data, 69 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T13:46:54.587 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:46:54 smithi099 ceph-mon[24912]: pgmap v76: 161 pgs: 161 active+clean; 585 KiB data, 69 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T13:46:54.587 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:46:54 smithi099 ceph-mon[29691]: pgmap v76: 161 pgs: 161 active+clean; 585 KiB data, 69 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T13:46:56.506 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:46:56 smithi181 ceph-mon[25762]: pgmap v77: 161 pgs: 161 active+clean; 585 KiB data, 69 MiB used, 715 GiB / 715 GiB avail; 590 B/s rd, 0 op/s 2024-03-30T13:46:56.587 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:46:56 smithi099 ceph-mon[24912]: pgmap v77: 161 pgs: 161 active+clean; 585 KiB data, 69 MiB used, 715 GiB / 715 GiB avail; 590 B/s rd, 0 op/s 2024-03-30T13:46:56.587 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:46:56 smithi099 ceph-mon[29691]: pgmap v77: 161 pgs: 161 active+clean; 585 KiB data, 69 MiB used, 715 GiB / 715 GiB avail; 590 B/s rd, 0 op/s 2024-03-30T13:46:58.006 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 13:46:57 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-x[50211]: ::ffff:172.21.15.181 - - [30/Mar/2024:13:46:57] "GET /metrics HTTP/1.1" 200 37961 "" "Prometheus/2.33.4" 2024-03-30T13:46:58.283 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:46:58 smithi099 ceph-mon[24912]: pgmap v78: 161 pgs: 161 active+clean; 585 KiB data, 69 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T13:46:58.283 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:46:58 smithi099 ceph-mon[29691]: pgmap v78: 161 pgs: 161 active+clean; 585 KiB data, 69 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T13:46:58.506 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:46:58 smithi181 ceph-mon[25762]: pgmap v78: 161 pgs: 161 active+clean; 585 KiB data, 69 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T13:46:59.006 INFO:journalctl@ceph.prometheus.a.smithi181.stdout:Mar 30 13:46:58 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-prometheus-a[55395]: ts=2024-03-30T13:46:58.660Z caller=manager.go:609 level=warn component="rule manager" group=osd msg="Evaluating rule failed" rule="alert: CephOSDFlapping\nexpr: (rate(ceph_osd_up[5m]) * on(ceph_daemon) group_left(hostname) ceph_osd_metadata)\n * 60 > 1\nlabels:\n oid: 1.3.6.1.4.1.50495.1.2.1.4.4\n severity: warning\n type: ceph_default\nannotations:\n description: OSD {{ $labels.ceph_daemon }} on {{ $labels.hostname }} was marked\n down and back up {{ $value | humanize }} times once a minute for 5 minutes. This\n may indicate a network issue (latency, packet loss, MTU mismatch) on the cluster\n network, or the public network if no cluster network is deployed. Check the network\n stats on the listed host(s).\n documentation: https://docs.ceph.com/en/latest/rados/troubleshooting/troubleshooting-osd#flapping-osds\n summary: Network issues are causing OSDs to flap (mark each other down)\n" err="found duplicate series for the match group {ceph_daemon=\"osd.0\"} on the right hand-side of the operation: [{__name__=\"ceph_osd_metadata\", ceph_daemon=\"osd.0\", ceph_version=\"ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)\", cluster_addr=\"172.21.15.99\", device_class=\"ssd\", hostname=\"smithi099\", instance=\"smithi181:9283\", job=\"ceph\", objectstore=\"bluestore\", public_addr=\"172.21.15.99\"}, {__name__=\"ceph_osd_metadata\", ceph_daemon=\"osd.0\", ceph_version=\"ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)\", cluster_addr=\"172.21.15.99\", device_class=\"ssd\", hostname=\"smithi099\", instance=\"172.21.15.181:9283\", job=\"ceph\", objectstore=\"bluestore\", public_addr=\"172.21.15.99\"}];many-to-many matching not allowed: matching labels must be unique on one side" 2024-03-30T13:46:59.452 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:46:59 smithi099 ceph-mon[24912]: from='client.24806 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T13:46:59.452 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:46:59 smithi099 ceph-mon[24912]: from='mgr.24746 ' entity='mgr.x' 2024-03-30T13:46:59.452 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:46:59 smithi099 ceph-mon[24912]: from='mgr.24746 ' entity='mgr.x' 2024-03-30T13:46:59.452 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:46:59 smithi099 ceph-mon[24912]: pgmap v79: 161 pgs: 161 active+clean; 585 KiB data, 69 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-03-30T13:46:59.452 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:46:59 smithi099 ceph-mon[24912]: pgmap v80: 161 pgs: 161 active+clean; 585 KiB data, 69 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-03-30T13:46:59.452 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:46:59 smithi099 ceph-mon[24912]: from='mgr.24746 ' entity='mgr.x' 2024-03-30T13:46:59.452 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:46:59 smithi099 ceph-mon[29691]: from='client.24806 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T13:46:59.452 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:46:59 smithi099 ceph-mon[29691]: from='mgr.24746 ' entity='mgr.x' 2024-03-30T13:46:59.453 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:46:59 smithi099 ceph-mon[29691]: from='mgr.24746 ' entity='mgr.x' 2024-03-30T13:46:59.453 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:46:59 smithi099 ceph-mon[29691]: pgmap v79: 161 pgs: 161 active+clean; 585 KiB data, 69 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-03-30T13:46:59.453 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:46:59 smithi099 ceph-mon[29691]: pgmap v80: 161 pgs: 161 active+clean; 585 KiB data, 69 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-03-30T13:46:59.453 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:46:59 smithi099 ceph-mon[29691]: from='mgr.24746 ' entity='mgr.x' 2024-03-30T13:46:59.756 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:46:59 smithi181 ceph-mon[25762]: from='client.24806 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T13:46:59.756 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:46:59 smithi181 ceph-mon[25762]: from='mgr.24746 ' entity='mgr.x' 2024-03-30T13:46:59.756 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:46:59 smithi181 ceph-mon[25762]: from='mgr.24746 ' entity='mgr.x' 2024-03-30T13:46:59.756 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:46:59 smithi181 ceph-mon[25762]: pgmap v79: 161 pgs: 161 active+clean; 585 KiB data, 69 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-03-30T13:46:59.756 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:46:59 smithi181 ceph-mon[25762]: pgmap v80: 161 pgs: 161 active+clean; 585 KiB data, 69 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-03-30T13:46:59.757 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:46:59 smithi181 ceph-mon[25762]: from='mgr.24746 ' entity='mgr.x' 2024-03-30T13:47:01.521 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:47:01 smithi181 ceph-mon[25762]: pgmap v81: 161 pgs: 161 active+clean; 585 KiB data, 69 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-03-30T13:47:01.521 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 13:47:01 smithi181 systemd[1]: ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4@grafana.a.service: Scheduled restart job, restart counter is at 5. 2024-03-30T13:47:01.521 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 13:47:01 smithi181 systemd[1]: Stopped Ceph grafana.a for 98ebaeb8-ee99-11ee-b647-cb9ed24678a4. 2024-03-30T13:47:01.521 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 13:47:01 smithi181 systemd[1]: Starting Ceph grafana.a for 98ebaeb8-ee99-11ee-b647-cb9ed24678a4... 2024-03-30T13:47:01.521 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 13:47:01 smithi181 podman[58693]: 2024-03-30 13:47:01.394174903 +0000 UTC m=+0.017648071 image pull dad864ee21e98e69f4029d1e417aa085001566be0d322fbc75bc6f29b0050c01 quay.io/ceph/ceph-grafana:8.3.5 2024-03-30T13:47:01.588 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:47:01 smithi099 ceph-mon[24912]: pgmap v81: 161 pgs: 161 active+clean; 585 KiB data, 69 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-03-30T13:47:01.588 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:47:01 smithi099 ceph-mon[29691]: pgmap v81: 161 pgs: 161 active+clean; 585 KiB data, 69 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-03-30T13:47:01.823 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 13:47:01 smithi181 podman[58693]: 2024-03-30 13:47:01.519841925 +0000 UTC m=+0.143315129 container create c9b933cb7999dd3532a5fb94e60d633abbfaac5aeb06e4e59e92381bcca9d6ac (image=quay.io/ceph/ceph-grafana:8.3.5, name=ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a, io.openshift.tags=base rhel8, build-date=2022-03-28T10:36:18.413762, io.buildah.version=1.24.2, io.k8s.display-name=Red Hat Universal Base Image 8, description=Ceph Grafana Container, vcs-ref=3aadd00326f3dd6cfe65ee31017ab98915fddb56, vendor=Red Hat, Inc., summary=Grafana Container configured for Ceph mgr/dashboard integration, release=236.1648460182, io.k8s.description=The Universal Base Image is designed and engineered to be the base layer for all of your containerized applications, middleware and utilities. This base image is freely redistributable, but Red Hat only supports Red Hat technologies through subscriptions for Red Hat products. This image is maintained by Red Hat and updated regularly., com.redhat.license_terms=https://www.redhat.com/en/about/red-hat-end-user-license-agreements#UBI, maintainer=Paul Cuzner , io.openshift.expose-services=, url=https://access.redhat.com/containers/#/registry.access.redhat.com/ubi8/images/8.5-236.1648460182, com.redhat.component=ubi8-container, distribution-scope=public, com.redhat.build-host=cpt-1002.osbs.prod.upshift.rdu2.redhat.com, name=ubi8, version=8.5, architecture=x86_64, vcs-type=git) 2024-03-30T13:47:01.823 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 13:47:01 smithi181 podman[58693]: 2024-03-30 13:47:01.713556419 +0000 UTC m=+0.337029581 container init c9b933cb7999dd3532a5fb94e60d633abbfaac5aeb06e4e59e92381bcca9d6ac (image=quay.io/ceph/ceph-grafana:8.3.5, name=ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a, url=https://access.redhat.com/containers/#/registry.access.redhat.com/ubi8/images/8.5-236.1648460182, release=236.1648460182, architecture=x86_64, io.k8s.description=The Universal Base Image is designed and engineered to be the base layer for all of your containerized applications, middleware and utilities. This base image is freely redistributable, but Red Hat only supports Red Hat technologies through subscriptions for Red Hat products. This image is maintained by Red Hat and updated regularly., name=ubi8, version=8.5, vcs-ref=3aadd00326f3dd6cfe65ee31017ab98915fddb56, vendor=Red Hat, Inc., io.openshift.tags=base rhel8, vcs-type=git, build-date=2022-03-28T10:36:18.413762, com.redhat.license_terms=https://www.redhat.com/en/about/red-hat-end-user-license-agreements#UBI, com.redhat.build-host=cpt-1002.osbs.prod.upshift.rdu2.redhat.com, io.openshift.expose-services=, maintainer=Paul Cuzner , io.k8s.display-name=Red Hat Universal Base Image 8, io.buildah.version=1.24.2, summary=Grafana Container configured for Ceph mgr/dashboard integration, com.redhat.component=ubi8-container, distribution-scope=public, description=Ceph Grafana Container) 2024-03-30T13:47:01.823 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 13:47:01 smithi181 podman[58693]: 2024-03-30 13:47:01.71614931 +0000 UTC m=+0.339622472 container start c9b933cb7999dd3532a5fb94e60d633abbfaac5aeb06e4e59e92381bcca9d6ac (image=quay.io/ceph/ceph-grafana:8.3.5, name=ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a, io.k8s.display-name=Red Hat Universal Base Image 8, distribution-scope=public, com.redhat.build-host=cpt-1002.osbs.prod.upshift.rdu2.redhat.com, vendor=Red Hat, Inc., architecture=x86_64, url=https://access.redhat.com/containers/#/registry.access.redhat.com/ubi8/images/8.5-236.1648460182, vcs-type=git, io.buildah.version=1.24.2, io.k8s.description=The Universal Base Image is designed and engineered to be the base layer for all of your containerized applications, middleware and utilities. This base image is freely redistributable, but Red Hat only supports Red Hat technologies through subscriptions for Red Hat products. This image is maintained by Red Hat and updated regularly., maintainer=Paul Cuzner , vcs-ref=3aadd00326f3dd6cfe65ee31017ab98915fddb56, com.redhat.component=ubi8-container, io.openshift.tags=base rhel8, summary=Grafana Container configured for Ceph mgr/dashboard integration, com.redhat.license_terms=https://www.redhat.com/en/about/red-hat-end-user-license-agreements#UBI, io.openshift.expose-services=, description=Ceph Grafana Container, build-date=2022-03-28T10:36:18.413762, release=236.1648460182, name=ubi8, version=8.5) 2024-03-30T13:47:01.823 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 13:47:01 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a[58707]: Failed to start grafana. error: failed to create log directory "/usr/share/grafana/data/log": mkdir /usr/share/grafana/data: permission denied 2024-03-30T13:47:01.824 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 13:47:01 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a[58707]: failed to create log directory "/usr/share/grafana/data/log": mkdir /usr/share/grafana/data: permission denied 2024-03-30T13:47:01.824 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 13:47:01 smithi181 bash[58693]: c9b933cb7999dd3532a5fb94e60d633abbfaac5aeb06e4e59e92381bcca9d6ac 2024-03-30T13:47:02.256 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 13:47:01 smithi181 systemd[1]: Started Ceph grafana.a for 98ebaeb8-ee99-11ee-b647-cb9ed24678a4. 2024-03-30T13:47:02.256 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 13:47:01 smithi181 podman[58722]: 2024-03-30 13:47:01.849075887 +0000 UTC m=+0.097566542 container died c9b933cb7999dd3532a5fb94e60d633abbfaac5aeb06e4e59e92381bcca9d6ac (image=quay.io/ceph/ceph-grafana:8.3.5, name=ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a, name=ubi8, maintainer=Paul Cuzner , com.redhat.license_terms=https://www.redhat.com/en/about/red-hat-end-user-license-agreements#UBI, io.k8s.display-name=Red Hat Universal Base Image 8, io.openshift.expose-services=, distribution-scope=public, url=https://access.redhat.com/containers/#/registry.access.redhat.com/ubi8/images/8.5-236.1648460182, com.redhat.component=ubi8-container, summary=Grafana Container configured for Ceph mgr/dashboard integration, build-date=2022-03-28T10:36:18.413762, com.redhat.build-host=cpt-1002.osbs.prod.upshift.rdu2.redhat.com, io.openshift.tags=base rhel8, vcs-type=git, description=Ceph Grafana Container, io.buildah.version=1.24.2, version=8.5, architecture=x86_64, vendor=Red Hat, Inc., vcs-ref=3aadd00326f3dd6cfe65ee31017ab98915fddb56, release=236.1648460182, io.k8s.description=The Universal Base Image is designed and engineered to be the base layer for all of your containerized applications, middleware and utilities. This base image is freely redistributable, but Red Hat only supports Red Hat technologies through subscriptions for Red Hat products. This image is maintained by Red Hat and updated regularly.) 2024-03-30T13:47:02.756 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 13:47:02 smithi181 podman[58722]: 2024-03-30 13:47:02.468169 +0000 UTC m=+0.716659657 container remove c9b933cb7999dd3532a5fb94e60d633abbfaac5aeb06e4e59e92381bcca9d6ac (image=quay.io/ceph/ceph-grafana:8.3.5, name=ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a, summary=Grafana Container configured for Ceph mgr/dashboard integration, vcs-ref=3aadd00326f3dd6cfe65ee31017ab98915fddb56, name=ubi8, release=236.1648460182, io.k8s.display-name=Red Hat Universal Base Image 8, version=8.5, io.buildah.version=1.24.2, vendor=Red Hat, Inc., com.redhat.license_terms=https://www.redhat.com/en/about/red-hat-end-user-license-agreements#UBI, com.redhat.build-host=cpt-1002.osbs.prod.upshift.rdu2.redhat.com, io.openshift.tags=base rhel8, io.openshift.expose-services=, build-date=2022-03-28T10:36:18.413762, description=Ceph Grafana Container, maintainer=Paul Cuzner , url=https://access.redhat.com/containers/#/registry.access.redhat.com/ubi8/images/8.5-236.1648460182, vcs-type=git, architecture=x86_64, distribution-scope=public, com.redhat.component=ubi8-container, io.k8s.description=The Universal Base Image is designed and engineered to be the base layer for all of your containerized applications, middleware and utilities. This base image is freely redistributable, but Red Hat only supports Red Hat technologies through subscriptions for Red Hat products. This image is maintained by Red Hat and updated regularly.) 2024-03-30T13:47:02.756 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 13:47:02 smithi181 systemd[1]: ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4@grafana.a.service: Main process exited, code=exited, status=1/FAILURE 2024-03-30T13:47:02.757 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 13:47:02 smithi181 systemd[1]: ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4@grafana.a.service: Failed with result 'exit-code'. 2024-03-30T13:47:03.587 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:47:03 smithi099 ceph-mon[24912]: pgmap v82: 161 pgs: 161 active+clean; 585 KiB data, 69 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-03-30T13:47:03.588 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:47:03 smithi099 ceph-mon[29691]: pgmap v82: 161 pgs: 161 active+clean; 585 KiB data, 69 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-03-30T13:47:03.756 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:47:03 smithi181 ceph-mon[25762]: pgmap v82: 161 pgs: 161 active+clean; 585 KiB data, 69 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-03-30T13:47:05.006 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:47:04 smithi181 ceph-mon[25762]: from='mgr.24746 172.21.15.181:0/2892154077' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T13:47:05.006 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:47:04 smithi181 ceph-mon[25762]: pgmap v83: 161 pgs: 161 active+clean; 585 KiB data, 69 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-03-30T13:47:05.087 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:47:04 smithi099 ceph-mon[29691]: from='mgr.24746 172.21.15.181:0/2892154077' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T13:47:05.087 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:47:04 smithi099 ceph-mon[29691]: pgmap v83: 161 pgs: 161 active+clean; 585 KiB data, 69 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-03-30T13:47:05.087 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:47:04 smithi099 ceph-mon[24912]: from='mgr.24746 172.21.15.181:0/2892154077' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T13:47:05.088 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:47:04 smithi099 ceph-mon[24912]: pgmap v83: 161 pgs: 161 active+clean; 585 KiB data, 69 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-03-30T13:47:07.590 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:47:07 smithi099 ceph-mon[29691]: pgmap v84: 161 pgs: 161 active+clean; 585 KiB data, 69 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-03-30T13:47:07.590 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:47:07 smithi099 ceph-mon[24912]: pgmap v84: 161 pgs: 161 active+clean; 585 KiB data, 69 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-03-30T13:47:07.591 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:47:07 smithi181 ceph-mon[25762]: pgmap v84: 161 pgs: 161 active+clean; 585 KiB data, 69 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-03-30T13:47:08.006 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 13:47:07 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-x[50211]: ::ffff:172.21.15.181 - - [30/Mar/2024:13:47:07] "GET /metrics HTTP/1.1" 200 37960 "" "Prometheus/2.33.4" 2024-03-30T13:47:08.948 INFO:journalctl@ceph.prometheus.a.smithi181.stdout:Mar 30 13:47:08 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-prometheus-a[55395]: ts=2024-03-30T13:47:08.660Z caller=manager.go:609 level=warn component="rule manager" group=osd msg="Evaluating rule failed" rule="alert: CephOSDFlapping\nexpr: (rate(ceph_osd_up[5m]) * on(ceph_daemon) group_left(hostname) ceph_osd_metadata)\n * 60 > 1\nlabels:\n oid: 1.3.6.1.4.1.50495.1.2.1.4.4\n severity: warning\n type: ceph_default\nannotations:\n description: OSD {{ $labels.ceph_daemon }} on {{ $labels.hostname }} was marked\n down and back up {{ $value | humanize }} times once a minute for 5 minutes. This\n may indicate a network issue (latency, packet loss, MTU mismatch) on the cluster\n network, or the public network if no cluster network is deployed. Check the network\n stats on the listed host(s).\n documentation: https://docs.ceph.com/en/latest/rados/troubleshooting/troubleshooting-osd#flapping-osds\n summary: Network issues are causing OSDs to flap (mark each other down)\n" err="found duplicate series for the match group {ceph_daemon=\"osd.0\"} on the right hand-side of the operation: [{__name__=\"ceph_osd_metadata\", ceph_daemon=\"osd.0\", ceph_version=\"ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)\", cluster_addr=\"172.21.15.99\", device_class=\"ssd\", hostname=\"smithi099\", instance=\"smithi181:9283\", job=\"ceph\", objectstore=\"bluestore\", public_addr=\"172.21.15.99\"}, {__name__=\"ceph_osd_metadata\", ceph_daemon=\"osd.0\", ceph_version=\"ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)\", cluster_addr=\"172.21.15.99\", device_class=\"ssd\", hostname=\"smithi099\", instance=\"172.21.15.181:9283\", job=\"ceph\", objectstore=\"bluestore\", public_addr=\"172.21.15.99\"}];many-to-many matching not allowed: matching labels must be unique on one side" 2024-03-30T13:47:09.717 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:47:09 smithi181 ceph-mon[25762]: from='client.24806 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T13:47:09.717 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:47:09 smithi181 ceph-mon[25762]: pgmap v85: 161 pgs: 161 active+clean; 585 KiB data, 69 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-03-30T13:47:09.717 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:47:09 smithi181 ceph-mon[25762]: from='mgr.24746 ' entity='mgr.x' 2024-03-30T13:47:09.718 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:47:09 smithi181 ceph-mon[25762]: from='mgr.24746 ' entity='mgr.x' 2024-03-30T13:47:09.718 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:47:09 smithi181 ceph-mon[25762]: from='mgr.24746 ' entity='mgr.x' 2024-03-30T13:47:09.837 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:47:09 smithi099 ceph-mon[29691]: from='client.24806 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T13:47:09.837 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:47:09 smithi099 ceph-mon[29691]: pgmap v85: 161 pgs: 161 active+clean; 585 KiB data, 69 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-03-30T13:47:09.837 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:47:09 smithi099 ceph-mon[29691]: from='mgr.24746 ' entity='mgr.x' 2024-03-30T13:47:09.838 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:47:09 smithi099 ceph-mon[29691]: from='mgr.24746 ' entity='mgr.x' 2024-03-30T13:47:09.838 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:47:09 smithi099 ceph-mon[29691]: from='mgr.24746 ' entity='mgr.x' 2024-03-30T13:47:09.838 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:47:09 smithi099 ceph-mon[24912]: from='client.24806 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T13:47:09.838 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:47:09 smithi099 ceph-mon[24912]: pgmap v85: 161 pgs: 161 active+clean; 585 KiB data, 69 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-03-30T13:47:09.838 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:47:09 smithi099 ceph-mon[24912]: from='mgr.24746 ' entity='mgr.x' 2024-03-30T13:47:09.838 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:47:09 smithi099 ceph-mon[24912]: from='mgr.24746 ' entity='mgr.x' 2024-03-30T13:47:09.838 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:47:09 smithi099 ceph-mon[24912]: from='mgr.24746 ' entity='mgr.x' 2024-03-30T13:47:10.756 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:47:10 smithi181 ceph-mon[25762]: pgmap v86: 161 pgs: 161 active+clean; 585 KiB data, 69 MiB used, 715 GiB / 715 GiB avail; 959 B/s rd, 0 op/s 2024-03-30T13:47:10.756 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:47:10 smithi181 ceph-mon[25762]: pgmap v87: 161 pgs: 161 active+clean; 585 KiB data, 69 MiB used, 715 GiB / 715 GiB avail; 590 B/s rd, 0 op/s 2024-03-30T13:47:10.837 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:47:10 smithi099 ceph-mon[29691]: pgmap v86: 161 pgs: 161 active+clean; 585 KiB data, 69 MiB used, 715 GiB / 715 GiB avail; 959 B/s rd, 0 op/s 2024-03-30T13:47:10.837 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:47:10 smithi099 ceph-mon[29691]: pgmap v87: 161 pgs: 161 active+clean; 585 KiB data, 69 MiB used, 715 GiB / 715 GiB avail; 590 B/s rd, 0 op/s 2024-03-30T13:47:10.837 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:47:10 smithi099 ceph-mon[24912]: pgmap v86: 161 pgs: 161 active+clean; 585 KiB data, 69 MiB used, 715 GiB / 715 GiB avail; 959 B/s rd, 0 op/s 2024-03-30T13:47:10.838 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:47:10 smithi099 ceph-mon[24912]: pgmap v87: 161 pgs: 161 active+clean; 585 KiB data, 69 MiB used, 715 GiB / 715 GiB avail; 590 B/s rd, 0 op/s 2024-03-30T13:47:12.756 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:47:12 smithi181 ceph-mon[25762]: pgmap v88: 161 pgs: 161 active+clean; 585 KiB data, 69 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T13:47:12.756 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 13:47:12 smithi181 systemd[1]: ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4@grafana.a.service: Scheduled restart job, restart counter is at 6. 2024-03-30T13:47:12.757 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 13:47:12 smithi181 systemd[1]: Stopped Ceph grafana.a for 98ebaeb8-ee99-11ee-b647-cb9ed24678a4. 2024-03-30T13:47:12.757 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 13:47:12 smithi181 systemd[1]: ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4@grafana.a.service: Start request repeated too quickly. 2024-03-30T13:47:12.757 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 13:47:12 smithi181 systemd[1]: ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4@grafana.a.service: Failed with result 'exit-code'. 2024-03-30T13:47:12.757 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 13:47:12 smithi181 systemd[1]: Failed to start Ceph grafana.a for 98ebaeb8-ee99-11ee-b647-cb9ed24678a4. 2024-03-30T13:47:12.837 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:47:12 smithi099 ceph-mon[29691]: pgmap v88: 161 pgs: 161 active+clean; 585 KiB data, 69 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T13:47:12.837 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:47:12 smithi099 ceph-mon[24912]: pgmap v88: 161 pgs: 161 active+clean; 585 KiB data, 69 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T13:47:14.756 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:47:14 smithi181 ceph-mon[25762]: pgmap v89: 161 pgs: 161 active+clean; 585 KiB data, 69 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T13:47:14.837 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:47:14 smithi099 ceph-mon[24912]: pgmap v89: 161 pgs: 161 active+clean; 585 KiB data, 69 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T13:47:14.837 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:47:14 smithi099 ceph-mon[29691]: pgmap v89: 161 pgs: 161 active+clean; 585 KiB data, 69 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T13:47:16.744 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:47:16 smithi099 ceph-mon[24912]: pgmap v90: 161 pgs: 161 active+clean; 585 KiB data, 69 MiB used, 715 GiB / 715 GiB avail; 590 B/s rd, 0 op/s 2024-03-30T13:47:16.745 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:47:16 smithi099 ceph-mon[29691]: pgmap v90: 161 pgs: 161 active+clean; 585 KiB data, 69 MiB used, 715 GiB / 715 GiB avail; 590 B/s rd, 0 op/s 2024-03-30T13:47:16.756 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:47:16 smithi181 ceph-mon[25762]: pgmap v90: 161 pgs: 161 active+clean; 585 KiB data, 69 MiB used, 715 GiB / 715 GiB avail; 590 B/s rd, 0 op/s 2024-03-30T13:47:17.587 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:47:17 smithi099 ceph-mon[29691]: from='mgr.24746 172.21.15.181:0/2892154077' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:47:17.587 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:47:17 smithi099 ceph-mon[29691]: from='mgr.24746 172.21.15.181:0/2892154077' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:47:17.587 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:47:17 smithi099 ceph-mon[29691]: from='mgr.24746 ' entity='mgr.x' 2024-03-30T13:47:17.588 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:47:17 smithi099 ceph-mon[24912]: from='mgr.24746 172.21.15.181:0/2892154077' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:47:17.588 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:47:17 smithi099 ceph-mon[24912]: from='mgr.24746 172.21.15.181:0/2892154077' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:47:17.588 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:47:17 smithi099 ceph-mon[24912]: from='mgr.24746 ' entity='mgr.x' 2024-03-30T13:47:17.756 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:47:17 smithi181 ceph-mon[25762]: from='mgr.24746 172.21.15.181:0/2892154077' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:47:17.756 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:47:17 smithi181 ceph-mon[25762]: from='mgr.24746 172.21.15.181:0/2892154077' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:47:17.756 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:47:17 smithi181 ceph-mon[25762]: from='mgr.24746 ' entity='mgr.x' 2024-03-30T13:47:17.756 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 13:47:17 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-x[50211]: ::ffff:172.21.15.181 - - [30/Mar/2024:13:47:17] "GET /metrics HTTP/1.1" 200 37960 "" "Prometheus/2.33.4" 2024-03-30T13:47:18.587 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:47:18 smithi099 ceph-mon[24912]: pgmap v91: 161 pgs: 161 active+clean; 585 KiB data, 69 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T13:47:18.587 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:47:18 smithi099 ceph-mon[24912]: pgmap v92: 161 pgs: 161 active+clean; 585 KiB data, 69 MiB used, 715 GiB / 715 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-03-30T13:47:18.588 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:47:18 smithi099 ceph-mon[29691]: pgmap v91: 161 pgs: 161 active+clean; 585 KiB data, 69 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T13:47:18.588 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:47:18 smithi099 ceph-mon[29691]: pgmap v92: 161 pgs: 161 active+clean; 585 KiB data, 69 MiB used, 715 GiB / 715 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-03-30T13:47:18.661 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:47:18 smithi181 ceph-mon[25762]: pgmap v91: 161 pgs: 161 active+clean; 585 KiB data, 69 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T13:47:18.661 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:47:18 smithi181 ceph-mon[25762]: pgmap v92: 161 pgs: 161 active+clean; 585 KiB data, 69 MiB used, 715 GiB / 715 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-03-30T13:47:19.006 INFO:journalctl@ceph.prometheus.a.smithi181.stdout:Mar 30 13:47:18 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-prometheus-a[55395]: ts=2024-03-30T13:47:18.660Z caller=manager.go:609 level=warn component="rule manager" group=osd msg="Evaluating rule failed" rule="alert: CephOSDFlapping\nexpr: (rate(ceph_osd_up[5m]) * on(ceph_daemon) group_left(hostname) ceph_osd_metadata)\n * 60 > 1\nlabels:\n oid: 1.3.6.1.4.1.50495.1.2.1.4.4\n severity: warning\n type: ceph_default\nannotations:\n description: OSD {{ $labels.ceph_daemon }} on {{ $labels.hostname }} was marked\n down and back up {{ $value | humanize }} times once a minute for 5 minutes. This\n may indicate a network issue (latency, packet loss, MTU mismatch) on the cluster\n network, or the public network if no cluster network is deployed. Check the network\n stats on the listed host(s).\n documentation: https://docs.ceph.com/en/latest/rados/troubleshooting/troubleshooting-osd#flapping-osds\n summary: Network issues are causing OSDs to flap (mark each other down)\n" err="found duplicate series for the match group {ceph_daemon=\"osd.0\"} on the right hand-side of the operation: [{__name__=\"ceph_osd_metadata\", ceph_daemon=\"osd.0\", ceph_version=\"ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)\", cluster_addr=\"172.21.15.99\", device_class=\"ssd\", hostname=\"smithi099\", instance=\"smithi181:9283\", job=\"ceph\", objectstore=\"bluestore\", public_addr=\"172.21.15.99\"}, {__name__=\"ceph_osd_metadata\", ceph_daemon=\"osd.0\", ceph_version=\"ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)\", cluster_addr=\"172.21.15.99\", device_class=\"ssd\", hostname=\"smithi099\", instance=\"172.21.15.181:9283\", job=\"ceph\", objectstore=\"bluestore\", public_addr=\"172.21.15.99\"}];many-to-many matching not allowed: matching labels must be unique on one side" 2024-03-30T13:47:19.587 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:47:19 smithi099 ceph-mon[29691]: from='client.24806 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T13:47:19.587 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:47:19 smithi099 ceph-mon[29691]: from='mgr.24746 ' entity='mgr.x' 2024-03-30T13:47:19.587 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:47:19 smithi099 ceph-mon[29691]: from='mgr.24746 ' entity='mgr.x' 2024-03-30T13:47:19.587 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:47:19 smithi099 ceph-mon[29691]: from='mgr.24746 ' entity='mgr.x' 2024-03-30T13:47:19.587 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:47:19 smithi099 ceph-mon[29691]: from='mgr.24746 172.21.15.181:0/2892154077' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T13:47:19.587 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:47:19 smithi099 ceph-mon[24912]: from='client.24806 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T13:47:19.588 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:47:19 smithi099 ceph-mon[24912]: from='mgr.24746 ' entity='mgr.x' 2024-03-30T13:47:19.588 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:47:19 smithi099 ceph-mon[24912]: from='mgr.24746 ' entity='mgr.x' 2024-03-30T13:47:19.588 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:47:19 smithi099 ceph-mon[24912]: from='mgr.24746 ' entity='mgr.x' 2024-03-30T13:47:19.588 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:47:19 smithi099 ceph-mon[24912]: from='mgr.24746 172.21.15.181:0/2892154077' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T13:47:19.756 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:47:19 smithi181 ceph-mon[25762]: from='client.24806 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T13:47:19.757 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:47:19 smithi181 ceph-mon[25762]: from='mgr.24746 ' entity='mgr.x' 2024-03-30T13:47:19.757 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:47:19 smithi181 ceph-mon[25762]: from='mgr.24746 ' entity='mgr.x' 2024-03-30T13:47:19.757 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:47:19 smithi181 ceph-mon[25762]: from='mgr.24746 ' entity='mgr.x' 2024-03-30T13:47:19.757 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:47:19 smithi181 ceph-mon[25762]: from='mgr.24746 172.21.15.181:0/2892154077' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T13:47:20.587 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:47:20 smithi099 ceph-mon[24912]: pgmap v93: 161 pgs: 161 active+clean; 585 KiB data, 69 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-03-30T13:47:20.587 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:47:20 smithi099 ceph-mon[24912]: pgmap v94: 161 pgs: 161 active+clean; 585 KiB data, 69 MiB used, 715 GiB / 715 GiB avail; 686 B/s rd, 0 op/s 2024-03-30T13:47:20.587 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:47:20 smithi099 ceph-mon[29691]: pgmap v93: 161 pgs: 161 active+clean; 585 KiB data, 69 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-03-30T13:47:20.588 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:47:20 smithi099 ceph-mon[29691]: pgmap v94: 161 pgs: 161 active+clean; 585 KiB data, 69 MiB used, 715 GiB / 715 GiB avail; 686 B/s rd, 0 op/s 2024-03-30T13:47:20.756 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:47:20 smithi181 ceph-mon[25762]: pgmap v93: 161 pgs: 161 active+clean; 585 KiB data, 69 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-03-30T13:47:20.756 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:47:20 smithi181 ceph-mon[25762]: pgmap v94: 161 pgs: 161 active+clean; 585 KiB data, 69 MiB used, 715 GiB / 715 GiB avail; 686 B/s rd, 0 op/s 2024-03-30T13:47:21.587 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:47:21 smithi099 ceph-mon[24912]: pgmap v95: 161 pgs: 161 active+clean; 585 KiB data, 69 MiB used, 715 GiB / 715 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-03-30T13:47:21.587 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:47:21 smithi099 ceph-mon[29691]: pgmap v95: 161 pgs: 161 active+clean; 585 KiB data, 69 MiB used, 715 GiB / 715 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-03-30T13:47:21.756 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:47:21 smithi181 ceph-mon[25762]: pgmap v95: 161 pgs: 161 active+clean; 585 KiB data, 69 MiB used, 715 GiB / 715 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-03-30T13:47:23.756 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:47:23 smithi181 ceph-mon[25762]: pgmap v96: 161 pgs: 161 active+clean; 585 KiB data, 69 MiB used, 715 GiB / 715 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-03-30T13:47:23.837 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:47:23 smithi099 ceph-mon[24912]: pgmap v96: 161 pgs: 161 active+clean; 585 KiB data, 69 MiB used, 715 GiB / 715 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-03-30T13:47:23.837 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:47:23 smithi099 ceph-mon[29691]: pgmap v96: 161 pgs: 161 active+clean; 585 KiB data, 69 MiB used, 715 GiB / 715 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-03-30T13:47:25.587 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:47:25 smithi099 ceph-mon[24912]: from='mgr.24746 ' entity='mgr.x' 2024-03-30T13:47:25.587 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:47:25 smithi099 ceph-mon[24912]: from='mgr.24746 ' entity='mgr.x' 2024-03-30T13:47:25.587 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:47:25 smithi099 ceph-mon[24912]: pgmap v97: 161 pgs: 161 active+clean; 585 KiB data, 69 MiB used, 715 GiB / 715 GiB avail; 694 B/s rd, 0 op/s 2024-03-30T13:47:25.587 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:47:25 smithi099 ceph-mon[24912]: pgmap v98: 161 pgs: 161 active+clean; 585 KiB data, 69 MiB used, 715 GiB / 715 GiB avail; 694 B/s rd, 0 op/s 2024-03-30T13:47:25.587 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:47:25 smithi099 ceph-mon[24912]: from='mgr.24746 ' entity='mgr.x' 2024-03-30T13:47:25.588 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:47:25 smithi099 ceph-mon[29691]: from='mgr.24746 ' entity='mgr.x' 2024-03-30T13:47:25.588 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:47:25 smithi099 ceph-mon[29691]: from='mgr.24746 ' entity='mgr.x' 2024-03-30T13:47:25.588 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:47:25 smithi099 ceph-mon[29691]: pgmap v97: 161 pgs: 161 active+clean; 585 KiB data, 69 MiB used, 715 GiB / 715 GiB avail; 694 B/s rd, 0 op/s 2024-03-30T13:47:25.588 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:47:25 smithi099 ceph-mon[29691]: pgmap v98: 161 pgs: 161 active+clean; 585 KiB data, 69 MiB used, 715 GiB / 715 GiB avail; 694 B/s rd, 0 op/s 2024-03-30T13:47:25.588 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:47:25 smithi099 ceph-mon[29691]: from='mgr.24746 ' entity='mgr.x' 2024-03-30T13:47:25.757 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:47:25 smithi181 ceph-mon[25762]: from='mgr.24746 ' entity='mgr.x' 2024-03-30T13:47:25.757 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:47:25 smithi181 ceph-mon[25762]: from='mgr.24746 ' entity='mgr.x' 2024-03-30T13:47:25.757 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:47:25 smithi181 ceph-mon[25762]: pgmap v97: 161 pgs: 161 active+clean; 585 KiB data, 69 MiB used, 715 GiB / 715 GiB avail; 694 B/s rd, 0 op/s 2024-03-30T13:47:25.757 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:47:25 smithi181 ceph-mon[25762]: pgmap v98: 161 pgs: 161 active+clean; 585 KiB data, 69 MiB used, 715 GiB / 715 GiB avail; 694 B/s rd, 0 op/s 2024-03-30T13:47:25.757 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:47:25 smithi181 ceph-mon[25762]: from='mgr.24746 ' entity='mgr.x' 2024-03-30T13:47:27.625 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:47:27 smithi099 ceph-mon[24912]: pgmap v99: 161 pgs: 161 active+clean; 585 KiB data, 69 MiB used, 715 GiB / 715 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-03-30T13:47:27.625 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:47:27 smithi099 ceph-mon[29691]: pgmap v99: 161 pgs: 161 active+clean; 585 KiB data, 69 MiB used, 715 GiB / 715 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-03-30T13:47:27.756 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:47:27 smithi181 ceph-mon[25762]: pgmap v99: 161 pgs: 161 active+clean; 585 KiB data, 69 MiB used, 715 GiB / 715 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-03-30T13:47:27.757 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 13:47:27 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-x[50211]: ::ffff:172.21.15.181 - - [30/Mar/2024:13:47:27] "GET /metrics HTTP/1.1" 200 37969 "" "Prometheus/2.33.4" 2024-03-30T13:47:28.807 INFO:journalctl@ceph.prometheus.a.smithi181.stdout:Mar 30 13:47:28 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-prometheus-a[55395]: ts=2024-03-30T13:47:28.660Z caller=manager.go:609 level=warn component="rule manager" group=osd msg="Evaluating rule failed" rule="alert: CephOSDFlapping\nexpr: (rate(ceph_osd_up[5m]) * on(ceph_daemon) group_left(hostname) ceph_osd_metadata)\n * 60 > 1\nlabels:\n oid: 1.3.6.1.4.1.50495.1.2.1.4.4\n severity: warning\n type: ceph_default\nannotations:\n description: OSD {{ $labels.ceph_daemon }} on {{ $labels.hostname }} was marked\n down and back up {{ $value | humanize }} times once a minute for 5 minutes. This\n may indicate a network issue (latency, packet loss, MTU mismatch) on the cluster\n network, or the public network if no cluster network is deployed. Check the network\n stats on the listed host(s).\n documentation: https://docs.ceph.com/en/latest/rados/troubleshooting/troubleshooting-osd#flapping-osds\n summary: Network issues are causing OSDs to flap (mark each other down)\n" err="found duplicate series for the match group {ceph_daemon=\"osd.0\"} on the right hand-side of the operation: [{__name__=\"ceph_osd_metadata\", ceph_daemon=\"osd.0\", ceph_version=\"ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)\", cluster_addr=\"172.21.15.99\", device_class=\"ssd\", hostname=\"smithi099\", instance=\"smithi181:9283\", job=\"ceph\", objectstore=\"bluestore\", public_addr=\"172.21.15.99\"}, {__name__=\"ceph_osd_metadata\", ceph_daemon=\"osd.0\", ceph_version=\"ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)\", cluster_addr=\"172.21.15.99\", device_class=\"ssd\", hostname=\"smithi099\", instance=\"172.21.15.181:9283\", job=\"ceph\", objectstore=\"bluestore\", public_addr=\"172.21.15.99\"}];many-to-many matching not allowed: matching labels must be unique on one side" 2024-03-30T13:47:29.498 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:47:29 smithi181 ceph-mon[25762]: from='client.24806 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T13:47:29.498 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:47:29 smithi181 ceph-mon[25762]: pgmap v100: 161 pgs: 161 active+clean; 585 KiB data, 69 MiB used, 715 GiB / 715 GiB avail; 1.0 KiB/s rd, 1 op/s 2024-03-30T13:47:29.837 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:47:29 smithi099 ceph-mon[29691]: from='client.24806 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T13:47:29.837 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:47:29 smithi099 ceph-mon[29691]: pgmap v100: 161 pgs: 161 active+clean; 585 KiB data, 69 MiB used, 715 GiB / 715 GiB avail; 1.0 KiB/s rd, 1 op/s 2024-03-30T13:47:29.838 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:47:29 smithi099 ceph-mon[24912]: from='client.24806 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T13:47:29.838 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:47:29 smithi099 ceph-mon[24912]: pgmap v100: 161 pgs: 161 active+clean; 585 KiB data, 69 MiB used, 715 GiB / 715 GiB avail; 1.0 KiB/s rd, 1 op/s 2024-03-30T13:47:31.506 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:47:31 smithi181 ceph-mon[25762]: pgmap v101: 161 pgs: 161 active+clean; 585 KiB data, 69 MiB used, 715 GiB / 715 GiB avail; 1.0 KiB/s rd, 1 op/s 2024-03-30T13:47:31.587 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:47:31 smithi099 ceph-mon[24912]: pgmap v101: 161 pgs: 161 active+clean; 585 KiB data, 69 MiB used, 715 GiB / 715 GiB avail; 1.0 KiB/s rd, 1 op/s 2024-03-30T13:47:31.587 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:47:31 smithi099 ceph-mon[29691]: pgmap v101: 161 pgs: 161 active+clean; 585 KiB data, 69 MiB used, 715 GiB / 715 GiB avail; 1.0 KiB/s rd, 1 op/s 2024-03-30T13:47:33.756 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:47:33 smithi181 ceph-mon[25762]: pgmap v102: 161 pgs: 161 active+clean; 585 KiB data, 69 MiB used, 715 GiB / 715 GiB avail; 1.0 KiB/s rd, 1 op/s 2024-03-30T13:47:33.837 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:47:33 smithi099 ceph-mon[24912]: pgmap v102: 161 pgs: 161 active+clean; 585 KiB data, 69 MiB used, 715 GiB / 715 GiB avail; 1.0 KiB/s rd, 1 op/s 2024-03-30T13:47:33.837 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:47:33 smithi099 ceph-mon[29691]: pgmap v102: 161 pgs: 161 active+clean; 585 KiB data, 69 MiB used, 715 GiB / 715 GiB avail; 1.0 KiB/s rd, 1 op/s 2024-03-30T13:47:35.006 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:47:34 smithi181 ceph-mon[25762]: from='mgr.24746 172.21.15.181:0/2892154077' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T13:47:35.006 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:47:34 smithi181 ceph-mon[25762]: pgmap v103: 161 pgs: 161 active+clean; 585 KiB data, 69 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-03-30T13:47:35.087 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:47:34 smithi099 ceph-mon[24912]: from='mgr.24746 172.21.15.181:0/2892154077' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T13:47:35.087 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:47:34 smithi099 ceph-mon[24912]: pgmap v103: 161 pgs: 161 active+clean; 585 KiB data, 69 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-03-30T13:47:35.087 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:47:34 smithi099 ceph-mon[29691]: from='mgr.24746 172.21.15.181:0/2892154077' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T13:47:35.087 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:47:34 smithi099 ceph-mon[29691]: pgmap v103: 161 pgs: 161 active+clean; 585 KiB data, 69 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-03-30T13:47:37.636 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:47:37 smithi099 ceph-mon[29691]: pgmap v104: 161 pgs: 161 active+clean; 585 KiB data, 69 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T13:47:37.636 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:47:37 smithi099 ceph-mon[24912]: pgmap v104: 161 pgs: 161 active+clean; 585 KiB data, 69 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T13:47:37.756 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:47:37 smithi181 ceph-mon[25762]: pgmap v104: 161 pgs: 161 active+clean; 585 KiB data, 69 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T13:47:37.757 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 13:47:37 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-x[50211]: ::ffff:172.21.15.181 - - [30/Mar/2024:13:47:37] "GET /metrics HTTP/1.1" 200 37973 "" "Prometheus/2.33.4" 2024-03-30T13:47:39.006 INFO:journalctl@ceph.prometheus.a.smithi181.stdout:Mar 30 13:47:38 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-prometheus-a[55395]: ts=2024-03-30T13:47:38.659Z caller=manager.go:609 level=warn component="rule manager" group=osd msg="Evaluating rule failed" rule="alert: CephOSDFlapping\nexpr: (rate(ceph_osd_up[5m]) * on(ceph_daemon) group_left(hostname) ceph_osd_metadata)\n * 60 > 1\nlabels:\n oid: 1.3.6.1.4.1.50495.1.2.1.4.4\n severity: warning\n type: ceph_default\nannotations:\n description: OSD {{ $labels.ceph_daemon }} on {{ $labels.hostname }} was marked\n down and back up {{ $value | humanize }} times once a minute for 5 minutes. This\n may indicate a network issue (latency, packet loss, MTU mismatch) on the cluster\n network, or the public network if no cluster network is deployed. Check the network\n stats on the listed host(s).\n documentation: https://docs.ceph.com/en/latest/rados/troubleshooting/troubleshooting-osd#flapping-osds\n summary: Network issues are causing OSDs to flap (mark each other down)\n" err="found duplicate series for the match group {ceph_daemon=\"osd.0\"} on the right hand-side of the operation: [{__name__=\"ceph_osd_metadata\", ceph_daemon=\"osd.0\", ceph_version=\"ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)\", cluster_addr=\"172.21.15.99\", device_class=\"ssd\", hostname=\"smithi099\", instance=\"smithi181:9283\", job=\"ceph\", objectstore=\"bluestore\", public_addr=\"172.21.15.99\"}, {__name__=\"ceph_osd_metadata\", ceph_daemon=\"osd.0\", ceph_version=\"ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)\", cluster_addr=\"172.21.15.99\", device_class=\"ssd\", hostname=\"smithi099\", instance=\"172.21.15.181:9283\", job=\"ceph\", objectstore=\"bluestore\", public_addr=\"172.21.15.99\"}];many-to-many matching not allowed: matching labels must be unique on one side" 2024-03-30T13:47:39.485 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:47:39 smithi099 ceph-mon[24912]: from='client.24806 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T13:47:39.486 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:47:39 smithi099 ceph-mon[24912]: pgmap v105: 161 pgs: 161 active+clean; 585 KiB data, 69 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T13:47:39.486 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:47:39 smithi099 ceph-mon[24912]: from='mgr.24746 ' entity='mgr.x' 2024-03-30T13:47:39.486 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:47:39 smithi099 ceph-mon[24912]: from='mgr.24746 ' entity='mgr.x' 2024-03-30T13:47:39.486 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:47:39 smithi099 ceph-mon[24912]: from='mgr.24746 ' entity='mgr.x' 2024-03-30T13:47:39.486 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:47:39 smithi099 ceph-mon[29691]: from='client.24806 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T13:47:39.486 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:47:39 smithi099 ceph-mon[29691]: pgmap v105: 161 pgs: 161 active+clean; 585 KiB data, 69 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T13:47:39.486 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:47:39 smithi099 ceph-mon[29691]: from='mgr.24746 ' entity='mgr.x' 2024-03-30T13:47:39.486 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:47:39 smithi099 ceph-mon[29691]: from='mgr.24746 ' entity='mgr.x' 2024-03-30T13:47:39.487 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:47:39 smithi099 ceph-mon[29691]: from='mgr.24746 ' entity='mgr.x' 2024-03-30T13:47:39.756 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:47:39 smithi181 ceph-mon[25762]: from='client.24806 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T13:47:39.756 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:47:39 smithi181 ceph-mon[25762]: pgmap v105: 161 pgs: 161 active+clean; 585 KiB data, 69 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T13:47:39.756 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:47:39 smithi181 ceph-mon[25762]: from='mgr.24746 ' entity='mgr.x' 2024-03-30T13:47:39.756 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:47:39 smithi181 ceph-mon[25762]: from='mgr.24746 ' entity='mgr.x' 2024-03-30T13:47:39.756 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:47:39 smithi181 ceph-mon[25762]: from='mgr.24746 ' entity='mgr.x' 2024-03-30T13:47:40.756 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:47:40 smithi181 ceph-mon[25762]: pgmap v106: 161 pgs: 161 active+clean; 585 KiB data, 69 MiB used, 715 GiB / 715 GiB avail; 1001 B/s rd, 0 op/s 2024-03-30T13:47:40.756 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:47:40 smithi181 ceph-mon[25762]: pgmap v107: 161 pgs: 161 active+clean; 585 KiB data, 69 MiB used, 715 GiB / 715 GiB avail; 622 B/s rd, 0 op/s 2024-03-30T13:47:40.837 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:47:40 smithi099 ceph-mon[24912]: pgmap v106: 161 pgs: 161 active+clean; 585 KiB data, 69 MiB used, 715 GiB / 715 GiB avail; 1001 B/s rd, 0 op/s 2024-03-30T13:47:40.837 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:47:40 smithi099 ceph-mon[24912]: pgmap v107: 161 pgs: 161 active+clean; 585 KiB data, 69 MiB used, 715 GiB / 715 GiB avail; 622 B/s rd, 0 op/s 2024-03-30T13:47:40.838 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:47:40 smithi099 ceph-mon[29691]: pgmap v106: 161 pgs: 161 active+clean; 585 KiB data, 69 MiB used, 715 GiB / 715 GiB avail; 1001 B/s rd, 0 op/s 2024-03-30T13:47:40.838 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:47:40 smithi099 ceph-mon[29691]: pgmap v107: 161 pgs: 161 active+clean; 585 KiB data, 69 MiB used, 715 GiB / 715 GiB avail; 622 B/s rd, 0 op/s 2024-03-30T13:47:42.756 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:47:42 smithi181 ceph-mon[25762]: pgmap v108: 161 pgs: 161 active+clean; 585 KiB data, 69 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T13:47:42.837 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:47:42 smithi099 ceph-mon[24912]: pgmap v108: 161 pgs: 161 active+clean; 585 KiB data, 69 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T13:47:42.837 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:47:42 smithi099 ceph-mon[29691]: pgmap v108: 161 pgs: 161 active+clean; 585 KiB data, 69 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T13:47:44.558 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:47:44 smithi181 ceph-mon[25762]: pgmap v109: 161 pgs: 161 active+clean; 585 KiB data, 69 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T13:47:44.837 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:47:44 smithi099 ceph-mon[24912]: pgmap v109: 161 pgs: 161 active+clean; 585 KiB data, 69 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T13:47:44.837 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:47:44 smithi099 ceph-mon[29691]: pgmap v109: 161 pgs: 161 active+clean; 585 KiB data, 69 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T13:47:45.710 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:47:45 smithi181 ceph-mon[25762]: from='mgr.24746 ' entity='mgr.x' 2024-03-30T13:47:45.711 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:47:45 smithi181 ceph-mon[25762]: from='mgr.24746 ' entity='mgr.x' 2024-03-30T13:47:45.711 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:47:45 smithi181 ceph-mon[25762]: pgmap v110: 161 pgs: 161 active+clean; 585 KiB data, 69 MiB used, 715 GiB / 715 GiB avail; 628 B/s rd, 0 op/s 2024-03-30T13:47:45.711 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:47:45 smithi181 ceph-mon[25762]: pgmap v111: 161 pgs: 161 active+clean; 585 KiB data, 69 MiB used, 715 GiB / 715 GiB avail; 833 B/s rd, 0 op/s 2024-03-30T13:47:45.711 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:47:45 smithi181 ceph-mon[25762]: from='mgr.24746 ' entity='mgr.x' 2024-03-30T13:47:45.837 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:47:45 smithi099 ceph-mon[24912]: from='mgr.24746 ' entity='mgr.x' 2024-03-30T13:47:45.837 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:47:45 smithi099 ceph-mon[24912]: from='mgr.24746 ' entity='mgr.x' 2024-03-30T13:47:45.837 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:47:45 smithi099 ceph-mon[24912]: pgmap v110: 161 pgs: 161 active+clean; 585 KiB data, 69 MiB used, 715 GiB / 715 GiB avail; 628 B/s rd, 0 op/s 2024-03-30T13:47:45.837 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:47:45 smithi099 ceph-mon[24912]: pgmap v111: 161 pgs: 161 active+clean; 585 KiB data, 69 MiB used, 715 GiB / 715 GiB avail; 833 B/s rd, 0 op/s 2024-03-30T13:47:45.837 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:47:45 smithi099 ceph-mon[24912]: from='mgr.24746 ' entity='mgr.x' 2024-03-30T13:47:45.838 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:47:45 smithi099 ceph-mon[29691]: from='mgr.24746 ' entity='mgr.x' 2024-03-30T13:47:45.838 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:47:45 smithi099 ceph-mon[29691]: from='mgr.24746 ' entity='mgr.x' 2024-03-30T13:47:45.838 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:47:45 smithi099 ceph-mon[29691]: pgmap v110: 161 pgs: 161 active+clean; 585 KiB data, 69 MiB used, 715 GiB / 715 GiB avail; 628 B/s rd, 0 op/s 2024-03-30T13:47:45.838 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:47:45 smithi099 ceph-mon[29691]: pgmap v111: 161 pgs: 161 active+clean; 585 KiB data, 69 MiB used, 715 GiB / 715 GiB avail; 833 B/s rd, 0 op/s 2024-03-30T13:47:45.838 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:47:45 smithi099 ceph-mon[29691]: from='mgr.24746 ' entity='mgr.x' 2024-03-30T13:47:47.837 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:47:47 smithi099 ceph-mon[24912]: pgmap v112: 161 pgs: 161 active+clean; 585 KiB data, 69 MiB used, 715 GiB / 715 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-03-30T13:47:47.837 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:47:47 smithi099 ceph-mon[29691]: pgmap v112: 161 pgs: 161 active+clean; 585 KiB data, 69 MiB used, 715 GiB / 715 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-03-30T13:47:48.006 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:47:47 smithi181 ceph-mon[25762]: pgmap v112: 161 pgs: 161 active+clean; 585 KiB data, 69 MiB used, 715 GiB / 715 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-03-30T13:47:48.007 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 13:47:47 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-x[50211]: ::ffff:172.21.15.181 - - [30/Mar/2024:13:47:47] "GET /metrics HTTP/1.1" 200 37973 "" "Prometheus/2.33.4" 2024-03-30T13:47:48.587 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:47:48 smithi099 ceph-mon[24912]: from='client.24806 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T13:47:48.587 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:47:48 smithi099 ceph-mon[29691]: from='client.24806 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T13:47:49.006 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:47:48 smithi181 ceph-mon[25762]: from='client.24806 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T13:47:49.007 INFO:journalctl@ceph.prometheus.a.smithi181.stdout:Mar 30 13:47:48 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-prometheus-a[55395]: ts=2024-03-30T13:47:48.660Z caller=manager.go:609 level=warn component="rule manager" group=osd msg="Evaluating rule failed" rule="alert: CephOSDFlapping\nexpr: (rate(ceph_osd_up[5m]) * on(ceph_daemon) group_left(hostname) ceph_osd_metadata)\n * 60 > 1\nlabels:\n oid: 1.3.6.1.4.1.50495.1.2.1.4.4\n severity: warning\n type: ceph_default\nannotations:\n description: OSD {{ $labels.ceph_daemon }} on {{ $labels.hostname }} was marked\n down and back up {{ $value | humanize }} times once a minute for 5 minutes. This\n may indicate a network issue (latency, packet loss, MTU mismatch) on the cluster\n network, or the public network if no cluster network is deployed. Check the network\n stats on the listed host(s).\n documentation: https://docs.ceph.com/en/latest/rados/troubleshooting/troubleshooting-osd#flapping-osds\n summary: Network issues are causing OSDs to flap (mark each other down)\n" err="found duplicate series for the match group {ceph_daemon=\"osd.0\"} on the right hand-side of the operation: [{__name__=\"ceph_osd_metadata\", ceph_daemon=\"osd.0\", ceph_version=\"ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)\", cluster_addr=\"172.21.15.99\", device_class=\"ssd\", hostname=\"smithi099\", instance=\"smithi181:9283\", job=\"ceph\", objectstore=\"bluestore\", public_addr=\"172.21.15.99\"}, {__name__=\"ceph_osd_metadata\", ceph_daemon=\"osd.0\", ceph_version=\"ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)\", cluster_addr=\"172.21.15.99\", device_class=\"ssd\", hostname=\"smithi099\", instance=\"172.21.15.181:9283\", job=\"ceph\", objectstore=\"bluestore\", public_addr=\"172.21.15.99\"}];many-to-many matching not allowed: matching labels must be unique on one side" 2024-03-30T13:47:50.004 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:47:49 smithi181 ceph-mon[25762]: pgmap v113: 161 pgs: 161 active+clean; 585 KiB data, 69 MiB used, 715 GiB / 715 GiB avail; 1.0 KiB/s rd, 1 op/s 2024-03-30T13:47:50.004 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:47:49 smithi181 ceph-mon[25762]: from='mgr.24746 172.21.15.181:0/2892154077' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T13:47:50.087 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:47:49 smithi099 ceph-mon[24912]: pgmap v113: 161 pgs: 161 active+clean; 585 KiB data, 69 MiB used, 715 GiB / 715 GiB avail; 1.0 KiB/s rd, 1 op/s 2024-03-30T13:47:50.087 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:47:49 smithi099 ceph-mon[24912]: from='mgr.24746 172.21.15.181:0/2892154077' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T13:47:50.087 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:47:49 smithi099 ceph-mon[29691]: pgmap v113: 161 pgs: 161 active+clean; 585 KiB data, 69 MiB used, 715 GiB / 715 GiB avail; 1.0 KiB/s rd, 1 op/s 2024-03-30T13:47:50.087 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:47:49 smithi099 ceph-mon[29691]: from='mgr.24746 172.21.15.181:0/2892154077' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T13:47:51.757 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:47:51 smithi181 ceph-mon[25762]: pgmap v114: 161 pgs: 161 active+clean; 585 KiB data, 69 MiB used, 715 GiB / 715 GiB avail; 1.0 KiB/s rd, 1 op/s 2024-03-30T13:47:52.087 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:47:51 smithi099 ceph-mon[24912]: pgmap v114: 161 pgs: 161 active+clean; 585 KiB data, 69 MiB used, 715 GiB / 715 GiB avail; 1.0 KiB/s rd, 1 op/s 2024-03-30T13:47:52.087 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:47:51 smithi099 ceph-mon[29691]: pgmap v114: 161 pgs: 161 active+clean; 585 KiB data, 69 MiB used, 715 GiB / 715 GiB avail; 1.0 KiB/s rd, 1 op/s 2024-03-30T13:47:54.006 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:47:53 smithi181 ceph-mon[25762]: pgmap v115: 161 pgs: 161 active+clean; 585 KiB data, 69 MiB used, 715 GiB / 715 GiB avail; 1.0 KiB/s rd, 1 op/s 2024-03-30T13:47:54.087 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:47:53 smithi099 ceph-mon[24912]: pgmap v115: 161 pgs: 161 active+clean; 585 KiB data, 69 MiB used, 715 GiB / 715 GiB avail; 1.0 KiB/s rd, 1 op/s 2024-03-30T13:47:54.087 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:47:53 smithi099 ceph-mon[29691]: pgmap v115: 161 pgs: 161 active+clean; 585 KiB data, 69 MiB used, 715 GiB / 715 GiB avail; 1.0 KiB/s rd, 1 op/s 2024-03-30T13:47:56.006 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:47:55 smithi181 ceph-mon[25762]: pgmap v116: 161 pgs: 161 active+clean; 585 KiB data, 69 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-03-30T13:47:56.087 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:47:55 smithi099 ceph-mon[24912]: pgmap v116: 161 pgs: 161 active+clean; 585 KiB data, 69 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-03-30T13:47:56.087 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:47:55 smithi099 ceph-mon[29691]: pgmap v116: 161 pgs: 161 active+clean; 585 KiB data, 69 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-03-30T13:47:58.006 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:47:57 smithi181 ceph-mon[25762]: pgmap v117: 161 pgs: 161 active+clean; 585 KiB data, 69 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T13:47:58.006 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 13:47:57 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-x[50211]: ::ffff:172.21.15.181 - - [30/Mar/2024:13:47:57] "GET /metrics HTTP/1.1" 200 37973 "" "Prometheus/2.33.4" 2024-03-30T13:47:58.087 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:47:57 smithi099 ceph-mon[24912]: pgmap v117: 161 pgs: 161 active+clean; 585 KiB data, 69 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T13:47:58.087 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:47:57 smithi099 ceph-mon[29691]: pgmap v117: 161 pgs: 161 active+clean; 585 KiB data, 69 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T13:47:59.006 INFO:journalctl@ceph.prometheus.a.smithi181.stdout:Mar 30 13:47:58 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-prometheus-a[55395]: ts=2024-03-30T13:47:58.660Z caller=manager.go:609 level=warn component="rule manager" group=osd msg="Evaluating rule failed" rule="alert: CephOSDFlapping\nexpr: (rate(ceph_osd_up[5m]) * on(ceph_daemon) group_left(hostname) ceph_osd_metadata)\n * 60 > 1\nlabels:\n oid: 1.3.6.1.4.1.50495.1.2.1.4.4\n severity: warning\n type: ceph_default\nannotations:\n description: OSD {{ $labels.ceph_daemon }} on {{ $labels.hostname }} was marked\n down and back up {{ $value | humanize }} times once a minute for 5 minutes. This\n may indicate a network issue (latency, packet loss, MTU mismatch) on the cluster\n network, or the public network if no cluster network is deployed. Check the network\n stats on the listed host(s).\n documentation: https://docs.ceph.com/en/latest/rados/troubleshooting/troubleshooting-osd#flapping-osds\n summary: Network issues are causing OSDs to flap (mark each other down)\n" err="found duplicate series for the match group {ceph_daemon=\"osd.0\"} on the right hand-side of the operation: [{__name__=\"ceph_osd_metadata\", ceph_daemon=\"osd.0\", ceph_version=\"ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)\", cluster_addr=\"172.21.15.99\", device_class=\"ssd\", hostname=\"smithi099\", instance=\"smithi181:9283\", job=\"ceph\", objectstore=\"bluestore\", public_addr=\"172.21.15.99\"}, {__name__=\"ceph_osd_metadata\", ceph_daemon=\"osd.0\", ceph_version=\"ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)\", cluster_addr=\"172.21.15.99\", device_class=\"ssd\", hostname=\"smithi099\", instance=\"172.21.15.181:9283\", job=\"ceph\", objectstore=\"bluestore\", public_addr=\"172.21.15.99\"}];many-to-many matching not allowed: matching labels must be unique on one side" 2024-03-30T13:47:59.007 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:47:58 smithi181 ceph-mon[25762]: from='client.24806 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T13:47:59.007 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:47:58 smithi181 ceph-mon[25762]: from='mgr.24746 ' entity='mgr.x' 2024-03-30T13:47:59.007 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:47:58 smithi181 ceph-mon[25762]: from='mgr.24746 ' entity='mgr.x' 2024-03-30T13:47:59.007 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:47:58 smithi181 ceph-mon[25762]: from='mgr.24746 ' entity='mgr.x' 2024-03-30T13:47:59.087 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:47:58 smithi099 ceph-mon[29691]: from='client.24806 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T13:47:59.087 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:47:58 smithi099 ceph-mon[29691]: from='mgr.24746 ' entity='mgr.x' 2024-03-30T13:47:59.087 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:47:58 smithi099 ceph-mon[29691]: from='mgr.24746 ' entity='mgr.x' 2024-03-30T13:47:59.087 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:47:58 smithi099 ceph-mon[29691]: from='mgr.24746 ' entity='mgr.x' 2024-03-30T13:47:59.087 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:47:58 smithi099 ceph-mon[24912]: from='client.24806 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T13:47:59.088 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:47:58 smithi099 ceph-mon[24912]: from='mgr.24746 ' entity='mgr.x' 2024-03-30T13:47:59.088 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:47:58 smithi099 ceph-mon[24912]: from='mgr.24746 ' entity='mgr.x' 2024-03-30T13:47:59.088 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:47:58 smithi099 ceph-mon[24912]: from='mgr.24746 ' entity='mgr.x' 2024-03-30T13:47:59.954 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:47:59 smithi099 ceph-mon[24912]: pgmap v118: 161 pgs: 161 active+clean; 585 KiB data, 69 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T13:47:59.954 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:47:59 smithi099 ceph-mon[24912]: pgmap v119: 161 pgs: 161 active+clean; 585 KiB data, 69 MiB used, 715 GiB / 715 GiB avail; 1002 B/s rd, 0 op/s 2024-03-30T13:47:59.954 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:47:59 smithi099 ceph-mon[24912]: pgmap v120: 161 pgs: 161 active+clean; 585 KiB data, 69 MiB used, 715 GiB / 715 GiB avail; 623 B/s rd, 0 op/s 2024-03-30T13:47:59.955 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:47:59 smithi099 ceph-mon[29691]: pgmap v118: 161 pgs: 161 active+clean; 585 KiB data, 69 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T13:47:59.955 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:47:59 smithi099 ceph-mon[29691]: pgmap v119: 161 pgs: 161 active+clean; 585 KiB data, 69 MiB used, 715 GiB / 715 GiB avail; 1002 B/s rd, 0 op/s 2024-03-30T13:47:59.955 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:47:59 smithi099 ceph-mon[29691]: pgmap v120: 161 pgs: 161 active+clean; 585 KiB data, 69 MiB used, 715 GiB / 715 GiB avail; 623 B/s rd, 0 op/s 2024-03-30T13:48:00.006 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:47:59 smithi181 ceph-mon[25762]: pgmap v118: 161 pgs: 161 active+clean; 585 KiB data, 69 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T13:48:00.006 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:47:59 smithi181 ceph-mon[25762]: pgmap v119: 161 pgs: 161 active+clean; 585 KiB data, 69 MiB used, 715 GiB / 715 GiB avail; 1002 B/s rd, 0 op/s 2024-03-30T13:48:00.006 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:47:59 smithi181 ceph-mon[25762]: pgmap v120: 161 pgs: 161 active+clean; 585 KiB data, 69 MiB used, 715 GiB / 715 GiB avail; 623 B/s rd, 0 op/s 2024-03-30T13:48:02.006 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:48:01 smithi181 ceph-mon[25762]: pgmap v121: 161 pgs: 161 active+clean; 585 KiB data, 69 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T13:48:02.036 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:48:01 smithi099 ceph-mon[24912]: pgmap v121: 161 pgs: 161 active+clean; 585 KiB data, 69 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T13:48:02.036 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:48:01 smithi099 ceph-mon[29691]: pgmap v121: 161 pgs: 161 active+clean; 585 KiB data, 69 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T13:48:04.006 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:48:03 smithi181 ceph-mon[25762]: pgmap v122: 161 pgs: 161 active+clean; 585 KiB data, 69 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T13:48:04.087 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:48:03 smithi099 ceph-mon[24912]: pgmap v122: 161 pgs: 161 active+clean; 585 KiB data, 69 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T13:48:04.087 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:48:03 smithi099 ceph-mon[29691]: pgmap v122: 161 pgs: 161 active+clean; 585 KiB data, 69 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T13:48:05.006 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:48:04 smithi181 ceph-mon[25762]: from='mgr.24746 172.21.15.181:0/2892154077' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T13:48:05.006 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:48:04 smithi181 ceph-mon[25762]: from='mgr.24746 ' entity='mgr.x' 2024-03-30T13:48:05.006 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:48:04 smithi181 ceph-mon[25762]: from='mgr.24746 ' entity='mgr.x' 2024-03-30T13:48:05.006 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:48:04 smithi181 ceph-mon[25762]: from='mgr.24746 ' entity='mgr.x' 2024-03-30T13:48:05.087 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:48:04 smithi099 ceph-mon[24912]: from='mgr.24746 172.21.15.181:0/2892154077' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T13:48:05.087 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:48:04 smithi099 ceph-mon[24912]: from='mgr.24746 ' entity='mgr.x' 2024-03-30T13:48:05.087 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:48:04 smithi099 ceph-mon[24912]: from='mgr.24746 ' entity='mgr.x' 2024-03-30T13:48:05.087 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:48:04 smithi099 ceph-mon[24912]: from='mgr.24746 ' entity='mgr.x' 2024-03-30T13:48:05.087 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:48:04 smithi099 ceph-mon[29691]: from='mgr.24746 172.21.15.181:0/2892154077' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T13:48:05.088 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:48:04 smithi099 ceph-mon[29691]: from='mgr.24746 ' entity='mgr.x' 2024-03-30T13:48:05.088 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:48:04 smithi099 ceph-mon[29691]: from='mgr.24746 ' entity='mgr.x' 2024-03-30T13:48:05.088 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:48:04 smithi099 ceph-mon[29691]: from='mgr.24746 ' entity='mgr.x' 2024-03-30T13:48:06.006 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:48:05 smithi181 ceph-mon[25762]: pgmap v123: 161 pgs: 161 active+clean; 585 KiB data, 69 MiB used, 715 GiB / 715 GiB avail; 628 B/s rd, 0 op/s 2024-03-30T13:48:06.006 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:48:05 smithi181 ceph-mon[25762]: pgmap v124: 161 pgs: 161 active+clean; 585 KiB data, 69 MiB used, 715 GiB / 715 GiB avail; 833 B/s rd, 0 op/s 2024-03-30T13:48:06.087 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:48:05 smithi099 ceph-mon[24912]: pgmap v123: 161 pgs: 161 active+clean; 585 KiB data, 69 MiB used, 715 GiB / 715 GiB avail; 628 B/s rd, 0 op/s 2024-03-30T13:48:06.087 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:48:05 smithi099 ceph-mon[24912]: pgmap v124: 161 pgs: 161 active+clean; 585 KiB data, 69 MiB used, 715 GiB / 715 GiB avail; 833 B/s rd, 0 op/s 2024-03-30T13:48:06.087 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:48:05 smithi099 ceph-mon[29691]: pgmap v123: 161 pgs: 161 active+clean; 585 KiB data, 69 MiB used, 715 GiB / 715 GiB avail; 628 B/s rd, 0 op/s 2024-03-30T13:48:06.087 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:48:05 smithi099 ceph-mon[29691]: pgmap v124: 161 pgs: 161 active+clean; 585 KiB data, 69 MiB used, 715 GiB / 715 GiB avail; 833 B/s rd, 0 op/s 2024-03-30T13:48:07.438 DEBUG:teuthology.orchestra.run.smithi099:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 98ebaeb8-ee99-11ee-b647-cb9ed24678a4 -e sha1=4e50bbcdd1630c7760b708f3a5b4d38a121e66cb -- bash -c 'ceph orch daemon redeploy "mgr.$(ceph mgr dump -f json | jq .standbys | jq .[] | jq -r .name)" --image quay.ceph.io/ceph-ci/ceph:$sha1' 2024-03-30T13:48:08.006 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:48:07 smithi181 ceph-mon[25762]: pgmap v125: 161 pgs: 161 active+clean; 585 KiB data, 69 MiB used, 715 GiB / 715 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-03-30T13:48:08.007 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 13:48:07 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-x[50211]: ::ffff:172.21.15.181 - - [30/Mar/2024:13:48:07] "GET /metrics HTTP/1.1" 200 37971 "" "Prometheus/2.33.4" 2024-03-30T13:48:08.077 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:48:07 smithi099 ceph-mon[24912]: pgmap v125: 161 pgs: 161 active+clean; 585 KiB data, 69 MiB used, 715 GiB / 715 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-03-30T13:48:08.078 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:48:07 smithi099 ceph-mon[29691]: pgmap v125: 161 pgs: 161 active+clean; 585 KiB data, 69 MiB used, 715 GiB / 715 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-03-30T13:48:08.981 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:48:08 smithi099 ceph-mon[24912]: from='client.24806 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T13:48:08.981 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:48:08 smithi099 ceph-mon[29691]: from='client.24806 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T13:48:09.006 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:48:08 smithi181 ceph-mon[25762]: from='client.24806 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T13:48:09.006 INFO:journalctl@ceph.prometheus.a.smithi181.stdout:Mar 30 13:48:08 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-prometheus-a[55395]: ts=2024-03-30T13:48:08.660Z caller=manager.go:609 level=warn component="rule manager" group=osd msg="Evaluating rule failed" rule="alert: CephOSDFlapping\nexpr: (rate(ceph_osd_up[5m]) * on(ceph_daemon) group_left(hostname) ceph_osd_metadata)\n * 60 > 1\nlabels:\n oid: 1.3.6.1.4.1.50495.1.2.1.4.4\n severity: warning\n type: ceph_default\nannotations:\n description: OSD {{ $labels.ceph_daemon }} on {{ $labels.hostname }} was marked\n down and back up {{ $value | humanize }} times once a minute for 5 minutes. This\n may indicate a network issue (latency, packet loss, MTU mismatch) on the cluster\n network, or the public network if no cluster network is deployed. Check the network\n stats on the listed host(s).\n documentation: https://docs.ceph.com/en/latest/rados/troubleshooting/troubleshooting-osd#flapping-osds\n summary: Network issues are causing OSDs to flap (mark each other down)\n" err="found duplicate series for the match group {ceph_daemon=\"osd.0\"} on the right hand-side of the operation: [{__name__=\"ceph_osd_metadata\", ceph_daemon=\"osd.0\", ceph_version=\"ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)\", cluster_addr=\"172.21.15.99\", device_class=\"ssd\", hostname=\"smithi099\", instance=\"smithi181:9283\", job=\"ceph\", objectstore=\"bluestore\", public_addr=\"172.21.15.99\"}, {__name__=\"ceph_osd_metadata\", ceph_daemon=\"osd.0\", ceph_version=\"ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)\", cluster_addr=\"172.21.15.99\", device_class=\"ssd\", hostname=\"smithi099\", instance=\"172.21.15.181:9283\", job=\"ceph\", objectstore=\"bluestore\", public_addr=\"172.21.15.99\"}];many-to-many matching not allowed: matching labels must be unique on one side" 2024-03-30T13:48:09.884 INFO:teuthology.orchestra.run.smithi099.stdout:Scheduled to redeploy mgr.y on host 'smithi099' 2024-03-30T13:48:10.006 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:48:09 smithi181 ceph-mon[25762]: pgmap v126: 161 pgs: 161 active+clean; 585 KiB data, 69 MiB used, 715 GiB / 715 GiB avail; 1.0 KiB/s rd, 1 op/s 2024-03-30T13:48:10.006 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:48:09 smithi181 ceph-mon[25762]: from='client.? 172.21.15.99:0/426827720' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-03-30T13:48:10.087 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:48:09 smithi099 ceph-mon[24912]: pgmap v126: 161 pgs: 161 active+clean; 585 KiB data, 69 MiB used, 715 GiB / 715 GiB avail; 1.0 KiB/s rd, 1 op/s 2024-03-30T13:48:10.087 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:48:09 smithi099 ceph-mon[24912]: from='client.? 172.21.15.99:0/426827720' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-03-30T13:48:10.087 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:48:09 smithi099 ceph-mon[29691]: pgmap v126: 161 pgs: 161 active+clean; 585 KiB data, 69 MiB used, 715 GiB / 715 GiB avail; 1.0 KiB/s rd, 1 op/s 2024-03-30T13:48:10.087 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:48:09 smithi099 ceph-mon[29691]: from='client.? 172.21.15.99:0/426827720' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-03-30T13:48:10.618 DEBUG:teuthology.orchestra.run.smithi099:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 98ebaeb8-ee99-11ee-b647-cb9ed24678a4 -e sha1=4e50bbcdd1630c7760b708f3a5b4d38a121e66cb -- bash -c 'ceph orch ps --refresh' 2024-03-30T13:48:11.242 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:48:10 smithi099 ceph-mon[24912]: from='client.15150 -' entity='client.admin' cmd=[{"prefix": "orch daemon redeploy", "name": "mgr.y", "image": "quay.ceph.io/ceph-ci/ceph:4e50bbcdd1630c7760b708f3a5b4d38a121e66cb", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T13:48:11.242 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:48:10 smithi099 ceph-mon[24912]: from='mgr.24746 ' entity='mgr.x' 2024-03-30T13:48:11.242 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:48:10 smithi099 ceph-mon[24912]: Schedule redeploy daemon mgr.y 2024-03-30T13:48:11.242 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:48:10 smithi099 ceph-mon[24912]: from='mgr.24746 ' entity='mgr.x' 2024-03-30T13:48:11.243 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:48:10 smithi099 ceph-mon[24912]: from='mgr.24746 ' entity='mgr.x' 2024-03-30T13:48:11.243 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:48:10 smithi099 ceph-mon[24912]: from='mgr.24746 172.21.15.181:0/2892154077' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:48:11.243 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:48:10 smithi099 ceph-mon[24912]: from='mgr.24746 172.21.15.181:0/2892154077' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:48:11.243 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:48:10 smithi099 ceph-mon[24912]: pgmap v127: 161 pgs: 161 active+clean; 585 KiB data, 69 MiB used, 715 GiB / 715 GiB avail; 554 B/s rd, 0 op/s 2024-03-30T13:48:11.243 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:48:10 smithi099 ceph-mon[24912]: pgmap v128: 161 pgs: 161 active+clean; 585 KiB data, 69 MiB used, 715 GiB / 715 GiB avail; 707 B/s rd, 0 op/s 2024-03-30T13:48:11.243 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:48:10 smithi099 ceph-mon[24912]: from='mgr.24746 ' entity='mgr.x' 2024-03-30T13:48:11.243 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:48:10 smithi099 ceph-mon[24912]: from='mgr.24746 172.21.15.181:0/2892154077' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-03-30T13:48:11.243 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:48:10 smithi099 ceph-mon[24912]: from='mgr.24746 ' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-03-30T13:48:11.243 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:48:10 smithi099 ceph-mon[24912]: from='mgr.24746 172.21.15.181:0/2892154077' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-03-30T13:48:11.243 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:48:10 smithi099 ceph-mon[24912]: from='mgr.24746 172.21.15.181:0/2892154077' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:48:11.243 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:48:10 smithi099 ceph-mon[24912]: Deploying daemon mgr.y on smithi099 2024-03-30T13:48:11.244 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:48:10 smithi099 ceph-mon[29691]: from='client.15150 -' entity='client.admin' cmd=[{"prefix": "orch daemon redeploy", "name": "mgr.y", "image": "quay.ceph.io/ceph-ci/ceph:4e50bbcdd1630c7760b708f3a5b4d38a121e66cb", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T13:48:11.244 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:48:10 smithi099 ceph-mon[29691]: from='mgr.24746 ' entity='mgr.x' 2024-03-30T13:48:11.244 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:48:10 smithi099 ceph-mon[29691]: Schedule redeploy daemon mgr.y 2024-03-30T13:48:11.244 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:48:10 smithi099 ceph-mon[29691]: from='mgr.24746 ' entity='mgr.x' 2024-03-30T13:48:11.244 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:48:10 smithi099 ceph-mon[29691]: from='mgr.24746 ' entity='mgr.x' 2024-03-30T13:48:11.244 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:48:10 smithi099 ceph-mon[29691]: from='mgr.24746 172.21.15.181:0/2892154077' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:48:11.244 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:48:10 smithi099 ceph-mon[29691]: from='mgr.24746 172.21.15.181:0/2892154077' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:48:11.244 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:48:10 smithi099 ceph-mon[29691]: pgmap v127: 161 pgs: 161 active+clean; 585 KiB data, 69 MiB used, 715 GiB / 715 GiB avail; 554 B/s rd, 0 op/s 2024-03-30T13:48:11.244 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:48:10 smithi099 ceph-mon[29691]: pgmap v128: 161 pgs: 161 active+clean; 585 KiB data, 69 MiB used, 715 GiB / 715 GiB avail; 707 B/s rd, 0 op/s 2024-03-30T13:48:11.244 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:48:10 smithi099 ceph-mon[29691]: from='mgr.24746 ' entity='mgr.x' 2024-03-30T13:48:11.244 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:48:10 smithi099 ceph-mon[29691]: from='mgr.24746 172.21.15.181:0/2892154077' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-03-30T13:48:11.244 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:48:10 smithi099 ceph-mon[29691]: from='mgr.24746 ' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-03-30T13:48:11.244 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:48:10 smithi099 ceph-mon[29691]: from='mgr.24746 172.21.15.181:0/2892154077' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-03-30T13:48:11.245 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:48:10 smithi099 ceph-mon[29691]: from='mgr.24746 172.21.15.181:0/2892154077' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:48:11.245 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:48:10 smithi099 ceph-mon[29691]: Deploying daemon mgr.y on smithi099 2024-03-30T13:48:11.257 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:48:10 smithi181 ceph-mon[25762]: from='client.15150 -' entity='client.admin' cmd=[{"prefix": "orch daemon redeploy", "name": "mgr.y", "image": "quay.ceph.io/ceph-ci/ceph:4e50bbcdd1630c7760b708f3a5b4d38a121e66cb", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T13:48:11.257 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:48:10 smithi181 ceph-mon[25762]: from='mgr.24746 ' entity='mgr.x' 2024-03-30T13:48:11.257 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:48:10 smithi181 ceph-mon[25762]: Schedule redeploy daemon mgr.y 2024-03-30T13:48:11.257 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:48:10 smithi181 ceph-mon[25762]: from='mgr.24746 ' entity='mgr.x' 2024-03-30T13:48:11.257 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:48:10 smithi181 ceph-mon[25762]: from='mgr.24746 ' entity='mgr.x' 2024-03-30T13:48:11.257 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:48:10 smithi181 ceph-mon[25762]: from='mgr.24746 172.21.15.181:0/2892154077' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:48:11.257 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:48:10 smithi181 ceph-mon[25762]: from='mgr.24746 172.21.15.181:0/2892154077' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:48:11.257 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:48:10 smithi181 ceph-mon[25762]: pgmap v127: 161 pgs: 161 active+clean; 585 KiB data, 69 MiB used, 715 GiB / 715 GiB avail; 554 B/s rd, 0 op/s 2024-03-30T13:48:11.257 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:48:10 smithi181 ceph-mon[25762]: pgmap v128: 161 pgs: 161 active+clean; 585 KiB data, 69 MiB used, 715 GiB / 715 GiB avail; 707 B/s rd, 0 op/s 2024-03-30T13:48:11.257 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:48:10 smithi181 ceph-mon[25762]: from='mgr.24746 ' entity='mgr.x' 2024-03-30T13:48:11.257 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:48:10 smithi181 ceph-mon[25762]: from='mgr.24746 172.21.15.181:0/2892154077' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-03-30T13:48:11.257 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:48:10 smithi181 ceph-mon[25762]: from='mgr.24746 ' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-03-30T13:48:11.258 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:48:10 smithi181 ceph-mon[25762]: from='mgr.24746 172.21.15.181:0/2892154077' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-03-30T13:48:11.258 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:48:10 smithi181 ceph-mon[25762]: from='mgr.24746 172.21.15.181:0/2892154077' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:48:11.258 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:48:10 smithi181 ceph-mon[25762]: Deploying daemon mgr.y on smithi099 2024-03-30T13:48:13.017 INFO:teuthology.orchestra.run.smithi099.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-03-30T13:48:13.017 INFO:teuthology.orchestra.run.smithi099.stdout:agent.smithi099 smithi099 running 14s ago 16m - - 2024-03-30T13:48:13.017 INFO:teuthology.orchestra.run.smithi099.stdout:agent.smithi181 smithi181 running 8s ago 16m - - 2024-03-30T13:48:13.017 INFO:teuthology.orchestra.run.smithi099.stdout:alertmanager.a smithi099 *:9093,9094 running (2m) 14s ago 10m 25.6M - 0.23.0 ba2b418f427c 0f1be3801027 2024-03-30T13:48:13.017 INFO:teuthology.orchestra.run.smithi099.stdout:grafana.a smithi181 *:3000 error 8s ago 10m - - 2024-03-30T13:48:13.018 INFO:teuthology.orchestra.run.smithi099.stdout:iscsi.foo.smithi099.qyjuvr smithi099 running (2m) 14s ago 9m 53.0M - 3.5 e1d6a67b021e e34931b9505a 2024-03-30T13:48:13.018 INFO:teuthology.orchestra.run.smithi099.stdout:mgr.x smithi181 *:8443,9283 running (5m) 8s ago 15m 513M - 19.0.0-1967-g4e50bbcd b0c4478f1d83 f3d971ab3b10 2024-03-30T13:48:13.018 INFO:teuthology.orchestra.run.smithi099.stdout:mgr.y smithi099 *:9283 running (17m) 14s ago 17m 411M - 17.2.0 e1d6a67b021e db3430cee99a 2024-03-30T13:48:13.018 INFO:teuthology.orchestra.run.smithi099.stdout:mon.a smithi099 running (17m) 14s ago 17m 63.7M 2048M 17.2.0 e1d6a67b021e af06ebb19fd8 2024-03-30T13:48:13.018 INFO:teuthology.orchestra.run.smithi099.stdout:mon.b smithi181 running (16m) 8s ago 15m 46.0M 2048M 17.2.0 e1d6a67b021e e678a2a25c90 2024-03-30T13:48:13.018 INFO:teuthology.orchestra.run.smithi099.stdout:mon.c smithi099 running (16m) 14s ago 16m 45.0M 2048M 17.2.0 e1d6a67b021e 0f1e98917718 2024-03-30T13:48:13.018 INFO:teuthology.orchestra.run.smithi099.stdout:node-exporter.a smithi099 *:9100 running (3m) 14s ago 11m 19.0M - 1.3.1 1dbe0e931976 76284405d5f5 2024-03-30T13:48:13.018 INFO:teuthology.orchestra.run.smithi099.stdout:node-exporter.b smithi181 *:9100 running (2m) 8s ago 11m 17.0M - 1.3.1 1dbe0e931976 90245951476f 2024-03-30T13:48:13.018 INFO:teuthology.orchestra.run.smithi099.stdout:osd.0 smithi099 running (15m) 14s ago 15m 51.9M 4096M 17.2.0 e1d6a67b021e 3158ee1b0c67 2024-03-30T13:48:13.018 INFO:teuthology.orchestra.run.smithi099.stdout:osd.1 smithi099 running (15m) 14s ago 15m 54.8M 4096M 17.2.0 e1d6a67b021e c4af0fd7071a 2024-03-30T13:48:13.018 INFO:teuthology.orchestra.run.smithi099.stdout:osd.2 smithi099 running (14m) 14s ago 14m 47.4M 4096M 17.2.0 e1d6a67b021e 8e4e805a7e20 2024-03-30T13:48:13.018 INFO:teuthology.orchestra.run.smithi099.stdout:osd.3 smithi099 running (14m) 14s ago 14m 51.4M 4096M 17.2.0 e1d6a67b021e 718812bcf065 2024-03-30T13:48:13.018 INFO:teuthology.orchestra.run.smithi099.stdout:osd.4 smithi181 running (13m) 8s ago 13m 51.2M 4096M 17.2.0 e1d6a67b021e 5e205434e973 2024-03-30T13:48:13.019 INFO:teuthology.orchestra.run.smithi099.stdout:osd.5 smithi181 running (13m) 8s ago 13m 50.1M 4096M 17.2.0 e1d6a67b021e e330c920f152 2024-03-30T13:48:13.019 INFO:teuthology.orchestra.run.smithi099.stdout:osd.6 smithi181 running (13m) 8s ago 13m 48.6M 4096M 17.2.0 e1d6a67b021e 81d889ea213d 2024-03-30T13:48:13.019 INFO:teuthology.orchestra.run.smithi099.stdout:osd.7 smithi181 running (12m) 8s ago 12m 50.1M 4096M 17.2.0 e1d6a67b021e c08b1839dd7e 2024-03-30T13:48:13.019 INFO:teuthology.orchestra.run.smithi099.stdout:prometheus.a smithi181 *:9095 running (2m) 8s ago 11m 63.7M - 2.33.4 514e6a882f6e fe9273415d72 2024-03-30T13:48:13.019 INFO:teuthology.orchestra.run.smithi099.stdout:rgw.foo.smithi099.fxjbmp smithi099 *:8000 running (10m) 14s ago 10m 72.1M - 17.2.0 e1d6a67b021e 400b28b3f650 2024-03-30T13:48:13.019 INFO:teuthology.orchestra.run.smithi099.stdout:rgw.foo.smithi181.wfqwti smithi181 *:8000 running (10m) 8s ago 10m 71.7M - 17.2.0 e1d6a67b021e 97e1b130f9d4 2024-03-30T13:48:13.087 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:48:12 smithi099 ceph-mon[24912]: pgmap v129: 161 pgs: 161 active+clean; 585 KiB data, 78 MiB used, 715 GiB / 715 GiB avail; 60 KiB/s rd, 0 B/s wr, 99 op/s 2024-03-30T13:48:13.087 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:48:12 smithi099 ceph-mon[29691]: pgmap v129: 161 pgs: 161 active+clean; 585 KiB data, 78 MiB used, 715 GiB / 715 GiB avail; 60 KiB/s rd, 0 B/s wr, 99 op/s 2024-03-30T13:48:13.256 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:48:12 smithi181 ceph-mon[25762]: pgmap v129: 161 pgs: 161 active+clean; 585 KiB data, 78 MiB used, 715 GiB / 715 GiB avail; 60 KiB/s rd, 0 B/s wr, 99 op/s 2024-03-30T13:48:13.841 DEBUG:teuthology.orchestra.run.smithi099:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 98ebaeb8-ee99-11ee-b647-cb9ed24678a4 -e sha1=4e50bbcdd1630c7760b708f3a5b4d38a121e66cb -- bash -c 'sleep 180' 2024-03-30T13:48:14.087 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:48:13 smithi099 ceph-mon[24912]: from='client.15156 -' entity='client.admin' cmd=[{"prefix": "orch ps", "refresh": true, "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T13:48:14.087 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:48:13 smithi099 ceph-mon[29691]: from='client.15156 -' entity='client.admin' cmd=[{"prefix": "orch ps", "refresh": true, "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T13:48:14.256 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:48:13 smithi181 ceph-mon[25762]: from='client.15156 -' entity='client.admin' cmd=[{"prefix": "orch ps", "refresh": true, "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T13:48:15.256 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:48:14 smithi181 ceph-mon[25762]: pgmap v130: 161 pgs: 161 active+clean; 585 KiB data, 78 MiB used, 715 GiB / 715 GiB avail; 47 KiB/s rd, 0 B/s wr, 77 op/s 2024-03-30T13:48:15.338 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:48:14 smithi099 ceph-mon[24912]: pgmap v130: 161 pgs: 161 active+clean; 585 KiB data, 78 MiB used, 715 GiB / 715 GiB avail; 47 KiB/s rd, 0 B/s wr, 77 op/s 2024-03-30T13:48:15.338 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:48:14 smithi099 ceph-mon[29691]: pgmap v130: 161 pgs: 161 active+clean; 585 KiB data, 78 MiB used, 715 GiB / 715 GiB avail; 47 KiB/s rd, 0 B/s wr, 77 op/s 2024-03-30T13:48:17.218 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:48:16 smithi099 ceph-mon[24912]: pgmap v131: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 93 KiB/s rd, 0 B/s wr, 154 op/s 2024-03-30T13:48:17.218 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:48:16 smithi099 ceph-mon[29691]: pgmap v131: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 93 KiB/s rd, 0 B/s wr, 154 op/s 2024-03-30T13:48:17.256 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:48:16 smithi181 ceph-mon[25762]: pgmap v131: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 93 KiB/s rd, 0 B/s wr, 154 op/s 2024-03-30T13:48:18.006 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 13:48:17 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-x[50211]: ::ffff:172.21.15.181 - - [30/Mar/2024:13:48:17] "GET /metrics HTTP/1.1" 200 37971 "" "Prometheus/2.33.4" 2024-03-30T13:48:18.983 INFO:journalctl@ceph.prometheus.a.smithi181.stdout:Mar 30 13:48:18 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-prometheus-a[55395]: ts=2024-03-30T13:48:18.660Z caller=manager.go:609 level=warn component="rule manager" group=osd msg="Evaluating rule failed" rule="alert: CephOSDFlapping\nexpr: (rate(ceph_osd_up[5m]) * on(ceph_daemon) group_left(hostname) ceph_osd_metadata)\n * 60 > 1\nlabels:\n oid: 1.3.6.1.4.1.50495.1.2.1.4.4\n severity: warning\n type: ceph_default\nannotations:\n description: OSD {{ $labels.ceph_daemon }} on {{ $labels.hostname }} was marked\n down and back up {{ $value | humanize }} times once a minute for 5 minutes. This\n may indicate a network issue (latency, packet loss, MTU mismatch) on the cluster\n network, or the public network if no cluster network is deployed. Check the network\n stats on the listed host(s).\n documentation: https://docs.ceph.com/en/latest/rados/troubleshooting/troubleshooting-osd#flapping-osds\n summary: Network issues are causing OSDs to flap (mark each other down)\n" err="found duplicate series for the match group {ceph_daemon=\"osd.0\"} on the right hand-side of the operation: [{__name__=\"ceph_osd_metadata\", ceph_daemon=\"osd.0\", ceph_version=\"ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)\", cluster_addr=\"172.21.15.99\", device_class=\"ssd\", hostname=\"smithi099\", instance=\"smithi181:9283\", job=\"ceph\", objectstore=\"bluestore\", public_addr=\"172.21.15.99\"}, {__name__=\"ceph_osd_metadata\", ceph_daemon=\"osd.0\", ceph_version=\"ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)\", cluster_addr=\"172.21.15.99\", device_class=\"ssd\", hostname=\"smithi099\", instance=\"172.21.15.181:9283\", job=\"ceph\", objectstore=\"bluestore\", public_addr=\"172.21.15.99\"}];many-to-many matching not allowed: matching labels must be unique on one side" 2024-03-30T13:48:19.087 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:48:18 smithi099 ceph-mon[29691]: from='client.24806 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T13:48:19.087 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:48:18 smithi099 ceph-mon[29691]: pgmap v132: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 93 KiB/s rd, 0 B/s wr, 154 op/s 2024-03-30T13:48:19.087 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:48:18 smithi099 ceph-mon[29691]: from='mgr.24746 ' entity='mgr.x' 2024-03-30T13:48:19.087 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:48:18 smithi099 ceph-mon[29691]: from='mgr.24746 ' entity='mgr.x' 2024-03-30T13:48:19.087 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:48:18 smithi099 ceph-mon[29691]: from='mgr.24746 ' entity='mgr.x' 2024-03-30T13:48:19.087 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:48:18 smithi099 ceph-mon[24912]: from='client.24806 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T13:48:19.088 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:48:18 smithi099 ceph-mon[24912]: pgmap v132: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 93 KiB/s rd, 0 B/s wr, 154 op/s 2024-03-30T13:48:19.088 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:48:18 smithi099 ceph-mon[24912]: from='mgr.24746 ' entity='mgr.x' 2024-03-30T13:48:19.088 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:48:18 smithi099 ceph-mon[24912]: from='mgr.24746 ' entity='mgr.x' 2024-03-30T13:48:19.088 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:48:18 smithi099 ceph-mon[24912]: from='mgr.24746 ' entity='mgr.x' 2024-03-30T13:48:19.256 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:48:18 smithi181 ceph-mon[25762]: from='client.24806 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T13:48:19.256 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:48:18 smithi181 ceph-mon[25762]: pgmap v132: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 93 KiB/s rd, 0 B/s wr, 154 op/s 2024-03-30T13:48:19.256 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:48:18 smithi181 ceph-mon[25762]: from='mgr.24746 ' entity='mgr.x' 2024-03-30T13:48:19.256 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:48:18 smithi181 ceph-mon[25762]: from='mgr.24746 ' entity='mgr.x' 2024-03-30T13:48:19.256 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:48:18 smithi181 ceph-mon[25762]: from='mgr.24746 ' entity='mgr.x' 2024-03-30T13:48:20.256 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:48:19 smithi181 ceph-mon[25762]: pgmap v133: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 98 KiB/s rd, 0 B/s wr, 161 op/s 2024-03-30T13:48:20.256 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:48:19 smithi181 ceph-mon[25762]: pgmap v134: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 98 KiB/s rd, 0 B/s wr, 161 op/s 2024-03-30T13:48:20.256 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:48:19 smithi181 ceph-mon[25762]: from='mgr.24746 172.21.15.181:0/2892154077' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T13:48:20.337 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:48:19 smithi099 ceph-mon[29691]: pgmap v133: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 98 KiB/s rd, 0 B/s wr, 161 op/s 2024-03-30T13:48:20.337 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:48:19 smithi099 ceph-mon[29691]: pgmap v134: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 98 KiB/s rd, 0 B/s wr, 161 op/s 2024-03-30T13:48:20.337 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:48:19 smithi099 ceph-mon[29691]: from='mgr.24746 172.21.15.181:0/2892154077' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T13:48:20.337 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:48:19 smithi099 ceph-mon[24912]: pgmap v133: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 98 KiB/s rd, 0 B/s wr, 161 op/s 2024-03-30T13:48:20.337 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:48:19 smithi099 ceph-mon[24912]: pgmap v134: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 98 KiB/s rd, 0 B/s wr, 161 op/s 2024-03-30T13:48:20.337 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:48:19 smithi099 ceph-mon[24912]: from='mgr.24746 172.21.15.181:0/2892154077' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T13:48:22.256 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:48:21 smithi181 ceph-mon[25762]: pgmap v135: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 49 KiB/s rd, 0 B/s wr, 81 op/s 2024-03-30T13:48:22.337 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:48:21 smithi099 ceph-mon[24912]: pgmap v135: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 49 KiB/s rd, 0 B/s wr, 81 op/s 2024-03-30T13:48:22.337 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:48:21 smithi099 ceph-mon[29691]: pgmap v135: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 49 KiB/s rd, 0 B/s wr, 81 op/s 2024-03-30T13:48:24.256 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:48:23 smithi181 ceph-mon[25762]: pgmap v136: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 49 KiB/s rd, 0 B/s wr, 81 op/s 2024-03-30T13:48:24.337 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:48:23 smithi099 ceph-mon[24912]: pgmap v136: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 49 KiB/s rd, 0 B/s wr, 81 op/s 2024-03-30T13:48:24.337 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:48:23 smithi099 ceph-mon[29691]: pgmap v136: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 49 KiB/s rd, 0 B/s wr, 81 op/s 2024-03-30T13:48:26.007 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:48:25 smithi181 ceph-mon[25762]: from='mgr.24746 ' entity='mgr.x' 2024-03-30T13:48:26.007 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:48:25 smithi181 ceph-mon[25762]: from='mgr.24746 ' entity='mgr.x' 2024-03-30T13:48:26.007 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:48:25 smithi181 ceph-mon[25762]: pgmap v137: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 579 B/s rd, 0 op/s 2024-03-30T13:48:26.007 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:48:25 smithi181 ceph-mon[25762]: pgmap v138: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 749 B/s rd, 0 op/s 2024-03-30T13:48:26.007 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:48:25 smithi181 ceph-mon[25762]: from='mgr.24746 ' entity='mgr.x' 2024-03-30T13:48:26.087 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:48:25 smithi099 ceph-mon[29691]: from='mgr.24746 ' entity='mgr.x' 2024-03-30T13:48:26.087 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:48:25 smithi099 ceph-mon[29691]: from='mgr.24746 ' entity='mgr.x' 2024-03-30T13:48:26.088 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:48:25 smithi099 ceph-mon[29691]: pgmap v137: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 579 B/s rd, 0 op/s 2024-03-30T13:48:26.088 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:48:25 smithi099 ceph-mon[29691]: pgmap v138: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 749 B/s rd, 0 op/s 2024-03-30T13:48:26.088 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:48:25 smithi099 ceph-mon[29691]: from='mgr.24746 ' entity='mgr.x' 2024-03-30T13:48:26.088 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:48:25 smithi099 ceph-mon[24912]: from='mgr.24746 ' entity='mgr.x' 2024-03-30T13:48:26.088 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:48:25 smithi099 ceph-mon[24912]: from='mgr.24746 ' entity='mgr.x' 2024-03-30T13:48:26.088 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:48:25 smithi099 ceph-mon[24912]: pgmap v137: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 579 B/s rd, 0 op/s 2024-03-30T13:48:26.088 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:48:25 smithi099 ceph-mon[24912]: pgmap v138: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 749 B/s rd, 0 op/s 2024-03-30T13:48:26.089 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:48:25 smithi099 ceph-mon[24912]: from='mgr.24746 ' entity='mgr.x' 2024-03-30T13:48:28.006 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:48:27 smithi181 ceph-mon[25762]: pgmap v139: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-03-30T13:48:28.007 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 13:48:27 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-x[50211]: ::ffff:172.21.15.181 - - [30/Mar/2024:13:48:27] "GET /metrics HTTP/1.1" 200 37969 "" "Prometheus/2.33.4" 2024-03-30T13:48:28.087 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:48:27 smithi099 ceph-mon[24912]: pgmap v139: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-03-30T13:48:28.087 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:48:27 smithi099 ceph-mon[29691]: pgmap v139: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-03-30T13:48:29.006 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:48:28 smithi181 ceph-mon[25762]: from='client.24806 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T13:48:29.006 INFO:journalctl@ceph.prometheus.a.smithi181.stdout:Mar 30 13:48:28 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-prometheus-a[55395]: ts=2024-03-30T13:48:28.660Z caller=manager.go:609 level=warn component="rule manager" group=osd msg="Evaluating rule failed" rule="alert: CephOSDFlapping\nexpr: (rate(ceph_osd_up[5m]) * on(ceph_daemon) group_left(hostname) ceph_osd_metadata)\n * 60 > 1\nlabels:\n oid: 1.3.6.1.4.1.50495.1.2.1.4.4\n severity: warning\n type: ceph_default\nannotations:\n description: OSD {{ $labels.ceph_daemon }} on {{ $labels.hostname }} was marked\n down and back up {{ $value | humanize }} times once a minute for 5 minutes. This\n may indicate a network issue (latency, packet loss, MTU mismatch) on the cluster\n network, or the public network if no cluster network is deployed. Check the network\n stats on the listed host(s).\n documentation: https://docs.ceph.com/en/latest/rados/troubleshooting/troubleshooting-osd#flapping-osds\n summary: Network issues are causing OSDs to flap (mark each other down)\n" err="found duplicate series for the match group {ceph_daemon=\"osd.0\"} on the right hand-side of the operation: [{__name__=\"ceph_osd_metadata\", ceph_daemon=\"osd.0\", ceph_version=\"ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)\", cluster_addr=\"172.21.15.99\", device_class=\"ssd\", hostname=\"smithi099\", instance=\"smithi181:9283\", job=\"ceph\", objectstore=\"bluestore\", public_addr=\"172.21.15.99\"}, {__name__=\"ceph_osd_metadata\", ceph_daemon=\"osd.0\", ceph_version=\"ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)\", cluster_addr=\"172.21.15.99\", device_class=\"ssd\", hostname=\"smithi099\", instance=\"172.21.15.181:9283\", job=\"ceph\", objectstore=\"bluestore\", public_addr=\"172.21.15.99\"}];many-to-many matching not allowed: matching labels must be unique on one side" 2024-03-30T13:48:29.087 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:48:28 smithi099 ceph-mon[24912]: from='client.24806 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T13:48:29.087 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:48:28 smithi099 ceph-mon[29691]: from='client.24806 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T13:48:30.089 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:48:29 smithi099 ceph-mon[24912]: pgmap v140: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 1.0 KiB/s rd, 1 op/s 2024-03-30T13:48:30.089 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:48:29 smithi099 ceph-mon[29691]: pgmap v140: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 1.0 KiB/s rd, 1 op/s 2024-03-30T13:48:30.256 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:48:29 smithi181 ceph-mon[25762]: pgmap v140: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 1.0 KiB/s rd, 1 op/s 2024-03-30T13:48:32.006 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:48:31 smithi181 ceph-mon[25762]: pgmap v141: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 1.0 KiB/s rd, 1 op/s 2024-03-30T13:48:32.087 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:48:31 smithi099 ceph-mon[24912]: pgmap v141: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 1.0 KiB/s rd, 1 op/s 2024-03-30T13:48:32.087 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:48:31 smithi099 ceph-mon[29691]: pgmap v141: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 1.0 KiB/s rd, 1 op/s 2024-03-30T13:48:34.006 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:48:33 smithi181 ceph-mon[25762]: pgmap v142: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 1.0 KiB/s rd, 1 op/s 2024-03-30T13:48:34.087 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:48:33 smithi099 ceph-mon[24912]: pgmap v142: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 1.0 KiB/s rd, 1 op/s 2024-03-30T13:48:34.087 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:48:33 smithi099 ceph-mon[29691]: pgmap v142: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 1.0 KiB/s rd, 1 op/s 2024-03-30T13:48:35.087 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:48:34 smithi099 ceph-mon[24912]: from='mgr.24746 172.21.15.181:0/2892154077' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T13:48:35.087 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:48:34 smithi099 ceph-mon[29691]: from='mgr.24746 172.21.15.181:0/2892154077' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T13:48:35.256 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:48:34 smithi181 ceph-mon[25762]: from='mgr.24746 172.21.15.181:0/2892154077' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T13:48:36.087 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:48:35 smithi099 ceph-mon[24912]: pgmap v143: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-03-30T13:48:36.087 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:48:35 smithi099 ceph-mon[29691]: pgmap v143: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-03-30T13:48:36.256 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:48:35 smithi181 ceph-mon[25762]: pgmap v143: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-03-30T13:48:37.913 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:48:37 smithi099 ceph-mon[24912]: pgmap v144: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T13:48:37.913 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:48:37 smithi099 ceph-mon[29691]: pgmap v144: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T13:48:38.006 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:48:37 smithi181 ceph-mon[25762]: pgmap v144: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T13:48:38.006 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 13:48:37 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-x[50211]: ::ffff:172.21.15.181 - - [30/Mar/2024:13:48:37] "GET /metrics HTTP/1.1" 200 37972 "" "Prometheus/2.33.4" 2024-03-30T13:48:39.006 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:48:38 smithi181 ceph-mon[25762]: from='client.24806 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T13:48:39.006 INFO:journalctl@ceph.prometheus.a.smithi181.stdout:Mar 30 13:48:38 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-prometheus-a[55395]: ts=2024-03-30T13:48:38.659Z caller=manager.go:609 level=warn component="rule manager" group=osd msg="Evaluating rule failed" rule="alert: CephOSDFlapping\nexpr: (rate(ceph_osd_up[5m]) * on(ceph_daemon) group_left(hostname) ceph_osd_metadata)\n * 60 > 1\nlabels:\n oid: 1.3.6.1.4.1.50495.1.2.1.4.4\n severity: warning\n type: ceph_default\nannotations:\n description: OSD {{ $labels.ceph_daemon }} on {{ $labels.hostname }} was marked\n down and back up {{ $value | humanize }} times once a minute for 5 minutes. This\n may indicate a network issue (latency, packet loss, MTU mismatch) on the cluster\n network, or the public network if no cluster network is deployed. Check the network\n stats on the listed host(s).\n documentation: https://docs.ceph.com/en/latest/rados/troubleshooting/troubleshooting-osd#flapping-osds\n summary: Network issues are causing OSDs to flap (mark each other down)\n" err="found duplicate series for the match group {ceph_daemon=\"osd.0\"} on the right hand-side of the operation: [{__name__=\"ceph_osd_metadata\", ceph_daemon=\"osd.0\", ceph_version=\"ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)\", cluster_addr=\"172.21.15.99\", device_class=\"ssd\", hostname=\"smithi099\", instance=\"smithi181:9283\", job=\"ceph\", objectstore=\"bluestore\", public_addr=\"172.21.15.99\"}, {__name__=\"ceph_osd_metadata\", ceph_daemon=\"osd.0\", ceph_version=\"ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)\", cluster_addr=\"172.21.15.99\", device_class=\"ssd\", hostname=\"smithi099\", instance=\"172.21.15.181:9283\", job=\"ceph\", objectstore=\"bluestore\", public_addr=\"172.21.15.99\"}];many-to-many matching not allowed: matching labels must be unique on one side" 2024-03-30T13:48:39.087 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:48:38 smithi099 ceph-mon[24912]: from='client.24806 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T13:48:39.087 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:48:38 smithi099 ceph-mon[29691]: from='client.24806 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T13:48:39.415 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:48:39 smithi099 systemd[1]: Stopping Ceph mgr.y for 98ebaeb8-ee99-11ee-b647-cb9ed24678a4... 2024-03-30T13:48:39.726 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:48:39 smithi099 podman[70884]: 2024-03-30 13:48:39.414362197 +0000 UTC m=+0.139424221 container died db3430cee99a5316ae23cc6551d4ffb50ec041ee6faceb22d2923d97b8f45824 (image=quay.io/ceph/ceph:v17.2.0, name=ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y, architecture=x86_64, release=754, vendor=Red Hat, Inc., com.redhat.build-host=cpt-1002.osbs.prod.upshift.rdu2.redhat.com, vcs-type=git, summary=Provides a CentOS Stream container based on the Red Hat Universal Base Image, ceph=True, com.redhat.license_terms=https://centos.org/legal/licensing-policy/, vcs-ref=f1ee6e37554363ec55e0035aba1a693d3627fdeb, GIT_COMMIT=b613db0f44179c0940781c1c7fe04e1acb7093ac, version=8, io.k8s.display-name=CentOS Stream 8, GIT_REPO=https://github.com/ceph/ceph-container.git, url=https://access.redhat.com/containers/#/registry.access.redhat.com/ubi8/images/8.6-754, GIT_CLEAN=True, com.redhat.component=centos-stream-container, distribution-scope=public, name=centos-stream, io.k8s.description=The Universal Base Image is designed and engineered to be the base layer for all of your containerized applications, middleware and utilities. This base image is freely redistributable, but Red Hat only supports Red Hat technologies through subscriptions for Red Hat products. This image is maintained by Red Hat and updated regularly., io.openshift.tags=base centos centos-stream, maintainer=Guillaume Abrioux , description=CentOS Stream is a continuously delivered distro that tracks just ahead of Red Hat Enterprise Linux development. This image takes the Red Hat UBI and layers on content from CentOS Stream, io.buildah.version=1.19.8, io.openshift.expose-services=, CEPH_POINT_RELEASE=-17.2.0, GIT_BRANCH=HEAD, RELEASE=HEAD, build-date=2022-05-03T08:36:31.336870) 2024-03-30T13:48:40.052 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:48:39 smithi099 ceph-mon[24912]: pgmap v145: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T13:48:40.052 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:48:39 smithi099 ceph-mon[24912]: from='mgr.24746 ' entity='mgr.x' 2024-03-30T13:48:40.052 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:48:39 smithi099 ceph-mon[24912]: from='mgr.24746 ' entity='mgr.x' 2024-03-30T13:48:40.052 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:48:39 smithi099 ceph-mon[24912]: pgmap v146: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 1004 B/s rd, 0 op/s 2024-03-30T13:48:40.052 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:48:39 smithi099 ceph-mon[24912]: pgmap v147: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 625 B/s rd, 0 op/s 2024-03-30T13:48:40.053 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:48:39 smithi099 ceph-mon[24912]: from='mgr.24746 ' entity='mgr.x' 2024-03-30T13:48:40.053 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:48:39 smithi099 podman[70884]: 2024-03-30 13:48:39.808109849 +0000 UTC m=+0.533171873 container cleanup db3430cee99a5316ae23cc6551d4ffb50ec041ee6faceb22d2923d97b8f45824 (image=quay.io/ceph/ceph:v17.2.0, name=ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y, com.redhat.build-host=cpt-1002.osbs.prod.upshift.rdu2.redhat.com, io.openshift.tags=base centos centos-stream, io.k8s.display-name=CentOS Stream 8, vcs-type=git, distribution-scope=public, description=CentOS Stream is a continuously delivered distro that tracks just ahead of Red Hat Enterprise Linux development. This image takes the Red Hat UBI and layers on content from CentOS Stream, GIT_COMMIT=b613db0f44179c0940781c1c7fe04e1acb7093ac, io.buildah.version=1.19.8, name=centos-stream, io.k8s.description=The Universal Base Image is designed and engineered to be the base layer for all of your containerized applications, middleware and utilities. This base image is freely redistributable, but Red Hat only supports Red Hat technologies through subscriptions for Red Hat products. This image is maintained by Red Hat and updated regularly., release=754, RELEASE=HEAD, url=https://access.redhat.com/containers/#/registry.access.redhat.com/ubi8/images/8.6-754, GIT_REPO=https://github.com/ceph/ceph-container.git, com.redhat.component=centos-stream-container, version=8, vendor=Red Hat, Inc., build-date=2022-05-03T08:36:31.336870, io.openshift.expose-services=, maintainer=Guillaume Abrioux , GIT_CLEAN=True, ceph=True, summary=Provides a CentOS Stream container based on the Red Hat Universal Base Image, GIT_BRANCH=HEAD, com.redhat.license_terms=https://centos.org/legal/licensing-policy/, vcs-ref=f1ee6e37554363ec55e0035aba1a693d3627fdeb, CEPH_POINT_RELEASE=-17.2.0, architecture=x86_64) 2024-03-30T13:48:40.053 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:48:39 smithi099 bash[70884]: ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y 2024-03-30T13:48:40.053 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:48:39 smithi099 ceph-mon[29691]: pgmap v145: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T13:48:40.053 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:48:39 smithi099 ceph-mon[29691]: from='mgr.24746 ' entity='mgr.x' 2024-03-30T13:48:40.053 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:48:39 smithi099 ceph-mon[29691]: from='mgr.24746 ' entity='mgr.x' 2024-03-30T13:48:40.053 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:48:39 smithi099 ceph-mon[29691]: pgmap v146: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 1004 B/s rd, 0 op/s 2024-03-30T13:48:40.053 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:48:39 smithi099 ceph-mon[29691]: pgmap v147: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 625 B/s rd, 0 op/s 2024-03-30T13:48:40.054 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:48:39 smithi099 ceph-mon[29691]: from='mgr.24746 ' entity='mgr.x' 2024-03-30T13:48:40.256 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:48:39 smithi181 ceph-mon[25762]: pgmap v145: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T13:48:40.256 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:48:39 smithi181 ceph-mon[25762]: from='mgr.24746 ' entity='mgr.x' 2024-03-30T13:48:40.256 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:48:39 smithi181 ceph-mon[25762]: from='mgr.24746 ' entity='mgr.x' 2024-03-30T13:48:40.257 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:48:39 smithi181 ceph-mon[25762]: pgmap v146: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 1004 B/s rd, 0 op/s 2024-03-30T13:48:40.257 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:48:39 smithi181 ceph-mon[25762]: pgmap v147: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 625 B/s rd, 0 op/s 2024-03-30T13:48:40.257 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:48:39 smithi181 ceph-mon[25762]: from='mgr.24746 ' entity='mgr.x' 2024-03-30T13:48:40.316 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:48:40 smithi099 podman[70899]: 2024-03-30 13:48:40.051255395 +0000 UTC m=+0.641622704 container remove db3430cee99a5316ae23cc6551d4ffb50ec041ee6faceb22d2923d97b8f45824 (image=quay.io/ceph/ceph:v17.2.0, name=ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y, vendor=Red Hat, Inc., ceph=True, CEPH_POINT_RELEASE=-17.2.0, maintainer=Guillaume Abrioux , distribution-scope=public, io.buildah.version=1.19.8, GIT_BRANCH=HEAD, vcs-ref=f1ee6e37554363ec55e0035aba1a693d3627fdeb, architecture=x86_64, com.redhat.license_terms=https://centos.org/legal/licensing-policy/, url=https://access.redhat.com/containers/#/registry.access.redhat.com/ubi8/images/8.6-754, RELEASE=HEAD, release=754, GIT_CLEAN=True, com.redhat.component=centos-stream-container, version=8, io.k8s.display-name=CentOS Stream 8, name=centos-stream, description=CentOS Stream is a continuously delivered distro that tracks just ahead of Red Hat Enterprise Linux development. This image takes the Red Hat UBI and layers on content from CentOS Stream, com.redhat.build-host=cpt-1002.osbs.prod.upshift.rdu2.redhat.com, build-date=2022-05-03T08:36:31.336870, GIT_REPO=https://github.com/ceph/ceph-container.git, GIT_COMMIT=b613db0f44179c0940781c1c7fe04e1acb7093ac, io.openshift.tags=base centos centos-stream, io.openshift.expose-services=, io.k8s.description=The Universal Base Image is designed and engineered to be the base layer for all of your containerized applications, middleware and utilities. This base image is freely redistributable, but Red Hat only supports Red Hat technologies through subscriptions for Red Hat products. This image is maintained by Red Hat and updated regularly., vcs-type=git, summary=Provides a CentOS Stream container based on the Red Hat Universal Base Image) 2024-03-30T13:48:40.316 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:48:40 smithi099 systemd[1]: ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4@mgr.y.service: Main process exited, code=exited, status=143/n/a 2024-03-30T13:48:40.316 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:48:40 smithi099 systemd[1]: ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4@mgr.y.service: Failed with result 'exit-code'. 2024-03-30T13:48:40.316 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:48:40 smithi099 systemd[1]: Stopped Ceph mgr.y for 98ebaeb8-ee99-11ee-b647-cb9ed24678a4. 2024-03-30T13:48:40.316 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:48:40 smithi099 systemd[1]: ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4@mgr.y.service: Consumed 1min 7.432s CPU time. 2024-03-30T13:48:40.587 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:48:40 smithi099 systemd[1]: Starting Ceph mgr.y for 98ebaeb8-ee99-11ee-b647-cb9ed24678a4... 2024-03-30T13:48:40.905 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:48:40 smithi099 podman[71034]: 2024-03-30 13:48:40.538206334 +0000 UTC m=+0.017585851 image pull b0c4478f1d83795df4d538bf108aee5fac57194348fb16dcdbb3115f3e2fe95e quay.ceph.io/ceph-ci/ceph:4e50bbcdd1630c7760b708f3a5b4d38a121e66cb 2024-03-30T13:48:40.905 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:48:40 smithi099 podman[71034]: 2024-03-30 13:48:40.769814762 +0000 UTC m=+0.249194268 container create 0d464b8c1d1843df7d6f4d612d968f8d930994e8c5eb6c5e932f271d4e381b6f (image=quay.ceph.io/ceph-ci/ceph:4e50bbcdd1630c7760b708f3a5b4d38a121e66cb, name=ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, RELEASE=squid-4e50bbc, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, GIT_BRANCH=HEAD, ceph=True, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240326) 2024-03-30T13:48:41.337 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:48:41 smithi099 podman[71034]: 2024-03-30 13:48:41.022829064 +0000 UTC m=+0.502208585 container init 0d464b8c1d1843df7d6f4d612d968f8d930994e8c5eb6c5e932f271d4e381b6f (image=quay.ceph.io/ceph-ci/ceph:4e50bbcdd1630c7760b708f3a5b4d38a121e66cb, name=ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y, RELEASE=squid-4e50bbc, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240326, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image) 2024-03-30T13:48:41.337 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:48:41 smithi099 podman[71034]: 2024-03-30 13:48:41.025633214 +0000 UTC m=+0.505012724 container start 0d464b8c1d1843df7d6f4d612d968f8d930994e8c5eb6c5e932f271d4e381b6f (image=quay.ceph.io/ceph-ci/ceph:4e50bbcdd1630c7760b708f3a5b4d38a121e66cb, name=ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240326, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, RELEASE=squid-4e50bbc, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux ) 2024-03-30T13:48:41.337 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:48:41 smithi099 ceph-mgr[71053]: -- 172.21.15.99:0/1039769901 <== mon.1 v2:172.21.15.99:3301/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5635924645a0 con 0x563592439000 2024-03-30T13:48:41.337 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:48:41 smithi099 bash[71034]: 0d464b8c1d1843df7d6f4d612d968f8d930994e8c5eb6c5e932f271d4e381b6f 2024-03-30T13:48:41.337 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:48:41 smithi099 systemd[1]: Started Ceph mgr.y for 98ebaeb8-ee99-11ee-b647-cb9ed24678a4. 2024-03-30T13:48:42.087 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:48:41 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[71049]: 2024-03-30T13:48:41.597+0000 7fd4f4363200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-03-30T13:48:42.087 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:48:41 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[71049]: 2024-03-30T13:48:41.695+0000 7fd4f4363200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-03-30T13:48:42.477 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:48:42 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[71049]: 2024-03-30T13:48:42.381+0000 7fd4f4363200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-03-30T13:48:42.477 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:48:42 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[71049]: 2024-03-30T13:48:42.475+0000 7fd4f4363200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-03-30T13:48:42.477 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:48:42 smithi099 ceph-mon[24912]: pgmap v148: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T13:48:42.478 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:48:42 smithi099 ceph-mon[24912]: from='mgr.24746 ' entity='mgr.x' 2024-03-30T13:48:42.478 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:48:42 smithi099 ceph-mon[24912]: from='mgr.24746 ' entity='mgr.x' 2024-03-30T13:48:42.478 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:48:42 smithi099 ceph-mon[24912]: from='mgr.24746 ' entity='mgr.x' 2024-03-30T13:48:42.478 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:48:42 smithi099 ceph-mon[24912]: from='mgr.24746 ' entity='mgr.x' 2024-03-30T13:48:42.478 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:48:42 smithi099 ceph-mon[24912]: from='mgr.24746 172.21.15.181:0/2892154077' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:48:42.478 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:48:42 smithi099 ceph-mon[24912]: from='mgr.24746 172.21.15.181:0/2892154077' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:48:42.478 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:48:42 smithi099 ceph-mon[24912]: pgmap v149: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 1 op/s 2024-03-30T13:48:42.478 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:48:42 smithi099 ceph-mon[24912]: pgmap v150: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-03-30T13:48:42.478 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:48:42 smithi099 ceph-mon[24912]: from='mgr.24746 ' entity='mgr.x' 2024-03-30T13:48:42.478 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:48:42 smithi099 ceph-mon[29691]: pgmap v148: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T13:48:42.479 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:48:42 smithi099 ceph-mon[29691]: from='mgr.24746 ' entity='mgr.x' 2024-03-30T13:48:42.479 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:48:42 smithi099 ceph-mon[29691]: from='mgr.24746 ' entity='mgr.x' 2024-03-30T13:48:42.479 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:48:42 smithi099 ceph-mon[29691]: from='mgr.24746 ' entity='mgr.x' 2024-03-30T13:48:42.479 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:48:42 smithi099 ceph-mon[29691]: from='mgr.24746 ' entity='mgr.x' 2024-03-30T13:48:42.479 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:48:42 smithi099 ceph-mon[29691]: from='mgr.24746 172.21.15.181:0/2892154077' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:48:42.479 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:48:42 smithi099 ceph-mon[29691]: from='mgr.24746 172.21.15.181:0/2892154077' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:48:42.479 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:48:42 smithi099 ceph-mon[29691]: pgmap v149: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 1 op/s 2024-03-30T13:48:42.479 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:48:42 smithi099 ceph-mon[29691]: pgmap v150: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-03-30T13:48:42.479 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:48:42 smithi099 ceph-mon[29691]: from='mgr.24746 ' entity='mgr.x' 2024-03-30T13:48:42.506 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:48:42 smithi181 ceph-mon[25762]: pgmap v148: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T13:48:42.506 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:48:42 smithi181 ceph-mon[25762]: from='mgr.24746 ' entity='mgr.x' 2024-03-30T13:48:42.507 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:48:42 smithi181 ceph-mon[25762]: from='mgr.24746 ' entity='mgr.x' 2024-03-30T13:48:42.507 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:48:42 smithi181 ceph-mon[25762]: from='mgr.24746 ' entity='mgr.x' 2024-03-30T13:48:42.507 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:48:42 smithi181 ceph-mon[25762]: from='mgr.24746 ' entity='mgr.x' 2024-03-30T13:48:42.507 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:48:42 smithi181 ceph-mon[25762]: from='mgr.24746 172.21.15.181:0/2892154077' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:48:42.507 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:48:42 smithi181 ceph-mon[25762]: from='mgr.24746 172.21.15.181:0/2892154077' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:48:42.507 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:48:42 smithi181 ceph-mon[25762]: pgmap v149: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 1 op/s 2024-03-30T13:48:42.507 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:48:42 smithi181 ceph-mon[25762]: pgmap v150: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-03-30T13:48:42.507 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:48:42 smithi181 ceph-mon[25762]: from='mgr.24746 ' entity='mgr.x' 2024-03-30T13:48:42.731 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:48:42 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[71049]: 2024-03-30T13:48:42.619+0000 7fd4f4363200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-03-30T13:48:42.732 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:48:42 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[71049]: 2024-03-30T13:48:42.715+0000 7fd4f4363200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-03-30T13:48:43.040 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:48:42 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[71049]: 2024-03-30T13:48:42.801+0000 7fd4f4363200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-03-30T13:48:43.337 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:48:43 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[71049]: 2024-03-30T13:48:43.069+0000 7fd4f4363200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-03-30T13:48:43.337 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:48:43 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[71049]: 2024-03-30T13:48:43.181+0000 7fd4f4363200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-03-30T13:48:43.337 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:48:43 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[71049]: 2024-03-30T13:48:43.268+0000 7fd4f4363200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-03-30T13:48:43.837 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:48:43 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[71049]: 2024-03-30T13:48:43.364+0000 7fd4f4363200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-03-30T13:48:43.837 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:48:43 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[71049]: 2024-03-30T13:48:43.540+0000 7fd4f4363200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-03-30T13:48:44.587 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:48:44 smithi099 ceph-mon[24912]: pgmap v151: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-03-30T13:48:44.587 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:48:44 smithi099 ceph-mon[29691]: pgmap v151: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-03-30T13:48:44.587 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:48:44 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[71049]: 2024-03-30T13:48:44.523+0000 7fd4f4363200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-03-30T13:48:44.756 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:48:44 smithi181 ceph-mon[25762]: pgmap v151: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-03-30T13:48:44.996 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:48:44 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[71049]: 2024-03-30T13:48:44.656+0000 7fd4f4363200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-03-30T13:48:45.287 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:48:44 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[71049]: 2024-03-30T13:48:44.995+0000 7fd4f4363200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-03-30T13:48:45.287 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:48:45 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[71049]: 2024-03-30T13:48:45.086+0000 7fd4f4363200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-03-30T13:48:45.287 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:48:45 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[71049]: 2024-03-30T13:48:45.285+0000 7fd4f4363200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-03-30T13:48:45.587 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:48:45 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[71049]: 2024-03-30T13:48:45.472+0000 7fd4f4363200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-03-30T13:48:46.029 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:48:45 smithi099 ceph-mon[24912]: from='mgr.24746 ' entity='mgr.x' 2024-03-30T13:48:46.029 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:48:45 smithi099 ceph-mon[24912]: from='mgr.24746 ' entity='mgr.x' 2024-03-30T13:48:46.029 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:48:45 smithi099 ceph-mon[24912]: pgmap v152: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 861 B/s rd, 0 op/s 2024-03-30T13:48:46.029 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:48:45 smithi099 ceph-mon[24912]: pgmap v153: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 861 B/s rd, 0 op/s 2024-03-30T13:48:46.030 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:48:45 smithi099 ceph-mon[24912]: from='mgr.24746 ' entity='mgr.x' 2024-03-30T13:48:46.030 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:48:45 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[71049]: 2024-03-30T13:48:45.763+0000 7fd4f4363200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-03-30T13:48:46.030 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:48:45 smithi099 ceph-mon[29691]: from='mgr.24746 ' entity='mgr.x' 2024-03-30T13:48:46.030 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:48:45 smithi099 ceph-mon[29691]: from='mgr.24746 ' entity='mgr.x' 2024-03-30T13:48:46.030 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:48:45 smithi099 ceph-mon[29691]: pgmap v152: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 861 B/s rd, 0 op/s 2024-03-30T13:48:46.030 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:48:45 smithi099 ceph-mon[29691]: pgmap v153: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 861 B/s rd, 0 op/s 2024-03-30T13:48:46.030 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:48:45 smithi099 ceph-mon[29691]: from='mgr.24746 ' entity='mgr.x' 2024-03-30T13:48:46.256 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:48:45 smithi181 ceph-mon[25762]: from='mgr.24746 ' entity='mgr.x' 2024-03-30T13:48:46.256 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:48:45 smithi181 ceph-mon[25762]: from='mgr.24746 ' entity='mgr.x' 2024-03-30T13:48:46.256 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:48:45 smithi181 ceph-mon[25762]: pgmap v152: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 861 B/s rd, 0 op/s 2024-03-30T13:48:46.256 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:48:45 smithi181 ceph-mon[25762]: pgmap v153: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 861 B/s rd, 0 op/s 2024-03-30T13:48:46.256 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:48:45 smithi181 ceph-mon[25762]: from='mgr.24746 ' entity='mgr.x' 2024-03-30T13:48:46.337 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:48:46 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[71049]: 2024-03-30T13:48:46.027+0000 7fd4f4363200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-03-30T13:48:46.337 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:48:46 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[71049]: 2024-03-30T13:48:46.274+0000 7fd4f4363200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-03-30T13:48:47.587 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:48:47 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[71049]: 2024-03-30T13:48:47.104+0000 7fd4f4363200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-03-30T13:48:47.941 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:48:47 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[71049]: 2024-03-30T13:48:47.682+0000 7fd4f4363200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-03-30T13:48:47.941 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:48:47 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[71049]: 2024-03-30T13:48:47.782+0000 7fd4f4363200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-03-30T13:48:47.942 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 13:48:47 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-x[50211]: ::ffff:172.21.15.181 - - [30/Mar/2024:13:48:47] "GET /metrics HTTP/1.1" 200 37972 "" "Prometheus/2.33.4" 2024-03-30T13:48:48.256 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:48:47 smithi181 ceph-mon[25762]: pgmap v154: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 861 B/s rd, 0 op/s 2024-03-30T13:48:48.338 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:48:47 smithi099 ceph-mon[24912]: pgmap v154: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 861 B/s rd, 0 op/s 2024-03-30T13:48:48.338 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:48:47 smithi099 ceph-mon[29691]: pgmap v154: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 861 B/s rd, 0 op/s 2024-03-30T13:48:48.338 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:48:48 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[71049]: 2024-03-30T13:48:48.005+0000 7fd4f4363200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-03-30T13:48:48.338 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:48:48 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[71049]: [30/Mar/2024:13:48:48] ENGINE Bus STARTING 2024-03-30T13:48:48.338 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:48:48 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[71049]: CherryPy Checker: 2024-03-30T13:48:48.339 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:48:48 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[71049]: The Application mounted at '' has an empty config. 2024-03-30T13:48:48.339 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:48:48 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[71049]: 2024-03-30T13:48:48.339 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:48:48 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[71049]: [30/Mar/2024:13:48:48] ENGINE Serving on http://:::9283 2024-03-30T13:48:48.339 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:48:48 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[71049]: [30/Mar/2024:13:48:48] ENGINE Bus STARTED 2024-03-30T13:48:48.943 INFO:journalctl@ceph.prometheus.a.smithi181.stdout:Mar 30 13:48:48 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-prometheus-a[55395]: ts=2024-03-30T13:48:48.660Z caller=manager.go:609 level=warn component="rule manager" group=osd msg="Evaluating rule failed" rule="alert: CephOSDFlapping\nexpr: (rate(ceph_osd_up[5m]) * on(ceph_daemon) group_left(hostname) ceph_osd_metadata)\n * 60 > 1\nlabels:\n oid: 1.3.6.1.4.1.50495.1.2.1.4.4\n severity: warning\n type: ceph_default\nannotations:\n description: OSD {{ $labels.ceph_daemon }} on {{ $labels.hostname }} was marked\n down and back up {{ $value | humanize }} times once a minute for 5 minutes. This\n may indicate a network issue (latency, packet loss, MTU mismatch) on the cluster\n network, or the public network if no cluster network is deployed. Check the network\n stats on the listed host(s).\n documentation: https://docs.ceph.com/en/latest/rados/troubleshooting/troubleshooting-osd#flapping-osds\n summary: Network issues are causing OSDs to flap (mark each other down)\n" err="found duplicate series for the match group {ceph_daemon=\"osd.0\"} on the right hand-side of the operation: [{__name__=\"ceph_osd_metadata\", ceph_daemon=\"osd.0\", ceph_version=\"ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)\", cluster_addr=\"172.21.15.99\", device_class=\"ssd\", hostname=\"smithi099\", instance=\"smithi181:9283\", job=\"ceph\", objectstore=\"bluestore\", public_addr=\"172.21.15.99\"}, {__name__=\"ceph_osd_metadata\", ceph_daemon=\"osd.0\", ceph_version=\"ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)\", cluster_addr=\"172.21.15.99\", device_class=\"ssd\", hostname=\"smithi099\", instance=\"172.21.15.181:9283\", job=\"ceph\", objectstore=\"bluestore\", public_addr=\"172.21.15.99\"}];many-to-many matching not allowed: matching labels must be unique on one side" 2024-03-30T13:48:49.256 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:48:48 smithi181 ceph-mon[25762]: from='client.24806 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T13:48:49.256 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:48:48 smithi181 ceph-mon[25762]: Standby manager daemon y restarted 2024-03-30T13:48:49.256 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:48:48 smithi181 ceph-mon[25762]: Standby manager daemon y started 2024-03-30T13:48:49.256 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:48:48 smithi181 ceph-mon[25762]: from='mgr.? 172.21.15.99:0/1165207787' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-03-30T13:48:49.257 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:48:48 smithi181 ceph-mon[25762]: from='mgr.? 172.21.15.99:0/1165207787' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-03-30T13:48:49.257 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:48:48 smithi181 ceph-mon[25762]: from='mgr.? 172.21.15.99:0/1165207787' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-03-30T13:48:49.257 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:48:48 smithi181 ceph-mon[25762]: from='mgr.? 172.21.15.99:0/1165207787' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-03-30T13:48:49.337 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:48:48 smithi099 ceph-mon[24912]: from='client.24806 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T13:48:49.337 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:48:48 smithi099 ceph-mon[24912]: Standby manager daemon y restarted 2024-03-30T13:48:49.337 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:48:48 smithi099 ceph-mon[24912]: Standby manager daemon y started 2024-03-30T13:48:49.338 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:48:48 smithi099 ceph-mon[24912]: from='mgr.? 172.21.15.99:0/1165207787' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-03-30T13:48:49.338 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:48:48 smithi099 ceph-mon[24912]: from='mgr.? 172.21.15.99:0/1165207787' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-03-30T13:48:49.338 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:48:48 smithi099 ceph-mon[24912]: from='mgr.? 172.21.15.99:0/1165207787' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-03-30T13:48:49.338 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:48:48 smithi099 ceph-mon[24912]: from='mgr.? 172.21.15.99:0/1165207787' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-03-30T13:48:49.338 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:48:48 smithi099 ceph-mon[29691]: from='client.24806 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T13:48:49.338 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:48:48 smithi099 ceph-mon[29691]: Standby manager daemon y restarted 2024-03-30T13:48:49.338 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:48:48 smithi099 ceph-mon[29691]: Standby manager daemon y started 2024-03-30T13:48:49.338 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:48:48 smithi099 ceph-mon[29691]: from='mgr.? 172.21.15.99:0/1165207787' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-03-30T13:48:49.338 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:48:48 smithi099 ceph-mon[29691]: from='mgr.? 172.21.15.99:0/1165207787' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-03-30T13:48:49.338 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:48:48 smithi099 ceph-mon[29691]: from='mgr.? 172.21.15.99:0/1165207787' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-03-30T13:48:49.338 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:48:48 smithi099 ceph-mon[29691]: from='mgr.? 172.21.15.99:0/1165207787' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-03-30T13:48:50.256 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:48:49 smithi181 ceph-mon[25762]: pgmap v155: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 667 B/s rd, 0 op/s 2024-03-30T13:48:50.256 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:48:49 smithi181 ceph-mon[25762]: mgrmap e26: x(active, since 3m), standbys: y 2024-03-30T13:48:50.256 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:48:49 smithi181 ceph-mon[25762]: from='mgr.24746 172.21.15.181:0/2892154077' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T13:48:50.337 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:48:49 smithi099 ceph-mon[24912]: pgmap v155: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 667 B/s rd, 0 op/s 2024-03-30T13:48:50.337 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:48:49 smithi099 ceph-mon[24912]: mgrmap e26: x(active, since 3m), standbys: y 2024-03-30T13:48:50.337 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:48:49 smithi099 ceph-mon[24912]: from='mgr.24746 172.21.15.181:0/2892154077' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T13:48:50.337 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:48:49 smithi099 ceph-mon[29691]: pgmap v155: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 667 B/s rd, 0 op/s 2024-03-30T13:48:50.338 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:48:49 smithi099 ceph-mon[29691]: mgrmap e26: x(active, since 3m), standbys: y 2024-03-30T13:48:50.338 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:48:49 smithi099 ceph-mon[29691]: from='mgr.24746 172.21.15.181:0/2892154077' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T13:48:52.256 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:48:51 smithi181 ceph-mon[25762]: pgmap v156: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 1.0 KiB/s rd, 1 op/s 2024-03-30T13:48:52.337 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:48:51 smithi099 ceph-mon[24912]: pgmap v156: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 1.0 KiB/s rd, 1 op/s 2024-03-30T13:48:52.337 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:48:51 smithi099 ceph-mon[29691]: pgmap v156: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 1.0 KiB/s rd, 1 op/s 2024-03-30T13:48:54.256 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:48:53 smithi181 ceph-mon[25762]: pgmap v157: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 1.0 KiB/s rd, 1 op/s 2024-03-30T13:48:54.337 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:48:53 smithi099 ceph-mon[24912]: pgmap v157: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 1.0 KiB/s rd, 1 op/s 2024-03-30T13:48:54.337 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:48:53 smithi099 ceph-mon[29691]: pgmap v157: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 1.0 KiB/s rd, 1 op/s 2024-03-30T13:48:56.256 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:48:55 smithi181 ceph-mon[25762]: pgmap v158: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-03-30T13:48:56.337 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:48:55 smithi099 ceph-mon[24912]: pgmap v158: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-03-30T13:48:56.337 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:48:55 smithi099 ceph-mon[29691]: pgmap v158: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-03-30T13:48:57.962 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 13:48:57 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-x[50211]: ::ffff:172.21.15.181 - - [30/Mar/2024:13:48:57] "GET /metrics HTTP/1.1" 200 37971 "" "Prometheus/2.33.4" 2024-03-30T13:48:58.256 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:48:57 smithi181 ceph-mon[25762]: pgmap v159: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T13:48:58.337 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:48:57 smithi099 ceph-mon[24912]: pgmap v159: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T13:48:58.337 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:48:57 smithi099 ceph-mon[29691]: pgmap v159: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T13:48:58.963 INFO:journalctl@ceph.prometheus.a.smithi181.stdout:Mar 30 13:48:58 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-prometheus-a[55395]: ts=2024-03-30T13:48:58.661Z caller=manager.go:609 level=warn component="rule manager" group=osd msg="Evaluating rule failed" rule="alert: CephOSDFlapping\nexpr: (rate(ceph_osd_up[5m]) * on(ceph_daemon) group_left(hostname) ceph_osd_metadata)\n * 60 > 1\nlabels:\n oid: 1.3.6.1.4.1.50495.1.2.1.4.4\n severity: warning\n type: ceph_default\nannotations:\n description: OSD {{ $labels.ceph_daemon }} on {{ $labels.hostname }} was marked\n down and back up {{ $value | humanize }} times once a minute for 5 minutes. This\n may indicate a network issue (latency, packet loss, MTU mismatch) on the cluster\n network, or the public network if no cluster network is deployed. Check the network\n stats on the listed host(s).\n documentation: https://docs.ceph.com/en/latest/rados/troubleshooting/troubleshooting-osd#flapping-osds\n summary: Network issues are causing OSDs to flap (mark each other down)\n" err="found duplicate series for the match group {ceph_daemon=\"osd.0\"} on the right hand-side of the operation: [{__name__=\"ceph_osd_metadata\", ceph_daemon=\"osd.0\", ceph_version=\"ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)\", cluster_addr=\"172.21.15.99\", device_class=\"ssd\", hostname=\"smithi099\", instance=\"smithi181:9283\", job=\"ceph\", objectstore=\"bluestore\", public_addr=\"172.21.15.99\"}, {__name__=\"ceph_osd_metadata\", ceph_daemon=\"osd.0\", ceph_version=\"ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)\", cluster_addr=\"172.21.15.99\", device_class=\"ssd\", hostname=\"smithi099\", instance=\"172.21.15.181:9283\", job=\"ceph\", objectstore=\"bluestore\", public_addr=\"172.21.15.99\"}];many-to-many matching not allowed: matching labels must be unique on one side" 2024-03-30T13:48:59.256 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:48:58 smithi181 ceph-mon[25762]: from='client.24806 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T13:48:59.337 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:48:58 smithi099 ceph-mon[24912]: from='client.24806 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T13:48:59.338 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:48:58 smithi099 ceph-mon[29691]: from='client.24806 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T13:49:00.324 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:49:00 smithi099 ceph-mon[24912]: pgmap v160: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T13:49:00.324 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:49:00 smithi099 ceph-mon[24912]: from='mgr.24746 ' entity='mgr.x' 2024-03-30T13:49:00.324 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:49:00 smithi099 ceph-mon[24912]: from='mgr.24746 ' entity='mgr.x' 2024-03-30T13:49:00.324 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:49:00 smithi099 ceph-mon[24912]: pgmap v161: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 1003 B/s rd, 0 op/s 2024-03-30T13:49:00.324 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:49:00 smithi099 ceph-mon[24912]: pgmap v162: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 623 B/s rd, 0 op/s 2024-03-30T13:49:00.324 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:49:00 smithi099 ceph-mon[24912]: from='mgr.24746 ' entity='mgr.x' 2024-03-30T13:49:00.324 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:49:00 smithi099 ceph-mon[29691]: pgmap v160: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T13:49:00.324 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:49:00 smithi099 ceph-mon[29691]: from='mgr.24746 ' entity='mgr.x' 2024-03-30T13:49:00.324 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:49:00 smithi099 ceph-mon[29691]: from='mgr.24746 ' entity='mgr.x' 2024-03-30T13:49:00.325 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:49:00 smithi099 ceph-mon[29691]: pgmap v161: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 1003 B/s rd, 0 op/s 2024-03-30T13:49:00.325 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:49:00 smithi099 ceph-mon[29691]: pgmap v162: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 623 B/s rd, 0 op/s 2024-03-30T13:49:00.325 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:49:00 smithi099 ceph-mon[29691]: from='mgr.24746 ' entity='mgr.x' 2024-03-30T13:49:00.506 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:49:00 smithi181 ceph-mon[25762]: pgmap v160: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T13:49:00.506 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:49:00 smithi181 ceph-mon[25762]: from='mgr.24746 ' entity='mgr.x' 2024-03-30T13:49:00.506 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:49:00 smithi181 ceph-mon[25762]: from='mgr.24746 ' entity='mgr.x' 2024-03-30T13:49:00.507 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:49:00 smithi181 ceph-mon[25762]: pgmap v161: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 1003 B/s rd, 0 op/s 2024-03-30T13:49:00.507 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:49:00 smithi181 ceph-mon[25762]: pgmap v162: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 623 B/s rd, 0 op/s 2024-03-30T13:49:00.507 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:49:00 smithi181 ceph-mon[25762]: from='mgr.24746 ' entity='mgr.x' 2024-03-30T13:49:02.499 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:49:02 smithi099 ceph-mon[24912]: pgmap v163: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T13:49:02.500 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:49:02 smithi099 ceph-mon[29691]: pgmap v163: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T13:49:02.506 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:49:02 smithi181 ceph-mon[25762]: pgmap v163: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T13:49:04.506 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:49:04 smithi181 ceph-mon[25762]: pgmap v164: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T13:49:04.506 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:49:04 smithi181 ceph-mon[25762]: from='mgr.24746 ' entity='mgr.x' 2024-03-30T13:49:04.507 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:49:04 smithi181 ceph-mon[25762]: from='mgr.24746 ' entity='mgr.x' 2024-03-30T13:49:04.507 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:49:04 smithi181 ceph-mon[25762]: from='mgr.24746 ' entity='mgr.x' 2024-03-30T13:49:04.507 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:49:04 smithi181 ceph-mon[25762]: from='mgr.24746 172.21.15.181:0/2892154077' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T13:49:04.587 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:49:04 smithi099 ceph-mon[24912]: pgmap v164: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T13:49:04.587 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:49:04 smithi099 ceph-mon[24912]: from='mgr.24746 ' entity='mgr.x' 2024-03-30T13:49:04.587 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:49:04 smithi099 ceph-mon[24912]: from='mgr.24746 ' entity='mgr.x' 2024-03-30T13:49:04.588 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:49:04 smithi099 ceph-mon[24912]: from='mgr.24746 ' entity='mgr.x' 2024-03-30T13:49:04.588 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:49:04 smithi099 ceph-mon[24912]: from='mgr.24746 172.21.15.181:0/2892154077' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T13:49:04.588 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:49:04 smithi099 ceph-mon[29691]: pgmap v164: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T13:49:04.588 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:49:04 smithi099 ceph-mon[29691]: from='mgr.24746 ' entity='mgr.x' 2024-03-30T13:49:04.588 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:49:04 smithi099 ceph-mon[29691]: from='mgr.24746 ' entity='mgr.x' 2024-03-30T13:49:04.588 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:49:04 smithi099 ceph-mon[29691]: from='mgr.24746 ' entity='mgr.x' 2024-03-30T13:49:04.588 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:49:04 smithi099 ceph-mon[29691]: from='mgr.24746 172.21.15.181:0/2892154077' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T13:49:05.506 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:49:05 smithi181 ceph-mon[25762]: pgmap v165: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 744 B/s rd, 0 op/s 2024-03-30T13:49:05.506 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:49:05 smithi181 ceph-mon[25762]: pgmap v166: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 1.0 KiB/s rd, 1 op/s 2024-03-30T13:49:05.507 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:49:05 smithi181 ceph-mon[25762]: from='mgr.24746 ' entity='mgr.x' 2024-03-30T13:49:05.507 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:49:05 smithi181 ceph-mon[25762]: from='mgr.24746 ' entity='mgr.x' 2024-03-30T13:49:05.507 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:49:05 smithi181 ceph-mon[25762]: from='mgr.24746 ' entity='mgr.x' 2024-03-30T13:49:05.587 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:49:05 smithi099 ceph-mon[24912]: pgmap v165: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 744 B/s rd, 0 op/s 2024-03-30T13:49:05.587 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:49:05 smithi099 ceph-mon[24912]: pgmap v166: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 1.0 KiB/s rd, 1 op/s 2024-03-30T13:49:05.587 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:49:05 smithi099 ceph-mon[24912]: from='mgr.24746 ' entity='mgr.x' 2024-03-30T13:49:05.587 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:49:05 smithi099 ceph-mon[24912]: from='mgr.24746 ' entity='mgr.x' 2024-03-30T13:49:05.587 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:49:05 smithi099 ceph-mon[24912]: from='mgr.24746 ' entity='mgr.x' 2024-03-30T13:49:05.588 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:49:05 smithi099 ceph-mon[29691]: pgmap v165: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 744 B/s rd, 0 op/s 2024-03-30T13:49:05.588 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:49:05 smithi099 ceph-mon[29691]: pgmap v166: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 1.0 KiB/s rd, 1 op/s 2024-03-30T13:49:05.588 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:49:05 smithi099 ceph-mon[29691]: from='mgr.24746 ' entity='mgr.x' 2024-03-30T13:49:05.588 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:49:05 smithi099 ceph-mon[29691]: from='mgr.24746 ' entity='mgr.x' 2024-03-30T13:49:05.588 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:49:05 smithi099 ceph-mon[29691]: from='mgr.24746 ' entity='mgr.x' 2024-03-30T13:49:06.506 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:49:06 smithi181 ceph-mon[25762]: pgmap v167: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 863 B/s rd, 0 op/s 2024-03-30T13:49:06.506 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:49:06 smithi181 ceph-mon[25762]: pgmap v168: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 863 B/s rd, 0 op/s 2024-03-30T13:49:06.587 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:49:06 smithi099 ceph-mon[24912]: pgmap v167: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 863 B/s rd, 0 op/s 2024-03-30T13:49:06.587 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:49:06 smithi099 ceph-mon[24912]: pgmap v168: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 863 B/s rd, 0 op/s 2024-03-30T13:49:06.587 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:49:06 smithi099 ceph-mon[29691]: pgmap v167: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 863 B/s rd, 0 op/s 2024-03-30T13:49:06.588 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:49:06 smithi099 ceph-mon[29691]: pgmap v168: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 863 B/s rd, 0 op/s 2024-03-30T13:49:08.006 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 13:49:07 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-x[50211]: ::ffff:172.21.15.181 - - [30/Mar/2024:13:49:07] "GET /metrics HTTP/1.1" 200 37969 "" "Prometheus/2.33.4" 2024-03-30T13:49:08.506 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:49:08 smithi181 ceph-mon[25762]: pgmap v169: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 863 B/s rd, 0 op/s 2024-03-30T13:49:08.587 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:49:08 smithi099 ceph-mon[24912]: pgmap v169: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 863 B/s rd, 0 op/s 2024-03-30T13:49:08.587 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:49:08 smithi099 ceph-mon[29691]: pgmap v169: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 863 B/s rd, 0 op/s 2024-03-30T13:49:09.006 INFO:journalctl@ceph.prometheus.a.smithi181.stdout:Mar 30 13:49:08 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-prometheus-a[55395]: ts=2024-03-30T13:49:08.660Z caller=manager.go:609 level=warn component="rule manager" group=osd msg="Evaluating rule failed" rule="alert: CephOSDFlapping\nexpr: (rate(ceph_osd_up[5m]) * on(ceph_daemon) group_left(hostname) ceph_osd_metadata)\n * 60 > 1\nlabels:\n oid: 1.3.6.1.4.1.50495.1.2.1.4.4\n severity: warning\n type: ceph_default\nannotations:\n description: OSD {{ $labels.ceph_daemon }} on {{ $labels.hostname }} was marked\n down and back up {{ $value | humanize }} times once a minute for 5 minutes. This\n may indicate a network issue (latency, packet loss, MTU mismatch) on the cluster\n network, or the public network if no cluster network is deployed. Check the network\n stats on the listed host(s).\n documentation: https://docs.ceph.com/en/latest/rados/troubleshooting/troubleshooting-osd#flapping-osds\n summary: Network issues are causing OSDs to flap (mark each other down)\n" err="found duplicate series for the match group {ceph_daemon=\"osd.0\"} on the right hand-side of the operation: [{__name__=\"ceph_osd_metadata\", ceph_daemon=\"osd.0\", ceph_version=\"ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)\", cluster_addr=\"172.21.15.99\", device_class=\"ssd\", hostname=\"smithi099\", instance=\"smithi181:9283\", job=\"ceph\", objectstore=\"bluestore\", public_addr=\"172.21.15.99\"}, {__name__=\"ceph_osd_metadata\", ceph_daemon=\"osd.0\", ceph_version=\"ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)\", cluster_addr=\"172.21.15.99\", device_class=\"ssd\", hostname=\"smithi099\", instance=\"172.21.15.181:9283\", job=\"ceph\", objectstore=\"bluestore\", public_addr=\"172.21.15.99\"}];many-to-many matching not allowed: matching labels must be unique on one side" 2024-03-30T13:49:09.506 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:49:09 smithi181 ceph-mon[25762]: from='client.24806 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T13:49:09.525 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:49:09 smithi099 ceph-mon[24912]: from='client.24806 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T13:49:09.525 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:49:09 smithi099 ceph-mon[29691]: from='client.24806 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T13:49:10.506 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:49:10 smithi181 ceph-mon[25762]: pgmap v170: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 863 B/s rd, 0 op/s 2024-03-30T13:49:10.587 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:49:10 smithi099 ceph-mon[24912]: pgmap v170: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 863 B/s rd, 0 op/s 2024-03-30T13:49:10.587 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:49:10 smithi099 ceph-mon[29691]: pgmap v170: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 863 B/s rd, 0 op/s 2024-03-30T13:49:12.337 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:49:12 smithi099 ceph-mon[24912]: pgmap v171: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-03-30T13:49:12.338 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:49:12 smithi099 ceph-mon[29691]: pgmap v171: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-03-30T13:49:12.506 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:49:12 smithi181 ceph-mon[25762]: pgmap v171: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-03-30T13:49:14.447 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:49:14 smithi181 ceph-mon[25762]: pgmap v172: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-03-30T13:49:14.587 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:49:14 smithi099 ceph-mon[24912]: pgmap v172: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-03-30T13:49:14.588 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:49:14 smithi099 ceph-mon[29691]: pgmap v172: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-03-30T13:49:16.506 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:49:16 smithi181 ceph-mon[25762]: pgmap v173: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-03-30T13:49:16.587 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:49:16 smithi099 ceph-mon[24912]: pgmap v173: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-03-30T13:49:16.587 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:49:16 smithi099 ceph-mon[29691]: pgmap v173: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-03-30T13:49:18.006 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 13:49:17 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-x[50211]: ::ffff:172.21.15.181 - - [30/Mar/2024:13:49:17] "GET /metrics HTTP/1.1" 200 37969 "" "Prometheus/2.33.4" 2024-03-30T13:49:18.506 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:49:18 smithi181 ceph-mon[25762]: pgmap v174: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T13:49:18.587 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:49:18 smithi099 ceph-mon[24912]: pgmap v174: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T13:49:18.587 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:49:18 smithi099 ceph-mon[29691]: pgmap v174: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T13:49:19.006 INFO:journalctl@ceph.prometheus.a.smithi181.stdout:Mar 30 13:49:18 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-prometheus-a[55395]: ts=2024-03-30T13:49:18.660Z caller=manager.go:609 level=warn component="rule manager" group=osd msg="Evaluating rule failed" rule="alert: CephOSDFlapping\nexpr: (rate(ceph_osd_up[5m]) * on(ceph_daemon) group_left(hostname) ceph_osd_metadata)\n * 60 > 1\nlabels:\n oid: 1.3.6.1.4.1.50495.1.2.1.4.4\n severity: warning\n type: ceph_default\nannotations:\n description: OSD {{ $labels.ceph_daemon }} on {{ $labels.hostname }} was marked\n down and back up {{ $value | humanize }} times once a minute for 5 minutes. This\n may indicate a network issue (latency, packet loss, MTU mismatch) on the cluster\n network, or the public network if no cluster network is deployed. Check the network\n stats on the listed host(s).\n documentation: https://docs.ceph.com/en/latest/rados/troubleshooting/troubleshooting-osd#flapping-osds\n summary: Network issues are causing OSDs to flap (mark each other down)\n" err="found duplicate series for the match group {ceph_daemon=\"osd.0\"} on the right hand-side of the operation: [{__name__=\"ceph_osd_metadata\", ceph_daemon=\"osd.0\", ceph_version=\"ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)\", cluster_addr=\"172.21.15.99\", device_class=\"ssd\", hostname=\"smithi099\", instance=\"smithi181:9283\", job=\"ceph\", objectstore=\"bluestore\", public_addr=\"172.21.15.99\"}, {__name__=\"ceph_osd_metadata\", ceph_daemon=\"osd.0\", ceph_version=\"ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)\", cluster_addr=\"172.21.15.99\", device_class=\"ssd\", hostname=\"smithi099\", instance=\"172.21.15.181:9283\", job=\"ceph\", objectstore=\"bluestore\", public_addr=\"172.21.15.99\"}];many-to-many matching not allowed: matching labels must be unique on one side" 2024-03-30T13:49:19.506 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:49:19 smithi181 ceph-mon[25762]: from='client.24806 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T13:49:19.506 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:49:19 smithi181 ceph-mon[25762]: from='mgr.24746 172.21.15.181:0/2892154077' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T13:49:19.587 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:49:19 smithi099 ceph-mon[24912]: from='client.24806 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T13:49:19.587 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:49:19 smithi099 ceph-mon[24912]: from='mgr.24746 172.21.15.181:0/2892154077' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T13:49:19.588 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:49:19 smithi099 ceph-mon[29691]: from='client.24806 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T13:49:19.588 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:49:19 smithi099 ceph-mon[29691]: from='mgr.24746 172.21.15.181:0/2892154077' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T13:49:20.506 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:49:20 smithi181 ceph-mon[25762]: pgmap v175: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T13:49:20.587 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:49:20 smithi099 ceph-mon[24912]: pgmap v175: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T13:49:20.588 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:49:20 smithi099 ceph-mon[29691]: pgmap v175: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T13:49:22.337 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:49:22 smithi099 ceph-mon[24912]: pgmap v176: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T13:49:22.337 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:49:22 smithi099 ceph-mon[24912]: from='mgr.24746 ' entity='mgr.x' 2024-03-30T13:49:22.337 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:49:22 smithi099 ceph-mon[24912]: from='mgr.24746 ' entity='mgr.x' 2024-03-30T13:49:22.337 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:49:22 smithi099 ceph-mon[24912]: from='mgr.24746 ' entity='mgr.x' 2024-03-30T13:49:22.337 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:49:22 smithi099 ceph-mon[29691]: pgmap v176: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T13:49:22.338 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:49:22 smithi099 ceph-mon[29691]: from='mgr.24746 ' entity='mgr.x' 2024-03-30T13:49:22.338 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:49:22 smithi099 ceph-mon[29691]: from='mgr.24746 ' entity='mgr.x' 2024-03-30T13:49:22.338 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:49:22 smithi099 ceph-mon[29691]: from='mgr.24746 ' entity='mgr.x' 2024-03-30T13:49:22.506 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:49:22 smithi181 ceph-mon[25762]: pgmap v176: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T13:49:22.506 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:49:22 smithi181 ceph-mon[25762]: from='mgr.24746 ' entity='mgr.x' 2024-03-30T13:49:22.507 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:49:22 smithi181 ceph-mon[25762]: from='mgr.24746 ' entity='mgr.x' 2024-03-30T13:49:22.507 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:49:22 smithi181 ceph-mon[25762]: from='mgr.24746 ' entity='mgr.x' 2024-03-30T13:49:23.506 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:49:23 smithi181 ceph-mon[25762]: pgmap v177: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 932 B/s rd, 0 op/s 2024-03-30T13:49:23.506 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:49:23 smithi181 ceph-mon[25762]: pgmap v178: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-03-30T13:49:23.587 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:49:23 smithi099 ceph-mon[24912]: pgmap v177: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 932 B/s rd, 0 op/s 2024-03-30T13:49:23.587 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:49:23 smithi099 ceph-mon[24912]: pgmap v178: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-03-30T13:49:23.587 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:49:23 smithi099 ceph-mon[29691]: pgmap v177: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 932 B/s rd, 0 op/s 2024-03-30T13:49:23.587 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:49:23 smithi099 ceph-mon[29691]: pgmap v178: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-03-30T13:49:24.837 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:49:24 smithi099 ceph-mon[24912]: pgmap v179: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-03-30T13:49:24.837 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:49:24 smithi099 ceph-mon[29691]: pgmap v179: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-03-30T13:49:25.006 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:49:24 smithi181 ceph-mon[25762]: pgmap v179: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-03-30T13:49:26.256 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:49:26 smithi181 ceph-mon[25762]: from='mgr.24746 ' entity='mgr.x' 2024-03-30T13:49:26.256 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:49:26 smithi181 ceph-mon[25762]: from='mgr.24746 ' entity='mgr.x' 2024-03-30T13:49:26.256 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:49:26 smithi181 ceph-mon[25762]: pgmap v180: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T13:49:26.257 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:49:26 smithi181 ceph-mon[25762]: from='mgr.24746 ' entity='mgr.x' 2024-03-30T13:49:26.514 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:49:26 smithi099 ceph-mon[24912]: from='mgr.24746 ' entity='mgr.x' 2024-03-30T13:49:26.515 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:49:26 smithi099 ceph-mon[24912]: from='mgr.24746 ' entity='mgr.x' 2024-03-30T13:49:26.515 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:49:26 smithi099 ceph-mon[24912]: pgmap v180: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T13:49:26.515 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:49:26 smithi099 ceph-mon[24912]: from='mgr.24746 ' entity='mgr.x' 2024-03-30T13:49:26.515 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:49:26 smithi099 ceph-mon[29691]: from='mgr.24746 ' entity='mgr.x' 2024-03-30T13:49:26.515 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:49:26 smithi099 ceph-mon[29691]: from='mgr.24746 ' entity='mgr.x' 2024-03-30T13:49:26.515 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:49:26 smithi099 ceph-mon[29691]: pgmap v180: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T13:49:26.515 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:49:26 smithi099 ceph-mon[29691]: from='mgr.24746 ' entity='mgr.x' 2024-03-30T13:49:28.006 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 13:49:27 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-x[50211]: ::ffff:172.21.15.181 - - [30/Mar/2024:13:49:27] "GET /metrics HTTP/1.1" 200 37972 "" "Prometheus/2.33.4" 2024-03-30T13:49:28.506 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:49:28 smithi181 ceph-mon[25762]: pgmap v181: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T13:49:28.587 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:49:28 smithi099 ceph-mon[24912]: pgmap v181: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T13:49:28.587 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:49:28 smithi099 ceph-mon[29691]: pgmap v181: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T13:49:29.006 INFO:journalctl@ceph.prometheus.a.smithi181.stdout:Mar 30 13:49:28 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-prometheus-a[55395]: ts=2024-03-30T13:49:28.659Z caller=manager.go:609 level=warn component="rule manager" group=osd msg="Evaluating rule failed" rule="alert: CephOSDFlapping\nexpr: (rate(ceph_osd_up[5m]) * on(ceph_daemon) group_left(hostname) ceph_osd_metadata)\n * 60 > 1\nlabels:\n oid: 1.3.6.1.4.1.50495.1.2.1.4.4\n severity: warning\n type: ceph_default\nannotations:\n description: OSD {{ $labels.ceph_daemon }} on {{ $labels.hostname }} was marked\n down and back up {{ $value | humanize }} times once a minute for 5 minutes. This\n may indicate a network issue (latency, packet loss, MTU mismatch) on the cluster\n network, or the public network if no cluster network is deployed. Check the network\n stats on the listed host(s).\n documentation: https://docs.ceph.com/en/latest/rados/troubleshooting/troubleshooting-osd#flapping-osds\n summary: Network issues are causing OSDs to flap (mark each other down)\n" err="found duplicate series for the match group {ceph_daemon=\"osd.0\"} on the right hand-side of the operation: [{__name__=\"ceph_osd_metadata\", ceph_daemon=\"osd.0\", ceph_version=\"ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)\", cluster_addr=\"172.21.15.99\", device_class=\"ssd\", hostname=\"smithi099\", instance=\"smithi181:9283\", job=\"ceph\", objectstore=\"bluestore\", public_addr=\"172.21.15.99\"}, {__name__=\"ceph_osd_metadata\", ceph_daemon=\"osd.0\", ceph_version=\"ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)\", cluster_addr=\"172.21.15.99\", device_class=\"ssd\", hostname=\"smithi099\", instance=\"172.21.15.181:9283\", job=\"ceph\", objectstore=\"bluestore\", public_addr=\"172.21.15.99\"}];many-to-many matching not allowed: matching labels must be unique on one side" 2024-03-30T13:49:29.506 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:49:29 smithi181 ceph-mon[25762]: from='client.24806 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T13:49:29.587 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:49:29 smithi099 ceph-mon[24912]: from='client.24806 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T13:49:29.587 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:49:29 smithi099 ceph-mon[29691]: from='client.24806 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T13:49:30.506 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:49:30 smithi181 ceph-mon[25762]: pgmap v182: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 629 B/s rd, 0 op/s 2024-03-30T13:49:30.587 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:49:30 smithi099 ceph-mon[24912]: pgmap v182: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 629 B/s rd, 0 op/s 2024-03-30T13:49:30.587 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:49:30 smithi099 ceph-mon[29691]: pgmap v182: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 629 B/s rd, 0 op/s 2024-03-30T13:49:32.506 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:49:32 smithi181 ceph-mon[25762]: pgmap v183: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-03-30T13:49:32.587 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:49:32 smithi099 ceph-mon[24912]: pgmap v183: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-03-30T13:49:32.587 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:49:32 smithi099 ceph-mon[29691]: pgmap v183: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-03-30T13:49:34.256 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:49:34 smithi181 ceph-mon[25762]: pgmap v184: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 917 B/s rd, 0 op/s 2024-03-30T13:49:34.256 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:49:34 smithi181 ceph-mon[25762]: from='mgr.24746 172.21.15.181:0/2892154077' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T13:49:34.587 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:49:34 smithi099 ceph-mon[24912]: pgmap v184: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 917 B/s rd, 0 op/s 2024-03-30T13:49:34.587 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:49:34 smithi099 ceph-mon[24912]: from='mgr.24746 172.21.15.181:0/2892154077' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T13:49:34.587 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:49:34 smithi099 ceph-mon[29691]: pgmap v184: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 917 B/s rd, 0 op/s 2024-03-30T13:49:34.588 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:49:34 smithi099 ceph-mon[29691]: from='mgr.24746 172.21.15.181:0/2892154077' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T13:49:36.405 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:49:36 smithi181 ceph-mon[25762]: pgmap v185: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-03-30T13:49:36.587 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:49:36 smithi099 ceph-mon[24912]: pgmap v185: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-03-30T13:49:36.587 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:49:36 smithi099 ceph-mon[29691]: pgmap v185: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-03-30T13:49:38.006 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 13:49:37 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-x[50211]: ::ffff:172.21.15.181 - - [30/Mar/2024:13:49:37] "GET /metrics HTTP/1.1" 200 37970 "" "Prometheus/2.33.4" 2024-03-30T13:49:38.506 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:49:38 smithi181 ceph-mon[25762]: pgmap v186: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T13:49:38.587 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:49:38 smithi099 ceph-mon[24912]: pgmap v186: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T13:49:38.588 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:49:38 smithi099 ceph-mon[29691]: pgmap v186: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T13:49:39.006 INFO:journalctl@ceph.prometheus.a.smithi181.stdout:Mar 30 13:49:38 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-prometheus-a[55395]: ts=2024-03-30T13:49:38.660Z caller=manager.go:609 level=warn component="rule manager" group=osd msg="Evaluating rule failed" rule="alert: CephOSDFlapping\nexpr: (rate(ceph_osd_up[5m]) * on(ceph_daemon) group_left(hostname) ceph_osd_metadata)\n * 60 > 1\nlabels:\n oid: 1.3.6.1.4.1.50495.1.2.1.4.4\n severity: warning\n type: ceph_default\nannotations:\n description: OSD {{ $labels.ceph_daemon }} on {{ $labels.hostname }} was marked\n down and back up {{ $value | humanize }} times once a minute for 5 minutes. This\n may indicate a network issue (latency, packet loss, MTU mismatch) on the cluster\n network, or the public network if no cluster network is deployed. Check the network\n stats on the listed host(s).\n documentation: https://docs.ceph.com/en/latest/rados/troubleshooting/troubleshooting-osd#flapping-osds\n summary: Network issues are causing OSDs to flap (mark each other down)\n" err="found duplicate series for the match group {ceph_daemon=\"osd.0\"} on the right hand-side of the operation: [{__name__=\"ceph_osd_metadata\", ceph_daemon=\"osd.0\", ceph_version=\"ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)\", cluster_addr=\"172.21.15.99\", device_class=\"ssd\", hostname=\"smithi099\", instance=\"smithi181:9283\", job=\"ceph\", objectstore=\"bluestore\", public_addr=\"172.21.15.99\"}, {__name__=\"ceph_osd_metadata\", ceph_daemon=\"osd.0\", ceph_version=\"ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)\", cluster_addr=\"172.21.15.99\", device_class=\"ssd\", hostname=\"smithi099\", instance=\"172.21.15.181:9283\", job=\"ceph\", objectstore=\"bluestore\", public_addr=\"172.21.15.99\"}];many-to-many matching not allowed: matching labels must be unique on one side" 2024-03-30T13:49:39.506 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:49:39 smithi181 ceph-mon[25762]: from='client.24806 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T13:49:39.587 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:49:39 smithi099 ceph-mon[24912]: from='client.24806 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T13:49:39.587 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:49:39 smithi099 ceph-mon[29691]: from='client.24806 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T13:49:40.506 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:49:40 smithi181 ceph-mon[25762]: pgmap v187: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T13:49:40.587 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:49:40 smithi099 ceph-mon[29691]: pgmap v187: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T13:49:40.587 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:49:40 smithi099 ceph-mon[24912]: pgmap v187: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T13:49:42.506 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:49:42 smithi181 ceph-mon[25762]: pgmap v188: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T13:49:42.506 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:49:42 smithi181 ceph-mon[25762]: from='mgr.24746 172.21.15.181:0/2892154077' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:49:42.506 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:49:42 smithi181 ceph-mon[25762]: from='mgr.24746 172.21.15.181:0/2892154077' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:49:42.507 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:49:42 smithi181 ceph-mon[25762]: pgmap v189: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 1003 B/s rd, 0 op/s 2024-03-30T13:49:42.507 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:49:42 smithi181 ceph-mon[25762]: from='mgr.24746 ' entity='mgr.x' 2024-03-30T13:49:42.507 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:49:42 smithi181 ceph-mon[25762]: from='mgr.24746 ' entity='mgr.x' 2024-03-30T13:49:42.507 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:49:42 smithi181 ceph-mon[25762]: from='mgr.24746 ' entity='mgr.x' 2024-03-30T13:49:42.507 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:49:42 smithi181 ceph-mon[25762]: from='mgr.24746 ' entity='mgr.x' 2024-03-30T13:49:42.587 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:49:42 smithi099 ceph-mon[24912]: pgmap v188: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T13:49:42.587 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:49:42 smithi099 ceph-mon[24912]: from='mgr.24746 172.21.15.181:0/2892154077' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:49:42.587 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:49:42 smithi099 ceph-mon[24912]: from='mgr.24746 172.21.15.181:0/2892154077' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:49:42.588 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:49:42 smithi099 ceph-mon[24912]: pgmap v189: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 1003 B/s rd, 0 op/s 2024-03-30T13:49:42.588 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:49:42 smithi099 ceph-mon[24912]: from='mgr.24746 ' entity='mgr.x' 2024-03-30T13:49:42.588 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:49:42 smithi099 ceph-mon[24912]: from='mgr.24746 ' entity='mgr.x' 2024-03-30T13:49:42.588 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:49:42 smithi099 ceph-mon[24912]: from='mgr.24746 ' entity='mgr.x' 2024-03-30T13:49:42.588 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:49:42 smithi099 ceph-mon[24912]: from='mgr.24746 ' entity='mgr.x' 2024-03-30T13:49:42.588 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:49:42 smithi099 ceph-mon[29691]: pgmap v188: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T13:49:42.588 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:49:42 smithi099 ceph-mon[29691]: from='mgr.24746 172.21.15.181:0/2892154077' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:49:42.588 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:49:42 smithi099 ceph-mon[29691]: from='mgr.24746 172.21.15.181:0/2892154077' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:49:42.588 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:49:42 smithi099 ceph-mon[29691]: pgmap v189: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 1003 B/s rd, 0 op/s 2024-03-30T13:49:42.588 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:49:42 smithi099 ceph-mon[29691]: from='mgr.24746 ' entity='mgr.x' 2024-03-30T13:49:42.588 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:49:42 smithi099 ceph-mon[29691]: from='mgr.24746 ' entity='mgr.x' 2024-03-30T13:49:42.588 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:49:42 smithi099 ceph-mon[29691]: from='mgr.24746 ' entity='mgr.x' 2024-03-30T13:49:42.588 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:49:42 smithi099 ceph-mon[29691]: from='mgr.24746 ' entity='mgr.x' 2024-03-30T13:49:43.506 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:49:43 smithi181 ceph-mon[25762]: pgmap v190: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-03-30T13:49:43.506 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:49:43 smithi181 ceph-mon[25762]: pgmap v191: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 734 B/s rd, 0 op/s 2024-03-30T13:49:43.587 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:49:43 smithi099 ceph-mon[29691]: pgmap v190: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-03-30T13:49:43.587 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:49:43 smithi099 ceph-mon[29691]: pgmap v191: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 734 B/s rd, 0 op/s 2024-03-30T13:49:43.587 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:49:43 smithi099 ceph-mon[24912]: pgmap v190: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-03-30T13:49:43.588 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:49:43 smithi099 ceph-mon[24912]: pgmap v191: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 734 B/s rd, 0 op/s 2024-03-30T13:49:45.006 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:49:44 smithi181 ceph-mon[25762]: pgmap v192: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 734 B/s rd, 0 op/s 2024-03-30T13:49:45.053 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:49:44 smithi099 ceph-mon[24912]: pgmap v192: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 734 B/s rd, 0 op/s 2024-03-30T13:49:45.053 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:49:44 smithi099 ceph-mon[29691]: pgmap v192: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 734 B/s rd, 0 op/s 2024-03-30T13:49:46.506 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:49:46 smithi181 ceph-mon[25762]: from='mgr.24746 ' entity='mgr.x' 2024-03-30T13:49:46.506 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:49:46 smithi181 ceph-mon[25762]: from='mgr.24746 ' entity='mgr.x' 2024-03-30T13:49:46.507 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:49:46 smithi181 ceph-mon[25762]: pgmap v193: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-03-30T13:49:46.507 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:49:46 smithi181 ceph-mon[25762]: pgmap v194: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T13:49:46.507 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:49:46 smithi181 ceph-mon[25762]: from='mgr.24746 ' entity='mgr.x' 2024-03-30T13:49:46.587 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:49:46 smithi099 ceph-mon[24912]: from='mgr.24746 ' entity='mgr.x' 2024-03-30T13:49:46.588 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:49:46 smithi099 ceph-mon[24912]: from='mgr.24746 ' entity='mgr.x' 2024-03-30T13:49:46.588 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:49:46 smithi099 ceph-mon[24912]: pgmap v193: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-03-30T13:49:46.588 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:49:46 smithi099 ceph-mon[24912]: pgmap v194: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T13:49:46.588 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:49:46 smithi099 ceph-mon[24912]: from='mgr.24746 ' entity='mgr.x' 2024-03-30T13:49:46.588 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:49:46 smithi099 ceph-mon[29691]: from='mgr.24746 ' entity='mgr.x' 2024-03-30T13:49:46.588 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:49:46 smithi099 ceph-mon[29691]: from='mgr.24746 ' entity='mgr.x' 2024-03-30T13:49:46.588 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:49:46 smithi099 ceph-mon[29691]: pgmap v193: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-03-30T13:49:46.588 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:49:46 smithi099 ceph-mon[29691]: pgmap v194: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T13:49:46.588 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:49:46 smithi099 ceph-mon[29691]: from='mgr.24746 ' entity='mgr.x' 2024-03-30T13:49:48.006 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 13:49:47 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-x[50211]: ::ffff:172.21.15.181 - - [30/Mar/2024:13:49:47] "GET /metrics HTTP/1.1" 200 37970 "" "Prometheus/2.33.4" 2024-03-30T13:49:48.662 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:49:48 smithi181 ceph-mon[25762]: pgmap v195: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 861 B/s rd, 0 op/s 2024-03-30T13:49:48.837 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:49:48 smithi099 ceph-mon[24912]: pgmap v195: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 861 B/s rd, 0 op/s 2024-03-30T13:49:48.837 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:49:48 smithi099 ceph-mon[29691]: pgmap v195: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 861 B/s rd, 0 op/s 2024-03-30T13:49:49.006 INFO:journalctl@ceph.prometheus.a.smithi181.stdout:Mar 30 13:49:48 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-prometheus-a[55395]: ts=2024-03-30T13:49:48.660Z caller=manager.go:609 level=warn component="rule manager" group=osd msg="Evaluating rule failed" rule="alert: CephOSDFlapping\nexpr: (rate(ceph_osd_up[5m]) * on(ceph_daemon) group_left(hostname) ceph_osd_metadata)\n * 60 > 1\nlabels:\n oid: 1.3.6.1.4.1.50495.1.2.1.4.4\n severity: warning\n type: ceph_default\nannotations:\n description: OSD {{ $labels.ceph_daemon }} on {{ $labels.hostname }} was marked\n down and back up {{ $value | humanize }} times once a minute for 5 minutes. This\n may indicate a network issue (latency, packet loss, MTU mismatch) on the cluster\n network, or the public network if no cluster network is deployed. Check the network\n stats on the listed host(s).\n documentation: https://docs.ceph.com/en/latest/rados/troubleshooting/troubleshooting-osd#flapping-osds\n summary: Network issues are causing OSDs to flap (mark each other down)\n" err="found duplicate series for the match group {ceph_daemon=\"osd.0\"} on the right hand-side of the operation: [{__name__=\"ceph_osd_metadata\", ceph_daemon=\"osd.0\", ceph_version=\"ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)\", cluster_addr=\"172.21.15.99\", device_class=\"ssd\", hostname=\"smithi099\", instance=\"smithi181:9283\", job=\"ceph\", objectstore=\"bluestore\", public_addr=\"172.21.15.99\"}, {__name__=\"ceph_osd_metadata\", ceph_daemon=\"osd.0\", ceph_version=\"ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)\", cluster_addr=\"172.21.15.99\", device_class=\"ssd\", hostname=\"smithi099\", instance=\"172.21.15.181:9283\", job=\"ceph\", objectstore=\"bluestore\", public_addr=\"172.21.15.99\"}];many-to-many matching not allowed: matching labels must be unique on one side" 2024-03-30T13:49:49.756 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:49:49 smithi181 ceph-mon[25762]: from='client.24806 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T13:49:49.796 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:49:49 smithi181 ceph-mon[25762]: from='mgr.24746 172.21.15.181:0/2892154077' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T13:49:49.837 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:49:49 smithi099 ceph-mon[24912]: from='client.24806 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T13:49:49.837 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:49:49 smithi099 ceph-mon[24912]: from='mgr.24746 172.21.15.181:0/2892154077' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T13:49:49.838 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:49:49 smithi099 ceph-mon[29691]: from='client.24806 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T13:49:49.838 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:49:49 smithi099 ceph-mon[29691]: from='mgr.24746 172.21.15.181:0/2892154077' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T13:49:50.756 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:49:50 smithi181 ceph-mon[25762]: pgmap v196: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 713 B/s rd, 0 op/s 2024-03-30T13:49:50.837 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:49:50 smithi099 ceph-mon[24912]: pgmap v196: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 713 B/s rd, 0 op/s 2024-03-30T13:49:50.837 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:49:50 smithi099 ceph-mon[29691]: pgmap v196: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 713 B/s rd, 0 op/s 2024-03-30T13:49:52.756 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:49:52 smithi181 ceph-mon[25762]: pgmap v197: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-03-30T13:49:52.837 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:49:52 smithi099 ceph-mon[24912]: pgmap v197: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-03-30T13:49:52.837 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:49:52 smithi099 ceph-mon[29691]: pgmap v197: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-03-30T13:49:54.756 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:49:54 smithi181 ceph-mon[25762]: pgmap v198: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-03-30T13:49:54.837 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:49:54 smithi099 ceph-mon[24912]: pgmap v198: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-03-30T13:49:54.837 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:49:54 smithi099 ceph-mon[29691]: pgmap v198: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-03-30T13:49:56.587 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:49:56 smithi099 ceph-mon[24912]: pgmap v199: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-03-30T13:49:56.588 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:49:56 smithi099 ceph-mon[29691]: pgmap v199: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-03-30T13:49:56.756 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:49:56 smithi181 ceph-mon[25762]: pgmap v199: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-03-30T13:49:57.756 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 13:49:57 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-x[50211]: ::ffff:172.21.15.181 - - [30/Mar/2024:13:49:57] "GET /metrics HTTP/1.1" 200 37971 "" "Prometheus/2.33.4" 2024-03-30T13:49:58.587 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:49:58 smithi099 ceph-mon[24912]: pgmap v200: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T13:49:58.587 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:49:58 smithi099 ceph-mon[29691]: pgmap v200: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T13:49:58.660 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:49:58 smithi181 ceph-mon[25762]: pgmap v200: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T13:49:59.006 INFO:journalctl@ceph.prometheus.a.smithi181.stdout:Mar 30 13:49:58 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-prometheus-a[55395]: ts=2024-03-30T13:49:58.659Z caller=manager.go:609 level=warn component="rule manager" group=osd msg="Evaluating rule failed" rule="alert: CephOSDFlapping\nexpr: (rate(ceph_osd_up[5m]) * on(ceph_daemon) group_left(hostname) ceph_osd_metadata)\n * 60 > 1\nlabels:\n oid: 1.3.6.1.4.1.50495.1.2.1.4.4\n severity: warning\n type: ceph_default\nannotations:\n description: OSD {{ $labels.ceph_daemon }} on {{ $labels.hostname }} was marked\n down and back up {{ $value | humanize }} times once a minute for 5 minutes. This\n may indicate a network issue (latency, packet loss, MTU mismatch) on the cluster\n network, or the public network if no cluster network is deployed. Check the network\n stats on the listed host(s).\n documentation: https://docs.ceph.com/en/latest/rados/troubleshooting/troubleshooting-osd#flapping-osds\n summary: Network issues are causing OSDs to flap (mark each other down)\n" err="found duplicate series for the match group {ceph_daemon=\"osd.0\"} on the right hand-side of the operation: [{__name__=\"ceph_osd_metadata\", ceph_daemon=\"osd.0\", ceph_version=\"ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)\", cluster_addr=\"172.21.15.99\", device_class=\"ssd\", hostname=\"smithi099\", instance=\"smithi181:9283\", job=\"ceph\", objectstore=\"bluestore\", public_addr=\"172.21.15.99\"}, {__name__=\"ceph_osd_metadata\", ceph_daemon=\"osd.0\", ceph_version=\"ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)\", cluster_addr=\"172.21.15.99\", device_class=\"ssd\", hostname=\"smithi099\", instance=\"172.21.15.181:9283\", job=\"ceph\", objectstore=\"bluestore\", public_addr=\"172.21.15.99\"}];many-to-many matching not allowed: matching labels must be unique on one side" 2024-03-30T13:49:59.756 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:49:59 smithi181 ceph-mon[25762]: from='client.24806 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T13:49:59.837 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:49:59 smithi099 ceph-mon[24912]: from='client.24806 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T13:49:59.837 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:49:59 smithi099 ceph-mon[29691]: from='client.24806 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T13:50:00.756 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:50:00 smithi181 ceph-mon[25762]: pgmap v201: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T13:50:00.756 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:50:00 smithi181 ceph-mon[25762]: Health detail: HEALTH_WARN 1 failed cephadm daemon(s) 2024-03-30T13:50:00.756 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:50:00 smithi181 ceph-mon[25762]: [WRN] CEPHADM_FAILED_DAEMON: 1 failed cephadm daemon(s) 2024-03-30T13:50:00.756 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:50:00 smithi181 ceph-mon[25762]: daemon grafana.a on smithi181 is in error state 2024-03-30T13:50:00.837 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:50:00 smithi099 ceph-mon[24912]: pgmap v201: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T13:50:00.837 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:50:00 smithi099 ceph-mon[24912]: Health detail: HEALTH_WARN 1 failed cephadm daemon(s) 2024-03-30T13:50:00.837 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:50:00 smithi099 ceph-mon[24912]: [WRN] CEPHADM_FAILED_DAEMON: 1 failed cephadm daemon(s) 2024-03-30T13:50:00.837 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:50:00 smithi099 ceph-mon[24912]: daemon grafana.a on smithi181 is in error state 2024-03-30T13:50:00.838 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:50:00 smithi099 ceph-mon[29691]: pgmap v201: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T13:50:00.838 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:50:00 smithi099 ceph-mon[29691]: Health detail: HEALTH_WARN 1 failed cephadm daemon(s) 2024-03-30T13:50:00.838 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:50:00 smithi099 ceph-mon[29691]: [WRN] CEPHADM_FAILED_DAEMON: 1 failed cephadm daemon(s) 2024-03-30T13:50:00.838 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:50:00 smithi099 ceph-mon[29691]: daemon grafana.a on smithi181 is in error state 2024-03-30T13:50:02.587 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:50:02 smithi099 ceph-mon[24912]: pgmap v202: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T13:50:02.587 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:50:02 smithi099 ceph-mon[24912]: from='mgr.24746 ' entity='mgr.x' 2024-03-30T13:50:02.587 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:50:02 smithi099 ceph-mon[24912]: from='mgr.24746 ' entity='mgr.x' 2024-03-30T13:50:02.587 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:50:02 smithi099 ceph-mon[24912]: from='mgr.24746 ' entity='mgr.x' 2024-03-30T13:50:02.588 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:50:02 smithi099 ceph-mon[29691]: pgmap v202: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T13:50:02.588 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:50:02 smithi099 ceph-mon[29691]: from='mgr.24746 ' entity='mgr.x' 2024-03-30T13:50:02.588 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:50:02 smithi099 ceph-mon[29691]: from='mgr.24746 ' entity='mgr.x' 2024-03-30T13:50:02.588 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:50:02 smithi099 ceph-mon[29691]: from='mgr.24746 ' entity='mgr.x' 2024-03-30T13:50:02.756 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:50:02 smithi181 ceph-mon[25762]: pgmap v202: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T13:50:02.756 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:50:02 smithi181 ceph-mon[25762]: from='mgr.24746 ' entity='mgr.x' 2024-03-30T13:50:02.756 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:50:02 smithi181 ceph-mon[25762]: from='mgr.24746 ' entity='mgr.x' 2024-03-30T13:50:02.756 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:50:02 smithi181 ceph-mon[25762]: from='mgr.24746 ' entity='mgr.x' 2024-03-30T13:50:03.756 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:50:03 smithi181 ceph-mon[25762]: pgmap v203: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 933 B/s rd, 0 op/s 2024-03-30T13:50:03.756 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:50:03 smithi181 ceph-mon[25762]: pgmap v204: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-03-30T13:50:03.837 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:50:03 smithi099 ceph-mon[24912]: pgmap v203: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 933 B/s rd, 0 op/s 2024-03-30T13:50:03.837 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:50:03 smithi099 ceph-mon[24912]: pgmap v204: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-03-30T13:50:03.838 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:50:03 smithi099 ceph-mon[29691]: pgmap v203: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 933 B/s rd, 0 op/s 2024-03-30T13:50:03.838 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:50:03 smithi099 ceph-mon[29691]: pgmap v204: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-03-30T13:50:05.006 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:50:04 smithi181 ceph-mon[25762]: from='mgr.24746 172.21.15.181:0/2892154077' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T13:50:05.006 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:50:04 smithi181 ceph-mon[25762]: pgmap v205: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 571 B/s rd, 0 op/s 2024-03-30T13:50:05.017 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:50:04 smithi099 ceph-mon[24912]: from='mgr.24746 172.21.15.181:0/2892154077' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T13:50:05.017 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:50:04 smithi099 ceph-mon[24912]: pgmap v205: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 571 B/s rd, 0 op/s 2024-03-30T13:50:05.018 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:50:04 smithi099 ceph-mon[29691]: from='mgr.24746 172.21.15.181:0/2892154077' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T13:50:05.018 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:50:04 smithi099 ceph-mon[29691]: pgmap v205: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 571 B/s rd, 0 op/s 2024-03-30T13:50:06.756 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:50:06 smithi181 ceph-mon[25762]: from='mgr.24746 ' entity='mgr.x' 2024-03-30T13:50:06.756 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:50:06 smithi181 ceph-mon[25762]: from='mgr.24746 ' entity='mgr.x' 2024-03-30T13:50:06.756 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:50:06 smithi181 ceph-mon[25762]: pgmap v206: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T13:50:06.756 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:50:06 smithi181 ceph-mon[25762]: from='mgr.24746 ' entity='mgr.x' 2024-03-30T13:50:06.837 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:50:06 smithi099 ceph-mon[24912]: from='mgr.24746 ' entity='mgr.x' 2024-03-30T13:50:06.837 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:50:06 smithi099 ceph-mon[24912]: from='mgr.24746 ' entity='mgr.x' 2024-03-30T13:50:06.837 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:50:06 smithi099 ceph-mon[24912]: pgmap v206: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T13:50:06.837 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:50:06 smithi099 ceph-mon[24912]: from='mgr.24746 ' entity='mgr.x' 2024-03-30T13:50:06.837 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:50:06 smithi099 ceph-mon[29691]: from='mgr.24746 ' entity='mgr.x' 2024-03-30T13:50:06.838 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:50:06 smithi099 ceph-mon[29691]: from='mgr.24746 ' entity='mgr.x' 2024-03-30T13:50:06.838 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:50:06 smithi099 ceph-mon[29691]: pgmap v206: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T13:50:06.838 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:50:06 smithi099 ceph-mon[29691]: from='mgr.24746 ' entity='mgr.x' 2024-03-30T13:50:08.006 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 13:50:07 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-x[50211]: ::ffff:172.21.15.181 - - [30/Mar/2024:13:50:07] "GET /metrics HTTP/1.1" 200 37971 "" "Prometheus/2.33.4" 2024-03-30T13:50:08.756 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:50:08 smithi181 ceph-mon[25762]: pgmap v207: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T13:50:08.756 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:50:08 smithi181 ceph-mon[25762]: from='client.24806 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T13:50:08.756 INFO:journalctl@ceph.prometheus.a.smithi181.stdout:Mar 30 13:50:08 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-prometheus-a[55395]: ts=2024-03-30T13:50:08.659Z caller=manager.go:609 level=warn component="rule manager" group=osd msg="Evaluating rule failed" rule="alert: CephOSDFlapping\nexpr: (rate(ceph_osd_up[5m]) * on(ceph_daemon) group_left(hostname) ceph_osd_metadata)\n * 60 > 1\nlabels:\n oid: 1.3.6.1.4.1.50495.1.2.1.4.4\n severity: warning\n type: ceph_default\nannotations:\n description: OSD {{ $labels.ceph_daemon }} on {{ $labels.hostname }} was marked\n down and back up {{ $value | humanize }} times once a minute for 5 minutes. This\n may indicate a network issue (latency, packet loss, MTU mismatch) on the cluster\n network, or the public network if no cluster network is deployed. Check the network\n stats on the listed host(s).\n documentation: https://docs.ceph.com/en/latest/rados/troubleshooting/troubleshooting-osd#flapping-osds\n summary: Network issues are causing OSDs to flap (mark each other down)\n" err="found duplicate series for the match group {ceph_daemon=\"osd.0\"} on the right hand-side of the operation: [{__name__=\"ceph_osd_metadata\", ceph_daemon=\"osd.0\", ceph_version=\"ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)\", cluster_addr=\"172.21.15.99\", device_class=\"ssd\", hostname=\"smithi099\", instance=\"smithi181:9283\", job=\"ceph\", objectstore=\"bluestore\", public_addr=\"172.21.15.99\"}, {__name__=\"ceph_osd_metadata\", ceph_daemon=\"osd.0\", ceph_version=\"ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)\", cluster_addr=\"172.21.15.99\", device_class=\"ssd\", hostname=\"smithi099\", instance=\"172.21.15.181:9283\", job=\"ceph\", objectstore=\"bluestore\", public_addr=\"172.21.15.99\"}];many-to-many matching not allowed: matching labels must be unique on one side" 2024-03-30T13:50:08.837 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:50:08 smithi099 ceph-mon[24912]: pgmap v207: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T13:50:08.837 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:50:08 smithi099 ceph-mon[24912]: from='client.24806 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T13:50:08.837 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:50:08 smithi099 ceph-mon[29691]: pgmap v207: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T13:50:08.837 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:50:08 smithi099 ceph-mon[29691]: from='client.24806 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T13:50:11.006 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:50:10 smithi181 ceph-mon[25762]: pgmap v208: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 629 B/s rd, 0 op/s 2024-03-30T13:50:11.087 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:50:10 smithi099 ceph-mon[24912]: pgmap v208: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 629 B/s rd, 0 op/s 2024-03-30T13:50:11.087 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:50:10 smithi099 ceph-mon[29691]: pgmap v208: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 629 B/s rd, 0 op/s 2024-03-30T13:50:13.006 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:50:12 smithi181 ceph-mon[25762]: pgmap v209: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-03-30T13:50:13.087 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:50:12 smithi099 ceph-mon[24912]: pgmap v209: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-03-30T13:50:13.087 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:50:12 smithi099 ceph-mon[29691]: pgmap v209: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-03-30T13:50:15.006 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:50:14 smithi181 ceph-mon[25762]: pgmap v210: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 916 B/s rd, 0 op/s 2024-03-30T13:50:15.087 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:50:14 smithi099 ceph-mon[24912]: pgmap v210: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 916 B/s rd, 0 op/s 2024-03-30T13:50:15.087 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:50:14 smithi099 ceph-mon[29691]: pgmap v210: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 916 B/s rd, 0 op/s 2024-03-30T13:50:17.006 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:50:16 smithi181 ceph-mon[25762]: pgmap v211: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-03-30T13:50:17.087 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:50:16 smithi099 ceph-mon[24912]: pgmap v211: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-03-30T13:50:17.087 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:50:16 smithi099 ceph-mon[29691]: pgmap v211: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-03-30T13:50:18.006 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 13:50:17 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-x[50211]: ::ffff:172.21.15.181 - - [30/Mar/2024:13:50:17] "GET /metrics HTTP/1.1" 200 37971 "" "Prometheus/2.33.4" 2024-03-30T13:50:19.006 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:50:18 smithi181 ceph-mon[25762]: pgmap v212: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T13:50:19.006 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:50:18 smithi181 ceph-mon[25762]: from='client.24806 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T13:50:19.006 INFO:journalctl@ceph.prometheus.a.smithi181.stdout:Mar 30 13:50:18 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-prometheus-a[55395]: ts=2024-03-30T13:50:18.660Z caller=manager.go:609 level=warn component="rule manager" group=osd msg="Evaluating rule failed" rule="alert: CephOSDFlapping\nexpr: (rate(ceph_osd_up[5m]) * on(ceph_daemon) group_left(hostname) ceph_osd_metadata)\n * 60 > 1\nlabels:\n oid: 1.3.6.1.4.1.50495.1.2.1.4.4\n severity: warning\n type: ceph_default\nannotations:\n description: OSD {{ $labels.ceph_daemon }} on {{ $labels.hostname }} was marked\n down and back up {{ $value | humanize }} times once a minute for 5 minutes. This\n may indicate a network issue (latency, packet loss, MTU mismatch) on the cluster\n network, or the public network if no cluster network is deployed. Check the network\n stats on the listed host(s).\n documentation: https://docs.ceph.com/en/latest/rados/troubleshooting/troubleshooting-osd#flapping-osds\n summary: Network issues are causing OSDs to flap (mark each other down)\n" err="found duplicate series for the match group {ceph_daemon=\"osd.0\"} on the right hand-side of the operation: [{__name__=\"ceph_osd_metadata\", ceph_daemon=\"osd.0\", ceph_version=\"ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)\", cluster_addr=\"172.21.15.99\", device_class=\"ssd\", hostname=\"smithi099\", instance=\"smithi181:9283\", job=\"ceph\", objectstore=\"bluestore\", public_addr=\"172.21.15.99\"}, {__name__=\"ceph_osd_metadata\", ceph_daemon=\"osd.0\", ceph_version=\"ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)\", cluster_addr=\"172.21.15.99\", device_class=\"ssd\", hostname=\"smithi099\", instance=\"172.21.15.181:9283\", job=\"ceph\", objectstore=\"bluestore\", public_addr=\"172.21.15.99\"}];many-to-many matching not allowed: matching labels must be unique on one side" 2024-03-30T13:50:19.087 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:50:18 smithi099 ceph-mon[24912]: pgmap v212: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T13:50:19.087 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:50:18 smithi099 ceph-mon[24912]: from='client.24806 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T13:50:19.087 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:50:18 smithi099 ceph-mon[29691]: pgmap v212: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T13:50:19.087 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:50:18 smithi099 ceph-mon[29691]: from='client.24806 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T13:50:20.006 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:50:19 smithi181 ceph-mon[25762]: from='mgr.24746 172.21.15.181:0/2892154077' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T13:50:20.087 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:50:19 smithi099 ceph-mon[24912]: from='mgr.24746 172.21.15.181:0/2892154077' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T13:50:20.087 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:50:19 smithi099 ceph-mon[29691]: from='mgr.24746 172.21.15.181:0/2892154077' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T13:50:21.006 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:50:20 smithi181 ceph-mon[25762]: pgmap v213: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T13:50:21.086 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:50:20 smithi099 ceph-mon[24912]: pgmap v213: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T13:50:21.087 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:50:20 smithi099 ceph-mon[29691]: pgmap v213: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T13:50:23.756 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:50:23 smithi181 ceph-mon[25762]: pgmap v214: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T13:50:23.756 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:50:23 smithi181 ceph-mon[25762]: from='mgr.24746 ' entity='mgr.x' 2024-03-30T13:50:23.756 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:50:23 smithi181 ceph-mon[25762]: from='mgr.24746 ' entity='mgr.x' 2024-03-30T13:50:23.756 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:50:23 smithi181 ceph-mon[25762]: pgmap v215: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 933 B/s rd, 0 op/s 2024-03-30T13:50:23.756 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:50:23 smithi181 ceph-mon[25762]: pgmap v216: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-03-30T13:50:23.756 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:50:23 smithi181 ceph-mon[25762]: from='mgr.24746 ' entity='mgr.x' 2024-03-30T13:50:23.837 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:50:23 smithi099 ceph-mon[24912]: pgmap v214: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T13:50:23.837 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:50:23 smithi099 ceph-mon[24912]: from='mgr.24746 ' entity='mgr.x' 2024-03-30T13:50:23.837 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:50:23 smithi099 ceph-mon[24912]: from='mgr.24746 ' entity='mgr.x' 2024-03-30T13:50:23.837 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:50:23 smithi099 ceph-mon[24912]: pgmap v215: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 933 B/s rd, 0 op/s 2024-03-30T13:50:23.837 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:50:23 smithi099 ceph-mon[24912]: pgmap v216: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-03-30T13:50:23.837 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:50:23 smithi099 ceph-mon[24912]: from='mgr.24746 ' entity='mgr.x' 2024-03-30T13:50:23.837 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:50:23 smithi099 ceph-mon[29691]: pgmap v214: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T13:50:23.837 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:50:23 smithi099 ceph-mon[29691]: from='mgr.24746 ' entity='mgr.x' 2024-03-30T13:50:23.837 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:50:23 smithi099 ceph-mon[29691]: from='mgr.24746 ' entity='mgr.x' 2024-03-30T13:50:23.837 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:50:23 smithi099 ceph-mon[29691]: pgmap v215: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 933 B/s rd, 0 op/s 2024-03-30T13:50:23.838 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:50:23 smithi099 ceph-mon[29691]: pgmap v216: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-03-30T13:50:23.838 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:50:23 smithi099 ceph-mon[29691]: from='mgr.24746 ' entity='mgr.x' 2024-03-30T13:50:25.006 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:50:24 smithi181 ceph-mon[25762]: pgmap v217: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 570 B/s rd, 0 op/s 2024-03-30T13:50:25.087 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:50:24 smithi099 ceph-mon[24912]: pgmap v217: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 570 B/s rd, 0 op/s 2024-03-30T13:50:25.087 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:50:24 smithi099 ceph-mon[29691]: pgmap v217: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 570 B/s rd, 0 op/s 2024-03-30T13:50:26.837 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:50:26 smithi099 ceph-mon[24912]: from='mgr.24746 ' entity='mgr.x' 2024-03-30T13:50:26.837 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:50:26 smithi099 ceph-mon[24912]: from='mgr.24746 ' entity='mgr.x' 2024-03-30T13:50:26.837 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:50:26 smithi099 ceph-mon[24912]: pgmap v218: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T13:50:26.837 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:50:26 smithi099 ceph-mon[24912]: pgmap v219: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-03-30T13:50:26.837 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:50:26 smithi099 ceph-mon[24912]: from='mgr.24746 ' entity='mgr.x' 2024-03-30T13:50:26.837 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:50:26 smithi099 ceph-mon[29691]: from='mgr.24746 ' entity='mgr.x' 2024-03-30T13:50:26.837 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:50:26 smithi099 ceph-mon[29691]: from='mgr.24746 ' entity='mgr.x' 2024-03-30T13:50:26.837 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:50:26 smithi099 ceph-mon[29691]: pgmap v218: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T13:50:26.838 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:50:26 smithi099 ceph-mon[29691]: pgmap v219: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-03-30T13:50:26.838 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:50:26 smithi099 ceph-mon[29691]: from='mgr.24746 ' entity='mgr.x' 2024-03-30T13:50:27.006 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:50:26 smithi181 ceph-mon[25762]: from='mgr.24746 ' entity='mgr.x' 2024-03-30T13:50:27.006 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:50:26 smithi181 ceph-mon[25762]: from='mgr.24746 ' entity='mgr.x' 2024-03-30T13:50:27.006 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:50:26 smithi181 ceph-mon[25762]: pgmap v218: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T13:50:27.006 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:50:26 smithi181 ceph-mon[25762]: pgmap v219: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-03-30T13:50:27.006 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:50:26 smithi181 ceph-mon[25762]: from='mgr.24746 ' entity='mgr.x' 2024-03-30T13:50:28.005 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 13:50:27 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-x[50211]: ::ffff:172.21.15.181 - - [30/Mar/2024:13:50:27] "GET /metrics HTTP/1.1" 200 37971 "" "Prometheus/2.33.4" 2024-03-30T13:50:29.006 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:50:28 smithi181 ceph-mon[25762]: pgmap v220: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 835 B/s rd, 0 op/s 2024-03-30T13:50:29.006 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:50:28 smithi181 ceph-mon[25762]: from='client.24806 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T13:50:29.006 INFO:journalctl@ceph.prometheus.a.smithi181.stdout:Mar 30 13:50:28 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-prometheus-a[55395]: ts=2024-03-30T13:50:28.660Z caller=manager.go:609 level=warn component="rule manager" group=osd msg="Evaluating rule failed" rule="alert: CephOSDFlapping\nexpr: (rate(ceph_osd_up[5m]) * on(ceph_daemon) group_left(hostname) ceph_osd_metadata)\n * 60 > 1\nlabels:\n oid: 1.3.6.1.4.1.50495.1.2.1.4.4\n severity: warning\n type: ceph_default\nannotations:\n description: OSD {{ $labels.ceph_daemon }} on {{ $labels.hostname }} was marked\n down and back up {{ $value | humanize }} times once a minute for 5 minutes. This\n may indicate a network issue (latency, packet loss, MTU mismatch) on the cluster\n network, or the public network if no cluster network is deployed. Check the network\n stats on the listed host(s).\n documentation: https://docs.ceph.com/en/latest/rados/troubleshooting/troubleshooting-osd#flapping-osds\n summary: Network issues are causing OSDs to flap (mark each other down)\n" err="found duplicate series for the match group {ceph_daemon=\"osd.0\"} on the right hand-side of the operation: [{__name__=\"ceph_osd_metadata\", ceph_daemon=\"osd.0\", ceph_version=\"ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)\", cluster_addr=\"172.21.15.99\", device_class=\"ssd\", hostname=\"smithi099\", instance=\"smithi181:9283\", job=\"ceph\", objectstore=\"bluestore\", public_addr=\"172.21.15.99\"}, {__name__=\"ceph_osd_metadata\", ceph_daemon=\"osd.0\", ceph_version=\"ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)\", cluster_addr=\"172.21.15.99\", device_class=\"ssd\", hostname=\"smithi099\", instance=\"172.21.15.181:9283\", job=\"ceph\", objectstore=\"bluestore\", public_addr=\"172.21.15.99\"}];many-to-many matching not allowed: matching labels must be unique on one side" 2024-03-30T13:50:29.086 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:50:28 smithi099 ceph-mon[24912]: pgmap v220: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 835 B/s rd, 0 op/s 2024-03-30T13:50:29.087 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:50:28 smithi099 ceph-mon[24912]: from='client.24806 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T13:50:29.087 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:50:28 smithi099 ceph-mon[29691]: pgmap v220: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 835 B/s rd, 0 op/s 2024-03-30T13:50:29.087 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:50:28 smithi099 ceph-mon[29691]: from='client.24806 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T13:50:31.006 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:50:30 smithi181 ceph-mon[25762]: pgmap v221: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 714 B/s rd, 0 op/s 2024-03-30T13:50:31.086 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:50:30 smithi099 ceph-mon[24912]: pgmap v221: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 714 B/s rd, 0 op/s 2024-03-30T13:50:31.087 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:50:30 smithi099 ceph-mon[29691]: pgmap v221: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 714 B/s rd, 0 op/s 2024-03-30T13:50:33.005 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:50:32 smithi181 ceph-mon[25762]: pgmap v222: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-03-30T13:50:33.086 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:50:32 smithi099 ceph-mon[24912]: pgmap v222: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-03-30T13:50:33.087 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:50:32 smithi099 ceph-mon[29691]: pgmap v222: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-03-30T13:50:35.005 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:50:34 smithi181 ceph-mon[25762]: pgmap v223: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-03-30T13:50:35.006 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:50:34 smithi181 ceph-mon[25762]: from='mgr.24746 172.21.15.181:0/2892154077' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T13:50:35.086 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:50:34 smithi099 ceph-mon[24912]: pgmap v223: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-03-30T13:50:35.087 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:50:34 smithi099 ceph-mon[24912]: from='mgr.24746 172.21.15.181:0/2892154077' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T13:50:35.087 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:50:34 smithi099 ceph-mon[29691]: pgmap v223: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-03-30T13:50:35.087 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:50:34 smithi099 ceph-mon[29691]: from='mgr.24746 172.21.15.181:0/2892154077' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T13:50:36.961 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:50:36 smithi181 ceph-mon[25762]: pgmap v224: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-03-30T13:50:37.086 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:50:36 smithi099 ceph-mon[24912]: pgmap v224: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-03-30T13:50:37.087 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:50:36 smithi099 ceph-mon[29691]: pgmap v224: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-03-30T13:50:37.748 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 13:50:37 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-x[50211]: ::ffff:172.21.15.181 - - [30/Mar/2024:13:50:37] "GET /metrics HTTP/1.1" 200 37970 "" "Prometheus/2.33.4" 2024-03-30T13:50:38.870 INFO:journalctl@ceph.prometheus.a.smithi181.stdout:Mar 30 13:50:38 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-prometheus-a[55395]: ts=2024-03-30T13:50:38.660Z caller=manager.go:609 level=warn component="rule manager" group=osd msg="Evaluating rule failed" rule="alert: CephOSDFlapping\nexpr: (rate(ceph_osd_up[5m]) * on(ceph_daemon) group_left(hostname) ceph_osd_metadata)\n * 60 > 1\nlabels:\n oid: 1.3.6.1.4.1.50495.1.2.1.4.4\n severity: warning\n type: ceph_default\nannotations:\n description: OSD {{ $labels.ceph_daemon }} on {{ $labels.hostname }} was marked\n down and back up {{ $value | humanize }} times once a minute for 5 minutes. This\n may indicate a network issue (latency, packet loss, MTU mismatch) on the cluster\n network, or the public network if no cluster network is deployed. Check the network\n stats on the listed host(s).\n documentation: https://docs.ceph.com/en/latest/rados/troubleshooting/troubleshooting-osd#flapping-osds\n summary: Network issues are causing OSDs to flap (mark each other down)\n" err="found duplicate series for the match group {ceph_daemon=\"osd.0\"} on the right hand-side of the operation: [{__name__=\"ceph_osd_metadata\", ceph_daemon=\"osd.0\", ceph_version=\"ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)\", cluster_addr=\"172.21.15.99\", device_class=\"ssd\", hostname=\"smithi099\", instance=\"smithi181:9283\", job=\"ceph\", objectstore=\"bluestore\", public_addr=\"172.21.15.99\"}, {__name__=\"ceph_osd_metadata\", ceph_daemon=\"osd.0\", ceph_version=\"ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)\", cluster_addr=\"172.21.15.99\", device_class=\"ssd\", hostname=\"smithi099\", instance=\"172.21.15.181:9283\", job=\"ceph\", objectstore=\"bluestore\", public_addr=\"172.21.15.99\"}];many-to-many matching not allowed: matching labels must be unique on one side" 2024-03-30T13:50:38.870 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:50:38 smithi181 ceph-mon[25762]: pgmap v225: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T13:50:38.870 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:50:38 smithi181 ceph-mon[25762]: from='client.24806 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T13:50:39.086 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:50:38 smithi099 ceph-mon[24912]: pgmap v225: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T13:50:39.086 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:50:38 smithi099 ceph-mon[24912]: from='client.24806 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T13:50:39.087 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:50:38 smithi099 ceph-mon[29691]: pgmap v225: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T13:50:39.087 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:50:38 smithi099 ceph-mon[29691]: from='client.24806 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T13:50:41.005 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:50:40 smithi181 ceph-mon[25762]: pgmap v226: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T13:50:41.087 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:50:40 smithi099 ceph-mon[24912]: pgmap v226: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T13:50:41.087 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:50:40 smithi099 ceph-mon[29691]: pgmap v226: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T13:50:42.086 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:50:41 smithi099 ceph-mon[24912]: from='mgr.24746 172.21.15.181:0/2892154077' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:50:42.086 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:50:41 smithi099 ceph-mon[24912]: from='mgr.24746 172.21.15.181:0/2892154077' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:50:42.087 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:50:41 smithi099 ceph-mon[24912]: from='mgr.24746 ' entity='mgr.x' 2024-03-30T13:50:42.087 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:50:41 smithi099 ceph-mon[29691]: from='mgr.24746 172.21.15.181:0/2892154077' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:50:42.087 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:50:41 smithi099 ceph-mon[29691]: from='mgr.24746 172.21.15.181:0/2892154077' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:50:42.087 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:50:41 smithi099 ceph-mon[29691]: from='mgr.24746 ' entity='mgr.x' 2024-03-30T13:50:42.255 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:50:41 smithi181 ceph-mon[25762]: from='mgr.24746 172.21.15.181:0/2892154077' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:50:42.256 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:50:41 smithi181 ceph-mon[25762]: from='mgr.24746 172.21.15.181:0/2892154077' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:50:42.256 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:50:41 smithi181 ceph-mon[25762]: from='mgr.24746 ' entity='mgr.x' 2024-03-30T13:50:42.836 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:50:42 smithi099 ceph-mon[24912]: pgmap v227: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-03-30T13:50:42.837 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:50:42 smithi099 ceph-mon[24912]: pgmap v228: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 1.0 KiB/s rd, 1 op/s 2024-03-30T13:50:42.837 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:50:42 smithi099 ceph-mon[24912]: from='mgr.24746 ' entity='mgr.x' 2024-03-30T13:50:42.837 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:50:42 smithi099 ceph-mon[24912]: from='mgr.24746 ' entity='mgr.x' 2024-03-30T13:50:42.837 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:50:42 smithi099 ceph-mon[24912]: from='mgr.24746 ' entity='mgr.x' 2024-03-30T13:50:42.837 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:50:42 smithi099 ceph-mon[29691]: pgmap v227: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-03-30T13:50:42.837 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:50:42 smithi099 ceph-mon[29691]: pgmap v228: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 1.0 KiB/s rd, 1 op/s 2024-03-30T13:50:42.837 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:50:42 smithi099 ceph-mon[29691]: from='mgr.24746 ' entity='mgr.x' 2024-03-30T13:50:42.837 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:50:42 smithi099 ceph-mon[29691]: from='mgr.24746 ' entity='mgr.x' 2024-03-30T13:50:42.837 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:50:42 smithi099 ceph-mon[29691]: from='mgr.24746 ' entity='mgr.x' 2024-03-30T13:50:43.255 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:50:42 smithi181 ceph-mon[25762]: pgmap v227: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-03-30T13:50:43.256 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:50:42 smithi181 ceph-mon[25762]: pgmap v228: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 1.0 KiB/s rd, 1 op/s 2024-03-30T13:50:43.256 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:50:42 smithi181 ceph-mon[25762]: from='mgr.24746 ' entity='mgr.x' 2024-03-30T13:50:43.256 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:50:42 smithi181 ceph-mon[25762]: from='mgr.24746 ' entity='mgr.x' 2024-03-30T13:50:43.256 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:50:42 smithi181 ceph-mon[25762]: from='mgr.24746 ' entity='mgr.x' 2024-03-30T13:50:44.086 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:50:43 smithi099 ceph-mon[24912]: pgmap v229: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-03-30T13:50:44.086 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:50:43 smithi099 ceph-mon[24912]: pgmap v230: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 734 B/s rd, 0 op/s 2024-03-30T13:50:44.086 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:50:43 smithi099 ceph-mon[29691]: pgmap v229: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-03-30T13:50:44.086 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:50:43 smithi099 ceph-mon[29691]: pgmap v230: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 734 B/s rd, 0 op/s 2024-03-30T13:50:44.255 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:50:43 smithi181 ceph-mon[25762]: pgmap v229: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-03-30T13:50:44.255 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:50:43 smithi181 ceph-mon[25762]: pgmap v230: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 734 B/s rd, 0 op/s 2024-03-30T13:50:46.006 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:50:45 smithi181 ceph-mon[25762]: pgmap v231: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 734 B/s rd, 0 op/s 2024-03-30T13:50:46.006 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:50:45 smithi181 ceph-mon[25762]: from='mgr.24746 ' entity='mgr.x' 2024-03-30T13:50:46.006 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:50:45 smithi181 ceph-mon[25762]: from='mgr.24746 ' entity='mgr.x' 2024-03-30T13:50:46.006 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:50:45 smithi181 ceph-mon[25762]: from='mgr.24746 ' entity='mgr.x' 2024-03-30T13:50:46.087 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:50:45 smithi099 ceph-mon[24912]: pgmap v231: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 734 B/s rd, 0 op/s 2024-03-30T13:50:46.087 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:50:45 smithi099 ceph-mon[24912]: from='mgr.24746 ' entity='mgr.x' 2024-03-30T13:50:46.087 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:50:45 smithi099 ceph-mon[24912]: from='mgr.24746 ' entity='mgr.x' 2024-03-30T13:50:46.087 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:50:45 smithi099 ceph-mon[24912]: from='mgr.24746 ' entity='mgr.x' 2024-03-30T13:50:46.087 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:50:45 smithi099 ceph-mon[29691]: pgmap v231: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 734 B/s rd, 0 op/s 2024-03-30T13:50:46.087 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:50:45 smithi099 ceph-mon[29691]: from='mgr.24746 ' entity='mgr.x' 2024-03-30T13:50:46.087 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:50:45 smithi099 ceph-mon[29691]: from='mgr.24746 ' entity='mgr.x' 2024-03-30T13:50:46.087 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:50:45 smithi099 ceph-mon[29691]: from='mgr.24746 ' entity='mgr.x' 2024-03-30T13:50:46.824 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:50:46 smithi099 ceph-mon[24912]: pgmap v232: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-03-30T13:50:46.824 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:50:46 smithi099 ceph-mon[24912]: pgmap v233: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T13:50:46.824 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:50:46 smithi099 ceph-mon[29691]: pgmap v232: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-03-30T13:50:46.824 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:50:46 smithi099 ceph-mon[29691]: pgmap v233: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T13:50:47.255 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:50:46 smithi181 ceph-mon[25762]: pgmap v232: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-03-30T13:50:47.255 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:50:46 smithi181 ceph-mon[25762]: pgmap v233: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T13:50:48.005 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 13:50:47 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-x[50211]: ::ffff:172.21.15.181 - - [30/Mar/2024:13:50:47] "GET /metrics HTTP/1.1" 200 37970 "" "Prometheus/2.33.4" 2024-03-30T13:50:49.086 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:50:48 smithi099 ceph-mon[24912]: pgmap v234: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 826 B/s rd, 0 op/s 2024-03-30T13:50:49.086 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:50:48 smithi099 ceph-mon[24912]: from='client.24806 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T13:50:49.087 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:50:48 smithi099 ceph-mon[29691]: pgmap v234: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 826 B/s rd, 0 op/s 2024-03-30T13:50:49.087 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:50:48 smithi099 ceph-mon[29691]: from='client.24806 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T13:50:49.255 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:50:48 smithi181 ceph-mon[25762]: pgmap v234: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 826 B/s rd, 0 op/s 2024-03-30T13:50:49.256 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:50:48 smithi181 ceph-mon[25762]: from='client.24806 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T13:50:50.005 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:50:49 smithi181 ceph-mon[25762]: from='mgr.24746 172.21.15.181:0/2892154077' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T13:50:50.086 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:50:49 smithi099 ceph-mon[24912]: from='mgr.24746 172.21.15.181:0/2892154077' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T13:50:50.086 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:50:49 smithi099 ceph-mon[29691]: from='mgr.24746 172.21.15.181:0/2892154077' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T13:50:51.086 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:50:50 smithi099 ceph-mon[24912]: pgmap v235: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 714 B/s rd, 0 op/s 2024-03-30T13:50:51.087 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:50:50 smithi099 ceph-mon[29691]: pgmap v235: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 714 B/s rd, 0 op/s 2024-03-30T13:50:51.255 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:50:50 smithi181 ceph-mon[25762]: pgmap v235: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 714 B/s rd, 0 op/s 2024-03-30T13:50:53.086 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:50:52 smithi099 ceph-mon[24912]: pgmap v236: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-03-30T13:50:53.086 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:50:52 smithi099 ceph-mon[29691]: pgmap v236: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-03-30T13:50:53.255 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:50:52 smithi181 ceph-mon[25762]: pgmap v236: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-03-30T13:50:55.086 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:50:54 smithi099 ceph-mon[24912]: pgmap v237: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-03-30T13:50:55.087 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:50:54 smithi099 ceph-mon[29691]: pgmap v237: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-03-30T13:50:55.255 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:50:54 smithi181 ceph-mon[25762]: pgmap v237: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-03-30T13:50:57.087 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:50:56 smithi099 ceph-mon[29691]: pgmap v238: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-03-30T13:50:57.087 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:50:56 smithi099 ceph-mon[24912]: pgmap v238: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-03-30T13:50:57.255 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:50:56 smithi181 ceph-mon[25762]: pgmap v238: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-03-30T13:50:57.862 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 13:50:57 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-x[50211]: ::ffff:172.21.15.181 - - [30/Mar/2024:13:50:57] "GET /metrics HTTP/1.1" 200 37969 "" "Prometheus/2.33.4" 2024-03-30T13:50:58.923 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:50:58 smithi181 ceph-mon[25762]: pgmap v239: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T13:50:58.923 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:50:58 smithi181 ceph-mon[25762]: from='client.24806 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T13:50:59.086 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:50:58 smithi099 ceph-mon[24912]: pgmap v239: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T13:50:59.086 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:50:58 smithi099 ceph-mon[24912]: from='client.24806 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T13:50:59.086 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:50:58 smithi099 ceph-mon[29691]: pgmap v239: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T13:50:59.086 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:50:58 smithi099 ceph-mon[29691]: from='client.24806 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T13:51:01.086 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:51:00 smithi099 ceph-mon[24912]: pgmap v240: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T13:51:01.086 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:51:00 smithi099 ceph-mon[29691]: pgmap v240: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T13:51:01.255 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:51:00 smithi181 ceph-mon[25762]: pgmap v240: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T13:51:03.086 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:51:02 smithi099 ceph-mon[24912]: pgmap v241: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T13:51:03.086 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:51:02 smithi099 ceph-mon[24912]: from='mgr.24746 ' entity='mgr.x' 2024-03-30T13:51:03.086 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:51:02 smithi099 ceph-mon[24912]: from='mgr.24746 ' entity='mgr.x' 2024-03-30T13:51:03.087 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:51:02 smithi099 ceph-mon[24912]: from='mgr.24746 ' entity='mgr.x' 2024-03-30T13:51:03.087 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:51:02 smithi099 ceph-mon[29691]: pgmap v241: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T13:51:03.087 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:51:02 smithi099 ceph-mon[29691]: from='mgr.24746 ' entity='mgr.x' 2024-03-30T13:51:03.087 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:51:02 smithi099 ceph-mon[29691]: from='mgr.24746 ' entity='mgr.x' 2024-03-30T13:51:03.087 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:51:02 smithi099 ceph-mon[29691]: from='mgr.24746 ' entity='mgr.x' 2024-03-30T13:51:03.255 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:51:02 smithi181 ceph-mon[25762]: pgmap v241: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T13:51:03.255 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:51:02 smithi181 ceph-mon[25762]: from='mgr.24746 ' entity='mgr.x' 2024-03-30T13:51:03.255 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:51:02 smithi181 ceph-mon[25762]: from='mgr.24746 ' entity='mgr.x' 2024-03-30T13:51:03.255 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:51:02 smithi181 ceph-mon[25762]: from='mgr.24746 ' entity='mgr.x' 2024-03-30T13:51:04.086 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:51:03 smithi099 ceph-mon[29691]: pgmap v242: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 933 B/s rd, 0 op/s 2024-03-30T13:51:04.086 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:51:03 smithi099 ceph-mon[29691]: pgmap v243: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-03-30T13:51:04.086 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:51:03 smithi099 ceph-mon[24912]: pgmap v242: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 933 B/s rd, 0 op/s 2024-03-30T13:51:04.086 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:51:03 smithi099 ceph-mon[24912]: pgmap v243: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-03-30T13:51:04.255 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:51:03 smithi181 ceph-mon[25762]: pgmap v242: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 933 B/s rd, 0 op/s 2024-03-30T13:51:04.255 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:51:03 smithi181 ceph-mon[25762]: pgmap v243: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-03-30T13:51:05.087 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:51:04 smithi099 ceph-mon[24912]: from='mgr.24746 172.21.15.181:0/2892154077' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T13:51:05.087 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:51:04 smithi099 ceph-mon[29691]: from='mgr.24746 172.21.15.181:0/2892154077' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T13:51:05.255 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:51:04 smithi181 ceph-mon[25762]: from='mgr.24746 172.21.15.181:0/2892154077' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T13:51:06.081 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:51:05 smithi099 ceph-mon[24912]: pgmap v244: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 570 B/s rd, 0 op/s 2024-03-30T13:51:06.082 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:51:05 smithi099 ceph-mon[29691]: pgmap v244: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 570 B/s rd, 0 op/s 2024-03-30T13:51:06.255 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:51:05 smithi181 ceph-mon[25762]: pgmap v244: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 570 B/s rd, 0 op/s 2024-03-30T13:51:07.086 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:51:06 smithi099 ceph-mon[24912]: from='mgr.24746 ' entity='mgr.x' 2024-03-30T13:51:07.086 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:51:06 smithi099 ceph-mon[24912]: from='mgr.24746 ' entity='mgr.x' 2024-03-30T13:51:07.086 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:51:06 smithi099 ceph-mon[24912]: pgmap v245: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T13:51:07.087 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:51:06 smithi099 ceph-mon[24912]: pgmap v246: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-03-30T13:51:07.087 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:51:06 smithi099 ceph-mon[24912]: from='mgr.24746 ' entity='mgr.x' 2024-03-30T13:51:07.087 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:51:06 smithi099 ceph-mon[29691]: from='mgr.24746 ' entity='mgr.x' 2024-03-30T13:51:07.087 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:51:06 smithi099 ceph-mon[29691]: from='mgr.24746 ' entity='mgr.x' 2024-03-30T13:51:07.087 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:51:06 smithi099 ceph-mon[29691]: pgmap v245: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T13:51:07.087 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:51:06 smithi099 ceph-mon[29691]: pgmap v246: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-03-30T13:51:07.087 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:51:06 smithi099 ceph-mon[29691]: from='mgr.24746 ' entity='mgr.x' 2024-03-30T13:51:07.255 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:51:06 smithi181 ceph-mon[25762]: from='mgr.24746 ' entity='mgr.x' 2024-03-30T13:51:07.255 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:51:06 smithi181 ceph-mon[25762]: from='mgr.24746 ' entity='mgr.x' 2024-03-30T13:51:07.255 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:51:06 smithi181 ceph-mon[25762]: pgmap v245: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T13:51:07.256 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:51:06 smithi181 ceph-mon[25762]: pgmap v246: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-03-30T13:51:07.256 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:51:06 smithi181 ceph-mon[25762]: from='mgr.24746 ' entity='mgr.x' 2024-03-30T13:51:08.005 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 13:51:07 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-x[50211]: ::ffff:172.21.15.181 - - [30/Mar/2024:13:51:07] "GET /metrics HTTP/1.1" 200 37968 "" "Prometheus/2.33.4" 2024-03-30T13:51:09.255 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:51:08 smithi181 ceph-mon[25762]: from='client.24806 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T13:51:09.255 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:51:08 smithi181 ceph-mon[25762]: pgmap v247: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 834 B/s rd, 0 op/s 2024-03-30T13:51:09.336 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:51:08 smithi099 ceph-mon[24912]: from='client.24806 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T13:51:09.336 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:51:08 smithi099 ceph-mon[24912]: pgmap v247: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 834 B/s rd, 0 op/s 2024-03-30T13:51:09.336 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:51:08 smithi099 ceph-mon[29691]: from='client.24806 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T13:51:09.336 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:51:08 smithi099 ceph-mon[29691]: pgmap v247: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 834 B/s rd, 0 op/s 2024-03-30T13:51:11.255 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:51:10 smithi181 ceph-mon[25762]: pgmap v248: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 714 B/s rd, 0 op/s 2024-03-30T13:51:11.336 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:51:10 smithi099 ceph-mon[24912]: pgmap v248: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 714 B/s rd, 0 op/s 2024-03-30T13:51:11.336 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:51:10 smithi099 ceph-mon[29691]: pgmap v248: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 714 B/s rd, 0 op/s 2024-03-30T13:51:13.255 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:51:12 smithi181 ceph-mon[25762]: pgmap v249: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-03-30T13:51:13.336 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:51:12 smithi099 ceph-mon[24912]: pgmap v249: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-03-30T13:51:13.336 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:51:12 smithi099 ceph-mon[29691]: pgmap v249: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-03-30T13:51:15.005 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:51:14 smithi181 ceph-mon[25762]: pgmap v250: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-03-30T13:51:15.086 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:51:14 smithi099 ceph-mon[24912]: pgmap v250: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-03-30T13:51:15.086 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:51:14 smithi099 ceph-mon[29691]: pgmap v250: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-03-30T13:51:17.255 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:51:16 smithi181 ceph-mon[25762]: pgmap v251: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-03-30T13:51:17.336 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:51:16 smithi099 ceph-mon[24912]: pgmap v251: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-03-30T13:51:17.336 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:51:16 smithi099 ceph-mon[29691]: pgmap v251: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-03-30T13:51:17.847 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 13:51:17 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-x[50211]: ::ffff:172.21.15.181 - - [30/Mar/2024:13:51:17] "GET /metrics HTTP/1.1" 200 37968 "" "Prometheus/2.33.4" 2024-03-30T13:51:18.187 DEBUG:teuthology.orchestra.run.smithi099:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 98ebaeb8-ee99-11ee-b647-cb9ed24678a4 -e sha1=4e50bbcdd1630c7760b708f3a5b4d38a121e66cb -- bash -c 'ceph orch ps' 2024-03-30T13:51:19.072 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:51:18 smithi181 ceph-mon[25762]: from='client.24806 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T13:51:19.072 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:51:18 smithi181 ceph-mon[25762]: pgmap v252: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T13:51:19.086 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:51:18 smithi099 ceph-mon[24912]: from='client.24806 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T13:51:19.086 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:51:18 smithi099 ceph-mon[24912]: pgmap v252: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T13:51:19.086 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:51:18 smithi099 ceph-mon[29691]: from='client.24806 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T13:51:19.087 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:51:18 smithi099 ceph-mon[29691]: pgmap v252: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T13:51:20.005 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:51:19 smithi181 ceph-mon[25762]: from='mgr.24746 172.21.15.181:0/2892154077' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T13:51:20.086 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:51:19 smithi099 ceph-mon[24912]: from='mgr.24746 172.21.15.181:0/2892154077' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T13:51:20.086 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:51:19 smithi099 ceph-mon[29691]: from='mgr.24746 172.21.15.181:0/2892154077' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T13:51:20.199 INFO:teuthology.orchestra.run.smithi099.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-03-30T13:51:20.199 INFO:teuthology.orchestra.run.smithi099.stdout:agent.smithi099 smithi099 running 17s ago 19m - - 2024-03-30T13:51:20.199 INFO:teuthology.orchestra.run.smithi099.stdout:agent.smithi181 smithi181 running 14s ago 19m - - 2024-03-30T13:51:20.199 INFO:teuthology.orchestra.run.smithi099.stdout:alertmanager.a smithi099 *:9093,9094 running (5m) 17s ago 13m 24.0M - 0.23.0 ba2b418f427c 0f1be3801027 2024-03-30T13:51:20.199 INFO:teuthology.orchestra.run.smithi099.stdout:grafana.a smithi181 *:3000 error 14s ago 13m - - 2024-03-30T13:51:20.199 INFO:teuthology.orchestra.run.smithi099.stdout:iscsi.foo.smithi099.qyjuvr smithi099 running (5m) 17s ago 12m 55.7M - 3.5 e1d6a67b021e e34931b9505a 2024-03-30T13:51:20.199 INFO:teuthology.orchestra.run.smithi099.stdout:mgr.x smithi181 *:8443,9283 running (9m) 14s ago 18m 520M - 19.0.0-1967-g4e50bbcd b0c4478f1d83 f3d971ab3b10 2024-03-30T13:51:20.199 INFO:teuthology.orchestra.run.smithi099.stdout:mgr.y smithi099 *:8443,9283,8765 running (2m) 17s ago 20m 449M - 19.0.0-1967-g4e50bbcd b0c4478f1d83 0d464b8c1d18 2024-03-30T13:51:20.199 INFO:teuthology.orchestra.run.smithi099.stdout:mon.a smithi099 running (20m) 17s ago 20m 67.7M 2048M 17.2.0 e1d6a67b021e af06ebb19fd8 2024-03-30T13:51:20.199 INFO:teuthology.orchestra.run.smithi099.stdout:mon.b smithi181 running (19m) 14s ago 19m 52.2M 2048M 17.2.0 e1d6a67b021e e678a2a25c90 2024-03-30T13:51:20.199 INFO:teuthology.orchestra.run.smithi099.stdout:mon.c smithi099 running (19m) 17s ago 19m 47.7M 2048M 17.2.0 e1d6a67b021e 0f1e98917718 2024-03-30T13:51:20.199 INFO:teuthology.orchestra.run.smithi099.stdout:node-exporter.a smithi099 *:9100 running (6m) 17s ago 14m 18.8M - 1.3.1 1dbe0e931976 76284405d5f5 2024-03-30T13:51:20.199 INFO:teuthology.orchestra.run.smithi099.stdout:node-exporter.b smithi181 *:9100 running (5m) 14s ago 14m 17.1M - 1.3.1 1dbe0e931976 90245951476f 2024-03-30T13:51:20.200 INFO:teuthology.orchestra.run.smithi099.stdout:osd.0 smithi099 running (18m) 17s ago 18m 52.8M 4096M 17.2.0 e1d6a67b021e 3158ee1b0c67 2024-03-30T13:51:20.200 INFO:teuthology.orchestra.run.smithi099.stdout:osd.1 smithi099 running (18m) 17s ago 18m 55.8M 4096M 17.2.0 e1d6a67b021e c4af0fd7071a 2024-03-30T13:51:20.200 INFO:teuthology.orchestra.run.smithi099.stdout:osd.2 smithi099 running (17m) 17s ago 17m 48.9M 4096M 17.2.0 e1d6a67b021e 8e4e805a7e20 2024-03-30T13:51:20.200 INFO:teuthology.orchestra.run.smithi099.stdout:osd.3 smithi099 running (17m) 17s ago 17m 52.7M 4096M 17.2.0 e1d6a67b021e 718812bcf065 2024-03-30T13:51:20.200 INFO:teuthology.orchestra.run.smithi099.stdout:osd.4 smithi181 running (16m) 14s ago 16m 52.2M 4096M 17.2.0 e1d6a67b021e 5e205434e973 2024-03-30T13:51:20.200 INFO:teuthology.orchestra.run.smithi099.stdout:osd.5 smithi181 running (16m) 14s ago 16m 51.2M 4096M 17.2.0 e1d6a67b021e e330c920f152 2024-03-30T13:51:20.200 INFO:teuthology.orchestra.run.smithi099.stdout:osd.6 smithi181 running (16m) 14s ago 16m 49.9M 4096M 17.2.0 e1d6a67b021e 81d889ea213d 2024-03-30T13:51:20.200 INFO:teuthology.orchestra.run.smithi099.stdout:osd.7 smithi181 running (15m) 14s ago 15m 51.4M 4096M 17.2.0 e1d6a67b021e c08b1839dd7e 2024-03-30T13:51:20.200 INFO:teuthology.orchestra.run.smithi099.stdout:prometheus.a smithi181 *:9095 running (5m) 14s ago 15m 68.3M - 2.33.4 514e6a882f6e fe9273415d72 2024-03-30T13:51:20.200 INFO:teuthology.orchestra.run.smithi099.stdout:rgw.foo.smithi099.fxjbmp smithi099 *:8000 running (13m) 17s ago 13m 73.2M - 17.2.0 e1d6a67b021e 400b28b3f650 2024-03-30T13:51:20.200 INFO:teuthology.orchestra.run.smithi099.stdout:rgw.foo.smithi181.wfqwti smithi181 *:8000 running (13m) 14s ago 13m 72.8M - 17.2.0 e1d6a67b021e 97e1b130f9d4 2024-03-30T13:51:20.838 DEBUG:teuthology.orchestra.run.smithi099:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 98ebaeb8-ee99-11ee-b647-cb9ed24678a4 -e sha1=4e50bbcdd1630c7760b708f3a5b4d38a121e66cb -- bash -c 'ceph versions' 2024-03-30T13:51:21.086 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:51:20 smithi099 ceph-mon[24912]: pgmap v253: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T13:51:21.086 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:51:20 smithi099 ceph-mon[24912]: from='client.25063 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T13:51:21.086 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:51:20 smithi099 ceph-mon[29691]: pgmap v253: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T13:51:21.086 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:51:20 smithi099 ceph-mon[29691]: from='client.25063 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T13:51:21.255 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:51:20 smithi181 ceph-mon[25762]: pgmap v253: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T13:51:21.255 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:51:20 smithi181 ceph-mon[25762]: from='client.25063 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T13:51:22.881 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-03-30T13:51:22.881 INFO:teuthology.orchestra.run.smithi099.stdout: "mon": { 2024-03-30T13:51:22.881 INFO:teuthology.orchestra.run.smithi099.stdout: "ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)": 3 2024-03-30T13:51:22.881 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:51:22.881 INFO:teuthology.orchestra.run.smithi099.stdout: "mgr": { 2024-03-30T13:51:22.881 INFO:teuthology.orchestra.run.smithi099.stdout: "ceph version 19.0.0-1967-g4e50bbcd (4e50bbcdd1630c7760b708f3a5b4d38a121e66cb) squid (dev)": 2 2024-03-30T13:51:22.882 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:51:22.882 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": { 2024-03-30T13:51:22.882 INFO:teuthology.orchestra.run.smithi099.stdout: "ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)": 8 2024-03-30T13:51:22.882 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:51:22.882 INFO:teuthology.orchestra.run.smithi099.stdout: "mds": {}, 2024-03-30T13:51:22.882 INFO:teuthology.orchestra.run.smithi099.stdout: "rgw": { 2024-03-30T13:51:22.882 INFO:teuthology.orchestra.run.smithi099.stdout: "ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)": 2 2024-03-30T13:51:22.882 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:51:22.882 INFO:teuthology.orchestra.run.smithi099.stdout: "overall": { 2024-03-30T13:51:22.882 INFO:teuthology.orchestra.run.smithi099.stdout: "ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)": 13, 2024-03-30T13:51:22.882 INFO:teuthology.orchestra.run.smithi099.stdout: "ceph version 19.0.0-1967-g4e50bbcd (4e50bbcdd1630c7760b708f3a5b4d38a121e66cb) squid (dev)": 2 2024-03-30T13:51:22.882 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-03-30T13:51:22.882 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-03-30T13:51:23.086 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:51:22 smithi099 ceph-mon[24912]: pgmap v254: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T13:51:23.086 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:51:22 smithi099 ceph-mon[24912]: from='mgr.24746 ' entity='mgr.x' 2024-03-30T13:51:23.086 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:51:22 smithi099 ceph-mon[24912]: from='mgr.24746 ' entity='mgr.x' 2024-03-30T13:51:23.086 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:51:22 smithi099 ceph-mon[24912]: from='mgr.24746 ' entity='mgr.x' 2024-03-30T13:51:23.086 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:51:22 smithi099 ceph-mon[24912]: from='client.? 172.21.15.99:0/834289247' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:51:23.086 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:51:22 smithi099 ceph-mon[29691]: pgmap v254: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T13:51:23.087 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:51:22 smithi099 ceph-mon[29691]: from='mgr.24746 ' entity='mgr.x' 2024-03-30T13:51:23.087 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:51:22 smithi099 ceph-mon[29691]: from='mgr.24746 ' entity='mgr.x' 2024-03-30T13:51:23.087 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:51:22 smithi099 ceph-mon[29691]: from='mgr.24746 ' entity='mgr.x' 2024-03-30T13:51:23.087 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:51:22 smithi099 ceph-mon[29691]: from='client.? 172.21.15.99:0/834289247' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:51:23.255 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:51:22 smithi181 ceph-mon[25762]: pgmap v254: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T13:51:23.255 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:51:22 smithi181 ceph-mon[25762]: from='mgr.24746 ' entity='mgr.x' 2024-03-30T13:51:23.255 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:51:22 smithi181 ceph-mon[25762]: from='mgr.24746 ' entity='mgr.x' 2024-03-30T13:51:23.255 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:51:22 smithi181 ceph-mon[25762]: from='mgr.24746 ' entity='mgr.x' 2024-03-30T13:51:23.255 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:51:22 smithi181 ceph-mon[25762]: from='client.? 172.21.15.99:0/834289247' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:51:23.483 DEBUG:teuthology.orchestra.run.smithi099:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 98ebaeb8-ee99-11ee-b647-cb9ed24678a4 -e sha1=4e50bbcdd1630c7760b708f3a5b4d38a121e66cb -- bash -c 'ceph health detail' 2024-03-30T13:51:24.086 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:51:23 smithi099 ceph-mon[24912]: pgmap v255: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 933 B/s rd, 0 op/s 2024-03-30T13:51:24.086 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:51:23 smithi099 ceph-mon[24912]: pgmap v256: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-03-30T13:51:24.086 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:51:23 smithi099 ceph-mon[29691]: pgmap v255: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 933 B/s rd, 0 op/s 2024-03-30T13:51:24.086 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:51:23 smithi099 ceph-mon[29691]: pgmap v256: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-03-30T13:51:24.255 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:51:23 smithi181 ceph-mon[25762]: pgmap v255: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 933 B/s rd, 0 op/s 2024-03-30T13:51:24.255 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:51:23 smithi181 ceph-mon[25762]: pgmap v256: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-03-30T13:51:26.086 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:51:25 smithi099 ceph-mon[24912]: pgmap v257: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 571 B/s rd, 0 op/s 2024-03-30T13:51:26.086 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:51:25 smithi099 ceph-mon[29691]: pgmap v257: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 571 B/s rd, 0 op/s 2024-03-30T13:51:26.184 INFO:teuthology.orchestra.run.smithi099.stdout:HEALTH_WARN 1 failed cephadm daemon(s) 2024-03-30T13:51:26.184 INFO:teuthology.orchestra.run.smithi099.stdout:[WRN] CEPHADM_FAILED_DAEMON: 1 failed cephadm daemon(s) 2024-03-30T13:51:26.185 INFO:teuthology.orchestra.run.smithi099.stdout: daemon grafana.a on smithi181 is in error state 2024-03-30T13:51:26.255 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:51:25 smithi181 ceph-mon[25762]: pgmap v257: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 571 B/s rd, 0 op/s 2024-03-30T13:51:26.966 DEBUG:teuthology.orchestra.run.smithi099:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 98ebaeb8-ee99-11ee-b647-cb9ed24678a4 -e sha1=4e50bbcdd1630c7760b708f3a5b4d38a121e66cb -- bash -c 'ceph -s' 2024-03-30T13:51:27.005 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:51:26 smithi181 ceph-mon[25762]: from='mgr.24746 ' entity='mgr.x' 2024-03-30T13:51:27.005 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:51:26 smithi181 ceph-mon[25762]: from='mgr.24746 ' entity='mgr.x' 2024-03-30T13:51:27.005 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:51:26 smithi181 ceph-mon[25762]: pgmap v258: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T13:51:27.005 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:51:26 smithi181 ceph-mon[25762]: pgmap v259: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-03-30T13:51:27.005 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:51:26 smithi181 ceph-mon[25762]: from='mgr.24746 ' entity='mgr.x' 2024-03-30T13:51:27.005 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:51:26 smithi181 ceph-mon[25762]: from='client.? 172.21.15.99:0/3366684631' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-03-30T13:51:27.198 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:51:26 smithi099 ceph-mon[29691]: from='mgr.24746 ' entity='mgr.x' 2024-03-30T13:51:27.198 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:51:26 smithi099 ceph-mon[29691]: from='mgr.24746 ' entity='mgr.x' 2024-03-30T13:51:27.198 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:51:26 smithi099 ceph-mon[29691]: pgmap v258: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T13:51:27.198 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:51:26 smithi099 ceph-mon[29691]: pgmap v259: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-03-30T13:51:27.198 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:51:26 smithi099 ceph-mon[29691]: from='mgr.24746 ' entity='mgr.x' 2024-03-30T13:51:27.198 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:51:26 smithi099 ceph-mon[29691]: from='client.? 172.21.15.99:0/3366684631' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-03-30T13:51:27.198 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:51:26 smithi099 ceph-mon[24912]: from='mgr.24746 ' entity='mgr.x' 2024-03-30T13:51:27.198 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:51:26 smithi099 ceph-mon[24912]: from='mgr.24746 ' entity='mgr.x' 2024-03-30T13:51:27.199 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:51:26 smithi099 ceph-mon[24912]: pgmap v258: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T13:51:27.199 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:51:26 smithi099 ceph-mon[24912]: pgmap v259: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-03-30T13:51:27.199 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:51:26 smithi099 ceph-mon[24912]: from='mgr.24746 ' entity='mgr.x' 2024-03-30T13:51:27.199 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:51:26 smithi099 ceph-mon[24912]: from='client.? 172.21.15.99:0/3366684631' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-03-30T13:51:28.005 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 13:51:27 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-x[50211]: ::ffff:172.21.15.181 - - [30/Mar/2024:13:51:27] "GET /metrics HTTP/1.1" 200 37965 "" "Prometheus/2.33.4" 2024-03-30T13:51:29.289 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:51:29 smithi099 ceph-mon[24912]: from='client.24806 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T13:51:29.289 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:51:29 smithi099 ceph-mon[24912]: pgmap v260: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 835 B/s rd, 0 op/s 2024-03-30T13:51:29.290 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:51:29 smithi099 ceph-mon[29691]: from='client.24806 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T13:51:29.290 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:51:29 smithi099 ceph-mon[29691]: pgmap v260: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 835 B/s rd, 0 op/s 2024-03-30T13:51:29.504 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:51:29 smithi181 ceph-mon[25762]: from='client.24806 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T13:51:29.505 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:51:29 smithi181 ceph-mon[25762]: pgmap v260: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 835 B/s rd, 0 op/s 2024-03-30T13:51:30.034 INFO:teuthology.orchestra.run.smithi099.stdout: cluster: 2024-03-30T13:51:30.035 INFO:teuthology.orchestra.run.smithi099.stdout: id: 98ebaeb8-ee99-11ee-b647-cb9ed24678a4 2024-03-30T13:51:30.035 INFO:teuthology.orchestra.run.smithi099.stdout: health: HEALTH_WARN 2024-03-30T13:51:30.035 INFO:teuthology.orchestra.run.smithi099.stdout: 1 failed cephadm daemon(s) 2024-03-30T13:51:30.035 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-03-30T13:51:30.035 INFO:teuthology.orchestra.run.smithi099.stdout: services: 2024-03-30T13:51:30.035 INFO:teuthology.orchestra.run.smithi099.stdout: mon: 3 daemons, quorum a,c,b (age 19m) 2024-03-30T13:51:30.035 INFO:teuthology.orchestra.run.smithi099.stdout: mgr: x(active, since 6m), standbys: y 2024-03-30T13:51:30.035 INFO:teuthology.orchestra.run.smithi099.stdout: osd: 8 osds: 8 up (since 15m), 8 in (since 16m) 2024-03-30T13:51:30.035 INFO:teuthology.orchestra.run.smithi099.stdout: rgw: 2 daemons active (2 hosts, 1 zones) 2024-03-30T13:51:30.035 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-03-30T13:51:30.035 INFO:teuthology.orchestra.run.smithi099.stdout: data: 2024-03-30T13:51:30.035 INFO:teuthology.orchestra.run.smithi099.stdout: pools: 6 pools, 161 pgs 2024-03-30T13:51:30.035 INFO:teuthology.orchestra.run.smithi099.stdout: objects: 209 objects, 585 KiB 2024-03-30T13:51:30.035 INFO:teuthology.orchestra.run.smithi099.stdout: usage: 95 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:51:30.035 INFO:teuthology.orchestra.run.smithi099.stdout: pgs: 161 active+clean 2024-03-30T13:51:30.036 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-03-30T13:51:30.036 INFO:teuthology.orchestra.run.smithi099.stdout: io: 2024-03-30T13:51:30.036 INFO:teuthology.orchestra.run.smithi099.stdout: client: 835 B/s rd, 0 op/s rd, 0 op/s wr 2024-03-30T13:51:30.036 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-03-30T13:51:30.336 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:51:30 smithi099 ceph-mon[24912]: from='client.? 172.21.15.99:0/614983565' entity='client.admin' cmd=[{"prefix": "status"}]: dispatch 2024-03-30T13:51:30.336 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:51:30 smithi099 ceph-mon[29691]: from='client.? 172.21.15.99:0/614983565' entity='client.admin' cmd=[{"prefix": "status"}]: dispatch 2024-03-30T13:51:30.505 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:51:30 smithi181 ceph-mon[25762]: from='client.? 172.21.15.99:0/614983565' entity='client.admin' cmd=[{"prefix": "status"}]: dispatch 2024-03-30T13:51:30.718 DEBUG:teuthology.orchestra.run.smithi099:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 98ebaeb8-ee99-11ee-b647-cb9ed24678a4 -e sha1=4e50bbcdd1630c7760b708f3a5b4d38a121e66cb -- bash -c 'ceph mgr fail' 2024-03-30T13:51:31.335 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:51:31 smithi099 ceph-mon[24912]: pgmap v261: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 714 B/s rd, 0 op/s 2024-03-30T13:51:31.336 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:51:31 smithi099 ceph-mon[29691]: pgmap v261: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 714 B/s rd, 0 op/s 2024-03-30T13:51:31.505 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:51:31 smithi181 ceph-mon[25762]: pgmap v261: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 714 B/s rd, 0 op/s 2024-03-30T13:51:33.335 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:51:33 smithi099 ceph-mon[24912]: pgmap v262: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-03-30T13:51:33.335 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:51:33 smithi099 ceph-mon[24912]: from='client.? 172.21.15.99:0/2430232444' entity='client.admin' cmd=[{"prefix": "mgr fail"}]: dispatch 2024-03-30T13:51:33.336 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:51:33 smithi099 ceph-mon[24912]: osdmap e104: 8 total, 8 up, 8 in 2024-03-30T13:51:33.336 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:51:33 smithi099 ceph-mon[29691]: pgmap v262: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-03-30T13:51:33.336 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:51:33 smithi099 ceph-mon[29691]: from='client.? 172.21.15.99:0/2430232444' entity='client.admin' cmd=[{"prefix": "mgr fail"}]: dispatch 2024-03-30T13:51:33.336 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:51:33 smithi099 ceph-mon[29691]: osdmap e104: 8 total, 8 up, 8 in 2024-03-30T13:51:33.336 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:51:33 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[71049]: [30/Mar/2024:13:51:33] ENGINE Bus STOPPING 2024-03-30T13:51:33.336 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:51:33 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[71049]: [30/Mar/2024:13:51:33] ENGINE HTTP Server cherrypy._cpwsgi_server.CPWSGIServer(('::', 9283)) shut down 2024-03-30T13:51:33.336 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:51:33 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[71049]: [30/Mar/2024:13:51:33] ENGINE Bus STOPPED 2024-03-30T13:51:33.336 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:51:33 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[71049]: [30/Mar/2024:13:51:33] ENGINE Bus STARTING 2024-03-30T13:51:33.337 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:51:33 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[71049]: [30/Mar/2024:13:51:33] ENGINE Serving on http://:::9283 2024-03-30T13:51:33.337 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:51:33 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[71049]: [30/Mar/2024:13:51:33] ENGINE Bus STARTED 2024-03-30T13:51:33.505 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:51:33 smithi181 ceph-mon[25762]: pgmap v262: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-03-30T13:51:33.505 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:51:33 smithi181 ceph-mon[25762]: from='client.? 172.21.15.99:0/2430232444' entity='client.admin' cmd=[{"prefix": "mgr fail"}]: dispatch 2024-03-30T13:51:33.505 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:51:33 smithi181 ceph-mon[25762]: osdmap e104: 8 total, 8 up, 8 in 2024-03-30T13:51:33.505 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 13:51:33 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-x[50211]: 2024-03-30T13:51:33.053+0000 7f389fb2e700 -1 mgr handle_mgr_map I was active but no longer am 2024-03-30T13:51:33.505 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 13:51:33 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-x[50211]: ignoring --setuser ceph since I am not root 2024-03-30T13:51:33.505 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 13:51:33 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-x[50211]: ignoring --setgroup ceph since I am not root 2024-03-30T13:51:33.506 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 13:51:33 smithi181 ceph-mgr[50215]: -- 172.21.15.181:0/3251961361 <== mon.2 v2:172.21.15.181:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55e5602c25a0 con 0x55e560296800 2024-03-30T13:51:33.873 DEBUG:teuthology.orchestra.run.smithi099:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 98ebaeb8-ee99-11ee-b647-cb9ed24678a4 -e sha1=4e50bbcdd1630c7760b708f3a5b4d38a121e66cb -- bash -c 'sleep 180' 2024-03-30T13:51:34.004 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 13:51:33 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-x[50211]: 2024-03-30T13:51:33.620+0000 7fecb43f0200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-03-30T13:51:34.004 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 13:51:33 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-x[50211]: 2024-03-30T13:51:33.714+0000 7fecb43f0200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-03-30T13:51:34.060 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:51:34 smithi099 ceph-mon[24912]: from='client.? 172.21.15.99:0/2430232444' entity='client.admin' cmd='[{"prefix": "mgr fail"}]': finished 2024-03-30T13:51:34.060 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:51:34 smithi099 ceph-mon[24912]: mgrmap e27: y(active, starting, since 0.369725s) 2024-03-30T13:51:34.061 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:51:34 smithi099 ceph-mon[24912]: from='mgr.25057 172.21.15.99:0/1165207787' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-03-30T13:51:34.061 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:51:34 smithi099 ceph-mon[24912]: from='mgr.25057 172.21.15.99:0/1165207787' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-30T13:51:34.061 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:51:34 smithi099 ceph-mon[24912]: from='mgr.25057 172.21.15.99:0/1165207787' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-30T13:51:34.061 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:51:34 smithi099 ceph-mon[24912]: from='mgr.25057 172.21.15.99:0/1165207787' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-03-30T13:51:34.061 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:51:34 smithi099 ceph-mon[24912]: from='mgr.25057 172.21.15.99:0/1165207787' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-03-30T13:51:34.061 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:51:34 smithi099 ceph-mon[24912]: from='mgr.25057 172.21.15.99:0/1165207787' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-03-30T13:51:34.061 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:51:34 smithi099 ceph-mon[24912]: from='mgr.25057 172.21.15.99:0/1165207787' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-03-30T13:51:34.061 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:51:34 smithi099 ceph-mon[24912]: from='mgr.25057 172.21.15.99:0/1165207787' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-03-30T13:51:34.061 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:51:34 smithi099 ceph-mon[24912]: from='mgr.25057 172.21.15.99:0/1165207787' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-03-30T13:51:34.062 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:51:34 smithi099 ceph-mon[24912]: from='mgr.25057 172.21.15.99:0/1165207787' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-03-30T13:51:34.062 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:51:34 smithi099 ceph-mon[29691]: from='client.? 172.21.15.99:0/2430232444' entity='client.admin' cmd='[{"prefix": "mgr fail"}]': finished 2024-03-30T13:51:34.062 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:51:34 smithi099 ceph-mon[29691]: mgrmap e27: y(active, starting, since 0.369725s) 2024-03-30T13:51:34.062 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:51:34 smithi099 ceph-mon[29691]: from='mgr.25057 172.21.15.99:0/1165207787' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-03-30T13:51:34.062 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:51:34 smithi099 ceph-mon[29691]: from='mgr.25057 172.21.15.99:0/1165207787' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-30T13:51:34.063 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:51:34 smithi099 ceph-mon[29691]: from='mgr.25057 172.21.15.99:0/1165207787' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-30T13:51:34.063 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:51:34 smithi099 ceph-mon[29691]: from='mgr.25057 172.21.15.99:0/1165207787' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-03-30T13:51:34.063 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:51:34 smithi099 ceph-mon[29691]: from='mgr.25057 172.21.15.99:0/1165207787' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-03-30T13:51:34.063 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:51:34 smithi099 ceph-mon[29691]: from='mgr.25057 172.21.15.99:0/1165207787' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-03-30T13:51:34.063 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:51:34 smithi099 ceph-mon[29691]: from='mgr.25057 172.21.15.99:0/1165207787' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-03-30T13:51:34.063 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:51:34 smithi099 ceph-mon[29691]: from='mgr.25057 172.21.15.99:0/1165207787' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-03-30T13:51:34.063 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:51:34 smithi099 ceph-mon[29691]: from='mgr.25057 172.21.15.99:0/1165207787' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-03-30T13:51:34.063 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:51:34 smithi099 ceph-mon[29691]: from='mgr.25057 172.21.15.99:0/1165207787' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-03-30T13:51:34.063 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:51:34 smithi099 ceph-mon[29691]: from='mgr.25057 172.21.15.99:0/1165207787' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-03-30T13:51:34.064 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:51:34 smithi099 ceph-mon[29691]: from='mgr.25057 172.21.15.99:0/1165207787' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-03-30T13:51:34.064 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:51:34 smithi099 ceph-mon[29691]: from='mgr.25057 172.21.15.99:0/1165207787' entity='mgr.y' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-03-30T13:51:34.328 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:51:34 smithi181 ceph-mon[25762]: from='client.? 172.21.15.99:0/2430232444' entity='client.admin' cmd='[{"prefix": "mgr fail"}]': finished 2024-03-30T13:51:34.328 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:51:34 smithi181 ceph-mon[25762]: mgrmap e27: y(active, starting, since 0.369725s) 2024-03-30T13:51:34.328 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:51:34 smithi181 ceph-mon[25762]: from='mgr.25057 172.21.15.99:0/1165207787' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-03-30T13:51:34.328 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:51:34 smithi181 ceph-mon[25762]: from='mgr.25057 172.21.15.99:0/1165207787' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-30T13:51:34.328 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:51:34 smithi181 ceph-mon[25762]: from='mgr.25057 172.21.15.99:0/1165207787' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-30T13:51:34.328 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:51:34 smithi181 ceph-mon[25762]: from='mgr.25057 172.21.15.99:0/1165207787' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-03-30T13:51:34.328 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:51:34 smithi181 ceph-mon[25762]: from='mgr.25057 172.21.15.99:0/1165207787' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-03-30T13:51:34.328 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:51:34 smithi181 ceph-mon[25762]: from='mgr.25057 172.21.15.99:0/1165207787' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-03-30T13:51:34.329 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:51:34 smithi181 ceph-mon[25762]: from='mgr.25057 172.21.15.99:0/1165207787' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-03-30T13:51:34.329 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:51:34 smithi181 ceph-mon[25762]: from='mgr.25057 172.21.15.99:0/1165207787' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-03-30T13:51:34.329 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:51:34 smithi181 ceph-mon[25762]: from='mgr.25057 172.21.15.99:0/1165207787' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-03-30T13:51:34.329 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:51:34 smithi181 ceph-mon[25762]: from='mgr.25057 172.21.15.99:0/1165207787' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-03-30T13:51:34.329 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:51:34 smithi181 ceph-mon[25762]: from='mgr.25057 172.21.15.99:0/1165207787' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-03-30T13:51:34.329 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:51:34 smithi181 ceph-mon[25762]: from='mgr.25057 172.21.15.99:0/1165207787' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-03-30T13:51:34.329 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:51:34 smithi181 ceph-mon[25762]: from='mgr.25057 172.21.15.99:0/1165207787' entity='mgr.y' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-03-30T13:51:34.329 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:51:34 smithi181 ceph-mon[25762]: from='mgr.25057 172.21.15.99:0/1165207787' entity='mgr.y' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-03-30T13:51:34.329 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:51:34 smithi181 ceph-mon[25762]: from='mgr.25057 172.21.15.99:0/1165207787' entity='mgr.y' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-03-30T13:51:34.329 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:51:34 smithi181 ceph-mon[25762]: Manager daemon y is now available 2024-03-30T13:51:34.329 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:51:34 smithi181 ceph-mon[25762]: from='mgr.25057 ' entity='mgr.y' 2024-03-30T13:51:34.329 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:51:34 smithi181 ceph-mon[25762]: from='mgr.25057 172.21.15.99:0/1165207787' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.agent.smithi181", "caps": []}]: dispatch 2024-03-30T13:51:34.329 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:51:34 smithi181 ceph-mon[25762]: from='mgr.25057 ' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.agent.smithi181", "caps": []}]: dispatch 2024-03-30T13:51:34.329 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:51:34 smithi181 ceph-mon[25762]: from='mgr.25057 172.21.15.99:0/1165207787' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.agent.smithi099", "caps": []}]: dispatch 2024-03-30T13:51:34.329 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:51:34 smithi181 ceph-mon[25762]: from='mgr.25057 ' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.agent.smithi099", "caps": []}]: dispatch 2024-03-30T13:51:34.330 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:51:34 smithi181 ceph-mon[25762]: from='mgr.25057 172.21.15.99:0/1165207787' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T13:51:34.330 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:51:34 smithi181 ceph-mon[25762]: from='mgr.25057 172.21.15.99:0/1165207787' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-03-30T13:51:34.330 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:51:34 smithi181 ceph-mon[25762]: from='mgr.25057 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-03-30T13:51:34.330 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:51:34 smithi181 ceph-mon[25762]: from='mgr.25057 172.21.15.99:0/1165207787' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-03-30T13:51:34.330 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:51:34 smithi181 ceph-mon[25762]: from='mgr.25057 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-03-30T13:51:34.330 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:51:34 smithi181 ceph-mon[25762]: from='mgr.25057 ' entity='mgr.y' 2024-03-30T13:51:34.330 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:51:34 smithi181 ceph-mon[25762]: from='mgr.25057 172.21.15.99:0/1165207787' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd/host:smithi181", "name": "osd_memory_target"}]: dispatch 2024-03-30T13:51:34.330 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:51:34 smithi181 ceph-mon[25762]: from='mgr.25057 ' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd/host:smithi181", "name": "osd_memory_target"}]: dispatch 2024-03-30T13:51:34.330 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:51:34 smithi181 ceph-mon[25762]: from='mgr.25057 ' entity='mgr.y' 2024-03-30T13:51:34.335 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:51:34 smithi099 ceph-mon[24912]: from='mgr.25057 172.21.15.99:0/1165207787' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-03-30T13:51:34.335 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:51:34 smithi099 ceph-mon[24912]: from='mgr.25057 172.21.15.99:0/1165207787' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-03-30T13:51:34.336 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:51:34 smithi099 ceph-mon[24912]: from='mgr.25057 172.21.15.99:0/1165207787' entity='mgr.y' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-03-30T13:51:34.336 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:51:34 smithi099 ceph-mon[24912]: from='mgr.25057 172.21.15.99:0/1165207787' entity='mgr.y' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-03-30T13:51:34.336 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:51:34 smithi099 ceph-mon[24912]: from='mgr.25057 172.21.15.99:0/1165207787' entity='mgr.y' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-03-30T13:51:34.336 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:51:34 smithi099 ceph-mon[24912]: Manager daemon y is now available 2024-03-30T13:51:34.336 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:51:34 smithi099 ceph-mon[24912]: from='mgr.25057 ' entity='mgr.y' 2024-03-30T13:51:34.336 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:51:34 smithi099 ceph-mon[24912]: from='mgr.25057 172.21.15.99:0/1165207787' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.agent.smithi181", "caps": []}]: dispatch 2024-03-30T13:51:34.336 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:51:34 smithi099 ceph-mon[24912]: from='mgr.25057 ' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.agent.smithi181", "caps": []}]: dispatch 2024-03-30T13:51:34.336 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:51:34 smithi099 ceph-mon[24912]: from='mgr.25057 172.21.15.99:0/1165207787' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.agent.smithi099", "caps": []}]: dispatch 2024-03-30T13:51:34.336 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:51:34 smithi099 ceph-mon[24912]: from='mgr.25057 ' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.agent.smithi099", "caps": []}]: dispatch 2024-03-30T13:51:34.336 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:51:34 smithi099 ceph-mon[24912]: from='mgr.25057 172.21.15.99:0/1165207787' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T13:51:34.336 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:51:34 smithi099 ceph-mon[24912]: from='mgr.25057 172.21.15.99:0/1165207787' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-03-30T13:51:34.336 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:51:34 smithi099 ceph-mon[24912]: from='mgr.25057 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-03-30T13:51:34.336 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:51:34 smithi099 ceph-mon[24912]: from='mgr.25057 172.21.15.99:0/1165207787' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-03-30T13:51:34.336 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:51:34 smithi099 ceph-mon[24912]: from='mgr.25057 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-03-30T13:51:34.337 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:51:34 smithi099 ceph-mon[24912]: from='mgr.25057 ' entity='mgr.y' 2024-03-30T13:51:34.337 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:51:34 smithi099 ceph-mon[24912]: from='mgr.25057 172.21.15.99:0/1165207787' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd/host:smithi181", "name": "osd_memory_target"}]: dispatch 2024-03-30T13:51:34.337 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:51:34 smithi099 ceph-mon[24912]: from='mgr.25057 ' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd/host:smithi181", "name": "osd_memory_target"}]: dispatch 2024-03-30T13:51:34.337 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:51:34 smithi099 ceph-mon[24912]: from='mgr.25057 ' entity='mgr.y' 2024-03-30T13:51:34.337 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:51:34 smithi099 ceph-mon[29691]: from='mgr.25057 172.21.15.99:0/1165207787' entity='mgr.y' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-03-30T13:51:34.337 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:51:34 smithi099 ceph-mon[29691]: from='mgr.25057 172.21.15.99:0/1165207787' entity='mgr.y' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-03-30T13:51:34.337 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:51:34 smithi099 ceph-mon[29691]: Manager daemon y is now available 2024-03-30T13:51:34.337 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:51:34 smithi099 ceph-mon[29691]: from='mgr.25057 ' entity='mgr.y' 2024-03-30T13:51:34.337 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:51:34 smithi099 ceph-mon[29691]: from='mgr.25057 172.21.15.99:0/1165207787' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.agent.smithi181", "caps": []}]: dispatch 2024-03-30T13:51:34.337 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:51:34 smithi099 ceph-mon[29691]: from='mgr.25057 ' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.agent.smithi181", "caps": []}]: dispatch 2024-03-30T13:51:34.337 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:51:34 smithi099 ceph-mon[29691]: from='mgr.25057 172.21.15.99:0/1165207787' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.agent.smithi099", "caps": []}]: dispatch 2024-03-30T13:51:34.337 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:51:34 smithi099 ceph-mon[29691]: from='mgr.25057 ' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.agent.smithi099", "caps": []}]: dispatch 2024-03-30T13:51:34.338 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:51:34 smithi099 ceph-mon[29691]: from='mgr.25057 172.21.15.99:0/1165207787' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T13:51:34.338 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:51:34 smithi099 ceph-mon[29691]: from='mgr.25057 172.21.15.99:0/1165207787' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-03-30T13:51:34.338 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:51:34 smithi099 ceph-mon[29691]: from='mgr.25057 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-03-30T13:51:34.338 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:51:34 smithi099 ceph-mon[29691]: from='mgr.25057 172.21.15.99:0/1165207787' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-03-30T13:51:34.338 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:51:34 smithi099 ceph-mon[29691]: from='mgr.25057 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-03-30T13:51:34.338 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:51:34 smithi099 ceph-mon[29691]: from='mgr.25057 ' entity='mgr.y' 2024-03-30T13:51:34.338 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:51:34 smithi099 ceph-mon[29691]: from='mgr.25057 172.21.15.99:0/1165207787' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd/host:smithi181", "name": "osd_memory_target"}]: dispatch 2024-03-30T13:51:34.338 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:51:34 smithi099 ceph-mon[29691]: from='mgr.25057 ' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd/host:smithi181", "name": "osd_memory_target"}]: dispatch 2024-03-30T13:51:34.338 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:51:34 smithi099 ceph-mon[29691]: from='mgr.25057 ' entity='mgr.y' 2024-03-30T13:51:34.592 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 13:51:34 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-x[50211]: 2024-03-30T13:51:34.373+0000 7fecb43f0200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-03-30T13:51:34.592 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 13:51:34 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-x[50211]: 2024-03-30T13:51:34.481+0000 7fecb43f0200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-03-30T13:51:34.872 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 13:51:34 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-x[50211]: 2024-03-30T13:51:34.638+0000 7fecb43f0200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-03-30T13:51:34.872 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 13:51:34 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-x[50211]: 2024-03-30T13:51:34.742+0000 7fecb43f0200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-03-30T13:51:34.872 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 13:51:34 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-x[50211]: 2024-03-30T13:51:34.836+0000 7fecb43f0200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-03-30T13:51:35.124 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:51:35 smithi181 ceph-mon[25762]: [30/Mar/2024:13:51:33] ENGINE Bus STARTING 2024-03-30T13:51:35.124 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:51:35 smithi181 ceph-mon[25762]: [30/Mar/2024:13:51:33] ENGINE Serving on http://172.21.15.99:8765 2024-03-30T13:51:35.124 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:51:35 smithi181 ceph-mon[25762]: [30/Mar/2024:13:51:34] ENGINE Serving on https://172.21.15.99:7150 2024-03-30T13:51:35.124 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:51:35 smithi181 ceph-mon[25762]: [30/Mar/2024:13:51:34] ENGINE Bus STARTED 2024-03-30T13:51:35.124 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:51:35 smithi181 ceph-mon[25762]: mgrmap e28: y(active, since 1.39464s) 2024-03-30T13:51:35.124 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:51:35 smithi181 ceph-mon[25762]: from='mgr.25057 ' entity='mgr.y' 2024-03-30T13:51:35.124 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:51:35 smithi181 ceph-mon[25762]: from='mgr.25057 ' entity='mgr.y' 2024-03-30T13:51:35.125 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:51:35 smithi181 ceph-mon[25762]: from='mgr.25057 ' entity='mgr.y' 2024-03-30T13:51:35.125 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:51:35 smithi181 ceph-mon[25762]: from='mgr.25057 172.21.15.99:0/1165207787' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-03-30T13:51:35.125 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:51:35 smithi181 ceph-mon[25762]: from='mgr.25057 ' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-03-30T13:51:35.125 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:51:35 smithi181 ceph-mon[25762]: from='mgr.25057 172.21.15.99:0/1165207787' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-03-30T13:51:35.125 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:51:35 smithi181 ceph-mon[25762]: from='mgr.25057 ' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-03-30T13:51:35.125 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:51:35 smithi181 ceph-mon[25762]: from='mgr.25057 172.21.15.99:0/1165207787' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-03-30T13:51:35.125 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:51:35 smithi181 ceph-mon[25762]: from='mgr.25057 ' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-03-30T13:51:35.125 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:51:35 smithi181 ceph-mon[25762]: from='mgr.25057 172.21.15.99:0/1165207787' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-03-30T13:51:35.125 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:51:35 smithi181 ceph-mon[25762]: from='mgr.25057 ' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-03-30T13:51:35.125 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:51:35 smithi181 ceph-mon[25762]: from='mgr.25057 ' entity='mgr.y' 2024-03-30T13:51:35.125 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:51:35 smithi181 ceph-mon[25762]: from='mgr.25057 172.21.15.99:0/1165207787' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:51:35.125 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:51:35 smithi181 ceph-mon[25762]: from='mgr.25057 172.21.15.99:0/1165207787' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:51:35.125 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:51:35 smithi181 ceph-mon[25762]: from='mgr.25057 ' entity='mgr.y' 2024-03-30T13:51:35.126 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:51:35 smithi181 ceph-mon[25762]: from='mgr.25057 ' entity='mgr.y' 2024-03-30T13:51:35.126 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:51:35 smithi181 ceph-mon[25762]: from='mgr.25057 ' entity='mgr.y' 2024-03-30T13:51:35.126 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:51:35 smithi181 ceph-mon[25762]: from='mgr.25057 ' entity='mgr.y' 2024-03-30T13:51:35.283 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:51:35 smithi099 ceph-mon[24912]: [30/Mar/2024:13:51:33] ENGINE Bus STARTING 2024-03-30T13:51:35.283 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:51:35 smithi099 ceph-mon[24912]: [30/Mar/2024:13:51:33] ENGINE Serving on http://172.21.15.99:8765 2024-03-30T13:51:35.283 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:51:35 smithi099 ceph-mon[24912]: [30/Mar/2024:13:51:34] ENGINE Serving on https://172.21.15.99:7150 2024-03-30T13:51:35.283 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:51:35 smithi099 ceph-mon[24912]: [30/Mar/2024:13:51:34] ENGINE Bus STARTED 2024-03-30T13:51:35.283 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:51:35 smithi099 ceph-mon[24912]: mgrmap e28: y(active, since 1.39464s) 2024-03-30T13:51:35.283 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:51:35 smithi099 ceph-mon[24912]: from='mgr.25057 ' entity='mgr.y' 2024-03-30T13:51:35.283 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:51:35 smithi099 ceph-mon[24912]: from='mgr.25057 ' entity='mgr.y' 2024-03-30T13:51:35.283 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:51:35 smithi099 ceph-mon[24912]: from='mgr.25057 ' entity='mgr.y' 2024-03-30T13:51:35.283 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:51:35 smithi099 ceph-mon[24912]: from='mgr.25057 172.21.15.99:0/1165207787' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-03-30T13:51:35.284 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:51:35 smithi099 ceph-mon[24912]: from='mgr.25057 ' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-03-30T13:51:35.284 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:51:35 smithi099 ceph-mon[24912]: from='mgr.25057 172.21.15.99:0/1165207787' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-03-30T13:51:35.284 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:51:35 smithi099 ceph-mon[24912]: from='mgr.25057 ' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-03-30T13:51:35.284 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:51:35 smithi099 ceph-mon[24912]: from='mgr.25057 172.21.15.99:0/1165207787' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-03-30T13:51:35.284 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:51:35 smithi099 ceph-mon[24912]: from='mgr.25057 ' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-03-30T13:51:35.284 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:51:35 smithi099 ceph-mon[24912]: from='mgr.25057 172.21.15.99:0/1165207787' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-03-30T13:51:35.284 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:51:35 smithi099 ceph-mon[24912]: from='mgr.25057 ' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-03-30T13:51:35.284 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:51:35 smithi099 ceph-mon[24912]: from='mgr.25057 ' entity='mgr.y' 2024-03-30T13:51:35.284 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:51:35 smithi099 ceph-mon[24912]: from='mgr.25057 172.21.15.99:0/1165207787' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:51:35.284 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:51:35 smithi099 ceph-mon[24912]: from='mgr.25057 172.21.15.99:0/1165207787' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:51:35.284 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:51:35 smithi099 ceph-mon[24912]: from='mgr.25057 ' entity='mgr.y' 2024-03-30T13:51:35.284 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:51:35 smithi099 ceph-mon[24912]: from='mgr.25057 ' entity='mgr.y' 2024-03-30T13:51:35.284 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:51:35 smithi099 ceph-mon[24912]: from='mgr.25057 ' entity='mgr.y' 2024-03-30T13:51:35.285 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:51:35 smithi099 ceph-mon[24912]: from='mgr.25057 ' entity='mgr.y' 2024-03-30T13:51:35.285 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:51:35 smithi099 ceph-mon[29691]: [30/Mar/2024:13:51:33] ENGINE Bus STARTING 2024-03-30T13:51:35.285 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:51:35 smithi099 ceph-mon[29691]: [30/Mar/2024:13:51:33] ENGINE Serving on http://172.21.15.99:8765 2024-03-30T13:51:35.285 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:51:35 smithi099 ceph-mon[29691]: [30/Mar/2024:13:51:34] ENGINE Serving on https://172.21.15.99:7150 2024-03-30T13:51:35.285 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:51:35 smithi099 ceph-mon[29691]: [30/Mar/2024:13:51:34] ENGINE Bus STARTED 2024-03-30T13:51:35.285 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:51:35 smithi099 ceph-mon[29691]: mgrmap e28: y(active, since 1.39464s) 2024-03-30T13:51:35.285 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:51:35 smithi099 ceph-mon[29691]: from='mgr.25057 ' entity='mgr.y' 2024-03-30T13:51:35.285 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:51:35 smithi099 ceph-mon[29691]: from='mgr.25057 ' entity='mgr.y' 2024-03-30T13:51:35.285 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:51:35 smithi099 ceph-mon[29691]: from='mgr.25057 ' entity='mgr.y' 2024-03-30T13:51:35.285 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:51:35 smithi099 ceph-mon[29691]: from='mgr.25057 172.21.15.99:0/1165207787' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-03-30T13:51:35.285 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:51:35 smithi099 ceph-mon[29691]: from='mgr.25057 ' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-03-30T13:51:35.286 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:51:35 smithi099 ceph-mon[29691]: from='mgr.25057 172.21.15.99:0/1165207787' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-03-30T13:51:35.286 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:51:35 smithi099 ceph-mon[29691]: from='mgr.25057 ' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-03-30T13:51:35.286 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:51:35 smithi099 ceph-mon[29691]: from='mgr.25057 172.21.15.99:0/1165207787' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-03-30T13:51:35.286 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:51:35 smithi099 ceph-mon[29691]: from='mgr.25057 ' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-03-30T13:51:35.286 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:51:35 smithi099 ceph-mon[29691]: from='mgr.25057 172.21.15.99:0/1165207787' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-03-30T13:51:35.286 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:51:35 smithi099 ceph-mon[29691]: from='mgr.25057 ' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-03-30T13:51:35.286 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:51:35 smithi099 ceph-mon[29691]: from='mgr.25057 ' entity='mgr.y' 2024-03-30T13:51:35.286 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:51:35 smithi099 ceph-mon[29691]: from='mgr.25057 172.21.15.99:0/1165207787' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:51:35.286 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:51:35 smithi099 ceph-mon[29691]: from='mgr.25057 172.21.15.99:0/1165207787' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:51:35.286 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:51:35 smithi099 ceph-mon[29691]: from='mgr.25057 ' entity='mgr.y' 2024-03-30T13:51:35.286 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:51:35 smithi099 ceph-mon[29691]: from='mgr.25057 ' entity='mgr.y' 2024-03-30T13:51:35.287 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:51:35 smithi099 ceph-mon[29691]: from='mgr.25057 ' entity='mgr.y' 2024-03-30T13:51:35.287 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:51:35 smithi099 ceph-mon[29691]: from='mgr.25057 ' entity='mgr.y' 2024-03-30T13:51:35.440 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 13:51:35 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-x[50211]: 2024-03-30T13:51:35.123+0000 7fecb43f0200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-03-30T13:51:35.440 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 13:51:35 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-x[50211]: 2024-03-30T13:51:35.248+0000 7fecb43f0200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-03-30T13:51:35.440 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 13:51:35 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-x[50211]: 2024-03-30T13:51:35.340+0000 7fecb43f0200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-03-30T13:51:35.693 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 13:51:35 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-x[50211]: 2024-03-30T13:51:35.439+0000 7fecb43f0200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-03-30T13:51:35.693 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 13:51:35 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-x[50211]: 2024-03-30T13:51:35.621+0000 7fecb43f0200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-03-30T13:51:36.228 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:51:36 smithi181 ceph-mon[25762]: pgmap v3: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:51:36.228 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:51:36 smithi181 ceph-mon[25762]: Adjusting osd_memory_target on smithi099 to 2736M 2024-03-30T13:51:36.228 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:51:36 smithi181 ceph-mon[25762]: Updating smithi099:/etc/ceph/ceph.conf 2024-03-30T13:51:36.228 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:51:36 smithi181 ceph-mon[25762]: Updating smithi181:/etc/ceph/ceph.conf 2024-03-30T13:51:36.228 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:51:36 smithi181 ceph-mon[25762]: Updating smithi099:/var/lib/ceph/98ebaeb8-ee99-11ee-b647-cb9ed24678a4/config/ceph.conf 2024-03-30T13:51:36.229 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:51:36 smithi181 ceph-mon[25762]: Updating smithi181:/var/lib/ceph/98ebaeb8-ee99-11ee-b647-cb9ed24678a4/config/ceph.conf 2024-03-30T13:51:36.229 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:51:36 smithi181 ceph-mon[25762]: Updating smithi099:/etc/ceph/ceph.client.admin.keyring 2024-03-30T13:51:36.229 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:51:36 smithi181 ceph-mon[25762]: Updating smithi181:/etc/ceph/ceph.client.admin.keyring 2024-03-30T13:51:36.229 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:51:36 smithi181 ceph-mon[25762]: pgmap v4: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:51:36.229 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:51:36 smithi181 ceph-mon[25762]: Updating smithi099:/var/lib/ceph/98ebaeb8-ee99-11ee-b647-cb9ed24678a4/config/ceph.client.admin.keyring 2024-03-30T13:51:36.229 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:51:36 smithi181 ceph-mon[25762]: Health check cleared: CEPHADM_FAILED_DAEMON (was: 1 failed cephadm daemon(s)) 2024-03-30T13:51:36.229 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:51:36 smithi181 ceph-mon[25762]: Cluster is now healthy 2024-03-30T13:51:36.229 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:51:36 smithi181 ceph-mon[25762]: mgrmap e29: y(active, since 2s) 2024-03-30T13:51:36.229 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:51:36 smithi181 ceph-mon[25762]: Updating smithi181:/var/lib/ceph/98ebaeb8-ee99-11ee-b647-cb9ed24678a4/config/ceph.client.admin.keyring 2024-03-30T13:51:36.229 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:51:36 smithi181 ceph-mon[25762]: from='mgr.25057 ' entity='mgr.y' 2024-03-30T13:51:36.229 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:51:36 smithi181 ceph-mon[25762]: from='mgr.25057 ' entity='mgr.y' 2024-03-30T13:51:36.229 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:51:36 smithi181 ceph-mon[25762]: from='mgr.25057 ' entity='mgr.y' 2024-03-30T13:51:36.229 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:51:36 smithi181 ceph-mon[25762]: from='mgr.25057 ' entity='mgr.y' 2024-03-30T13:51:36.229 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:51:36 smithi181 ceph-mon[25762]: pgmap v5: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:51:36.229 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:51:36 smithi181 ceph-mon[25762]: from='mgr.25057 ' entity='mgr.y' 2024-03-30T13:51:36.230 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:51:36 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:51:36.230 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:51:36 smithi181 ceph-mon[25762]: from='mgr.25057 ' entity='mgr.y' 2024-03-30T13:51:36.230 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:51:36 smithi181 ceph-mon[25762]: Reconfiguring iscsi.foo.smithi099.qyjuvr (dependencies changed)... 2024-03-30T13:51:36.230 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:51:36 smithi181 ceph-mon[25762]: from='mgr.25057 172.21.15.99:0/1165207787' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.iscsi.foo.smithi099.qyjuvr", "caps": ["mon", "profile rbd, allow command \"osd blocklist\", allow command \"config-key get\" with \"key\" prefix \"iscsi/\"", "mgr", "allow command \"service status\"", "osd", "allow rwx"]}]: dispatch 2024-03-30T13:51:36.230 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:51:36 smithi181 ceph-mon[25762]: from='mgr.25057 ' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.iscsi.foo.smithi099.qyjuvr", "caps": ["mon", "profile rbd, allow command \"osd blocklist\", allow command \"config-key get\" with \"key\" prefix \"iscsi/\"", "mgr", "allow command \"service status\"", "osd", "allow rwx"]}]: dispatch 2024-03-30T13:51:36.230 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:51:36 smithi181 ceph-mon[25762]: from='mgr.25057 172.21.15.99:0/1165207787' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:51:36.230 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:51:36 smithi181 ceph-mon[25762]: Reconfiguring daemon iscsi.foo.smithi099.qyjuvr on smithi099 2024-03-30T13:51:36.230 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:51:36 smithi181 ceph-mon[25762]: from='mgr.25057 ' entity='mgr.y' 2024-03-30T13:51:36.283 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:51:36 smithi099 ceph-mon[24912]: pgmap v3: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:51:36.284 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:51:36 smithi099 ceph-mon[24912]: Adjusting osd_memory_target on smithi099 to 2736M 2024-03-30T13:51:36.284 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:51:36 smithi099 ceph-mon[24912]: Updating smithi099:/etc/ceph/ceph.conf 2024-03-30T13:51:36.284 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:51:36 smithi099 ceph-mon[24912]: Updating smithi181:/etc/ceph/ceph.conf 2024-03-30T13:51:36.284 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:51:36 smithi099 ceph-mon[24912]: Updating smithi099:/var/lib/ceph/98ebaeb8-ee99-11ee-b647-cb9ed24678a4/config/ceph.conf 2024-03-30T13:51:36.284 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:51:36 smithi099 ceph-mon[24912]: Updating smithi181:/var/lib/ceph/98ebaeb8-ee99-11ee-b647-cb9ed24678a4/config/ceph.conf 2024-03-30T13:51:36.284 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:51:36 smithi099 ceph-mon[24912]: Updating smithi099:/etc/ceph/ceph.client.admin.keyring 2024-03-30T13:51:36.284 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:51:36 smithi099 ceph-mon[24912]: Updating smithi181:/etc/ceph/ceph.client.admin.keyring 2024-03-30T13:51:36.284 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:51:36 smithi099 ceph-mon[24912]: pgmap v4: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:51:36.284 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:51:36 smithi099 ceph-mon[24912]: Updating smithi099:/var/lib/ceph/98ebaeb8-ee99-11ee-b647-cb9ed24678a4/config/ceph.client.admin.keyring 2024-03-30T13:51:36.284 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:51:36 smithi099 ceph-mon[24912]: Health check cleared: CEPHADM_FAILED_DAEMON (was: 1 failed cephadm daemon(s)) 2024-03-30T13:51:36.284 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:51:36 smithi099 ceph-mon[24912]: Cluster is now healthy 2024-03-30T13:51:36.284 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:51:36 smithi099 ceph-mon[24912]: mgrmap e29: y(active, since 2s) 2024-03-30T13:51:36.284 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:51:36 smithi099 ceph-mon[24912]: Updating smithi181:/var/lib/ceph/98ebaeb8-ee99-11ee-b647-cb9ed24678a4/config/ceph.client.admin.keyring 2024-03-30T13:51:36.285 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:51:36 smithi099 ceph-mon[24912]: from='mgr.25057 ' entity='mgr.y' 2024-03-30T13:51:36.285 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:51:36 smithi099 ceph-mon[24912]: from='mgr.25057 ' entity='mgr.y' 2024-03-30T13:51:36.285 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:51:36 smithi099 ceph-mon[24912]: from='mgr.25057 ' entity='mgr.y' 2024-03-30T13:51:36.285 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:51:36 smithi099 ceph-mon[24912]: from='mgr.25057 ' entity='mgr.y' 2024-03-30T13:51:36.285 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:51:36 smithi099 ceph-mon[24912]: pgmap v5: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:51:36.285 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:51:36 smithi099 ceph-mon[24912]: from='mgr.25057 ' entity='mgr.y' 2024-03-30T13:51:36.285 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:51:36 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:51:36.285 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:51:36 smithi099 ceph-mon[24912]: from='mgr.25057 ' entity='mgr.y' 2024-03-30T13:51:36.285 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:51:36 smithi099 ceph-mon[24912]: Reconfiguring iscsi.foo.smithi099.qyjuvr (dependencies changed)... 2024-03-30T13:51:36.285 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:51:36 smithi099 ceph-mon[24912]: from='mgr.25057 172.21.15.99:0/1165207787' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.iscsi.foo.smithi099.qyjuvr", "caps": ["mon", "profile rbd, allow command \"osd blocklist\", allow command \"config-key get\" with \"key\" prefix \"iscsi/\"", "mgr", "allow command \"service status\"", "osd", "allow rwx"]}]: dispatch 2024-03-30T13:51:36.285 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:51:36 smithi099 ceph-mon[24912]: from='mgr.25057 ' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.iscsi.foo.smithi099.qyjuvr", "caps": ["mon", "profile rbd, allow command \"osd blocklist\", allow command \"config-key get\" with \"key\" prefix \"iscsi/\"", "mgr", "allow command \"service status\"", "osd", "allow rwx"]}]: dispatch 2024-03-30T13:51:36.285 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:51:36 smithi099 ceph-mon[24912]: from='mgr.25057 172.21.15.99:0/1165207787' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:51:36.285 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:51:36 smithi099 ceph-mon[24912]: Reconfiguring daemon iscsi.foo.smithi099.qyjuvr on smithi099 2024-03-30T13:51:36.285 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:51:36 smithi099 ceph-mon[24912]: from='mgr.25057 ' entity='mgr.y' 2024-03-30T13:51:36.286 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:51:36 smithi099 ceph-mon[29691]: pgmap v3: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:51:36.286 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:51:36 smithi099 ceph-mon[29691]: Adjusting osd_memory_target on smithi099 to 2736M 2024-03-30T13:51:36.286 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:51:36 smithi099 ceph-mon[29691]: Updating smithi099:/etc/ceph/ceph.conf 2024-03-30T13:51:36.286 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:51:36 smithi099 ceph-mon[29691]: Updating smithi181:/etc/ceph/ceph.conf 2024-03-30T13:51:36.286 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:51:36 smithi099 ceph-mon[29691]: Updating smithi099:/var/lib/ceph/98ebaeb8-ee99-11ee-b647-cb9ed24678a4/config/ceph.conf 2024-03-30T13:51:36.286 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:51:36 smithi099 ceph-mon[29691]: Updating smithi181:/var/lib/ceph/98ebaeb8-ee99-11ee-b647-cb9ed24678a4/config/ceph.conf 2024-03-30T13:51:36.286 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:51:36 smithi099 ceph-mon[29691]: Updating smithi099:/etc/ceph/ceph.client.admin.keyring 2024-03-30T13:51:36.286 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:51:36 smithi099 ceph-mon[29691]: Updating smithi181:/etc/ceph/ceph.client.admin.keyring 2024-03-30T13:51:36.286 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:51:36 smithi099 ceph-mon[29691]: pgmap v4: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:51:36.286 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:51:36 smithi099 ceph-mon[29691]: Updating smithi099:/var/lib/ceph/98ebaeb8-ee99-11ee-b647-cb9ed24678a4/config/ceph.client.admin.keyring 2024-03-30T13:51:36.286 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:51:36 smithi099 ceph-mon[29691]: Health check cleared: CEPHADM_FAILED_DAEMON (was: 1 failed cephadm daemon(s)) 2024-03-30T13:51:36.287 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:51:36 smithi099 ceph-mon[29691]: Cluster is now healthy 2024-03-30T13:51:36.287 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:51:36 smithi099 ceph-mon[29691]: mgrmap e29: y(active, since 2s) 2024-03-30T13:51:36.287 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:51:36 smithi099 ceph-mon[29691]: Updating smithi181:/var/lib/ceph/98ebaeb8-ee99-11ee-b647-cb9ed24678a4/config/ceph.client.admin.keyring 2024-03-30T13:51:36.287 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:51:36 smithi099 ceph-mon[29691]: from='mgr.25057 ' entity='mgr.y' 2024-03-30T13:51:36.287 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:51:36 smithi099 ceph-mon[29691]: from='mgr.25057 ' entity='mgr.y' 2024-03-30T13:51:36.287 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:51:36 smithi099 ceph-mon[29691]: from='mgr.25057 ' entity='mgr.y' 2024-03-30T13:51:36.287 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:51:36 smithi099 ceph-mon[29691]: from='mgr.25057 ' entity='mgr.y' 2024-03-30T13:51:36.287 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:51:36 smithi099 ceph-mon[29691]: pgmap v5: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:51:36.287 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:51:36 smithi099 ceph-mon[29691]: from='mgr.25057 ' entity='mgr.y' 2024-03-30T13:51:36.287 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:51:36 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:51:36.287 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:51:36 smithi099 ceph-mon[29691]: from='mgr.25057 ' entity='mgr.y' 2024-03-30T13:51:36.287 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:51:36 smithi099 ceph-mon[29691]: Reconfiguring iscsi.foo.smithi099.qyjuvr (dependencies changed)... 2024-03-30T13:51:36.287 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:51:36 smithi099 ceph-mon[29691]: from='mgr.25057 172.21.15.99:0/1165207787' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.iscsi.foo.smithi099.qyjuvr", "caps": ["mon", "profile rbd, allow command \"osd blocklist\", allow command \"config-key get\" with \"key\" prefix \"iscsi/\"", "mgr", "allow command \"service status\"", "osd", "allow rwx"]}]: dispatch 2024-03-30T13:51:36.287 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:51:36 smithi099 ceph-mon[29691]: from='mgr.25057 ' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.iscsi.foo.smithi099.qyjuvr", "caps": ["mon", "profile rbd, allow command \"osd blocklist\", allow command \"config-key get\" with \"key\" prefix \"iscsi/\"", "mgr", "allow command \"service status\"", "osd", "allow rwx"]}]: dispatch 2024-03-30T13:51:36.288 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:51:36 smithi099 ceph-mon[29691]: from='mgr.25057 172.21.15.99:0/1165207787' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:51:36.288 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:51:36 smithi099 ceph-mon[29691]: Reconfiguring daemon iscsi.foo.smithi099.qyjuvr on smithi099 2024-03-30T13:51:36.288 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:51:36 smithi099 ceph-mon[29691]: from='mgr.25057 ' entity='mgr.y' 2024-03-30T13:51:36.827 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 13:51:36 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-x[50211]: 2024-03-30T13:51:36.681+0000 7fecb43f0200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-03-30T13:51:36.827 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 13:51:36 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-x[50211]: 2024-03-30T13:51:36.826+0000 7fecb43f0200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-03-30T13:51:37.315 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:51:37 smithi099 ceph-mon[29691]: from='mgr.25057 ' entity='mgr.y' 2024-03-30T13:51:37.315 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:51:37 smithi099 ceph-mon[29691]: from='mgr.25057 ' entity='mgr.y' 2024-03-30T13:51:37.315 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:51:37 smithi099 ceph-mon[29691]: pgmap v6: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:51:37.316 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:51:37 smithi099 ceph-mon[29691]: pgmap v7: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:51:37.316 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:51:37 smithi099 ceph-mon[29691]: from='mgr.25057 ' entity='mgr.y' 2024-03-30T13:51:37.316 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:51:37 smithi099 ceph-mon[29691]: Health check failed: 1 failed cephadm daemon(s) (CEPHADM_FAILED_DAEMON) 2024-03-30T13:51:37.316 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:51:37 smithi099 ceph-mon[29691]: from='mgr.25057 ' entity='mgr.y' 2024-03-30T13:51:37.316 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:51:37 smithi099 ceph-mon[29691]: from='mgr.25057 ' entity='mgr.y' 2024-03-30T13:51:37.316 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:51:37 smithi099 ceph-mon[29691]: pgmap v8: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:51:37.316 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:51:37 smithi099 ceph-mon[29691]: pgmap v9: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:51:37.316 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:51:37 smithi099 ceph-mon[29691]: from='mgr.25057 ' entity='mgr.y' 2024-03-30T13:51:37.316 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:51:37 smithi099 ceph-mon[29691]: mgrmap e30: y(active, since 4s) 2024-03-30T13:51:37.316 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:51:37 smithi099 ceph-mon[24912]: from='mgr.25057 ' entity='mgr.y' 2024-03-30T13:51:37.316 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:51:37 smithi099 ceph-mon[24912]: from='mgr.25057 ' entity='mgr.y' 2024-03-30T13:51:37.316 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:51:37 smithi099 ceph-mon[24912]: pgmap v6: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:51:37.316 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:51:37 smithi099 ceph-mon[24912]: pgmap v7: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:51:37.317 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:51:37 smithi099 ceph-mon[24912]: from='mgr.25057 ' entity='mgr.y' 2024-03-30T13:51:37.317 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:51:37 smithi099 ceph-mon[24912]: Health check failed: 1 failed cephadm daemon(s) (CEPHADM_FAILED_DAEMON) 2024-03-30T13:51:37.317 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:51:37 smithi099 ceph-mon[24912]: from='mgr.25057 ' entity='mgr.y' 2024-03-30T13:51:37.317 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:51:37 smithi099 ceph-mon[24912]: from='mgr.25057 ' entity='mgr.y' 2024-03-30T13:51:37.317 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:51:37 smithi099 ceph-mon[24912]: pgmap v8: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:51:37.317 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:51:37 smithi099 ceph-mon[24912]: pgmap v9: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:51:37.317 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:51:37 smithi099 ceph-mon[24912]: from='mgr.25057 ' entity='mgr.y' 2024-03-30T13:51:37.317 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:51:37 smithi099 ceph-mon[24912]: mgrmap e30: y(active, since 4s) 2024-03-30T13:51:37.437 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 13:51:37 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-x[50211]: 2024-03-30T13:51:37.183+0000 7fecb43f0200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-03-30T13:51:37.437 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 13:51:37 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-x[50211]: 2024-03-30T13:51:37.275+0000 7fecb43f0200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-03-30T13:51:37.437 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:51:37 smithi181 ceph-mon[25762]: from='mgr.25057 ' entity='mgr.y' 2024-03-30T13:51:37.437 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:51:37 smithi181 ceph-mon[25762]: from='mgr.25057 ' entity='mgr.y' 2024-03-30T13:51:37.438 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:51:37 smithi181 ceph-mon[25762]: pgmap v6: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:51:37.438 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:51:37 smithi181 ceph-mon[25762]: pgmap v7: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:51:37.438 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:51:37 smithi181 ceph-mon[25762]: from='mgr.25057 ' entity='mgr.y' 2024-03-30T13:51:37.438 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:51:37 smithi181 ceph-mon[25762]: Health check failed: 1 failed cephadm daemon(s) (CEPHADM_FAILED_DAEMON) 2024-03-30T13:51:37.438 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:51:37 smithi181 ceph-mon[25762]: from='mgr.25057 ' entity='mgr.y' 2024-03-30T13:51:37.438 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:51:37 smithi181 ceph-mon[25762]: from='mgr.25057 ' entity='mgr.y' 2024-03-30T13:51:37.438 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:51:37 smithi181 ceph-mon[25762]: pgmap v8: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:51:37.438 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:51:37 smithi181 ceph-mon[25762]: pgmap v9: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:51:37.438 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:51:37 smithi181 ceph-mon[25762]: from='mgr.25057 ' entity='mgr.y' 2024-03-30T13:51:37.438 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:51:37 smithi181 ceph-mon[25762]: mgrmap e30: y(active, since 4s) 2024-03-30T13:51:37.695 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 13:51:37 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-x[50211]: 2024-03-30T13:51:37.498+0000 7fecb43f0200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-03-30T13:51:38.003 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 13:51:37 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-x[50211]: 2024-03-30T13:51:37.695+0000 7fecb43f0200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-03-30T13:51:38.003 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 13:51:38 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-x[50211]: 2024-03-30T13:51:38.002+0000 7fecb43f0200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-03-30T13:51:38.569 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 13:51:38 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-x[50211]: 2024-03-30T13:51:38.272+0000 7fecb43f0200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-03-30T13:51:38.569 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 13:51:38 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-x[50211]: 2024-03-30T13:51:38.516+0000 7fecb43f0200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-03-30T13:51:38.702 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:51:38 smithi099 ceph-mon[24912]: from='mgr.25057 ' entity='mgr.y' 2024-03-30T13:51:38.702 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:51:38 smithi099 ceph-mon[24912]: from='mgr.25057 ' entity='mgr.y' 2024-03-30T13:51:38.702 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:51:38 smithi099 ceph-mon[24912]: pgmap v10: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:51:38.702 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:51:38 smithi099 ceph-mon[24912]: pgmap v11: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:51:38.702 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:51:38 smithi099 ceph-mon[24912]: from='mgr.25057 ' entity='mgr.y' 2024-03-30T13:51:38.702 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:51:38 smithi099 ceph-mon[24912]: from='client.24806 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T13:51:38.702 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:51:38 smithi099 ceph-mon[24912]: from='mgr.25057 ' entity='mgr.y' 2024-03-30T13:51:38.702 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:51:38 smithi099 ceph-mon[24912]: from='mgr.25057 ' entity='mgr.y' 2024-03-30T13:51:38.703 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:51:38 smithi099 ceph-mon[24912]: from='mgr.25057 ' entity='mgr.y' 2024-03-30T13:51:38.703 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:51:38 smithi099 ceph-mon[29691]: from='mgr.25057 ' entity='mgr.y' 2024-03-30T13:51:38.703 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:51:38 smithi099 ceph-mon[29691]: from='mgr.25057 ' entity='mgr.y' 2024-03-30T13:51:38.703 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:51:38 smithi099 ceph-mon[29691]: pgmap v10: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:51:38.703 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:51:38 smithi099 ceph-mon[29691]: pgmap v11: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:51:38.703 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:51:38 smithi099 ceph-mon[29691]: from='mgr.25057 ' entity='mgr.y' 2024-03-30T13:51:38.703 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:51:38 smithi099 ceph-mon[29691]: from='client.24806 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T13:51:38.703 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:51:38 smithi099 ceph-mon[29691]: from='mgr.25057 ' entity='mgr.y' 2024-03-30T13:51:38.703 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:51:38 smithi099 ceph-mon[29691]: from='mgr.25057 ' entity='mgr.y' 2024-03-30T13:51:38.703 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:51:38 smithi099 ceph-mon[29691]: from='mgr.25057 ' entity='mgr.y' 2024-03-30T13:51:38.874 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:51:38 smithi181 ceph-mon[25762]: from='mgr.25057 ' entity='mgr.y' 2024-03-30T13:51:38.874 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:51:38 smithi181 ceph-mon[25762]: from='mgr.25057 ' entity='mgr.y' 2024-03-30T13:51:38.874 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:51:38 smithi181 ceph-mon[25762]: pgmap v10: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:51:38.874 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:51:38 smithi181 ceph-mon[25762]: pgmap v11: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:51:38.874 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:51:38 smithi181 ceph-mon[25762]: from='mgr.25057 ' entity='mgr.y' 2024-03-30T13:51:38.875 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:51:38 smithi181 ceph-mon[25762]: from='client.24806 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T13:51:38.875 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:51:38 smithi181 ceph-mon[25762]: from='mgr.25057 ' entity='mgr.y' 2024-03-30T13:51:38.875 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:51:38 smithi181 ceph-mon[25762]: from='mgr.25057 ' entity='mgr.y' 2024-03-30T13:51:38.875 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:51:38 smithi181 ceph-mon[25762]: from='mgr.25057 ' entity='mgr.y' 2024-03-30T13:51:39.504 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 13:51:39 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-x[50211]: 2024-03-30T13:51:39.369+0000 7fecb43f0200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-03-30T13:51:39.835 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:51:39 smithi099 ceph-mon[24912]: pgmap v12: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:51:39.836 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:51:39 smithi099 ceph-mon[24912]: pgmap v13: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:51:39.836 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:51:39 smithi099 ceph-mon[29691]: pgmap v12: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:51:39.836 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:51:39 smithi099 ceph-mon[29691]: pgmap v13: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:51:40.004 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:51:39 smithi181 ceph-mon[25762]: pgmap v12: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:51:40.005 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:51:39 smithi181 ceph-mon[25762]: pgmap v13: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:51:40.005 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 13:51:39 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-x[50211]: 2024-03-30T13:51:39.977+0000 7fecb43f0200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-03-30T13:51:40.353 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 13:51:40 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-x[50211]: 2024-03-30T13:51:40.083+0000 7fecb43f0200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-03-30T13:51:40.353 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 13:51:40 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-x[50211]: 2024-03-30T13:51:40.310+0000 7fecb43f0200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-03-30T13:51:40.353 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 13:51:40 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-x[50211]: [30/Mar/2024:13:51:40] ENGINE Bus STARTING 2024-03-30T13:51:40.752 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 13:51:40 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-x[50211]: CherryPy Checker: 2024-03-30T13:51:40.752 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 13:51:40 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-x[50211]: The Application mounted at '' has an empty config. 2024-03-30T13:51:40.752 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 13:51:40 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-x[50211]: 2024-03-30T13:51:40.752 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 13:51:40 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-x[50211]: [30/Mar/2024:13:51:40] ENGINE Serving on http://:::9283 2024-03-30T13:51:40.752 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 13:51:40 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-x[50211]: [30/Mar/2024:13:51:40] ENGINE Bus STARTED 2024-03-30T13:51:40.836 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:51:40 smithi099 ceph-mon[24912]: Standby manager daemon x started 2024-03-30T13:51:40.836 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:51:40 smithi099 ceph-mon[24912]: from='mgr.? 172.21.15.181:0/1979512792' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/crt"}]: dispatch 2024-03-30T13:51:40.836 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:51:40 smithi099 ceph-mon[24912]: from='mgr.? 172.21.15.181:0/1979512792' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-03-30T13:51:40.836 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:51:40 smithi099 ceph-mon[24912]: from='mgr.? 172.21.15.181:0/1979512792' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/key"}]: dispatch 2024-03-30T13:51:40.836 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:51:40 smithi099 ceph-mon[24912]: from='mgr.? 172.21.15.181:0/1979512792' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-03-30T13:51:40.836 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:51:40 smithi099 ceph-mon[24912]: from='mgr.25057 ' entity='mgr.y' 2024-03-30T13:51:40.836 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:51:40 smithi099 ceph-mon[24912]: from='mgr.25057 ' entity='mgr.y' 2024-03-30T13:51:40.836 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:51:40 smithi099 ceph-mon[24912]: from='mgr.25057 ' entity='mgr.y' 2024-03-30T13:51:40.836 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:51:40 smithi099 ceph-mon[29691]: Standby manager daemon x started 2024-03-30T13:51:40.837 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:51:40 smithi099 ceph-mon[29691]: from='mgr.? 172.21.15.181:0/1979512792' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/crt"}]: dispatch 2024-03-30T13:51:40.837 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:51:40 smithi099 ceph-mon[29691]: from='mgr.? 172.21.15.181:0/1979512792' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-03-30T13:51:40.837 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:51:40 smithi099 ceph-mon[29691]: from='mgr.? 172.21.15.181:0/1979512792' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/key"}]: dispatch 2024-03-30T13:51:40.837 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:51:40 smithi099 ceph-mon[29691]: from='mgr.? 172.21.15.181:0/1979512792' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-03-30T13:51:40.837 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:51:40 smithi099 ceph-mon[29691]: from='mgr.25057 ' entity='mgr.y' 2024-03-30T13:51:40.837 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:51:40 smithi099 ceph-mon[29691]: from='mgr.25057 ' entity='mgr.y' 2024-03-30T13:51:40.837 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:51:40 smithi099 ceph-mon[29691]: from='mgr.25057 ' entity='mgr.y' 2024-03-30T13:51:41.004 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:51:40 smithi181 ceph-mon[25762]: Standby manager daemon x started 2024-03-30T13:51:41.005 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:51:40 smithi181 ceph-mon[25762]: from='mgr.? 172.21.15.181:0/1979512792' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/crt"}]: dispatch 2024-03-30T13:51:41.005 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:51:40 smithi181 ceph-mon[25762]: from='mgr.? 172.21.15.181:0/1979512792' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-03-30T13:51:41.005 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:51:40 smithi181 ceph-mon[25762]: from='mgr.? 172.21.15.181:0/1979512792' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/key"}]: dispatch 2024-03-30T13:51:41.005 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:51:40 smithi181 ceph-mon[25762]: from='mgr.? 172.21.15.181:0/1979512792' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-03-30T13:51:41.005 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:51:40 smithi181 ceph-mon[25762]: from='mgr.25057 ' entity='mgr.y' 2024-03-30T13:51:41.005 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:51:40 smithi181 ceph-mon[25762]: from='mgr.25057 ' entity='mgr.y' 2024-03-30T13:51:41.005 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:51:40 smithi181 ceph-mon[25762]: from='mgr.25057 ' entity='mgr.y' 2024-03-30T13:51:41.835 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:51:41 smithi099 ceph-mon[24912]: pgmap v14: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 59 KiB/s rd, 0 B/s wr, 33 op/s 2024-03-30T13:51:41.836 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:51:41 smithi099 ceph-mon[24912]: pgmap v15: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 53 KiB/s rd, 0 B/s wr, 30 op/s 2024-03-30T13:51:41.836 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:51:41 smithi099 ceph-mon[24912]: pgmap v16: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 73 KiB/s rd, 0 B/s wr, 41 op/s 2024-03-30T13:51:41.836 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:51:41 smithi099 ceph-mon[24912]: mgrmap e31: y(active, since 8s), standbys: x 2024-03-30T13:51:41.836 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:51:41 smithi099 ceph-mon[24912]: from='mgr.25057 172.21.15.99:0/1165207787' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-03-30T13:51:41.836 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:51:41 smithi099 ceph-mon[29691]: pgmap v14: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 59 KiB/s rd, 0 B/s wr, 33 op/s 2024-03-30T13:51:41.836 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:51:41 smithi099 ceph-mon[29691]: pgmap v15: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 53 KiB/s rd, 0 B/s wr, 30 op/s 2024-03-30T13:51:41.836 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:51:41 smithi099 ceph-mon[29691]: pgmap v16: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 73 KiB/s rd, 0 B/s wr, 41 op/s 2024-03-30T13:51:41.836 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:51:41 smithi099 ceph-mon[29691]: mgrmap e31: y(active, since 8s), standbys: x 2024-03-30T13:51:41.836 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:51:41 smithi099 ceph-mon[29691]: from='mgr.25057 172.21.15.99:0/1165207787' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-03-30T13:51:42.205 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:51:42 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[71049]: 2024-03-30T13:51:42.067+0000 7fd47a046700 -1 log_channel(cephadm) log [ERR] : cephadm exited with an error code: 1, stderr: Reconfig daemon iscsi.foo.smithi099.qyjuvr ... 2024-03-30T13:51:42.206 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:51:42 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[71049]: Creating ceph-iscsi config... 2024-03-30T13:51:42.206 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:51:42 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[71049]: Write file: /var/lib/ceph/98ebaeb8-ee99-11ee-b647-cb9ed24678a4/iscsi.foo.smithi099.qyjuvr/iscsi-gateway.cfg 2024-03-30T13:51:42.206 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:51:42 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[71049]: Write file: /var/lib/ceph/98ebaeb8-ee99-11ee-b647-cb9ed24678a4/iscsi.foo.smithi099.qyjuvr/tcmu-runner-entrypoint.sh 2024-03-30T13:51:42.206 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:51:42 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[71049]: Non-zero exit code 1 from systemctl restart ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4@iscsi.foo.smithi099.qyjuvr 2024-03-30T13:51:42.206 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:51:42 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[71049]: systemctl: stderr Job for ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4@iscsi.foo.smithi099.qyjuvr.service failed because the control process exited with error code. 2024-03-30T13:51:42.206 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:51:42 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[71049]: systemctl: stderr See "systemctl status ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4@iscsi.foo.smithi099.qyjuvr.service" and "journalctl -xeu ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4@iscsi.foo.smithi099.qyjuvr.service" for details. 2024-03-30T13:51:42.206 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:51:42 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[71049]: Traceback (most recent call last): 2024-03-30T13:51:42.206 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:51:42 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[71049]: File "/usr/lib64/python3.9/runpy.py", line 197, in _run_module_as_main 2024-03-30T13:51:42.206 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:51:42 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[71049]: return _run_code(code, main_globals, None, 2024-03-30T13:51:42.206 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:51:42 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[71049]: File "/usr/lib64/python3.9/runpy.py", line 87, in _run_code 2024-03-30T13:51:42.206 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:51:42 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[71049]: exec(code, run_globals) 2024-03-30T13:51:42.206 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:51:42 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[71049]: File "/var/lib/ceph/98ebaeb8-ee99-11ee-b647-cb9ed24678a4/cephadm.a8f553f8c0a1bbbd91f4e60c8e13381b6fabffa3561f875fe77bb96af479b3ca/__main__.py", line 5528, in 2024-03-30T13:51:42.207 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:51:42 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[71049]: File "/var/lib/ceph/98ebaeb8-ee99-11ee-b647-cb9ed24678a4/cephadm.a8f553f8c0a1bbbd91f4e60c8e13381b6fabffa3561f875fe77bb96af479b3ca/__main__.py", line 5516, in main 2024-03-30T13:51:42.207 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:51:42 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[71049]: File "/var/lib/ceph/98ebaeb8-ee99-11ee-b647-cb9ed24678a4/cephadm.a8f553f8c0a1bbbd91f4e60c8e13381b6fabffa3561f875fe77bb96af479b3ca/__main__.py", line 3040, in command_deploy_from 2024-03-30T13:51:42.207 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:51:42 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[71049]: File "/var/lib/ceph/98ebaeb8-ee99-11ee-b647-cb9ed24678a4/cephadm.a8f553f8c0a1bbbd91f4e60c8e13381b6fabffa3561f875fe77bb96af479b3ca/__main__.py", line 3075, in _common_deploy 2024-03-30T13:51:42.207 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:51:42 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[71049]: File "/var/lib/ceph/98ebaeb8-ee99-11ee-b647-cb9ed24678a4/cephadm.a8f553f8c0a1bbbd91f4e60c8e13381b6fabffa3561f875fe77bb96af479b3ca/__main__.py", line 3095, in _deploy_daemon_container 2024-03-30T13:51:42.207 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:51:42 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[71049]: File "/var/lib/ceph/98ebaeb8-ee99-11ee-b647-cb9ed24678a4/cephadm.a8f553f8c0a1bbbd91f4e60c8e13381b6fabffa3561f875fe77bb96af479b3ca/__main__.py", line 1067, in deploy_daemon 2024-03-30T13:51:42.207 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:51:42 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[71049]: File "/var/lib/ceph/98ebaeb8-ee99-11ee-b647-cb9ed24678a4/cephadm.a8f553f8c0a1bbbd91f4e60c8e13381b6fabffa3561f875fe77bb96af479b3ca/cephadmlib/call_wrappers.py", line 307, in call_throws 2024-03-30T13:51:42.207 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:51:42 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[71049]: RuntimeError: Failed command: systemctl restart ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4@iscsi.foo.smithi099.qyjuvr: Job for ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4@iscsi.foo.smithi099.qyjuvr.service failed because the control process exited with error code. 2024-03-30T13:51:42.207 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:51:42 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[71049]: See "systemctl status ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4@iscsi.foo.smithi099.qyjuvr.service" and "journalctl -xeu ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4@iscsi.foo.smithi099.qyjuvr.service" for details. 2024-03-30T13:51:42.208 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:51:42 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[71049]: Traceback (most recent call last): 2024-03-30T13:51:42.208 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:51:42 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[71049]: File "/usr/share/ceph/mgr/cephadm/serve.py", line 1114, in _check_daemons 2024-03-30T13:51:42.208 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:51:42 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[71049]: self.mgr._daemon_action(daemon_spec, action=action) 2024-03-30T13:51:42.208 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:51:42 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[71049]: File "/usr/share/ceph/mgr/cephadm/module.py", line 2390, in _daemon_action 2024-03-30T13:51:42.208 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:51:42 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[71049]: CephadmServe(self)._create_daemon(daemon_spec, reconfig=(action == 'reconfig'))) 2024-03-30T13:51:42.208 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:51:42 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[71049]: File "/usr/share/ceph/mgr/cephadm/module.py", line 747, in wait_async 2024-03-30T13:51:42.208 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:51:42 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[71049]: return self.event_loop.get_result(coro, timeout) 2024-03-30T13:51:42.208 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:51:42 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[71049]: File "/usr/share/ceph/mgr/cephadm/ssh.py", line 136, in get_result 2024-03-30T13:51:42.208 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:51:42 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[71049]: return future.result(timeout) 2024-03-30T13:51:42.208 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:51:42 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[71049]: File "/lib64/python3.6/concurrent/futures/_base.py", line 432, in result 2024-03-30T13:51:42.208 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:51:42 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[71049]: return self.__get_result() 2024-03-30T13:51:42.208 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:51:42 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[71049]: File "/lib64/python3.6/concurrent/futures/_base.py", line 384, in __get_result 2024-03-30T13:51:42.208 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:51:42 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[71049]: raise self._exception 2024-03-30T13:51:42.208 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:51:42 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[71049]: File "/usr/share/ceph/mgr/cephadm/serve.py", line 1374, in _create_daemon 2024-03-30T13:51:42.209 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:51:42 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[71049]: config_blobs=daemon_spec.final_config, 2024-03-30T13:51:42.209 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:51:42 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[71049]: File "/usr/share/ceph/mgr/cephadm/serve.py", line 1685, in _run_cephadm 2024-03-30T13:51:42.209 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:51:42 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[71049]: f'cephadm exited with an error code: {code}, stderr: {err}') 2024-03-30T13:51:42.209 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:51:42 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[71049]: orchestrator._interface.OrchestratorError: cephadm exited with an error code: 1, stderr: Reconfig daemon iscsi.foo.smithi099.qyjuvr ... 2024-03-30T13:51:42.209 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:51:42 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[71049]: Creating ceph-iscsi config... 2024-03-30T13:51:42.209 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:51:42 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[71049]: Write file: /var/lib/ceph/98ebaeb8-ee99-11ee-b647-cb9ed24678a4/iscsi.foo.smithi099.qyjuvr/iscsi-gateway.cfg 2024-03-30T13:51:42.209 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:51:42 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[71049]: Write file: /var/lib/ceph/98ebaeb8-ee99-11ee-b647-cb9ed24678a4/iscsi.foo.smithi099.qyjuvr/tcmu-runner-entrypoint.sh 2024-03-30T13:51:42.209 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:51:42 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[71049]: Non-zero exit code 1 from systemctl restart ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4@iscsi.foo.smithi099.qyjuvr 2024-03-30T13:51:42.209 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:51:42 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[71049]: systemctl: stderr Job for ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4@iscsi.foo.smithi099.qyjuvr.service failed because the control process exited with error code. 2024-03-30T13:51:42.209 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:51:42 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[71049]: systemctl: stderr See "systemctl status ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4@iscsi.foo.smithi099.qyjuvr.service" and "journalctl -xeu ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4@iscsi.foo.smithi099.qyjuvr.service" for details. 2024-03-30T13:51:42.209 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:51:42 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[71049]: Traceback (most recent call last): 2024-03-30T13:51:42.209 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:51:42 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[71049]: File "/usr/lib64/python3.9/runpy.py", line 197, in _run_module_as_main 2024-03-30T13:51:42.209 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:51:42 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[71049]: return _run_code(code, main_globals, None, 2024-03-30T13:51:42.209 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:51:42 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[71049]: File "/usr/lib64/python3.9/runpy.py", line 87, in _run_code 2024-03-30T13:51:42.210 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:51:42 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[71049]: exec(code, run_globals) 2024-03-30T13:51:42.210 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:51:42 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[71049]: File "/var/lib/ceph/98ebaeb8-ee99-11ee-b647-cb9ed24678a4/cephadm.a8f553f8c0a1bbbd91f4e60c8e13381b6fabffa3561f875fe77bb96af479b3ca/__main__.py", line 5528, in 2024-03-30T13:51:42.210 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:51:42 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[71049]: File "/var/lib/ceph/98ebaeb8-ee99-11ee-b647-cb9ed24678a4/cephadm.a8f553f8c0a1bbbd91f4e60c8e13381b6fabffa3561f875fe77bb96af479b3ca/__main__.py", line 5516, in main 2024-03-30T13:51:42.210 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:51:42 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[71049]: File "/var/lib/ceph/98ebaeb8-ee99-11ee-b647-cb9ed24678a4/cephadm.a8f553f8c0a1bbbd91f4e60c8e13381b6fabffa3561f875fe77bb96af479b3ca/__main__.py", line 3040, in command_deploy_from 2024-03-30T13:51:42.210 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:51:42 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[71049]: File "/var/lib/ceph/98ebaeb8-ee99-11ee-b647-cb9ed24678a4/cephadm.a8f553f8c0a1bbbd91f4e60c8e13381b6fabffa3561f875fe77bb96af479b3ca/__main__.py", line 3075, in _common_deploy 2024-03-30T13:51:42.210 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:51:42 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[71049]: File "/var/lib/ceph/98ebaeb8-ee99-11ee-b647-cb9ed24678a4/cephadm.a8f553f8c0a1bbbd91f4e60c8e13381b6fabffa3561f875fe77bb96af479b3ca/__main__.py", line 3095, in _deploy_daemon_container 2024-03-30T13:51:42.210 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:51:42 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[71049]: File "/var/lib/ceph/98ebaeb8-ee99-11ee-b647-cb9ed24678a4/cephadm.a8f553f8c0a1bbbd91f4e60c8e13381b6fabffa3561f875fe77bb96af479b3ca/__main__.py", line 1067, in deploy_daemon 2024-03-30T13:51:42.210 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:51:42 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[71049]: File "/var/lib/ceph/98ebaeb8-ee99-11ee-b647-cb9ed24678a4/cephadm.a8f553f8c0a1bbbd91f4e60c8e13381b6fabffa3561f875fe77bb96af479b3ca/cephadmlib/call_wrappers.py", line 307, in call_throws 2024-03-30T13:51:42.210 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:51:42 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[71049]: RuntimeError: Failed command: systemctl restart ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4@iscsi.foo.smithi099.qyjuvr: Job for ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4@iscsi.foo.smithi099.qyjuvr.service failed because the control process exited with error code. 2024-03-30T13:51:42.210 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:51:42 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[71049]: See "systemctl status ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4@iscsi.foo.smithi099.qyjuvr.service" and "journalctl -xeu ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4@iscsi.foo.smithi099.qyjuvr.service" for details. 2024-03-30T13:51:42.254 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:51:41 smithi181 ceph-mon[25762]: pgmap v14: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 59 KiB/s rd, 0 B/s wr, 33 op/s 2024-03-30T13:51:42.255 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:51:41 smithi181 ceph-mon[25762]: pgmap v15: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 53 KiB/s rd, 0 B/s wr, 30 op/s 2024-03-30T13:51:42.255 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:51:41 smithi181 ceph-mon[25762]: pgmap v16: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 73 KiB/s rd, 0 B/s wr, 41 op/s 2024-03-30T13:51:42.255 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:51:41 smithi181 ceph-mon[25762]: mgrmap e31: y(active, since 8s), standbys: x 2024-03-30T13:51:42.255 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:51:41 smithi181 ceph-mon[25762]: from='mgr.25057 172.21.15.99:0/1165207787' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-03-30T13:51:43.086 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:51:42 smithi099 ceph-mon[24912]: cephadm exited with an error code: 1, stderr: Reconfig daemon iscsi.foo.smithi099.qyjuvr ... 2024-03-30T13:51:43.086 INFO:journalctl@ceph.mon.a.smithi099.stdout: Creating ceph-iscsi config... 2024-03-30T13:51:43.086 INFO:journalctl@ceph.mon.a.smithi099.stdout: Write file: /var/lib/ceph/98ebaeb8-ee99-11ee-b647-cb9ed24678a4/iscsi.foo.smithi099.qyjuvr/iscsi-gateway.cfg 2024-03-30T13:51:43.086 INFO:journalctl@ceph.mon.a.smithi099.stdout: Write file: /var/lib/ceph/98ebaeb8-ee99-11ee-b647-cb9ed24678a4/iscsi.foo.smithi099.qyjuvr/tcmu-runner-entrypoint.sh 2024-03-30T13:51:43.086 INFO:journalctl@ceph.mon.a.smithi099.stdout: Non-zero exit code 1 from systemctl restart ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4@iscsi.foo.smithi099.qyjuvr 2024-03-30T13:51:43.086 INFO:journalctl@ceph.mon.a.smithi099.stdout: systemctl: stderr Job for ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4@iscsi.foo.smithi099.qyjuvr.service failed because the control process exited with error code. 2024-03-30T13:51:43.086 INFO:journalctl@ceph.mon.a.smithi099.stdout: systemctl: stderr See "systemctl status ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4@iscsi.foo.smithi099.qyjuvr.service" and "journalctl -xeu ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4@iscsi.foo.smithi099.qyjuvr.service" for details. 2024-03-30T13:51:43.087 INFO:journalctl@ceph.mon.a.smithi099.stdout: Traceback (most recent call last): 2024-03-30T13:51:43.087 INFO:journalctl@ceph.mon.a.smithi099.stdout: File "/usr/lib64/python3.9/runpy.py", line 197, in _run_module_as_main 2024-03-30T13:51:43.087 INFO:journalctl@ceph.mon.a.smithi099.stdout: return _run_code(code, main_globals, None, 2024-03-30T13:51:43.087 INFO:journalctl@ceph.mon.a.smithi099.stdout: File "/usr/lib64/python3.9/runpy.py", line 87, in _run_code 2024-03-30T13:51:43.087 INFO:journalctl@ceph.mon.a.smithi099.stdout: exec(code, run_globals) 2024-03-30T13:51:43.087 INFO:journalctl@ceph.mon.a.smithi099.stdout: File "/var/lib/ceph/98ebaeb8-ee99-11ee-b647-cb9ed24678a4/cephadm.a8f553f8c0a1bbbd91f4e60c8e13381b6fabffa3561f875fe77bb96af479b3ca/__main__.py", line 5528, in 2024-03-30T13:51:43.087 INFO:journalctl@ceph.mon.a.smithi099.stdout: File "/var/lib/ceph/98ebaeb8-ee99-11ee-b647-cb9ed24678a4/cephadm.a8f553f8c0a1bbbd91f4e60c8e13381b6fabffa3561f875fe77bb96af479b3ca/__main__.py", line 5516, in main 2024-03-30T13:51:43.087 INFO:journalctl@ceph.mon.a.smithi099.stdout: File "/var/lib/ceph/98ebaeb8-ee99-11ee-b647-cb9ed24678a4/cephadm.a8f553f8c0a1bbbd91f4e60c8e13381b6fabffa3561f875fe77bb96af479b3ca/__main__.py", line 3040, in command_deploy_from 2024-03-30T13:51:43.087 INFO:journalctl@ceph.mon.a.smithi099.stdout: File "/var/lib/ceph/98ebaeb8-ee99-11ee-b647-cb9ed24678a4/cephadm.a8f553f8c0a1bbbd91f4e60c8e13381b6fabffa3561f875fe77bb96af479b3ca/__main__.py", line 3075, in _common_deploy 2024-03-30T13:51:43.087 INFO:journalctl@ceph.mon.a.smithi099.stdout: File "/var/lib/ceph/98ebaeb8-ee99-11ee-b647-cb9ed24678a4/cephadm.a8f553f8c0a1bbbd91f4e60c8e13381b6fabffa3561f875fe77bb96af479b3ca/__main__.py", line 3095, in _deploy_daemon_container 2024-03-30T13:51:43.087 INFO:journalctl@ceph.mon.a.smithi099.stdout: File "/var/lib/ceph/98ebaeb8-ee99-11ee-b647-cb9ed24678a4/cephadm.a8f553f8c0a1bbbd91f4e60c8e13381b6fabffa3561f875fe77bb96af479b3ca/__main__.py", line 1067, in deploy_daemon 2024-03-30T13:51:43.087 INFO:journalctl@ceph.mon.a.smithi099.stdout: File "/var/lib/ceph/98ebaeb8-ee99-11ee-b647-cb9ed24678a4/cephadm.a8f553f8c0a1bbbd91f4e60c8e13381b6fabffa3561f875fe77bb96af479b3ca/cephadmlib/call_wrappers.py", line 307, in call_throws 2024-03-30T13:51:43.087 INFO:journalctl@ceph.mon.a.smithi099.stdout: RuntimeError: Failed command: systemctl restart ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4@iscsi.foo.smithi099.qyjuvr: Job for ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4@iscsi.foo.smithi099.qyjuvr.service failed because the control process exited with error code. 2024-03-30T13:51:43.087 INFO:journalctl@ceph.mon.a.smithi099.stdout: See "systemctl status ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4@iscsi.foo.smithi099.qyjuvr.service" and "journalctl -xeu ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4@iscsi.foo.smithi099.qyjuvr.service" for details. 2024-03-30T13:51:43.088 INFO:journalctl@ceph.mon.a.smithi099.stdout: Traceback (most recent call last): 2024-03-30T13:51:43.088 INFO:journalctl@ceph.mon.a.smithi099.stdout: File "/usr/share/ceph/mgr/cephadm/serve.py", line 1114, in _check_daemons 2024-03-30T13:51:43.088 INFO:journalctl@ceph.mon.a.smithi099.stdout: self.mgr._daemon_action(daemon_spec, action=action) 2024-03-30T13:51:43.088 INFO:journalctl@ceph.mon.a.smithi099.stdout: File "/usr/share/ceph/mgr/cephadm/module.py", line 2390, in _daemon_action 2024-03-30T13:51:43.088 INFO:journalctl@ceph.mon.a.smithi099.stdout: CephadmServe(self)._create_daemon(daemon_spec, reconfig=(action == 'reconfig'))) 2024-03-30T13:51:43.088 INFO:journalctl@ceph.mon.a.smithi099.stdout: File "/usr/share/ceph/mgr/cephadm/module.py", line 747, in wait_async 2024-03-30T13:51:43.088 INFO:journalctl@ceph.mon.a.smithi099.stdout: return self.event_loop.get_result(coro, timeout) 2024-03-30T13:51:43.088 INFO:journalctl@ceph.mon.a.smithi099.stdout: File "/usr/share/ceph/mgr/cephadm/ssh.py", line 136, in get_result 2024-03-30T13:51:43.088 INFO:journalctl@ceph.mon.a.smithi099.stdout: return future.result(timeout) 2024-03-30T13:51:43.088 INFO:journalctl@ceph.mon.a.smithi099.stdout: File "/lib64/python3.6/concurrent/futures/_base.py", line 432, in result 2024-03-30T13:51:43.088 INFO:journalctl@ceph.mon.a.smithi099.stdout: return self.__get_result() 2024-03-30T13:51:43.088 INFO:journalctl@ceph.mon.a.smithi099.stdout: File "/lib64/python3.6/concurrent/futures/_base.py", line 384, in __get_result 2024-03-30T13:51:43.088 INFO:journalctl@ceph.mon.a.smithi099.stdout: raise self._exception 2024-03-30T13:51:43.088 INFO:journalctl@ceph.mon.a.smithi099.stdout: File "/usr/share/ceph/mgr/cephadm/serve.py", line 1374, in _create_daemon 2024-03-30T13:51:43.089 INFO:journalctl@ceph.mon.a.smithi099.stdout: config_blobs=daemon_spec.final_config, 2024-03-30T13:51:43.089 INFO:journalctl@ceph.mon.a.smithi099.stdout: File "/usr/share/ceph/mgr/cephadm/serve.py", line 1685, in _run_cephadm 2024-03-30T13:51:43.089 INFO:journalctl@ceph.mon.a.smithi099.stdout: f'cephadm exited with an error code: {code}, stderr: {err}') 2024-03-30T13:51:43.089 INFO:journalctl@ceph.mon.a.smithi099.stdout: orchestrator._interface.OrchestratorError: cephadm exited with an error code: 1, stderr: Reconfig daemon iscsi.foo.smithi099.qyjuvr ... 2024-03-30T13:51:43.089 INFO:journalctl@ceph.mon.a.smithi099.stdout: Creating ceph-iscsi config... 2024-03-30T13:51:43.089 INFO:journalctl@ceph.mon.a.smithi099.stdout: Write file: /var/lib/ceph/98ebaeb8-ee99-11ee-b647-cb9ed24678a4/iscsi.foo.smithi099.qyjuvr/iscsi-gateway.cfg 2024-03-30T13:51:43.089 INFO:journalctl@ceph.mon.a.smithi099.stdout: Write file: /var/lib/ceph/98ebaeb8-ee99-11ee-b647-cb9ed24678a4/iscsi.foo.smithi099.qyjuvr/tcmu-runner-entrypoint.sh 2024-03-30T13:51:43.089 INFO:journalctl@ceph.mon.a.smithi099.stdout: Non-zero exit code 1 from systemctl restart ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4@iscsi.foo.smithi099.qyjuvr 2024-03-30T13:51:43.089 INFO:journalctl@ceph.mon.a.smithi099.stdout: systemctl: stderr Job for ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4@iscsi.foo.smithi099.qyjuvr.service failed because the control process exited with error code. 2024-03-30T13:51:43.089 INFO:journalctl@ceph.mon.a.smithi099.stdout: systemctl: stderr See "systemctl status ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4@iscsi.foo.smithi099.qyjuvr.service" and "journalctl -xeu ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4@iscsi.foo.smithi099.qyjuvr.service" for details. 2024-03-30T13:51:43.089 INFO:journalctl@ceph.mon.a.smithi099.stdout: Traceback (most recent call last): 2024-03-30T13:51:43.089 INFO:journalctl@ceph.mon.a.smithi099.stdout: File "/usr/lib64/python3.9/runpy.py", line 197, in _run_module_as_main 2024-03-30T13:51:43.089 INFO:journalctl@ceph.mon.a.smithi099.stdout: return _run_code(code, main_globals, None, 2024-03-30T13:51:43.089 INFO:journalctl@ceph.mon.a.smithi099.stdout: File "/usr/lib64/python3.9/runpy.py", line 87, in _run_code 2024-03-30T13:51:43.089 INFO:journalctl@ceph.mon.a.smithi099.stdout: exec(code, run_globals) 2024-03-30T13:51:43.090 INFO:journalctl@ceph.mon.a.smithi099.stdout: File "/var/lib/ceph/98ebaeb8-ee99-11ee-b647-cb9ed24678a4/cephadm.a8f553f8c0a1bbbd91f4e60c8e13381b6fabffa3561f875fe77bb96af479b3ca/__main__.py", line 5528, in 2024-03-30T13:51:43.090 INFO:journalctl@ceph.mon.a.smithi099.stdout: File "/var/lib/ceph/98ebaeb8-ee99-11ee-b647-cb9ed24678a4/cephadm.a8f553f8c0a1bbbd91f4e60c8e13381b6fabffa3561f875fe77bb96af479b3ca/__main__.py", line 5516, in main 2024-03-30T13:51:43.090 INFO:journalctl@ceph.mon.a.smithi099.stdout: File "/var/lib/ceph/98ebaeb8-ee99-11ee-b647-cb9ed24678a4/cephadm.a8f553f8c0a1bbbd91f4e60c8e13381b6fabffa3561f875fe77bb96af479b3ca/__main__.py", line 3040, in command_deploy_from 2024-03-30T13:51:43.090 INFO:journalctl@ceph.mon.a.smithi099.stdout: File "/var/lib/ceph/98ebaeb8-ee99-11ee-b647-cb9ed24678a4/cephadm.a8f553f8c0a1bbbd91f4e60c8e13381b6fabffa3561f875fe77bb96af479b3ca/__main__.py", line 3075, in _common_deploy 2024-03-30T13:51:43.090 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:51:42 smithi099 ceph-mon[29691]: cephadm exited with an error code: 1, stderr: Reconfig daemon iscsi.foo.smithi099.qyjuvr ... 2024-03-30T13:51:43.090 INFO:journalctl@ceph.mon.c.smithi099.stdout: Creating ceph-iscsi config... 2024-03-30T13:51:43.090 INFO:journalctl@ceph.mon.c.smithi099.stdout: Write file: /var/lib/ceph/98ebaeb8-ee99-11ee-b647-cb9ed24678a4/iscsi.foo.smithi099.qyjuvr/iscsi-gateway.cfg 2024-03-30T13:51:43.090 INFO:journalctl@ceph.mon.c.smithi099.stdout: Write file: /var/lib/ceph/98ebaeb8-ee99-11ee-b647-cb9ed24678a4/iscsi.foo.smithi099.qyjuvr/tcmu-runner-entrypoint.sh 2024-03-30T13:51:43.090 INFO:journalctl@ceph.mon.c.smithi099.stdout: Non-zero exit code 1 from systemctl restart ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4@iscsi.foo.smithi099.qyjuvr 2024-03-30T13:51:43.091 INFO:journalctl@ceph.mon.c.smithi099.stdout: systemctl: stderr Job for ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4@iscsi.foo.smithi099.qyjuvr.service failed because the control process exited with error code. 2024-03-30T13:51:43.091 INFO:journalctl@ceph.mon.c.smithi099.stdout: systemctl: stderr See "systemctl status ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4@iscsi.foo.smithi099.qyjuvr.service" and "journalctl -xeu ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4@iscsi.foo.smithi099.qyjuvr.service" for details. 2024-03-30T13:51:43.091 INFO:journalctl@ceph.mon.c.smithi099.stdout: Traceback (most recent call last): 2024-03-30T13:51:43.091 INFO:journalctl@ceph.mon.c.smithi099.stdout: File "/usr/lib64/python3.9/runpy.py", line 197, in _run_module_as_main 2024-03-30T13:51:43.091 INFO:journalctl@ceph.mon.c.smithi099.stdout: return _run_code(code, main_globals, None, 2024-03-30T13:51:43.091 INFO:journalctl@ceph.mon.c.smithi099.stdout: File "/usr/lib64/python3.9/runpy.py", line 87, in _run_code 2024-03-30T13:51:43.091 INFO:journalctl@ceph.mon.c.smithi099.stdout: exec(code, run_globals) 2024-03-30T13:51:43.091 INFO:journalctl@ceph.mon.c.smithi099.stdout: File "/var/lib/ceph/98ebaeb8-ee99-11ee-b647-cb9ed24678a4/cephadm.a8f553f8c0a1bbbd91f4e60c8e13381b6fabffa3561f875fe77bb96af479b3ca/__main__.py", line 5528, in 2024-03-30T13:51:43.091 INFO:journalctl@ceph.mon.c.smithi099.stdout: File "/var/lib/ceph/98ebaeb8-ee99-11ee-b647-cb9ed24678a4/cephadm.a8f553f8c0a1bbbd91f4e60c8e13381b6fabffa3561f875fe77bb96af479b3ca/__main__.py", line 5516, in main 2024-03-30T13:51:43.091 INFO:journalctl@ceph.mon.c.smithi099.stdout: File "/var/lib/ceph/98ebaeb8-ee99-11ee-b647-cb9ed24678a4/cephadm.a8f553f8c0a1bbbd91f4e60c8e13381b6fabffa3561f875fe77bb96af479b3ca/__main__.py", line 3040, in command_deploy_from 2024-03-30T13:51:43.091 INFO:journalctl@ceph.mon.c.smithi099.stdout: File "/var/lib/ceph/98ebaeb8-ee99-11ee-b647-cb9ed24678a4/cephadm.a8f553f8c0a1bbbd91f4e60c8e13381b6fabffa3561f875fe77bb96af479b3ca/__main__.py", line 3075, in _common_deploy 2024-03-30T13:51:43.091 INFO:journalctl@ceph.mon.c.smithi099.stdout: File "/var/lib/ceph/98ebaeb8-ee99-11ee-b647-cb9ed24678a4/cephadm.a8f553f8c0a1bbbd91f4e60c8e13381b6fabffa3561f875fe77bb96af479b3ca/__main__.py", line 3095, in _deploy_daemon_container 2024-03-30T13:51:43.091 INFO:journalctl@ceph.mon.c.smithi099.stdout: File "/var/lib/ceph/98ebaeb8-ee99-11ee-b647-cb9ed24678a4/cephadm.a8f553f8c0a1bbbd91f4e60c8e13381b6fabffa3561f875fe77bb96af479b3ca/__main__.py", line 1067, in deploy_daemon 2024-03-30T13:51:43.091 INFO:journalctl@ceph.mon.c.smithi099.stdout: File "/var/lib/ceph/98ebaeb8-ee99-11ee-b647-cb9ed24678a4/cephadm.a8f553f8c0a1bbbd91f4e60c8e13381b6fabffa3561f875fe77bb96af479b3ca/cephadmlib/call_wrappers.py", line 307, in call_throws 2024-03-30T13:51:43.092 INFO:journalctl@ceph.mon.c.smithi099.stdout: RuntimeError: Failed command: systemctl restart ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4@iscsi.foo.smithi099.qyjuvr: Job for ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4@iscsi.foo.smithi099.qyjuvr.service failed because the control process exited with error code. 2024-03-30T13:51:43.092 INFO:journalctl@ceph.mon.c.smithi099.stdout: See "systemctl status ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4@iscsi.foo.smithi099.qyjuvr.service" and "journalctl -xeu ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4@iscsi.foo.smithi099.qyjuvr.service" for details. 2024-03-30T13:51:43.092 INFO:journalctl@ceph.mon.c.smithi099.stdout: Traceback (most recent call last): 2024-03-30T13:51:43.092 INFO:journalctl@ceph.mon.c.smithi099.stdout: File "/usr/share/ceph/mgr/cephadm/serve.py", line 1114, in _check_daemons 2024-03-30T13:51:43.092 INFO:journalctl@ceph.mon.c.smithi099.stdout: self.mgr._daemon_action(daemon_spec, action=action) 2024-03-30T13:51:43.092 INFO:journalctl@ceph.mon.c.smithi099.stdout: File "/usr/share/ceph/mgr/cephadm/module.py", line 2390, in _daemon_action 2024-03-30T13:51:43.092 INFO:journalctl@ceph.mon.c.smithi099.stdout: CephadmServe(self)._create_daemon(daemon_spec, reconfig=(action == 'reconfig'))) 2024-03-30T13:51:43.092 INFO:journalctl@ceph.mon.c.smithi099.stdout: File "/usr/share/ceph/mgr/cephadm/module.py", line 747, in wait_async 2024-03-30T13:51:43.092 INFO:journalctl@ceph.mon.c.smithi099.stdout: return self.event_loop.get_result(coro, timeout) 2024-03-30T13:51:43.092 INFO:journalctl@ceph.mon.c.smithi099.stdout: File "/usr/share/ceph/mgr/cephadm/ssh.py", line 136, in get_result 2024-03-30T13:51:43.092 INFO:journalctl@ceph.mon.c.smithi099.stdout: return future.result(timeout) 2024-03-30T13:51:43.092 INFO:journalctl@ceph.mon.c.smithi099.stdout: File "/lib64/python3.6/concurrent/futures/_base.py", line 432, in result 2024-03-30T13:51:43.092 INFO:journalctl@ceph.mon.c.smithi099.stdout: return self.__get_result() 2024-03-30T13:51:43.092 INFO:journalctl@ceph.mon.c.smithi099.stdout: File "/lib64/python3.6/concurrent/futures/_base.py", line 384, in __get_result 2024-03-30T13:51:43.092 INFO:journalctl@ceph.mon.c.smithi099.stdout: raise self._exception 2024-03-30T13:51:43.093 INFO:journalctl@ceph.mon.c.smithi099.stdout: File "/usr/share/ceph/mgr/cephadm/serve.py", line 1374, in _create_daemon 2024-03-30T13:51:43.093 INFO:journalctl@ceph.mon.c.smithi099.stdout: config_blobs=daemon_spec.final_config, 2024-03-30T13:51:43.093 INFO:journalctl@ceph.mon.c.smithi099.stdout: File "/usr/share/ceph/mgr/cephadm/serve.py", line 1685, in _run_cephadm 2024-03-30T13:51:43.093 INFO:journalctl@ceph.mon.c.smithi099.stdout: f'cephadm exited with an error code: {code}, stderr: {err}') 2024-03-30T13:51:43.093 INFO:journalctl@ceph.mon.c.smithi099.stdout: orchestrator._interface.OrchestratorError: cephadm exited with an error code: 1, stderr: Reconfig daemon iscsi.foo.smithi099.qyjuvr ... 2024-03-30T13:51:43.093 INFO:journalctl@ceph.mon.c.smithi099.stdout: Creating ceph-iscsi config... 2024-03-30T13:51:43.093 INFO:journalctl@ceph.mon.c.smithi099.stdout: Write file: /var/lib/ceph/98ebaeb8-ee99-11ee-b647-cb9ed24678a4/iscsi.foo.smithi099.qyjuvr/iscsi-gateway.cfg 2024-03-30T13:51:43.093 INFO:journalctl@ceph.mon.c.smithi099.stdout: Write file: /var/lib/ceph/98ebaeb8-ee99-11ee-b647-cb9ed24678a4/iscsi.foo.smithi099.qyjuvr/tcmu-runner-entrypoint.sh 2024-03-30T13:51:43.093 INFO:journalctl@ceph.mon.c.smithi099.stdout: Non-zero exit code 1 from systemctl restart ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4@iscsi.foo.smithi099.qyjuvr 2024-03-30T13:51:43.093 INFO:journalctl@ceph.mon.c.smithi099.stdout: systemctl: stderr Job for ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4@iscsi.foo.smithi099.qyjuvr.service failed because the control process exited with error code. 2024-03-30T13:51:43.093 INFO:journalctl@ceph.mon.c.smithi099.stdout: systemctl: stderr See "systemctl status ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4@iscsi.foo.smithi099.qyjuvr.service" and "journalctl -xeu ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4@iscsi.foo.smithi099.qyjuvr.service" for details. 2024-03-30T13:51:43.093 INFO:journalctl@ceph.mon.c.smithi099.stdout: Traceback (most recent call last): 2024-03-30T13:51:43.093 INFO:journalctl@ceph.mon.c.smithi099.stdout: File "/usr/lib64/python3.9/runpy.py", line 197, in _run_module_as_main 2024-03-30T13:51:43.093 INFO:journalctl@ceph.mon.c.smithi099.stdout: return _run_code(code, main_globals, None, 2024-03-30T13:51:43.094 INFO:journalctl@ceph.mon.c.smithi099.stdout: File "/usr/lib64/python3.9/runpy.py", line 87, in _run_code 2024-03-30T13:51:43.094 INFO:journalctl@ceph.mon.c.smithi099.stdout: exec(code, run_globals) 2024-03-30T13:51:43.094 INFO:journalctl@ceph.mon.c.smithi099.stdout: File "/var/lib/ceph/98ebaeb8-ee99-11ee-b647-cb9ed24678a4/cephadm.a8f553f8c0a1bbbd91f4e60c8e13381b6fabffa3561f875fe77bb96af479b3ca/__main__.py", line 5528, in 2024-03-30T13:51:43.094 INFO:journalctl@ceph.mon.c.smithi099.stdout: File "/var/lib/ceph/98ebaeb8-ee99-11ee-b647-cb9ed24678a4/cephadm.a8f553f8c0a1bbbd91f4e60c8e13381b6fabffa3561f875fe77bb96af479b3ca/__main__.py", line 5516, in main 2024-03-30T13:51:43.094 INFO:journalctl@ceph.mon.c.smithi099.stdout: File "/var/lib/ceph/98ebaeb8-ee99-11ee-b647-cb9ed24678a4/cephadm.a8f553f8c0a1bbbd91f4e60c8e13381b6fabffa3561f875fe77bb96af479b3ca/__main__.py", line 3040, in command_deploy_from 2024-03-30T13:51:43.094 INFO:journalctl@ceph.mon.c.smithi099.stdout: File "/var/lib/ceph/98ebaeb8-ee99-11ee-b647-cb9ed24678a4/cephadm.a8f553f8c0a1bbbd91f4e60c8e13381b6fabffa3561f875fe77bb96af479b3ca/__main__.py", line 3075, in _common_deploy 2024-03-30T13:51:43.094 INFO:journalctl@ceph.mon.c.smithi099.stdout: File "/var/lib/ceph/98ebaeb8-ee99-11ee-b647-cb9ed24678a4/cephadm.a8f553f8c0a1bbbd91f4e60c8e13381b6fabffa3561f875fe77bb96af479b3ca/__main__.py", line 3095, in _deploy_daemon_container 2024-03-30T13:51:43.094 INFO:journalctl@ceph.mon.c.smithi099.stdout: File "/var/lib/ceph/98ebaeb8-ee99-11ee-b647-cb9ed24678a4/cephadm.a8f553f8c0a1bbbd91f4e60c8e13381b6fabffa3561f875fe77bb96af479b3ca/__main__.py", line 1067, in deploy_daemon 2024-03-30T13:51:43.094 INFO:journalctl@ceph.mon.c.smithi099.stdout: File "/var/lib/ceph/98ebaeb8-ee99-11ee-b647-cb9ed24678a4/cephadm.a8f553f8c0a1bbbd91f4e60c8e13381b6fabffa3561f875fe77bb96af479b3ca/cephadmlib/call_wrappers.py", line 307, in call_throws 2024-03-30T13:51:43.094 INFO:journalctl@ceph.mon.c.smithi099.stdout: RuntimeError: Failed command: systemctl restart ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4@iscsi.foo.smithi099.qyjuvr: Job for ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4@iscsi.foo.smithi099.qyjuvr.service failed because the control process exited with error code. 2024-03-30T13:51:43.094 INFO:journalctl@ceph.mon.c.smithi099.stdout: See "systemctl status ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4@iscsi.foo.smithi099.qyjuvr.service" and "journalctl -xeu ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4@iscsi.foo.smithi099.qyjuvr.service" for details. 2024-03-30T13:51:43.094 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:51:42 smithi099 ceph-mon[29691]: Reconfiguring prometheus.a (dependencies changed)... 2024-03-30T13:51:43.095 INFO:journalctl@ceph.mon.a.smithi099.stdout: File "/var/lib/ceph/98ebaeb8-ee99-11ee-b647-cb9ed24678a4/cephadm.a8f553f8c0a1bbbd91f4e60c8e13381b6fabffa3561f875fe77bb96af479b3ca/__main__.py", line 3095, in _deploy_daemon_container 2024-03-30T13:51:43.095 INFO:journalctl@ceph.mon.a.smithi099.stdout: File "/var/lib/ceph/98ebaeb8-ee99-11ee-b647-cb9ed24678a4/cephadm.a8f553f8c0a1bbbd91f4e60c8e13381b6fabffa3561f875fe77bb96af479b3ca/__main__.py", line 1067, in deploy_daemon 2024-03-30T13:51:43.095 INFO:journalctl@ceph.mon.a.smithi099.stdout: File "/var/lib/ceph/98ebaeb8-ee99-11ee-b647-cb9ed24678a4/cephadm.a8f553f8c0a1bbbd91f4e60c8e13381b6fabffa3561f875fe77bb96af479b3ca/cephadmlib/call_wrappers.py", line 307, in call_throws 2024-03-30T13:51:43.095 INFO:journalctl@ceph.mon.a.smithi099.stdout: RuntimeError: Failed command: systemctl restart ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4@iscsi.foo.smithi099.qyjuvr: Job for ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4@iscsi.foo.smithi099.qyjuvr.service failed because the control process exited with error code. 2024-03-30T13:51:43.095 INFO:journalctl@ceph.mon.a.smithi099.stdout: See "systemctl status ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4@iscsi.foo.smithi099.qyjuvr.service" and "journalctl -xeu ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4@iscsi.foo.smithi099.qyjuvr.service" for details. 2024-03-30T13:51:43.095 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:51:42 smithi099 ceph-mon[24912]: Reconfiguring prometheus.a (dependencies changed)... 2024-03-30T13:51:43.147 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:51:42 smithi181 ceph-mon[25762]: cephadm exited with an error code: 1, stderr: Reconfig daemon iscsi.foo.smithi099.qyjuvr ... 2024-03-30T13:51:43.147 INFO:journalctl@ceph.mon.b.smithi181.stdout: Creating ceph-iscsi config... 2024-03-30T13:51:43.147 INFO:journalctl@ceph.mon.b.smithi181.stdout: Write file: /var/lib/ceph/98ebaeb8-ee99-11ee-b647-cb9ed24678a4/iscsi.foo.smithi099.qyjuvr/iscsi-gateway.cfg 2024-03-30T13:51:43.147 INFO:journalctl@ceph.mon.b.smithi181.stdout: Write file: /var/lib/ceph/98ebaeb8-ee99-11ee-b647-cb9ed24678a4/iscsi.foo.smithi099.qyjuvr/tcmu-runner-entrypoint.sh 2024-03-30T13:51:43.147 INFO:journalctl@ceph.mon.b.smithi181.stdout: Non-zero exit code 1 from systemctl restart ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4@iscsi.foo.smithi099.qyjuvr 2024-03-30T13:51:43.147 INFO:journalctl@ceph.mon.b.smithi181.stdout: systemctl: stderr Job for ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4@iscsi.foo.smithi099.qyjuvr.service failed because the control process exited with error code. 2024-03-30T13:51:43.147 INFO:journalctl@ceph.mon.b.smithi181.stdout: systemctl: stderr See "systemctl status ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4@iscsi.foo.smithi099.qyjuvr.service" and "journalctl -xeu ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4@iscsi.foo.smithi099.qyjuvr.service" for details. 2024-03-30T13:51:43.147 INFO:journalctl@ceph.mon.b.smithi181.stdout: Traceback (most recent call last): 2024-03-30T13:51:43.147 INFO:journalctl@ceph.mon.b.smithi181.stdout: File "/usr/lib64/python3.9/runpy.py", line 197, in _run_module_as_main 2024-03-30T13:51:43.148 INFO:journalctl@ceph.mon.b.smithi181.stdout: return _run_code(code, main_globals, None, 2024-03-30T13:51:43.148 INFO:journalctl@ceph.mon.b.smithi181.stdout: File "/usr/lib64/python3.9/runpy.py", line 87, in _run_code 2024-03-30T13:51:43.148 INFO:journalctl@ceph.mon.b.smithi181.stdout: exec(code, run_globals) 2024-03-30T13:51:43.148 INFO:journalctl@ceph.mon.b.smithi181.stdout: File "/var/lib/ceph/98ebaeb8-ee99-11ee-b647-cb9ed24678a4/cephadm.a8f553f8c0a1bbbd91f4e60c8e13381b6fabffa3561f875fe77bb96af479b3ca/__main__.py", line 5528, in 2024-03-30T13:51:43.148 INFO:journalctl@ceph.mon.b.smithi181.stdout: File "/var/lib/ceph/98ebaeb8-ee99-11ee-b647-cb9ed24678a4/cephadm.a8f553f8c0a1bbbd91f4e60c8e13381b6fabffa3561f875fe77bb96af479b3ca/__main__.py", line 5516, in main 2024-03-30T13:51:43.148 INFO:journalctl@ceph.mon.b.smithi181.stdout: File "/var/lib/ceph/98ebaeb8-ee99-11ee-b647-cb9ed24678a4/cephadm.a8f553f8c0a1bbbd91f4e60c8e13381b6fabffa3561f875fe77bb96af479b3ca/__main__.py", line 3040, in command_deploy_from 2024-03-30T13:51:43.148 INFO:journalctl@ceph.mon.b.smithi181.stdout: File "/var/lib/ceph/98ebaeb8-ee99-11ee-b647-cb9ed24678a4/cephadm.a8f553f8c0a1bbbd91f4e60c8e13381b6fabffa3561f875fe77bb96af479b3ca/__main__.py", line 3075, in _common_deploy 2024-03-30T13:51:43.148 INFO:journalctl@ceph.mon.b.smithi181.stdout: File "/var/lib/ceph/98ebaeb8-ee99-11ee-b647-cb9ed24678a4/cephadm.a8f553f8c0a1bbbd91f4e60c8e13381b6fabffa3561f875fe77bb96af479b3ca/__main__.py", line 3095, in _deploy_daemon_container 2024-03-30T13:51:43.148 INFO:journalctl@ceph.mon.b.smithi181.stdout: File "/var/lib/ceph/98ebaeb8-ee99-11ee-b647-cb9ed24678a4/cephadm.a8f553f8c0a1bbbd91f4e60c8e13381b6fabffa3561f875fe77bb96af479b3ca/__main__.py", line 1067, in deploy_daemon 2024-03-30T13:51:43.148 INFO:journalctl@ceph.mon.b.smithi181.stdout: File "/var/lib/ceph/98ebaeb8-ee99-11ee-b647-cb9ed24678a4/cephadm.a8f553f8c0a1bbbd91f4e60c8e13381b6fabffa3561f875fe77bb96af479b3ca/cephadmlib/call_wrappers.py", line 307, in call_throws 2024-03-30T13:51:43.148 INFO:journalctl@ceph.mon.b.smithi181.stdout: RuntimeError: Failed command: systemctl restart ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4@iscsi.foo.smithi099.qyjuvr: Job for ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4@iscsi.foo.smithi099.qyjuvr.service failed because the control process exited with error code. 2024-03-30T13:51:43.148 INFO:journalctl@ceph.mon.b.smithi181.stdout: See "systemctl status ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4@iscsi.foo.smithi099.qyjuvr.service" and "journalctl -xeu ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4@iscsi.foo.smithi099.qyjuvr.service" for details. 2024-03-30T13:51:43.148 INFO:journalctl@ceph.mon.b.smithi181.stdout: Traceback (most recent call last): 2024-03-30T13:51:43.148 INFO:journalctl@ceph.mon.b.smithi181.stdout: File "/usr/share/ceph/mgr/cephadm/serve.py", line 1114, in _check_daemons 2024-03-30T13:51:43.148 INFO:journalctl@ceph.mon.b.smithi181.stdout: self.mgr._daemon_action(daemon_spec, action=action) 2024-03-30T13:51:43.149 INFO:journalctl@ceph.mon.b.smithi181.stdout: File "/usr/share/ceph/mgr/cephadm/module.py", line 2390, in _daemon_action 2024-03-30T13:51:43.149 INFO:journalctl@ceph.mon.b.smithi181.stdout: CephadmServe(self)._create_daemon(daemon_spec, reconfig=(action == 'reconfig'))) 2024-03-30T13:51:43.149 INFO:journalctl@ceph.mon.b.smithi181.stdout: File "/usr/share/ceph/mgr/cephadm/module.py", line 747, in wait_async 2024-03-30T13:51:43.149 INFO:journalctl@ceph.mon.b.smithi181.stdout: return self.event_loop.get_result(coro, timeout) 2024-03-30T13:51:43.149 INFO:journalctl@ceph.mon.b.smithi181.stdout: File "/usr/share/ceph/mgr/cephadm/ssh.py", line 136, in get_result 2024-03-30T13:51:43.149 INFO:journalctl@ceph.mon.b.smithi181.stdout: return future.result(timeout) 2024-03-30T13:51:43.149 INFO:journalctl@ceph.mon.b.smithi181.stdout: File "/lib64/python3.6/concurrent/futures/_base.py", line 432, in result 2024-03-30T13:51:43.149 INFO:journalctl@ceph.mon.b.smithi181.stdout: return self.__get_result() 2024-03-30T13:51:43.149 INFO:journalctl@ceph.mon.b.smithi181.stdout: File "/lib64/python3.6/concurrent/futures/_base.py", line 384, in __get_result 2024-03-30T13:51:43.149 INFO:journalctl@ceph.mon.b.smithi181.stdout: raise self._exception 2024-03-30T13:51:43.149 INFO:journalctl@ceph.mon.b.smithi181.stdout: File "/usr/share/ceph/mgr/cephadm/serve.py", line 1374, in _create_daemon 2024-03-30T13:51:43.149 INFO:journalctl@ceph.mon.b.smithi181.stdout: config_blobs=daemon_spec.final_config, 2024-03-30T13:51:43.149 INFO:journalctl@ceph.mon.b.smithi181.stdout: File "/usr/share/ceph/mgr/cephadm/serve.py", line 1685, in _run_cephadm 2024-03-30T13:51:43.149 INFO:journalctl@ceph.mon.b.smithi181.stdout: f'cephadm exited with an error code: {code}, stderr: {err}') 2024-03-30T13:51:43.149 INFO:journalctl@ceph.mon.b.smithi181.stdout: orchestrator._interface.OrchestratorError: cephadm exited with an error code: 1, stderr: Reconfig daemon iscsi.foo.smithi099.qyjuvr ... 2024-03-30T13:51:43.150 INFO:journalctl@ceph.mon.b.smithi181.stdout: Creating ceph-iscsi config... 2024-03-30T13:51:43.150 INFO:journalctl@ceph.mon.b.smithi181.stdout: Write file: /var/lib/ceph/98ebaeb8-ee99-11ee-b647-cb9ed24678a4/iscsi.foo.smithi099.qyjuvr/iscsi-gateway.cfg 2024-03-30T13:51:43.150 INFO:journalctl@ceph.mon.b.smithi181.stdout: Write file: /var/lib/ceph/98ebaeb8-ee99-11ee-b647-cb9ed24678a4/iscsi.foo.smithi099.qyjuvr/tcmu-runner-entrypoint.sh 2024-03-30T13:51:43.150 INFO:journalctl@ceph.mon.b.smithi181.stdout: Non-zero exit code 1 from systemctl restart ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4@iscsi.foo.smithi099.qyjuvr 2024-03-30T13:51:43.150 INFO:journalctl@ceph.mon.b.smithi181.stdout: systemctl: stderr Job for ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4@iscsi.foo.smithi099.qyjuvr.service failed because the control process exited with error code. 2024-03-30T13:51:43.150 INFO:journalctl@ceph.mon.b.smithi181.stdout: systemctl: stderr See "systemctl status ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4@iscsi.foo.smithi099.qyjuvr.service" and "journalctl -xeu ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4@iscsi.foo.smithi099.qyjuvr.service" for details. 2024-03-30T13:51:43.150 INFO:journalctl@ceph.mon.b.smithi181.stdout: Traceback (most recent call last): 2024-03-30T13:51:43.150 INFO:journalctl@ceph.mon.b.smithi181.stdout: File "/usr/lib64/python3.9/runpy.py", line 197, in _run_module_as_main 2024-03-30T13:51:43.150 INFO:journalctl@ceph.mon.b.smithi181.stdout: return _run_code(code, main_globals, None, 2024-03-30T13:51:43.150 INFO:journalctl@ceph.mon.b.smithi181.stdout: File "/usr/lib64/python3.9/runpy.py", line 87, in _run_code 2024-03-30T13:51:43.150 INFO:journalctl@ceph.mon.b.smithi181.stdout: exec(code, run_globals) 2024-03-30T13:51:43.150 INFO:journalctl@ceph.mon.b.smithi181.stdout: File "/var/lib/ceph/98ebaeb8-ee99-11ee-b647-cb9ed24678a4/cephadm.a8f553f8c0a1bbbd91f4e60c8e13381b6fabffa3561f875fe77bb96af479b3ca/__main__.py", line 5528, in 2024-03-30T13:51:43.150 INFO:journalctl@ceph.mon.b.smithi181.stdout: File "/var/lib/ceph/98ebaeb8-ee99-11ee-b647-cb9ed24678a4/cephadm.a8f553f8c0a1bbbd91f4e60c8e13381b6fabffa3561f875fe77bb96af479b3ca/__main__.py", line 5516, in main 2024-03-30T13:51:43.150 INFO:journalctl@ceph.mon.b.smithi181.stdout: File "/var/lib/ceph/98ebaeb8-ee99-11ee-b647-cb9ed24678a4/cephadm.a8f553f8c0a1bbbd91f4e60c8e13381b6fabffa3561f875fe77bb96af479b3ca/__main__.py", line 3040, in command_deploy_from 2024-03-30T13:51:43.151 INFO:journalctl@ceph.mon.b.smithi181.stdout: File "/var/lib/ceph/98ebaeb8-ee99-11ee-b647-cb9ed24678a4/cephadm.a8f553f8c0a1bbbd91f4e60c8e13381b6fabffa3561f875fe77bb96af479b3ca/__main__.py", line 3075, in _common_deploy 2024-03-30T13:51:43.151 INFO:journalctl@ceph.mon.b.smithi181.stdout: File "/var/lib/ceph/98ebaeb8-ee99-11ee-b647-cb9ed24678a4/cephadm.a8f553f8c0a1bbbd91f4e60c8e13381b6fabffa3561f875fe77bb96af479b3ca/__main__.py", line 3095, in _deploy_daemon_container 2024-03-30T13:51:43.151 INFO:journalctl@ceph.mon.b.smithi181.stdout: File "/var/lib/ceph/98ebaeb8-ee99-11ee-b647-cb9ed24678a4/cephadm.a8f553f8c0a1bbbd91f4e60c8e13381b6fabffa3561f875fe77bb96af479b3ca/__main__.py", line 1067, in deploy_daemon 2024-03-30T13:51:43.151 INFO:journalctl@ceph.mon.b.smithi181.stdout: File "/var/lib/ceph/98ebaeb8-ee99-11ee-b647-cb9ed24678a4/cephadm.a8f553f8c0a1bbbd91f4e60c8e13381b6fabffa3561f875fe77bb96af479b3ca/cephadmlib/call_wrappers.py", line 307, in call_throws 2024-03-30T13:51:43.151 INFO:journalctl@ceph.mon.b.smithi181.stdout: RuntimeError: Failed command: systemctl restart ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4@iscsi.foo.smithi099.qyjuvr: Job for ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4@iscsi.foo.smithi099.qyjuvr.service failed because the control process exited with error code. 2024-03-30T13:51:43.151 INFO:journalctl@ceph.mon.b.smithi181.stdout: See "systemctl status ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4@iscsi.foo.smithi099.qyjuvr.service" and "journalctl -xeu ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4@iscsi.foo.smithi099.qyjuvr.service" for details. 2024-03-30T13:51:43.151 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:51:42 smithi181 ceph-mon[25762]: Reconfiguring prometheus.a (dependencies changed)... 2024-03-30T13:51:44.076 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:51:43 smithi181 ceph-mon[25762]: Reconfiguring daemon prometheus.a on smithi181 2024-03-30T13:51:44.076 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:51:43 smithi181 ceph-mon[25762]: pgmap v17: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 43 KiB/s rd, 0 B/s wr, 24 op/s 2024-03-30T13:51:44.085 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:51:43 smithi099 ceph-mon[24912]: Reconfiguring daemon prometheus.a on smithi181 2024-03-30T13:51:44.085 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:51:43 smithi099 ceph-mon[24912]: pgmap v17: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 43 KiB/s rd, 0 B/s wr, 24 op/s 2024-03-30T13:51:44.085 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:51:43 smithi099 ceph-mon[29691]: Reconfiguring daemon prometheus.a on smithi181 2024-03-30T13:51:44.085 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:51:43 smithi099 ceph-mon[29691]: pgmap v17: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 43 KiB/s rd, 0 B/s wr, 24 op/s 2024-03-30T13:51:45.255 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:51:44 smithi181 ceph-mon[25762]: from='mgr.25057 ' entity='mgr.y' 2024-03-30T13:51:45.255 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:51:44 smithi181 ceph-mon[25762]: from='mgr.25057 ' entity='mgr.y' 2024-03-30T13:51:45.255 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:51:44 smithi181 ceph-mon[25762]: pgmap v18: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 36 KiB/s rd, 0 B/s wr, 20 op/s 2024-03-30T13:51:45.255 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:51:44 smithi181 ceph-mon[25762]: pgmap v19: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 36 KiB/s rd, 0 B/s wr, 20 op/s 2024-03-30T13:51:45.255 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:51:44 smithi181 ceph-mon[25762]: from='mgr.25057 ' entity='mgr.y' 2024-03-30T13:51:45.335 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:51:44 smithi099 ceph-mon[24912]: from='mgr.25057 ' entity='mgr.y' 2024-03-30T13:51:45.336 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:51:44 smithi099 ceph-mon[24912]: from='mgr.25057 ' entity='mgr.y' 2024-03-30T13:51:45.336 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:51:44 smithi099 ceph-mon[24912]: pgmap v18: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 36 KiB/s rd, 0 B/s wr, 20 op/s 2024-03-30T13:51:45.336 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:51:44 smithi099 ceph-mon[24912]: pgmap v19: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 36 KiB/s rd, 0 B/s wr, 20 op/s 2024-03-30T13:51:45.336 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:51:44 smithi099 ceph-mon[24912]: from='mgr.25057 ' entity='mgr.y' 2024-03-30T13:51:45.336 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:51:44 smithi099 ceph-mon[29691]: from='mgr.25057 ' entity='mgr.y' 2024-03-30T13:51:45.336 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:51:44 smithi099 ceph-mon[29691]: from='mgr.25057 ' entity='mgr.y' 2024-03-30T13:51:45.336 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:51:44 smithi099 ceph-mon[29691]: pgmap v18: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 36 KiB/s rd, 0 B/s wr, 20 op/s 2024-03-30T13:51:45.336 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:51:44 smithi099 ceph-mon[29691]: pgmap v19: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 36 KiB/s rd, 0 B/s wr, 20 op/s 2024-03-30T13:51:45.336 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:51:44 smithi099 ceph-mon[29691]: from='mgr.25057 ' entity='mgr.y' 2024-03-30T13:51:45.546 INFO:journalctl@ceph.prometheus.a.smithi181.stdout:Mar 30 13:51:45 smithi181 systemd[1]: Stopping Ceph prometheus.a for 98ebaeb8-ee99-11ee-b647-cb9ed24678a4... 2024-03-30T13:51:45.547 INFO:journalctl@ceph.prometheus.a.smithi181.stdout:Mar 30 13:51:45 smithi181 bash[63472]: Error: no container with name or ID "ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-prometheus.a" found: no such container 2024-03-30T13:51:45.547 INFO:journalctl@ceph.prometheus.a.smithi181.stdout:Mar 30 13:51:45 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-prometheus-a[55395]: ts=2024-03-30T13:51:45.484Z caller=refresh.go:98 level=error component="discovery manager scrape" discovery=http msg="Unable to refresh target groups" err="Get \"http://172.21.15.181:8765/sd/prometheus/sd-config?service=node-exporter\": dial tcp 172.21.15.181:8765: connect: connection refused" 2024-03-30T13:51:45.547 INFO:journalctl@ceph.prometheus.a.smithi181.stdout:Mar 30 13:51:45 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-prometheus-a[55395]: ts=2024-03-30T13:51:45.485Z caller=refresh.go:98 level=error component="discovery manager notify" discovery=http msg="Unable to refresh target groups" err="Get \"http://172.21.15.181:8765/sd/prometheus/sd-config?service=alertmanager\": dial tcp 172.21.15.181:8765: connect: connection refused" 2024-03-30T13:51:45.547 INFO:journalctl@ceph.prometheus.a.smithi181.stdout:Mar 30 13:51:45 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-prometheus-a[55395]: ts=2024-03-30T13:51:45.485Z caller=refresh.go:98 level=error component="discovery manager scrape" discovery=http msg="Unable to refresh target groups" err="Get \"http://172.21.15.181:8765/sd/prometheus/sd-config?service=ceph-exporter\": dial tcp 172.21.15.181:8765: connect: connection refused" 2024-03-30T13:51:45.547 INFO:journalctl@ceph.prometheus.a.smithi181.stdout:Mar 30 13:51:45 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-prometheus-a[55395]: ts=2024-03-30T13:51:45.486Z caller=refresh.go:98 level=error component="discovery manager scrape" discovery=http msg="Unable to refresh target groups" err="Get \"http://172.21.15.181:8765/sd/prometheus/sd-config?service=mgr-prometheus\": dial tcp 172.21.15.181:8765: connect: connection refused" 2024-03-30T13:51:45.806 INFO:journalctl@ceph.prometheus.a.smithi181.stdout:Mar 30 13:51:45 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-prometheus-a[55395]: ts=2024-03-30T13:51:45.547Z caller=main.go:775 level=warn msg="Received SIGTERM, exiting gracefully..." 2024-03-30T13:51:45.806 INFO:journalctl@ceph.prometheus.a.smithi181.stdout:Mar 30 13:51:45 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-prometheus-a[55395]: ts=2024-03-30T13:51:45.547Z caller=main.go:798 level=info msg="Stopping scrape discovery manager..." 2024-03-30T13:51:45.806 INFO:journalctl@ceph.prometheus.a.smithi181.stdout:Mar 30 13:51:45 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-prometheus-a[55395]: ts=2024-03-30T13:51:45.547Z caller=main.go:812 level=info msg="Stopping notify discovery manager..." 2024-03-30T13:51:45.806 INFO:journalctl@ceph.prometheus.a.smithi181.stdout:Mar 30 13:51:45 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-prometheus-a[55395]: ts=2024-03-30T13:51:45.547Z caller=main.go:834 level=info msg="Stopping scrape manager..." 2024-03-30T13:51:45.806 INFO:journalctl@ceph.prometheus.a.smithi181.stdout:Mar 30 13:51:45 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-prometheus-a[55395]: ts=2024-03-30T13:51:45.547Z caller=main.go:794 level=info msg="Scrape discovery manager stopped" 2024-03-30T13:51:45.806 INFO:journalctl@ceph.prometheus.a.smithi181.stdout:Mar 30 13:51:45 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-prometheus-a[55395]: ts=2024-03-30T13:51:45.547Z caller=main.go:808 level=info msg="Notify discovery manager stopped" 2024-03-30T13:51:45.806 INFO:journalctl@ceph.prometheus.a.smithi181.stdout:Mar 30 13:51:45 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-prometheus-a[55395]: ts=2024-03-30T13:51:45.547Z caller=manager.go:945 level=info component="rule manager" msg="Stopping rule manager..." 2024-03-30T13:51:45.806 INFO:journalctl@ceph.prometheus.a.smithi181.stdout:Mar 30 13:51:45 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-prometheus-a[55395]: ts=2024-03-30T13:51:45.547Z caller=main.go:828 level=info msg="Scrape manager stopped" 2024-03-30T13:51:45.806 INFO:journalctl@ceph.prometheus.a.smithi181.stdout:Mar 30 13:51:45 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-prometheus-a[55395]: ts=2024-03-30T13:51:45.547Z caller=manager.go:955 level=info component="rule manager" msg="Rule manager stopped" 2024-03-30T13:51:45.807 INFO:journalctl@ceph.prometheus.a.smithi181.stdout:Mar 30 13:51:45 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-prometheus-a[55395]: ts=2024-03-30T13:51:45.547Z caller=notifier.go:600 level=info component=notifier msg="Stopping notification manager..." 2024-03-30T13:51:45.807 INFO:journalctl@ceph.prometheus.a.smithi181.stdout:Mar 30 13:51:45 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-prometheus-a[55395]: ts=2024-03-30T13:51:45.547Z caller=main.go:1054 level=info msg="Notifier manager stopped" 2024-03-30T13:51:45.807 INFO:journalctl@ceph.prometheus.a.smithi181.stdout:Mar 30 13:51:45 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-prometheus-a[55395]: ts=2024-03-30T13:51:45.547Z caller=main.go:1066 level=info msg="See you next time!" 2024-03-30T13:51:45.807 INFO:journalctl@ceph.prometheus.a.smithi181.stdout:Mar 30 13:51:45 smithi181 podman[63485]: 2024-03-30 13:51:45.557573035 +0000 UTC m=+0.105351398 container died fe9273415d72a017487fa57e684aa4d26f83bda6121c833f9e3ebf9816087c5c (image=quay.io/prometheus/prometheus:v2.33.4, name=ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-prometheus-a, maintainer=The Prometheus Authors ) 2024-03-30T13:51:46.105 INFO:journalctl@ceph.prometheus.a.smithi181.stdout:Mar 30 13:51:45 smithi181 podman[63485]: 2024-03-30 13:51:45.896724908 +0000 UTC m=+0.444503265 container cleanup fe9273415d72a017487fa57e684aa4d26f83bda6121c833f9e3ebf9816087c5c (image=quay.io/prometheus/prometheus:v2.33.4, name=ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-prometheus-a, maintainer=The Prometheus Authors ) 2024-03-30T13:51:46.105 INFO:journalctl@ceph.prometheus.a.smithi181.stdout:Mar 30 13:51:45 smithi181 bash[63485]: ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-prometheus-a 2024-03-30T13:51:46.391 INFO:journalctl@ceph.prometheus.a.smithi181.stdout:Mar 30 13:51:46 smithi181 podman[63499]: 2024-03-30 13:51:46.106289702 +0000 UTC m=+0.549069114 container remove fe9273415d72a017487fa57e684aa4d26f83bda6121c833f9e3ebf9816087c5c (image=quay.io/prometheus/prometheus:v2.33.4, name=ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-prometheus-a, maintainer=The Prometheus Authors ) 2024-03-30T13:51:46.391 INFO:journalctl@ceph.prometheus.a.smithi181.stdout:Mar 30 13:51:46 smithi181 bash[63515]: Error: no container with name or ID "ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-prometheus.a" found: no such container 2024-03-30T13:51:46.391 INFO:journalctl@ceph.prometheus.a.smithi181.stdout:Mar 30 13:51:46 smithi181 systemd[1]: ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4@prometheus.a.service: Deactivated successfully. 2024-03-30T13:51:46.391 INFO:journalctl@ceph.prometheus.a.smithi181.stdout:Mar 30 13:51:46 smithi181 systemd[1]: Stopped Ceph prometheus.a for 98ebaeb8-ee99-11ee-b647-cb9ed24678a4. 2024-03-30T13:51:46.391 INFO:journalctl@ceph.prometheus.a.smithi181.stdout:Mar 30 13:51:46 smithi181 systemd[1]: ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4@prometheus.a.service: Consumed 1.723s CPU time. 2024-03-30T13:51:46.391 INFO:journalctl@ceph.prometheus.a.smithi181.stdout:Mar 30 13:51:46 smithi181 systemd[1]: Starting Ceph prometheus.a for 98ebaeb8-ee99-11ee-b647-cb9ed24678a4... 2024-03-30T13:51:46.667 INFO:journalctl@ceph.prometheus.a.smithi181.stdout:Mar 30 13:51:46 smithi181 podman[63583]: 2024-03-30 13:51:46.29573082 +0000 UTC m=+0.018997659 image pull 514e6a882f6e74806a5856468489eeff8d7106095557578da96935e4d0ba4d9d quay.io/prometheus/prometheus:v2.33.4 2024-03-30T13:51:46.668 INFO:journalctl@ceph.prometheus.a.smithi181.stdout:Mar 30 13:51:46 smithi181 podman[63583]: 2024-03-30 13:51:46.43745171 +0000 UTC m=+0.160718552 container create 9bcfb373cf8c564687b9be02df59ca73905593290577a69447f0fe91d5f70dcb (image=quay.io/prometheus/prometheus:v2.33.4, name=ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-prometheus-a, maintainer=The Prometheus Authors ) 2024-03-30T13:51:46.927 INFO:journalctl@ceph.prometheus.a.smithi181.stdout:Mar 30 13:51:46 smithi181 podman[63583]: 2024-03-30 13:51:46.668687275 +0000 UTC m=+0.391954114 container init 9bcfb373cf8c564687b9be02df59ca73905593290577a69447f0fe91d5f70dcb (image=quay.io/prometheus/prometheus:v2.33.4, name=ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-prometheus-a, maintainer=The Prometheus Authors ) 2024-03-30T13:51:46.927 INFO:journalctl@ceph.prometheus.a.smithi181.stdout:Mar 30 13:51:46 smithi181 podman[63583]: 2024-03-30 13:51:46.671202496 +0000 UTC m=+0.394469338 container start 9bcfb373cf8c564687b9be02df59ca73905593290577a69447f0fe91d5f70dcb (image=quay.io/prometheus/prometheus:v2.33.4, name=ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-prometheus-a, maintainer=The Prometheus Authors ) 2024-03-30T13:51:46.927 INFO:journalctl@ceph.prometheus.a.smithi181.stdout:Mar 30 13:51:46 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-prometheus-a[63597]: ts=2024-03-30T13:51:46.694Z caller=main.go:475 level=info msg="No time or size retention was set so using the default time retention" duration=15d 2024-03-30T13:51:46.928 INFO:journalctl@ceph.prometheus.a.smithi181.stdout:Mar 30 13:51:46 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-prometheus-a[63597]: ts=2024-03-30T13:51:46.694Z caller=main.go:512 level=info msg="Starting Prometheus" version="(version=2.33.4, branch=HEAD, revision=83032011a5d3e6102624fe58241a374a7201fee8)" 2024-03-30T13:51:46.928 INFO:journalctl@ceph.prometheus.a.smithi181.stdout:Mar 30 13:51:46 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-prometheus-a[63597]: ts=2024-03-30T13:51:46.694Z caller=main.go:517 level=info build_context="(go=go1.17.7, user=root@d13bf69e7be8, date=20220222-16:51:28)" 2024-03-30T13:51:46.928 INFO:journalctl@ceph.prometheus.a.smithi181.stdout:Mar 30 13:51:46 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-prometheus-a[63597]: ts=2024-03-30T13:51:46.694Z caller=main.go:518 level=info host_details="(Linux 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 x86_64 smithi181 (none))" 2024-03-30T13:51:46.928 INFO:journalctl@ceph.prometheus.a.smithi181.stdout:Mar 30 13:51:46 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-prometheus-a[63597]: ts=2024-03-30T13:51:46.694Z caller=main.go:519 level=info fd_limits="(soft=1048576, hard=1048576)" 2024-03-30T13:51:46.928 INFO:journalctl@ceph.prometheus.a.smithi181.stdout:Mar 30 13:51:46 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-prometheus-a[63597]: ts=2024-03-30T13:51:46.694Z caller=main.go:520 level=info vm_limits="(soft=unlimited, hard=unlimited)" 2024-03-30T13:51:46.928 INFO:journalctl@ceph.prometheus.a.smithi181.stdout:Mar 30 13:51:46 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-prometheus-a[63597]: ts=2024-03-30T13:51:46.696Z caller=web.go:570 level=info component=web msg="Start listening for connections" address=:9095 2024-03-30T13:51:46.928 INFO:journalctl@ceph.prometheus.a.smithi181.stdout:Mar 30 13:51:46 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-prometheus-a[63597]: ts=2024-03-30T13:51:46.696Z caller=main.go:923 level=info msg="Starting TSDB ..." 2024-03-30T13:51:46.928 INFO:journalctl@ceph.prometheus.a.smithi181.stdout:Mar 30 13:51:46 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-prometheus-a[63597]: ts=2024-03-30T13:51:46.697Z caller=tls_config.go:195 level=info component=web msg="TLS is disabled." http2=false 2024-03-30T13:51:46.928 INFO:journalctl@ceph.prometheus.a.smithi181.stdout:Mar 30 13:51:46 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-prometheus-a[63597]: ts=2024-03-30T13:51:46.700Z caller=head.go:493 level=info component=tsdb msg="Replaying on-disk memory mappable chunks if any" 2024-03-30T13:51:46.928 INFO:journalctl@ceph.prometheus.a.smithi181.stdout:Mar 30 13:51:46 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-prometheus-a[63597]: ts=2024-03-30T13:51:46.700Z caller=head.go:527 level=info component=tsdb msg="On-disk memory mappable chunks replay completed" duration=1.779µs 2024-03-30T13:51:46.928 INFO:journalctl@ceph.prometheus.a.smithi181.stdout:Mar 30 13:51:46 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-prometheus-a[63597]: ts=2024-03-30T13:51:46.700Z caller=head.go:533 level=info component=tsdb msg="Replaying WAL, this may take a while" 2024-03-30T13:51:46.928 INFO:journalctl@ceph.prometheus.a.smithi181.stdout:Mar 30 13:51:46 smithi181 bash[63583]: 9bcfb373cf8c564687b9be02df59ca73905593290577a69447f0fe91d5f70dcb 2024-03-30T13:51:46.928 INFO:journalctl@ceph.prometheus.a.smithi181.stdout:Mar 30 13:51:46 smithi181 systemd[1]: Started Ceph prometheus.a for 98ebaeb8-ee99-11ee-b647-cb9ed24678a4. 2024-03-30T13:51:46.928 INFO:journalctl@ceph.prometheus.a.smithi181.stdout:Mar 30 13:51:46 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-prometheus-a[63597]: ts=2024-03-30T13:51:46.927Z caller=head.go:604 level=info component=tsdb msg="WAL segment loaded" segment=0 maxSegment=4 2024-03-30T13:51:47.226 INFO:journalctl@ceph.prometheus.a.smithi181.stdout:Mar 30 13:51:47 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-prometheus-a[63597]: ts=2024-03-30T13:51:47.097Z caller=head.go:604 level=info component=tsdb msg="WAL segment loaded" segment=1 maxSegment=4 2024-03-30T13:51:47.226 INFO:journalctl@ceph.prometheus.a.smithi181.stdout:Mar 30 13:51:47 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-prometheus-a[63597]: ts=2024-03-30T13:51:47.176Z caller=head.go:604 level=info component=tsdb msg="WAL segment loaded" segment=2 maxSegment=4 2024-03-30T13:51:47.226 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:51:46 smithi181 ceph-mon[25762]: pgmap v20: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 353 B/s rd, 0 op/s 2024-03-30T13:51:47.226 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:51:46 smithi181 ceph-mon[25762]: from='mgr.25057 ' entity='mgr.y' 2024-03-30T13:51:47.227 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:51:46 smithi181 ceph-mon[25762]: from='mgr.25057 ' entity='mgr.y' 2024-03-30T13:51:47.227 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:51:46 smithi181 ceph-mon[25762]: from='mgr.25057 172.21.15.99:0/1165207787' entity='mgr.y' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-03-30T13:51:47.227 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:51:46 smithi181 ceph-mon[25762]: from='mgr.25057 172.21.15.99:0/1165207787' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:51:47.227 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:51:46 smithi181 ceph-mon[25762]: from='mgr.25057 172.21.15.99:0/1165207787' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:51:47.227 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:51:46 smithi181 ceph-mon[25762]: from='mgr.25057 ' entity='mgr.y' 2024-03-30T13:51:47.335 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:51:46 smithi099 ceph-mon[24912]: pgmap v20: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 353 B/s rd, 0 op/s 2024-03-30T13:51:47.335 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:51:46 smithi099 ceph-mon[24912]: from='mgr.25057 ' entity='mgr.y' 2024-03-30T13:51:47.335 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:51:46 smithi099 ceph-mon[24912]: from='mgr.25057 ' entity='mgr.y' 2024-03-30T13:51:47.336 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:51:46 smithi099 ceph-mon[24912]: from='mgr.25057 172.21.15.99:0/1165207787' entity='mgr.y' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-03-30T13:51:47.336 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:51:46 smithi099 ceph-mon[24912]: from='mgr.25057 172.21.15.99:0/1165207787' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:51:47.336 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:51:46 smithi099 ceph-mon[24912]: from='mgr.25057 172.21.15.99:0/1165207787' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:51:47.336 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:51:46 smithi099 ceph-mon[24912]: from='mgr.25057 ' entity='mgr.y' 2024-03-30T13:51:47.336 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:51:46 smithi099 ceph-mon[29691]: pgmap v20: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 353 B/s rd, 0 op/s 2024-03-30T13:51:47.336 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:51:46 smithi099 ceph-mon[29691]: from='mgr.25057 ' entity='mgr.y' 2024-03-30T13:51:47.336 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:51:46 smithi099 ceph-mon[29691]: from='mgr.25057 ' entity='mgr.y' 2024-03-30T13:51:47.336 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:51:46 smithi099 ceph-mon[29691]: from='mgr.25057 172.21.15.99:0/1165207787' entity='mgr.y' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-03-30T13:51:47.336 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:51:46 smithi099 ceph-mon[29691]: from='mgr.25057 172.21.15.99:0/1165207787' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:51:47.336 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:51:46 smithi099 ceph-mon[29691]: from='mgr.25057 172.21.15.99:0/1165207787' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:51:47.336 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:51:46 smithi099 ceph-mon[29691]: from='mgr.25057 ' entity='mgr.y' 2024-03-30T13:51:47.504 INFO:journalctl@ceph.prometheus.a.smithi181.stdout:Mar 30 13:51:47 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-prometheus-a[63597]: ts=2024-03-30T13:51:47.226Z caller=head.go:604 level=info component=tsdb msg="WAL segment loaded" segment=3 maxSegment=4 2024-03-30T13:51:47.505 INFO:journalctl@ceph.prometheus.a.smithi181.stdout:Mar 30 13:51:47 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-prometheus-a[63597]: ts=2024-03-30T13:51:47.227Z caller=head.go:604 level=info component=tsdb msg="WAL segment loaded" segment=4 maxSegment=4 2024-03-30T13:51:47.505 INFO:journalctl@ceph.prometheus.a.smithi181.stdout:Mar 30 13:51:47 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-prometheus-a[63597]: ts=2024-03-30T13:51:47.227Z caller=head.go:610 level=info component=tsdb msg="WAL replay completed" checkpoint_replay_duration=36.372µs wal_replay_duration=526.940949ms total_replay_duration=526.991147ms 2024-03-30T13:51:47.505 INFO:journalctl@ceph.prometheus.a.smithi181.stdout:Mar 30 13:51:47 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-prometheus-a[63597]: ts=2024-03-30T13:51:47.230Z caller=main.go:944 level=info fs_type=XFS_SUPER_MAGIC 2024-03-30T13:51:47.505 INFO:journalctl@ceph.prometheus.a.smithi181.stdout:Mar 30 13:51:47 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-prometheus-a[63597]: ts=2024-03-30T13:51:47.230Z caller=main.go:947 level=info msg="TSDB started" 2024-03-30T13:51:47.505 INFO:journalctl@ceph.prometheus.a.smithi181.stdout:Mar 30 13:51:47 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-prometheus-a[63597]: ts=2024-03-30T13:51:47.230Z caller=main.go:1128 level=info msg="Loading configuration file" filename=/etc/prometheus/prometheus.yml 2024-03-30T13:51:47.505 INFO:journalctl@ceph.prometheus.a.smithi181.stdout:Mar 30 13:51:47 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-prometheus-a[63597]: ts=2024-03-30T13:51:47.250Z caller=main.go:1165 level=info msg="Completed loading of configuration file" filename=/etc/prometheus/prometheus.yml totalDuration=19.25221ms db_storage=1.009µs remote_storage=1.151µs web_handler=436ns query_engine=745ns scrape=340.503µs scrape_sd=76.598µs notify=19.423µs notify_sd=23.716µs rules=18.567503ms 2024-03-30T13:51:47.505 INFO:journalctl@ceph.prometheus.a.smithi181.stdout:Mar 30 13:51:47 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-prometheus-a[63597]: ts=2024-03-30T13:51:47.250Z caller=main.go:896 level=info msg="Server is ready to receive web requests." 2024-03-30T13:51:48.238 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:51:47 smithi181 ceph-mon[25762]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-03-30T13:51:48.238 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:51:47 smithi181 ceph-mon[25762]: pgmap v21: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 321 B/s rd, 0 op/s 2024-03-30T13:51:48.238 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:51:47 smithi181 ceph-mon[25762]: pgmap v22: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 321 B/s rd, 0 op/s 2024-03-30T13:51:48.238 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:51:47 smithi181 ceph-mon[25762]: Reconfiguring iscsi.foo.smithi099.qyjuvr (dependencies changed)... 2024-03-30T13:51:48.239 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:51:47 smithi181 ceph-mon[25762]: from='mgr.25057 172.21.15.99:0/1165207787' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.iscsi.foo.smithi099.qyjuvr", "caps": ["mon", "profile rbd, allow command \"osd blocklist\", allow command \"config-key get\" with \"key\" prefix \"iscsi/\"", "mgr", "allow command \"service status\"", "osd", "allow rwx"]}]: dispatch 2024-03-30T13:51:48.239 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:51:47 smithi181 ceph-mon[25762]: from='mgr.25057 ' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.iscsi.foo.smithi099.qyjuvr", "caps": ["mon", "profile rbd, allow command \"osd blocklist\", allow command \"config-key get\" with \"key\" prefix \"iscsi/\"", "mgr", "allow command \"service status\"", "osd", "allow rwx"]}]: dispatch 2024-03-30T13:51:48.239 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:51:47 smithi181 ceph-mon[25762]: from='mgr.25057 172.21.15.99:0/1165207787' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:51:48.239 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:51:47 smithi181 ceph-mon[25762]: Reconfiguring daemon iscsi.foo.smithi099.qyjuvr on smithi099 2024-03-30T13:51:48.335 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:51:47 smithi099 ceph-mon[29691]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-03-30T13:51:48.335 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:51:47 smithi099 ceph-mon[29691]: pgmap v21: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 321 B/s rd, 0 op/s 2024-03-30T13:51:48.336 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:51:47 smithi099 ceph-mon[29691]: pgmap v22: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 321 B/s rd, 0 op/s 2024-03-30T13:51:48.336 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:51:47 smithi099 ceph-mon[29691]: Reconfiguring iscsi.foo.smithi099.qyjuvr (dependencies changed)... 2024-03-30T13:51:48.336 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:51:47 smithi099 ceph-mon[29691]: from='mgr.25057 172.21.15.99:0/1165207787' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.iscsi.foo.smithi099.qyjuvr", "caps": ["mon", "profile rbd, allow command \"osd blocklist\", allow command \"config-key get\" with \"key\" prefix \"iscsi/\"", "mgr", "allow command \"service status\"", "osd", "allow rwx"]}]: dispatch 2024-03-30T13:51:48.336 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:51:47 smithi099 ceph-mon[29691]: from='mgr.25057 ' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.iscsi.foo.smithi099.qyjuvr", "caps": ["mon", "profile rbd, allow command \"osd blocklist\", allow command \"config-key get\" with \"key\" prefix \"iscsi/\"", "mgr", "allow command \"service status\"", "osd", "allow rwx"]}]: dispatch 2024-03-30T13:51:48.336 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:51:47 smithi099 ceph-mon[29691]: from='mgr.25057 172.21.15.99:0/1165207787' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:51:48.336 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:51:47 smithi099 ceph-mon[29691]: Reconfiguring daemon iscsi.foo.smithi099.qyjuvr on smithi099 2024-03-30T13:51:48.336 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:51:47 smithi099 ceph-mon[24912]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-03-30T13:51:48.336 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:51:47 smithi099 ceph-mon[24912]: pgmap v21: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 321 B/s rd, 0 op/s 2024-03-30T13:51:48.336 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:51:47 smithi099 ceph-mon[24912]: pgmap v22: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 321 B/s rd, 0 op/s 2024-03-30T13:51:48.336 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:51:47 smithi099 ceph-mon[24912]: Reconfiguring iscsi.foo.smithi099.qyjuvr (dependencies changed)... 2024-03-30T13:51:48.336 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:51:47 smithi099 ceph-mon[24912]: from='mgr.25057 172.21.15.99:0/1165207787' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.iscsi.foo.smithi099.qyjuvr", "caps": ["mon", "profile rbd, allow command \"osd blocklist\", allow command \"config-key get\" with \"key\" prefix \"iscsi/\"", "mgr", "allow command \"service status\"", "osd", "allow rwx"]}]: dispatch 2024-03-30T13:51:48.336 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:51:47 smithi099 ceph-mon[24912]: from='mgr.25057 ' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.iscsi.foo.smithi099.qyjuvr", "caps": ["mon", "profile rbd, allow command \"osd blocklist\", allow command \"config-key get\" with \"key\" prefix \"iscsi/\"", "mgr", "allow command \"service status\"", "osd", "allow rwx"]}]: dispatch 2024-03-30T13:51:48.336 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:51:47 smithi099 ceph-mon[24912]: from='mgr.25057 172.21.15.99:0/1165207787' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:51:48.337 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:51:47 smithi099 ceph-mon[24912]: Reconfiguring daemon iscsi.foo.smithi099.qyjuvr on smithi099 2024-03-30T13:51:49.085 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:51:48 smithi099 ceph-mon[24912]: from='mgr.25057 172.21.15.99:0/1165207787' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T13:51:49.086 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:51:48 smithi099 ceph-mon[29691]: from='mgr.25057 172.21.15.99:0/1165207787' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T13:51:49.254 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:51:48 smithi181 ceph-mon[25762]: from='mgr.25057 172.21.15.99:0/1165207787' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T13:51:50.071 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:51:49 smithi099 ceph-mon[24912]: pgmap v23: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 321 B/s rd, 0 op/s 2024-03-30T13:51:50.071 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:51:49 smithi099 ceph-mon[24912]: from='mgr.25057 ' entity='mgr.y' 2024-03-30T13:51:50.071 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:51:49 smithi099 ceph-mon[24912]: from='mgr.25057 ' entity='mgr.y' 2024-03-30T13:51:50.071 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:51:49 smithi099 ceph-mon[24912]: from='mgr.25057 172.21.15.99:0/1165207787' entity='mgr.y' cmd=[{"prefix": "dashboard iscsi-gateway-list"}]: dispatch 2024-03-30T13:51:50.071 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:51:49 smithi099 ceph-mon[24912]: from='mgr.25057 172.21.15.99:0/1165207787' entity='mgr.y' cmd=[{"prefix": "dashboard set-iscsi-api-ssl-verification", "value": "true"}]: dispatch 2024-03-30T13:51:50.071 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:51:49 smithi099 ceph-mon[24912]: from='mgr.25057 172.21.15.99:0/1165207787' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:51:50.071 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:51:49 smithi099 ceph-mon[24912]: from='mgr.25057 172.21.15.99:0/1165207787' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:51:50.071 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:51:49 smithi099 ceph-mon[24912]: from='mgr.25057 ' entity='mgr.y' 2024-03-30T13:51:50.071 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:51:49 smithi099 ceph-mon[29691]: pgmap v23: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 321 B/s rd, 0 op/s 2024-03-30T13:51:50.072 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:51:49 smithi099 ceph-mon[29691]: from='mgr.25057 ' entity='mgr.y' 2024-03-30T13:51:50.072 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:51:49 smithi099 ceph-mon[29691]: from='mgr.25057 ' entity='mgr.y' 2024-03-30T13:51:50.072 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:51:49 smithi099 ceph-mon[29691]: from='mgr.25057 172.21.15.99:0/1165207787' entity='mgr.y' cmd=[{"prefix": "dashboard iscsi-gateway-list"}]: dispatch 2024-03-30T13:51:50.072 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:51:49 smithi099 ceph-mon[29691]: from='mgr.25057 172.21.15.99:0/1165207787' entity='mgr.y' cmd=[{"prefix": "dashboard set-iscsi-api-ssl-verification", "value": "true"}]: dispatch 2024-03-30T13:51:50.072 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:51:49 smithi099 ceph-mon[29691]: from='mgr.25057 172.21.15.99:0/1165207787' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:51:50.072 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:51:49 smithi099 ceph-mon[29691]: from='mgr.25057 172.21.15.99:0/1165207787' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:51:50.072 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:51:49 smithi099 ceph-mon[29691]: from='mgr.25057 ' entity='mgr.y' 2024-03-30T13:51:50.254 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:51:49 smithi181 ceph-mon[25762]: pgmap v23: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 321 B/s rd, 0 op/s 2024-03-30T13:51:50.254 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:51:49 smithi181 ceph-mon[25762]: from='mgr.25057 ' entity='mgr.y' 2024-03-30T13:51:50.255 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:51:49 smithi181 ceph-mon[25762]: from='mgr.25057 ' entity='mgr.y' 2024-03-30T13:51:50.255 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:51:49 smithi181 ceph-mon[25762]: from='mgr.25057 172.21.15.99:0/1165207787' entity='mgr.y' cmd=[{"prefix": "dashboard iscsi-gateway-list"}]: dispatch 2024-03-30T13:51:50.255 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:51:49 smithi181 ceph-mon[25762]: from='mgr.25057 172.21.15.99:0/1165207787' entity='mgr.y' cmd=[{"prefix": "dashboard set-iscsi-api-ssl-verification", "value": "true"}]: dispatch 2024-03-30T13:51:50.255 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:51:49 smithi181 ceph-mon[25762]: from='mgr.25057 172.21.15.99:0/1165207787' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:51:50.255 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:51:49 smithi181 ceph-mon[25762]: from='mgr.25057 172.21.15.99:0/1165207787' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:51:50.255 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:51:49 smithi181 ceph-mon[25762]: from='mgr.25057 ' entity='mgr.y' 2024-03-30T13:51:51.254 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:51:50 smithi181 ceph-mon[25762]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard iscsi-gateway-list"}]: dispatch 2024-03-30T13:51:51.255 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:51:50 smithi181 ceph-mon[25762]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard set-iscsi-api-ssl-verification", "value": "true"}]: dispatch 2024-03-30T13:51:51.255 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:51:50 smithi181 ceph-mon[25762]: pgmap v24: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 357 B/s rd, 0 op/s 2024-03-30T13:51:51.255 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:51:50 smithi181 ceph-mon[25762]: pgmap v25: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 356 B/s rd, 0 op/s 2024-03-30T13:51:51.255 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:51:50 smithi181 ceph-mon[25762]: from='client.? 172.21.15.99:0/2745153152' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-03-30T13:51:51.335 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:51:50 smithi099 ceph-mon[24912]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard iscsi-gateway-list"}]: dispatch 2024-03-30T13:51:51.335 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:51:50 smithi099 ceph-mon[24912]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard set-iscsi-api-ssl-verification", "value": "true"}]: dispatch 2024-03-30T13:51:51.335 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:51:50 smithi099 ceph-mon[24912]: pgmap v24: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 357 B/s rd, 0 op/s 2024-03-30T13:51:51.335 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:51:50 smithi099 ceph-mon[24912]: pgmap v25: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 356 B/s rd, 0 op/s 2024-03-30T13:51:51.336 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:51:50 smithi099 ceph-mon[24912]: from='client.? 172.21.15.99:0/2745153152' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-03-30T13:51:51.336 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:51:50 smithi099 ceph-mon[29691]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard iscsi-gateway-list"}]: dispatch 2024-03-30T13:51:51.336 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:51:50 smithi099 ceph-mon[29691]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard set-iscsi-api-ssl-verification", "value": "true"}]: dispatch 2024-03-30T13:51:51.336 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:51:50 smithi099 ceph-mon[29691]: pgmap v24: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 357 B/s rd, 0 op/s 2024-03-30T13:51:51.336 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:51:50 smithi099 ceph-mon[29691]: pgmap v25: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 356 B/s rd, 0 op/s 2024-03-30T13:51:51.336 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:51:50 smithi099 ceph-mon[29691]: from='client.? 172.21.15.99:0/2745153152' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-03-30T13:51:53.259 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:51:52 smithi181 ceph-mon[25762]: pgmap v26: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:51:53.339 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:51:52 smithi099 ceph-mon[24912]: pgmap v26: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:51:53.339 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:51:52 smithi099 ceph-mon[29691]: pgmap v26: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:51:55.081 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:51:54 smithi099 ceph-mon[24912]: pgmap v27: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:51:55.082 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:51:54 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[71049]: ::ffff:172.21.15.181 - - [30/Mar/2024:13:51:54] "GET /metrics HTTP/1.1" 200 37984 "" "Prometheus/2.33.4" 2024-03-30T13:51:55.082 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:51:54 smithi099 ceph-mon[29691]: pgmap v27: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:51:55.254 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:51:54 smithi181 ceph-mon[25762]: pgmap v27: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:51:57.244 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:51:56 smithi181 ceph-mon[25762]: pgmap v28: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 582 B/s rd, 0 op/s 2024-03-30T13:51:57.250 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:51:56 smithi099 ceph-mon[24912]: pgmap v28: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 582 B/s rd, 0 op/s 2024-03-30T13:51:57.250 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:51:56 smithi099 ceph-mon[29691]: pgmap v28: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 582 B/s rd, 0 op/s 2024-03-30T13:51:59.138 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:51:58 smithi181 ceph-mon[25762]: pgmap v29: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 582 B/s rd, 0 op/s 2024-03-30T13:51:59.254 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:51:58 smithi099 ceph-mon[24912]: pgmap v29: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 582 B/s rd, 0 op/s 2024-03-30T13:51:59.254 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:51:58 smithi099 ceph-mon[29691]: pgmap v29: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 582 B/s rd, 0 op/s 2024-03-30T13:52:00.504 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:52:00 smithi181 ceph-mon[25762]: from='mgr.25057 ' entity='mgr.y' 2024-03-30T13:52:00.504 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:52:00 smithi181 ceph-mon[25762]: from='mgr.25057 ' entity='mgr.y' 2024-03-30T13:52:00.504 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:52:00 smithi181 ceph-mon[25762]: pgmap v30: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 1.0 KiB/s rd, 1 op/s 2024-03-30T13:52:00.504 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:52:00 smithi181 ceph-mon[25762]: pgmap v31: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 1.0 KiB/s rd, 1 op/s 2024-03-30T13:52:00.505 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:52:00 smithi181 ceph-mon[25762]: from='mgr.25057 ' entity='mgr.y' 2024-03-30T13:52:00.505 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:52:00 smithi181 ceph-mon[25762]: from='client.15237 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T13:52:00.585 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:52:00 smithi099 ceph-mon[24912]: from='mgr.25057 ' entity='mgr.y' 2024-03-30T13:52:00.585 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:52:00 smithi099 ceph-mon[24912]: from='mgr.25057 ' entity='mgr.y' 2024-03-30T13:52:00.585 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:52:00 smithi099 ceph-mon[24912]: pgmap v30: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 1.0 KiB/s rd, 1 op/s 2024-03-30T13:52:00.585 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:52:00 smithi099 ceph-mon[24912]: pgmap v31: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 1.0 KiB/s rd, 1 op/s 2024-03-30T13:52:00.585 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:52:00 smithi099 ceph-mon[24912]: from='mgr.25057 ' entity='mgr.y' 2024-03-30T13:52:00.586 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:52:00 smithi099 ceph-mon[24912]: from='client.15237 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T13:52:00.586 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:52:00 smithi099 ceph-mon[29691]: from='mgr.25057 ' entity='mgr.y' 2024-03-30T13:52:00.586 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:52:00 smithi099 ceph-mon[29691]: from='mgr.25057 ' entity='mgr.y' 2024-03-30T13:52:00.586 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:52:00 smithi099 ceph-mon[29691]: pgmap v30: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 1.0 KiB/s rd, 1 op/s 2024-03-30T13:52:00.586 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:52:00 smithi099 ceph-mon[29691]: pgmap v31: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 1.0 KiB/s rd, 1 op/s 2024-03-30T13:52:00.586 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:52:00 smithi099 ceph-mon[29691]: from='mgr.25057 ' entity='mgr.y' 2024-03-30T13:52:00.586 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:52:00 smithi099 ceph-mon[29691]: from='client.15237 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T13:52:01.836 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:52:01 smithi099 ceph-mon[24912]: from='mgr.25057 ' entity='mgr.y' 2024-03-30T13:52:01.836 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:52:01 smithi099 ceph-mon[24912]: from='mgr.25057 ' entity='mgr.y' 2024-03-30T13:52:01.836 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:52:01 smithi099 ceph-mon[24912]: pgmap v32: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-03-30T13:52:01.836 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:52:01 smithi099 ceph-mon[24912]: from='mgr.25057 ' entity='mgr.y' 2024-03-30T13:52:01.836 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:52:01 smithi099 ceph-mon[24912]: from='mgr.25057 ' entity='mgr.y' 2024-03-30T13:52:01.836 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:52:01 smithi099 ceph-mon[24912]: from='mgr.25057 ' entity='mgr.y' 2024-03-30T13:52:01.836 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:52:01 smithi099 ceph-mon[24912]: from='mgr.25057 ' entity='mgr.y' 2024-03-30T13:52:01.836 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:52:01 smithi099 ceph-mon[29691]: from='mgr.25057 ' entity='mgr.y' 2024-03-30T13:52:01.837 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:52:01 smithi099 ceph-mon[29691]: from='mgr.25057 ' entity='mgr.y' 2024-03-30T13:52:01.837 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:52:01 smithi099 ceph-mon[29691]: pgmap v32: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-03-30T13:52:01.837 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:52:01 smithi099 ceph-mon[29691]: from='mgr.25057 ' entity='mgr.y' 2024-03-30T13:52:01.837 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:52:01 smithi099 ceph-mon[29691]: from='mgr.25057 ' entity='mgr.y' 2024-03-30T13:52:01.837 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:52:01 smithi099 ceph-mon[29691]: from='mgr.25057 ' entity='mgr.y' 2024-03-30T13:52:01.837 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:52:01 smithi099 ceph-mon[29691]: from='mgr.25057 ' entity='mgr.y' 2024-03-30T13:52:01.944 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:52:01 smithi181 ceph-mon[25762]: from='mgr.25057 ' entity='mgr.y' 2024-03-30T13:52:01.944 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:52:01 smithi181 ceph-mon[25762]: from='mgr.25057 ' entity='mgr.y' 2024-03-30T13:52:01.944 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:52:01 smithi181 ceph-mon[25762]: pgmap v32: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-03-30T13:52:01.944 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:52:01 smithi181 ceph-mon[25762]: from='mgr.25057 ' entity='mgr.y' 2024-03-30T13:52:01.944 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:52:01 smithi181 ceph-mon[25762]: from='mgr.25057 ' entity='mgr.y' 2024-03-30T13:52:01.944 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:52:01 smithi181 ceph-mon[25762]: from='mgr.25057 ' entity='mgr.y' 2024-03-30T13:52:01.944 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:52:01 smithi181 ceph-mon[25762]: from='mgr.25057 ' entity='mgr.y' 2024-03-30T13:52:02.835 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:52:02 smithi099 ceph-mon[24912]: pgmap v33: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-03-30T13:52:02.835 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:52:02 smithi099 ceph-mon[24912]: pgmap v34: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 874 B/s rd, 0 op/s 2024-03-30T13:52:02.835 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:52:02 smithi099 ceph-mon[29691]: pgmap v33: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-03-30T13:52:02.835 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:52:02 smithi099 ceph-mon[29691]: pgmap v34: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 874 B/s rd, 0 op/s 2024-03-30T13:52:03.004 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:52:02 smithi181 ceph-mon[25762]: pgmap v33: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-03-30T13:52:03.004 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:52:02 smithi181 ceph-mon[25762]: pgmap v34: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 874 B/s rd, 0 op/s 2024-03-30T13:52:04.004 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:52:03 smithi181 ceph-mon[25762]: from='mgr.25057 172.21.15.99:0/1165207787' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T13:52:04.085 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:52:03 smithi099 ceph-mon[24912]: from='mgr.25057 172.21.15.99:0/1165207787' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T13:52:04.085 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:52:03 smithi099 ceph-mon[29691]: from='mgr.25057 172.21.15.99:0/1165207787' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T13:52:05.004 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:52:04 smithi181 ceph-mon[25762]: pgmap v35: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 874 B/s rd, 0 op/s 2024-03-30T13:52:05.085 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:52:04 smithi099 ceph-mon[24912]: pgmap v35: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 874 B/s rd, 0 op/s 2024-03-30T13:52:05.085 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:52:04 smithi099 ceph-mon[29691]: pgmap v35: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 874 B/s rd, 0 op/s 2024-03-30T13:52:05.086 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:52:04 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[71049]: ::ffff:172.21.15.181 - - [30/Mar/2024:13:52:04] "GET /metrics HTTP/1.1" 200 37981 "" "Prometheus/2.33.4" 2024-03-30T13:52:07.085 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:52:06 smithi099 ceph-mon[24912]: pgmap v36: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 820 B/s rd, 0 op/s 2024-03-30T13:52:07.085 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:52:06 smithi099 ceph-mon[29691]: pgmap v36: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 820 B/s rd, 0 op/s 2024-03-30T13:52:07.254 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:52:06 smithi181 ceph-mon[25762]: pgmap v36: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 820 B/s rd, 0 op/s 2024-03-30T13:52:09.085 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:52:08 smithi099 ceph-mon[24912]: pgmap v37: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 621 B/s rd, 0 op/s 2024-03-30T13:52:09.085 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:52:08 smithi099 ceph-mon[29691]: pgmap v37: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 621 B/s rd, 0 op/s 2024-03-30T13:52:09.254 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:52:08 smithi181 ceph-mon[25762]: pgmap v37: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 621 B/s rd, 0 op/s 2024-03-30T13:52:11.085 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:52:10 smithi099 ceph-mon[24912]: pgmap v38: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-03-30T13:52:11.085 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:52:10 smithi099 ceph-mon[24912]: from='client.15237 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T13:52:11.085 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:52:10 smithi099 ceph-mon[29691]: pgmap v38: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-03-30T13:52:11.085 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:52:10 smithi099 ceph-mon[29691]: from='client.15237 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T13:52:11.254 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:52:10 smithi181 ceph-mon[25762]: pgmap v38: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-03-30T13:52:11.254 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:52:10 smithi181 ceph-mon[25762]: from='client.15237 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T13:52:13.004 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:52:12 smithi181 ceph-mon[25762]: pgmap v39: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-03-30T13:52:13.085 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:52:12 smithi099 ceph-mon[24912]: pgmap v39: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-03-30T13:52:13.085 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:52:12 smithi099 ceph-mon[29691]: pgmap v39: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-03-30T13:52:15.085 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:52:14 smithi099 ceph-mon[24912]: pgmap v40: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T13:52:15.085 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:52:14 smithi099 ceph-mon[29691]: pgmap v40: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T13:52:15.085 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:52:14 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[71049]: ::ffff:172.21.15.181 - - [30/Mar/2024:13:52:14] "GET /metrics HTTP/1.1" 200 37981 "" "Prometheus/2.33.4" 2024-03-30T13:52:15.254 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:52:14 smithi181 ceph-mon[25762]: pgmap v40: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T13:52:17.056 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:52:16 smithi181 ceph-mon[25762]: pgmap v41: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T13:52:17.085 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:52:16 smithi099 ceph-mon[24912]: pgmap v41: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T13:52:17.085 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:52:16 smithi099 ceph-mon[29691]: pgmap v41: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T13:52:18.754 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:52:18 smithi181 ceph-mon[25762]: from='mgr.25057 ' entity='mgr.y' 2024-03-30T13:52:18.754 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:52:18 smithi181 ceph-mon[25762]: from='mgr.25057 ' entity='mgr.y' 2024-03-30T13:52:18.754 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:52:18 smithi181 ceph-mon[25762]: pgmap v42: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 854 B/s rd, 0 op/s 2024-03-30T13:52:18.754 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:52:18 smithi181 ceph-mon[25762]: pgmap v43: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 1.0 KiB/s rd, 1 op/s 2024-03-30T13:52:18.754 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:52:18 smithi181 ceph-mon[25762]: from='mgr.25057 ' entity='mgr.y' 2024-03-30T13:52:18.754 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:52:18 smithi181 ceph-mon[25762]: from='mgr.25057 172.21.15.99:0/1165207787' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T13:52:18.813 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:52:18 smithi099 ceph-mon[24912]: from='mgr.25057 ' entity='mgr.y' 2024-03-30T13:52:18.813 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:52:18 smithi099 ceph-mon[24912]: from='mgr.25057 ' entity='mgr.y' 2024-03-30T13:52:18.813 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:52:18 smithi099 ceph-mon[24912]: pgmap v42: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 854 B/s rd, 0 op/s 2024-03-30T13:52:18.813 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:52:18 smithi099 ceph-mon[24912]: pgmap v43: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 1.0 KiB/s rd, 1 op/s 2024-03-30T13:52:18.813 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:52:18 smithi099 ceph-mon[24912]: from='mgr.25057 ' entity='mgr.y' 2024-03-30T13:52:18.814 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:52:18 smithi099 ceph-mon[24912]: from='mgr.25057 172.21.15.99:0/1165207787' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T13:52:18.814 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:52:18 smithi099 ceph-mon[29691]: from='mgr.25057 ' entity='mgr.y' 2024-03-30T13:52:18.814 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:52:18 smithi099 ceph-mon[29691]: from='mgr.25057 ' entity='mgr.y' 2024-03-30T13:52:18.814 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:52:18 smithi099 ceph-mon[29691]: pgmap v42: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 854 B/s rd, 0 op/s 2024-03-30T13:52:18.814 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:52:18 smithi099 ceph-mon[29691]: pgmap v43: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 1.0 KiB/s rd, 1 op/s 2024-03-30T13:52:18.814 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:52:18 smithi099 ceph-mon[29691]: from='mgr.25057 ' entity='mgr.y' 2024-03-30T13:52:18.814 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:52:18 smithi099 ceph-mon[29691]: from='mgr.25057 172.21.15.99:0/1165207787' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T13:52:20.954 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:52:20 smithi181 ceph-mon[25762]: pgmap v44: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 1.0 KiB/s rd, 1 op/s 2024-03-30T13:52:20.954 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:52:20 smithi181 ceph-mon[25762]: from='mgr.25057 ' entity='mgr.y' 2024-03-30T13:52:20.955 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:52:20 smithi181 ceph-mon[25762]: from='mgr.25057 ' entity='mgr.y' 2024-03-30T13:52:20.955 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:52:20 smithi181 ceph-mon[25762]: pgmap v45: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T13:52:20.955 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:52:20 smithi181 ceph-mon[25762]: pgmap v46: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-03-30T13:52:20.955 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:52:20 smithi181 ceph-mon[25762]: from='mgr.25057 ' entity='mgr.y' 2024-03-30T13:52:20.955 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:52:20 smithi181 ceph-mon[25762]: from='client.15237 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T13:52:21.085 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:52:20 smithi099 ceph-mon[24912]: pgmap v44: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 1.0 KiB/s rd, 1 op/s 2024-03-30T13:52:21.085 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:52:20 smithi099 ceph-mon[24912]: from='mgr.25057 ' entity='mgr.y' 2024-03-30T13:52:21.086 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:52:20 smithi099 ceph-mon[24912]: from='mgr.25057 ' entity='mgr.y' 2024-03-30T13:52:21.086 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:52:20 smithi099 ceph-mon[24912]: pgmap v45: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T13:52:21.086 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:52:20 smithi099 ceph-mon[24912]: pgmap v46: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-03-30T13:52:21.086 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:52:20 smithi099 ceph-mon[24912]: from='mgr.25057 ' entity='mgr.y' 2024-03-30T13:52:21.086 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:52:20 smithi099 ceph-mon[24912]: from='client.15237 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T13:52:21.086 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:52:20 smithi099 ceph-mon[29691]: pgmap v44: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 1.0 KiB/s rd, 1 op/s 2024-03-30T13:52:21.086 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:52:20 smithi099 ceph-mon[29691]: from='mgr.25057 ' entity='mgr.y' 2024-03-30T13:52:21.086 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:52:20 smithi099 ceph-mon[29691]: from='mgr.25057 ' entity='mgr.y' 2024-03-30T13:52:21.086 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:52:20 smithi099 ceph-mon[29691]: pgmap v45: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T13:52:21.086 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:52:20 smithi099 ceph-mon[29691]: pgmap v46: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-03-30T13:52:21.087 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:52:20 smithi099 ceph-mon[29691]: from='mgr.25057 ' entity='mgr.y' 2024-03-30T13:52:21.087 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:52:20 smithi099 ceph-mon[29691]: from='client.15237 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T13:52:23.004 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:52:22 smithi181 ceph-mon[25762]: pgmap v47: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 825 B/s rd, 0 op/s 2024-03-30T13:52:23.085 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:52:22 smithi099 ceph-mon[24912]: pgmap v47: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 825 B/s rd, 0 op/s 2024-03-30T13:52:23.085 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:52:22 smithi099 ceph-mon[29691]: pgmap v47: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 825 B/s rd, 0 op/s 2024-03-30T13:52:25.085 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:52:24 smithi099 ceph-mon[24912]: pgmap v48: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 822 B/s rd, 0 op/s 2024-03-30T13:52:25.085 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:52:24 smithi099 ceph-mon[29691]: pgmap v48: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 822 B/s rd, 0 op/s 2024-03-30T13:52:25.085 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:52:24 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[71049]: ::ffff:172.21.15.181 - - [30/Mar/2024:13:52:24] "GET /metrics HTTP/1.1" 200 37982 "" "Prometheus/2.33.4" 2024-03-30T13:52:25.254 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:52:24 smithi181 ceph-mon[25762]: pgmap v48: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 822 B/s rd, 0 op/s 2024-03-30T13:52:27.085 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:52:26 smithi099 ceph-mon[24912]: pgmap v49: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T13:52:27.085 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:52:26 smithi099 ceph-mon[29691]: pgmap v49: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T13:52:27.254 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:52:26 smithi181 ceph-mon[25762]: pgmap v49: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T13:52:29.085 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:52:28 smithi099 ceph-mon[24912]: pgmap v50: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 622 B/s rd, 0 op/s 2024-03-30T13:52:29.086 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:52:28 smithi099 ceph-mon[29691]: pgmap v50: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 622 B/s rd, 0 op/s 2024-03-30T13:52:29.254 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:52:28 smithi181 ceph-mon[25762]: pgmap v50: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 622 B/s rd, 0 op/s 2024-03-30T13:52:31.085 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:52:30 smithi099 ceph-mon[24912]: pgmap v51: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-03-30T13:52:31.085 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:52:30 smithi099 ceph-mon[24912]: from='client.15237 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T13:52:31.085 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:52:30 smithi099 ceph-mon[29691]: pgmap v51: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-03-30T13:52:31.085 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:52:30 smithi099 ceph-mon[29691]: from='client.15237 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T13:52:31.254 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:52:30 smithi181 ceph-mon[25762]: pgmap v51: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-03-30T13:52:31.254 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:52:30 smithi181 ceph-mon[25762]: from='client.15237 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T13:52:33.085 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:52:32 smithi099 ceph-mon[24912]: pgmap v52: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T13:52:33.085 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:52:32 smithi099 ceph-mon[29691]: pgmap v52: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T13:52:33.254 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:52:32 smithi181 ceph-mon[25762]: pgmap v52: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T13:52:34.085 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:52:33 smithi099 ceph-mon[24912]: from='mgr.25057 172.21.15.99:0/1165207787' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T13:52:34.085 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:52:33 smithi099 ceph-mon[29691]: from='mgr.25057 172.21.15.99:0/1165207787' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T13:52:34.254 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:52:33 smithi181 ceph-mon[25762]: from='mgr.25057 172.21.15.99:0/1165207787' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T13:52:35.085 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:52:34 smithi099 ceph-mon[24912]: pgmap v53: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T13:52:35.085 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:52:34 smithi099 ceph-mon[29691]: pgmap v53: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T13:52:35.085 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:52:34 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[71049]: ::ffff:172.21.15.181 - - [30/Mar/2024:13:52:34] "GET /metrics HTTP/1.1" 200 37977 "" "Prometheus/2.33.4" 2024-03-30T13:52:35.254 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:52:34 smithi181 ceph-mon[25762]: pgmap v53: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T13:52:37.085 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:52:36 smithi099 ceph-mon[24912]: pgmap v54: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T13:52:37.085 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:52:36 smithi099 ceph-mon[29691]: pgmap v54: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T13:52:37.254 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:52:36 smithi181 ceph-mon[25762]: pgmap v54: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T13:52:38.970 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:52:38 smithi099 ceph-mon[24912]: from='mgr.25057 ' entity='mgr.y' 2024-03-30T13:52:38.970 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:52:38 smithi099 ceph-mon[24912]: from='mgr.25057 ' entity='mgr.y' 2024-03-30T13:52:38.970 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:52:38 smithi099 ceph-mon[24912]: pgmap v55: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 859 B/s rd, 0 op/s 2024-03-30T13:52:38.970 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:52:38 smithi099 ceph-mon[24912]: pgmap v56: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 1.0 KiB/s rd, 1 op/s 2024-03-30T13:52:38.970 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:52:38 smithi099 ceph-mon[24912]: from='mgr.25057 ' entity='mgr.y' 2024-03-30T13:52:38.971 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:52:38 smithi099 ceph-mon[29691]: from='mgr.25057 ' entity='mgr.y' 2024-03-30T13:52:38.971 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:52:38 smithi099 ceph-mon[29691]: from='mgr.25057 ' entity='mgr.y' 2024-03-30T13:52:38.971 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:52:38 smithi099 ceph-mon[29691]: pgmap v55: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 859 B/s rd, 0 op/s 2024-03-30T13:52:38.971 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:52:38 smithi099 ceph-mon[29691]: pgmap v56: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 1.0 KiB/s rd, 1 op/s 2024-03-30T13:52:38.971 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:52:38 smithi099 ceph-mon[29691]: from='mgr.25057 ' entity='mgr.y' 2024-03-30T13:52:39.003 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:52:38 smithi181 ceph-mon[25762]: from='mgr.25057 ' entity='mgr.y' 2024-03-30T13:52:39.003 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:52:38 smithi181 ceph-mon[25762]: from='mgr.25057 ' entity='mgr.y' 2024-03-30T13:52:39.004 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:52:38 smithi181 ceph-mon[25762]: pgmap v55: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 859 B/s rd, 0 op/s 2024-03-30T13:52:39.004 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:52:38 smithi181 ceph-mon[25762]: pgmap v56: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 1.0 KiB/s rd, 1 op/s 2024-03-30T13:52:39.004 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:52:38 smithi181 ceph-mon[25762]: from='mgr.25057 ' entity='mgr.y' 2024-03-30T13:52:41.069 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:52:40 smithi181 ceph-mon[25762]: pgmap v57: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 1.0 KiB/s rd, 1 op/s 2024-03-30T13:52:41.069 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:52:40 smithi181 ceph-mon[25762]: from='client.15237 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T13:52:41.069 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:52:40 smithi181 ceph-mon[25762]: from='mgr.25057 ' entity='mgr.y' 2024-03-30T13:52:41.069 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:52:40 smithi181 ceph-mon[25762]: from='mgr.25057 ' entity='mgr.y' 2024-03-30T13:52:41.069 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:52:40 smithi181 ceph-mon[25762]: pgmap v58: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T13:52:41.069 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:52:40 smithi181 ceph-mon[25762]: pgmap v59: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-03-30T13:52:41.069 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:52:40 smithi181 ceph-mon[25762]: from='mgr.25057 ' entity='mgr.y' 2024-03-30T13:52:41.085 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:52:40 smithi099 ceph-mon[24912]: pgmap v57: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 1.0 KiB/s rd, 1 op/s 2024-03-30T13:52:41.085 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:52:40 smithi099 ceph-mon[24912]: from='client.15237 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T13:52:41.085 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:52:40 smithi099 ceph-mon[24912]: from='mgr.25057 ' entity='mgr.y' 2024-03-30T13:52:41.085 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:52:40 smithi099 ceph-mon[24912]: from='mgr.25057 ' entity='mgr.y' 2024-03-30T13:52:41.085 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:52:40 smithi099 ceph-mon[24912]: pgmap v58: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T13:52:41.085 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:52:40 smithi099 ceph-mon[24912]: pgmap v59: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-03-30T13:52:41.085 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:52:40 smithi099 ceph-mon[24912]: from='mgr.25057 ' entity='mgr.y' 2024-03-30T13:52:41.085 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:52:40 smithi099 ceph-mon[29691]: pgmap v57: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 1.0 KiB/s rd, 1 op/s 2024-03-30T13:52:41.085 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:52:40 smithi099 ceph-mon[29691]: from='client.15237 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T13:52:41.085 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:52:40 smithi099 ceph-mon[29691]: from='mgr.25057 ' entity='mgr.y' 2024-03-30T13:52:41.085 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:52:40 smithi099 ceph-mon[29691]: from='mgr.25057 ' entity='mgr.y' 2024-03-30T13:52:41.085 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:52:40 smithi099 ceph-mon[29691]: pgmap v58: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T13:52:41.086 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:52:40 smithi099 ceph-mon[29691]: pgmap v59: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-03-30T13:52:41.086 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:52:40 smithi099 ceph-mon[29691]: from='mgr.25057 ' entity='mgr.y' 2024-03-30T13:52:43.006 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:52:42 smithi181 ceph-mon[25762]: pgmap v60: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 835 B/s rd, 0 op/s 2024-03-30T13:52:43.334 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:52:42 smithi099 ceph-mon[29691]: pgmap v60: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 835 B/s rd, 0 op/s 2024-03-30T13:52:43.335 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:52:42 smithi099 ceph-mon[24912]: pgmap v60: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 835 B/s rd, 0 op/s 2024-03-30T13:52:45.085 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:52:44 smithi099 ceph-mon[24912]: pgmap v61: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 823 B/s rd, 0 op/s 2024-03-30T13:52:45.085 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:52:44 smithi099 ceph-mon[29691]: pgmap v61: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 823 B/s rd, 0 op/s 2024-03-30T13:52:45.085 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:52:44 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[71049]: ::ffff:172.21.15.181 - - [30/Mar/2024:13:52:44] "GET /metrics HTTP/1.1" 200 37977 "" "Prometheus/2.33.4" 2024-03-30T13:52:45.255 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:52:44 smithi181 ceph-mon[25762]: pgmap v61: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 823 B/s rd, 0 op/s 2024-03-30T13:52:47.254 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:52:46 smithi181 ceph-mon[25762]: pgmap v62: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T13:52:47.334 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:52:46 smithi099 ceph-mon[24912]: pgmap v62: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T13:52:47.335 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:52:46 smithi099 ceph-mon[29691]: pgmap v62: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T13:52:49.253 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:52:48 smithi181 ceph-mon[25762]: pgmap v63: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 622 B/s rd, 0 op/s 2024-03-30T13:52:49.254 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:52:48 smithi181 ceph-mon[25762]: from='mgr.25057 172.21.15.99:0/1165207787' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T13:52:49.338 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:52:48 smithi099 ceph-mon[24912]: pgmap v63: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 622 B/s rd, 0 op/s 2024-03-30T13:52:49.338 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:52:48 smithi099 ceph-mon[24912]: from='mgr.25057 172.21.15.99:0/1165207787' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T13:52:49.338 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:52:48 smithi099 ceph-mon[29691]: pgmap v63: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 622 B/s rd, 0 op/s 2024-03-30T13:52:49.338 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:52:48 smithi099 ceph-mon[29691]: from='mgr.25057 172.21.15.99:0/1165207787' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T13:52:51.254 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:52:50 smithi181 ceph-mon[25762]: from='client.15237 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T13:52:51.254 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:52:50 smithi181 ceph-mon[25762]: pgmap v64: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-03-30T13:52:51.254 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:52:50 smithi181 ceph-mon[25762]: from='mgr.25057 ' entity='mgr.y' 2024-03-30T13:52:51.254 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:52:50 smithi181 ceph-mon[25762]: from='mgr.25057 ' entity='mgr.y' 2024-03-30T13:52:51.254 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:52:50 smithi181 ceph-mon[25762]: from='mgr.25057 172.21.15.99:0/1165207787' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:52:51.254 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:52:50 smithi181 ceph-mon[25762]: from='mgr.25057 172.21.15.99:0/1165207787' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:52:51.254 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:52:50 smithi181 ceph-mon[25762]: from='mgr.25057 ' entity='mgr.y' 2024-03-30T13:52:51.334 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:52:50 smithi099 ceph-mon[24912]: from='client.15237 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T13:52:51.335 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:52:50 smithi099 ceph-mon[24912]: pgmap v64: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-03-30T13:52:51.335 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:52:50 smithi099 ceph-mon[24912]: from='mgr.25057 ' entity='mgr.y' 2024-03-30T13:52:51.335 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:52:50 smithi099 ceph-mon[24912]: from='mgr.25057 ' entity='mgr.y' 2024-03-30T13:52:51.335 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:52:50 smithi099 ceph-mon[24912]: from='mgr.25057 172.21.15.99:0/1165207787' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:52:51.335 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:52:50 smithi099 ceph-mon[24912]: from='mgr.25057 172.21.15.99:0/1165207787' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:52:51.335 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:52:50 smithi099 ceph-mon[24912]: from='mgr.25057 ' entity='mgr.y' 2024-03-30T13:52:51.335 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:52:50 smithi099 ceph-mon[29691]: from='client.15237 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T13:52:51.335 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:52:50 smithi099 ceph-mon[29691]: pgmap v64: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-03-30T13:52:51.335 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:52:50 smithi099 ceph-mon[29691]: from='mgr.25057 ' entity='mgr.y' 2024-03-30T13:52:51.335 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:52:50 smithi099 ceph-mon[29691]: from='mgr.25057 ' entity='mgr.y' 2024-03-30T13:52:51.336 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:52:50 smithi099 ceph-mon[29691]: from='mgr.25057 172.21.15.99:0/1165207787' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:52:51.336 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:52:50 smithi099 ceph-mon[29691]: from='mgr.25057 172.21.15.99:0/1165207787' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:52:51.336 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:52:50 smithi099 ceph-mon[29691]: from='mgr.25057 ' entity='mgr.y' 2024-03-30T13:52:52.253 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:52:51 smithi181 ceph-mon[25762]: pgmap v65: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 980 B/s rd, 0 op/s 2024-03-30T13:52:52.254 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:52:51 smithi181 ceph-mon[25762]: pgmap v66: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T13:52:52.334 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:52:51 smithi099 ceph-mon[24912]: pgmap v65: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 980 B/s rd, 0 op/s 2024-03-30T13:52:52.335 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:52:51 smithi099 ceph-mon[24912]: pgmap v66: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T13:52:52.335 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:52:51 smithi099 ceph-mon[29691]: pgmap v65: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 980 B/s rd, 0 op/s 2024-03-30T13:52:52.335 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:52:51 smithi099 ceph-mon[29691]: pgmap v66: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T13:52:54.253 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:52:53 smithi181 ceph-mon[25762]: pgmap v67: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T13:52:54.334 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:52:53 smithi099 ceph-mon[24912]: pgmap v67: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T13:52:54.335 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:52:53 smithi099 ceph-mon[29691]: pgmap v67: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T13:52:55.084 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:52:54 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[71049]: ::ffff:172.21.15.181 - - [30/Mar/2024:13:52:54] "GET /metrics HTTP/1.1" 200 37980 "" "Prometheus/2.33.4" 2024-03-30T13:52:56.084 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:52:55 smithi099 ceph-mon[24912]: pgmap v68: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T13:52:56.085 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:52:55 smithi099 ceph-mon[29691]: pgmap v68: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T13:52:56.254 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:52:55 smithi181 ceph-mon[25762]: pgmap v68: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T13:52:58.084 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:52:57 smithi099 ceph-mon[29691]: pgmap v69: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T13:52:58.085 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:52:57 smithi099 ceph-mon[29691]: from='mgr.25057 ' entity='mgr.y' 2024-03-30T13:52:58.085 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:52:57 smithi099 ceph-mon[29691]: from='mgr.25057 ' entity='mgr.y' 2024-03-30T13:52:58.085 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:52:57 smithi099 ceph-mon[29691]: from='mgr.25057 ' entity='mgr.y' 2024-03-30T13:52:58.085 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:52:57 smithi099 ceph-mon[24912]: pgmap v69: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T13:52:58.085 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:52:57 smithi099 ceph-mon[24912]: from='mgr.25057 ' entity='mgr.y' 2024-03-30T13:52:58.085 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:52:57 smithi099 ceph-mon[24912]: from='mgr.25057 ' entity='mgr.y' 2024-03-30T13:52:58.085 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:52:57 smithi099 ceph-mon[24912]: from='mgr.25057 ' entity='mgr.y' 2024-03-30T13:52:58.253 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:52:57 smithi181 ceph-mon[25762]: pgmap v69: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T13:52:58.254 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:52:57 smithi181 ceph-mon[25762]: from='mgr.25057 ' entity='mgr.y' 2024-03-30T13:52:58.254 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:52:57 smithi181 ceph-mon[25762]: from='mgr.25057 ' entity='mgr.y' 2024-03-30T13:52:58.254 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:52:57 smithi181 ceph-mon[25762]: from='mgr.25057 ' entity='mgr.y' 2024-03-30T13:52:59.253 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:52:58 smithi181 ceph-mon[25762]: pgmap v70: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 647 B/s rd, 0 op/s 2024-03-30T13:52:59.253 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:52:58 smithi181 ceph-mon[25762]: pgmap v71: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 685 B/s rd, 0 op/s 2024-03-30T13:52:59.334 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:52:58 smithi099 ceph-mon[24912]: pgmap v70: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 647 B/s rd, 0 op/s 2024-03-30T13:52:59.334 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:52:58 smithi099 ceph-mon[24912]: pgmap v71: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 685 B/s rd, 0 op/s 2024-03-30T13:52:59.334 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:52:58 smithi099 ceph-mon[29691]: pgmap v70: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 647 B/s rd, 0 op/s 2024-03-30T13:52:59.335 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:52:58 smithi099 ceph-mon[29691]: pgmap v71: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 685 B/s rd, 0 op/s 2024-03-30T13:53:01.075 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:53:00 smithi181 ceph-mon[25762]: pgmap v72: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-03-30T13:53:01.075 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:53:00 smithi181 ceph-mon[25762]: from='client.15237 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T13:53:01.075 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:53:00 smithi181 ceph-mon[25762]: from='mgr.25057 ' entity='mgr.y' 2024-03-30T13:53:01.075 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:53:00 smithi181 ceph-mon[25762]: from='mgr.25057 ' entity='mgr.y' 2024-03-30T13:53:01.075 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:53:00 smithi181 ceph-mon[25762]: pgmap v73: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-03-30T13:53:01.076 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:53:00 smithi181 ceph-mon[25762]: pgmap v74: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 900 B/s rd, 0 op/s 2024-03-30T13:53:01.076 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:53:00 smithi181 ceph-mon[25762]: from='mgr.25057 ' entity='mgr.y' 2024-03-30T13:53:01.158 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:53:00 smithi099 ceph-mon[29691]: pgmap v72: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-03-30T13:53:01.158 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:53:00 smithi099 ceph-mon[29691]: from='client.15237 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T13:53:01.159 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:53:00 smithi099 ceph-mon[29691]: from='mgr.25057 ' entity='mgr.y' 2024-03-30T13:53:01.159 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:53:00 smithi099 ceph-mon[29691]: from='mgr.25057 ' entity='mgr.y' 2024-03-30T13:53:01.159 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:53:00 smithi099 ceph-mon[29691]: pgmap v73: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-03-30T13:53:01.159 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:53:00 smithi099 ceph-mon[29691]: pgmap v74: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 900 B/s rd, 0 op/s 2024-03-30T13:53:01.159 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:53:00 smithi099 ceph-mon[29691]: from='mgr.25057 ' entity='mgr.y' 2024-03-30T13:53:01.159 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:53:00 smithi099 ceph-mon[24912]: pgmap v72: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-03-30T13:53:01.159 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:53:00 smithi099 ceph-mon[24912]: from='client.15237 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T13:53:01.159 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:53:00 smithi099 ceph-mon[24912]: from='mgr.25057 ' entity='mgr.y' 2024-03-30T13:53:01.159 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:53:00 smithi099 ceph-mon[24912]: from='mgr.25057 ' entity='mgr.y' 2024-03-30T13:53:01.159 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:53:00 smithi099 ceph-mon[24912]: pgmap v73: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-03-30T13:53:01.159 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:53:00 smithi099 ceph-mon[24912]: pgmap v74: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 900 B/s rd, 0 op/s 2024-03-30T13:53:01.159 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:53:00 smithi099 ceph-mon[24912]: from='mgr.25057 ' entity='mgr.y' 2024-03-30T13:53:03.084 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:53:03 smithi099 ceph-mon[24912]: pgmap v75: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 900 B/s rd, 0 op/s 2024-03-30T13:53:03.085 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:53:03 smithi099 ceph-mon[29691]: pgmap v75: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 900 B/s rd, 0 op/s 2024-03-30T13:53:03.503 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:53:03 smithi181 ceph-mon[25762]: pgmap v75: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 900 B/s rd, 0 op/s 2024-03-30T13:53:04.334 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:53:04 smithi099 ceph-mon[24912]: from='mgr.25057 172.21.15.99:0/1165207787' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T13:53:04.335 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:53:04 smithi099 ceph-mon[29691]: from='mgr.25057 172.21.15.99:0/1165207787' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T13:53:04.503 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:53:04 smithi181 ceph-mon[25762]: from='mgr.25057 172.21.15.99:0/1165207787' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T13:53:05.086 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:53:05 smithi099 ceph-mon[24912]: pgmap v76: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 823 B/s rd, 0 op/s 2024-03-30T13:53:05.086 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:53:05 smithi099 ceph-mon[29691]: pgmap v76: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 823 B/s rd, 0 op/s 2024-03-30T13:53:05.086 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:53:04 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[71049]: ::ffff:172.21.15.181 - - [30/Mar/2024:13:53:04] "GET /metrics HTTP/1.1" 200 37978 "" "Prometheus/2.33.4" 2024-03-30T13:53:05.503 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:53:05 smithi181 ceph-mon[25762]: pgmap v76: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 823 B/s rd, 0 op/s 2024-03-30T13:53:07.337 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:53:07 smithi099 ceph-mon[24912]: pgmap v77: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T13:53:07.337 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:53:07 smithi099 ceph-mon[29691]: pgmap v77: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T13:53:07.503 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:53:07 smithi181 ceph-mon[25762]: pgmap v77: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T13:53:09.334 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:53:09 smithi099 ceph-mon[29691]: pgmap v78: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 622 B/s rd, 0 op/s 2024-03-30T13:53:09.335 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:53:09 smithi099 ceph-mon[24912]: pgmap v78: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 622 B/s rd, 0 op/s 2024-03-30T13:53:09.503 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:53:09 smithi181 ceph-mon[25762]: pgmap v78: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 622 B/s rd, 0 op/s 2024-03-30T13:53:11.334 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:53:11 smithi099 ceph-mon[24912]: from='client.15237 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T13:53:11.334 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:53:11 smithi099 ceph-mon[24912]: pgmap v79: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-03-30T13:53:11.335 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:53:11 smithi099 ceph-mon[29691]: from='client.15237 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T13:53:11.335 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:53:11 smithi099 ceph-mon[29691]: pgmap v79: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-03-30T13:53:11.503 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:53:11 smithi181 ceph-mon[25762]: from='client.15237 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T13:53:11.503 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:53:11 smithi181 ceph-mon[25762]: pgmap v79: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-03-30T13:53:13.334 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:53:13 smithi099 ceph-mon[24912]: pgmap v80: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T13:53:13.334 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:53:13 smithi099 ceph-mon[29691]: pgmap v80: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T13:53:13.503 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:53:13 smithi181 ceph-mon[25762]: pgmap v80: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T13:53:15.084 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:53:14 smithi099 ceph-mon[24912]: pgmap v81: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T13:53:15.084 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:53:14 smithi099 ceph-mon[29691]: pgmap v81: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T13:53:15.085 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:53:14 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[71049]: ::ffff:172.21.15.181 - - [30/Mar/2024:13:53:14] "GET /metrics HTTP/1.1" 200 37978 "" "Prometheus/2.33.4" 2024-03-30T13:53:15.253 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:53:14 smithi181 ceph-mon[25762]: pgmap v81: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T13:53:17.302 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:53:17 smithi181 ceph-mon[25762]: pgmap v82: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T13:53:17.334 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:53:17 smithi099 ceph-mon[24912]: pgmap v82: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T13:53:17.334 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:53:17 smithi099 ceph-mon[29691]: pgmap v82: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T13:53:19.253 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:53:18 smithi181 ceph-mon[25762]: from='mgr.25057 ' entity='mgr.y' 2024-03-30T13:53:19.253 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:53:18 smithi181 ceph-mon[25762]: from='mgr.25057 ' entity='mgr.y' 2024-03-30T13:53:19.253 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:53:18 smithi181 ceph-mon[25762]: pgmap v83: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 859 B/s rd, 0 op/s 2024-03-30T13:53:19.253 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:53:18 smithi181 ceph-mon[25762]: pgmap v84: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 1.0 KiB/s rd, 1 op/s 2024-03-30T13:53:19.254 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:53:18 smithi181 ceph-mon[25762]: from='mgr.25057 ' entity='mgr.y' 2024-03-30T13:53:19.254 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:53:18 smithi181 ceph-mon[25762]: from='mgr.25057 172.21.15.99:0/1165207787' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T13:53:19.334 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:53:18 smithi099 ceph-mon[24912]: from='mgr.25057 ' entity='mgr.y' 2024-03-30T13:53:19.335 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:53:18 smithi099 ceph-mon[24912]: from='mgr.25057 ' entity='mgr.y' 2024-03-30T13:53:19.335 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:53:18 smithi099 ceph-mon[24912]: pgmap v83: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 859 B/s rd, 0 op/s 2024-03-30T13:53:19.335 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:53:18 smithi099 ceph-mon[24912]: pgmap v84: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 1.0 KiB/s rd, 1 op/s 2024-03-30T13:53:19.335 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:53:18 smithi099 ceph-mon[24912]: from='mgr.25057 ' entity='mgr.y' 2024-03-30T13:53:19.335 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:53:18 smithi099 ceph-mon[24912]: from='mgr.25057 172.21.15.99:0/1165207787' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T13:53:19.335 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:53:18 smithi099 ceph-mon[29691]: from='mgr.25057 ' entity='mgr.y' 2024-03-30T13:53:19.335 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:53:18 smithi099 ceph-mon[29691]: from='mgr.25057 ' entity='mgr.y' 2024-03-30T13:53:19.335 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:53:18 smithi099 ceph-mon[29691]: pgmap v83: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 859 B/s rd, 0 op/s 2024-03-30T13:53:19.335 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:53:18 smithi099 ceph-mon[29691]: pgmap v84: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 1.0 KiB/s rd, 1 op/s 2024-03-30T13:53:19.335 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:53:18 smithi099 ceph-mon[29691]: from='mgr.25057 ' entity='mgr.y' 2024-03-30T13:53:19.336 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:53:18 smithi099 ceph-mon[29691]: from='mgr.25057 172.21.15.99:0/1165207787' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T13:53:21.307 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:53:21 smithi099 ceph-mon[24912]: from='client.15237 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T13:53:21.307 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:53:21 smithi099 ceph-mon[24912]: pgmap v85: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 1.0 KiB/s rd, 1 op/s 2024-03-30T13:53:21.307 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:53:21 smithi099 ceph-mon[24912]: from='mgr.25057 ' entity='mgr.y' 2024-03-30T13:53:21.307 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:53:21 smithi099 ceph-mon[24912]: from='mgr.25057 ' entity='mgr.y' 2024-03-30T13:53:21.307 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:53:21 smithi099 ceph-mon[24912]: from='mgr.25057 ' entity='mgr.y' 2024-03-30T13:53:21.308 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:53:21 smithi099 ceph-mon[29691]: from='client.15237 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T13:53:21.308 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:53:21 smithi099 ceph-mon[29691]: pgmap v85: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 1.0 KiB/s rd, 1 op/s 2024-03-30T13:53:21.308 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:53:21 smithi099 ceph-mon[29691]: from='mgr.25057 ' entity='mgr.y' 2024-03-30T13:53:21.308 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:53:21 smithi099 ceph-mon[29691]: from='mgr.25057 ' entity='mgr.y' 2024-03-30T13:53:21.308 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:53:21 smithi099 ceph-mon[29691]: from='mgr.25057 ' entity='mgr.y' 2024-03-30T13:53:21.503 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:53:21 smithi181 ceph-mon[25762]: from='client.15237 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T13:53:21.504 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:53:21 smithi181 ceph-mon[25762]: pgmap v85: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 1.0 KiB/s rd, 1 op/s 2024-03-30T13:53:21.504 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:53:21 smithi181 ceph-mon[25762]: from='mgr.25057 ' entity='mgr.y' 2024-03-30T13:53:21.504 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:53:21 smithi181 ceph-mon[25762]: from='mgr.25057 ' entity='mgr.y' 2024-03-30T13:53:21.504 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:53:21 smithi181 ceph-mon[25762]: from='mgr.25057 ' entity='mgr.y' 2024-03-30T13:53:22.253 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:53:22 smithi181 ceph-mon[25762]: pgmap v86: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T13:53:22.253 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:53:22 smithi181 ceph-mon[25762]: pgmap v87: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-03-30T13:53:22.489 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:53:22 smithi099 ceph-mon[24912]: pgmap v86: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T13:53:22.489 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:53:22 smithi099 ceph-mon[24912]: pgmap v87: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-03-30T13:53:22.489 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:53:22 smithi099 ceph-mon[29691]: pgmap v86: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T13:53:22.489 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:53:22 smithi099 ceph-mon[29691]: pgmap v87: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-03-30T13:53:24.503 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:53:24 smithi181 ceph-mon[25762]: pgmap v88: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 835 B/s rd, 0 op/s 2024-03-30T13:53:24.584 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:53:24 smithi099 ceph-mon[24912]: pgmap v88: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 835 B/s rd, 0 op/s 2024-03-30T13:53:24.584 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:53:24 smithi099 ceph-mon[29691]: pgmap v88: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 835 B/s rd, 0 op/s 2024-03-30T13:53:25.084 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:53:24 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[71049]: ::ffff:172.21.15.181 - - [30/Mar/2024:13:53:24] "GET /metrics HTTP/1.1" 200 37978 "" "Prometheus/2.33.4" 2024-03-30T13:53:25.503 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:53:25 smithi181 ceph-mon[25762]: pgmap v89: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-03-30T13:53:25.584 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:53:25 smithi099 ceph-mon[24912]: pgmap v89: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-03-30T13:53:25.584 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:53:25 smithi099 ceph-mon[29691]: pgmap v89: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-03-30T13:53:27.503 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:53:27 smithi181 ceph-mon[25762]: pgmap v90: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T13:53:27.584 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:53:27 smithi099 ceph-mon[24912]: pgmap v90: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T13:53:27.584 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:53:27 smithi099 ceph-mon[29691]: pgmap v90: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T13:53:30.084 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:53:29 smithi099 ceph-mon[24912]: pgmap v91: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 622 B/s rd, 0 op/s 2024-03-30T13:53:30.084 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:53:29 smithi099 ceph-mon[29691]: pgmap v91: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 622 B/s rd, 0 op/s 2024-03-30T13:53:30.253 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:53:29 smithi181 ceph-mon[25762]: pgmap v91: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 622 B/s rd, 0 op/s 2024-03-30T13:53:31.084 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:53:30 smithi099 ceph-mon[24912]: from='client.15237 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T13:53:31.084 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:53:30 smithi099 ceph-mon[29691]: from='client.15237 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T13:53:31.253 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:53:30 smithi181 ceph-mon[25762]: from='client.15237 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T13:53:32.084 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:53:31 smithi099 ceph-mon[24912]: pgmap v92: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-03-30T13:53:32.084 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:53:31 smithi099 ceph-mon[29691]: pgmap v92: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-03-30T13:53:32.253 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:53:31 smithi181 ceph-mon[25762]: pgmap v92: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-03-30T13:53:34.084 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:53:33 smithi099 ceph-mon[24912]: pgmap v93: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T13:53:34.084 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:53:33 smithi099 ceph-mon[24912]: from='mgr.25057 172.21.15.99:0/1165207787' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T13:53:34.084 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:53:33 smithi099 ceph-mon[29691]: pgmap v93: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T13:53:34.085 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:53:33 smithi099 ceph-mon[29691]: from='mgr.25057 172.21.15.99:0/1165207787' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T13:53:34.253 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:53:33 smithi181 ceph-mon[25762]: pgmap v93: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T13:53:34.253 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:53:33 smithi181 ceph-mon[25762]: from='mgr.25057 172.21.15.99:0/1165207787' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T13:53:35.084 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:53:34 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[71049]: ::ffff:172.21.15.181 - - [30/Mar/2024:13:53:34] "GET /metrics HTTP/1.1" 200 37976 "" "Prometheus/2.33.4" 2024-03-30T13:53:36.084 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:53:35 smithi099 ceph-mon[24912]: pgmap v94: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T13:53:36.084 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:53:35 smithi099 ceph-mon[29691]: pgmap v94: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T13:53:36.253 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:53:35 smithi181 ceph-mon[25762]: pgmap v94: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T13:53:38.084 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:53:37 smithi099 ceph-mon[24912]: pgmap v95: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T13:53:38.084 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:53:37 smithi099 ceph-mon[29691]: pgmap v95: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T13:53:38.253 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:53:37 smithi181 ceph-mon[25762]: pgmap v95: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T13:53:39.334 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:53:39 smithi099 ceph-mon[24912]: from='mgr.25057 ' entity='mgr.y' 2024-03-30T13:53:39.334 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:53:39 smithi099 ceph-mon[24912]: from='mgr.25057 ' entity='mgr.y' 2024-03-30T13:53:39.334 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:53:39 smithi099 ceph-mon[24912]: pgmap v96: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 859 B/s rd, 0 op/s 2024-03-30T13:53:39.334 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:53:39 smithi099 ceph-mon[24912]: pgmap v97: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 1.0 KiB/s rd, 1 op/s 2024-03-30T13:53:39.334 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:53:39 smithi099 ceph-mon[24912]: from='mgr.25057 ' entity='mgr.y' 2024-03-30T13:53:39.334 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:53:39 smithi099 ceph-mon[29691]: from='mgr.25057 ' entity='mgr.y' 2024-03-30T13:53:39.334 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:53:39 smithi099 ceph-mon[29691]: from='mgr.25057 ' entity='mgr.y' 2024-03-30T13:53:39.335 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:53:39 smithi099 ceph-mon[29691]: pgmap v96: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 859 B/s rd, 0 op/s 2024-03-30T13:53:39.335 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:53:39 smithi099 ceph-mon[29691]: pgmap v97: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 1.0 KiB/s rd, 1 op/s 2024-03-30T13:53:39.335 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:53:39 smithi099 ceph-mon[29691]: from='mgr.25057 ' entity='mgr.y' 2024-03-30T13:53:39.503 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:53:39 smithi181 ceph-mon[25762]: from='mgr.25057 ' entity='mgr.y' 2024-03-30T13:53:39.503 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:53:39 smithi181 ceph-mon[25762]: from='mgr.25057 ' entity='mgr.y' 2024-03-30T13:53:39.503 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:53:39 smithi181 ceph-mon[25762]: pgmap v96: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 859 B/s rd, 0 op/s 2024-03-30T13:53:39.503 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:53:39 smithi181 ceph-mon[25762]: pgmap v97: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 1.0 KiB/s rd, 1 op/s 2024-03-30T13:53:39.503 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:53:39 smithi181 ceph-mon[25762]: from='mgr.25057 ' entity='mgr.y' 2024-03-30T13:53:41.242 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:53:41 smithi099 ceph-mon[24912]: from='client.15237 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T13:53:41.242 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:53:41 smithi099 ceph-mon[24912]: pgmap v98: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 1.0 KiB/s rd, 1 op/s 2024-03-30T13:53:41.242 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:53:41 smithi099 ceph-mon[24912]: from='mgr.25057 ' entity='mgr.y' 2024-03-30T13:53:41.242 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:53:41 smithi099 ceph-mon[24912]: from='mgr.25057 ' entity='mgr.y' 2024-03-30T13:53:41.242 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:53:41 smithi099 ceph-mon[24912]: from='mgr.25057 ' entity='mgr.y' 2024-03-30T13:53:41.242 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:53:41 smithi099 ceph-mon[29691]: from='client.15237 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T13:53:41.242 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:53:41 smithi099 ceph-mon[29691]: pgmap v98: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 1.0 KiB/s rd, 1 op/s 2024-03-30T13:53:41.242 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:53:41 smithi099 ceph-mon[29691]: from='mgr.25057 ' entity='mgr.y' 2024-03-30T13:53:41.243 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:53:41 smithi099 ceph-mon[29691]: from='mgr.25057 ' entity='mgr.y' 2024-03-30T13:53:41.243 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:53:41 smithi099 ceph-mon[29691]: from='mgr.25057 ' entity='mgr.y' 2024-03-30T13:53:41.503 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:53:41 smithi181 ceph-mon[25762]: from='client.15237 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T13:53:41.503 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:53:41 smithi181 ceph-mon[25762]: pgmap v98: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 1.0 KiB/s rd, 1 op/s 2024-03-30T13:53:41.503 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:53:41 smithi181 ceph-mon[25762]: from='mgr.25057 ' entity='mgr.y' 2024-03-30T13:53:41.503 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:53:41 smithi181 ceph-mon[25762]: from='mgr.25057 ' entity='mgr.y' 2024-03-30T13:53:41.503 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:53:41 smithi181 ceph-mon[25762]: from='mgr.25057 ' entity='mgr.y' 2024-03-30T13:53:42.303 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:53:42 smithi099 ceph-mon[24912]: pgmap v99: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T13:53:42.303 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:53:42 smithi099 ceph-mon[24912]: pgmap v100: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 835 B/s rd, 0 op/s 2024-03-30T13:53:42.303 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:53:42 smithi099 ceph-mon[29691]: pgmap v99: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T13:53:42.303 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:53:42 smithi099 ceph-mon[29691]: pgmap v100: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 835 B/s rd, 0 op/s 2024-03-30T13:53:42.492 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:53:42 smithi181 ceph-mon[25762]: pgmap v99: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T13:53:42.492 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:53:42 smithi181 ceph-mon[25762]: pgmap v100: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 835 B/s rd, 0 op/s 2024-03-30T13:53:44.192 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:53:44 smithi181 ceph-mon[25762]: pgmap v101: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 835 B/s rd, 0 op/s 2024-03-30T13:53:44.334 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:53:44 smithi099 ceph-mon[24912]: pgmap v101: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 835 B/s rd, 0 op/s 2024-03-30T13:53:44.334 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:53:44 smithi099 ceph-mon[29691]: pgmap v101: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 835 B/s rd, 0 op/s 2024-03-30T13:53:45.084 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:53:44 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[71049]: ::ffff:172.21.15.181 - - [30/Mar/2024:13:53:44] "GET /metrics HTTP/1.1" 200 37976 "" "Prometheus/2.33.4" 2024-03-30T13:53:46.334 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:53:46 smithi099 ceph-mon[24912]: pgmap v102: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-03-30T13:53:46.334 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:53:46 smithi099 ceph-mon[29691]: pgmap v102: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-03-30T13:53:46.503 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:53:46 smithi181 ceph-mon[25762]: pgmap v102: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-03-30T13:53:48.334 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:53:48 smithi099 ceph-mon[24912]: pgmap v103: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T13:53:48.334 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:53:48 smithi099 ceph-mon[29691]: pgmap v103: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T13:53:48.503 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:53:48 smithi181 ceph-mon[25762]: pgmap v103: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T13:53:49.334 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:53:49 smithi099 ceph-mon[24912]: from='mgr.25057 172.21.15.99:0/1165207787' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T13:53:49.334 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:53:49 smithi099 ceph-mon[29691]: from='mgr.25057 172.21.15.99:0/1165207787' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T13:53:49.503 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:53:49 smithi181 ceph-mon[25762]: from='mgr.25057 172.21.15.99:0/1165207787' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T13:53:50.334 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:53:50 smithi099 ceph-mon[24912]: pgmap v104: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 623 B/s rd, 0 op/s 2024-03-30T13:53:50.334 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:53:50 smithi099 ceph-mon[29691]: pgmap v104: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 623 B/s rd, 0 op/s 2024-03-30T13:53:50.461 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:53:50 smithi181 ceph-mon[25762]: pgmap v104: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 623 B/s rd, 0 op/s 2024-03-30T13:53:51.503 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:53:51 smithi181 ceph-mon[25762]: from='client.15237 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T13:53:51.503 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:53:51 smithi181 ceph-mon[25762]: from='mgr.25057 172.21.15.99:0/1165207787' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:53:51.503 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:53:51 smithi181 ceph-mon[25762]: from='mgr.25057 172.21.15.99:0/1165207787' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:53:51.503 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:53:51 smithi181 ceph-mon[25762]: from='mgr.25057 ' entity='mgr.y' 2024-03-30T13:53:51.584 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:53:51 smithi099 ceph-mon[24912]: from='client.15237 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T13:53:51.584 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:53:51 smithi099 ceph-mon[24912]: from='mgr.25057 172.21.15.99:0/1165207787' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:53:51.584 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:53:51 smithi099 ceph-mon[24912]: from='mgr.25057 172.21.15.99:0/1165207787' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:53:51.584 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:53:51 smithi099 ceph-mon[24912]: from='mgr.25057 ' entity='mgr.y' 2024-03-30T13:53:51.584 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:53:51 smithi099 ceph-mon[29691]: from='client.15237 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T13:53:51.584 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:53:51 smithi099 ceph-mon[29691]: from='mgr.25057 172.21.15.99:0/1165207787' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:53:51.584 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:53:51 smithi099 ceph-mon[29691]: from='mgr.25057 172.21.15.99:0/1165207787' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:53:51.584 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:53:51 smithi099 ceph-mon[29691]: from='mgr.25057 ' entity='mgr.y' 2024-03-30T13:53:52.503 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:53:52 smithi181 ceph-mon[25762]: pgmap v105: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-03-30T13:53:52.503 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:53:52 smithi181 ceph-mon[25762]: pgmap v106: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 1007 B/s rd, 0 op/s 2024-03-30T13:53:52.503 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:53:52 smithi181 ceph-mon[25762]: pgmap v107: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T13:53:52.584 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:53:52 smithi099 ceph-mon[24912]: pgmap v105: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-03-30T13:53:52.584 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:53:52 smithi099 ceph-mon[24912]: pgmap v106: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 1007 B/s rd, 0 op/s 2024-03-30T13:53:52.584 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:53:52 smithi099 ceph-mon[24912]: pgmap v107: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T13:53:52.584 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:53:52 smithi099 ceph-mon[29691]: pgmap v105: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-03-30T13:53:52.584 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:53:52 smithi099 ceph-mon[29691]: pgmap v106: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 1007 B/s rd, 0 op/s 2024-03-30T13:53:52.584 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:53:52 smithi099 ceph-mon[29691]: pgmap v107: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T13:53:54.503 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:53:54 smithi181 ceph-mon[25762]: pgmap v108: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 627 B/s rd, 0 op/s 2024-03-30T13:53:54.584 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:53:54 smithi099 ceph-mon[24912]: pgmap v108: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 627 B/s rd, 0 op/s 2024-03-30T13:53:54.584 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:53:54 smithi099 ceph-mon[29691]: pgmap v108: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 627 B/s rd, 0 op/s 2024-03-30T13:53:55.084 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:53:54 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[71049]: ::ffff:172.21.15.181 - - [30/Mar/2024:13:53:54] "GET /metrics HTTP/1.1" 200 37988 "" "Prometheus/2.33.4" 2024-03-30T13:53:55.503 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:53:55 smithi181 ceph-mon[25762]: pgmap v109: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T13:53:55.584 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:53:55 smithi099 ceph-mon[24912]: pgmap v109: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T13:53:55.584 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:53:55 smithi099 ceph-mon[29691]: pgmap v109: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T13:53:57.753 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:53:57 smithi181 ceph-mon[25762]: pgmap v110: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T13:53:57.834 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:53:57 smithi099 ceph-mon[24912]: pgmap v110: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T13:53:57.834 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:53:57 smithi099 ceph-mon[29691]: pgmap v110: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T13:53:59.503 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:53:59 smithi181 ceph-mon[25762]: from='mgr.25057 ' entity='mgr.y' 2024-03-30T13:53:59.503 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:53:59 smithi181 ceph-mon[25762]: from='mgr.25057 ' entity='mgr.y' 2024-03-30T13:53:59.503 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:53:59 smithi181 ceph-mon[25762]: pgmap v111: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 646 B/s rd, 0 op/s 2024-03-30T13:53:59.503 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:53:59 smithi181 ceph-mon[25762]: pgmap v112: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 659 B/s rd, 0 op/s 2024-03-30T13:53:59.503 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:53:59 smithi181 ceph-mon[25762]: from='mgr.25057 ' entity='mgr.y' 2024-03-30T13:53:59.584 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:53:59 smithi099 ceph-mon[24912]: from='mgr.25057 ' entity='mgr.y' 2024-03-30T13:53:59.584 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:53:59 smithi099 ceph-mon[24912]: from='mgr.25057 ' entity='mgr.y' 2024-03-30T13:53:59.584 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:53:59 smithi099 ceph-mon[24912]: pgmap v111: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 646 B/s rd, 0 op/s 2024-03-30T13:53:59.584 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:53:59 smithi099 ceph-mon[24912]: pgmap v112: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 659 B/s rd, 0 op/s 2024-03-30T13:53:59.584 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:53:59 smithi099 ceph-mon[24912]: from='mgr.25057 ' entity='mgr.y' 2024-03-30T13:53:59.584 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:53:59 smithi099 ceph-mon[29691]: from='mgr.25057 ' entity='mgr.y' 2024-03-30T13:53:59.584 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:53:59 smithi099 ceph-mon[29691]: from='mgr.25057 ' entity='mgr.y' 2024-03-30T13:53:59.584 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:53:59 smithi099 ceph-mon[29691]: pgmap v111: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 646 B/s rd, 0 op/s 2024-03-30T13:53:59.584 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:53:59 smithi099 ceph-mon[29691]: pgmap v112: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 659 B/s rd, 0 op/s 2024-03-30T13:53:59.584 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:53:59 smithi099 ceph-mon[29691]: from='mgr.25057 ' entity='mgr.y' 2024-03-30T13:54:00.253 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:54:00 smithi181 ceph-mon[25762]: from='client.15237 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T13:54:00.584 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:54:00 smithi099 ceph-mon[24912]: from='client.15237 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T13:54:00.584 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:54:00 smithi099 ceph-mon[29691]: from='client.15237 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T13:54:01.753 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:54:01 smithi181 ceph-mon[25762]: pgmap v113: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 1.0 KiB/s rd, 1 op/s 2024-03-30T13:54:01.753 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:54:01 smithi181 ceph-mon[25762]: from='mgr.25057 ' entity='mgr.y' 2024-03-30T13:54:01.753 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:54:01 smithi181 ceph-mon[25762]: from='mgr.25057 ' entity='mgr.y' 2024-03-30T13:54:01.753 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:54:01 smithi181 ceph-mon[25762]: pgmap v114: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-03-30T13:54:01.753 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:54:01 smithi181 ceph-mon[25762]: pgmap v115: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 857 B/s rd, 0 op/s 2024-03-30T13:54:01.753 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:54:01 smithi181 ceph-mon[25762]: from='mgr.25057 ' entity='mgr.y' 2024-03-30T13:54:01.788 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:54:01 smithi099 ceph-mon[29691]: pgmap v113: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 1.0 KiB/s rd, 1 op/s 2024-03-30T13:54:01.788 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:54:01 smithi099 ceph-mon[29691]: from='mgr.25057 ' entity='mgr.y' 2024-03-30T13:54:01.788 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:54:01 smithi099 ceph-mon[29691]: from='mgr.25057 ' entity='mgr.y' 2024-03-30T13:54:01.788 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:54:01 smithi099 ceph-mon[29691]: pgmap v114: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-03-30T13:54:01.789 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:54:01 smithi099 ceph-mon[29691]: pgmap v115: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 857 B/s rd, 0 op/s 2024-03-30T13:54:01.789 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:54:01 smithi099 ceph-mon[29691]: from='mgr.25057 ' entity='mgr.y' 2024-03-30T13:54:01.789 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:54:01 smithi099 ceph-mon[24912]: pgmap v113: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 1.0 KiB/s rd, 1 op/s 2024-03-30T13:54:01.789 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:54:01 smithi099 ceph-mon[24912]: from='mgr.25057 ' entity='mgr.y' 2024-03-30T13:54:01.789 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:54:01 smithi099 ceph-mon[24912]: from='mgr.25057 ' entity='mgr.y' 2024-03-30T13:54:01.789 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:54:01 smithi099 ceph-mon[24912]: pgmap v114: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-03-30T13:54:01.789 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:54:01 smithi099 ceph-mon[24912]: pgmap v115: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 857 B/s rd, 0 op/s 2024-03-30T13:54:01.789 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:54:01 smithi099 ceph-mon[24912]: from='mgr.25057 ' entity='mgr.y' 2024-03-30T13:54:03.584 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:54:03 smithi099 ceph-mon[24912]: pgmap v116: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 857 B/s rd, 0 op/s 2024-03-30T13:54:03.584 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:54:03 smithi099 ceph-mon[24912]: from='mgr.25057 172.21.15.99:0/1165207787' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T13:54:03.584 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:54:03 smithi099 ceph-mon[29691]: pgmap v116: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 857 B/s rd, 0 op/s 2024-03-30T13:54:03.584 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:54:03 smithi099 ceph-mon[29691]: from='mgr.25057 172.21.15.99:0/1165207787' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T13:54:03.647 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:54:03 smithi181 ceph-mon[25762]: pgmap v116: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 857 B/s rd, 0 op/s 2024-03-30T13:54:03.648 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:54:03 smithi181 ceph-mon[25762]: from='mgr.25057 172.21.15.99:0/1165207787' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T13:54:05.083 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:54:04 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[71049]: ::ffff:172.21.15.181 - - [30/Mar/2024:13:54:04] "GET /metrics HTTP/1.1" 200 37989 "" "Prometheus/2.33.4" 2024-03-30T13:54:06.084 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:54:05 smithi099 ceph-mon[24912]: pgmap v117: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-03-30T13:54:06.084 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:54:05 smithi099 ceph-mon[29691]: pgmap v117: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-03-30T13:54:06.253 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:54:05 smithi181 ceph-mon[25762]: pgmap v117: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-03-30T13:54:08.083 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:54:07 smithi099 ceph-mon[24912]: pgmap v118: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T13:54:08.084 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:54:07 smithi099 ceph-mon[29691]: pgmap v118: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T13:54:08.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:54:07 smithi181 ceph-mon[25762]: pgmap v118: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T13:54:10.084 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:54:09 smithi099 ceph-mon[24912]: pgmap v119: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 623 B/s rd, 0 op/s 2024-03-30T13:54:10.084 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:54:09 smithi099 ceph-mon[29691]: pgmap v119: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 623 B/s rd, 0 op/s 2024-03-30T13:54:10.253 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:54:09 smithi181 ceph-mon[25762]: pgmap v119: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 623 B/s rd, 0 op/s 2024-03-30T13:54:11.056 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:54:10 smithi099 ceph-mon[24912]: from='client.15237 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T13:54:11.057 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:54:10 smithi099 ceph-mon[29691]: from='client.15237 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T13:54:11.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:54:10 smithi181 ceph-mon[25762]: from='client.15237 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T13:54:12.083 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:54:11 smithi099 ceph-mon[24912]: pgmap v120: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-03-30T13:54:12.084 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:54:11 smithi099 ceph-mon[29691]: pgmap v120: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-03-30T13:54:12.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:54:11 smithi181 ceph-mon[25762]: pgmap v120: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-03-30T13:54:14.083 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:54:13 smithi099 ceph-mon[24912]: pgmap v121: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T13:54:14.084 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:54:13 smithi099 ceph-mon[29691]: pgmap v121: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T13:54:14.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:54:13 smithi181 ceph-mon[25762]: pgmap v121: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T13:54:15.083 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:54:14 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[71049]: ::ffff:172.21.15.181 - - [30/Mar/2024:13:54:14] "GET /metrics HTTP/1.1" 200 37989 "" "Prometheus/2.33.4" 2024-03-30T13:54:16.083 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:54:15 smithi099 ceph-mon[24912]: pgmap v122: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T13:54:16.084 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:54:15 smithi099 ceph-mon[29691]: pgmap v122: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T13:54:16.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:54:15 smithi181 ceph-mon[25762]: pgmap v122: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T13:54:18.055 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:54:17 smithi181 ceph-mon[25762]: pgmap v123: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T13:54:18.083 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:54:17 smithi099 ceph-mon[24912]: pgmap v123: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T13:54:18.084 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:54:17 smithi099 ceph-mon[29691]: pgmap v123: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T13:54:19.083 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:54:18 smithi099 ceph-mon[29691]: from='mgr.25057 172.21.15.99:0/1165207787' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T13:54:19.083 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:54:18 smithi099 ceph-mon[29691]: from='mgr.25057 ' entity='mgr.y' 2024-03-30T13:54:19.084 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:54:18 smithi099 ceph-mon[29691]: from='mgr.25057 ' entity='mgr.y' 2024-03-30T13:54:19.084 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:54:18 smithi099 ceph-mon[29691]: from='mgr.25057 ' entity='mgr.y' 2024-03-30T13:54:19.084 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:54:18 smithi099 ceph-mon[24912]: from='mgr.25057 172.21.15.99:0/1165207787' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T13:54:19.084 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:54:18 smithi099 ceph-mon[24912]: from='mgr.25057 ' entity='mgr.y' 2024-03-30T13:54:19.084 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:54:18 smithi099 ceph-mon[24912]: from='mgr.25057 ' entity='mgr.y' 2024-03-30T13:54:19.084 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:54:18 smithi099 ceph-mon[24912]: from='mgr.25057 ' entity='mgr.y' 2024-03-30T13:54:19.221 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:54:18 smithi181 ceph-mon[25762]: from='mgr.25057 172.21.15.99:0/1165207787' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T13:54:19.221 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:54:18 smithi181 ceph-mon[25762]: from='mgr.25057 ' entity='mgr.y' 2024-03-30T13:54:19.221 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:54:18 smithi181 ceph-mon[25762]: from='mgr.25057 ' entity='mgr.y' 2024-03-30T13:54:19.221 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:54:18 smithi181 ceph-mon[25762]: from='mgr.25057 ' entity='mgr.y' 2024-03-30T13:54:20.083 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:54:19 smithi099 ceph-mon[24912]: pgmap v124: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 859 B/s rd, 0 op/s 2024-03-30T13:54:20.084 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:54:19 smithi099 ceph-mon[24912]: pgmap v125: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 1.0 KiB/s rd, 1 op/s 2024-03-30T13:54:20.084 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:54:19 smithi099 ceph-mon[29691]: pgmap v124: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 859 B/s rd, 0 op/s 2024-03-30T13:54:20.084 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:54:19 smithi099 ceph-mon[29691]: pgmap v125: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 1.0 KiB/s rd, 1 op/s 2024-03-30T13:54:20.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:54:19 smithi181 ceph-mon[25762]: pgmap v124: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 859 B/s rd, 0 op/s 2024-03-30T13:54:20.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:54:19 smithi181 ceph-mon[25762]: pgmap v125: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 1.0 KiB/s rd, 1 op/s 2024-03-30T13:54:21.083 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:54:20 smithi099 ceph-mon[24912]: from='client.15237 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T13:54:21.084 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:54:20 smithi099 ceph-mon[24912]: from='mgr.25057 ' entity='mgr.y' 2024-03-30T13:54:21.084 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:54:20 smithi099 ceph-mon[24912]: from='mgr.25057 ' entity='mgr.y' 2024-03-30T13:54:21.084 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:54:20 smithi099 ceph-mon[24912]: from='mgr.25057 ' entity='mgr.y' 2024-03-30T13:54:21.084 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:54:20 smithi099 ceph-mon[29691]: from='client.15237 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T13:54:21.084 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:54:20 smithi099 ceph-mon[29691]: from='mgr.25057 ' entity='mgr.y' 2024-03-30T13:54:21.084 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:54:20 smithi099 ceph-mon[29691]: from='mgr.25057 ' entity='mgr.y' 2024-03-30T13:54:21.084 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:54:20 smithi099 ceph-mon[29691]: from='mgr.25057 ' entity='mgr.y' 2024-03-30T13:54:21.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:54:20 smithi181 ceph-mon[25762]: from='client.15237 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T13:54:21.253 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:54:20 smithi181 ceph-mon[25762]: from='mgr.25057 ' entity='mgr.y' 2024-03-30T13:54:21.253 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:54:20 smithi181 ceph-mon[25762]: from='mgr.25057 ' entity='mgr.y' 2024-03-30T13:54:21.253 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:54:20 smithi181 ceph-mon[25762]: from='mgr.25057 ' entity='mgr.y' 2024-03-30T13:54:22.083 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:54:21 smithi099 ceph-mon[24912]: pgmap v126: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 1.0 KiB/s rd, 1 op/s 2024-03-30T13:54:22.083 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:54:21 smithi099 ceph-mon[24912]: pgmap v127: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T13:54:22.084 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:54:21 smithi099 ceph-mon[24912]: pgmap v128: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 834 B/s rd, 0 op/s 2024-03-30T13:54:22.084 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:54:21 smithi099 ceph-mon[29691]: pgmap v126: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 1.0 KiB/s rd, 1 op/s 2024-03-30T13:54:22.084 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:54:21 smithi099 ceph-mon[29691]: pgmap v127: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T13:54:22.084 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:54:21 smithi099 ceph-mon[29691]: pgmap v128: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 834 B/s rd, 0 op/s 2024-03-30T13:54:22.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:54:21 smithi181 ceph-mon[25762]: pgmap v126: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 1.0 KiB/s rd, 1 op/s 2024-03-30T13:54:22.253 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:54:21 smithi181 ceph-mon[25762]: pgmap v127: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T13:54:22.253 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:54:21 smithi181 ceph-mon[25762]: pgmap v128: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 834 B/s rd, 0 op/s 2024-03-30T13:54:23.900 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:54:23 smithi099 ceph-mon[24912]: pgmap v129: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 834 B/s rd, 0 op/s 2024-03-30T13:54:23.900 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:54:23 smithi099 ceph-mon[29691]: pgmap v129: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 834 B/s rd, 0 op/s 2024-03-30T13:54:24.213 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:54:23 smithi181 ceph-mon[25762]: pgmap v129: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 834 B/s rd, 0 op/s 2024-03-30T13:54:25.083 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:54:24 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[71049]: ::ffff:172.21.15.181 - - [30/Mar/2024:13:54:24] "GET /metrics HTTP/1.1" 200 37987 "" "Prometheus/2.33.4" 2024-03-30T13:54:25.872 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:54:25 smithi181 ceph-mon[25762]: pgmap v130: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-03-30T13:54:26.083 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:54:25 smithi099 ceph-mon[24912]: pgmap v130: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-03-30T13:54:26.083 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:54:25 smithi099 ceph-mon[29691]: pgmap v130: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-03-30T13:54:28.083 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:54:27 smithi099 ceph-mon[24912]: pgmap v131: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T13:54:28.084 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:54:27 smithi099 ceph-mon[29691]: pgmap v131: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T13:54:28.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:54:27 smithi181 ceph-mon[25762]: pgmap v131: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T13:54:30.253 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:54:29 smithi181 ceph-mon[25762]: pgmap v132: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 622 B/s rd, 0 op/s 2024-03-30T13:54:30.333 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:54:29 smithi099 ceph-mon[24912]: pgmap v132: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 622 B/s rd, 0 op/s 2024-03-30T13:54:30.333 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:54:29 smithi099 ceph-mon[29691]: pgmap v132: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 622 B/s rd, 0 op/s 2024-03-30T13:54:31.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:54:30 smithi181 ceph-mon[25762]: from='client.15237 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T13:54:31.333 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:54:30 smithi099 ceph-mon[29691]: from='client.15237 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T13:54:31.333 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:54:30 smithi099 ceph-mon[24912]: from='client.15237 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T13:54:32.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:54:31 smithi181 ceph-mon[25762]: pgmap v133: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-03-30T13:54:32.333 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:54:31 smithi099 ceph-mon[24912]: pgmap v133: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-03-30T13:54:32.333 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:54:31 smithi099 ceph-mon[29691]: pgmap v133: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-03-30T13:54:34.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:54:33 smithi181 ceph-mon[25762]: pgmap v134: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T13:54:34.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:54:33 smithi181 ceph-mon[25762]: from='mgr.25057 172.21.15.99:0/1165207787' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T13:54:34.333 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:54:33 smithi099 ceph-mon[24912]: pgmap v134: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T13:54:34.333 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:54:33 smithi099 ceph-mon[24912]: from='mgr.25057 172.21.15.99:0/1165207787' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T13:54:34.333 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:54:33 smithi099 ceph-mon[29691]: pgmap v134: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T13:54:34.333 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:54:33 smithi099 ceph-mon[29691]: from='mgr.25057 172.21.15.99:0/1165207787' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T13:54:35.083 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:54:34 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[71049]: ::ffff:172.21.15.181 - - [30/Mar/2024:13:54:34] "GET /metrics HTTP/1.1" 200 37983 "" "Prometheus/2.33.4" 2024-03-30T13:54:36.169 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:54:35 smithi099 ceph-mon[24912]: pgmap v135: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T13:54:36.169 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:54:35 smithi099 ceph-mon[29691]: pgmap v135: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T13:54:36.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:54:35 smithi181 ceph-mon[25762]: pgmap v135: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T13:54:37.798 DEBUG:teuthology.orchestra.run.smithi099:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 98ebaeb8-ee99-11ee-b647-cb9ed24678a4 -e sha1=4e50bbcdd1630c7760b708f3a5b4d38a121e66cb -- bash -c 'ceph orch ps' 2024-03-30T13:54:38.083 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:54:37 smithi099 ceph-mon[24912]: pgmap v136: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T13:54:38.083 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:54:37 smithi099 ceph-mon[29691]: pgmap v136: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T13:54:38.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:54:37 smithi181 ceph-mon[25762]: pgmap v136: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T13:54:39.751 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:54:39 smithi099 ceph-mon[29691]: from='mgr.25057 ' entity='mgr.y' 2024-03-30T13:54:39.751 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:54:39 smithi099 ceph-mon[29691]: from='mgr.25057 ' entity='mgr.y' 2024-03-30T13:54:39.751 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:54:39 smithi099 ceph-mon[29691]: pgmap v137: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 859 B/s rd, 0 op/s 2024-03-30T13:54:39.751 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:54:39 smithi099 ceph-mon[29691]: pgmap v138: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 1.0 KiB/s rd, 1 op/s 2024-03-30T13:54:39.751 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:54:39 smithi099 ceph-mon[29691]: from='mgr.25057 ' entity='mgr.y' 2024-03-30T13:54:39.751 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:54:39 smithi099 ceph-mon[24912]: from='mgr.25057 ' entity='mgr.y' 2024-03-30T13:54:39.751 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:54:39 smithi099 ceph-mon[24912]: from='mgr.25057 ' entity='mgr.y' 2024-03-30T13:54:39.752 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:54:39 smithi099 ceph-mon[24912]: pgmap v137: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 859 B/s rd, 0 op/s 2024-03-30T13:54:39.752 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:54:39 smithi099 ceph-mon[24912]: pgmap v138: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 1.0 KiB/s rd, 1 op/s 2024-03-30T13:54:39.752 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:54:39 smithi099 ceph-mon[24912]: from='mgr.25057 ' entity='mgr.y' 2024-03-30T13:54:39.752 INFO:teuthology.orchestra.run.smithi099.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-03-30T13:54:39.752 INFO:teuthology.orchestra.run.smithi099.stdout:agent.smithi099 smithi099 running 1s ago 22m - - 2024-03-30T13:54:39.752 INFO:teuthology.orchestra.run.smithi099.stdout:agent.smithi181 smithi181 running 19s ago 22m - - 2024-03-30T13:54:39.752 INFO:teuthology.orchestra.run.smithi099.stdout:alertmanager.a smithi099 *:9093,9094 running (9m) 1s ago 17m 23.7M - 0.23.0 ba2b418f427c 0f1be3801027 2024-03-30T13:54:39.752 INFO:teuthology.orchestra.run.smithi099.stdout:grafana.a smithi181 *:3000 error 19s ago 16m - - 2024-03-30T13:54:39.752 INFO:teuthology.orchestra.run.smithi099.stdout:iscsi.foo.smithi099.qyjuvr smithi099 running (2m) 1s ago 16m 55.0M - 3.5 e1d6a67b021e 9b47e600970f 2024-03-30T13:54:39.752 INFO:teuthology.orchestra.run.smithi099.stdout:mgr.x smithi181 *:8443,9283 running (12m) 19s ago 22m 449M - 19.0.0-1967-g4e50bbcd b0c4478f1d83 f3d971ab3b10 2024-03-30T13:54:39.752 INFO:teuthology.orchestra.run.smithi099.stdout:mgr.y smithi099 *:8443,9283,8765 running (5m) 1s ago 23m 513M - 19.0.0-1967-g4e50bbcd b0c4478f1d83 0d464b8c1d18 2024-03-30T13:54:39.752 INFO:teuthology.orchestra.run.smithi099.stdout:mon.a smithi099 running (23m) 1s ago 23m 76.7M 2048M 17.2.0 e1d6a67b021e af06ebb19fd8 2024-03-30T13:54:39.752 INFO:teuthology.orchestra.run.smithi099.stdout:mon.b smithi181 running (22m) 19s ago 22m 53.1M 2048M 17.2.0 e1d6a67b021e e678a2a25c90 2024-03-30T13:54:39.753 INFO:teuthology.orchestra.run.smithi099.stdout:mon.c smithi099 running (22m) 1s ago 22m 52.4M 2048M 17.2.0 e1d6a67b021e 0f1e98917718 2024-03-30T13:54:39.753 INFO:teuthology.orchestra.run.smithi099.stdout:node-exporter.a smithi099 *:9100 running (9m) 1s ago 18m 18.6M - 1.3.1 1dbe0e931976 76284405d5f5 2024-03-30T13:54:39.753 INFO:teuthology.orchestra.run.smithi099.stdout:node-exporter.b smithi181 *:9100 running (8m) 19s ago 18m 16.6M - 1.3.1 1dbe0e931976 90245951476f 2024-03-30T13:54:39.753 INFO:teuthology.orchestra.run.smithi099.stdout:osd.0 smithi099 running (21m) 1s ago 21m 53.1M 2736M 17.2.0 e1d6a67b021e 3158ee1b0c67 2024-03-30T13:54:39.753 INFO:teuthology.orchestra.run.smithi099.stdout:osd.1 smithi099 running (21m) 1s ago 21m 55.9M 2736M 17.2.0 e1d6a67b021e c4af0fd7071a 2024-03-30T13:54:39.753 INFO:teuthology.orchestra.run.smithi099.stdout:osd.2 smithi099 running (21m) 1s ago 21m 49.1M 2736M 17.2.0 e1d6a67b021e 8e4e805a7e20 2024-03-30T13:54:39.753 INFO:teuthology.orchestra.run.smithi099.stdout:osd.3 smithi099 running (20m) 1s ago 20m 53.0M 2736M 17.2.0 e1d6a67b021e 718812bcf065 2024-03-30T13:54:39.753 INFO:teuthology.orchestra.run.smithi099.stdout:osd.4 smithi181 running (20m) 19s ago 20m 52.4M 4096M 17.2.0 e1d6a67b021e 5e205434e973 2024-03-30T13:54:39.753 INFO:teuthology.orchestra.run.smithi099.stdout:osd.5 smithi181 running (19m) 19s ago 19m 51.4M 4096M 17.2.0 e1d6a67b021e e330c920f152 2024-03-30T13:54:39.753 INFO:teuthology.orchestra.run.smithi099.stdout:osd.6 smithi181 running (19m) 19s ago 19m 50.3M 4096M 17.2.0 e1d6a67b021e 81d889ea213d 2024-03-30T13:54:39.753 INFO:teuthology.orchestra.run.smithi099.stdout:osd.7 smithi181 running (19m) 19s ago 19m 51.9M 4096M 17.2.0 e1d6a67b021e c08b1839dd7e 2024-03-30T13:54:39.753 INFO:teuthology.orchestra.run.smithi099.stdout:prometheus.a smithi181 *:9095 running (2m) 19s ago 18m 69.4M - 2.33.4 514e6a882f6e 9bcfb373cf8c 2024-03-30T13:54:39.753 INFO:teuthology.orchestra.run.smithi099.stdout:rgw.foo.smithi099.fxjbmp smithi099 *:8000 running (16m) 1s ago 16m 74.3M - 17.2.0 e1d6a67b021e 400b28b3f650 2024-03-30T13:54:39.753 INFO:teuthology.orchestra.run.smithi099.stdout:rgw.foo.smithi181.wfqwti smithi181 *:8000 running (16m) 19s ago 16m 74.2M - 17.2.0 e1d6a67b021e 97e1b130f9d4 2024-03-30T13:54:39.754 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:54:39 smithi181 ceph-mon[25762]: from='mgr.25057 ' entity='mgr.y' 2024-03-30T13:54:39.754 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:54:39 smithi181 ceph-mon[25762]: from='mgr.25057 ' entity='mgr.y' 2024-03-30T13:54:39.754 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:54:39 smithi181 ceph-mon[25762]: pgmap v137: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 859 B/s rd, 0 op/s 2024-03-30T13:54:39.754 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:54:39 smithi181 ceph-mon[25762]: pgmap v138: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 1.0 KiB/s rd, 1 op/s 2024-03-30T13:54:39.754 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:54:39 smithi181 ceph-mon[25762]: from='mgr.25057 ' entity='mgr.y' 2024-03-30T13:54:40.443 DEBUG:teuthology.orchestra.run.smithi099:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 98ebaeb8-ee99-11ee-b647-cb9ed24678a4 -e sha1=4e50bbcdd1630c7760b708f3a5b4d38a121e66cb -- bash -c 'ceph versions' 2024-03-30T13:54:40.700 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:54:40 smithi099 ceph-mon[24912]: from='client.15252 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T13:54:40.700 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:54:40 smithi099 ceph-mon[24912]: from='client.15237 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T13:54:40.700 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:54:40 smithi099 ceph-mon[29691]: from='client.15252 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T13:54:40.700 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:54:40 smithi099 ceph-mon[29691]: from='client.15237 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T13:54:40.752 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:54:40 smithi181 ceph-mon[25762]: from='client.15252 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T13:54:40.752 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:54:40 smithi181 ceph-mon[25762]: from='client.15237 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T13:54:41.770 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:54:41 smithi099 ceph-mon[24912]: pgmap v139: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 1.0 KiB/s rd, 1 op/s 2024-03-30T13:54:41.770 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:54:41 smithi099 ceph-mon[24912]: from='mgr.25057 ' entity='mgr.y' 2024-03-30T13:54:41.770 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:54:41 smithi099 ceph-mon[24912]: from='mgr.25057 ' entity='mgr.y' 2024-03-30T13:54:41.770 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:54:41 smithi099 ceph-mon[24912]: pgmap v140: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T13:54:41.770 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:54:41 smithi099 ceph-mon[24912]: pgmap v141: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 835 B/s rd, 0 op/s 2024-03-30T13:54:41.770 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:54:41 smithi099 ceph-mon[24912]: from='mgr.25057 ' entity='mgr.y' 2024-03-30T13:54:41.771 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:54:41 smithi099 ceph-mon[29691]: pgmap v139: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 1.0 KiB/s rd, 1 op/s 2024-03-30T13:54:41.771 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:54:41 smithi099 ceph-mon[29691]: from='mgr.25057 ' entity='mgr.y' 2024-03-30T13:54:41.771 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:54:41 smithi099 ceph-mon[29691]: from='mgr.25057 ' entity='mgr.y' 2024-03-30T13:54:41.771 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:54:41 smithi099 ceph-mon[29691]: pgmap v140: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T13:54:41.771 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:54:41 smithi099 ceph-mon[29691]: pgmap v141: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 835 B/s rd, 0 op/s 2024-03-30T13:54:41.771 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:54:41 smithi099 ceph-mon[29691]: from='mgr.25057 ' entity='mgr.y' 2024-03-30T13:54:42.002 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:54:41 smithi181 ceph-mon[25762]: pgmap v139: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 1.0 KiB/s rd, 1 op/s 2024-03-30T13:54:42.003 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:54:41 smithi181 ceph-mon[25762]: from='mgr.25057 ' entity='mgr.y' 2024-03-30T13:54:42.003 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:54:41 smithi181 ceph-mon[25762]: from='mgr.25057 ' entity='mgr.y' 2024-03-30T13:54:42.003 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:54:41 smithi181 ceph-mon[25762]: pgmap v140: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T13:54:42.003 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:54:41 smithi181 ceph-mon[25762]: pgmap v141: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 835 B/s rd, 0 op/s 2024-03-30T13:54:42.003 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:54:41 smithi181 ceph-mon[25762]: from='mgr.25057 ' entity='mgr.y' 2024-03-30T13:54:42.594 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-03-30T13:54:42.594 INFO:teuthology.orchestra.run.smithi099.stdout: "mon": { 2024-03-30T13:54:42.594 INFO:teuthology.orchestra.run.smithi099.stdout: "ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)": 3 2024-03-30T13:54:42.594 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:54:42.594 INFO:teuthology.orchestra.run.smithi099.stdout: "mgr": { 2024-03-30T13:54:42.594 INFO:teuthology.orchestra.run.smithi099.stdout: "ceph version 19.0.0-1967-g4e50bbcd (4e50bbcdd1630c7760b708f3a5b4d38a121e66cb) squid (dev)": 2 2024-03-30T13:54:42.594 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:54:42.594 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": { 2024-03-30T13:54:42.594 INFO:teuthology.orchestra.run.smithi099.stdout: "ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)": 8 2024-03-30T13:54:42.594 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:54:42.594 INFO:teuthology.orchestra.run.smithi099.stdout: "mds": {}, 2024-03-30T13:54:42.595 INFO:teuthology.orchestra.run.smithi099.stdout: "rgw": { 2024-03-30T13:54:42.595 INFO:teuthology.orchestra.run.smithi099.stdout: "ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)": 2 2024-03-30T13:54:42.595 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:54:42.595 INFO:teuthology.orchestra.run.smithi099.stdout: "overall": { 2024-03-30T13:54:42.595 INFO:teuthology.orchestra.run.smithi099.stdout: "ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)": 13, 2024-03-30T13:54:42.595 INFO:teuthology.orchestra.run.smithi099.stdout: "ceph version 19.0.0-1967-g4e50bbcd (4e50bbcdd1630c7760b708f3a5b4d38a121e66cb) squid (dev)": 2 2024-03-30T13:54:42.595 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-03-30T13:54:42.595 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-03-30T13:54:42.700 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:54:42 smithi099 ceph-mon[24912]: from='client.? 172.21.15.99:0/2888418552' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:54:42.700 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:54:42 smithi099 ceph-mon[29691]: from='client.? 172.21.15.99:0/2888418552' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:54:43.002 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:54:42 smithi181 ceph-mon[25762]: from='client.? 172.21.15.99:0/2888418552' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:54:43.833 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:54:43 smithi099 ceph-mon[24912]: pgmap v142: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 835 B/s rd, 0 op/s 2024-03-30T13:54:43.833 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:54:43 smithi099 ceph-mon[29691]: pgmap v142: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 835 B/s rd, 0 op/s 2024-03-30T13:54:43.896 DEBUG:teuthology.orchestra.run.smithi099:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 98ebaeb8-ee99-11ee-b647-cb9ed24678a4 -e sha1=4e50bbcdd1630c7760b708f3a5b4d38a121e66cb -- bash -c 'ceph -s' 2024-03-30T13:54:44.002 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:54:43 smithi181 ceph-mon[25762]: pgmap v142: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 835 B/s rd, 0 op/s 2024-03-30T13:54:45.083 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:54:44 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[71049]: ::ffff:172.21.15.181 - - [30/Mar/2024:13:54:44] "GET /metrics HTTP/1.1" 200 37983 "" "Prometheus/2.33.4" 2024-03-30T13:54:45.893 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:54:45 smithi099 ceph-mon[24912]: pgmap v143: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-03-30T13:54:45.893 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:54:45 smithi099 ceph-mon[29691]: pgmap v143: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-03-30T13:54:46.043 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:54:45 smithi181 ceph-mon[25762]: pgmap v143: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-03-30T13:54:46.505 INFO:teuthology.orchestra.run.smithi099.stdout: cluster: 2024-03-30T13:54:46.505 INFO:teuthology.orchestra.run.smithi099.stdout: id: 98ebaeb8-ee99-11ee-b647-cb9ed24678a4 2024-03-30T13:54:46.505 INFO:teuthology.orchestra.run.smithi099.stdout: health: HEALTH_WARN 2024-03-30T13:54:46.505 INFO:teuthology.orchestra.run.smithi099.stdout: 1 failed cephadm daemon(s) 2024-03-30T13:54:46.505 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-03-30T13:54:46.506 INFO:teuthology.orchestra.run.smithi099.stdout: services: 2024-03-30T13:54:46.506 INFO:teuthology.orchestra.run.smithi099.stdout: mon: 3 daemons, quorum a,c,b (age 22m) 2024-03-30T13:54:46.506 INFO:teuthology.orchestra.run.smithi099.stdout: mgr: y(active, since 3m), standbys: x 2024-03-30T13:54:46.506 INFO:teuthology.orchestra.run.smithi099.stdout: osd: 8 osds: 8 up (since 19m), 8 in (since 19m) 2024-03-30T13:54:46.506 INFO:teuthology.orchestra.run.smithi099.stdout: rgw: 2 daemons active (2 hosts, 1 zones) 2024-03-30T13:54:46.506 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-03-30T13:54:46.506 INFO:teuthology.orchestra.run.smithi099.stdout: data: 2024-03-30T13:54:46.506 INFO:teuthology.orchestra.run.smithi099.stdout: pools: 6 pools, 161 pgs 2024-03-30T13:54:46.506 INFO:teuthology.orchestra.run.smithi099.stdout: objects: 209 objects, 585 KiB 2024-03-30T13:54:46.506 INFO:teuthology.orchestra.run.smithi099.stdout: usage: 95 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:54:46.506 INFO:teuthology.orchestra.run.smithi099.stdout: pgs: 161 active+clean 2024-03-30T13:54:46.506 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-03-30T13:54:46.506 INFO:teuthology.orchestra.run.smithi099.stdout: io: 2024-03-30T13:54:46.507 INFO:teuthology.orchestra.run.smithi099.stdout: client: 1.6 KiB/s rd, 1 op/s rd, 0 op/s wr 2024-03-30T13:54:46.507 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-03-30T13:54:47.002 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:54:46 smithi181 ceph-mon[25762]: from='client.? 172.21.15.99:0/426904049' entity='client.admin' cmd=[{"prefix": "status"}]: dispatch 2024-03-30T13:54:47.083 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:54:46 smithi099 ceph-mon[29691]: from='client.? 172.21.15.99:0/426904049' entity='client.admin' cmd=[{"prefix": "status"}]: dispatch 2024-03-30T13:54:47.083 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:54:46 smithi099 ceph-mon[24912]: from='client.? 172.21.15.99:0/426904049' entity='client.admin' cmd=[{"prefix": "status"}]: dispatch 2024-03-30T13:54:47.762 DEBUG:teuthology.orchestra.run.smithi099:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 98ebaeb8-ee99-11ee-b647-cb9ed24678a4 -e sha1=4e50bbcdd1630c7760b708f3a5b4d38a121e66cb -- bash -c 'ceph health detail' 2024-03-30T13:54:48.075 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:54:47 smithi099 ceph-mon[24912]: pgmap v144: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T13:54:48.075 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:54:47 smithi099 ceph-mon[29691]: pgmap v144: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T13:54:48.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:54:47 smithi181 ceph-mon[25762]: pgmap v144: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T13:54:49.024 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:54:48 smithi099 ceph-mon[24912]: from='mgr.25057 172.21.15.99:0/1165207787' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T13:54:49.024 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:54:48 smithi099 ceph-mon[29691]: from='mgr.25057 172.21.15.99:0/1165207787' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T13:54:49.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:54:48 smithi181 ceph-mon[25762]: from='mgr.25057 172.21.15.99:0/1165207787' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T13:54:49.765 INFO:teuthology.orchestra.run.smithi099.stdout:HEALTH_WARN 1 failed cephadm daemon(s) 2024-03-30T13:54:49.765 INFO:teuthology.orchestra.run.smithi099.stdout:[WRN] CEPHADM_FAILED_DAEMON: 1 failed cephadm daemon(s) 2024-03-30T13:54:49.765 INFO:teuthology.orchestra.run.smithi099.stdout: daemon grafana.a on smithi181 is in error state 2024-03-30T13:54:50.083 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:54:49 smithi099 ceph-mon[24912]: pgmap v145: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 622 B/s rd, 0 op/s 2024-03-30T13:54:50.083 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:54:49 smithi099 ceph-mon[24912]: from='client.? 172.21.15.99:0/1121065072' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-03-30T13:54:50.083 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:54:49 smithi099 ceph-mon[29691]: pgmap v145: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 622 B/s rd, 0 op/s 2024-03-30T13:54:50.083 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:54:49 smithi099 ceph-mon[29691]: from='client.? 172.21.15.99:0/1121065072' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-03-30T13:54:50.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:54:49 smithi181 ceph-mon[25762]: pgmap v145: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 622 B/s rd, 0 op/s 2024-03-30T13:54:50.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:54:49 smithi181 ceph-mon[25762]: from='client.? 172.21.15.99:0/1121065072' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-03-30T13:54:50.441 DEBUG:teuthology.orchestra.run.smithi099:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 98ebaeb8-ee99-11ee-b647-cb9ed24678a4 -e sha1=4e50bbcdd1630c7760b708f3a5b4d38a121e66cb -- bash -c 'ceph versions | jq -e '"'"'.mgr | length == 1'"'"'' 2024-03-30T13:54:51.083 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:54:50 smithi099 ceph-mon[24912]: from='client.15237 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T13:54:51.083 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:54:50 smithi099 ceph-mon[24912]: from='mgr.25057 172.21.15.99:0/1165207787' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:54:51.083 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:54:50 smithi099 ceph-mon[24912]: from='mgr.25057 172.21.15.99:0/1165207787' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:54:51.083 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:54:50 smithi099 ceph-mon[24912]: from='mgr.25057 ' entity='mgr.y' 2024-03-30T13:54:51.083 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:54:50 smithi099 ceph-mon[29691]: from='client.15237 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T13:54:51.084 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:54:50 smithi099 ceph-mon[29691]: from='mgr.25057 172.21.15.99:0/1165207787' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:54:51.084 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:54:50 smithi099 ceph-mon[29691]: from='mgr.25057 172.21.15.99:0/1165207787' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:54:51.084 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:54:50 smithi099 ceph-mon[29691]: from='mgr.25057 ' entity='mgr.y' 2024-03-30T13:54:51.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:54:50 smithi181 ceph-mon[25762]: from='client.15237 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T13:54:51.253 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:54:50 smithi181 ceph-mon[25762]: from='mgr.25057 172.21.15.99:0/1165207787' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:54:51.253 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:54:50 smithi181 ceph-mon[25762]: from='mgr.25057 172.21.15.99:0/1165207787' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:54:51.253 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:54:50 smithi181 ceph-mon[25762]: from='mgr.25057 ' entity='mgr.y' 2024-03-30T13:54:52.038 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:54:51 smithi099 ceph-mon[24912]: pgmap v146: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 1.0 KiB/s rd, 1 op/s 2024-03-30T13:54:52.038 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:54:51 smithi099 ceph-mon[24912]: pgmap v147: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 1.0 KiB/s rd, 1 op/s 2024-03-30T13:54:52.038 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:54:51 smithi099 ceph-mon[29691]: pgmap v146: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 1.0 KiB/s rd, 1 op/s 2024-03-30T13:54:52.038 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:54:51 smithi099 ceph-mon[29691]: pgmap v147: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 1.0 KiB/s rd, 1 op/s 2024-03-30T13:54:52.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:54:51 smithi181 ceph-mon[25762]: pgmap v146: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 1.0 KiB/s rd, 1 op/s 2024-03-30T13:54:52.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:54:51 smithi181 ceph-mon[25762]: pgmap v147: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 1.0 KiB/s rd, 1 op/s 2024-03-30T13:54:52.543 INFO:teuthology.orchestra.run.smithi099.stdout:true 2024-03-30T13:54:53.083 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:54:52 smithi099 ceph-mon[29691]: from='client.? 172.21.15.99:0/3284972861' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:54:53.083 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:54:52 smithi099 ceph-mon[24912]: from='client.? 172.21.15.99:0/3284972861' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:54:53.172 DEBUG:teuthology.orchestra.run.smithi099:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 98ebaeb8-ee99-11ee-b647-cb9ed24678a4 -e sha1=4e50bbcdd1630c7760b708f3a5b4d38a121e66cb -- bash -c 'ceph mgr fail' 2024-03-30T13:54:53.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:54:52 smithi181 ceph-mon[25762]: from='client.? 172.21.15.99:0/3284972861' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:54:54.083 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:54:53 smithi099 ceph-mon[24912]: pgmap v148: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 1.0 KiB/s rd, 1 op/s 2024-03-30T13:54:54.083 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:54:53 smithi099 ceph-mon[29691]: pgmap v148: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 1.0 KiB/s rd, 1 op/s 2024-03-30T13:54:54.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:54:53 smithi181 ceph-mon[25762]: pgmap v148: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 1.0 KiB/s rd, 1 op/s 2024-03-30T13:54:55.083 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:54:54 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[71049]: ::ffff:172.21.15.181 - - [30/Mar/2024:13:54:54] "GET /metrics HTTP/1.1" 200 37987 "" "Prometheus/2.33.4" 2024-03-30T13:54:56.060 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:54:55 smithi099 ceph-mon[24912]: pgmap v149: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 1.0 KiB/s rd, 1 op/s 2024-03-30T13:54:56.060 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:54:55 smithi099 ceph-mon[24912]: from='client.? 172.21.15.99:0/1238959113' entity='client.admin' cmd=[{"prefix": "mgr fail"}]: dispatch 2024-03-30T13:54:56.060 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:54:55 smithi099 ceph-mon[24912]: from='client.? ' entity='client.admin' cmd=[{"prefix": "mgr fail"}]: dispatch 2024-03-30T13:54:56.060 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:54:55 smithi099 ceph-mon[24912]: osdmap e105: 8 total, 8 up, 8 in 2024-03-30T13:54:56.060 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:54:55 smithi099 ceph-mon[29691]: pgmap v149: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 1.0 KiB/s rd, 1 op/s 2024-03-30T13:54:56.060 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:54:55 smithi099 ceph-mon[29691]: from='client.? 172.21.15.99:0/1238959113' entity='client.admin' cmd=[{"prefix": "mgr fail"}]: dispatch 2024-03-30T13:54:56.060 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:54:55 smithi099 ceph-mon[29691]: from='client.? ' entity='client.admin' cmd=[{"prefix": "mgr fail"}]: dispatch 2024-03-30T13:54:56.061 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:54:55 smithi099 ceph-mon[29691]: osdmap e105: 8 total, 8 up, 8 in 2024-03-30T13:54:56.061 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:54:55 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[71049]: 2024-03-30T13:54:55.841+0000 7fd4e7956700 -1 mgr handle_mgr_map I was active but no longer am 2024-03-30T13:54:56.061 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:54:55 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[71049]: ignoring --setuser ceph since I am not root 2024-03-30T13:54:56.061 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:54:55 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[71049]: ignoring --setgroup ceph since I am not root 2024-03-30T13:54:56.061 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:54:55 smithi099 ceph-mgr[71053]: -- 172.21.15.99:0/534349282 <== mon.0 v2:172.21.15.99:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5600180e25a0 con 0x5600180b7000 2024-03-30T13:54:56.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:54:55 smithi181 ceph-mon[25762]: pgmap v149: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 1.0 KiB/s rd, 1 op/s 2024-03-30T13:54:56.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:54:55 smithi181 ceph-mon[25762]: from='client.? 172.21.15.99:0/1238959113' entity='client.admin' cmd=[{"prefix": "mgr fail"}]: dispatch 2024-03-30T13:54:56.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:54:55 smithi181 ceph-mon[25762]: from='client.? ' entity='client.admin' cmd=[{"prefix": "mgr fail"}]: dispatch 2024-03-30T13:54:56.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:54:55 smithi181 ceph-mon[25762]: osdmap e105: 8 total, 8 up, 8 in 2024-03-30T13:54:56.253 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 13:54:55 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-x[50211]: [30/Mar/2024:13:54:55] ENGINE Bus STOPPING 2024-03-30T13:54:56.253 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 13:54:55 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-x[50211]: [30/Mar/2024:13:54:55] ENGINE HTTP Server cherrypy._cpwsgi_server.CPWSGIServer(('::', 9283)) shut down 2024-03-30T13:54:56.253 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 13:54:55 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-x[50211]: [30/Mar/2024:13:54:55] ENGINE Bus STOPPED 2024-03-30T13:54:56.253 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 13:54:55 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-x[50211]: [30/Mar/2024:13:54:55] ENGINE Bus STARTING 2024-03-30T13:54:56.253 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 13:54:56 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-x[50211]: [30/Mar/2024:13:54:56] ENGINE Serving on http://:::9283 2024-03-30T13:54:56.253 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 13:54:56 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-x[50211]: [30/Mar/2024:13:54:56] ENGINE Bus STARTED 2024-03-30T13:54:56.520 DEBUG:teuthology.orchestra.run.smithi099:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 98ebaeb8-ee99-11ee-b647-cb9ed24678a4 -e sha1=4e50bbcdd1630c7760b708f3a5b4d38a121e66cb -- bash -c 'sleep 180' 2024-03-30T13:54:56.833 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:54:56 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[71049]: 2024-03-30T13:54:56.449+0000 7f5ff8116200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-03-30T13:54:56.833 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:54:56 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[71049]: 2024-03-30T13:54:56.549+0000 7f5ff8116200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-03-30T13:54:57.145 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:54:56 smithi099 ceph-mon[29691]: from='client.? ' entity='client.admin' cmd='[{"prefix": "mgr fail"}]': finished 2024-03-30T13:54:57.145 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:54:56 smithi099 ceph-mon[29691]: mgrmap e32: x(active, starting, since 0.69185s) 2024-03-30T13:54:57.145 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:54:56 smithi099 ceph-mon[29691]: from='mgr.24890 172.21.15.181:0/1979512792' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-03-30T13:54:57.146 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:54:56 smithi099 ceph-mon[29691]: from='mgr.24890 172.21.15.181:0/1979512792' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-30T13:54:57.146 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:54:56 smithi099 ceph-mon[29691]: from='mgr.24890 172.21.15.181:0/1979512792' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-30T13:54:57.146 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:54:56 smithi099 ceph-mon[29691]: from='mgr.24890 172.21.15.181:0/1979512792' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-03-30T13:54:57.146 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:54:56 smithi099 ceph-mon[29691]: from='mgr.24890 172.21.15.181:0/1979512792' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-03-30T13:54:57.146 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:54:56 smithi099 ceph-mon[29691]: from='mgr.24890 172.21.15.181:0/1979512792' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-03-30T13:54:57.146 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:54:56 smithi099 ceph-mon[29691]: from='mgr.24890 172.21.15.181:0/1979512792' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-03-30T13:54:57.146 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:54:56 smithi099 ceph-mon[29691]: from='mgr.24890 172.21.15.181:0/1979512792' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-03-30T13:54:57.146 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:54:56 smithi099 ceph-mon[29691]: from='mgr.24890 172.21.15.181:0/1979512792' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-03-30T13:54:57.146 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:54:56 smithi099 ceph-mon[29691]: from='mgr.24890 172.21.15.181:0/1979512792' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-03-30T13:54:57.146 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:54:56 smithi099 ceph-mon[29691]: from='mgr.24890 172.21.15.181:0/1979512792' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-03-30T13:54:57.146 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:54:56 smithi099 ceph-mon[29691]: from='mgr.24890 172.21.15.181:0/1979512792' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-03-30T13:54:57.146 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:54:56 smithi099 ceph-mon[29691]: from='mgr.24890 172.21.15.181:0/1979512792' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-03-30T13:54:57.146 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:54:56 smithi099 ceph-mon[29691]: from='mgr.24890 172.21.15.181:0/1979512792' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-03-30T13:54:57.146 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:54:56 smithi099 ceph-mon[29691]: from='mgr.24890 172.21.15.181:0/1979512792' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-03-30T13:54:57.147 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:54:56 smithi099 ceph-mon[29691]: Manager daemon x is now available 2024-03-30T13:54:57.147 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:54:56 smithi099 ceph-mon[29691]: from='mgr.24890 ' entity='mgr.x' 2024-03-30T13:54:57.147 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:54:56 smithi099 ceph-mon[29691]: from='mgr.24890 172.21.15.181:0/1979512792' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.agent.smithi181", "caps": []}]: dispatch 2024-03-30T13:54:57.147 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:54:56 smithi099 ceph-mon[29691]: from='mgr.24890 ' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.agent.smithi181", "caps": []}]: dispatch 2024-03-30T13:54:57.147 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:54:56 smithi099 ceph-mon[29691]: from='mgr.24890 172.21.15.181:0/1979512792' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.agent.smithi099", "caps": []}]: dispatch 2024-03-30T13:54:57.147 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:54:56 smithi099 ceph-mon[29691]: from='mgr.24890 ' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.agent.smithi099", "caps": []}]: dispatch 2024-03-30T13:54:57.147 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:54:56 smithi099 ceph-mon[29691]: from='mgr.24890 172.21.15.181:0/1979512792' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T13:54:57.147 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:54:56 smithi099 ceph-mon[29691]: from='mgr.24890 172.21.15.181:0/1979512792' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-03-30T13:54:57.147 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:54:56 smithi099 ceph-mon[29691]: from='mgr.24890 ' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-03-30T13:54:57.147 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:54:56 smithi099 ceph-mon[29691]: from='mgr.24890 172.21.15.181:0/1979512792' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-03-30T13:54:57.147 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:54:56 smithi099 ceph-mon[29691]: from='mgr.24890 ' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-03-30T13:54:57.147 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:54:56 smithi099 ceph-mon[29691]: from='mgr.24890 172.21.15.181:0/1979512792' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi181", "name": "osd_memory_target"}]: dispatch 2024-03-30T13:54:57.147 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:54:56 smithi099 ceph-mon[29691]: from='mgr.24890 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi181", "name": "osd_memory_target"}]: dispatch 2024-03-30T13:54:57.148 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:54:56 smithi099 ceph-mon[24912]: from='client.? ' entity='client.admin' cmd='[{"prefix": "mgr fail"}]': finished 2024-03-30T13:54:57.148 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:54:56 smithi099 ceph-mon[24912]: mgrmap e32: x(active, starting, since 0.69185s) 2024-03-30T13:54:57.148 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:54:56 smithi099 ceph-mon[24912]: from='mgr.24890 172.21.15.181:0/1979512792' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-03-30T13:54:57.148 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:54:56 smithi099 ceph-mon[24912]: from='mgr.24890 172.21.15.181:0/1979512792' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-30T13:54:57.148 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:54:56 smithi099 ceph-mon[24912]: from='mgr.24890 172.21.15.181:0/1979512792' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-30T13:54:57.148 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:54:56 smithi099 ceph-mon[24912]: from='mgr.24890 172.21.15.181:0/1979512792' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-03-30T13:54:57.148 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:54:56 smithi099 ceph-mon[24912]: from='mgr.24890 172.21.15.181:0/1979512792' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-03-30T13:54:57.148 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:54:56 smithi099 ceph-mon[24912]: from='mgr.24890 172.21.15.181:0/1979512792' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-03-30T13:54:57.148 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:54:56 smithi099 ceph-mon[24912]: from='mgr.24890 172.21.15.181:0/1979512792' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-03-30T13:54:57.148 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:54:56 smithi099 ceph-mon[24912]: from='mgr.24890 172.21.15.181:0/1979512792' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-03-30T13:54:57.148 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:54:56 smithi099 ceph-mon[24912]: from='mgr.24890 172.21.15.181:0/1979512792' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-03-30T13:54:57.149 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:54:56 smithi099 ceph-mon[24912]: from='mgr.24890 172.21.15.181:0/1979512792' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-03-30T13:54:57.149 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:54:56 smithi099 ceph-mon[24912]: from='mgr.24890 172.21.15.181:0/1979512792' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-03-30T13:54:57.149 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:54:56 smithi099 ceph-mon[24912]: from='mgr.24890 172.21.15.181:0/1979512792' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-03-30T13:54:57.149 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:54:56 smithi099 ceph-mon[24912]: from='mgr.24890 172.21.15.181:0/1979512792' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-03-30T13:54:57.149 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:54:56 smithi099 ceph-mon[24912]: from='mgr.24890 172.21.15.181:0/1979512792' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-03-30T13:54:57.149 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:54:56 smithi099 ceph-mon[24912]: from='mgr.24890 172.21.15.181:0/1979512792' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-03-30T13:54:57.149 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:54:56 smithi099 ceph-mon[24912]: Manager daemon x is now available 2024-03-30T13:54:57.149 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:54:56 smithi099 ceph-mon[24912]: from='mgr.24890 ' entity='mgr.x' 2024-03-30T13:54:57.149 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:54:56 smithi099 ceph-mon[24912]: from='mgr.24890 172.21.15.181:0/1979512792' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.agent.smithi181", "caps": []}]: dispatch 2024-03-30T13:54:57.149 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:54:56 smithi099 ceph-mon[24912]: from='mgr.24890 ' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.agent.smithi181", "caps": []}]: dispatch 2024-03-30T13:54:57.149 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:54:56 smithi099 ceph-mon[24912]: from='mgr.24890 172.21.15.181:0/1979512792' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.agent.smithi099", "caps": []}]: dispatch 2024-03-30T13:54:57.149 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:54:56 smithi099 ceph-mon[24912]: from='mgr.24890 ' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.agent.smithi099", "caps": []}]: dispatch 2024-03-30T13:54:57.149 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:54:56 smithi099 ceph-mon[24912]: from='mgr.24890 172.21.15.181:0/1979512792' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T13:54:57.149 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:54:56 smithi099 ceph-mon[24912]: from='mgr.24890 172.21.15.181:0/1979512792' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-03-30T13:54:57.150 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:54:56 smithi099 ceph-mon[24912]: from='mgr.24890 ' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-03-30T13:54:57.150 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:54:56 smithi099 ceph-mon[24912]: from='mgr.24890 172.21.15.181:0/1979512792' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-03-30T13:54:57.150 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:54:56 smithi099 ceph-mon[24912]: from='mgr.24890 ' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-03-30T13:54:57.150 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:54:56 smithi099 ceph-mon[24912]: from='mgr.24890 172.21.15.181:0/1979512792' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi181", "name": "osd_memory_target"}]: dispatch 2024-03-30T13:54:57.150 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:54:56 smithi099 ceph-mon[24912]: from='mgr.24890 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi181", "name": "osd_memory_target"}]: dispatch 2024-03-30T13:54:57.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:54:56 smithi181 ceph-mon[25762]: from='client.? ' entity='client.admin' cmd='[{"prefix": "mgr fail"}]': finished 2024-03-30T13:54:57.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:54:56 smithi181 ceph-mon[25762]: mgrmap e32: x(active, starting, since 0.69185s) 2024-03-30T13:54:57.253 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:54:56 smithi181 ceph-mon[25762]: from='mgr.24890 172.21.15.181:0/1979512792' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-03-30T13:54:57.253 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:54:56 smithi181 ceph-mon[25762]: from='mgr.24890 172.21.15.181:0/1979512792' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-30T13:54:57.253 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:54:56 smithi181 ceph-mon[25762]: from='mgr.24890 172.21.15.181:0/1979512792' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-30T13:54:57.253 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:54:56 smithi181 ceph-mon[25762]: from='mgr.24890 172.21.15.181:0/1979512792' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-03-30T13:54:57.253 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:54:56 smithi181 ceph-mon[25762]: from='mgr.24890 172.21.15.181:0/1979512792' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-03-30T13:54:57.253 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:54:56 smithi181 ceph-mon[25762]: from='mgr.24890 172.21.15.181:0/1979512792' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-03-30T13:54:57.253 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:54:56 smithi181 ceph-mon[25762]: from='mgr.24890 172.21.15.181:0/1979512792' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-03-30T13:54:57.253 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:54:56 smithi181 ceph-mon[25762]: from='mgr.24890 172.21.15.181:0/1979512792' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-03-30T13:54:57.253 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:54:56 smithi181 ceph-mon[25762]: from='mgr.24890 172.21.15.181:0/1979512792' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-03-30T13:54:57.253 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:54:56 smithi181 ceph-mon[25762]: from='mgr.24890 172.21.15.181:0/1979512792' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-03-30T13:54:57.253 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:54:56 smithi181 ceph-mon[25762]: from='mgr.24890 172.21.15.181:0/1979512792' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-03-30T13:54:57.253 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:54:56 smithi181 ceph-mon[25762]: from='mgr.24890 172.21.15.181:0/1979512792' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-03-30T13:54:57.253 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:54:56 smithi181 ceph-mon[25762]: from='mgr.24890 172.21.15.181:0/1979512792' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-03-30T13:54:57.253 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:54:56 smithi181 ceph-mon[25762]: from='mgr.24890 172.21.15.181:0/1979512792' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-03-30T13:54:57.254 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:54:56 smithi181 ceph-mon[25762]: from='mgr.24890 172.21.15.181:0/1979512792' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-03-30T13:54:57.254 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:54:56 smithi181 ceph-mon[25762]: Manager daemon x is now available 2024-03-30T13:54:57.254 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:54:56 smithi181 ceph-mon[25762]: from='mgr.24890 ' entity='mgr.x' 2024-03-30T13:54:57.254 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:54:56 smithi181 ceph-mon[25762]: from='mgr.24890 172.21.15.181:0/1979512792' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.agent.smithi181", "caps": []}]: dispatch 2024-03-30T13:54:57.254 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:54:56 smithi181 ceph-mon[25762]: from='mgr.24890 ' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.agent.smithi181", "caps": []}]: dispatch 2024-03-30T13:54:57.254 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:54:56 smithi181 ceph-mon[25762]: from='mgr.24890 172.21.15.181:0/1979512792' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.agent.smithi099", "caps": []}]: dispatch 2024-03-30T13:54:57.254 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:54:56 smithi181 ceph-mon[25762]: from='mgr.24890 ' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.agent.smithi099", "caps": []}]: dispatch 2024-03-30T13:54:57.254 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:54:56 smithi181 ceph-mon[25762]: from='mgr.24890 172.21.15.181:0/1979512792' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T13:54:57.254 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:54:56 smithi181 ceph-mon[25762]: from='mgr.24890 172.21.15.181:0/1979512792' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-03-30T13:54:57.254 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:54:56 smithi181 ceph-mon[25762]: from='mgr.24890 ' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-03-30T13:54:57.255 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:54:56 smithi181 ceph-mon[25762]: from='mgr.24890 172.21.15.181:0/1979512792' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-03-30T13:54:57.255 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:54:56 smithi181 ceph-mon[25762]: from='mgr.24890 ' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-03-30T13:54:57.255 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:54:56 smithi181 ceph-mon[25762]: from='mgr.24890 172.21.15.181:0/1979512792' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi181", "name": "osd_memory_target"}]: dispatch 2024-03-30T13:54:57.255 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:54:56 smithi181 ceph-mon[25762]: from='mgr.24890 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi181", "name": "osd_memory_target"}]: dispatch 2024-03-30T13:54:57.402 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:54:57 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[71049]: 2024-03-30T13:54:57.265+0000 7f5ff8116200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-03-30T13:54:57.402 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:54:57 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[71049]: 2024-03-30T13:54:57.369+0000 7f5ff8116200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-03-30T13:54:57.712 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:54:57 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[71049]: 2024-03-30T13:54:57.523+0000 7f5ff8116200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-03-30T13:54:57.712 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:54:57 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[71049]: 2024-03-30T13:54:57.624+0000 7f5ff8116200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-03-30T13:54:57.712 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:54:57 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[71049]: 2024-03-30T13:54:57.714+0000 7f5ff8116200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-03-30T13:54:57.973 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:54:57 smithi099 ceph-mon[24912]: [30/Mar/2024:13:54:56] ENGINE Bus STARTING 2024-03-30T13:54:57.973 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:54:57 smithi099 ceph-mon[24912]: [30/Mar/2024:13:54:56] ENGINE Serving on http://172.21.15.181:8765 2024-03-30T13:54:57.973 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:54:57 smithi099 ceph-mon[24912]: [30/Mar/2024:13:54:56] ENGINE Serving on https://172.21.15.181:7150 2024-03-30T13:54:57.974 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:54:57 smithi099 ceph-mon[24912]: [30/Mar/2024:13:54:56] ENGINE Bus STARTED 2024-03-30T13:54:57.974 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:54:57 smithi099 ceph-mon[24912]: mgrmap e33: x(active, since 1.70688s) 2024-03-30T13:54:57.974 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:54:57 smithi099 ceph-mon[24912]: pgmap v3: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:54:57.974 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:54:57 smithi099 ceph-mon[24912]: from='mgr.24890 172.21.15.181:0/1979512792' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi099", "name": "osd_memory_target"}]: dispatch 2024-03-30T13:54:57.974 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:54:57 smithi099 ceph-mon[24912]: from='mgr.24890 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi099", "name": "osd_memory_target"}]: dispatch 2024-03-30T13:54:57.974 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:54:57 smithi099 ceph-mon[24912]: from='mgr.24890 ' entity='mgr.x' cmd='[{"prefix": "config rm", "who": "osd/host:smithi099", "name": "osd_memory_target"}]': finished 2024-03-30T13:54:57.974 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:54:57 smithi099 ceph-mon[24912]: from='mgr.24890 172.21.15.181:0/1979512792' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:54:57.974 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:54:57 smithi099 ceph-mon[24912]: from='mgr.24890 172.21.15.181:0/1979512792' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:54:57.974 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:54:57 smithi099 ceph-mon[24912]: Updating smithi099:/etc/ceph/ceph.conf 2024-03-30T13:54:57.974 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:54:57 smithi099 ceph-mon[24912]: Updating smithi181:/etc/ceph/ceph.conf 2024-03-30T13:54:57.974 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:54:57 smithi099 ceph-mon[24912]: from='mgr.24890 ' entity='mgr.x' 2024-03-30T13:54:57.974 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:54:57 smithi099 ceph-mon[24912]: from='mgr.24890 ' entity='mgr.x' 2024-03-30T13:54:57.974 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:54:57 smithi099 ceph-mon[24912]: from='mgr.24890 ' entity='mgr.x' 2024-03-30T13:54:57.975 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:54:57 smithi099 ceph-mon[24912]: from='mgr.24890 ' entity='mgr.x' 2024-03-30T13:54:57.975 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:54:57 smithi099 ceph-mon[29691]: [30/Mar/2024:13:54:56] ENGINE Bus STARTING 2024-03-30T13:54:57.975 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:54:57 smithi099 ceph-mon[29691]: [30/Mar/2024:13:54:56] ENGINE Serving on http://172.21.15.181:8765 2024-03-30T13:54:57.975 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:54:57 smithi099 ceph-mon[29691]: [30/Mar/2024:13:54:56] ENGINE Serving on https://172.21.15.181:7150 2024-03-30T13:54:57.975 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:54:57 smithi099 ceph-mon[29691]: [30/Mar/2024:13:54:56] ENGINE Bus STARTED 2024-03-30T13:54:57.975 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:54:57 smithi099 ceph-mon[29691]: mgrmap e33: x(active, since 1.70688s) 2024-03-30T13:54:57.975 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:54:57 smithi099 ceph-mon[29691]: pgmap v3: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:54:57.975 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:54:57 smithi099 ceph-mon[29691]: from='mgr.24890 172.21.15.181:0/1979512792' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi099", "name": "osd_memory_target"}]: dispatch 2024-03-30T13:54:57.975 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:54:57 smithi099 ceph-mon[29691]: from='mgr.24890 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi099", "name": "osd_memory_target"}]: dispatch 2024-03-30T13:54:57.975 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:54:57 smithi099 ceph-mon[29691]: from='mgr.24890 ' entity='mgr.x' cmd='[{"prefix": "config rm", "who": "osd/host:smithi099", "name": "osd_memory_target"}]': finished 2024-03-30T13:54:57.976 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:54:57 smithi099 ceph-mon[29691]: from='mgr.24890 172.21.15.181:0/1979512792' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:54:57.976 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:54:57 smithi099 ceph-mon[29691]: from='mgr.24890 172.21.15.181:0/1979512792' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:54:57.976 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:54:57 smithi099 ceph-mon[29691]: Updating smithi099:/etc/ceph/ceph.conf 2024-03-30T13:54:57.976 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:54:57 smithi099 ceph-mon[29691]: Updating smithi181:/etc/ceph/ceph.conf 2024-03-30T13:54:57.976 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:54:57 smithi099 ceph-mon[29691]: from='mgr.24890 ' entity='mgr.x' 2024-03-30T13:54:57.976 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:54:57 smithi099 ceph-mon[29691]: from='mgr.24890 ' entity='mgr.x' 2024-03-30T13:54:57.976 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:54:57 smithi099 ceph-mon[29691]: from='mgr.24890 ' entity='mgr.x' 2024-03-30T13:54:57.976 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:54:57 smithi099 ceph-mon[29691]: from='mgr.24890 ' entity='mgr.x' 2024-03-30T13:54:58.002 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:54:57 smithi181 ceph-mon[25762]: [30/Mar/2024:13:54:56] ENGINE Bus STARTING 2024-03-30T13:54:58.003 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:54:57 smithi181 ceph-mon[25762]: [30/Mar/2024:13:54:56] ENGINE Serving on http://172.21.15.181:8765 2024-03-30T13:54:58.003 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:54:57 smithi181 ceph-mon[25762]: [30/Mar/2024:13:54:56] ENGINE Serving on https://172.21.15.181:7150 2024-03-30T13:54:58.003 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:54:57 smithi181 ceph-mon[25762]: [30/Mar/2024:13:54:56] ENGINE Bus STARTED 2024-03-30T13:54:58.003 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:54:57 smithi181 ceph-mon[25762]: mgrmap e33: x(active, since 1.70688s) 2024-03-30T13:54:58.003 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:54:57 smithi181 ceph-mon[25762]: pgmap v3: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:54:58.003 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:54:57 smithi181 ceph-mon[25762]: from='mgr.24890 172.21.15.181:0/1979512792' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi099", "name": "osd_memory_target"}]: dispatch 2024-03-30T13:54:58.003 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:54:57 smithi181 ceph-mon[25762]: from='mgr.24890 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi099", "name": "osd_memory_target"}]: dispatch 2024-03-30T13:54:58.003 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:54:57 smithi181 ceph-mon[25762]: from='mgr.24890 ' entity='mgr.x' cmd='[{"prefix": "config rm", "who": "osd/host:smithi099", "name": "osd_memory_target"}]': finished 2024-03-30T13:54:58.003 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:54:57 smithi181 ceph-mon[25762]: from='mgr.24890 172.21.15.181:0/1979512792' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:54:58.003 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:54:57 smithi181 ceph-mon[25762]: from='mgr.24890 172.21.15.181:0/1979512792' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:54:58.003 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:54:57 smithi181 ceph-mon[25762]: Updating smithi099:/etc/ceph/ceph.conf 2024-03-30T13:54:58.003 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:54:57 smithi181 ceph-mon[25762]: Updating smithi181:/etc/ceph/ceph.conf 2024-03-30T13:54:58.004 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:54:57 smithi181 ceph-mon[25762]: from='mgr.24890 ' entity='mgr.x' 2024-03-30T13:54:58.004 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:54:57 smithi181 ceph-mon[25762]: from='mgr.24890 ' entity='mgr.x' 2024-03-30T13:54:58.004 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:54:57 smithi181 ceph-mon[25762]: from='mgr.24890 ' entity='mgr.x' 2024-03-30T13:54:58.004 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:54:57 smithi181 ceph-mon[25762]: from='mgr.24890 ' entity='mgr.x' 2024-03-30T13:54:58.261 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:54:58 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[71049]: 2024-03-30T13:54:58.004+0000 7f5ff8116200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-03-30T13:54:58.261 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:54:58 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[71049]: 2024-03-30T13:54:58.132+0000 7f5ff8116200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-03-30T13:54:58.261 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:54:58 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[71049]: 2024-03-30T13:54:58.225+0000 7f5ff8116200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-03-30T13:54:58.521 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:54:58 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[71049]: 2024-03-30T13:54:58.336+0000 7f5ff8116200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-03-30T13:54:58.521 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:54:58 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[71049]: 2024-03-30T13:54:58.523+0000 7f5ff8116200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-03-30T13:54:59.127 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:54:58 smithi181 ceph-mon[25762]: Updating smithi181:/var/lib/ceph/98ebaeb8-ee99-11ee-b647-cb9ed24678a4/config/ceph.conf 2024-03-30T13:54:59.127 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:54:58 smithi181 ceph-mon[25762]: Updating smithi099:/var/lib/ceph/98ebaeb8-ee99-11ee-b647-cb9ed24678a4/config/ceph.conf 2024-03-30T13:54:59.127 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:54:58 smithi181 ceph-mon[25762]: Updating smithi181:/etc/ceph/ceph.client.admin.keyring 2024-03-30T13:54:59.127 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:54:58 smithi181 ceph-mon[25762]: Updating smithi099:/etc/ceph/ceph.client.admin.keyring 2024-03-30T13:54:59.127 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:54:58 smithi181 ceph-mon[25762]: Updating smithi181:/var/lib/ceph/98ebaeb8-ee99-11ee-b647-cb9ed24678a4/config/ceph.client.admin.keyring 2024-03-30T13:54:59.127 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:54:58 smithi181 ceph-mon[25762]: Updating smithi099:/var/lib/ceph/98ebaeb8-ee99-11ee-b647-cb9ed24678a4/config/ceph.client.admin.keyring 2024-03-30T13:54:59.127 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:54:58 smithi181 ceph-mon[25762]: pgmap v4: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:54:59.128 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:54:58 smithi181 ceph-mon[25762]: Health check cleared: CEPHADM_FAILED_DAEMON (was: 1 failed cephadm daemon(s)) 2024-03-30T13:54:59.128 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:54:58 smithi181 ceph-mon[25762]: Cluster is now healthy 2024-03-30T13:54:59.128 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:54:58 smithi181 ceph-mon[25762]: from='mgr.24890 ' entity='mgr.x' 2024-03-30T13:54:59.128 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:54:58 smithi181 ceph-mon[25762]: from='mgr.24890 ' entity='mgr.x' 2024-03-30T13:54:59.128 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:54:58 smithi181 ceph-mon[25762]: from='mgr.24890 ' entity='mgr.x' 2024-03-30T13:54:59.128 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:54:58 smithi181 ceph-mon[25762]: from='mgr.24890 ' entity='mgr.x' 2024-03-30T13:54:59.128 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:54:58 smithi181 ceph-mon[25762]: from='mgr.24890 ' entity='mgr.x' 2024-03-30T13:54:59.128 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:54:58 smithi181 ceph-mon[25762]: from='mgr.24890 ' entity='mgr.x' 2024-03-30T13:54:59.128 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:54:58 smithi181 ceph-mon[25762]: pgmap v5: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:54:59.128 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:54:58 smithi181 ceph-mon[25762]: from='mgr.24890 ' entity='mgr.x' 2024-03-30T13:54:59.128 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:54:58 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:54:59.128 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:54:58 smithi181 ceph-mon[25762]: from='mgr.24890 ' entity='mgr.x' 2024-03-30T13:54:59.128 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:54:58 smithi181 ceph-mon[25762]: from='mgr.24890 172.21.15.181:0/1979512792' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.iscsi.foo.smithi099.qyjuvr", "caps": ["mon", "profile rbd, allow command \"osd blocklist\", allow command \"config-key get\" with \"key\" prefix \"iscsi/\"", "mgr", "allow command \"service status\"", "osd", "allow rwx"]}]: dispatch 2024-03-30T13:54:59.128 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:54:58 smithi181 ceph-mon[25762]: from='mgr.24890 ' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.iscsi.foo.smithi099.qyjuvr", "caps": ["mon", "profile rbd, allow command \"osd blocklist\", allow command \"config-key get\" with \"key\" prefix \"iscsi/\"", "mgr", "allow command \"service status\"", "osd", "allow rwx"]}]: dispatch 2024-03-30T13:54:59.129 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:54:58 smithi181 ceph-mon[25762]: from='mgr.24890 172.21.15.181:0/1979512792' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:54:59.308 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:54:58 smithi099 ceph-mon[24912]: Updating smithi181:/var/lib/ceph/98ebaeb8-ee99-11ee-b647-cb9ed24678a4/config/ceph.conf 2024-03-30T13:54:59.308 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:54:58 smithi099 ceph-mon[24912]: Updating smithi099:/var/lib/ceph/98ebaeb8-ee99-11ee-b647-cb9ed24678a4/config/ceph.conf 2024-03-30T13:54:59.309 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:54:58 smithi099 ceph-mon[24912]: Updating smithi181:/etc/ceph/ceph.client.admin.keyring 2024-03-30T13:54:59.309 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:54:58 smithi099 ceph-mon[24912]: Updating smithi099:/etc/ceph/ceph.client.admin.keyring 2024-03-30T13:54:59.309 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:54:58 smithi099 ceph-mon[24912]: Updating smithi181:/var/lib/ceph/98ebaeb8-ee99-11ee-b647-cb9ed24678a4/config/ceph.client.admin.keyring 2024-03-30T13:54:59.309 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:54:58 smithi099 ceph-mon[24912]: Updating smithi099:/var/lib/ceph/98ebaeb8-ee99-11ee-b647-cb9ed24678a4/config/ceph.client.admin.keyring 2024-03-30T13:54:59.309 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:54:58 smithi099 ceph-mon[24912]: pgmap v4: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:54:59.309 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:54:58 smithi099 ceph-mon[24912]: Health check cleared: CEPHADM_FAILED_DAEMON (was: 1 failed cephadm daemon(s)) 2024-03-30T13:54:59.309 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:54:58 smithi099 ceph-mon[24912]: Cluster is now healthy 2024-03-30T13:54:59.309 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:54:58 smithi099 ceph-mon[24912]: from='mgr.24890 ' entity='mgr.x' 2024-03-30T13:54:59.309 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:54:58 smithi099 ceph-mon[24912]: from='mgr.24890 ' entity='mgr.x' 2024-03-30T13:54:59.309 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:54:58 smithi099 ceph-mon[24912]: from='mgr.24890 ' entity='mgr.x' 2024-03-30T13:54:59.309 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:54:58 smithi099 ceph-mon[24912]: from='mgr.24890 ' entity='mgr.x' 2024-03-30T13:54:59.310 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:54:58 smithi099 ceph-mon[24912]: from='mgr.24890 ' entity='mgr.x' 2024-03-30T13:54:59.310 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:54:58 smithi099 ceph-mon[24912]: from='mgr.24890 ' entity='mgr.x' 2024-03-30T13:54:59.310 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:54:58 smithi099 ceph-mon[24912]: pgmap v5: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:54:59.310 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:54:58 smithi099 ceph-mon[24912]: from='mgr.24890 ' entity='mgr.x' 2024-03-30T13:54:59.310 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:54:58 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:54:59.310 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:54:58 smithi099 ceph-mon[24912]: from='mgr.24890 ' entity='mgr.x' 2024-03-30T13:54:59.310 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:54:58 smithi099 ceph-mon[24912]: from='mgr.24890 172.21.15.181:0/1979512792' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.iscsi.foo.smithi099.qyjuvr", "caps": ["mon", "profile rbd, allow command \"osd blocklist\", allow command \"config-key get\" with \"key\" prefix \"iscsi/\"", "mgr", "allow command \"service status\"", "osd", "allow rwx"]}]: dispatch 2024-03-30T13:54:59.310 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:54:58 smithi099 ceph-mon[24912]: from='mgr.24890 ' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.iscsi.foo.smithi099.qyjuvr", "caps": ["mon", "profile rbd, allow command \"osd blocklist\", allow command \"config-key get\" with \"key\" prefix \"iscsi/\"", "mgr", "allow command \"service status\"", "osd", "allow rwx"]}]: dispatch 2024-03-30T13:54:59.310 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:54:58 smithi099 ceph-mon[24912]: from='mgr.24890 172.21.15.181:0/1979512792' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:54:59.311 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:54:58 smithi099 ceph-mon[29691]: Updating smithi181:/var/lib/ceph/98ebaeb8-ee99-11ee-b647-cb9ed24678a4/config/ceph.conf 2024-03-30T13:54:59.311 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:54:58 smithi099 ceph-mon[29691]: Updating smithi099:/var/lib/ceph/98ebaeb8-ee99-11ee-b647-cb9ed24678a4/config/ceph.conf 2024-03-30T13:54:59.311 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:54:58 smithi099 ceph-mon[29691]: Updating smithi181:/etc/ceph/ceph.client.admin.keyring 2024-03-30T13:54:59.311 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:54:58 smithi099 ceph-mon[29691]: Updating smithi099:/etc/ceph/ceph.client.admin.keyring 2024-03-30T13:54:59.311 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:54:58 smithi099 ceph-mon[29691]: Updating smithi181:/var/lib/ceph/98ebaeb8-ee99-11ee-b647-cb9ed24678a4/config/ceph.client.admin.keyring 2024-03-30T13:54:59.311 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:54:58 smithi099 ceph-mon[29691]: Updating smithi099:/var/lib/ceph/98ebaeb8-ee99-11ee-b647-cb9ed24678a4/config/ceph.client.admin.keyring 2024-03-30T13:54:59.311 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:54:58 smithi099 ceph-mon[29691]: pgmap v4: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:54:59.311 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:54:58 smithi099 ceph-mon[29691]: Health check cleared: CEPHADM_FAILED_DAEMON (was: 1 failed cephadm daemon(s)) 2024-03-30T13:54:59.311 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:54:58 smithi099 ceph-mon[29691]: Cluster is now healthy 2024-03-30T13:54:59.311 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:54:58 smithi099 ceph-mon[29691]: from='mgr.24890 ' entity='mgr.x' 2024-03-30T13:54:59.311 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:54:58 smithi099 ceph-mon[29691]: from='mgr.24890 ' entity='mgr.x' 2024-03-30T13:54:59.311 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:54:58 smithi099 ceph-mon[29691]: from='mgr.24890 ' entity='mgr.x' 2024-03-30T13:54:59.312 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:54:58 smithi099 ceph-mon[29691]: from='mgr.24890 ' entity='mgr.x' 2024-03-30T13:54:59.312 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:54:58 smithi099 ceph-mon[29691]: from='mgr.24890 ' entity='mgr.x' 2024-03-30T13:54:59.312 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:54:58 smithi099 ceph-mon[29691]: from='mgr.24890 ' entity='mgr.x' 2024-03-30T13:54:59.312 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:54:58 smithi099 ceph-mon[29691]: pgmap v5: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:54:59.312 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:54:58 smithi099 ceph-mon[29691]: from='mgr.24890 ' entity='mgr.x' 2024-03-30T13:54:59.312 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:54:58 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:54:59.312 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:54:58 smithi099 ceph-mon[29691]: from='mgr.24890 ' entity='mgr.x' 2024-03-30T13:54:59.312 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:54:58 smithi099 ceph-mon[29691]: from='mgr.24890 172.21.15.181:0/1979512792' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.iscsi.foo.smithi099.qyjuvr", "caps": ["mon", "profile rbd, allow command \"osd blocklist\", allow command \"config-key get\" with \"key\" prefix \"iscsi/\"", "mgr", "allow command \"service status\"", "osd", "allow rwx"]}]: dispatch 2024-03-30T13:54:59.312 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:54:58 smithi099 ceph-mon[29691]: from='mgr.24890 ' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.iscsi.foo.smithi099.qyjuvr", "caps": ["mon", "profile rbd, allow command \"osd blocklist\", allow command \"config-key get\" with \"key\" prefix \"iscsi/\"", "mgr", "allow command \"service status\"", "osd", "allow rwx"]}]: dispatch 2024-03-30T13:54:59.312 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:54:58 smithi099 ceph-mon[29691]: from='mgr.24890 172.21.15.181:0/1979512792' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:54:59.833 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:54:59 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[71049]: 2024-03-30T13:54:59.573+0000 7f5ff8116200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-03-30T13:54:59.833 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:54:59 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[71049]: 2024-03-30T13:54:59.710+0000 7f5ff8116200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-03-30T13:55:00.067 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:54:59 smithi181 ceph-mon[25762]: Reconfiguring iscsi.foo.smithi099.qyjuvr (dependencies changed)... 2024-03-30T13:55:00.067 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:54:59 smithi181 ceph-mon[25762]: Reconfiguring daemon iscsi.foo.smithi099.qyjuvr on smithi099 2024-03-30T13:55:00.067 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:54:59 smithi181 ceph-mon[25762]: Health check failed: 1 failed cephadm daemon(s) (CEPHADM_FAILED_DAEMON) 2024-03-30T13:55:00.067 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:54:59 smithi181 ceph-mon[25762]: mgrmap e34: x(active, since 3s) 2024-03-30T13:55:00.067 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:54:59 smithi181 ceph-mon[25762]: from='mgr.24890 ' entity='mgr.x' 2024-03-30T13:55:00.067 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:54:59 smithi181 ceph-mon[25762]: from='mgr.24890 ' entity='mgr.x' 2024-03-30T13:55:00.067 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:54:59 smithi181 ceph-mon[25762]: from='mgr.24890 ' entity='mgr.x' 2024-03-30T13:55:00.067 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:54:59 smithi181 ceph-mon[25762]: from='mgr.24890 ' entity='mgr.x' 2024-03-30T13:55:00.149 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:55:00 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[71049]: 2024-03-30T13:55:00.060+0000 7f5ff8116200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-03-30T13:55:00.150 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:54:59 smithi099 ceph-mon[29691]: Reconfiguring iscsi.foo.smithi099.qyjuvr (dependencies changed)... 2024-03-30T13:55:00.150 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:54:59 smithi099 ceph-mon[29691]: Reconfiguring daemon iscsi.foo.smithi099.qyjuvr on smithi099 2024-03-30T13:55:00.150 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:54:59 smithi099 ceph-mon[29691]: Health check failed: 1 failed cephadm daemon(s) (CEPHADM_FAILED_DAEMON) 2024-03-30T13:55:00.150 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:54:59 smithi099 ceph-mon[29691]: mgrmap e34: x(active, since 3s) 2024-03-30T13:55:00.150 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:54:59 smithi099 ceph-mon[29691]: from='mgr.24890 ' entity='mgr.x' 2024-03-30T13:55:00.150 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:54:59 smithi099 ceph-mon[29691]: from='mgr.24890 ' entity='mgr.x' 2024-03-30T13:55:00.150 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:54:59 smithi099 ceph-mon[29691]: from='mgr.24890 ' entity='mgr.x' 2024-03-30T13:55:00.150 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:54:59 smithi099 ceph-mon[29691]: from='mgr.24890 ' entity='mgr.x' 2024-03-30T13:55:00.151 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:54:59 smithi099 ceph-mon[24912]: Reconfiguring iscsi.foo.smithi099.qyjuvr (dependencies changed)... 2024-03-30T13:55:00.151 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:54:59 smithi099 ceph-mon[24912]: Reconfiguring daemon iscsi.foo.smithi099.qyjuvr on smithi099 2024-03-30T13:55:00.151 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:54:59 smithi099 ceph-mon[24912]: Health check failed: 1 failed cephadm daemon(s) (CEPHADM_FAILED_DAEMON) 2024-03-30T13:55:00.151 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:54:59 smithi099 ceph-mon[24912]: mgrmap e34: x(active, since 3s) 2024-03-30T13:55:00.151 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:54:59 smithi099 ceph-mon[24912]: from='mgr.24890 ' entity='mgr.x' 2024-03-30T13:55:00.151 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:54:59 smithi099 ceph-mon[24912]: from='mgr.24890 ' entity='mgr.x' 2024-03-30T13:55:00.151 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:54:59 smithi099 ceph-mon[24912]: from='mgr.24890 ' entity='mgr.x' 2024-03-30T13:55:00.151 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:54:59 smithi099 ceph-mon[24912]: from='mgr.24890 ' entity='mgr.x' 2024-03-30T13:55:00.526 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:55:00 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[71049]: 2024-03-30T13:55:00.151+0000 7f5ff8116200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-03-30T13:55:00.526 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:55:00 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[71049]: 2024-03-30T13:55:00.355+0000 7f5ff8116200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-03-30T13:55:00.809 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:55:00 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[71049]: 2024-03-30T13:55:00.552+0000 7f5ff8116200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-03-30T13:55:00.910 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:55:00 smithi181 ceph-mon[25762]: pgmap v6: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:55:00.910 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:55:00 smithi181 ceph-mon[25762]: pgmap v7: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:55:00.910 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:55:00 smithi181 ceph-mon[25762]: from='client.15237 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T13:55:00.910 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:55:00 smithi181 ceph-mon[25762]: from='mgr.24890 ' entity='mgr.x' 2024-03-30T13:55:00.910 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:55:00 smithi181 ceph-mon[25762]: from='mgr.24890 ' entity='mgr.x' 2024-03-30T13:55:00.910 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:55:00 smithi181 ceph-mon[25762]: from='mgr.24890 ' entity='mgr.x' 2024-03-30T13:55:01.083 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:55:00 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[71049]: 2024-03-30T13:55:00.855+0000 7f5ff8116200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-03-30T13:55:01.083 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:55:00 smithi099 ceph-mon[29691]: pgmap v6: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:55:01.083 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:55:00 smithi099 ceph-mon[29691]: pgmap v7: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:55:01.084 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:55:00 smithi099 ceph-mon[29691]: from='client.15237 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T13:55:01.084 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:55:00 smithi099 ceph-mon[29691]: from='mgr.24890 ' entity='mgr.x' 2024-03-30T13:55:01.084 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:55:00 smithi099 ceph-mon[29691]: from='mgr.24890 ' entity='mgr.x' 2024-03-30T13:55:01.084 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:55:00 smithi099 ceph-mon[29691]: from='mgr.24890 ' entity='mgr.x' 2024-03-30T13:55:01.084 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:55:00 smithi099 ceph-mon[24912]: pgmap v6: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:55:01.084 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:55:00 smithi099 ceph-mon[24912]: pgmap v7: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:55:01.084 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:55:00 smithi099 ceph-mon[24912]: from='client.15237 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T13:55:01.084 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:55:00 smithi099 ceph-mon[24912]: from='mgr.24890 ' entity='mgr.x' 2024-03-30T13:55:01.084 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:55:00 smithi099 ceph-mon[24912]: from='mgr.24890 ' entity='mgr.x' 2024-03-30T13:55:01.084 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:55:00 smithi099 ceph-mon[24912]: from='mgr.24890 ' entity='mgr.x' 2024-03-30T13:55:01.438 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:55:01 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[71049]: 2024-03-30T13:55:01.169+0000 7f5ff8116200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-03-30T13:55:01.438 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:55:01 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[71049]: 2024-03-30T13:55:01.417+0000 7f5ff8116200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-03-30T13:55:02.002 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:55:01 smithi181 ceph-mon[25762]: pgmap v8: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:55:02.002 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:55:01 smithi181 ceph-mon[25762]: pgmap v9: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:55:02.002 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:55:01 smithi181 ceph-mon[25762]: from='mgr.24890 ' entity='mgr.x' 2024-03-30T13:55:02.002 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:55:01 smithi181 ceph-mon[25762]: from='mgr.24890 ' entity='mgr.x' 2024-03-30T13:55:02.002 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:55:01 smithi181 ceph-mon[25762]: from='mgr.24890 ' entity='mgr.x' 2024-03-30T13:55:02.104 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:55:01 smithi099 ceph-mon[24912]: pgmap v8: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:55:02.104 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:55:01 smithi099 ceph-mon[24912]: pgmap v9: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:55:02.104 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:55:01 smithi099 ceph-mon[24912]: from='mgr.24890 ' entity='mgr.x' 2024-03-30T13:55:02.104 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:55:01 smithi099 ceph-mon[24912]: from='mgr.24890 ' entity='mgr.x' 2024-03-30T13:55:02.105 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:55:01 smithi099 ceph-mon[24912]: from='mgr.24890 ' entity='mgr.x' 2024-03-30T13:55:02.105 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:55:01 smithi099 ceph-mon[29691]: pgmap v8: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:55:02.105 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:55:01 smithi099 ceph-mon[29691]: pgmap v9: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:55:02.105 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:55:01 smithi099 ceph-mon[29691]: from='mgr.24890 ' entity='mgr.x' 2024-03-30T13:55:02.105 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:55:01 smithi099 ceph-mon[29691]: from='mgr.24890 ' entity='mgr.x' 2024-03-30T13:55:02.105 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:55:01 smithi099 ceph-mon[29691]: from='mgr.24890 ' entity='mgr.x' 2024-03-30T13:55:02.360 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:55:02 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[71049]: 2024-03-30T13:55:02.278+0000 7f5ff8116200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-03-30T13:55:02.752 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 13:55:02 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-x[50211]: 2024-03-30T13:55:02.441+0000 7fec3a4b1700 -1 log_channel(cephadm) log [ERR] : cephadm exited with an error code: 1, stderr: Reconfig daemon iscsi.foo.smithi099.qyjuvr ... 2024-03-30T13:55:02.752 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 13:55:02 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-x[50211]: Creating ceph-iscsi config... 2024-03-30T13:55:02.752 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 13:55:02 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-x[50211]: Write file: /var/lib/ceph/98ebaeb8-ee99-11ee-b647-cb9ed24678a4/iscsi.foo.smithi099.qyjuvr/iscsi-gateway.cfg 2024-03-30T13:55:02.753 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 13:55:02 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-x[50211]: Write file: /var/lib/ceph/98ebaeb8-ee99-11ee-b647-cb9ed24678a4/iscsi.foo.smithi099.qyjuvr/tcmu-runner-entrypoint.sh 2024-03-30T13:55:02.753 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 13:55:02 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-x[50211]: Non-zero exit code 1 from systemctl restart ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4@iscsi.foo.smithi099.qyjuvr 2024-03-30T13:55:02.753 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 13:55:02 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-x[50211]: systemctl: stderr Job for ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4@iscsi.foo.smithi099.qyjuvr.service failed because the control process exited with error code. 2024-03-30T13:55:02.753 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 13:55:02 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-x[50211]: systemctl: stderr See "systemctl status ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4@iscsi.foo.smithi099.qyjuvr.service" and "journalctl -xeu ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4@iscsi.foo.smithi099.qyjuvr.service" for details. 2024-03-30T13:55:02.753 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 13:55:02 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-x[50211]: Traceback (most recent call last): 2024-03-30T13:55:02.753 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 13:55:02 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-x[50211]: File "/usr/lib64/python3.9/runpy.py", line 197, in _run_module_as_main 2024-03-30T13:55:02.753 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 13:55:02 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-x[50211]: return _run_code(code, main_globals, None, 2024-03-30T13:55:02.753 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 13:55:02 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-x[50211]: File "/usr/lib64/python3.9/runpy.py", line 87, in _run_code 2024-03-30T13:55:02.753 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 13:55:02 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-x[50211]: exec(code, run_globals) 2024-03-30T13:55:02.753 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 13:55:02 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-x[50211]: File "/var/lib/ceph/98ebaeb8-ee99-11ee-b647-cb9ed24678a4/cephadm.a8f553f8c0a1bbbd91f4e60c8e13381b6fabffa3561f875fe77bb96af479b3ca/__main__.py", line 5528, in 2024-03-30T13:55:02.753 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 13:55:02 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-x[50211]: File "/var/lib/ceph/98ebaeb8-ee99-11ee-b647-cb9ed24678a4/cephadm.a8f553f8c0a1bbbd91f4e60c8e13381b6fabffa3561f875fe77bb96af479b3ca/__main__.py", line 5516, in main 2024-03-30T13:55:02.753 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 13:55:02 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-x[50211]: File "/var/lib/ceph/98ebaeb8-ee99-11ee-b647-cb9ed24678a4/cephadm.a8f553f8c0a1bbbd91f4e60c8e13381b6fabffa3561f875fe77bb96af479b3ca/__main__.py", line 3040, in command_deploy_from 2024-03-30T13:55:02.753 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 13:55:02 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-x[50211]: File "/var/lib/ceph/98ebaeb8-ee99-11ee-b647-cb9ed24678a4/cephadm.a8f553f8c0a1bbbd91f4e60c8e13381b6fabffa3561f875fe77bb96af479b3ca/__main__.py", line 3075, in _common_deploy 2024-03-30T13:55:02.753 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 13:55:02 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-x[50211]: File "/var/lib/ceph/98ebaeb8-ee99-11ee-b647-cb9ed24678a4/cephadm.a8f553f8c0a1bbbd91f4e60c8e13381b6fabffa3561f875fe77bb96af479b3ca/__main__.py", line 3095, in _deploy_daemon_container 2024-03-30T13:55:02.754 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 13:55:02 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-x[50211]: File "/var/lib/ceph/98ebaeb8-ee99-11ee-b647-cb9ed24678a4/cephadm.a8f553f8c0a1bbbd91f4e60c8e13381b6fabffa3561f875fe77bb96af479b3ca/__main__.py", line 1067, in deploy_daemon 2024-03-30T13:55:02.754 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 13:55:02 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-x[50211]: File "/var/lib/ceph/98ebaeb8-ee99-11ee-b647-cb9ed24678a4/cephadm.a8f553f8c0a1bbbd91f4e60c8e13381b6fabffa3561f875fe77bb96af479b3ca/cephadmlib/call_wrappers.py", line 307, in call_throws 2024-03-30T13:55:02.754 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 13:55:02 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-x[50211]: RuntimeError: Failed command: systemctl restart ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4@iscsi.foo.smithi099.qyjuvr: Job for ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4@iscsi.foo.smithi099.qyjuvr.service failed because the control process exited with error code. 2024-03-30T13:55:02.754 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 13:55:02 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-x[50211]: See "systemctl status ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4@iscsi.foo.smithi099.qyjuvr.service" and "journalctl -xeu ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4@iscsi.foo.smithi099.qyjuvr.service" for details. 2024-03-30T13:55:02.754 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 13:55:02 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-x[50211]: Traceback (most recent call last): 2024-03-30T13:55:02.754 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 13:55:02 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-x[50211]: File "/usr/share/ceph/mgr/cephadm/serve.py", line 1114, in _check_daemons 2024-03-30T13:55:02.754 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 13:55:02 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-x[50211]: self.mgr._daemon_action(daemon_spec, action=action) 2024-03-30T13:55:02.755 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 13:55:02 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-x[50211]: File "/usr/share/ceph/mgr/cephadm/module.py", line 2390, in _daemon_action 2024-03-30T13:55:02.755 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 13:55:02 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-x[50211]: CephadmServe(self)._create_daemon(daemon_spec, reconfig=(action == 'reconfig'))) 2024-03-30T13:55:02.755 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 13:55:02 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-x[50211]: File "/usr/share/ceph/mgr/cephadm/module.py", line 747, in wait_async 2024-03-30T13:55:02.755 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 13:55:02 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-x[50211]: return self.event_loop.get_result(coro, timeout) 2024-03-30T13:55:02.755 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 13:55:02 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-x[50211]: File "/usr/share/ceph/mgr/cephadm/ssh.py", line 136, in get_result 2024-03-30T13:55:02.755 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 13:55:02 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-x[50211]: return future.result(timeout) 2024-03-30T13:55:02.755 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 13:55:02 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-x[50211]: File "/lib64/python3.6/concurrent/futures/_base.py", line 432, in result 2024-03-30T13:55:02.755 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 13:55:02 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-x[50211]: return self.__get_result() 2024-03-30T13:55:02.755 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 13:55:02 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-x[50211]: File "/lib64/python3.6/concurrent/futures/_base.py", line 384, in __get_result 2024-03-30T13:55:02.755 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 13:55:02 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-x[50211]: raise self._exception 2024-03-30T13:55:02.755 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 13:55:02 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-x[50211]: File "/usr/share/ceph/mgr/cephadm/serve.py", line 1374, in _create_daemon 2024-03-30T13:55:02.755 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 13:55:02 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-x[50211]: config_blobs=daemon_spec.final_config, 2024-03-30T13:55:02.755 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 13:55:02 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-x[50211]: File "/usr/share/ceph/mgr/cephadm/serve.py", line 1685, in _run_cephadm 2024-03-30T13:55:02.755 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 13:55:02 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-x[50211]: f'cephadm exited with an error code: {code}, stderr: {err}') 2024-03-30T13:55:02.756 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 13:55:02 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-x[50211]: orchestrator._interface.OrchestratorError: cephadm exited with an error code: 1, stderr: Reconfig daemon iscsi.foo.smithi099.qyjuvr ... 2024-03-30T13:55:02.756 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 13:55:02 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-x[50211]: Creating ceph-iscsi config... 2024-03-30T13:55:02.756 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 13:55:02 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-x[50211]: Write file: /var/lib/ceph/98ebaeb8-ee99-11ee-b647-cb9ed24678a4/iscsi.foo.smithi099.qyjuvr/iscsi-gateway.cfg 2024-03-30T13:55:02.756 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 13:55:02 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-x[50211]: Write file: /var/lib/ceph/98ebaeb8-ee99-11ee-b647-cb9ed24678a4/iscsi.foo.smithi099.qyjuvr/tcmu-runner-entrypoint.sh 2024-03-30T13:55:02.756 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 13:55:02 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-x[50211]: Non-zero exit code 1 from systemctl restart ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4@iscsi.foo.smithi099.qyjuvr 2024-03-30T13:55:02.756 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 13:55:02 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-x[50211]: systemctl: stderr Job for ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4@iscsi.foo.smithi099.qyjuvr.service failed because the control process exited with error code. 2024-03-30T13:55:02.756 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 13:55:02 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-x[50211]: systemctl: stderr See "systemctl status ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4@iscsi.foo.smithi099.qyjuvr.service" and "journalctl -xeu ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4@iscsi.foo.smithi099.qyjuvr.service" for details. 2024-03-30T13:55:02.756 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 13:55:02 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-x[50211]: Traceback (most recent call last): 2024-03-30T13:55:02.756 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 13:55:02 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-x[50211]: File "/usr/lib64/python3.9/runpy.py", line 197, in _run_module_as_main 2024-03-30T13:55:02.756 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 13:55:02 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-x[50211]: return _run_code(code, main_globals, None, 2024-03-30T13:55:02.756 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 13:55:02 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-x[50211]: File "/usr/lib64/python3.9/runpy.py", line 87, in _run_code 2024-03-30T13:55:02.756 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 13:55:02 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-x[50211]: exec(code, run_globals) 2024-03-30T13:55:02.756 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 13:55:02 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-x[50211]: File "/var/lib/ceph/98ebaeb8-ee99-11ee-b647-cb9ed24678a4/cephadm.a8f553f8c0a1bbbd91f4e60c8e13381b6fabffa3561f875fe77bb96af479b3ca/__main__.py", line 5528, in 2024-03-30T13:55:02.756 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 13:55:02 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-x[50211]: File "/var/lib/ceph/98ebaeb8-ee99-11ee-b647-cb9ed24678a4/cephadm.a8f553f8c0a1bbbd91f4e60c8e13381b6fabffa3561f875fe77bb96af479b3ca/__main__.py", line 5516, in main 2024-03-30T13:55:02.756 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 13:55:02 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-x[50211]: File "/var/lib/ceph/98ebaeb8-ee99-11ee-b647-cb9ed24678a4/cephadm.a8f553f8c0a1bbbd91f4e60c8e13381b6fabffa3561f875fe77bb96af479b3ca/__main__.py", line 3040, in command_deploy_from 2024-03-30T13:55:02.757 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 13:55:02 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-x[50211]: File "/var/lib/ceph/98ebaeb8-ee99-11ee-b647-cb9ed24678a4/cephadm.a8f553f8c0a1bbbd91f4e60c8e13381b6fabffa3561f875fe77bb96af479b3ca/__main__.py", line 3075, in _common_deploy 2024-03-30T13:55:02.757 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 13:55:02 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-x[50211]: File "/var/lib/ceph/98ebaeb8-ee99-11ee-b647-cb9ed24678a4/cephadm.a8f553f8c0a1bbbd91f4e60c8e13381b6fabffa3561f875fe77bb96af479b3ca/__main__.py", line 3095, in _deploy_daemon_container 2024-03-30T13:55:02.757 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 13:55:02 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-x[50211]: File "/var/lib/ceph/98ebaeb8-ee99-11ee-b647-cb9ed24678a4/cephadm.a8f553f8c0a1bbbd91f4e60c8e13381b6fabffa3561f875fe77bb96af479b3ca/__main__.py", line 1067, in deploy_daemon 2024-03-30T13:55:02.757 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 13:55:02 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-x[50211]: File "/var/lib/ceph/98ebaeb8-ee99-11ee-b647-cb9ed24678a4/cephadm.a8f553f8c0a1bbbd91f4e60c8e13381b6fabffa3561f875fe77bb96af479b3ca/cephadmlib/call_wrappers.py", line 307, in call_throws 2024-03-30T13:55:02.757 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 13:55:02 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-x[50211]: RuntimeError: Failed command: systemctl restart ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4@iscsi.foo.smithi099.qyjuvr: Job for ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4@iscsi.foo.smithi099.qyjuvr.service failed because the control process exited with error code. 2024-03-30T13:55:02.757 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 13:55:02 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-x[50211]: See "systemctl status ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4@iscsi.foo.smithi099.qyjuvr.service" and "journalctl -xeu ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4@iscsi.foo.smithi099.qyjuvr.service" for details. 2024-03-30T13:55:02.944 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:55:02 smithi099 ceph-mon[24912]: pgmap v10: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:55:02.945 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:55:02 smithi099 ceph-mon[24912]: pgmap v11: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:55:02.945 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:55:02 smithi099 ceph-mon[29691]: pgmap v10: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:55:02.945 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:55:02 smithi099 ceph-mon[29691]: pgmap v11: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:55:02.945 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:55:02 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[71049]: 2024-03-30T13:55:02.875+0000 7f5ff8116200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-03-30T13:55:03.088 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:55:02 smithi181 ceph-mon[25762]: pgmap v10: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:55:03.088 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:55:02 smithi181 ceph-mon[25762]: pgmap v11: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:55:03.224 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:55:02 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[71049]: 2024-03-30T13:55:02.994+0000 7f5ff8116200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-03-30T13:55:03.583 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:55:03 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[71049]: 2024-03-30T13:55:03.226+0000 7f5ff8116200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-03-30T13:55:03.583 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:55:03 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[71049]: [30/Mar/2024:13:55:03] ENGINE Bus STARTING 2024-03-30T13:55:03.583 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:55:03 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[71049]: CherryPy Checker: 2024-03-30T13:55:03.583 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:55:03 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[71049]: The Application mounted at '' has an empty config. 2024-03-30T13:55:03.583 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:55:03 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[71049]: 2024-03-30T13:55:03.583 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:55:03 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[71049]: [30/Mar/2024:13:55:03] ENGINE Serving on http://:::9283 2024-03-30T13:55:03.584 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:55:03 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[71049]: [30/Mar/2024:13:55:03] ENGINE Bus STARTED 2024-03-30T13:55:03.985 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:55:03 smithi099 ceph-mon[24912]: cephadm exited with an error code: 1, stderr: Reconfig daemon iscsi.foo.smithi099.qyjuvr ... 2024-03-30T13:55:03.986 INFO:journalctl@ceph.mon.a.smithi099.stdout: Creating ceph-iscsi config... 2024-03-30T13:55:03.986 INFO:journalctl@ceph.mon.a.smithi099.stdout: Write file: /var/lib/ceph/98ebaeb8-ee99-11ee-b647-cb9ed24678a4/iscsi.foo.smithi099.qyjuvr/iscsi-gateway.cfg 2024-03-30T13:55:03.986 INFO:journalctl@ceph.mon.a.smithi099.stdout: Write file: /var/lib/ceph/98ebaeb8-ee99-11ee-b647-cb9ed24678a4/iscsi.foo.smithi099.qyjuvr/tcmu-runner-entrypoint.sh 2024-03-30T13:55:03.986 INFO:journalctl@ceph.mon.a.smithi099.stdout: Non-zero exit code 1 from systemctl restart ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4@iscsi.foo.smithi099.qyjuvr 2024-03-30T13:55:03.986 INFO:journalctl@ceph.mon.a.smithi099.stdout: systemctl: stderr Job for ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4@iscsi.foo.smithi099.qyjuvr.service failed because the control process exited with error code. 2024-03-30T13:55:03.986 INFO:journalctl@ceph.mon.a.smithi099.stdout: systemctl: stderr See "systemctl status ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4@iscsi.foo.smithi099.qyjuvr.service" and "journalctl -xeu ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4@iscsi.foo.smithi099.qyjuvr.service" for details. 2024-03-30T13:55:03.986 INFO:journalctl@ceph.mon.a.smithi099.stdout: Traceback (most recent call last): 2024-03-30T13:55:03.986 INFO:journalctl@ceph.mon.a.smithi099.stdout: File "/usr/lib64/python3.9/runpy.py", line 197, in _run_module_as_main 2024-03-30T13:55:03.986 INFO:journalctl@ceph.mon.a.smithi099.stdout: return _run_code(code, main_globals, None, 2024-03-30T13:55:03.986 INFO:journalctl@ceph.mon.a.smithi099.stdout: File "/usr/lib64/python3.9/runpy.py", line 87, in _run_code 2024-03-30T13:55:03.986 INFO:journalctl@ceph.mon.a.smithi099.stdout: exec(code, run_globals) 2024-03-30T13:55:03.986 INFO:journalctl@ceph.mon.a.smithi099.stdout: File "/var/lib/ceph/98ebaeb8-ee99-11ee-b647-cb9ed24678a4/cephadm.a8f553f8c0a1bbbd91f4e60c8e13381b6fabffa3561f875fe77bb96af479b3ca/__main__.py", line 5528, in 2024-03-30T13:55:03.987 INFO:journalctl@ceph.mon.a.smithi099.stdout: File "/var/lib/ceph/98ebaeb8-ee99-11ee-b647-cb9ed24678a4/cephadm.a8f553f8c0a1bbbd91f4e60c8e13381b6fabffa3561f875fe77bb96af479b3ca/__main__.py", line 5516, in main 2024-03-30T13:55:03.987 INFO:journalctl@ceph.mon.a.smithi099.stdout: File "/var/lib/ceph/98ebaeb8-ee99-11ee-b647-cb9ed24678a4/cephadm.a8f553f8c0a1bbbd91f4e60c8e13381b6fabffa3561f875fe77bb96af479b3ca/__main__.py", line 3040, in command_deploy_from 2024-03-30T13:55:03.987 INFO:journalctl@ceph.mon.a.smithi099.stdout: File "/var/lib/ceph/98ebaeb8-ee99-11ee-b647-cb9ed24678a4/cephadm.a8f553f8c0a1bbbd91f4e60c8e13381b6fabffa3561f875fe77bb96af479b3ca/__main__.py", line 3075, in _common_deploy 2024-03-30T13:55:03.987 INFO:journalctl@ceph.mon.a.smithi099.stdout: File "/var/lib/ceph/98ebaeb8-ee99-11ee-b647-cb9ed24678a4/cephadm.a8f553f8c0a1bbbd91f4e60c8e13381b6fabffa3561f875fe77bb96af479b3ca/__main__.py", line 3095, in _deploy_daemon_container 2024-03-30T13:55:03.987 INFO:journalctl@ceph.mon.a.smithi099.stdout: File "/var/lib/ceph/98ebaeb8-ee99-11ee-b647-cb9ed24678a4/cephadm.a8f553f8c0a1bbbd91f4e60c8e13381b6fabffa3561f875fe77bb96af479b3ca/__main__.py", line 1067, in deploy_daemon 2024-03-30T13:55:03.987 INFO:journalctl@ceph.mon.a.smithi099.stdout: File "/var/lib/ceph/98ebaeb8-ee99-11ee-b647-cb9ed24678a4/cephadm.a8f553f8c0a1bbbd91f4e60c8e13381b6fabffa3561f875fe77bb96af479b3ca/cephadmlib/call_wrappers.py", line 307, in call_throws 2024-03-30T13:55:03.987 INFO:journalctl@ceph.mon.a.smithi099.stdout: RuntimeError: Failed command: systemctl restart ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4@iscsi.foo.smithi099.qyjuvr: Job for ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4@iscsi.foo.smithi099.qyjuvr.service failed because the control process exited with error code. 2024-03-30T13:55:03.987 INFO:journalctl@ceph.mon.a.smithi099.stdout: See "systemctl status ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4@iscsi.foo.smithi099.qyjuvr.service" and "journalctl -xeu ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4@iscsi.foo.smithi099.qyjuvr.service" for details. 2024-03-30T13:55:03.987 INFO:journalctl@ceph.mon.a.smithi099.stdout: Traceback (most recent call last): 2024-03-30T13:55:03.987 INFO:journalctl@ceph.mon.a.smithi099.stdout: File "/usr/share/ceph/mgr/cephadm/serve.py", line 1114, in _check_daemons 2024-03-30T13:55:03.987 INFO:journalctl@ceph.mon.a.smithi099.stdout: self.mgr._daemon_action(daemon_spec, action=action) 2024-03-30T13:55:03.987 INFO:journalctl@ceph.mon.a.smithi099.stdout: File "/usr/share/ceph/mgr/cephadm/module.py", line 2390, in _daemon_action 2024-03-30T13:55:03.987 INFO:journalctl@ceph.mon.a.smithi099.stdout: CephadmServe(self)._create_daemon(daemon_spec, reconfig=(action == 'reconfig'))) 2024-03-30T13:55:03.987 INFO:journalctl@ceph.mon.a.smithi099.stdout: File "/usr/share/ceph/mgr/cephadm/module.py", line 747, in wait_async 2024-03-30T13:55:03.988 INFO:journalctl@ceph.mon.a.smithi099.stdout: return self.event_loop.get_result(coro, timeout) 2024-03-30T13:55:03.988 INFO:journalctl@ceph.mon.a.smithi099.stdout: File "/usr/share/ceph/mgr/cephadm/ssh.py", line 136, in get_result 2024-03-30T13:55:03.988 INFO:journalctl@ceph.mon.a.smithi099.stdout: return future.result(timeout) 2024-03-30T13:55:03.988 INFO:journalctl@ceph.mon.a.smithi099.stdout: File "/lib64/python3.6/concurrent/futures/_base.py", line 432, in result 2024-03-30T13:55:03.988 INFO:journalctl@ceph.mon.a.smithi099.stdout: return self.__get_result() 2024-03-30T13:55:03.988 INFO:journalctl@ceph.mon.a.smithi099.stdout: File "/lib64/python3.6/concurrent/futures/_base.py", line 384, in __get_result 2024-03-30T13:55:03.988 INFO:journalctl@ceph.mon.a.smithi099.stdout: raise self._exception 2024-03-30T13:55:03.988 INFO:journalctl@ceph.mon.a.smithi099.stdout: File "/usr/share/ceph/mgr/cephadm/serve.py", line 1374, in _create_daemon 2024-03-30T13:55:03.988 INFO:journalctl@ceph.mon.a.smithi099.stdout: config_blobs=daemon_spec.final_config, 2024-03-30T13:55:03.988 INFO:journalctl@ceph.mon.a.smithi099.stdout: File "/usr/share/ceph/mgr/cephadm/serve.py", line 1685, in _run_cephadm 2024-03-30T13:55:03.988 INFO:journalctl@ceph.mon.a.smithi099.stdout: f'cephadm exited with an error code: {code}, stderr: {err}') 2024-03-30T13:55:03.988 INFO:journalctl@ceph.mon.a.smithi099.stdout: orchestrator._interface.OrchestratorError: cephadm exited with an error code: 1, stderr: Reconfig daemon iscsi.foo.smithi099.qyjuvr ... 2024-03-30T13:55:03.988 INFO:journalctl@ceph.mon.a.smithi099.stdout: Creating ceph-iscsi config... 2024-03-30T13:55:03.988 INFO:journalctl@ceph.mon.a.smithi099.stdout: Write file: /var/lib/ceph/98ebaeb8-ee99-11ee-b647-cb9ed24678a4/iscsi.foo.smithi099.qyjuvr/iscsi-gateway.cfg 2024-03-30T13:55:03.989 INFO:journalctl@ceph.mon.a.smithi099.stdout: Write file: /var/lib/ceph/98ebaeb8-ee99-11ee-b647-cb9ed24678a4/iscsi.foo.smithi099.qyjuvr/tcmu-runner-entrypoint.sh 2024-03-30T13:55:03.989 INFO:journalctl@ceph.mon.a.smithi099.stdout: Non-zero exit code 1 from systemctl restart ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4@iscsi.foo.smithi099.qyjuvr 2024-03-30T13:55:03.989 INFO:journalctl@ceph.mon.a.smithi099.stdout: systemctl: stderr Job for ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4@iscsi.foo.smithi099.qyjuvr.service failed because the control process exited with error code. 2024-03-30T13:55:03.989 INFO:journalctl@ceph.mon.a.smithi099.stdout: systemctl: stderr See "systemctl status ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4@iscsi.foo.smithi099.qyjuvr.service" and "journalctl -xeu ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4@iscsi.foo.smithi099.qyjuvr.service" for details. 2024-03-30T13:55:03.989 INFO:journalctl@ceph.mon.a.smithi099.stdout: Traceback (most recent call last): 2024-03-30T13:55:03.989 INFO:journalctl@ceph.mon.a.smithi099.stdout: File "/usr/lib64/python3.9/runpy.py", line 197, in _run_module_as_main 2024-03-30T13:55:03.989 INFO:journalctl@ceph.mon.a.smithi099.stdout: return _run_code(code, main_globals, None, 2024-03-30T13:55:03.989 INFO:journalctl@ceph.mon.a.smithi099.stdout: File "/usr/lib64/python3.9/runpy.py", line 87, in _run_code 2024-03-30T13:55:03.989 INFO:journalctl@ceph.mon.a.smithi099.stdout: exec(code, run_globals) 2024-03-30T13:55:03.989 INFO:journalctl@ceph.mon.a.smithi099.stdout: File "/var/lib/ceph/98ebaeb8-ee99-11ee-b647-cb9ed24678a4/cephadm.a8f553f8c0a1bbbd91f4e60c8e13381b6fabffa3561f875fe77bb96af479b3ca/__main__.py", line 5528, in 2024-03-30T13:55:03.989 INFO:journalctl@ceph.mon.a.smithi099.stdout: File "/var/lib/ceph/98ebaeb8-ee99-11ee-b647-cb9ed24678a4/cephadm.a8f553f8c0a1bbbd91f4e60c8e13381b6fabffa3561f875fe77bb96af479b3ca/__main__.py", line 5516, in main 2024-03-30T13:55:03.989 INFO:journalctl@ceph.mon.a.smithi099.stdout: File "/var/lib/ceph/98ebaeb8-ee99-11ee-b647-cb9ed24678a4/cephadm.a8f553f8c0a1bbbd91f4e60c8e13381b6fabffa3561f875fe77bb96af479b3ca/__main__.py", line 3040, in command_deploy_from 2024-03-30T13:55:03.989 INFO:journalctl@ceph.mon.a.smithi099.stdout: File "/var/lib/ceph/98ebaeb8-ee99-11ee-b647-cb9ed24678a4/cephadm.a8f553f8c0a1bbbd91f4e60c8e13381b6fabffa3561f875fe77bb96af479b3ca/__main__.py", line 3075, in _common_deploy 2024-03-30T13:55:03.990 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:55:03 smithi099 ceph-mon[29691]: cephadm exited with an error code: 1, stderr: Reconfig daemon iscsi.foo.smithi099.qyjuvr ... 2024-03-30T13:55:03.990 INFO:journalctl@ceph.mon.c.smithi099.stdout: Creating ceph-iscsi config... 2024-03-30T13:55:03.990 INFO:journalctl@ceph.mon.c.smithi099.stdout: Write file: /var/lib/ceph/98ebaeb8-ee99-11ee-b647-cb9ed24678a4/iscsi.foo.smithi099.qyjuvr/iscsi-gateway.cfg 2024-03-30T13:55:03.990 INFO:journalctl@ceph.mon.c.smithi099.stdout: Write file: /var/lib/ceph/98ebaeb8-ee99-11ee-b647-cb9ed24678a4/iscsi.foo.smithi099.qyjuvr/tcmu-runner-entrypoint.sh 2024-03-30T13:55:03.990 INFO:journalctl@ceph.mon.c.smithi099.stdout: Non-zero exit code 1 from systemctl restart ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4@iscsi.foo.smithi099.qyjuvr 2024-03-30T13:55:03.990 INFO:journalctl@ceph.mon.c.smithi099.stdout: systemctl: stderr Job for ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4@iscsi.foo.smithi099.qyjuvr.service failed because the control process exited with error code. 2024-03-30T13:55:03.990 INFO:journalctl@ceph.mon.c.smithi099.stdout: systemctl: stderr See "systemctl status ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4@iscsi.foo.smithi099.qyjuvr.service" and "journalctl -xeu ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4@iscsi.foo.smithi099.qyjuvr.service" for details. 2024-03-30T13:55:03.990 INFO:journalctl@ceph.mon.c.smithi099.stdout: Traceback (most recent call last): 2024-03-30T13:55:03.990 INFO:journalctl@ceph.mon.c.smithi099.stdout: File "/usr/lib64/python3.9/runpy.py", line 197, in _run_module_as_main 2024-03-30T13:55:03.990 INFO:journalctl@ceph.mon.c.smithi099.stdout: return _run_code(code, main_globals, None, 2024-03-30T13:55:03.990 INFO:journalctl@ceph.mon.c.smithi099.stdout: File "/usr/lib64/python3.9/runpy.py", line 87, in _run_code 2024-03-30T13:55:03.991 INFO:journalctl@ceph.mon.c.smithi099.stdout: exec(code, run_globals) 2024-03-30T13:55:03.991 INFO:journalctl@ceph.mon.c.smithi099.stdout: File "/var/lib/ceph/98ebaeb8-ee99-11ee-b647-cb9ed24678a4/cephadm.a8f553f8c0a1bbbd91f4e60c8e13381b6fabffa3561f875fe77bb96af479b3ca/__main__.py", line 5528, in 2024-03-30T13:55:03.991 INFO:journalctl@ceph.mon.c.smithi099.stdout: File "/var/lib/ceph/98ebaeb8-ee99-11ee-b647-cb9ed24678a4/cephadm.a8f553f8c0a1bbbd91f4e60c8e13381b6fabffa3561f875fe77bb96af479b3ca/__main__.py", line 5516, in main 2024-03-30T13:55:03.991 INFO:journalctl@ceph.mon.c.smithi099.stdout: File "/var/lib/ceph/98ebaeb8-ee99-11ee-b647-cb9ed24678a4/cephadm.a8f553f8c0a1bbbd91f4e60c8e13381b6fabffa3561f875fe77bb96af479b3ca/__main__.py", line 3040, in command_deploy_from 2024-03-30T13:55:03.991 INFO:journalctl@ceph.mon.c.smithi099.stdout: File "/var/lib/ceph/98ebaeb8-ee99-11ee-b647-cb9ed24678a4/cephadm.a8f553f8c0a1bbbd91f4e60c8e13381b6fabffa3561f875fe77bb96af479b3ca/__main__.py", line 3075, in _common_deploy 2024-03-30T13:55:03.991 INFO:journalctl@ceph.mon.c.smithi099.stdout: File "/var/lib/ceph/98ebaeb8-ee99-11ee-b647-cb9ed24678a4/cephadm.a8f553f8c0a1bbbd91f4e60c8e13381b6fabffa3561f875fe77bb96af479b3ca/__main__.py", line 3095, in _deploy_daemon_container 2024-03-30T13:55:03.991 INFO:journalctl@ceph.mon.c.smithi099.stdout: File "/var/lib/ceph/98ebaeb8-ee99-11ee-b647-cb9ed24678a4/cephadm.a8f553f8c0a1bbbd91f4e60c8e13381b6fabffa3561f875fe77bb96af479b3ca/__main__.py", line 1067, in deploy_daemon 2024-03-30T13:55:03.991 INFO:journalctl@ceph.mon.c.smithi099.stdout: File "/var/lib/ceph/98ebaeb8-ee99-11ee-b647-cb9ed24678a4/cephadm.a8f553f8c0a1bbbd91f4e60c8e13381b6fabffa3561f875fe77bb96af479b3ca/cephadmlib/call_wrappers.py", line 307, in call_throws 2024-03-30T13:55:03.991 INFO:journalctl@ceph.mon.c.smithi099.stdout: RuntimeError: Failed command: systemctl restart ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4@iscsi.foo.smithi099.qyjuvr: Job for ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4@iscsi.foo.smithi099.qyjuvr.service failed because the control process exited with error code. 2024-03-30T13:55:03.991 INFO:journalctl@ceph.mon.c.smithi099.stdout: See "systemctl status ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4@iscsi.foo.smithi099.qyjuvr.service" and "journalctl -xeu ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4@iscsi.foo.smithi099.qyjuvr.service" for details. 2024-03-30T13:55:03.991 INFO:journalctl@ceph.mon.c.smithi099.stdout: Traceback (most recent call last): 2024-03-30T13:55:03.991 INFO:journalctl@ceph.mon.c.smithi099.stdout: File "/usr/share/ceph/mgr/cephadm/serve.py", line 1114, in _check_daemons 2024-03-30T13:55:03.991 INFO:journalctl@ceph.mon.c.smithi099.stdout: self.mgr._daemon_action(daemon_spec, action=action) 2024-03-30T13:55:03.991 INFO:journalctl@ceph.mon.c.smithi099.stdout: File "/usr/share/ceph/mgr/cephadm/module.py", line 2390, in _daemon_action 2024-03-30T13:55:03.991 INFO:journalctl@ceph.mon.c.smithi099.stdout: CephadmServe(self)._create_daemon(daemon_spec, reconfig=(action == 'reconfig'))) 2024-03-30T13:55:03.992 INFO:journalctl@ceph.mon.c.smithi099.stdout: File "/usr/share/ceph/mgr/cephadm/module.py", line 747, in wait_async 2024-03-30T13:55:03.992 INFO:journalctl@ceph.mon.c.smithi099.stdout: return self.event_loop.get_result(coro, timeout) 2024-03-30T13:55:03.992 INFO:journalctl@ceph.mon.c.smithi099.stdout: File "/usr/share/ceph/mgr/cephadm/ssh.py", line 136, in get_result 2024-03-30T13:55:03.992 INFO:journalctl@ceph.mon.c.smithi099.stdout: return future.result(timeout) 2024-03-30T13:55:03.992 INFO:journalctl@ceph.mon.c.smithi099.stdout: File "/lib64/python3.6/concurrent/futures/_base.py", line 432, in result 2024-03-30T13:55:03.992 INFO:journalctl@ceph.mon.c.smithi099.stdout: return self.__get_result() 2024-03-30T13:55:03.992 INFO:journalctl@ceph.mon.c.smithi099.stdout: File "/lib64/python3.6/concurrent/futures/_base.py", line 384, in __get_result 2024-03-30T13:55:03.992 INFO:journalctl@ceph.mon.c.smithi099.stdout: raise self._exception 2024-03-30T13:55:03.992 INFO:journalctl@ceph.mon.c.smithi099.stdout: File "/usr/share/ceph/mgr/cephadm/serve.py", line 1374, in _create_daemon 2024-03-30T13:55:03.992 INFO:journalctl@ceph.mon.c.smithi099.stdout: config_blobs=daemon_spec.final_config, 2024-03-30T13:55:03.992 INFO:journalctl@ceph.mon.c.smithi099.stdout: File "/usr/share/ceph/mgr/cephadm/serve.py", line 1685, in _run_cephadm 2024-03-30T13:55:03.992 INFO:journalctl@ceph.mon.c.smithi099.stdout: f'cephadm exited with an error code: {code}, stderr: {err}') 2024-03-30T13:55:03.992 INFO:journalctl@ceph.mon.c.smithi099.stdout: orchestrator._interface.OrchestratorError: cephadm exited with an error code: 1, stderr: Reconfig daemon iscsi.foo.smithi099.qyjuvr ... 2024-03-30T13:55:03.992 INFO:journalctl@ceph.mon.c.smithi099.stdout: Creating ceph-iscsi config... 2024-03-30T13:55:03.992 INFO:journalctl@ceph.mon.c.smithi099.stdout: Write file: /var/lib/ceph/98ebaeb8-ee99-11ee-b647-cb9ed24678a4/iscsi.foo.smithi099.qyjuvr/iscsi-gateway.cfg 2024-03-30T13:55:03.993 INFO:journalctl@ceph.mon.c.smithi099.stdout: Write file: /var/lib/ceph/98ebaeb8-ee99-11ee-b647-cb9ed24678a4/iscsi.foo.smithi099.qyjuvr/tcmu-runner-entrypoint.sh 2024-03-30T13:55:03.993 INFO:journalctl@ceph.mon.c.smithi099.stdout: Non-zero exit code 1 from systemctl restart ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4@iscsi.foo.smithi099.qyjuvr 2024-03-30T13:55:03.993 INFO:journalctl@ceph.mon.c.smithi099.stdout: systemctl: stderr Job for ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4@iscsi.foo.smithi099.qyjuvr.service failed because the control process exited with error code. 2024-03-30T13:55:03.993 INFO:journalctl@ceph.mon.c.smithi099.stdout: systemctl: stderr See "systemctl status ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4@iscsi.foo.smithi099.qyjuvr.service" and "journalctl -xeu ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4@iscsi.foo.smithi099.qyjuvr.service" for details. 2024-03-30T13:55:03.993 INFO:journalctl@ceph.mon.c.smithi099.stdout: Traceback (most recent call last): 2024-03-30T13:55:03.993 INFO:journalctl@ceph.mon.c.smithi099.stdout: File "/usr/lib64/python3.9/runpy.py", line 197, in _run_module_as_main 2024-03-30T13:55:03.993 INFO:journalctl@ceph.mon.c.smithi099.stdout: return _run_code(code, main_globals, None, 2024-03-30T13:55:03.993 INFO:journalctl@ceph.mon.c.smithi099.stdout: File "/usr/lib64/python3.9/runpy.py", line 87, in _run_code 2024-03-30T13:55:03.993 INFO:journalctl@ceph.mon.c.smithi099.stdout: exec(code, run_globals) 2024-03-30T13:55:03.993 INFO:journalctl@ceph.mon.c.smithi099.stdout: File "/var/lib/ceph/98ebaeb8-ee99-11ee-b647-cb9ed24678a4/cephadm.a8f553f8c0a1bbbd91f4e60c8e13381b6fabffa3561f875fe77bb96af479b3ca/__main__.py", line 5528, in 2024-03-30T13:55:03.993 INFO:journalctl@ceph.mon.c.smithi099.stdout: File "/var/lib/ceph/98ebaeb8-ee99-11ee-b647-cb9ed24678a4/cephadm.a8f553f8c0a1bbbd91f4e60c8e13381b6fabffa3561f875fe77bb96af479b3ca/__main__.py", line 5516, in main 2024-03-30T13:55:03.993 INFO:journalctl@ceph.mon.c.smithi099.stdout: File "/var/lib/ceph/98ebaeb8-ee99-11ee-b647-cb9ed24678a4/cephadm.a8f553f8c0a1bbbd91f4e60c8e13381b6fabffa3561f875fe77bb96af479b3ca/__main__.py", line 3040, in command_deploy_from 2024-03-30T13:55:03.993 INFO:journalctl@ceph.mon.c.smithi099.stdout: File "/var/lib/ceph/98ebaeb8-ee99-11ee-b647-cb9ed24678a4/cephadm.a8f553f8c0a1bbbd91f4e60c8e13381b6fabffa3561f875fe77bb96af479b3ca/__main__.py", line 3075, in _common_deploy 2024-03-30T13:55:03.994 INFO:journalctl@ceph.mon.a.smithi099.stdout: File "/var/lib/ceph/98ebaeb8-ee99-11ee-b647-cb9ed24678a4/cephadm.a8f553f8c0a1bbbd91f4e60c8e13381b6fabffa3561f875fe77bb96af479b3ca/__main__.py", line 3095, in _deploy_daemon_container 2024-03-30T13:55:03.994 INFO:journalctl@ceph.mon.a.smithi099.stdout: File "/var/lib/ceph/98ebaeb8-ee99-11ee-b647-cb9ed24678a4/cephadm.a8f553f8c0a1bbbd91f4e60c8e13381b6fabffa3561f875fe77bb96af479b3ca/__main__.py", line 1067, in deploy_daemon 2024-03-30T13:55:03.994 INFO:journalctl@ceph.mon.a.smithi099.stdout: File "/var/lib/ceph/98ebaeb8-ee99-11ee-b647-cb9ed24678a4/cephadm.a8f553f8c0a1bbbd91f4e60c8e13381b6fabffa3561f875fe77bb96af479b3ca/cephadmlib/call_wrappers.py", line 307, in call_throws 2024-03-30T13:55:03.994 INFO:journalctl@ceph.mon.a.smithi099.stdout: RuntimeError: Failed command: systemctl restart ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4@iscsi.foo.smithi099.qyjuvr: Job for ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4@iscsi.foo.smithi099.qyjuvr.service failed because the control process exited with error code. 2024-03-30T13:55:03.994 INFO:journalctl@ceph.mon.a.smithi099.stdout: See "systemctl status ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4@iscsi.foo.smithi099.qyjuvr.service" and "journalctl -xeu ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4@iscsi.foo.smithi099.qyjuvr.service" for details. 2024-03-30T13:55:03.994 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:55:03 smithi099 ceph-mon[24912]: Reconfiguring prometheus.a (dependencies changed)... 2024-03-30T13:55:03.994 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:55:03 smithi099 ceph-mon[24912]: Reconfiguring daemon prometheus.a on smithi181 2024-03-30T13:55:03.994 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:55:03 smithi099 ceph-mon[24912]: Standby manager daemon y started 2024-03-30T13:55:03.994 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:55:03 smithi099 ceph-mon[24912]: from='mgr.? 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-03-30T13:55:03.994 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:55:03 smithi099 ceph-mon[24912]: from='mgr.? 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-03-30T13:55:03.994 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:55:03 smithi099 ceph-mon[24912]: from='mgr.? 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-03-30T13:55:03.994 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:55:03 smithi099 ceph-mon[24912]: from='mgr.? 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-03-30T13:55:03.994 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:55:03 smithi099 ceph-mon[24912]: from='mgr.24890 ' entity='mgr.x' 2024-03-30T13:55:03.994 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:55:03 smithi099 ceph-mon[24912]: from='mgr.24890 ' entity='mgr.x' 2024-03-30T13:55:03.995 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:55:03 smithi099 ceph-mon[24912]: from='mgr.24890 ' entity='mgr.x' 2024-03-30T13:55:03.995 INFO:journalctl@ceph.mon.c.smithi099.stdout: File "/var/lib/ceph/98ebaeb8-ee99-11ee-b647-cb9ed24678a4/cephadm.a8f553f8c0a1bbbd91f4e60c8e13381b6fabffa3561f875fe77bb96af479b3ca/__main__.py", line 3095, in _deploy_daemon_container 2024-03-30T13:55:03.995 INFO:journalctl@ceph.mon.c.smithi099.stdout: File "/var/lib/ceph/98ebaeb8-ee99-11ee-b647-cb9ed24678a4/cephadm.a8f553f8c0a1bbbd91f4e60c8e13381b6fabffa3561f875fe77bb96af479b3ca/__main__.py", line 1067, in deploy_daemon 2024-03-30T13:55:03.995 INFO:journalctl@ceph.mon.c.smithi099.stdout: File "/var/lib/ceph/98ebaeb8-ee99-11ee-b647-cb9ed24678a4/cephadm.a8f553f8c0a1bbbd91f4e60c8e13381b6fabffa3561f875fe77bb96af479b3ca/cephadmlib/call_wrappers.py", line 307, in call_throws 2024-03-30T13:55:03.995 INFO:journalctl@ceph.mon.c.smithi099.stdout: RuntimeError: Failed command: systemctl restart ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4@iscsi.foo.smithi099.qyjuvr: Job for ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4@iscsi.foo.smithi099.qyjuvr.service failed because the control process exited with error code. 2024-03-30T13:55:03.995 INFO:journalctl@ceph.mon.c.smithi099.stdout: See "systemctl status ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4@iscsi.foo.smithi099.qyjuvr.service" and "journalctl -xeu ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4@iscsi.foo.smithi099.qyjuvr.service" for details. 2024-03-30T13:55:03.995 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:55:03 smithi099 ceph-mon[29691]: Reconfiguring prometheus.a (dependencies changed)... 2024-03-30T13:55:03.995 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:55:03 smithi099 ceph-mon[29691]: Reconfiguring daemon prometheus.a on smithi181 2024-03-30T13:55:03.995 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:55:03 smithi099 ceph-mon[29691]: Standby manager daemon y started 2024-03-30T13:55:03.995 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:55:03 smithi099 ceph-mon[29691]: from='mgr.? 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-03-30T13:55:03.995 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:55:03 smithi099 ceph-mon[29691]: from='mgr.? 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-03-30T13:55:03.995 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:55:03 smithi099 ceph-mon[29691]: from='mgr.? 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-03-30T13:55:03.995 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:55:03 smithi099 ceph-mon[29691]: from='mgr.? 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-03-30T13:55:03.996 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:55:03 smithi099 ceph-mon[29691]: from='mgr.24890 ' entity='mgr.x' 2024-03-30T13:55:03.996 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:55:03 smithi099 ceph-mon[29691]: from='mgr.24890 ' entity='mgr.x' 2024-03-30T13:55:03.996 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:55:03 smithi099 ceph-mon[29691]: from='mgr.24890 ' entity='mgr.x' 2024-03-30T13:55:04.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:55:03 smithi181 ceph-mon[25762]: cephadm exited with an error code: 1, stderr: Reconfig daemon iscsi.foo.smithi099.qyjuvr ... 2024-03-30T13:55:04.001 INFO:journalctl@ceph.mon.b.smithi181.stdout: Creating ceph-iscsi config... 2024-03-30T13:55:04.001 INFO:journalctl@ceph.mon.b.smithi181.stdout: Write file: /var/lib/ceph/98ebaeb8-ee99-11ee-b647-cb9ed24678a4/iscsi.foo.smithi099.qyjuvr/iscsi-gateway.cfg 2024-03-30T13:55:04.002 INFO:journalctl@ceph.mon.b.smithi181.stdout: Write file: /var/lib/ceph/98ebaeb8-ee99-11ee-b647-cb9ed24678a4/iscsi.foo.smithi099.qyjuvr/tcmu-runner-entrypoint.sh 2024-03-30T13:55:04.002 INFO:journalctl@ceph.mon.b.smithi181.stdout: Non-zero exit code 1 from systemctl restart ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4@iscsi.foo.smithi099.qyjuvr 2024-03-30T13:55:04.002 INFO:journalctl@ceph.mon.b.smithi181.stdout: systemctl: stderr Job for ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4@iscsi.foo.smithi099.qyjuvr.service failed because the control process exited with error code. 2024-03-30T13:55:04.002 INFO:journalctl@ceph.mon.b.smithi181.stdout: systemctl: stderr See "systemctl status ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4@iscsi.foo.smithi099.qyjuvr.service" and "journalctl -xeu ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4@iscsi.foo.smithi099.qyjuvr.service" for details. 2024-03-30T13:55:04.002 INFO:journalctl@ceph.mon.b.smithi181.stdout: Traceback (most recent call last): 2024-03-30T13:55:04.002 INFO:journalctl@ceph.mon.b.smithi181.stdout: File "/usr/lib64/python3.9/runpy.py", line 197, in _run_module_as_main 2024-03-30T13:55:04.002 INFO:journalctl@ceph.mon.b.smithi181.stdout: return _run_code(code, main_globals, None, 2024-03-30T13:55:04.002 INFO:journalctl@ceph.mon.b.smithi181.stdout: File "/usr/lib64/python3.9/runpy.py", line 87, in _run_code 2024-03-30T13:55:04.002 INFO:journalctl@ceph.mon.b.smithi181.stdout: exec(code, run_globals) 2024-03-30T13:55:04.002 INFO:journalctl@ceph.mon.b.smithi181.stdout: File "/var/lib/ceph/98ebaeb8-ee99-11ee-b647-cb9ed24678a4/cephadm.a8f553f8c0a1bbbd91f4e60c8e13381b6fabffa3561f875fe77bb96af479b3ca/__main__.py", line 5528, in 2024-03-30T13:55:04.002 INFO:journalctl@ceph.mon.b.smithi181.stdout: File "/var/lib/ceph/98ebaeb8-ee99-11ee-b647-cb9ed24678a4/cephadm.a8f553f8c0a1bbbd91f4e60c8e13381b6fabffa3561f875fe77bb96af479b3ca/__main__.py", line 5516, in main 2024-03-30T13:55:04.002 INFO:journalctl@ceph.mon.b.smithi181.stdout: File "/var/lib/ceph/98ebaeb8-ee99-11ee-b647-cb9ed24678a4/cephadm.a8f553f8c0a1bbbd91f4e60c8e13381b6fabffa3561f875fe77bb96af479b3ca/__main__.py", line 3040, in command_deploy_from 2024-03-30T13:55:04.002 INFO:journalctl@ceph.mon.b.smithi181.stdout: File "/var/lib/ceph/98ebaeb8-ee99-11ee-b647-cb9ed24678a4/cephadm.a8f553f8c0a1bbbd91f4e60c8e13381b6fabffa3561f875fe77bb96af479b3ca/__main__.py", line 3075, in _common_deploy 2024-03-30T13:55:04.003 INFO:journalctl@ceph.mon.b.smithi181.stdout: File "/var/lib/ceph/98ebaeb8-ee99-11ee-b647-cb9ed24678a4/cephadm.a8f553f8c0a1bbbd91f4e60c8e13381b6fabffa3561f875fe77bb96af479b3ca/__main__.py", line 3095, in _deploy_daemon_container 2024-03-30T13:55:04.003 INFO:journalctl@ceph.mon.b.smithi181.stdout: File "/var/lib/ceph/98ebaeb8-ee99-11ee-b647-cb9ed24678a4/cephadm.a8f553f8c0a1bbbd91f4e60c8e13381b6fabffa3561f875fe77bb96af479b3ca/__main__.py", line 1067, in deploy_daemon 2024-03-30T13:55:04.003 INFO:journalctl@ceph.mon.b.smithi181.stdout: File "/var/lib/ceph/98ebaeb8-ee99-11ee-b647-cb9ed24678a4/cephadm.a8f553f8c0a1bbbd91f4e60c8e13381b6fabffa3561f875fe77bb96af479b3ca/cephadmlib/call_wrappers.py", line 307, in call_throws 2024-03-30T13:55:04.003 INFO:journalctl@ceph.mon.b.smithi181.stdout: RuntimeError: Failed command: systemctl restart ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4@iscsi.foo.smithi099.qyjuvr: Job for ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4@iscsi.foo.smithi099.qyjuvr.service failed because the control process exited with error code. 2024-03-30T13:55:04.003 INFO:journalctl@ceph.mon.b.smithi181.stdout: See "systemctl status ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4@iscsi.foo.smithi099.qyjuvr.service" and "journalctl -xeu ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4@iscsi.foo.smithi099.qyjuvr.service" for details. 2024-03-30T13:55:04.003 INFO:journalctl@ceph.mon.b.smithi181.stdout: Traceback (most recent call last): 2024-03-30T13:55:04.003 INFO:journalctl@ceph.mon.b.smithi181.stdout: File "/usr/share/ceph/mgr/cephadm/serve.py", line 1114, in _check_daemons 2024-03-30T13:55:04.003 INFO:journalctl@ceph.mon.b.smithi181.stdout: self.mgr._daemon_action(daemon_spec, action=action) 2024-03-30T13:55:04.003 INFO:journalctl@ceph.mon.b.smithi181.stdout: File "/usr/share/ceph/mgr/cephadm/module.py", line 2390, in _daemon_action 2024-03-30T13:55:04.003 INFO:journalctl@ceph.mon.b.smithi181.stdout: CephadmServe(self)._create_daemon(daemon_spec, reconfig=(action == 'reconfig'))) 2024-03-30T13:55:04.003 INFO:journalctl@ceph.mon.b.smithi181.stdout: File "/usr/share/ceph/mgr/cephadm/module.py", line 747, in wait_async 2024-03-30T13:55:04.003 INFO:journalctl@ceph.mon.b.smithi181.stdout: return self.event_loop.get_result(coro, timeout) 2024-03-30T13:55:04.003 INFO:journalctl@ceph.mon.b.smithi181.stdout: File "/usr/share/ceph/mgr/cephadm/ssh.py", line 136, in get_result 2024-03-30T13:55:04.003 INFO:journalctl@ceph.mon.b.smithi181.stdout: return future.result(timeout) 2024-03-30T13:55:04.003 INFO:journalctl@ceph.mon.b.smithi181.stdout: File "/lib64/python3.6/concurrent/futures/_base.py", line 432, in result 2024-03-30T13:55:04.004 INFO:journalctl@ceph.mon.b.smithi181.stdout: return self.__get_result() 2024-03-30T13:55:04.004 INFO:journalctl@ceph.mon.b.smithi181.stdout: File "/lib64/python3.6/concurrent/futures/_base.py", line 384, in __get_result 2024-03-30T13:55:04.004 INFO:journalctl@ceph.mon.b.smithi181.stdout: raise self._exception 2024-03-30T13:55:04.004 INFO:journalctl@ceph.mon.b.smithi181.stdout: File "/usr/share/ceph/mgr/cephadm/serve.py", line 1374, in _create_daemon 2024-03-30T13:55:04.004 INFO:journalctl@ceph.mon.b.smithi181.stdout: config_blobs=daemon_spec.final_config, 2024-03-30T13:55:04.004 INFO:journalctl@ceph.mon.b.smithi181.stdout: File "/usr/share/ceph/mgr/cephadm/serve.py", line 1685, in _run_cephadm 2024-03-30T13:55:04.004 INFO:journalctl@ceph.mon.b.smithi181.stdout: f'cephadm exited with an error code: {code}, stderr: {err}') 2024-03-30T13:55:04.004 INFO:journalctl@ceph.mon.b.smithi181.stdout: orchestrator._interface.OrchestratorError: cephadm exited with an error code: 1, stderr: Reconfig daemon iscsi.foo.smithi099.qyjuvr ... 2024-03-30T13:55:04.004 INFO:journalctl@ceph.mon.b.smithi181.stdout: Creating ceph-iscsi config... 2024-03-30T13:55:04.004 INFO:journalctl@ceph.mon.b.smithi181.stdout: Write file: /var/lib/ceph/98ebaeb8-ee99-11ee-b647-cb9ed24678a4/iscsi.foo.smithi099.qyjuvr/iscsi-gateway.cfg 2024-03-30T13:55:04.004 INFO:journalctl@ceph.mon.b.smithi181.stdout: Write file: /var/lib/ceph/98ebaeb8-ee99-11ee-b647-cb9ed24678a4/iscsi.foo.smithi099.qyjuvr/tcmu-runner-entrypoint.sh 2024-03-30T13:55:04.004 INFO:journalctl@ceph.mon.b.smithi181.stdout: Non-zero exit code 1 from systemctl restart ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4@iscsi.foo.smithi099.qyjuvr 2024-03-30T13:55:04.004 INFO:journalctl@ceph.mon.b.smithi181.stdout: systemctl: stderr Job for ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4@iscsi.foo.smithi099.qyjuvr.service failed because the control process exited with error code. 2024-03-30T13:55:04.004 INFO:journalctl@ceph.mon.b.smithi181.stdout: systemctl: stderr See "systemctl status ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4@iscsi.foo.smithi099.qyjuvr.service" and "journalctl -xeu ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4@iscsi.foo.smithi099.qyjuvr.service" for details. 2024-03-30T13:55:04.004 INFO:journalctl@ceph.mon.b.smithi181.stdout: Traceback (most recent call last): 2024-03-30T13:55:04.005 INFO:journalctl@ceph.mon.b.smithi181.stdout: File "/usr/lib64/python3.9/runpy.py", line 197, in _run_module_as_main 2024-03-30T13:55:04.005 INFO:journalctl@ceph.mon.b.smithi181.stdout: return _run_code(code, main_globals, None, 2024-03-30T13:55:04.005 INFO:journalctl@ceph.mon.b.smithi181.stdout: File "/usr/lib64/python3.9/runpy.py", line 87, in _run_code 2024-03-30T13:55:04.005 INFO:journalctl@ceph.mon.b.smithi181.stdout: exec(code, run_globals) 2024-03-30T13:55:04.005 INFO:journalctl@ceph.mon.b.smithi181.stdout: File "/var/lib/ceph/98ebaeb8-ee99-11ee-b647-cb9ed24678a4/cephadm.a8f553f8c0a1bbbd91f4e60c8e13381b6fabffa3561f875fe77bb96af479b3ca/__main__.py", line 5528, in 2024-03-30T13:55:04.005 INFO:journalctl@ceph.mon.b.smithi181.stdout: File "/var/lib/ceph/98ebaeb8-ee99-11ee-b647-cb9ed24678a4/cephadm.a8f553f8c0a1bbbd91f4e60c8e13381b6fabffa3561f875fe77bb96af479b3ca/__main__.py", line 5516, in main 2024-03-30T13:55:04.005 INFO:journalctl@ceph.mon.b.smithi181.stdout: File "/var/lib/ceph/98ebaeb8-ee99-11ee-b647-cb9ed24678a4/cephadm.a8f553f8c0a1bbbd91f4e60c8e13381b6fabffa3561f875fe77bb96af479b3ca/__main__.py", line 3040, in command_deploy_from 2024-03-30T13:55:04.005 INFO:journalctl@ceph.mon.b.smithi181.stdout: File "/var/lib/ceph/98ebaeb8-ee99-11ee-b647-cb9ed24678a4/cephadm.a8f553f8c0a1bbbd91f4e60c8e13381b6fabffa3561f875fe77bb96af479b3ca/__main__.py", line 3075, in _common_deploy 2024-03-30T13:55:04.005 INFO:journalctl@ceph.mon.b.smithi181.stdout: File "/var/lib/ceph/98ebaeb8-ee99-11ee-b647-cb9ed24678a4/cephadm.a8f553f8c0a1bbbd91f4e60c8e13381b6fabffa3561f875fe77bb96af479b3ca/__main__.py", line 3095, in _deploy_daemon_container 2024-03-30T13:55:04.005 INFO:journalctl@ceph.mon.b.smithi181.stdout: File "/var/lib/ceph/98ebaeb8-ee99-11ee-b647-cb9ed24678a4/cephadm.a8f553f8c0a1bbbd91f4e60c8e13381b6fabffa3561f875fe77bb96af479b3ca/__main__.py", line 1067, in deploy_daemon 2024-03-30T13:55:04.005 INFO:journalctl@ceph.mon.b.smithi181.stdout: File "/var/lib/ceph/98ebaeb8-ee99-11ee-b647-cb9ed24678a4/cephadm.a8f553f8c0a1bbbd91f4e60c8e13381b6fabffa3561f875fe77bb96af479b3ca/cephadmlib/call_wrappers.py", line 307, in call_throws 2024-03-30T13:55:04.005 INFO:journalctl@ceph.mon.b.smithi181.stdout: RuntimeError: Failed command: systemctl restart ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4@iscsi.foo.smithi099.qyjuvr: Job for ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4@iscsi.foo.smithi099.qyjuvr.service failed because the control process exited with error code. 2024-03-30T13:55:04.005 INFO:journalctl@ceph.mon.b.smithi181.stdout: See "systemctl status ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4@iscsi.foo.smithi099.qyjuvr.service" and "journalctl -xeu ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4@iscsi.foo.smithi099.qyjuvr.service" for details. 2024-03-30T13:55:04.005 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:55:03 smithi181 ceph-mon[25762]: Reconfiguring prometheus.a (dependencies changed)... 2024-03-30T13:55:04.005 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:55:03 smithi181 ceph-mon[25762]: Reconfiguring daemon prometheus.a on smithi181 2024-03-30T13:55:04.006 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:55:03 smithi181 ceph-mon[25762]: Standby manager daemon y started 2024-03-30T13:55:04.006 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:55:03 smithi181 ceph-mon[25762]: from='mgr.? 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-03-30T13:55:04.006 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:55:03 smithi181 ceph-mon[25762]: from='mgr.? 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-03-30T13:55:04.006 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:55:03 smithi181 ceph-mon[25762]: from='mgr.? 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-03-30T13:55:04.006 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:55:03 smithi181 ceph-mon[25762]: from='mgr.? 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-03-30T13:55:04.006 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:55:03 smithi181 ceph-mon[25762]: from='mgr.24890 ' entity='mgr.x' 2024-03-30T13:55:04.006 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:55:03 smithi181 ceph-mon[25762]: from='mgr.24890 ' entity='mgr.x' 2024-03-30T13:55:04.006 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:55:03 smithi181 ceph-mon[25762]: from='mgr.24890 ' entity='mgr.x' 2024-03-30T13:55:05.002 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:55:04 smithi181 ceph-mon[25762]: pgmap v12: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 63 KiB/s rd, 0 B/s wr, 36 op/s 2024-03-30T13:55:05.002 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:55:04 smithi181 ceph-mon[25762]: pgmap v13: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 57 KiB/s rd, 0 B/s wr, 32 op/s 2024-03-30T13:55:05.002 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:55:04 smithi181 ceph-mon[25762]: pgmap v14: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 77 KiB/s rd, 0 B/s wr, 44 op/s 2024-03-30T13:55:05.002 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:55:04 smithi181 ceph-mon[25762]: mgrmap e35: x(active, since 8s), standbys: y 2024-03-30T13:55:05.002 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:55:04 smithi181 ceph-mon[25762]: from='mgr.24890 172.21.15.181:0/1979512792' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-03-30T13:55:05.003 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:55:04 smithi181 ceph-mon[25762]: from='mgr.24890 ' entity='mgr.x' 2024-03-30T13:55:05.003 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:55:04 smithi181 ceph-mon[25762]: from='mgr.24890 ' entity='mgr.x' 2024-03-30T13:55:05.003 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:55:04 smithi181 ceph-mon[25762]: from='mgr.24890 ' entity='mgr.x' 2024-03-30T13:55:05.083 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:55:04 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[71049]: ::ffff:172.21.15.181 - - [30/Mar/2024:13:55:04] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-03-30T13:55:05.083 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:55:04 smithi099 ceph-mon[24912]: pgmap v12: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 63 KiB/s rd, 0 B/s wr, 36 op/s 2024-03-30T13:55:05.084 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:55:04 smithi099 ceph-mon[24912]: pgmap v13: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 57 KiB/s rd, 0 B/s wr, 32 op/s 2024-03-30T13:55:05.084 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:55:04 smithi099 ceph-mon[24912]: pgmap v14: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 77 KiB/s rd, 0 B/s wr, 44 op/s 2024-03-30T13:55:05.084 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:55:04 smithi099 ceph-mon[24912]: mgrmap e35: x(active, since 8s), standbys: y 2024-03-30T13:55:05.084 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:55:04 smithi099 ceph-mon[24912]: from='mgr.24890 172.21.15.181:0/1979512792' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-03-30T13:55:05.084 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:55:04 smithi099 ceph-mon[24912]: from='mgr.24890 ' entity='mgr.x' 2024-03-30T13:55:05.084 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:55:04 smithi099 ceph-mon[24912]: from='mgr.24890 ' entity='mgr.x' 2024-03-30T13:55:05.084 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:55:04 smithi099 ceph-mon[24912]: from='mgr.24890 ' entity='mgr.x' 2024-03-30T13:55:05.084 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:55:04 smithi099 ceph-mon[29691]: pgmap v12: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 63 KiB/s rd, 0 B/s wr, 36 op/s 2024-03-30T13:55:05.084 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:55:04 smithi099 ceph-mon[29691]: pgmap v13: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 57 KiB/s rd, 0 B/s wr, 32 op/s 2024-03-30T13:55:05.084 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:55:04 smithi099 ceph-mon[29691]: pgmap v14: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 77 KiB/s rd, 0 B/s wr, 44 op/s 2024-03-30T13:55:05.084 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:55:04 smithi099 ceph-mon[29691]: mgrmap e35: x(active, since 8s), standbys: y 2024-03-30T13:55:05.084 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:55:04 smithi099 ceph-mon[29691]: from='mgr.24890 172.21.15.181:0/1979512792' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-03-30T13:55:05.085 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:55:04 smithi099 ceph-mon[29691]: from='mgr.24890 ' entity='mgr.x' 2024-03-30T13:55:05.085 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:55:04 smithi099 ceph-mon[29691]: from='mgr.24890 ' entity='mgr.x' 2024-03-30T13:55:05.085 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:55:04 smithi099 ceph-mon[29691]: from='mgr.24890 ' entity='mgr.x' 2024-03-30T13:55:06.002 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:55:05 smithi181 ceph-mon[25762]: pgmap v15: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 56 KiB/s rd, 0 B/s wr, 32 op/s 2024-03-30T13:55:06.002 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:55:05 smithi181 ceph-mon[25762]: pgmap v16: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 62 KiB/s rd, 0 B/s wr, 35 op/s 2024-03-30T13:55:06.333 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:55:05 smithi099 ceph-mon[24912]: pgmap v15: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 56 KiB/s rd, 0 B/s wr, 32 op/s 2024-03-30T13:55:06.333 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:55:05 smithi099 ceph-mon[24912]: pgmap v16: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 62 KiB/s rd, 0 B/s wr, 35 op/s 2024-03-30T13:55:06.333 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:55:05 smithi099 ceph-mon[29691]: pgmap v15: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 56 KiB/s rd, 0 B/s wr, 32 op/s 2024-03-30T13:55:06.333 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:55:05 smithi099 ceph-mon[29691]: pgmap v16: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 62 KiB/s rd, 0 B/s wr, 35 op/s 2024-03-30T13:55:06.352 INFO:journalctl@ceph.prometheus.a.smithi181.stdout:Mar 30 13:55:06 smithi181 systemd[1]: Stopping Ceph prometheus.a for 98ebaeb8-ee99-11ee-b647-cb9ed24678a4... 2024-03-30T13:55:06.352 INFO:journalctl@ceph.prometheus.a.smithi181.stdout:Mar 30 13:55:06 smithi181 bash[68066]: Error: no container with name or ID "ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-prometheus.a" found: no such container 2024-03-30T13:55:06.703 INFO:journalctl@ceph.prometheus.a.smithi181.stdout:Mar 30 13:55:06 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-prometheus-a[63597]: ts=2024-03-30T13:55:06.354Z caller=main.go:775 level=warn msg="Received SIGTERM, exiting gracefully..." 2024-03-30T13:55:06.703 INFO:journalctl@ceph.prometheus.a.smithi181.stdout:Mar 30 13:55:06 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-prometheus-a[63597]: ts=2024-03-30T13:55:06.354Z caller=main.go:798 level=info msg="Stopping scrape discovery manager..." 2024-03-30T13:55:06.703 INFO:journalctl@ceph.prometheus.a.smithi181.stdout:Mar 30 13:55:06 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-prometheus-a[63597]: ts=2024-03-30T13:55:06.354Z caller=main.go:812 level=info msg="Stopping notify discovery manager..." 2024-03-30T13:55:06.703 INFO:journalctl@ceph.prometheus.a.smithi181.stdout:Mar 30 13:55:06 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-prometheus-a[63597]: ts=2024-03-30T13:55:06.355Z caller=main.go:834 level=info msg="Stopping scrape manager..." 2024-03-30T13:55:06.703 INFO:journalctl@ceph.prometheus.a.smithi181.stdout:Mar 30 13:55:06 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-prometheus-a[63597]: ts=2024-03-30T13:55:06.355Z caller=main.go:808 level=info msg="Notify discovery manager stopped" 2024-03-30T13:55:06.703 INFO:journalctl@ceph.prometheus.a.smithi181.stdout:Mar 30 13:55:06 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-prometheus-a[63597]: ts=2024-03-30T13:55:06.355Z caller=main.go:794 level=info msg="Scrape discovery manager stopped" 2024-03-30T13:55:06.703 INFO:journalctl@ceph.prometheus.a.smithi181.stdout:Mar 30 13:55:06 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-prometheus-a[63597]: ts=2024-03-30T13:55:06.355Z caller=manager.go:945 level=info component="rule manager" msg="Stopping rule manager..." 2024-03-30T13:55:06.703 INFO:journalctl@ceph.prometheus.a.smithi181.stdout:Mar 30 13:55:06 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-prometheus-a[63597]: ts=2024-03-30T13:55:06.355Z caller=main.go:828 level=info msg="Scrape manager stopped" 2024-03-30T13:55:06.703 INFO:journalctl@ceph.prometheus.a.smithi181.stdout:Mar 30 13:55:06 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-prometheus-a[63597]: ts=2024-03-30T13:55:06.355Z caller=manager.go:955 level=info component="rule manager" msg="Rule manager stopped" 2024-03-30T13:55:06.704 INFO:journalctl@ceph.prometheus.a.smithi181.stdout:Mar 30 13:55:06 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-prometheus-a[63597]: ts=2024-03-30T13:55:06.355Z caller=notifier.go:600 level=info component=notifier msg="Stopping notification manager..." 2024-03-30T13:55:06.704 INFO:journalctl@ceph.prometheus.a.smithi181.stdout:Mar 30 13:55:06 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-prometheus-a[63597]: ts=2024-03-30T13:55:06.355Z caller=main.go:1054 level=info msg="Notifier manager stopped" 2024-03-30T13:55:06.704 INFO:journalctl@ceph.prometheus.a.smithi181.stdout:Mar 30 13:55:06 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-prometheus-a[63597]: ts=2024-03-30T13:55:06.355Z caller=main.go:1066 level=info msg="See you next time!" 2024-03-30T13:55:06.704 INFO:journalctl@ceph.prometheus.a.smithi181.stdout:Mar 30 13:55:06 smithi181 podman[68079]: 2024-03-30 13:55:06.364933013 +0000 UTC m=+0.134543170 container died 9bcfb373cf8c564687b9be02df59ca73905593290577a69447f0fe91d5f70dcb (image=quay.io/prometheus/prometheus:v2.33.4, name=ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-prometheus-a, maintainer=The Prometheus Authors ) 2024-03-30T13:55:07.002 INFO:journalctl@ceph.prometheus.a.smithi181.stdout:Mar 30 13:55:06 smithi181 podman[68079]: 2024-03-30 13:55:06.796239608 +0000 UTC m=+0.565849772 container cleanup 9bcfb373cf8c564687b9be02df59ca73905593290577a69447f0fe91d5f70dcb (image=quay.io/prometheus/prometheus:v2.33.4, name=ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-prometheus-a, maintainer=The Prometheus Authors ) 2024-03-30T13:55:07.002 INFO:journalctl@ceph.prometheus.a.smithi181.stdout:Mar 30 13:55:06 smithi181 bash[68079]: ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-prometheus-a 2024-03-30T13:55:07.002 INFO:journalctl@ceph.prometheus.a.smithi181.stdout:Mar 30 13:55:06 smithi181 bash[68107]: Error: no container with name or ID "ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-prometheus.a" found: no such container 2024-03-30T13:55:07.313 INFO:journalctl@ceph.prometheus.a.smithi181.stdout:Mar 30 13:55:07 smithi181 podman[68093]: 2024-03-30 13:55:07.056495213 +0000 UTC m=+0.694141593 container remove 9bcfb373cf8c564687b9be02df59ca73905593290577a69447f0fe91d5f70dcb (image=quay.io/prometheus/prometheus:v2.33.4, name=ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-prometheus-a, maintainer=The Prometheus Authors ) 2024-03-30T13:55:07.313 INFO:journalctl@ceph.prometheus.a.smithi181.stdout:Mar 30 13:55:07 smithi181 systemd[1]: ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4@prometheus.a.service: Deactivated successfully. 2024-03-30T13:55:07.313 INFO:journalctl@ceph.prometheus.a.smithi181.stdout:Mar 30 13:55:07 smithi181 systemd[1]: Stopped Ceph prometheus.a for 98ebaeb8-ee99-11ee-b647-cb9ed24678a4. 2024-03-30T13:55:07.313 INFO:journalctl@ceph.prometheus.a.smithi181.stdout:Mar 30 13:55:07 smithi181 systemd[1]: ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4@prometheus.a.service: Consumed 1.297s CPU time. 2024-03-30T13:55:07.313 INFO:journalctl@ceph.prometheus.a.smithi181.stdout:Mar 30 13:55:07 smithi181 systemd[1]: Starting Ceph prometheus.a for 98ebaeb8-ee99-11ee-b647-cb9ed24678a4... 2024-03-30T13:55:07.313 INFO:journalctl@ceph.prometheus.a.smithi181.stdout:Mar 30 13:55:07 smithi181 podman[68173]: 2024-03-30 13:55:07.196296427 +0000 UTC m=+0.019682438 image pull 514e6a882f6e74806a5856468489eeff8d7106095557578da96935e4d0ba4d9d quay.io/prometheus/prometheus:v2.33.4 2024-03-30T13:55:07.313 INFO:journalctl@ceph.prometheus.a.smithi181.stdout:Mar 30 13:55:07 smithi181 podman[68173]: 2024-03-30 13:55:07.316057 +0000 UTC m=+0.139443037 container create 54e4324e49e367fdc711d55def7aa13f625b776cccad29ec8f161f19a9f90f4f (image=quay.io/prometheus/prometheus:v2.33.4, name=ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-prometheus-a, maintainer=The Prometheus Authors ) 2024-03-30T13:55:07.871 INFO:journalctl@ceph.prometheus.a.smithi181.stdout:Mar 30 13:55:07 smithi181 podman[68173]: 2024-03-30 13:55:07.568271077 +0000 UTC m=+0.391657076 container init 54e4324e49e367fdc711d55def7aa13f625b776cccad29ec8f161f19a9f90f4f (image=quay.io/prometheus/prometheus:v2.33.4, name=ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-prometheus-a, maintainer=The Prometheus Authors ) 2024-03-30T13:55:07.871 INFO:journalctl@ceph.prometheus.a.smithi181.stdout:Mar 30 13:55:07 smithi181 podman[68173]: 2024-03-30 13:55:07.57092203 +0000 UTC m=+0.394308031 container start 54e4324e49e367fdc711d55def7aa13f625b776cccad29ec8f161f19a9f90f4f (image=quay.io/prometheus/prometheus:v2.33.4, name=ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-prometheus-a, maintainer=The Prometheus Authors ) 2024-03-30T13:55:07.871 INFO:journalctl@ceph.prometheus.a.smithi181.stdout:Mar 30 13:55:07 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-prometheus-a[68188]: ts=2024-03-30T13:55:07.594Z caller=main.go:475 level=info msg="No time or size retention was set so using the default time retention" duration=15d 2024-03-30T13:55:07.871 INFO:journalctl@ceph.prometheus.a.smithi181.stdout:Mar 30 13:55:07 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-prometheus-a[68188]: ts=2024-03-30T13:55:07.594Z caller=main.go:512 level=info msg="Starting Prometheus" version="(version=2.33.4, branch=HEAD, revision=83032011a5d3e6102624fe58241a374a7201fee8)" 2024-03-30T13:55:07.871 INFO:journalctl@ceph.prometheus.a.smithi181.stdout:Mar 30 13:55:07 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-prometheus-a[68188]: ts=2024-03-30T13:55:07.594Z caller=main.go:517 level=info build_context="(go=go1.17.7, user=root@d13bf69e7be8, date=20220222-16:51:28)" 2024-03-30T13:55:07.871 INFO:journalctl@ceph.prometheus.a.smithi181.stdout:Mar 30 13:55:07 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-prometheus-a[68188]: ts=2024-03-30T13:55:07.594Z caller=main.go:518 level=info host_details="(Linux 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 x86_64 smithi181 (none))" 2024-03-30T13:55:07.871 INFO:journalctl@ceph.prometheus.a.smithi181.stdout:Mar 30 13:55:07 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-prometheus-a[68188]: ts=2024-03-30T13:55:07.594Z caller=main.go:519 level=info fd_limits="(soft=1048576, hard=1048576)" 2024-03-30T13:55:07.871 INFO:journalctl@ceph.prometheus.a.smithi181.stdout:Mar 30 13:55:07 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-prometheus-a[68188]: ts=2024-03-30T13:55:07.594Z caller=main.go:520 level=info vm_limits="(soft=unlimited, hard=unlimited)" 2024-03-30T13:55:07.872 INFO:journalctl@ceph.prometheus.a.smithi181.stdout:Mar 30 13:55:07 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-prometheus-a[68188]: ts=2024-03-30T13:55:07.595Z caller=web.go:570 level=info component=web msg="Start listening for connections" address=:9095 2024-03-30T13:55:07.872 INFO:journalctl@ceph.prometheus.a.smithi181.stdout:Mar 30 13:55:07 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-prometheus-a[68188]: ts=2024-03-30T13:55:07.596Z caller=main.go:923 level=info msg="Starting TSDB ..." 2024-03-30T13:55:07.872 INFO:journalctl@ceph.prometheus.a.smithi181.stdout:Mar 30 13:55:07 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-prometheus-a[68188]: ts=2024-03-30T13:55:07.596Z caller=tls_config.go:195 level=info component=web msg="TLS is disabled." http2=false 2024-03-30T13:55:07.872 INFO:journalctl@ceph.prometheus.a.smithi181.stdout:Mar 30 13:55:07 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-prometheus-a[68188]: ts=2024-03-30T13:55:07.598Z caller=head.go:493 level=info component=tsdb msg="Replaying on-disk memory mappable chunks if any" 2024-03-30T13:55:07.872 INFO:journalctl@ceph.prometheus.a.smithi181.stdout:Mar 30 13:55:07 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-prometheus-a[68188]: ts=2024-03-30T13:55:07.598Z caller=head.go:527 level=info component=tsdb msg="On-disk memory mappable chunks replay completed" duration=3.607µs 2024-03-30T13:55:07.872 INFO:journalctl@ceph.prometheus.a.smithi181.stdout:Mar 30 13:55:07 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-prometheus-a[68188]: ts=2024-03-30T13:55:07.598Z caller=head.go:533 level=info component=tsdb msg="Replaying WAL, this may take a while" 2024-03-30T13:55:07.872 INFO:journalctl@ceph.prometheus.a.smithi181.stdout:Mar 30 13:55:07 smithi181 bash[68173]: 54e4324e49e367fdc711d55def7aa13f625b776cccad29ec8f161f19a9f90f4f 2024-03-30T13:55:07.872 INFO:journalctl@ceph.prometheus.a.smithi181.stdout:Mar 30 13:55:07 smithi181 systemd[1]: Started Ceph prometheus.a for 98ebaeb8-ee99-11ee-b647-cb9ed24678a4. 2024-03-30T13:55:07.872 INFO:journalctl@ceph.prometheus.a.smithi181.stdout:Mar 30 13:55:07 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-prometheus-a[68188]: ts=2024-03-30T13:55:07.807Z caller=head.go:604 level=info component=tsdb msg="WAL segment loaded" segment=0 maxSegment=5 2024-03-30T13:55:08.174 INFO:journalctl@ceph.prometheus.a.smithi181.stdout:Mar 30 13:55:07 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-prometheus-a[68188]: ts=2024-03-30T13:55:07.987Z caller=head.go:604 level=info component=tsdb msg="WAL segment loaded" segment=1 maxSegment=5 2024-03-30T13:55:08.174 INFO:journalctl@ceph.prometheus.a.smithi181.stdout:Mar 30 13:55:08 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-prometheus-a[68188]: ts=2024-03-30T13:55:08.067Z caller=head.go:604 level=info component=tsdb msg="WAL segment loaded" segment=2 maxSegment=5 2024-03-30T13:55:08.175 INFO:journalctl@ceph.prometheus.a.smithi181.stdout:Mar 30 13:55:08 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-prometheus-a[68188]: ts=2024-03-30T13:55:08.118Z caller=head.go:604 level=info component=tsdb msg="WAL segment loaded" segment=3 maxSegment=5 2024-03-30T13:55:08.175 INFO:journalctl@ceph.prometheus.a.smithi181.stdout:Mar 30 13:55:08 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-prometheus-a[68188]: ts=2024-03-30T13:55:08.177Z caller=head.go:604 level=info component=tsdb msg="WAL segment loaded" segment=4 maxSegment=5 2024-03-30T13:55:08.175 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:55:07 smithi181 ceph-mon[25762]: pgmap v17: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 39 KiB/s rd, 0 B/s wr, 22 op/s 2024-03-30T13:55:08.175 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:55:07 smithi181 ceph-mon[25762]: from='mgr.24890 ' entity='mgr.x' 2024-03-30T13:55:08.175 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:55:07 smithi181 ceph-mon[25762]: from='mgr.24890 ' entity='mgr.x' 2024-03-30T13:55:08.175 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:55:07 smithi181 ceph-mon[25762]: from='mgr.24890 ' entity='mgr.x' 2024-03-30T13:55:08.175 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:55:07 smithi181 ceph-mon[25762]: from='mgr.24890 ' entity='mgr.x' 2024-03-30T13:55:08.175 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:55:07 smithi181 ceph-mon[25762]: from='mgr.24890 ' entity='mgr.x' 2024-03-30T13:55:08.175 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:55:07 smithi181 ceph-mon[25762]: from='mgr.24890 172.21.15.181:0/1979512792' entity='mgr.x' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-03-30T13:55:08.175 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:55:07 smithi181 ceph-mon[25762]: from='mgr.24890 172.21.15.181:0/1979512792' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:55:08.175 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:55:07 smithi181 ceph-mon[25762]: from='mgr.24890 172.21.15.181:0/1979512792' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:55:08.175 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:55:07 smithi181 ceph-mon[25762]: from='mgr.24890 ' entity='mgr.x' 2024-03-30T13:55:08.175 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:55:07 smithi181 ceph-mon[25762]: from='mgr.24890 172.21.15.181:0/1979512792' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.iscsi.foo.smithi099.qyjuvr", "caps": ["mon", "profile rbd, allow command \"osd blocklist\", allow command \"config-key get\" with \"key\" prefix \"iscsi/\"", "mgr", "allow command \"service status\"", "osd", "allow rwx"]}]: dispatch 2024-03-30T13:55:08.175 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:55:07 smithi181 ceph-mon[25762]: from='mgr.24890 ' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.iscsi.foo.smithi099.qyjuvr", "caps": ["mon", "profile rbd, allow command \"osd blocklist\", allow command \"config-key get\" with \"key\" prefix \"iscsi/\"", "mgr", "allow command \"service status\"", "osd", "allow rwx"]}]: dispatch 2024-03-30T13:55:08.176 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:55:07 smithi181 ceph-mon[25762]: from='mgr.24890 172.21.15.181:0/1979512792' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:55:08.333 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:55:07 smithi099 ceph-mon[29691]: pgmap v17: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 39 KiB/s rd, 0 B/s wr, 22 op/s 2024-03-30T13:55:08.333 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:55:07 smithi099 ceph-mon[29691]: from='mgr.24890 ' entity='mgr.x' 2024-03-30T13:55:08.333 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:55:07 smithi099 ceph-mon[29691]: from='mgr.24890 ' entity='mgr.x' 2024-03-30T13:55:08.333 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:55:07 smithi099 ceph-mon[29691]: from='mgr.24890 ' entity='mgr.x' 2024-03-30T13:55:08.333 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:55:07 smithi099 ceph-mon[29691]: from='mgr.24890 ' entity='mgr.x' 2024-03-30T13:55:08.333 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:55:07 smithi099 ceph-mon[29691]: from='mgr.24890 ' entity='mgr.x' 2024-03-30T13:55:08.333 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:55:07 smithi099 ceph-mon[29691]: from='mgr.24890 172.21.15.181:0/1979512792' entity='mgr.x' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-03-30T13:55:08.334 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:55:07 smithi099 ceph-mon[29691]: from='mgr.24890 172.21.15.181:0/1979512792' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:55:08.334 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:55:07 smithi099 ceph-mon[29691]: from='mgr.24890 172.21.15.181:0/1979512792' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:55:08.334 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:55:07 smithi099 ceph-mon[29691]: from='mgr.24890 ' entity='mgr.x' 2024-03-30T13:55:08.334 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:55:07 smithi099 ceph-mon[29691]: from='mgr.24890 172.21.15.181:0/1979512792' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.iscsi.foo.smithi099.qyjuvr", "caps": ["mon", "profile rbd, allow command \"osd blocklist\", allow command \"config-key get\" with \"key\" prefix \"iscsi/\"", "mgr", "allow command \"service status\"", "osd", "allow rwx"]}]: dispatch 2024-03-30T13:55:08.334 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:55:07 smithi099 ceph-mon[29691]: from='mgr.24890 ' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.iscsi.foo.smithi099.qyjuvr", "caps": ["mon", "profile rbd, allow command \"osd blocklist\", allow command \"config-key get\" with \"key\" prefix \"iscsi/\"", "mgr", "allow command \"service status\"", "osd", "allow rwx"]}]: dispatch 2024-03-30T13:55:08.334 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:55:07 smithi099 ceph-mon[29691]: from='mgr.24890 172.21.15.181:0/1979512792' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:55:08.334 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:55:07 smithi099 ceph-mon[24912]: pgmap v17: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 39 KiB/s rd, 0 B/s wr, 22 op/s 2024-03-30T13:55:08.334 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:55:07 smithi099 ceph-mon[24912]: from='mgr.24890 ' entity='mgr.x' 2024-03-30T13:55:08.334 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:55:07 smithi099 ceph-mon[24912]: from='mgr.24890 ' entity='mgr.x' 2024-03-30T13:55:08.334 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:55:07 smithi099 ceph-mon[24912]: from='mgr.24890 ' entity='mgr.x' 2024-03-30T13:55:08.334 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:55:07 smithi099 ceph-mon[24912]: from='mgr.24890 ' entity='mgr.x' 2024-03-30T13:55:08.335 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:55:07 smithi099 ceph-mon[24912]: from='mgr.24890 ' entity='mgr.x' 2024-03-30T13:55:08.335 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:55:07 smithi099 ceph-mon[24912]: from='mgr.24890 172.21.15.181:0/1979512792' entity='mgr.x' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-03-30T13:55:08.335 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:55:07 smithi099 ceph-mon[24912]: from='mgr.24890 172.21.15.181:0/1979512792' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:55:08.335 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:55:07 smithi099 ceph-mon[24912]: from='mgr.24890 172.21.15.181:0/1979512792' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:55:08.335 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:55:07 smithi099 ceph-mon[24912]: from='mgr.24890 ' entity='mgr.x' 2024-03-30T13:55:08.335 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:55:07 smithi099 ceph-mon[24912]: from='mgr.24890 172.21.15.181:0/1979512792' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.iscsi.foo.smithi099.qyjuvr", "caps": ["mon", "profile rbd, allow command \"osd blocklist\", allow command \"config-key get\" with \"key\" prefix \"iscsi/\"", "mgr", "allow command \"service status\"", "osd", "allow rwx"]}]: dispatch 2024-03-30T13:55:08.335 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:55:07 smithi099 ceph-mon[24912]: from='mgr.24890 ' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.iscsi.foo.smithi099.qyjuvr", "caps": ["mon", "profile rbd, allow command \"osd blocklist\", allow command \"config-key get\" with \"key\" prefix \"iscsi/\"", "mgr", "allow command \"service status\"", "osd", "allow rwx"]}]: dispatch 2024-03-30T13:55:08.335 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:55:07 smithi099 ceph-mon[24912]: from='mgr.24890 172.21.15.181:0/1979512792' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:55:08.502 INFO:journalctl@ceph.prometheus.a.smithi181.stdout:Mar 30 13:55:08 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-prometheus-a[68188]: ts=2024-03-30T13:55:08.178Z caller=head.go:604 level=info component=tsdb msg="WAL segment loaded" segment=5 maxSegment=5 2024-03-30T13:55:08.502 INFO:journalctl@ceph.prometheus.a.smithi181.stdout:Mar 30 13:55:08 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-prometheus-a[68188]: ts=2024-03-30T13:55:08.178Z caller=head.go:610 level=info component=tsdb msg="WAL replay completed" checkpoint_replay_duration=80.279µs wal_replay_duration=578.982229ms total_replay_duration=579.141291ms 2024-03-30T13:55:08.502 INFO:journalctl@ceph.prometheus.a.smithi181.stdout:Mar 30 13:55:08 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-prometheus-a[68188]: ts=2024-03-30T13:55:08.181Z caller=main.go:944 level=info fs_type=XFS_SUPER_MAGIC 2024-03-30T13:55:08.502 INFO:journalctl@ceph.prometheus.a.smithi181.stdout:Mar 30 13:55:08 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-prometheus-a[68188]: ts=2024-03-30T13:55:08.181Z caller=main.go:947 level=info msg="TSDB started" 2024-03-30T13:55:08.502 INFO:journalctl@ceph.prometheus.a.smithi181.stdout:Mar 30 13:55:08 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-prometheus-a[68188]: ts=2024-03-30T13:55:08.181Z caller=main.go:1128 level=info msg="Loading configuration file" filename=/etc/prometheus/prometheus.yml 2024-03-30T13:55:08.502 INFO:journalctl@ceph.prometheus.a.smithi181.stdout:Mar 30 13:55:08 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-prometheus-a[68188]: ts=2024-03-30T13:55:08.201Z caller=main.go:1165 level=info msg="Completed loading of configuration file" filename=/etc/prometheus/prometheus.yml totalDuration=19.879799ms db_storage=749ns remote_storage=1.304µs web_handler=384ns query_engine=591ns scrape=398.015µs scrape_sd=76.906µs notify=15.364µs notify_sd=10.021µs rules=19.15897ms 2024-03-30T13:55:08.503 INFO:journalctl@ceph.prometheus.a.smithi181.stdout:Mar 30 13:55:08 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-prometheus-a[68188]: ts=2024-03-30T13:55:08.201Z caller=main.go:896 level=info msg="Server is ready to receive web requests." 2024-03-30T13:55:09.083 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:55:08 smithi099 ceph-mon[24912]: pgmap v18: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:55:09.083 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:55:08 smithi099 ceph-mon[24912]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-03-30T13:55:09.084 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:55:08 smithi099 ceph-mon[24912]: pgmap v19: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:55:09.084 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:55:08 smithi099 ceph-mon[24912]: pgmap v20: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:55:09.084 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:55:08 smithi099 ceph-mon[24912]: Reconfiguring iscsi.foo.smithi099.qyjuvr (dependencies changed)... 2024-03-30T13:55:09.084 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:55:08 smithi099 ceph-mon[24912]: Reconfiguring daemon iscsi.foo.smithi099.qyjuvr on smithi099 2024-03-30T13:55:09.084 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:55:08 smithi099 ceph-mon[24912]: Health check update: 2 failed cephadm daemon(s) (CEPHADM_FAILED_DAEMON) 2024-03-30T13:55:09.084 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:55:08 smithi099 ceph-mon[29691]: pgmap v18: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:55:09.084 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:55:08 smithi099 ceph-mon[29691]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-03-30T13:55:09.084 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:55:08 smithi099 ceph-mon[29691]: pgmap v19: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:55:09.084 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:55:08 smithi099 ceph-mon[29691]: pgmap v20: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:55:09.084 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:55:08 smithi099 ceph-mon[29691]: Reconfiguring iscsi.foo.smithi099.qyjuvr (dependencies changed)... 2024-03-30T13:55:09.084 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:55:08 smithi099 ceph-mon[29691]: Reconfiguring daemon iscsi.foo.smithi099.qyjuvr on smithi099 2024-03-30T13:55:09.084 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:55:08 smithi099 ceph-mon[29691]: Health check update: 2 failed cephadm daemon(s) (CEPHADM_FAILED_DAEMON) 2024-03-30T13:55:09.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:55:08 smithi181 ceph-mon[25762]: pgmap v18: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:55:09.262 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:55:08 smithi181 ceph-mon[25762]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-03-30T13:55:09.262 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:55:08 smithi181 ceph-mon[25762]: pgmap v19: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:55:09.262 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:55:08 smithi181 ceph-mon[25762]: pgmap v20: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:55:09.262 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:55:08 smithi181 ceph-mon[25762]: Reconfiguring iscsi.foo.smithi099.qyjuvr (dependencies changed)... 2024-03-30T13:55:09.262 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:55:08 smithi181 ceph-mon[25762]: Reconfiguring daemon iscsi.foo.smithi099.qyjuvr on smithi099 2024-03-30T13:55:09.262 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:55:08 smithi181 ceph-mon[25762]: Health check update: 2 failed cephadm daemon(s) (CEPHADM_FAILED_DAEMON) 2024-03-30T13:55:11.254 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:55:10 smithi181 ceph-mon[25762]: pgmap v21: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:55:11.254 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:55:10 smithi181 ceph-mon[25762]: from='mgr.24890 ' entity='mgr.x' 2024-03-30T13:55:11.254 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:55:10 smithi181 ceph-mon[25762]: from='mgr.24890 ' entity='mgr.x' 2024-03-30T13:55:11.254 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:55:10 smithi181 ceph-mon[25762]: from='mgr.24890 172.21.15.181:0/1979512792' entity='mgr.x' cmd=[{"prefix": "dashboard iscsi-gateway-list"}]: dispatch 2024-03-30T13:55:11.254 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:55:10 smithi181 ceph-mon[25762]: from='mgr.24890 172.21.15.181:0/1979512792' entity='mgr.x' cmd=[{"prefix": "dashboard set-iscsi-api-ssl-verification", "value": "true"}]: dispatch 2024-03-30T13:55:11.254 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:55:10 smithi181 ceph-mon[25762]: from='mgr.24890 172.21.15.181:0/1979512792' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:55:11.254 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:55:10 smithi181 ceph-mon[25762]: from='mgr.24890 172.21.15.181:0/1979512792' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:55:11.254 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:55:10 smithi181 ceph-mon[25762]: from='mgr.24890 ' entity='mgr.x' 2024-03-30T13:55:11.333 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:55:10 smithi099 ceph-mon[29691]: pgmap v21: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:55:11.333 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:55:10 smithi099 ceph-mon[29691]: from='mgr.24890 ' entity='mgr.x' 2024-03-30T13:55:11.333 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:55:10 smithi099 ceph-mon[29691]: from='mgr.24890 ' entity='mgr.x' 2024-03-30T13:55:11.333 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:55:10 smithi099 ceph-mon[29691]: from='mgr.24890 172.21.15.181:0/1979512792' entity='mgr.x' cmd=[{"prefix": "dashboard iscsi-gateway-list"}]: dispatch 2024-03-30T13:55:11.333 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:55:10 smithi099 ceph-mon[29691]: from='mgr.24890 172.21.15.181:0/1979512792' entity='mgr.x' cmd=[{"prefix": "dashboard set-iscsi-api-ssl-verification", "value": "true"}]: dispatch 2024-03-30T13:55:11.333 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:55:10 smithi099 ceph-mon[29691]: from='mgr.24890 172.21.15.181:0/1979512792' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:55:11.333 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:55:10 smithi099 ceph-mon[29691]: from='mgr.24890 172.21.15.181:0/1979512792' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:55:11.333 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:55:10 smithi099 ceph-mon[29691]: from='mgr.24890 ' entity='mgr.x' 2024-03-30T13:55:11.333 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:55:10 smithi099 ceph-mon[24912]: pgmap v21: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:55:11.334 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:55:10 smithi099 ceph-mon[24912]: from='mgr.24890 ' entity='mgr.x' 2024-03-30T13:55:11.334 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:55:10 smithi099 ceph-mon[24912]: from='mgr.24890 ' entity='mgr.x' 2024-03-30T13:55:11.334 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:55:10 smithi099 ceph-mon[24912]: from='mgr.24890 172.21.15.181:0/1979512792' entity='mgr.x' cmd=[{"prefix": "dashboard iscsi-gateway-list"}]: dispatch 2024-03-30T13:55:11.334 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:55:10 smithi099 ceph-mon[24912]: from='mgr.24890 172.21.15.181:0/1979512792' entity='mgr.x' cmd=[{"prefix": "dashboard set-iscsi-api-ssl-verification", "value": "true"}]: dispatch 2024-03-30T13:55:11.334 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:55:10 smithi099 ceph-mon[24912]: from='mgr.24890 172.21.15.181:0/1979512792' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:55:11.334 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:55:10 smithi099 ceph-mon[24912]: from='mgr.24890 172.21.15.181:0/1979512792' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:55:11.334 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:55:10 smithi099 ceph-mon[24912]: from='mgr.24890 ' entity='mgr.x' 2024-03-30T13:55:12.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:55:11 smithi181 ceph-mon[25762]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard iscsi-gateway-list"}]: dispatch 2024-03-30T13:55:12.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:55:11 smithi181 ceph-mon[25762]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard set-iscsi-api-ssl-verification", "value": "true"}]: dispatch 2024-03-30T13:55:12.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:55:11 smithi181 ceph-mon[25762]: pgmap v22: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:55:12.253 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:55:11 smithi181 ceph-mon[25762]: pgmap v23: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:55:12.253 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:55:11 smithi181 ceph-mon[25762]: from='mgr.24890 172.21.15.181:0/1979512792' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T13:55:12.253 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:55:11 smithi181 ceph-mon[25762]: from='client.? 172.21.15.99:0/3944166463' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-03-30T13:55:12.253 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:55:11 smithi181 ceph-mon[25762]: from='client.? 172.21.15.99:0/2082460953' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.99:6801/1768898510"}]: dispatch 2024-03-30T13:55:12.333 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:55:11 smithi099 ceph-mon[24912]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard iscsi-gateway-list"}]: dispatch 2024-03-30T13:55:12.333 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:55:11 smithi099 ceph-mon[24912]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard set-iscsi-api-ssl-verification", "value": "true"}]: dispatch 2024-03-30T13:55:12.333 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:55:11 smithi099 ceph-mon[24912]: pgmap v22: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:55:12.334 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:55:11 smithi099 ceph-mon[24912]: pgmap v23: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:55:12.334 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:55:11 smithi099 ceph-mon[24912]: from='mgr.24890 172.21.15.181:0/1979512792' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T13:55:12.334 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:55:11 smithi099 ceph-mon[24912]: from='client.? 172.21.15.99:0/3944166463' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-03-30T13:55:12.334 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:55:11 smithi099 ceph-mon[24912]: from='client.? 172.21.15.99:0/2082460953' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.99:6801/1768898510"}]: dispatch 2024-03-30T13:55:12.334 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:55:11 smithi099 ceph-mon[29691]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard iscsi-gateway-list"}]: dispatch 2024-03-30T13:55:12.334 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:55:11 smithi099 ceph-mon[29691]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard set-iscsi-api-ssl-verification", "value": "true"}]: dispatch 2024-03-30T13:55:12.335 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:55:11 smithi099 ceph-mon[29691]: pgmap v22: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:55:12.335 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:55:11 smithi099 ceph-mon[29691]: pgmap v23: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:55:12.335 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:55:11 smithi099 ceph-mon[29691]: from='mgr.24890 172.21.15.181:0/1979512792' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T13:55:12.335 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:55:11 smithi099 ceph-mon[29691]: from='client.? 172.21.15.99:0/3944166463' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-03-30T13:55:12.335 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:55:11 smithi099 ceph-mon[29691]: from='client.? 172.21.15.99:0/2082460953' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.99:6801/1768898510"}]: dispatch 2024-03-30T13:55:13.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:55:12 smithi181 ceph-mon[25762]: from='client.? 172.21.15.99:0/2082460953' entity='client.iscsi.foo.smithi099.qyjuvr' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.99:6801/1768898510"}]': finished 2024-03-30T13:55:13.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:55:12 smithi181 ceph-mon[25762]: osdmap e106: 8 total, 8 up, 8 in 2024-03-30T13:55:13.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:55:12 smithi181 ceph-mon[25762]: from='client.? 172.21.15.99:0/1444637342' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.99:6800/1768898510"}]: dispatch 2024-03-30T13:55:13.333 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:55:12 smithi099 ceph-mon[29691]: from='client.? 172.21.15.99:0/2082460953' entity='client.iscsi.foo.smithi099.qyjuvr' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.99:6801/1768898510"}]': finished 2024-03-30T13:55:13.333 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:55:12 smithi099 ceph-mon[29691]: osdmap e106: 8 total, 8 up, 8 in 2024-03-30T13:55:13.333 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:55:12 smithi099 ceph-mon[29691]: from='client.? 172.21.15.99:0/1444637342' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.99:6800/1768898510"}]: dispatch 2024-03-30T13:55:13.333 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:55:12 smithi099 ceph-mon[24912]: from='client.? 172.21.15.99:0/2082460953' entity='client.iscsi.foo.smithi099.qyjuvr' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.99:6801/1768898510"}]': finished 2024-03-30T13:55:13.333 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:55:12 smithi099 ceph-mon[24912]: osdmap e106: 8 total, 8 up, 8 in 2024-03-30T13:55:13.333 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:55:12 smithi099 ceph-mon[24912]: from='client.? 172.21.15.99:0/1444637342' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.99:6800/1768898510"}]: dispatch 2024-03-30T13:55:14.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:55:13 smithi181 ceph-mon[25762]: pgmap v25: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 419 B/s rd, 0 op/s 2024-03-30T13:55:14.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:55:13 smithi181 ceph-mon[25762]: from='client.? 172.21.15.99:0/1444637342' entity='client.iscsi.foo.smithi099.qyjuvr' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.99:6800/1768898510"}]': finished 2024-03-30T13:55:14.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:55:13 smithi181 ceph-mon[25762]: osdmap e107: 8 total, 8 up, 8 in 2024-03-30T13:55:14.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:55:13 smithi181 ceph-mon[25762]: from='client.? 172.21.15.99:0/3199621697' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.99:0/468075200"}]: dispatch 2024-03-30T13:55:14.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:55:13 smithi181 ceph-mon[25762]: from='client.? ' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.99:0/468075200"}]: dispatch 2024-03-30T13:55:14.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:55:13 smithi181 ceph-mon[25762]: Health check update: 1 failed cephadm daemon(s) (CEPHADM_FAILED_DAEMON) 2024-03-30T13:55:14.333 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:55:13 smithi099 ceph-mon[24912]: pgmap v25: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 419 B/s rd, 0 op/s 2024-03-30T13:55:14.333 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:55:13 smithi099 ceph-mon[24912]: from='client.? 172.21.15.99:0/1444637342' entity='client.iscsi.foo.smithi099.qyjuvr' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.99:6800/1768898510"}]': finished 2024-03-30T13:55:14.333 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:55:13 smithi099 ceph-mon[24912]: osdmap e107: 8 total, 8 up, 8 in 2024-03-30T13:55:14.333 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:55:13 smithi099 ceph-mon[24912]: from='client.? 172.21.15.99:0/3199621697' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.99:0/468075200"}]: dispatch 2024-03-30T13:55:14.333 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:55:13 smithi099 ceph-mon[24912]: from='client.? ' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.99:0/468075200"}]: dispatch 2024-03-30T13:55:14.333 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:55:13 smithi099 ceph-mon[24912]: Health check update: 1 failed cephadm daemon(s) (CEPHADM_FAILED_DAEMON) 2024-03-30T13:55:14.334 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:55:13 smithi099 ceph-mon[29691]: pgmap v25: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 419 B/s rd, 0 op/s 2024-03-30T13:55:14.334 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:55:13 smithi099 ceph-mon[29691]: from='client.? 172.21.15.99:0/1444637342' entity='client.iscsi.foo.smithi099.qyjuvr' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.99:6800/1768898510"}]': finished 2024-03-30T13:55:14.334 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:55:13 smithi099 ceph-mon[29691]: osdmap e107: 8 total, 8 up, 8 in 2024-03-30T13:55:14.334 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:55:13 smithi099 ceph-mon[29691]: from='client.? 172.21.15.99:0/3199621697' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.99:0/468075200"}]: dispatch 2024-03-30T13:55:14.334 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:55:13 smithi099 ceph-mon[29691]: from='client.? ' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.99:0/468075200"}]: dispatch 2024-03-30T13:55:14.334 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:55:13 smithi099 ceph-mon[29691]: Health check update: 1 failed cephadm daemon(s) (CEPHADM_FAILED_DAEMON) 2024-03-30T13:55:15.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:55:14 smithi181 ceph-mon[25762]: from='client.? ' entity='client.iscsi.foo.smithi099.qyjuvr' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.99:0/468075200"}]': finished 2024-03-30T13:55:15.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:55:14 smithi181 ceph-mon[25762]: osdmap e108: 8 total, 8 up, 8 in 2024-03-30T13:55:15.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:55:14 smithi181 ceph-mon[25762]: from='client.? 172.21.15.99:0/1996509241' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.99:0/3786770314"}]: dispatch 2024-03-30T13:55:15.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:55:14 smithi181 ceph-mon[25762]: from='client.? ' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.99:0/3786770314"}]: dispatch 2024-03-30T13:55:15.333 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:55:14 smithi099 ceph-mon[24912]: from='client.? ' entity='client.iscsi.foo.smithi099.qyjuvr' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.99:0/468075200"}]': finished 2024-03-30T13:55:15.333 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:55:14 smithi099 ceph-mon[24912]: osdmap e108: 8 total, 8 up, 8 in 2024-03-30T13:55:15.333 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:55:14 smithi099 ceph-mon[24912]: from='client.? 172.21.15.99:0/1996509241' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.99:0/3786770314"}]: dispatch 2024-03-30T13:55:15.333 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:55:14 smithi099 ceph-mon[24912]: from='client.? ' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.99:0/3786770314"}]: dispatch 2024-03-30T13:55:15.333 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:55:14 smithi099 ceph-mon[29691]: from='client.? ' entity='client.iscsi.foo.smithi099.qyjuvr' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.99:0/468075200"}]': finished 2024-03-30T13:55:15.333 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:55:14 smithi099 ceph-mon[29691]: osdmap e108: 8 total, 8 up, 8 in 2024-03-30T13:55:15.334 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:55:14 smithi099 ceph-mon[29691]: from='client.? 172.21.15.99:0/1996509241' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.99:0/3786770314"}]: dispatch 2024-03-30T13:55:15.334 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:55:14 smithi099 ceph-mon[29691]: from='client.? ' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.99:0/3786770314"}]: dispatch 2024-03-30T13:55:16.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:55:15 smithi181 ceph-mon[25762]: pgmap v28: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 511 B/s rd, 0 op/s 2024-03-30T13:55:16.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:55:15 smithi181 ceph-mon[25762]: from='client.? ' entity='client.iscsi.foo.smithi099.qyjuvr' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.99:0/3786770314"}]': finished 2024-03-30T13:55:16.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:55:15 smithi181 ceph-mon[25762]: osdmap e109: 8 total, 8 up, 8 in 2024-03-30T13:55:16.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:55:15 smithi181 ceph-mon[25762]: from='client.? 172.21.15.99:0/3578820120' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.99:0/3099425038"}]: dispatch 2024-03-30T13:55:16.333 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:55:15 smithi099 ceph-mon[24912]: pgmap v28: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 511 B/s rd, 0 op/s 2024-03-30T13:55:16.333 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:55:15 smithi099 ceph-mon[24912]: from='client.? ' entity='client.iscsi.foo.smithi099.qyjuvr' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.99:0/3786770314"}]': finished 2024-03-30T13:55:16.333 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:55:15 smithi099 ceph-mon[24912]: osdmap e109: 8 total, 8 up, 8 in 2024-03-30T13:55:16.333 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:55:15 smithi099 ceph-mon[24912]: from='client.? 172.21.15.99:0/3578820120' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.99:0/3099425038"}]: dispatch 2024-03-30T13:55:16.334 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:55:15 smithi099 ceph-mon[29691]: pgmap v28: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 511 B/s rd, 0 op/s 2024-03-30T13:55:16.334 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:55:15 smithi099 ceph-mon[29691]: from='client.? ' entity='client.iscsi.foo.smithi099.qyjuvr' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.99:0/3786770314"}]': finished 2024-03-30T13:55:16.334 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:55:15 smithi099 ceph-mon[29691]: osdmap e109: 8 total, 8 up, 8 in 2024-03-30T13:55:16.334 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:55:15 smithi099 ceph-mon[29691]: from='client.? 172.21.15.99:0/3578820120' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.99:0/3099425038"}]: dispatch 2024-03-30T13:55:17.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:55:16 smithi181 ceph-mon[25762]: from='client.? 172.21.15.99:0/3578820120' entity='client.iscsi.foo.smithi099.qyjuvr' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.99:0/3099425038"}]': finished 2024-03-30T13:55:17.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:55:16 smithi181 ceph-mon[25762]: osdmap e110: 8 total, 8 up, 8 in 2024-03-30T13:55:17.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:55:16 smithi181 ceph-mon[25762]: from='client.? 172.21.15.99:0/592206696' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.99:0/1568602912"}]: dispatch 2024-03-30T13:55:17.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:55:16 smithi181 ceph-mon[25762]: from='client.? ' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.99:0/1568602912"}]: dispatch 2024-03-30T13:55:17.333 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:55:16 smithi099 ceph-mon[24912]: from='client.? 172.21.15.99:0/3578820120' entity='client.iscsi.foo.smithi099.qyjuvr' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.99:0/3099425038"}]': finished 2024-03-30T13:55:17.333 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:55:16 smithi099 ceph-mon[24912]: osdmap e110: 8 total, 8 up, 8 in 2024-03-30T13:55:17.333 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:55:16 smithi099 ceph-mon[24912]: from='client.? 172.21.15.99:0/592206696' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.99:0/1568602912"}]: dispatch 2024-03-30T13:55:17.333 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:55:16 smithi099 ceph-mon[24912]: from='client.? ' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.99:0/1568602912"}]: dispatch 2024-03-30T13:55:17.333 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:55:16 smithi099 ceph-mon[29691]: from='client.? 172.21.15.99:0/3578820120' entity='client.iscsi.foo.smithi099.qyjuvr' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.99:0/3099425038"}]': finished 2024-03-30T13:55:17.333 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:55:16 smithi099 ceph-mon[29691]: osdmap e110: 8 total, 8 up, 8 in 2024-03-30T13:55:17.333 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:55:16 smithi099 ceph-mon[29691]: from='client.? 172.21.15.99:0/592206696' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.99:0/1568602912"}]: dispatch 2024-03-30T13:55:17.333 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:55:16 smithi099 ceph-mon[29691]: from='client.? ' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.99:0/1568602912"}]: dispatch 2024-03-30T13:55:17.940 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 13:55:17 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-x[50211]: ::ffff:172.21.15.181 - - [30/Mar/2024:13:55:17] "GET /metrics HTTP/1.1" 200 37986 "" "Prometheus/2.33.4" 2024-03-30T13:55:18.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:55:17 smithi181 ceph-mon[25762]: pgmap v31: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:55:18.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:55:17 smithi181 ceph-mon[25762]: from='client.? ' entity='client.iscsi.foo.smithi099.qyjuvr' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.99:0/1568602912"}]': finished 2024-03-30T13:55:18.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:55:17 smithi181 ceph-mon[25762]: osdmap e111: 8 total, 8 up, 8 in 2024-03-30T13:55:18.333 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:55:17 smithi099 ceph-mon[24912]: pgmap v31: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:55:18.333 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:55:17 smithi099 ceph-mon[24912]: from='client.? ' entity='client.iscsi.foo.smithi099.qyjuvr' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.99:0/1568602912"}]': finished 2024-03-30T13:55:18.333 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:55:17 smithi099 ceph-mon[24912]: osdmap e111: 8 total, 8 up, 8 in 2024-03-30T13:55:18.333 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:55:17 smithi099 ceph-mon[29691]: pgmap v31: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:55:18.333 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:55:17 smithi099 ceph-mon[29691]: from='client.? ' entity='client.iscsi.foo.smithi099.qyjuvr' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.99:0/1568602912"}]': finished 2024-03-30T13:55:18.333 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:55:17 smithi099 ceph-mon[29691]: osdmap e111: 8 total, 8 up, 8 in 2024-03-30T13:55:20.002 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:55:19 smithi181 ceph-mon[25762]: pgmap v33: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-03-30T13:55:20.258 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:55:19 smithi099 ceph-mon[24912]: pgmap v33: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-03-30T13:55:20.258 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:55:19 smithi099 ceph-mon[29691]: pgmap v33: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-03-30T13:55:22.082 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:55:21 smithi099 ceph-mon[24912]: pgmap v34: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T13:55:22.083 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:55:21 smithi099 ceph-mon[24912]: from='client.15324 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T13:55:22.083 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:55:21 smithi099 ceph-mon[29691]: pgmap v34: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T13:55:22.083 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:55:21 smithi099 ceph-mon[29691]: from='client.15324 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T13:55:22.218 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:55:21 smithi181 ceph-mon[25762]: pgmap v34: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T13:55:22.218 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:55:21 smithi181 ceph-mon[25762]: from='client.15324 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T13:55:24.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:55:23 smithi181 ceph-mon[25762]: pgmap v35: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-03-30T13:55:24.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:55:23 smithi181 ceph-mon[25762]: from='mgr.24890 ' entity='mgr.x' 2024-03-30T13:55:24.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:55:23 smithi181 ceph-mon[25762]: from='mgr.24890 ' entity='mgr.x' 2024-03-30T13:55:24.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:55:23 smithi181 ceph-mon[25762]: from='mgr.24890 ' entity='mgr.x' 2024-03-30T13:55:24.333 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:55:23 smithi099 ceph-mon[24912]: pgmap v35: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-03-30T13:55:24.333 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:55:23 smithi099 ceph-mon[24912]: from='mgr.24890 ' entity='mgr.x' 2024-03-30T13:55:24.333 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:55:23 smithi099 ceph-mon[24912]: from='mgr.24890 ' entity='mgr.x' 2024-03-30T13:55:24.333 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:55:23 smithi099 ceph-mon[24912]: from='mgr.24890 ' entity='mgr.x' 2024-03-30T13:55:24.334 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:55:23 smithi099 ceph-mon[29691]: pgmap v35: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-03-30T13:55:24.334 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:55:23 smithi099 ceph-mon[29691]: from='mgr.24890 ' entity='mgr.x' 2024-03-30T13:55:24.334 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:55:23 smithi099 ceph-mon[29691]: from='mgr.24890 ' entity='mgr.x' 2024-03-30T13:55:24.334 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:55:23 smithi099 ceph-mon[29691]: from='mgr.24890 ' entity='mgr.x' 2024-03-30T13:55:25.002 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:55:24 smithi181 ceph-mon[25762]: pgmap v36: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-03-30T13:55:25.002 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:55:24 smithi181 ceph-mon[25762]: pgmap v37: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-03-30T13:55:25.305 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:55:24 smithi099 ceph-mon[24912]: pgmap v36: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-03-30T13:55:25.306 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:55:24 smithi099 ceph-mon[24912]: pgmap v37: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-03-30T13:55:25.306 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:55:24 smithi099 ceph-mon[29691]: pgmap v36: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-03-30T13:55:25.306 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:55:24 smithi099 ceph-mon[29691]: pgmap v37: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-03-30T13:55:27.002 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:55:26 smithi181 ceph-mon[25762]: pgmap v38: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 587 B/s rd, 0 op/s 2024-03-30T13:55:27.003 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:55:26 smithi181 ceph-mon[25762]: from='mgr.24890 ' entity='mgr.x' 2024-03-30T13:55:27.003 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:55:26 smithi181 ceph-mon[25762]: from='mgr.24890 ' entity='mgr.x' 2024-03-30T13:55:27.003 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:55:26 smithi181 ceph-mon[25762]: pgmap v39: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 719 B/s rd, 0 op/s 2024-03-30T13:55:27.003 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:55:26 smithi181 ceph-mon[25762]: pgmap v40: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 1001 B/s rd, 0 op/s 2024-03-30T13:55:27.003 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:55:26 smithi181 ceph-mon[25762]: from='mgr.24890 ' entity='mgr.x' 2024-03-30T13:55:27.003 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:55:26 smithi181 ceph-mon[25762]: from='mgr.24890 ' entity='mgr.x' 2024-03-30T13:55:27.003 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:55:26 smithi181 ceph-mon[25762]: from='mgr.24890 ' entity='mgr.x' 2024-03-30T13:55:27.003 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:55:26 smithi181 ceph-mon[25762]: pgmap v41: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:55:27.003 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:55:26 smithi181 ceph-mon[25762]: pgmap v42: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:55:27.003 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:55:26 smithi181 ceph-mon[25762]: from='mgr.24890 ' entity='mgr.x' 2024-03-30T13:55:27.003 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:55:26 smithi181 ceph-mon[25762]: from='mgr.24890 172.21.15.181:0/1979512792' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T13:55:27.083 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:55:26 smithi099 ceph-mon[29691]: pgmap v38: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 587 B/s rd, 0 op/s 2024-03-30T13:55:27.083 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:55:26 smithi099 ceph-mon[29691]: from='mgr.24890 ' entity='mgr.x' 2024-03-30T13:55:27.083 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:55:26 smithi099 ceph-mon[29691]: from='mgr.24890 ' entity='mgr.x' 2024-03-30T13:55:27.083 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:55:26 smithi099 ceph-mon[29691]: pgmap v39: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 719 B/s rd, 0 op/s 2024-03-30T13:55:27.083 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:55:26 smithi099 ceph-mon[29691]: pgmap v40: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 1001 B/s rd, 0 op/s 2024-03-30T13:55:27.084 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:55:26 smithi099 ceph-mon[29691]: from='mgr.24890 ' entity='mgr.x' 2024-03-30T13:55:27.084 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:55:26 smithi099 ceph-mon[29691]: from='mgr.24890 ' entity='mgr.x' 2024-03-30T13:55:27.084 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:55:26 smithi099 ceph-mon[29691]: from='mgr.24890 ' entity='mgr.x' 2024-03-30T13:55:27.084 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:55:26 smithi099 ceph-mon[29691]: pgmap v41: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:55:27.084 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:55:26 smithi099 ceph-mon[29691]: pgmap v42: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:55:27.084 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:55:26 smithi099 ceph-mon[29691]: from='mgr.24890 ' entity='mgr.x' 2024-03-30T13:55:27.084 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:55:26 smithi099 ceph-mon[29691]: from='mgr.24890 172.21.15.181:0/1979512792' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T13:55:27.084 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:55:26 smithi099 ceph-mon[24912]: pgmap v38: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 587 B/s rd, 0 op/s 2024-03-30T13:55:27.084 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:55:26 smithi099 ceph-mon[24912]: from='mgr.24890 ' entity='mgr.x' 2024-03-30T13:55:27.084 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:55:26 smithi099 ceph-mon[24912]: from='mgr.24890 ' entity='mgr.x' 2024-03-30T13:55:27.084 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:55:26 smithi099 ceph-mon[24912]: pgmap v39: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 719 B/s rd, 0 op/s 2024-03-30T13:55:27.084 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:55:26 smithi099 ceph-mon[24912]: pgmap v40: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 1001 B/s rd, 0 op/s 2024-03-30T13:55:27.085 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:55:26 smithi099 ceph-mon[24912]: from='mgr.24890 ' entity='mgr.x' 2024-03-30T13:55:27.085 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:55:26 smithi099 ceph-mon[24912]: from='mgr.24890 ' entity='mgr.x' 2024-03-30T13:55:27.085 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:55:26 smithi099 ceph-mon[24912]: from='mgr.24890 ' entity='mgr.x' 2024-03-30T13:55:27.085 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:55:26 smithi099 ceph-mon[24912]: pgmap v41: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:55:27.085 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:55:26 smithi099 ceph-mon[24912]: pgmap v42: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:55:27.085 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:55:26 smithi099 ceph-mon[24912]: from='mgr.24890 ' entity='mgr.x' 2024-03-30T13:55:27.085 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:55:26 smithi099 ceph-mon[24912]: from='mgr.24890 172.21.15.181:0/1979512792' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T13:55:28.002 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 13:55:27 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-x[50211]: ::ffff:172.21.15.181 - - [30/Mar/2024:13:55:27] "GET /metrics HTTP/1.1" 200 37986 "" "Prometheus/2.33.4" 2024-03-30T13:55:29.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:55:28 smithi181 ceph-mon[25762]: pgmap v43: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T13:55:29.333 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:55:28 smithi099 ceph-mon[24912]: pgmap v43: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T13:55:29.333 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:55:28 smithi099 ceph-mon[29691]: pgmap v43: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T13:55:31.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:55:30 smithi181 ceph-mon[25762]: pgmap v44: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T13:55:31.333 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:55:30 smithi099 ceph-mon[29691]: pgmap v44: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T13:55:31.333 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:55:30 smithi099 ceph-mon[24912]: pgmap v44: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T13:55:32.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:55:31 smithi181 ceph-mon[25762]: from='client.15324 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T13:55:32.332 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:55:31 smithi099 ceph-mon[24912]: from='client.15324 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T13:55:32.333 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:55:31 smithi099 ceph-mon[29691]: from='client.15324 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T13:55:33.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:55:32 smithi181 ceph-mon[25762]: pgmap v45: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-03-30T13:55:33.332 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:55:32 smithi099 ceph-mon[24912]: pgmap v45: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-03-30T13:55:33.333 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:55:32 smithi099 ceph-mon[29691]: pgmap v45: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-03-30T13:55:35.083 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:55:34 smithi099 ceph-mon[24912]: pgmap v46: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T13:55:35.083 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:55:34 smithi099 ceph-mon[29691]: pgmap v46: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T13:55:35.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:55:34 smithi181 ceph-mon[25762]: pgmap v46: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T13:55:37.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:55:36 smithi181 ceph-mon[25762]: pgmap v47: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-03-30T13:55:37.332 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:55:36 smithi099 ceph-mon[24912]: pgmap v47: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-03-30T13:55:37.333 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:55:36 smithi099 ceph-mon[29691]: pgmap v47: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-03-30T13:55:38.002 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 13:55:37 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-x[50211]: ::ffff:172.21.15.181 - - [30/Mar/2024:13:55:37] "GET /metrics HTTP/1.1" 200 37986 "" "Prometheus/2.33.4" 2024-03-30T13:55:39.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:55:38 smithi181 ceph-mon[25762]: pgmap v48: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T13:55:39.332 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:55:38 smithi099 ceph-mon[24912]: pgmap v48: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T13:55:39.333 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:55:38 smithi099 ceph-mon[29691]: pgmap v48: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T13:55:41.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:55:40 smithi181 ceph-mon[25762]: pgmap v49: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T13:55:41.285 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:55:40 smithi099 ceph-mon[24912]: pgmap v49: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T13:55:41.286 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:55:40 smithi099 ceph-mon[29691]: pgmap v49: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T13:55:42.199 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:55:41 smithi181 ceph-mon[25762]: from='client.15324 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T13:55:42.199 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:55:41 smithi181 ceph-mon[25762]: from='mgr.24890 172.21.15.181:0/1979512792' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T13:55:42.333 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:55:41 smithi099 ceph-mon[24912]: from='client.15324 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T13:55:42.333 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:55:41 smithi099 ceph-mon[24912]: from='mgr.24890 172.21.15.181:0/1979512792' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T13:55:42.333 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:55:41 smithi099 ceph-mon[29691]: from='client.15324 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T13:55:42.333 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:55:41 smithi099 ceph-mon[29691]: from='mgr.24890 172.21.15.181:0/1979512792' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T13:55:43.146 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:55:42 smithi181 ceph-mon[25762]: pgmap v50: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T13:55:43.146 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:55:42 smithi181 ceph-mon[25762]: from='mgr.24890 ' entity='mgr.x' 2024-03-30T13:55:43.147 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:55:42 smithi181 ceph-mon[25762]: from='mgr.24890 ' entity='mgr.x' 2024-03-30T13:55:43.147 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:55:42 smithi181 ceph-mon[25762]: from='mgr.24890 ' entity='mgr.x' 2024-03-30T13:55:43.321 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:55:42 smithi099 ceph-mon[24912]: pgmap v50: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T13:55:43.321 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:55:42 smithi099 ceph-mon[24912]: from='mgr.24890 ' entity='mgr.x' 2024-03-30T13:55:43.321 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:55:42 smithi099 ceph-mon[24912]: from='mgr.24890 ' entity='mgr.x' 2024-03-30T13:55:43.321 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:55:42 smithi099 ceph-mon[24912]: from='mgr.24890 ' entity='mgr.x' 2024-03-30T13:55:43.321 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:55:42 smithi099 ceph-mon[29691]: pgmap v50: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T13:55:43.321 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:55:42 smithi099 ceph-mon[29691]: from='mgr.24890 ' entity='mgr.x' 2024-03-30T13:55:43.321 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:55:42 smithi099 ceph-mon[29691]: from='mgr.24890 ' entity='mgr.x' 2024-03-30T13:55:43.321 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:55:42 smithi099 ceph-mon[29691]: from='mgr.24890 ' entity='mgr.x' 2024-03-30T13:55:44.106 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:55:43 smithi181 ceph-mon[25762]: pgmap v51: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 927 B/s rd, 0 op/s 2024-03-30T13:55:44.106 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:55:43 smithi181 ceph-mon[25762]: pgmap v52: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-03-30T13:55:44.332 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:55:43 smithi099 ceph-mon[24912]: pgmap v51: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 927 B/s rd, 0 op/s 2024-03-30T13:55:44.333 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:55:43 smithi099 ceph-mon[24912]: pgmap v52: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-03-30T13:55:44.333 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:55:43 smithi099 ceph-mon[29691]: pgmap v51: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 927 B/s rd, 0 op/s 2024-03-30T13:55:44.333 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:55:43 smithi099 ceph-mon[29691]: pgmap v52: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-03-30T13:55:45.479 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:55:45 smithi099 ceph-mon[24912]: from='mgr.24890 ' entity='mgr.x' 2024-03-30T13:55:45.480 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:55:45 smithi099 ceph-mon[24912]: from='mgr.24890 ' entity='mgr.x' 2024-03-30T13:55:45.480 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:55:45 smithi099 ceph-mon[24912]: pgmap v53: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T13:55:45.480 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:55:45 smithi099 ceph-mon[24912]: pgmap v54: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 822 B/s rd, 0 op/s 2024-03-30T13:55:45.480 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:55:45 smithi099 ceph-mon[24912]: from='mgr.24890 ' entity='mgr.x' 2024-03-30T13:55:45.480 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:55:45 smithi099 ceph-mon[29691]: from='mgr.24890 ' entity='mgr.x' 2024-03-30T13:55:45.480 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:55:45 smithi099 ceph-mon[29691]: from='mgr.24890 ' entity='mgr.x' 2024-03-30T13:55:45.480 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:55:45 smithi099 ceph-mon[29691]: pgmap v53: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T13:55:45.480 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:55:45 smithi099 ceph-mon[29691]: pgmap v54: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 822 B/s rd, 0 op/s 2024-03-30T13:55:45.480 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:55:45 smithi099 ceph-mon[29691]: from='mgr.24890 ' entity='mgr.x' 2024-03-30T13:55:45.501 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:55:45 smithi181 ceph-mon[25762]: from='mgr.24890 ' entity='mgr.x' 2024-03-30T13:55:45.501 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:55:45 smithi181 ceph-mon[25762]: from='mgr.24890 ' entity='mgr.x' 2024-03-30T13:55:45.502 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:55:45 smithi181 ceph-mon[25762]: pgmap v53: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T13:55:45.502 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:55:45 smithi181 ceph-mon[25762]: pgmap v54: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 822 B/s rd, 0 op/s 2024-03-30T13:55:45.502 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:55:45 smithi181 ceph-mon[25762]: from='mgr.24890 ' entity='mgr.x' 2024-03-30T13:55:46.501 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:55:46 smithi181 ceph-mon[25762]: pgmap v55: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 823 B/s rd, 0 op/s 2024-03-30T13:55:46.582 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:55:46 smithi099 ceph-mon[24912]: pgmap v55: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 823 B/s rd, 0 op/s 2024-03-30T13:55:46.583 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:55:46 smithi099 ceph-mon[29691]: pgmap v55: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 823 B/s rd, 0 op/s 2024-03-30T13:55:48.001 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 13:55:47 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-x[50211]: ::ffff:172.21.15.181 - - [30/Mar/2024:13:55:47] "GET /metrics HTTP/1.1" 200 37983 "" "Prometheus/2.33.4" 2024-03-30T13:55:48.502 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:55:48 smithi181 ceph-mon[25762]: pgmap v56: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 822 B/s rd, 0 op/s 2024-03-30T13:55:48.582 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:55:48 smithi099 ceph-mon[24912]: pgmap v56: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 822 B/s rd, 0 op/s 2024-03-30T13:55:48.583 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:55:48 smithi099 ceph-mon[29691]: pgmap v56: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 822 B/s rd, 0 op/s 2024-03-30T13:55:50.501 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:55:50 smithi181 ceph-mon[25762]: pgmap v57: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 712 B/s rd, 0 op/s 2024-03-30T13:55:50.582 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:55:50 smithi099 ceph-mon[24912]: pgmap v57: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 712 B/s rd, 0 op/s 2024-03-30T13:55:50.583 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:55:50 smithi099 ceph-mon[29691]: pgmap v57: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 712 B/s rd, 0 op/s 2024-03-30T13:55:51.501 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:55:51 smithi181 ceph-mon[25762]: from='client.15324 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T13:55:51.582 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:55:51 smithi099 ceph-mon[24912]: from='client.15324 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T13:55:51.583 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:55:51 smithi099 ceph-mon[29691]: from='client.15324 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T13:55:52.501 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:55:52 smithi181 ceph-mon[25762]: pgmap v58: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-03-30T13:55:52.582 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:55:52 smithi099 ceph-mon[24912]: pgmap v58: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-03-30T13:55:52.583 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:55:52 smithi099 ceph-mon[29691]: pgmap v58: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-03-30T13:55:55.082 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:55:54 smithi099 ceph-mon[24912]: pgmap v59: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-03-30T13:55:55.083 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:55:54 smithi099 ceph-mon[29691]: pgmap v59: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-03-30T13:55:55.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:55:54 smithi181 ceph-mon[25762]: pgmap v59: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-03-30T13:55:56.332 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:55:56 smithi099 ceph-mon[24912]: from='mgr.24890 172.21.15.181:0/1979512792' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T13:55:56.333 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:55:56 smithi099 ceph-mon[29691]: from='mgr.24890 172.21.15.181:0/1979512792' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T13:55:56.502 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:55:56 smithi181 ceph-mon[25762]: from='mgr.24890 172.21.15.181:0/1979512792' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T13:55:57.332 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:55:57 smithi099 ceph-mon[24912]: pgmap v60: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T13:55:57.333 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:55:57 smithi099 ceph-mon[29691]: pgmap v60: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T13:55:57.501 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:55:57 smithi181 ceph-mon[25762]: pgmap v60: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T13:55:58.001 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 13:55:57 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-x[50211]: ::ffff:172.21.15.181 - - [30/Mar/2024:13:55:57] "GET /metrics HTTP/1.1" 200 37982 "" "Prometheus/2.33.4" 2024-03-30T13:55:58.501 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:55:58 smithi181 ceph-mon[25762]: pgmap v61: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T13:55:58.582 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:55:58 smithi099 ceph-mon[24912]: pgmap v61: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T13:55:58.583 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:55:58 smithi099 ceph-mon[29691]: pgmap v61: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T13:56:00.502 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:56:00 smithi181 ceph-mon[25762]: pgmap v62: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T13:56:00.582 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:56:00 smithi099 ceph-mon[24912]: pgmap v62: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T13:56:00.583 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:56:00 smithi099 ceph-mon[29691]: pgmap v62: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T13:56:01.501 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:56:01 smithi181 ceph-mon[25762]: from='client.15324 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T13:56:01.582 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:56:01 smithi099 ceph-mon[24912]: from='client.15324 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T13:56:01.583 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:56:01 smithi099 ceph-mon[29691]: from='client.15324 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T13:56:02.501 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:56:02 smithi181 ceph-mon[25762]: pgmap v63: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T13:56:02.583 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:56:02 smithi099 ceph-mon[24912]: pgmap v63: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T13:56:02.583 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:56:02 smithi099 ceph-mon[29691]: pgmap v63: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T13:56:04.333 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:56:04 smithi099 ceph-mon[24912]: from='mgr.24890 ' entity='mgr.x' 2024-03-30T13:56:04.333 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:56:04 smithi099 ceph-mon[24912]: from='mgr.24890 ' entity='mgr.x' 2024-03-30T13:56:04.333 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:56:04 smithi099 ceph-mon[24912]: pgmap v64: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 934 B/s rd, 0 op/s 2024-03-30T13:56:04.333 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:56:04 smithi099 ceph-mon[24912]: pgmap v65: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-03-30T13:56:04.333 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:56:04 smithi099 ceph-mon[24912]: from='mgr.24890 ' entity='mgr.x' 2024-03-30T13:56:04.333 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:56:04 smithi099 ceph-mon[29691]: from='mgr.24890 ' entity='mgr.x' 2024-03-30T13:56:04.334 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:56:04 smithi099 ceph-mon[29691]: from='mgr.24890 ' entity='mgr.x' 2024-03-30T13:56:04.334 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:56:04 smithi099 ceph-mon[29691]: pgmap v64: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 934 B/s rd, 0 op/s 2024-03-30T13:56:04.334 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:56:04 smithi099 ceph-mon[29691]: pgmap v65: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-03-30T13:56:04.334 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:56:04 smithi099 ceph-mon[29691]: from='mgr.24890 ' entity='mgr.x' 2024-03-30T13:56:04.501 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:56:04 smithi181 ceph-mon[25762]: from='mgr.24890 ' entity='mgr.x' 2024-03-30T13:56:04.502 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:56:04 smithi181 ceph-mon[25762]: from='mgr.24890 ' entity='mgr.x' 2024-03-30T13:56:04.502 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:56:04 smithi181 ceph-mon[25762]: pgmap v64: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 934 B/s rd, 0 op/s 2024-03-30T13:56:04.502 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:56:04 smithi181 ceph-mon[25762]: pgmap v65: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-03-30T13:56:04.502 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:56:04 smithi181 ceph-mon[25762]: from='mgr.24890 ' entity='mgr.x' 2024-03-30T13:56:05.496 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:56:05 smithi099 ceph-mon[24912]: from='mgr.24890 ' entity='mgr.x' 2024-03-30T13:56:05.496 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:56:05 smithi099 ceph-mon[24912]: from='mgr.24890 ' entity='mgr.x' 2024-03-30T13:56:05.496 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:56:05 smithi099 ceph-mon[24912]: pgmap v66: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T13:56:05.496 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:56:05 smithi099 ceph-mon[24912]: pgmap v67: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 834 B/s rd, 0 op/s 2024-03-30T13:56:05.496 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:56:05 smithi099 ceph-mon[24912]: from='mgr.24890 ' entity='mgr.x' 2024-03-30T13:56:05.497 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:56:05 smithi099 ceph-mon[29691]: from='mgr.24890 ' entity='mgr.x' 2024-03-30T13:56:05.497 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:56:05 smithi099 ceph-mon[29691]: from='mgr.24890 ' entity='mgr.x' 2024-03-30T13:56:05.497 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:56:05 smithi099 ceph-mon[29691]: pgmap v66: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T13:56:05.497 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:56:05 smithi099 ceph-mon[29691]: pgmap v67: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 834 B/s rd, 0 op/s 2024-03-30T13:56:05.497 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:56:05 smithi099 ceph-mon[29691]: from='mgr.24890 ' entity='mgr.x' 2024-03-30T13:56:05.501 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:56:05 smithi181 ceph-mon[25762]: from='mgr.24890 ' entity='mgr.x' 2024-03-30T13:56:05.501 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:56:05 smithi181 ceph-mon[25762]: from='mgr.24890 ' entity='mgr.x' 2024-03-30T13:56:05.502 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:56:05 smithi181 ceph-mon[25762]: pgmap v66: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T13:56:05.502 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:56:05 smithi181 ceph-mon[25762]: pgmap v67: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 834 B/s rd, 0 op/s 2024-03-30T13:56:05.502 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:56:05 smithi181 ceph-mon[25762]: from='mgr.24890 ' entity='mgr.x' 2024-03-30T13:56:07.582 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:56:07 smithi099 ceph-mon[24912]: pgmap v68: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 834 B/s rd, 0 op/s 2024-03-30T13:56:07.583 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:56:07 smithi099 ceph-mon[29691]: pgmap v68: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 834 B/s rd, 0 op/s 2024-03-30T13:56:07.587 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:56:07 smithi181 ceph-mon[25762]: pgmap v68: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 834 B/s rd, 0 op/s 2024-03-30T13:56:08.001 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 13:56:07 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-x[50211]: ::ffff:172.21.15.181 - - [30/Mar/2024:13:56:07] "GET /metrics HTTP/1.1" 200 37982 "" "Prometheus/2.33.4" 2024-03-30T13:56:10.082 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:56:09 smithi099 ceph-mon[24912]: pgmap v69: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 834 B/s rd, 0 op/s 2024-03-30T13:56:10.083 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:56:09 smithi099 ceph-mon[29691]: pgmap v69: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 834 B/s rd, 0 op/s 2024-03-30T13:56:10.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:56:09 smithi181 ceph-mon[25762]: pgmap v69: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 834 B/s rd, 0 op/s 2024-03-30T13:56:11.082 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:56:10 smithi099 ceph-mon[29691]: from='mgr.24890 172.21.15.181:0/1979512792' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:56:11.082 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:56:10 smithi099 ceph-mon[29691]: from='mgr.24890 172.21.15.181:0/1979512792' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:56:11.082 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:56:10 smithi099 ceph-mon[29691]: from='mgr.24890 ' entity='mgr.x' 2024-03-30T13:56:11.083 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:56:10 smithi099 ceph-mon[24912]: from='mgr.24890 172.21.15.181:0/1979512792' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:56:11.083 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:56:10 smithi099 ceph-mon[24912]: from='mgr.24890 172.21.15.181:0/1979512792' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:56:11.083 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:56:10 smithi099 ceph-mon[24912]: from='mgr.24890 ' entity='mgr.x' 2024-03-30T13:56:11.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:56:10 smithi181 ceph-mon[25762]: from='mgr.24890 172.21.15.181:0/1979512792' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:56:11.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:56:10 smithi181 ceph-mon[25762]: from='mgr.24890 172.21.15.181:0/1979512792' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:56:11.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:56:10 smithi181 ceph-mon[25762]: from='mgr.24890 ' entity='mgr.x' 2024-03-30T13:56:12.082 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:56:11 smithi099 ceph-mon[24912]: pgmap v70: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 712 B/s rd, 0 op/s 2024-03-30T13:56:12.083 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:56:11 smithi099 ceph-mon[24912]: from='client.15324 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T13:56:12.083 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:56:11 smithi099 ceph-mon[24912]: pgmap v71: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 666 B/s rd, 0 op/s 2024-03-30T13:56:12.083 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:56:11 smithi099 ceph-mon[24912]: pgmap v72: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 787 B/s rd, 0 op/s 2024-03-30T13:56:12.083 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:56:11 smithi099 ceph-mon[24912]: from='mgr.24890 172.21.15.181:0/1979512792' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T13:56:12.083 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:56:11 smithi099 ceph-mon[29691]: pgmap v70: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 712 B/s rd, 0 op/s 2024-03-30T13:56:12.083 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:56:11 smithi099 ceph-mon[29691]: from='client.15324 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T13:56:12.083 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:56:11 smithi099 ceph-mon[29691]: pgmap v71: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 666 B/s rd, 0 op/s 2024-03-30T13:56:12.083 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:56:11 smithi099 ceph-mon[29691]: pgmap v72: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 787 B/s rd, 0 op/s 2024-03-30T13:56:12.083 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:56:11 smithi099 ceph-mon[29691]: from='mgr.24890 172.21.15.181:0/1979512792' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T13:56:12.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:56:11 smithi181 ceph-mon[25762]: pgmap v70: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 712 B/s rd, 0 op/s 2024-03-30T13:56:12.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:56:11 smithi181 ceph-mon[25762]: from='client.15324 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T13:56:12.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:56:11 smithi181 ceph-mon[25762]: pgmap v71: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 666 B/s rd, 0 op/s 2024-03-30T13:56:12.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:56:11 smithi181 ceph-mon[25762]: pgmap v72: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 787 B/s rd, 0 op/s 2024-03-30T13:56:12.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:56:11 smithi181 ceph-mon[25762]: from='mgr.24890 172.21.15.181:0/1979512792' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T13:56:14.082 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:56:13 smithi099 ceph-mon[24912]: pgmap v73: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T13:56:14.083 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:56:13 smithi099 ceph-mon[29691]: pgmap v73: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T13:56:14.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:56:13 smithi181 ceph-mon[25762]: pgmap v73: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T13:56:16.082 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:56:15 smithi099 ceph-mon[24912]: pgmap v74: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T13:56:16.082 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:56:15 smithi099 ceph-mon[29691]: pgmap v74: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T13:56:16.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:56:15 smithi181 ceph-mon[25762]: pgmap v74: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T13:56:18.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:56:17 smithi181 ceph-mon[25762]: pgmap v75: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 602 B/s rd, 0 op/s 2024-03-30T13:56:18.002 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 13:56:17 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-x[50211]: ::ffff:172.21.15.181 - - [30/Mar/2024:13:56:17] "GET /metrics HTTP/1.1" 200 37984 "" "Prometheus/2.33.4" 2024-03-30T13:56:18.082 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:56:17 smithi099 ceph-mon[24912]: pgmap v75: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 602 B/s rd, 0 op/s 2024-03-30T13:56:18.083 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:56:17 smithi099 ceph-mon[29691]: pgmap v75: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 602 B/s rd, 0 op/s 2024-03-30T13:56:20.082 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:56:19 smithi099 ceph-mon[24912]: pgmap v76: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T13:56:20.083 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:56:19 smithi099 ceph-mon[29691]: pgmap v76: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T13:56:20.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:56:19 smithi181 ceph-mon[25762]: pgmap v76: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T13:56:22.082 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:56:21 smithi099 ceph-mon[24912]: from='client.15324 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T13:56:22.082 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:56:21 smithi099 ceph-mon[24912]: pgmap v77: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-03-30T13:56:22.083 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:56:21 smithi099 ceph-mon[29691]: from='client.15324 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T13:56:22.083 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:56:21 smithi099 ceph-mon[29691]: pgmap v77: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-03-30T13:56:22.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:56:21 smithi181 ceph-mon[25762]: from='client.15324 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T13:56:22.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:56:21 smithi181 ceph-mon[25762]: pgmap v77: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-03-30T13:56:24.002 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:56:23 smithi181 ceph-mon[25762]: pgmap v78: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T13:56:24.003 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:56:23 smithi181 ceph-mon[25762]: from='mgr.24890 ' entity='mgr.x' 2024-03-30T13:56:24.003 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:56:23 smithi181 ceph-mon[25762]: from='mgr.24890 ' entity='mgr.x' 2024-03-30T13:56:24.003 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:56:23 smithi181 ceph-mon[25762]: from='mgr.24890 ' entity='mgr.x' 2024-03-30T13:56:24.082 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:56:23 smithi099 ceph-mon[24912]: pgmap v78: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T13:56:24.082 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:56:23 smithi099 ceph-mon[24912]: from='mgr.24890 ' entity='mgr.x' 2024-03-30T13:56:24.082 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:56:23 smithi099 ceph-mon[24912]: from='mgr.24890 ' entity='mgr.x' 2024-03-30T13:56:24.082 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:56:23 smithi099 ceph-mon[24912]: from='mgr.24890 ' entity='mgr.x' 2024-03-30T13:56:24.083 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:56:23 smithi099 ceph-mon[29691]: pgmap v78: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T13:56:24.083 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:56:23 smithi099 ceph-mon[29691]: from='mgr.24890 ' entity='mgr.x' 2024-03-30T13:56:24.083 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:56:23 smithi099 ceph-mon[29691]: from='mgr.24890 ' entity='mgr.x' 2024-03-30T13:56:24.083 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:56:23 smithi099 ceph-mon[29691]: from='mgr.24890 ' entity='mgr.x' 2024-03-30T13:56:25.092 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:56:24 smithi099 ceph-mon[24912]: pgmap v79: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 980 B/s rd, 0 op/s 2024-03-30T13:56:25.092 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:56:24 smithi099 ceph-mon[24912]: pgmap v80: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T13:56:25.092 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:56:24 smithi099 ceph-mon[24912]: from='mgr.24890 ' entity='mgr.x' 2024-03-30T13:56:25.092 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:56:24 smithi099 ceph-mon[24912]: from='mgr.24890 ' entity='mgr.x' 2024-03-30T13:56:25.092 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:56:24 smithi099 ceph-mon[24912]: from='mgr.24890 ' entity='mgr.x' 2024-03-30T13:56:25.092 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:56:24 smithi099 ceph-mon[29691]: pgmap v79: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 980 B/s rd, 0 op/s 2024-03-30T13:56:25.092 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:56:24 smithi099 ceph-mon[29691]: pgmap v80: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T13:56:25.093 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:56:24 smithi099 ceph-mon[29691]: from='mgr.24890 ' entity='mgr.x' 2024-03-30T13:56:25.093 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:56:24 smithi099 ceph-mon[29691]: from='mgr.24890 ' entity='mgr.x' 2024-03-30T13:56:25.093 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:56:24 smithi099 ceph-mon[29691]: from='mgr.24890 ' entity='mgr.x' 2024-03-30T13:56:25.142 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:56:24 smithi181 ceph-mon[25762]: pgmap v79: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 980 B/s rd, 0 op/s 2024-03-30T13:56:25.142 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:56:24 smithi181 ceph-mon[25762]: pgmap v80: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T13:56:25.142 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:56:24 smithi181 ceph-mon[25762]: from='mgr.24890 ' entity='mgr.x' 2024-03-30T13:56:25.142 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:56:24 smithi181 ceph-mon[25762]: from='mgr.24890 ' entity='mgr.x' 2024-03-30T13:56:25.143 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:56:24 smithi181 ceph-mon[25762]: from='mgr.24890 ' entity='mgr.x' 2024-03-30T13:56:25.962 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:56:25 smithi099 ceph-mon[24912]: pgmap v81: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-03-30T13:56:25.963 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:56:25 smithi099 ceph-mon[24912]: pgmap v82: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 909 B/s rd, 0 op/s 2024-03-30T13:56:25.963 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:56:25 smithi099 ceph-mon[29691]: pgmap v81: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-03-30T13:56:25.963 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:56:25 smithi099 ceph-mon[29691]: pgmap v82: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 909 B/s rd, 0 op/s 2024-03-30T13:56:26.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:56:25 smithi181 ceph-mon[25762]: pgmap v81: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-03-30T13:56:26.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:56:25 smithi181 ceph-mon[25762]: pgmap v82: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 909 B/s rd, 0 op/s 2024-03-30T13:56:27.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:56:26 smithi181 ceph-mon[25762]: from='mgr.24890 172.21.15.181:0/1979512792' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T13:56:27.332 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:56:26 smithi099 ceph-mon[24912]: from='mgr.24890 172.21.15.181:0/1979512792' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T13:56:27.332 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:56:26 smithi099 ceph-mon[29691]: from='mgr.24890 172.21.15.181:0/1979512792' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T13:56:27.842 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 13:56:27 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-x[50211]: ::ffff:172.21.15.181 - - [30/Mar/2024:13:56:27] "GET /metrics HTTP/1.1" 200 37983 "" "Prometheus/2.33.4" 2024-03-30T13:56:28.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:56:27 smithi181 ceph-mon[25762]: pgmap v83: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 909 B/s rd, 0 op/s 2024-03-30T13:56:28.332 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:56:27 smithi099 ceph-mon[24912]: pgmap v83: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 909 B/s rd, 0 op/s 2024-03-30T13:56:28.332 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:56:27 smithi099 ceph-mon[29691]: pgmap v83: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 909 B/s rd, 0 op/s 2024-03-30T13:56:30.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:56:29 smithi181 ceph-mon[25762]: pgmap v84: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 909 B/s rd, 0 op/s 2024-03-30T13:56:30.332 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:56:29 smithi099 ceph-mon[24912]: pgmap v84: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 909 B/s rd, 0 op/s 2024-03-30T13:56:30.332 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:56:29 smithi099 ceph-mon[29691]: pgmap v84: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 909 B/s rd, 0 op/s 2024-03-30T13:56:32.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:56:31 smithi181 ceph-mon[25762]: pgmap v85: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 712 B/s rd, 0 op/s 2024-03-30T13:56:32.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:56:31 smithi181 ceph-mon[25762]: from='client.15324 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T13:56:32.332 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:56:31 smithi099 ceph-mon[24912]: pgmap v85: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 712 B/s rd, 0 op/s 2024-03-30T13:56:32.332 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:56:31 smithi099 ceph-mon[24912]: from='client.15324 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T13:56:32.332 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:56:31 smithi099 ceph-mon[29691]: pgmap v85: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 712 B/s rd, 0 op/s 2024-03-30T13:56:32.332 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:56:31 smithi099 ceph-mon[29691]: from='client.15324 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T13:56:34.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:56:33 smithi181 ceph-mon[25762]: pgmap v86: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-03-30T13:56:34.332 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:56:33 smithi099 ceph-mon[24912]: pgmap v86: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-03-30T13:56:34.332 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:56:33 smithi099 ceph-mon[29691]: pgmap v86: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-03-30T13:56:36.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:56:35 smithi181 ceph-mon[25762]: pgmap v87: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-03-30T13:56:36.332 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:56:35 smithi099 ceph-mon[24912]: pgmap v87: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-03-30T13:56:36.332 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:56:35 smithi099 ceph-mon[29691]: pgmap v87: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-03-30T13:56:37.860 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 13:56:37 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-x[50211]: ::ffff:172.21.15.181 - - [30/Mar/2024:13:56:37] "GET /metrics HTTP/1.1" 200 37983 "" "Prometheus/2.33.4" 2024-03-30T13:56:38.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:56:37 smithi181 ceph-mon[25762]: pgmap v88: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T13:56:38.332 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:56:37 smithi099 ceph-mon[29691]: pgmap v88: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T13:56:38.332 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:56:37 smithi099 ceph-mon[24912]: pgmap v88: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T13:56:40.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:56:39 smithi181 ceph-mon[25762]: pgmap v89: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T13:56:40.332 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:56:39 smithi099 ceph-mon[24912]: pgmap v89: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T13:56:40.332 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:56:39 smithi099 ceph-mon[29691]: pgmap v89: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T13:56:42.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:56:41 smithi181 ceph-mon[25762]: pgmap v90: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T13:56:42.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:56:41 smithi181 ceph-mon[25762]: from='client.15324 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T13:56:42.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:56:41 smithi181 ceph-mon[25762]: from='mgr.24890 172.21.15.181:0/1979512792' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T13:56:42.332 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:56:41 smithi099 ceph-mon[24912]: pgmap v90: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T13:56:42.332 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:56:41 smithi099 ceph-mon[24912]: from='client.15324 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T13:56:42.332 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:56:41 smithi099 ceph-mon[24912]: from='mgr.24890 172.21.15.181:0/1979512792' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T13:56:42.332 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:56:41 smithi099 ceph-mon[29691]: pgmap v90: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T13:56:42.332 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:56:41 smithi099 ceph-mon[29691]: from='client.15324 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T13:56:42.333 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:56:41 smithi099 ceph-mon[29691]: from='mgr.24890 172.21.15.181:0/1979512792' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T13:56:44.183 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:56:43 smithi181 ceph-mon[25762]: pgmap v91: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T13:56:44.183 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:56:43 smithi181 ceph-mon[25762]: from='mgr.24890 ' entity='mgr.x' 2024-03-30T13:56:44.183 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:56:43 smithi181 ceph-mon[25762]: from='mgr.24890 ' entity='mgr.x' 2024-03-30T13:56:44.183 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:56:43 smithi181 ceph-mon[25762]: from='mgr.24890 ' entity='mgr.x' 2024-03-30T13:56:44.333 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:56:43 smithi099 ceph-mon[24912]: pgmap v91: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T13:56:44.333 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:56:43 smithi099 ceph-mon[24912]: from='mgr.24890 ' entity='mgr.x' 2024-03-30T13:56:44.333 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:56:43 smithi099 ceph-mon[24912]: from='mgr.24890 ' entity='mgr.x' 2024-03-30T13:56:44.333 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:56:43 smithi099 ceph-mon[24912]: from='mgr.24890 ' entity='mgr.x' 2024-03-30T13:56:44.333 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:56:43 smithi099 ceph-mon[29691]: pgmap v91: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T13:56:44.333 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:56:43 smithi099 ceph-mon[29691]: from='mgr.24890 ' entity='mgr.x' 2024-03-30T13:56:44.333 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:56:43 smithi099 ceph-mon[29691]: from='mgr.24890 ' entity='mgr.x' 2024-03-30T13:56:44.333 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:56:43 smithi099 ceph-mon[29691]: from='mgr.24890 ' entity='mgr.x' 2024-03-30T13:56:45.082 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:56:44 smithi099 ceph-mon[29691]: pgmap v92: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 935 B/s rd, 0 op/s 2024-03-30T13:56:45.082 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:56:44 smithi099 ceph-mon[29691]: pgmap v93: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-03-30T13:56:45.082 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:56:44 smithi099 ceph-mon[29691]: from='mgr.24890 ' entity='mgr.x' 2024-03-30T13:56:45.082 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:56:44 smithi099 ceph-mon[29691]: from='mgr.24890 ' entity='mgr.x' 2024-03-30T13:56:45.082 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:56:44 smithi099 ceph-mon[29691]: from='mgr.24890 ' entity='mgr.x' 2024-03-30T13:56:45.083 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:56:44 smithi099 ceph-mon[24912]: pgmap v92: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 935 B/s rd, 0 op/s 2024-03-30T13:56:45.083 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:56:44 smithi099 ceph-mon[24912]: pgmap v93: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-03-30T13:56:45.083 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:56:44 smithi099 ceph-mon[24912]: from='mgr.24890 ' entity='mgr.x' 2024-03-30T13:56:45.083 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:56:44 smithi099 ceph-mon[24912]: from='mgr.24890 ' entity='mgr.x' 2024-03-30T13:56:45.083 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:56:44 smithi099 ceph-mon[24912]: from='mgr.24890 ' entity='mgr.x' 2024-03-30T13:56:45.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:56:44 smithi181 ceph-mon[25762]: pgmap v92: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 935 B/s rd, 0 op/s 2024-03-30T13:56:45.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:56:44 smithi181 ceph-mon[25762]: pgmap v93: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-03-30T13:56:45.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:56:44 smithi181 ceph-mon[25762]: from='mgr.24890 ' entity='mgr.x' 2024-03-30T13:56:45.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:56:44 smithi181 ceph-mon[25762]: from='mgr.24890 ' entity='mgr.x' 2024-03-30T13:56:45.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:56:44 smithi181 ceph-mon[25762]: from='mgr.24890 ' entity='mgr.x' 2024-03-30T13:56:45.920 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:56:45 smithi181 ceph-mon[25762]: pgmap v94: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T13:56:45.920 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:56:45 smithi181 ceph-mon[25762]: pgmap v95: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 835 B/s rd, 0 op/s 2024-03-30T13:56:46.149 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:56:45 smithi099 ceph-mon[24912]: pgmap v94: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T13:56:46.149 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:56:45 smithi099 ceph-mon[24912]: pgmap v95: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 835 B/s rd, 0 op/s 2024-03-30T13:56:46.149 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:56:45 smithi099 ceph-mon[29691]: pgmap v94: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T13:56:46.149 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:56:45 smithi099 ceph-mon[29691]: pgmap v95: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 835 B/s rd, 0 op/s 2024-03-30T13:56:47.888 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 13:56:47 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-x[50211]: ::ffff:172.21.15.181 - - [30/Mar/2024:13:56:47] "GET /metrics HTTP/1.1" 200 37979 "" "Prometheus/2.33.4" 2024-03-30T13:56:48.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:56:47 smithi181 ceph-mon[25762]: pgmap v96: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 835 B/s rd, 0 op/s 2024-03-30T13:56:48.332 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:56:47 smithi099 ceph-mon[24912]: pgmap v96: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 835 B/s rd, 0 op/s 2024-03-30T13:56:48.332 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:56:47 smithi099 ceph-mon[29691]: pgmap v96: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 835 B/s rd, 0 op/s 2024-03-30T13:56:50.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:56:49 smithi181 ceph-mon[25762]: pgmap v97: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 835 B/s rd, 0 op/s 2024-03-30T13:56:50.332 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:56:49 smithi099 ceph-mon[24912]: pgmap v97: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 835 B/s rd, 0 op/s 2024-03-30T13:56:50.332 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:56:49 smithi099 ceph-mon[29691]: pgmap v97: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 835 B/s rd, 0 op/s 2024-03-30T13:56:52.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:56:51 smithi181 ceph-mon[25762]: pgmap v98: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 712 B/s rd, 0 op/s 2024-03-30T13:56:52.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:56:51 smithi181 ceph-mon[25762]: from='client.15324 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T13:56:52.332 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:56:51 smithi099 ceph-mon[24912]: pgmap v98: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 712 B/s rd, 0 op/s 2024-03-30T13:56:52.332 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:56:51 smithi099 ceph-mon[24912]: from='client.15324 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T13:56:52.332 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:56:51 smithi099 ceph-mon[29691]: pgmap v98: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 712 B/s rd, 0 op/s 2024-03-30T13:56:52.332 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:56:51 smithi099 ceph-mon[29691]: from='client.15324 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T13:56:54.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:56:53 smithi181 ceph-mon[25762]: pgmap v99: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-03-30T13:56:54.332 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:56:53 smithi099 ceph-mon[24912]: pgmap v99: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-03-30T13:56:54.332 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:56:53 smithi099 ceph-mon[29691]: pgmap v99: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-03-30T13:56:56.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:56:55 smithi181 ceph-mon[25762]: pgmap v100: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-03-30T13:56:56.332 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:56:55 smithi099 ceph-mon[24912]: pgmap v100: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-03-30T13:56:56.332 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:56:55 smithi099 ceph-mon[29691]: pgmap v100: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-03-30T13:56:57.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:56:56 smithi181 ceph-mon[25762]: from='mgr.24890 172.21.15.181:0/1979512792' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T13:56:57.332 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:56:56 smithi099 ceph-mon[24912]: from='mgr.24890 172.21.15.181:0/1979512792' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T13:56:57.332 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:56:56 smithi099 ceph-mon[29691]: from='mgr.24890 172.21.15.181:0/1979512792' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T13:56:57.911 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 13:56:57 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-x[50211]: ::ffff:172.21.15.181 - - [30/Mar/2024:13:56:57] "GET /metrics HTTP/1.1" 200 37978 "" "Prometheus/2.33.4" 2024-03-30T13:56:58.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:56:57 smithi181 ceph-mon[25762]: pgmap v101: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T13:56:58.332 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:56:57 smithi099 ceph-mon[24912]: pgmap v101: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T13:56:58.332 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:56:57 smithi099 ceph-mon[29691]: pgmap v101: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T13:57:00.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:56:59 smithi181 ceph-mon[25762]: pgmap v102: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T13:57:00.332 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:56:59 smithi099 ceph-mon[29691]: pgmap v102: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T13:57:00.332 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:56:59 smithi099 ceph-mon[24912]: pgmap v102: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T13:57:02.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:57:01 smithi181 ceph-mon[25762]: pgmap v103: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T13:57:02.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:57:01 smithi181 ceph-mon[25762]: from='client.15324 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T13:57:02.332 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:57:01 smithi099 ceph-mon[24912]: pgmap v103: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T13:57:02.332 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:57:01 smithi099 ceph-mon[24912]: from='client.15324 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T13:57:02.332 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:57:01 smithi099 ceph-mon[29691]: pgmap v103: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T13:57:02.332 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:57:01 smithi099 ceph-mon[29691]: from='client.15324 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T13:57:04.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:57:03 smithi181 ceph-mon[25762]: pgmap v104: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T13:57:04.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:57:03 smithi181 ceph-mon[25762]: from='mgr.24890 ' entity='mgr.x' 2024-03-30T13:57:04.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:57:03 smithi181 ceph-mon[25762]: from='mgr.24890 ' entity='mgr.x' 2024-03-30T13:57:04.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:57:03 smithi181 ceph-mon[25762]: from='mgr.24890 ' entity='mgr.x' 2024-03-30T13:57:04.279 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:57:03 smithi099 ceph-mon[29691]: pgmap v104: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T13:57:04.279 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:57:03 smithi099 ceph-mon[29691]: from='mgr.24890 ' entity='mgr.x' 2024-03-30T13:57:04.279 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:57:03 smithi099 ceph-mon[29691]: from='mgr.24890 ' entity='mgr.x' 2024-03-30T13:57:04.279 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:57:03 smithi099 ceph-mon[29691]: from='mgr.24890 ' entity='mgr.x' 2024-03-30T13:57:04.279 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:57:03 smithi099 ceph-mon[24912]: pgmap v104: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T13:57:04.279 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:57:03 smithi099 ceph-mon[24912]: from='mgr.24890 ' entity='mgr.x' 2024-03-30T13:57:04.279 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:57:03 smithi099 ceph-mon[24912]: from='mgr.24890 ' entity='mgr.x' 2024-03-30T13:57:04.279 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:57:03 smithi099 ceph-mon[24912]: from='mgr.24890 ' entity='mgr.x' 2024-03-30T13:57:05.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:57:04 smithi181 ceph-mon[25762]: pgmap v105: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 935 B/s rd, 0 op/s 2024-03-30T13:57:05.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:57:04 smithi181 ceph-mon[25762]: pgmap v106: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-03-30T13:57:05.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:57:04 smithi181 ceph-mon[25762]: from='mgr.24890 ' entity='mgr.x' 2024-03-30T13:57:05.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:57:04 smithi181 ceph-mon[25762]: from='mgr.24890 ' entity='mgr.x' 2024-03-30T13:57:05.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:57:04 smithi181 ceph-mon[25762]: from='mgr.24890 ' entity='mgr.x' 2024-03-30T13:57:05.314 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:57:04 smithi099 ceph-mon[29691]: pgmap v105: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 935 B/s rd, 0 op/s 2024-03-30T13:57:05.314 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:57:04 smithi099 ceph-mon[29691]: pgmap v106: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-03-30T13:57:05.314 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:57:04 smithi099 ceph-mon[29691]: from='mgr.24890 ' entity='mgr.x' 2024-03-30T13:57:05.314 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:57:04 smithi099 ceph-mon[29691]: from='mgr.24890 ' entity='mgr.x' 2024-03-30T13:57:05.314 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:57:04 smithi099 ceph-mon[29691]: from='mgr.24890 ' entity='mgr.x' 2024-03-30T13:57:05.314 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:57:04 smithi099 ceph-mon[24912]: pgmap v105: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 935 B/s rd, 0 op/s 2024-03-30T13:57:05.315 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:57:04 smithi099 ceph-mon[24912]: pgmap v106: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-03-30T13:57:05.315 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:57:04 smithi099 ceph-mon[24912]: from='mgr.24890 ' entity='mgr.x' 2024-03-30T13:57:05.315 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:57:04 smithi099 ceph-mon[24912]: from='mgr.24890 ' entity='mgr.x' 2024-03-30T13:57:05.315 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:57:04 smithi099 ceph-mon[24912]: from='mgr.24890 ' entity='mgr.x' 2024-03-30T13:57:06.161 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:57:05 smithi181 ceph-mon[25762]: pgmap v107: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T13:57:06.161 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:57:05 smithi181 ceph-mon[25762]: pgmap v108: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 836 B/s rd, 0 op/s 2024-03-30T13:57:06.332 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:57:05 smithi099 ceph-mon[24912]: pgmap v107: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T13:57:06.332 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:57:05 smithi099 ceph-mon[24912]: pgmap v108: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 836 B/s rd, 0 op/s 2024-03-30T13:57:06.332 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:57:05 smithi099 ceph-mon[29691]: pgmap v107: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T13:57:06.333 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:57:05 smithi099 ceph-mon[29691]: pgmap v108: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 836 B/s rd, 0 op/s 2024-03-30T13:57:07.931 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 13:57:07 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-x[50211]: ::ffff:172.21.15.181 - - [30/Mar/2024:13:57:07] "GET /metrics HTTP/1.1" 200 37978 "" "Prometheus/2.33.4" 2024-03-30T13:57:08.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:57:07 smithi181 ceph-mon[25762]: pgmap v109: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 836 B/s rd, 0 op/s 2024-03-30T13:57:08.332 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:57:07 smithi099 ceph-mon[24912]: pgmap v109: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 836 B/s rd, 0 op/s 2024-03-30T13:57:08.332 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:57:07 smithi099 ceph-mon[29691]: pgmap v109: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 836 B/s rd, 0 op/s 2024-03-30T13:57:10.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:57:09 smithi181 ceph-mon[25762]: pgmap v110: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 836 B/s rd, 0 op/s 2024-03-30T13:57:10.332 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:57:09 smithi099 ceph-mon[24912]: pgmap v110: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 836 B/s rd, 0 op/s 2024-03-30T13:57:10.332 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:57:09 smithi099 ceph-mon[29691]: pgmap v110: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 836 B/s rd, 0 op/s 2024-03-30T13:57:11.082 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:57:10 smithi099 ceph-mon[24912]: from='mgr.24890 172.21.15.181:0/1979512792' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:57:11.082 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:57:10 smithi099 ceph-mon[24912]: from='mgr.24890 172.21.15.181:0/1979512792' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:57:11.082 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:57:10 smithi099 ceph-mon[24912]: from='mgr.24890 ' entity='mgr.x' 2024-03-30T13:57:11.082 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:57:10 smithi099 ceph-mon[29691]: from='mgr.24890 172.21.15.181:0/1979512792' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:57:11.082 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:57:10 smithi099 ceph-mon[29691]: from='mgr.24890 172.21.15.181:0/1979512792' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:57:11.082 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:57:10 smithi099 ceph-mon[29691]: from='mgr.24890 ' entity='mgr.x' 2024-03-30T13:57:11.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:57:10 smithi181 ceph-mon[25762]: from='mgr.24890 172.21.15.181:0/1979512792' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:57:11.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:57:10 smithi181 ceph-mon[25762]: from='mgr.24890 172.21.15.181:0/1979512792' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:57:11.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:57:10 smithi181 ceph-mon[25762]: from='mgr.24890 ' entity='mgr.x' 2024-03-30T13:57:12.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:57:11 smithi181 ceph-mon[25762]: pgmap v111: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 713 B/s rd, 0 op/s 2024-03-30T13:57:12.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:57:11 smithi181 ceph-mon[25762]: from='client.15324 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T13:57:12.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:57:11 smithi181 ceph-mon[25762]: pgmap v112: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 689 B/s rd, 0 op/s 2024-03-30T13:57:12.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:57:11 smithi181 ceph-mon[25762]: pgmap v113: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 818 B/s rd, 0 op/s 2024-03-30T13:57:12.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:57:11 smithi181 ceph-mon[25762]: from='mgr.24890 172.21.15.181:0/1979512792' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T13:57:12.332 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:57:11 smithi099 ceph-mon[24912]: pgmap v111: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 713 B/s rd, 0 op/s 2024-03-30T13:57:12.332 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:57:11 smithi099 ceph-mon[24912]: from='client.15324 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T13:57:12.332 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:57:11 smithi099 ceph-mon[24912]: pgmap v112: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 689 B/s rd, 0 op/s 2024-03-30T13:57:12.332 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:57:11 smithi099 ceph-mon[24912]: pgmap v113: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 818 B/s rd, 0 op/s 2024-03-30T13:57:12.332 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:57:11 smithi099 ceph-mon[24912]: from='mgr.24890 172.21.15.181:0/1979512792' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T13:57:12.332 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:57:11 smithi099 ceph-mon[29691]: pgmap v111: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 713 B/s rd, 0 op/s 2024-03-30T13:57:12.332 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:57:11 smithi099 ceph-mon[29691]: from='client.15324 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T13:57:12.333 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:57:11 smithi099 ceph-mon[29691]: pgmap v112: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 689 B/s rd, 0 op/s 2024-03-30T13:57:12.333 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:57:11 smithi099 ceph-mon[29691]: pgmap v113: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 818 B/s rd, 0 op/s 2024-03-30T13:57:12.333 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:57:11 smithi099 ceph-mon[29691]: from='mgr.24890 172.21.15.181:0/1979512792' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T13:57:14.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:57:13 smithi181 ceph-mon[25762]: pgmap v114: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T13:57:14.332 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:57:13 smithi099 ceph-mon[24912]: pgmap v114: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T13:57:14.332 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:57:13 smithi099 ceph-mon[29691]: pgmap v114: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T13:57:16.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:57:15 smithi181 ceph-mon[25762]: pgmap v115: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T13:57:16.332 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:57:15 smithi099 ceph-mon[24912]: pgmap v115: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T13:57:16.332 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:57:15 smithi099 ceph-mon[29691]: pgmap v115: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T13:57:17.955 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 13:57:17 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-x[50211]: ::ffff:172.21.15.181 - - [30/Mar/2024:13:57:17] "GET /metrics HTTP/1.1" 200 37986 "" "Prometheus/2.33.4" 2024-03-30T13:57:18.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:57:17 smithi181 ceph-mon[25762]: pgmap v116: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T13:57:18.332 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:57:17 smithi099 ceph-mon[24912]: pgmap v116: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T13:57:18.332 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:57:17 smithi099 ceph-mon[29691]: pgmap v116: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T13:57:20.082 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:57:19 smithi099 ceph-mon[24912]: pgmap v117: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T13:57:20.082 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:57:19 smithi099 ceph-mon[29691]: pgmap v117: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T13:57:20.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:57:19 smithi181 ceph-mon[25762]: pgmap v117: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T13:57:22.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:57:21 smithi181 ceph-mon[25762]: from='client.15324 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T13:57:22.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:57:21 smithi181 ceph-mon[25762]: pgmap v118: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-03-30T13:57:22.332 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:57:21 smithi099 ceph-mon[24912]: from='client.15324 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T13:57:22.332 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:57:21 smithi099 ceph-mon[24912]: pgmap v118: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-03-30T13:57:22.332 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:57:21 smithi099 ceph-mon[29691]: from='client.15324 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T13:57:22.332 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:57:21 smithi099 ceph-mon[29691]: pgmap v118: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-03-30T13:57:24.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:57:23 smithi181 ceph-mon[25762]: pgmap v119: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T13:57:24.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:57:23 smithi181 ceph-mon[25762]: from='mgr.24890 ' entity='mgr.x' 2024-03-30T13:57:24.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:57:23 smithi181 ceph-mon[25762]: from='mgr.24890 ' entity='mgr.x' 2024-03-30T13:57:24.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:57:23 smithi181 ceph-mon[25762]: from='mgr.24890 ' entity='mgr.x' 2024-03-30T13:57:24.332 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:57:23 smithi099 ceph-mon[24912]: pgmap v119: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T13:57:24.332 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:57:23 smithi099 ceph-mon[24912]: from='mgr.24890 ' entity='mgr.x' 2024-03-30T13:57:24.332 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:57:23 smithi099 ceph-mon[24912]: from='mgr.24890 ' entity='mgr.x' 2024-03-30T13:57:24.332 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:57:23 smithi099 ceph-mon[24912]: from='mgr.24890 ' entity='mgr.x' 2024-03-30T13:57:24.332 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:57:23 smithi099 ceph-mon[29691]: pgmap v119: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T13:57:24.332 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:57:23 smithi099 ceph-mon[29691]: from='mgr.24890 ' entity='mgr.x' 2024-03-30T13:57:24.332 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:57:23 smithi099 ceph-mon[29691]: from='mgr.24890 ' entity='mgr.x' 2024-03-30T13:57:24.332 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:57:23 smithi099 ceph-mon[29691]: from='mgr.24890 ' entity='mgr.x' 2024-03-30T13:57:25.202 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:57:24 smithi099 ceph-mon[24912]: pgmap v120: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 956 B/s rd, 0 op/s 2024-03-30T13:57:25.202 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:57:24 smithi099 ceph-mon[24912]: pgmap v121: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-03-30T13:57:25.202 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:57:24 smithi099 ceph-mon[24912]: from='mgr.24890 ' entity='mgr.x' 2024-03-30T13:57:25.202 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:57:24 smithi099 ceph-mon[24912]: from='mgr.24890 ' entity='mgr.x' 2024-03-30T13:57:25.202 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:57:24 smithi099 ceph-mon[24912]: from='mgr.24890 ' entity='mgr.x' 2024-03-30T13:57:25.202 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:57:24 smithi099 ceph-mon[29691]: pgmap v120: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 956 B/s rd, 0 op/s 2024-03-30T13:57:25.202 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:57:24 smithi099 ceph-mon[29691]: pgmap v121: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-03-30T13:57:25.202 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:57:24 smithi099 ceph-mon[29691]: from='mgr.24890 ' entity='mgr.x' 2024-03-30T13:57:25.203 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:57:24 smithi099 ceph-mon[29691]: from='mgr.24890 ' entity='mgr.x' 2024-03-30T13:57:25.203 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:57:24 smithi099 ceph-mon[29691]: from='mgr.24890 ' entity='mgr.x' 2024-03-30T13:57:25.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:57:24 smithi181 ceph-mon[25762]: pgmap v120: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 956 B/s rd, 0 op/s 2024-03-30T13:57:25.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:57:24 smithi181 ceph-mon[25762]: pgmap v121: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-03-30T13:57:25.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:57:24 smithi181 ceph-mon[25762]: from='mgr.24890 ' entity='mgr.x' 2024-03-30T13:57:25.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:57:24 smithi181 ceph-mon[25762]: from='mgr.24890 ' entity='mgr.x' 2024-03-30T13:57:25.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:57:24 smithi181 ceph-mon[25762]: from='mgr.24890 ' entity='mgr.x' 2024-03-30T13:57:26.123 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:57:25 smithi181 ceph-mon[25762]: pgmap v122: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 650 B/s rd, 0 op/s 2024-03-30T13:57:26.123 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:57:25 smithi181 ceph-mon[25762]: pgmap v123: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 871 B/s rd, 0 op/s 2024-03-30T13:57:26.332 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:57:25 smithi099 ceph-mon[24912]: pgmap v122: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 650 B/s rd, 0 op/s 2024-03-30T13:57:26.332 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:57:25 smithi099 ceph-mon[24912]: pgmap v123: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 871 B/s rd, 0 op/s 2024-03-30T13:57:26.332 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:57:25 smithi099 ceph-mon[29691]: pgmap v122: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 650 B/s rd, 0 op/s 2024-03-30T13:57:26.332 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:57:25 smithi099 ceph-mon[29691]: pgmap v123: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 871 B/s rd, 0 op/s 2024-03-30T13:57:27.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:57:26 smithi181 ceph-mon[25762]: from='mgr.24890 172.21.15.181:0/1979512792' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T13:57:27.332 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:57:26 smithi099 ceph-mon[29691]: from='mgr.24890 172.21.15.181:0/1979512792' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T13:57:27.332 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:57:26 smithi099 ceph-mon[24912]: from='mgr.24890 172.21.15.181:0/1979512792' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T13:57:27.955 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 13:57:27 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-x[50211]: ::ffff:172.21.15.181 - - [30/Mar/2024:13:57:27] "GET /metrics HTTP/1.1" 200 37992 "" "Prometheus/2.33.4" 2024-03-30T13:57:28.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:57:27 smithi181 ceph-mon[25762]: pgmap v124: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 871 B/s rd, 0 op/s 2024-03-30T13:57:28.332 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:57:27 smithi099 ceph-mon[29691]: pgmap v124: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 871 B/s rd, 0 op/s 2024-03-30T13:57:28.332 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:57:27 smithi099 ceph-mon[24912]: pgmap v124: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 871 B/s rd, 0 op/s 2024-03-30T13:57:30.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:57:29 smithi181 ceph-mon[25762]: pgmap v125: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 871 B/s rd, 0 op/s 2024-03-30T13:57:30.332 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:57:29 smithi099 ceph-mon[24912]: pgmap v125: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 871 B/s rd, 0 op/s 2024-03-30T13:57:30.332 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:57:29 smithi099 ceph-mon[29691]: pgmap v125: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 871 B/s rd, 0 op/s 2024-03-30T13:57:32.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:57:31 smithi181 ceph-mon[25762]: from='client.15324 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T13:57:32.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:57:31 smithi181 ceph-mon[25762]: pgmap v126: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 713 B/s rd, 0 op/s 2024-03-30T13:57:32.331 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:57:31 smithi099 ceph-mon[24912]: from='client.15324 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T13:57:32.332 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:57:31 smithi099 ceph-mon[24912]: pgmap v126: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 713 B/s rd, 0 op/s 2024-03-30T13:57:32.332 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:57:31 smithi099 ceph-mon[29691]: from='client.15324 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T13:57:32.332 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:57:31 smithi099 ceph-mon[29691]: pgmap v126: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 713 B/s rd, 0 op/s 2024-03-30T13:57:34.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:57:33 smithi181 ceph-mon[25762]: pgmap v127: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 1004 B/s rd, 0 op/s 2024-03-30T13:57:34.331 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:57:33 smithi099 ceph-mon[24912]: pgmap v127: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 1004 B/s rd, 0 op/s 2024-03-30T13:57:34.332 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:57:33 smithi099 ceph-mon[29691]: pgmap v127: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 1004 B/s rd, 0 op/s 2024-03-30T13:57:36.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:57:35 smithi181 ceph-mon[25762]: pgmap v128: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 921 B/s rd, 0 op/s 2024-03-30T13:57:36.331 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:57:35 smithi099 ceph-mon[24912]: pgmap v128: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 921 B/s rd, 0 op/s 2024-03-30T13:57:36.332 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:57:35 smithi099 ceph-mon[29691]: pgmap v128: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 921 B/s rd, 0 op/s 2024-03-30T13:57:37.971 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 13:57:37 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-x[50211]: ::ffff:172.21.15.181 - - [30/Mar/2024:13:57:37] "GET /metrics HTTP/1.1" 200 37992 "" "Prometheus/2.33.4" 2024-03-30T13:57:38.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:57:37 smithi181 ceph-mon[25762]: pgmap v129: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 767 B/s rd, 0 op/s 2024-03-30T13:57:38.331 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:57:37 smithi099 ceph-mon[29691]: pgmap v129: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 767 B/s rd, 0 op/s 2024-03-30T13:57:38.332 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:57:37 smithi099 ceph-mon[24912]: pgmap v129: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 767 B/s rd, 0 op/s 2024-03-30T13:57:40.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:57:39 smithi181 ceph-mon[25762]: pgmap v130: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T13:57:40.331 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:57:39 smithi099 ceph-mon[24912]: pgmap v130: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T13:57:40.332 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:57:39 smithi099 ceph-mon[29691]: pgmap v130: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T13:57:41.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:57:40 smithi181 ceph-mon[25762]: from='mgr.24890 172.21.15.181:0/1979512792' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T13:57:41.331 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:57:40 smithi099 ceph-mon[24912]: from='mgr.24890 172.21.15.181:0/1979512792' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T13:57:41.332 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:57:40 smithi099 ceph-mon[29691]: from='mgr.24890 172.21.15.181:0/1979512792' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T13:57:42.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:57:41 smithi181 ceph-mon[25762]: pgmap v131: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 767 B/s rd, 0 op/s 2024-03-30T13:57:42.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:57:41 smithi181 ceph-mon[25762]: from='client.15324 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T13:57:42.332 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:57:41 smithi099 ceph-mon[24912]: pgmap v131: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 767 B/s rd, 0 op/s 2024-03-30T13:57:42.332 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:57:41 smithi099 ceph-mon[24912]: from='client.15324 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T13:57:42.332 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:57:41 smithi099 ceph-mon[29691]: pgmap v131: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 767 B/s rd, 0 op/s 2024-03-30T13:57:42.332 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:57:41 smithi099 ceph-mon[29691]: from='client.15324 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T13:57:44.082 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:57:43 smithi099 ceph-mon[24912]: pgmap v132: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T13:57:44.082 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:57:43 smithi099 ceph-mon[24912]: from='mgr.24890 ' entity='mgr.x' 2024-03-30T13:57:44.082 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:57:43 smithi099 ceph-mon[24912]: from='mgr.24890 ' entity='mgr.x' 2024-03-30T13:57:44.082 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:57:43 smithi099 ceph-mon[24912]: from='mgr.24890 ' entity='mgr.x' 2024-03-30T13:57:44.082 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:57:43 smithi099 ceph-mon[29691]: pgmap v132: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T13:57:44.082 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:57:43 smithi099 ceph-mon[29691]: from='mgr.24890 ' entity='mgr.x' 2024-03-30T13:57:44.082 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:57:43 smithi099 ceph-mon[29691]: from='mgr.24890 ' entity='mgr.x' 2024-03-30T13:57:44.082 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:57:43 smithi099 ceph-mon[29691]: from='mgr.24890 ' entity='mgr.x' 2024-03-30T13:57:44.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:57:43 smithi181 ceph-mon[25762]: pgmap v132: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T13:57:44.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:57:43 smithi181 ceph-mon[25762]: from='mgr.24890 ' entity='mgr.x' 2024-03-30T13:57:44.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:57:43 smithi181 ceph-mon[25762]: from='mgr.24890 ' entity='mgr.x' 2024-03-30T13:57:44.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:57:43 smithi181 ceph-mon[25762]: from='mgr.24890 ' entity='mgr.x' 2024-03-30T13:57:45.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:57:44 smithi181 ceph-mon[25762]: pgmap v133: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 934 B/s rd, 0 op/s 2024-03-30T13:57:45.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:57:44 smithi181 ceph-mon[25762]: from='mgr.24890 ' entity='mgr.x' 2024-03-30T13:57:45.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:57:44 smithi181 ceph-mon[25762]: from='mgr.24890 ' entity='mgr.x' 2024-03-30T13:57:45.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:57:44 smithi181 ceph-mon[25762]: from='mgr.24890 ' entity='mgr.x' 2024-03-30T13:57:45.332 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:57:44 smithi099 ceph-mon[24912]: pgmap v133: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 934 B/s rd, 0 op/s 2024-03-30T13:57:45.332 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:57:44 smithi099 ceph-mon[24912]: from='mgr.24890 ' entity='mgr.x' 2024-03-30T13:57:45.332 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:57:44 smithi099 ceph-mon[24912]: from='mgr.24890 ' entity='mgr.x' 2024-03-30T13:57:45.332 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:57:44 smithi099 ceph-mon[24912]: from='mgr.24890 ' entity='mgr.x' 2024-03-30T13:57:45.332 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:57:44 smithi099 ceph-mon[29691]: pgmap v133: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 934 B/s rd, 0 op/s 2024-03-30T13:57:45.332 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:57:44 smithi099 ceph-mon[29691]: from='mgr.24890 ' entity='mgr.x' 2024-03-30T13:57:45.333 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:57:44 smithi099 ceph-mon[29691]: from='mgr.24890 ' entity='mgr.x' 2024-03-30T13:57:45.333 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:57:44 smithi099 ceph-mon[29691]: from='mgr.24890 ' entity='mgr.x' 2024-03-30T13:57:46.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:57:45 smithi181 ceph-mon[25762]: pgmap v134: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 1010 B/s rd, 0 op/s 2024-03-30T13:57:46.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:57:45 smithi181 ceph-mon[25762]: pgmap v135: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T13:57:46.261 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:57:45 smithi099 ceph-mon[24912]: pgmap v134: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 1010 B/s rd, 0 op/s 2024-03-30T13:57:46.261 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:57:45 smithi099 ceph-mon[24912]: pgmap v135: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T13:57:46.261 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:57:45 smithi099 ceph-mon[29691]: pgmap v134: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 1010 B/s rd, 0 op/s 2024-03-30T13:57:46.262 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:57:45 smithi099 ceph-mon[29691]: pgmap v135: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T13:57:47.847 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 13:57:47 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-x[50211]: ::ffff:172.21.15.181 - - [30/Mar/2024:13:57:47] "GET /metrics HTTP/1.1" 200 37984 "" "Prometheus/2.33.4" 2024-03-30T13:57:48.134 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:57:47 smithi181 ceph-mon[25762]: pgmap v136: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T13:57:48.331 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:57:47 smithi099 ceph-mon[24912]: pgmap v136: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T13:57:48.332 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:57:47 smithi099 ceph-mon[29691]: pgmap v136: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T13:57:50.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:57:49 smithi181 ceph-mon[25762]: pgmap v137: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T13:57:50.331 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:57:49 smithi099 ceph-mon[24912]: pgmap v137: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T13:57:50.332 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:57:49 smithi099 ceph-mon[29691]: pgmap v137: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T13:57:52.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:57:51 smithi181 ceph-mon[25762]: from='client.15324 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T13:57:52.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:57:51 smithi181 ceph-mon[25762]: pgmap v138: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 629 B/s rd, 0 op/s 2024-03-30T13:57:52.332 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:57:51 smithi099 ceph-mon[29691]: from='client.15324 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T13:57:52.332 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:57:51 smithi099 ceph-mon[29691]: pgmap v138: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 629 B/s rd, 0 op/s 2024-03-30T13:57:52.332 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:57:51 smithi099 ceph-mon[24912]: from='client.15324 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T13:57:52.333 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:57:51 smithi099 ceph-mon[24912]: pgmap v138: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 629 B/s rd, 0 op/s 2024-03-30T13:57:54.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:57:53 smithi181 ceph-mon[25762]: pgmap v139: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-03-30T13:57:54.331 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:57:53 smithi099 ceph-mon[24912]: pgmap v139: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-03-30T13:57:54.332 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:57:53 smithi099 ceph-mon[29691]: pgmap v139: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-03-30T13:57:56.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:57:55 smithi181 ceph-mon[25762]: pgmap v140: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-03-30T13:57:56.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:57:55 smithi181 ceph-mon[25762]: from='mgr.24890 172.21.15.181:0/1979512792' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T13:57:56.331 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:57:55 smithi099 ceph-mon[24912]: pgmap v140: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-03-30T13:57:56.332 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:57:55 smithi099 ceph-mon[24912]: from='mgr.24890 172.21.15.181:0/1979512792' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T13:57:56.332 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:57:55 smithi099 ceph-mon[29691]: pgmap v140: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-03-30T13:57:56.332 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:57:55 smithi099 ceph-mon[29691]: from='mgr.24890 172.21.15.181:0/1979512792' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T13:57:57.965 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 13:57:57 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-x[50211]: ::ffff:172.21.15.181 - - [30/Mar/2024:13:57:57] "GET /metrics HTTP/1.1" 200 37991 "" "Prometheus/2.33.4" 2024-03-30T13:57:58.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:57:57 smithi181 ceph-mon[25762]: pgmap v141: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T13:57:58.331 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:57:57 smithi099 ceph-mon[24912]: pgmap v141: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T13:57:58.332 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:57:57 smithi099 ceph-mon[29691]: pgmap v141: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T13:57:59.093 DEBUG:teuthology.orchestra.run.smithi099:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 98ebaeb8-ee99-11ee-b647-cb9ed24678a4 -e sha1=4e50bbcdd1630c7760b708f3a5b4d38a121e66cb -- bash -c 'ceph orch ps' 2024-03-30T13:58:00.081 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:57:59 smithi099 ceph-mon[24912]: pgmap v142: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T13:58:00.082 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:57:59 smithi099 ceph-mon[29691]: pgmap v142: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T13:58:00.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:57:59 smithi181 ceph-mon[25762]: pgmap v142: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T13:58:01.290 INFO:teuthology.orchestra.run.smithi099.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-03-30T13:58:01.290 INFO:teuthology.orchestra.run.smithi099.stdout:agent.smithi099 smithi099 running 17s ago 26m - - 2024-03-30T13:58:01.290 INFO:teuthology.orchestra.run.smithi099.stdout:agent.smithi181 smithi181 running 16s ago 26m - - 2024-03-30T13:58:01.290 INFO:teuthology.orchestra.run.smithi099.stdout:alertmanager.a smithi099 *:9093,9094 running (12m) 17s ago 20m 23.3M - 0.23.0 ba2b418f427c 0f1be3801027 2024-03-30T13:58:01.290 INFO:teuthology.orchestra.run.smithi099.stdout:grafana.a smithi181 *:3000 error 16s ago 20m - - 2024-03-30T13:58:01.290 INFO:teuthology.orchestra.run.smithi099.stdout:iscsi.foo.smithi099.qyjuvr smithi099 running (2m) 17s ago 19m 55.1M - 3.5 e1d6a67b021e 409e508beaae 2024-03-30T13:58:01.290 INFO:teuthology.orchestra.run.smithi099.stdout:mgr.x smithi181 *:8443,9283 running (15m) 16s ago 25m 509M - 19.0.0-1967-g4e50bbcd b0c4478f1d83 f3d971ab3b10 2024-03-30T13:58:01.290 INFO:teuthology.orchestra.run.smithi099.stdout:mgr.y smithi099 *:8443,9283,8765 running (9m) 17s ago 27m 449M - 19.0.0-1967-g4e50bbcd b0c4478f1d83 0d464b8c1d18 2024-03-30T13:58:01.290 INFO:teuthology.orchestra.run.smithi099.stdout:mon.a smithi099 running (27m) 17s ago 27m 85.6M 2048M 17.2.0 e1d6a67b021e af06ebb19fd8 2024-03-30T13:58:01.290 INFO:teuthology.orchestra.run.smithi099.stdout:mon.b smithi181 running (25m) 16s ago 25m 61.2M 2048M 17.2.0 e1d6a67b021e e678a2a25c90 2024-03-30T13:58:01.291 INFO:teuthology.orchestra.run.smithi099.stdout:mon.c smithi099 running (25m) 17s ago 25m 57.5M 2048M 17.2.0 e1d6a67b021e 0f1e98917718 2024-03-30T13:58:01.291 INFO:teuthology.orchestra.run.smithi099.stdout:node-exporter.a smithi099 *:9100 running (12m) 17s ago 21m 21.5M - 1.3.1 1dbe0e931976 76284405d5f5 2024-03-30T13:58:01.291 INFO:teuthology.orchestra.run.smithi099.stdout:node-exporter.b smithi181 *:9100 running (12m) 16s ago 21m 17.0M - 1.3.1 1dbe0e931976 90245951476f 2024-03-30T13:58:01.291 INFO:teuthology.orchestra.run.smithi099.stdout:osd.0 smithi099 running (25m) 17s ago 25m 53.6M 4096M 17.2.0 e1d6a67b021e 3158ee1b0c67 2024-03-30T13:58:01.291 INFO:teuthology.orchestra.run.smithi099.stdout:osd.1 smithi099 running (24m) 17s ago 24m 56.4M 4096M 17.2.0 e1d6a67b021e c4af0fd7071a 2024-03-30T13:58:01.291 INFO:teuthology.orchestra.run.smithi099.stdout:osd.2 smithi099 running (24m) 17s ago 24m 49.3M 4096M 17.2.0 e1d6a67b021e 8e4e805a7e20 2024-03-30T13:58:01.291 INFO:teuthology.orchestra.run.smithi099.stdout:osd.3 smithi099 running (24m) 17s ago 24m 52.5M 4096M 17.2.0 e1d6a67b021e 718812bcf065 2024-03-30T13:58:01.291 INFO:teuthology.orchestra.run.smithi099.stdout:osd.4 smithi181 running (23m) 16s ago 23m 52.9M 4096M 17.2.0 e1d6a67b021e 5e205434e973 2024-03-30T13:58:01.291 INFO:teuthology.orchestra.run.smithi099.stdout:osd.5 smithi181 running (23m) 16s ago 23m 51.8M 4096M 17.2.0 e1d6a67b021e e330c920f152 2024-03-30T13:58:01.291 INFO:teuthology.orchestra.run.smithi099.stdout:osd.6 smithi181 running (22m) 16s ago 22m 50.8M 4096M 17.2.0 e1d6a67b021e 81d889ea213d 2024-03-30T13:58:01.291 INFO:teuthology.orchestra.run.smithi099.stdout:osd.7 smithi181 running (22m) 16s ago 22m 51.5M 4096M 17.2.0 e1d6a67b021e c08b1839dd7e 2024-03-30T13:58:01.291 INFO:teuthology.orchestra.run.smithi099.stdout:prometheus.a smithi181 *:9095 running (2m) 16s ago 21m 69.7M - 2.33.4 514e6a882f6e 54e4324e49e3 2024-03-30T13:58:01.291 INFO:teuthology.orchestra.run.smithi099.stdout:rgw.foo.smithi099.fxjbmp smithi099 *:8000 running (19m) 17s ago 19m 75.1M - 17.2.0 e1d6a67b021e 400b28b3f650 2024-03-30T13:58:01.291 INFO:teuthology.orchestra.run.smithi099.stdout:rgw.foo.smithi181.wfqwti smithi181 *:8000 running (19m) 16s ago 19m 75.0M - 17.2.0 e1d6a67b021e 97e1b130f9d4 2024-03-30T13:58:02.036 DEBUG:teuthology.orchestra.run.smithi099:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 98ebaeb8-ee99-11ee-b647-cb9ed24678a4 -e sha1=4e50bbcdd1630c7760b708f3a5b4d38a121e66cb -- bash -c 'ceph orch ls' 2024-03-30T13:58:02.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:01 smithi181 ceph-mon[25762]: from='client.15324 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T13:58:02.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:01 smithi181 ceph-mon[25762]: pgmap v143: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T13:58:02.331 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:01 smithi099 ceph-mon[24912]: from='client.15324 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T13:58:02.331 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:01 smithi099 ceph-mon[24912]: pgmap v143: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T13:58:02.332 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:01 smithi099 ceph-mon[29691]: from='client.15324 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T13:58:02.332 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:01 smithi099 ceph-mon[29691]: pgmap v143: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T13:58:03.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:02 smithi181 ceph-mon[25762]: from='client.25267 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T13:58:03.331 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:02 smithi099 ceph-mon[29691]: from='client.25267 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T13:58:03.332 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:02 smithi099 ceph-mon[24912]: from='client.25267 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T13:58:04.121 INFO:teuthology.orchestra.run.smithi099.stdout:NAME PORTS RUNNING REFRESHED AGE PLACEMENT 2024-03-30T13:58:04.121 INFO:teuthology.orchestra.run.smithi099.stdout:agent 2/2 19s ago 3m * 2024-03-30T13:58:04.122 INFO:teuthology.orchestra.run.smithi099.stdout:alertmanager ?:9093,9094 1/1 0s ago 22m smithi099=a;count:1 2024-03-30T13:58:04.122 INFO:teuthology.orchestra.run.smithi099.stdout:grafana ?:3000 0/1 19s ago 21m smithi181=a;count:1 2024-03-30T13:58:04.122 INFO:teuthology.orchestra.run.smithi099.stdout:iscsi.foo ?:5000 1/1 0s ago 19m count:1 2024-03-30T13:58:04.122 INFO:teuthology.orchestra.run.smithi099.stdout:mgr 2/2 19s ago 25m smithi099=y;smithi181=x;count:2 2024-03-30T13:58:04.122 INFO:teuthology.orchestra.run.smithi099.stdout:mon 3/3 19s ago 26m smithi099:172.21.15.99=a;smithi099:[v2:172.21.15.99:3301,v1:172.21.15.99:6790]=c;smithi181:172.21.15.181=b;count:3 2024-03-30T13:58:04.122 INFO:teuthology.orchestra.run.smithi099.stdout:node-exporter ?:9100 2/2 19s ago 22m smithi099=a;smithi181=b;count:2 2024-03-30T13:58:04.122 INFO:teuthology.orchestra.run.smithi099.stdout:osd 8 19s ago - 2024-03-30T13:58:04.122 INFO:teuthology.orchestra.run.smithi099.stdout:prometheus ?:9095 1/1 19s ago 22m smithi181=a;count:1 2024-03-30T13:58:04.122 INFO:teuthology.orchestra.run.smithi099.stdout:rgw.foo ?:8000 2/2 19s ago 20m count:2 2024-03-30T13:58:04.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:03 smithi181 ceph-mon[25762]: pgmap v144: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T13:58:04.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:03 smithi181 ceph-mon[25762]: from='mgr.24890 ' entity='mgr.x' 2024-03-30T13:58:04.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:03 smithi181 ceph-mon[25762]: from='mgr.24890 ' entity='mgr.x' 2024-03-30T13:58:04.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:03 smithi181 ceph-mon[25762]: from='mgr.24890 ' entity='mgr.x' 2024-03-30T13:58:04.331 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:03 smithi099 ceph-mon[24912]: pgmap v144: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T13:58:04.331 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:03 smithi099 ceph-mon[24912]: from='mgr.24890 ' entity='mgr.x' 2024-03-30T13:58:04.332 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:03 smithi099 ceph-mon[24912]: from='mgr.24890 ' entity='mgr.x' 2024-03-30T13:58:04.332 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:03 smithi099 ceph-mon[24912]: from='mgr.24890 ' entity='mgr.x' 2024-03-30T13:58:04.332 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:03 smithi099 ceph-mon[29691]: pgmap v144: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T13:58:04.332 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:03 smithi099 ceph-mon[29691]: from='mgr.24890 ' entity='mgr.x' 2024-03-30T13:58:04.332 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:03 smithi099 ceph-mon[29691]: from='mgr.24890 ' entity='mgr.x' 2024-03-30T13:58:04.332 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:03 smithi099 ceph-mon[29691]: from='mgr.24890 ' entity='mgr.x' 2024-03-30T13:58:04.716 DEBUG:teuthology.orchestra.run.smithi099:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 98ebaeb8-ee99-11ee-b647-cb9ed24678a4 -e sha1=4e50bbcdd1630c7760b708f3a5b4d38a121e66cb -- bash -c 'ceph versions' 2024-03-30T13:58:05.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:04 smithi181 ceph-mon[25762]: pgmap v145: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 932 B/s rd, 0 op/s 2024-03-30T13:58:05.254 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:04 smithi181 ceph-mon[25762]: pgmap v146: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-03-30T13:58:05.254 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:04 smithi181 ceph-mon[25762]: from='client.25273 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T13:58:05.270 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:04 smithi099 ceph-mon[24912]: pgmap v145: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 932 B/s rd, 0 op/s 2024-03-30T13:58:05.270 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:04 smithi099 ceph-mon[24912]: pgmap v146: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-03-30T13:58:05.270 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:04 smithi099 ceph-mon[24912]: from='client.25273 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T13:58:05.270 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:04 smithi099 ceph-mon[29691]: pgmap v145: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 932 B/s rd, 0 op/s 2024-03-30T13:58:05.271 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:04 smithi099 ceph-mon[29691]: pgmap v146: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-03-30T13:58:05.271 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:04 smithi099 ceph-mon[29691]: from='client.25273 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T13:58:06.301 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:06 smithi099 ceph-mon[29691]: from='mgr.24890 ' entity='mgr.x' 2024-03-30T13:58:06.301 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:06 smithi099 ceph-mon[29691]: from='mgr.24890 ' entity='mgr.x' 2024-03-30T13:58:06.301 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:06 smithi099 ceph-mon[29691]: pgmap v147: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 629 B/s rd, 0 op/s 2024-03-30T13:58:06.302 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:06 smithi099 ceph-mon[29691]: pgmap v148: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 835 B/s rd, 0 op/s 2024-03-30T13:58:06.302 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:06 smithi099 ceph-mon[29691]: from='mgr.24890 ' entity='mgr.x' 2024-03-30T13:58:06.302 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:06 smithi099 ceph-mon[24912]: from='mgr.24890 ' entity='mgr.x' 2024-03-30T13:58:06.302 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:06 smithi099 ceph-mon[24912]: from='mgr.24890 ' entity='mgr.x' 2024-03-30T13:58:06.302 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:06 smithi099 ceph-mon[24912]: pgmap v147: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 629 B/s rd, 0 op/s 2024-03-30T13:58:06.302 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:06 smithi099 ceph-mon[24912]: pgmap v148: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 835 B/s rd, 0 op/s 2024-03-30T13:58:06.302 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:06 smithi099 ceph-mon[24912]: from='mgr.24890 ' entity='mgr.x' 2024-03-30T13:58:06.500 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:06 smithi181 ceph-mon[25762]: from='mgr.24890 ' entity='mgr.x' 2024-03-30T13:58:06.501 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:06 smithi181 ceph-mon[25762]: from='mgr.24890 ' entity='mgr.x' 2024-03-30T13:58:06.501 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:06 smithi181 ceph-mon[25762]: pgmap v147: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 629 B/s rd, 0 op/s 2024-03-30T13:58:06.501 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:06 smithi181 ceph-mon[25762]: pgmap v148: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 835 B/s rd, 0 op/s 2024-03-30T13:58:06.501 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:06 smithi181 ceph-mon[25762]: from='mgr.24890 ' entity='mgr.x' 2024-03-30T13:58:06.687 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-03-30T13:58:06.687 INFO:teuthology.orchestra.run.smithi099.stdout: "mon": { 2024-03-30T13:58:06.687 INFO:teuthology.orchestra.run.smithi099.stdout: "ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)": 3 2024-03-30T13:58:06.687 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:58:06.687 INFO:teuthology.orchestra.run.smithi099.stdout: "mgr": { 2024-03-30T13:58:06.687 INFO:teuthology.orchestra.run.smithi099.stdout: "ceph version 19.0.0-1967-g4e50bbcd (4e50bbcdd1630c7760b708f3a5b4d38a121e66cb) squid (dev)": 2 2024-03-30T13:58:06.687 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:58:06.687 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": { 2024-03-30T13:58:06.687 INFO:teuthology.orchestra.run.smithi099.stdout: "ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)": 8 2024-03-30T13:58:06.687 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:58:06.688 INFO:teuthology.orchestra.run.smithi099.stdout: "mds": {}, 2024-03-30T13:58:06.688 INFO:teuthology.orchestra.run.smithi099.stdout: "rgw": { 2024-03-30T13:58:06.688 INFO:teuthology.orchestra.run.smithi099.stdout: "ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)": 2 2024-03-30T13:58:06.688 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:58:06.688 INFO:teuthology.orchestra.run.smithi099.stdout: "overall": { 2024-03-30T13:58:06.688 INFO:teuthology.orchestra.run.smithi099.stdout: "ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)": 13, 2024-03-30T13:58:06.688 INFO:teuthology.orchestra.run.smithi099.stdout: "ceph version 19.0.0-1967-g4e50bbcd (4e50bbcdd1630c7760b708f3a5b4d38a121e66cb) squid (dev)": 2 2024-03-30T13:58:06.688 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-03-30T13:58:06.688 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-03-30T13:58:07.272 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:07 smithi099 ceph-mon[24912]: from='client.? 172.21.15.99:0/3469998748' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:58:07.272 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:07 smithi099 ceph-mon[29691]: from='client.? 172.21.15.99:0/3469998748' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:58:07.298 DEBUG:teuthology.orchestra.run.smithi099:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 98ebaeb8-ee99-11ee-b647-cb9ed24678a4 -e sha1=4e50bbcdd1630c7760b708f3a5b4d38a121e66cb -- bash -c 'ceph orch upgrade start --image quay.ceph.io/ceph-ci/ceph:$sha1 --daemon-types mgr' 2024-03-30T13:58:07.500 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:07 smithi181 ceph-mon[25762]: from='client.? 172.21.15.99:0/3469998748' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:58:07.850 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 13:58:07 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-x[50211]: ::ffff:172.21.15.181 - - [30/Mar/2024:13:58:07] "GET /metrics HTTP/1.1" 200 37991 "" "Prometheus/2.33.4" 2024-03-30T13:58:08.114 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:08 smithi181 ceph-mon[25762]: pgmap v149: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 7.0 KiB/s rd, 0 B/s wr, 10 op/s 2024-03-30T13:58:08.331 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:08 smithi099 ceph-mon[24912]: pgmap v149: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 7.0 KiB/s rd, 0 B/s wr, 10 op/s 2024-03-30T13:58:08.332 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:08 smithi099 ceph-mon[29691]: pgmap v149: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 7.0 KiB/s rd, 0 B/s wr, 10 op/s 2024-03-30T13:58:10.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:09 smithi181 ceph-mon[25762]: pgmap v150: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 6.2 KiB/s rd, 0 B/s wr, 9 op/s 2024-03-30T13:58:10.087 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:09 smithi099 ceph-mon[24912]: pgmap v150: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 6.2 KiB/s rd, 0 B/s wr, 9 op/s 2024-03-30T13:58:10.087 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:09 smithi099 ceph-mon[29691]: pgmap v150: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 6.2 KiB/s rd, 0 B/s wr, 9 op/s 2024-03-30T13:58:11.060 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:11 smithi099 ceph-mon[24912]: from='mgr.24890 172.21.15.181:0/1979512792' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T13:58:11.060 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:11 smithi099 ceph-mon[29691]: from='mgr.24890 172.21.15.181:0/1979512792' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T13:58:11.500 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:11 smithi181 ceph-mon[25762]: from='mgr.24890 172.21.15.181:0/1979512792' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T13:58:12.081 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:12 smithi099 ceph-mon[29691]: from='client.15393 -' entity='client.admin' cmd=[{"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:4e50bbcdd1630c7760b708f3a5b4d38a121e66cb", "daemon_types": "mgr", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T13:58:12.081 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:12 smithi099 ceph-mon[29691]: from='client.15324 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T13:58:12.082 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:12 smithi099 ceph-mon[29691]: pgmap v151: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 5.3 KiB/s rd, 0 B/s wr, 8 op/s 2024-03-30T13:58:12.082 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:12 smithi099 ceph-mon[29691]: from='mgr.24890 172.21.15.181:0/1979512792' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:58:12.082 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:12 smithi099 ceph-mon[29691]: from='mgr.24890 172.21.15.181:0/1979512792' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:58:12.082 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:12 smithi099 ceph-mon[29691]: pgmap v152: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 5.3 KiB/s rd, 0 B/s wr, 8 op/s 2024-03-30T13:58:12.082 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:12 smithi099 ceph-mon[29691]: pgmap v153: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 6.3 KiB/s rd, 0 B/s wr, 9 op/s 2024-03-30T13:58:12.082 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:12 smithi099 ceph-mon[29691]: from='mgr.24890 ' entity='mgr.x' 2024-03-30T13:58:12.082 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:12 smithi099 ceph-mon[24912]: from='client.15393 -' entity='client.admin' cmd=[{"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:4e50bbcdd1630c7760b708f3a5b4d38a121e66cb", "daemon_types": "mgr", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T13:58:12.082 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:12 smithi099 ceph-mon[24912]: from='client.15324 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T13:58:12.082 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:12 smithi099 ceph-mon[24912]: pgmap v151: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 5.3 KiB/s rd, 0 B/s wr, 8 op/s 2024-03-30T13:58:12.082 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:12 smithi099 ceph-mon[24912]: from='mgr.24890 172.21.15.181:0/1979512792' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:58:12.082 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:12 smithi099 ceph-mon[24912]: from='mgr.24890 172.21.15.181:0/1979512792' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:58:12.083 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:12 smithi099 ceph-mon[24912]: pgmap v152: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 5.3 KiB/s rd, 0 B/s wr, 8 op/s 2024-03-30T13:58:12.083 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:12 smithi099 ceph-mon[24912]: pgmap v153: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 6.3 KiB/s rd, 0 B/s wr, 9 op/s 2024-03-30T13:58:12.083 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:12 smithi099 ceph-mon[24912]: from='mgr.24890 ' entity='mgr.x' 2024-03-30T13:58:12.163 INFO:teuthology.orchestra.run.smithi099.stdout:Initiating upgrade to quay.ceph.io/ceph-ci/ceph:4e50bbcdd1630c7760b708f3a5b4d38a121e66cb 2024-03-30T13:58:12.500 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:12 smithi181 ceph-mon[25762]: from='client.15393 -' entity='client.admin' cmd=[{"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:4e50bbcdd1630c7760b708f3a5b4d38a121e66cb", "daemon_types": "mgr", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T13:58:12.500 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:12 smithi181 ceph-mon[25762]: from='client.15324 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T13:58:12.500 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:12 smithi181 ceph-mon[25762]: pgmap v151: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 5.3 KiB/s rd, 0 B/s wr, 8 op/s 2024-03-30T13:58:12.501 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:12 smithi181 ceph-mon[25762]: from='mgr.24890 172.21.15.181:0/1979512792' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:58:12.501 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:12 smithi181 ceph-mon[25762]: from='mgr.24890 172.21.15.181:0/1979512792' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:58:12.501 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:12 smithi181 ceph-mon[25762]: pgmap v152: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 5.3 KiB/s rd, 0 B/s wr, 8 op/s 2024-03-30T13:58:12.501 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:12 smithi181 ceph-mon[25762]: pgmap v153: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 6.3 KiB/s rd, 0 B/s wr, 9 op/s 2024-03-30T13:58:12.501 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:12 smithi181 ceph-mon[25762]: from='mgr.24890 ' entity='mgr.x' 2024-03-30T13:58:13.443 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:13 smithi099 ceph-mon[29691]: Upgrade: Started with target quay.ceph.io/ceph-ci/ceph:4e50bbcdd1630c7760b708f3a5b4d38a121e66cb 2024-03-30T13:58:13.443 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:13 smithi099 ceph-mon[29691]: from='mgr.24890 ' entity='mgr.x' 2024-03-30T13:58:13.443 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:13 smithi099 ceph-mon[29691]: from='mgr.24890 172.21.15.181:0/1979512792' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:58:13.443 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:13 smithi099 ceph-mon[29691]: from='mgr.24890 172.21.15.181:0/1979512792' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:58:13.443 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:13 smithi099 ceph-mon[29691]: from='mgr.24890 ' entity='mgr.x' 2024-03-30T13:58:13.443 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:13 smithi099 ceph-mon[24912]: Upgrade: Started with target quay.ceph.io/ceph-ci/ceph:4e50bbcdd1630c7760b708f3a5b4d38a121e66cb 2024-03-30T13:58:13.443 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:13 smithi099 ceph-mon[24912]: from='mgr.24890 ' entity='mgr.x' 2024-03-30T13:58:13.443 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:13 smithi099 ceph-mon[24912]: from='mgr.24890 172.21.15.181:0/1979512792' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:58:13.443 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:13 smithi099 ceph-mon[24912]: from='mgr.24890 172.21.15.181:0/1979512792' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:58:13.443 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:13 smithi099 ceph-mon[24912]: from='mgr.24890 ' entity='mgr.x' 2024-03-30T13:58:13.467 DEBUG:teuthology.orchestra.run.smithi099:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 98ebaeb8-ee99-11ee-b647-cb9ed24678a4 -e sha1=4e50bbcdd1630c7760b708f3a5b4d38a121e66cb -- bash -c 'while ceph orch upgrade status | jq '"'"'.in_progress'"'"' | grep true && ! ceph orch upgrade status | jq '"'"'.message'"'"' | grep Error ; do ceph orch ps ; ceph versions ; ceph orch upgrade status ; sleep 30 ; done' 2024-03-30T13:58:13.500 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:13 smithi181 ceph-mon[25762]: Upgrade: Started with target quay.ceph.io/ceph-ci/ceph:4e50bbcdd1630c7760b708f3a5b4d38a121e66cb 2024-03-30T13:58:13.500 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:13 smithi181 ceph-mon[25762]: from='mgr.24890 ' entity='mgr.x' 2024-03-30T13:58:13.500 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:13 smithi181 ceph-mon[25762]: from='mgr.24890 172.21.15.181:0/1979512792' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:58:13.500 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:13 smithi181 ceph-mon[25762]: from='mgr.24890 172.21.15.181:0/1979512792' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:58:13.501 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:13 smithi181 ceph-mon[25762]: from='mgr.24890 ' entity='mgr.x' 2024-03-30T13:58:14.500 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:14 smithi181 ceph-mon[25762]: pgmap v154: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 122 KiB/s rd, 0 B/s wr, 201 op/s 2024-03-30T13:58:14.500 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:14 smithi181 ceph-mon[25762]: pgmap v155: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 161 KiB/s rd, 0 B/s wr, 268 op/s 2024-03-30T13:58:14.501 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:14 smithi181 ceph-mon[25762]: Upgrade: First pull of quay.ceph.io/ceph-ci/ceph:4e50bbcdd1630c7760b708f3a5b4d38a121e66cb 2024-03-30T13:58:14.558 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:14 smithi099 ceph-mon[24912]: pgmap v154: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 122 KiB/s rd, 0 B/s wr, 201 op/s 2024-03-30T13:58:14.558 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:14 smithi099 ceph-mon[24912]: pgmap v155: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 161 KiB/s rd, 0 B/s wr, 268 op/s 2024-03-30T13:58:14.558 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:14 smithi099 ceph-mon[24912]: Upgrade: First pull of quay.ceph.io/ceph-ci/ceph:4e50bbcdd1630c7760b708f3a5b4d38a121e66cb 2024-03-30T13:58:14.558 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:14 smithi099 ceph-mon[29691]: pgmap v154: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 122 KiB/s rd, 0 B/s wr, 201 op/s 2024-03-30T13:58:14.558 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:14 smithi099 ceph-mon[29691]: pgmap v155: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 161 KiB/s rd, 0 B/s wr, 268 op/s 2024-03-30T13:58:14.558 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:14 smithi099 ceph-mon[29691]: Upgrade: First pull of quay.ceph.io/ceph-ci/ceph:4e50bbcdd1630c7760b708f3a5b4d38a121e66cb 2024-03-30T13:58:15.831 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:15 smithi099 ceph-mon[24912]: pgmap v156: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 161 KiB/s rd, 0 B/s wr, 268 op/s 2024-03-30T13:58:15.831 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:15 smithi099 ceph-mon[24912]: from='mgr.24890 ' entity='mgr.x' 2024-03-30T13:58:15.832 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:15 smithi099 ceph-mon[24912]: Upgrade: Target is version 19.0.0-1967-g4e50bbcd (squid) 2024-03-30T13:58:15.832 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:15 smithi099 ceph-mon[24912]: Upgrade: Target container is quay.ceph.io/ceph-ci/ceph:4e50bbcdd1630c7760b708f3a5b4d38a121e66cb, digests ['quay.ceph.io/ceph-ci/ceph@sha256:8f3809717761e681477c3ef1d8d2c03114aee2c597cd7380b93b8c10f47fcb5d'] 2024-03-30T13:58:15.832 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:15 smithi099 ceph-mon[24912]: from='mgr.24890 172.21.15.181:0/1979512792' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:58:15.832 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:15 smithi099 ceph-mon[24912]: Upgrade: Need to upgrade myself (mgr.x) 2024-03-30T13:58:15.832 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:15 smithi099 ceph-mon[24912]: Upgrade: Need to upgrade myself (mgr.x) 2024-03-30T13:58:15.832 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:15 smithi099 ceph-mon[24912]: Failing over to other MGR 2024-03-30T13:58:15.832 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:15 smithi099 ceph-mon[24912]: from='mgr.24890 172.21.15.181:0/1979512792' entity='mgr.x' cmd=[{"prefix": "mgr fail", "who": "x"}]: dispatch 2024-03-30T13:58:15.832 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:15 smithi099 ceph-mon[24912]: from='mgr.24890 ' entity='mgr.x' cmd=[{"prefix": "mgr fail", "who": "x"}]: dispatch 2024-03-30T13:58:15.832 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:15 smithi099 ceph-mon[24912]: osdmap e112: 8 total, 8 up, 8 in 2024-03-30T13:58:15.832 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:15 smithi099 ceph-mon[29691]: pgmap v156: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 161 KiB/s rd, 0 B/s wr, 268 op/s 2024-03-30T13:58:15.833 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:15 smithi099 ceph-mon[29691]: from='mgr.24890 ' entity='mgr.x' 2024-03-30T13:58:15.833 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:15 smithi099 ceph-mon[29691]: Upgrade: Target is version 19.0.0-1967-g4e50bbcd (squid) 2024-03-30T13:58:15.833 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:15 smithi099 ceph-mon[29691]: Upgrade: Target container is quay.ceph.io/ceph-ci/ceph:4e50bbcdd1630c7760b708f3a5b4d38a121e66cb, digests ['quay.ceph.io/ceph-ci/ceph@sha256:8f3809717761e681477c3ef1d8d2c03114aee2c597cd7380b93b8c10f47fcb5d'] 2024-03-30T13:58:15.833 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:15 smithi099 ceph-mon[29691]: from='mgr.24890 172.21.15.181:0/1979512792' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:58:15.833 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:15 smithi099 ceph-mon[29691]: Upgrade: Need to upgrade myself (mgr.x) 2024-03-30T13:58:15.833 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:15 smithi099 ceph-mon[29691]: Upgrade: Need to upgrade myself (mgr.x) 2024-03-30T13:58:15.833 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:15 smithi099 ceph-mon[29691]: Failing over to other MGR 2024-03-30T13:58:15.833 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:15 smithi099 ceph-mon[29691]: from='mgr.24890 172.21.15.181:0/1979512792' entity='mgr.x' cmd=[{"prefix": "mgr fail", "who": "x"}]: dispatch 2024-03-30T13:58:15.833 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:15 smithi099 ceph-mon[29691]: from='mgr.24890 ' entity='mgr.x' cmd=[{"prefix": "mgr fail", "who": "x"}]: dispatch 2024-03-30T13:58:15.833 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:15 smithi099 ceph-mon[29691]: osdmap e112: 8 total, 8 up, 8 in 2024-03-30T13:58:15.833 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:58:15 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[71049]: [30/Mar/2024:13:58:15] ENGINE Bus STOPPING 2024-03-30T13:58:15.833 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:58:15 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[71049]: [30/Mar/2024:13:58:15] ENGINE HTTP Server cherrypy._cpwsgi_server.CPWSGIServer(('::', 9283)) shut down 2024-03-30T13:58:15.834 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:58:15 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[71049]: [30/Mar/2024:13:58:15] ENGINE Bus STOPPED 2024-03-30T13:58:15.834 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:58:15 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[71049]: [30/Mar/2024:13:58:15] ENGINE Bus STARTING 2024-03-30T13:58:16.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:15 smithi181 ceph-mon[25762]: pgmap v156: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 161 KiB/s rd, 0 B/s wr, 268 op/s 2024-03-30T13:58:16.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:15 smithi181 ceph-mon[25762]: from='mgr.24890 ' entity='mgr.x' 2024-03-30T13:58:16.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:15 smithi181 ceph-mon[25762]: Upgrade: Target is version 19.0.0-1967-g4e50bbcd (squid) 2024-03-30T13:58:16.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:15 smithi181 ceph-mon[25762]: Upgrade: Target container is quay.ceph.io/ceph-ci/ceph:4e50bbcdd1630c7760b708f3a5b4d38a121e66cb, digests ['quay.ceph.io/ceph-ci/ceph@sha256:8f3809717761e681477c3ef1d8d2c03114aee2c597cd7380b93b8c10f47fcb5d'] 2024-03-30T13:58:16.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:15 smithi181 ceph-mon[25762]: from='mgr.24890 172.21.15.181:0/1979512792' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:58:16.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:15 smithi181 ceph-mon[25762]: Upgrade: Need to upgrade myself (mgr.x) 2024-03-30T13:58:16.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:15 smithi181 ceph-mon[25762]: Upgrade: Need to upgrade myself (mgr.x) 2024-03-30T13:58:16.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:15 smithi181 ceph-mon[25762]: Failing over to other MGR 2024-03-30T13:58:16.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:15 smithi181 ceph-mon[25762]: from='mgr.24890 172.21.15.181:0/1979512792' entity='mgr.x' cmd=[{"prefix": "mgr fail", "who": "x"}]: dispatch 2024-03-30T13:58:16.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:15 smithi181 ceph-mon[25762]: from='mgr.24890 ' entity='mgr.x' cmd=[{"prefix": "mgr fail", "who": "x"}]: dispatch 2024-03-30T13:58:16.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:15 smithi181 ceph-mon[25762]: osdmap e112: 8 total, 8 up, 8 in 2024-03-30T13:58:16.002 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 13:58:15 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-x[50211]: 2024-03-30T13:58:15.611+0000 7feca7e01700 -1 mgr handle_mgr_map I was active but no longer am 2024-03-30T13:58:16.002 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 13:58:15 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-x[50211]: ignoring --setuser ceph since I am not root 2024-03-30T13:58:16.002 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 13:58:15 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-x[50211]: ignoring --setgroup ceph since I am not root 2024-03-30T13:58:16.002 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 13:58:15 smithi181 ceph-mgr[50215]: -- 172.21.15.181:0/2774749283 <== mon.2 v2:172.21.15.181:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5597d65365a0 con 0x5597d650a800 2024-03-30T13:58:16.332 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:58:15 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[71049]: [30/Mar/2024:13:58:15] ENGINE Serving on http://:::9283 2024-03-30T13:58:16.332 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:58:15 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[71049]: [30/Mar/2024:13:58:15] ENGINE Bus STARTED 2024-03-30T13:58:16.500 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 13:58:16 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-x[50211]: 2024-03-30T13:58:16.181+0000 7ff7502df200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-03-30T13:58:16.501 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 13:58:16 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-x[50211]: 2024-03-30T13:58:16.274+0000 7ff7502df200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-03-30T13:58:16.632 INFO:teuthology.orchestra.run.smithi099.stdout:true 2024-03-30T13:58:16.880 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:16 smithi181 ceph-mon[25762]: from='mgr.24890 ' entity='mgr.x' cmd='[{"prefix": "mgr fail", "who": "x"}]': finished 2024-03-30T13:58:16.880 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:16 smithi181 ceph-mon[25762]: mgrmap e36: y(active, starting, since 1.00436s) 2024-03-30T13:58:16.880 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:16 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-03-30T13:58:16.880 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:16 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-30T13:58:16.880 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:16 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-30T13:58:16.880 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:16 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-03-30T13:58:16.880 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:16 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-03-30T13:58:16.881 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:16 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-03-30T13:58:16.881 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:16 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-03-30T13:58:16.881 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:16 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-03-30T13:58:16.881 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:16 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-03-30T13:58:16.881 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:16 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-03-30T13:58:16.881 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:16 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-03-30T13:58:16.881 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:16 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-03-30T13:58:16.881 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:16 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-03-30T13:58:16.881 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:16 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-03-30T13:58:16.881 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:16 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-03-30T13:58:16.881 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:16 smithi181 ceph-mon[25762]: Manager daemon y is now available 2024-03-30T13:58:16.881 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:16 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:58:16.881 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:16 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.agent.smithi099", "caps": []}]: dispatch 2024-03-30T13:58:16.881 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:16 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.agent.smithi099", "caps": []}]: dispatch 2024-03-30T13:58:16.882 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:16 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.agent.smithi181", "caps": []}]: dispatch 2024-03-30T13:58:16.882 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:16 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.agent.smithi181", "caps": []}]: dispatch 2024-03-30T13:58:16.882 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:16 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T13:58:16.882 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:16 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-03-30T13:58:16.882 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:16 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-03-30T13:58:16.882 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:16 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-03-30T13:58:16.882 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:16 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-03-30T13:58:16.882 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:16 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd/host:smithi181", "name": "osd_memory_target"}]: dispatch 2024-03-30T13:58:16.882 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:16 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd/host:smithi181", "name": "osd_memory_target"}]: dispatch 2024-03-30T13:58:17.082 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:16 smithi099 ceph-mon[24912]: from='mgr.24890 ' entity='mgr.x' cmd='[{"prefix": "mgr fail", "who": "x"}]': finished 2024-03-30T13:58:17.082 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:16 smithi099 ceph-mon[24912]: mgrmap e36: y(active, starting, since 1.00436s) 2024-03-30T13:58:17.082 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:16 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-03-30T13:58:17.082 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:16 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-30T13:58:17.082 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:16 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-30T13:58:17.082 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:16 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-03-30T13:58:17.082 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:16 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-03-30T13:58:17.082 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:16 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-03-30T13:58:17.083 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:16 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-03-30T13:58:17.083 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:16 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-03-30T13:58:17.083 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:16 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-03-30T13:58:17.083 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:16 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-03-30T13:58:17.083 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:16 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-03-30T13:58:17.083 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:16 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-03-30T13:58:17.083 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:16 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-03-30T13:58:17.083 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:16 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-03-30T13:58:17.083 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:16 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-03-30T13:58:17.083 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:16 smithi099 ceph-mon[24912]: Manager daemon y is now available 2024-03-30T13:58:17.083 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:16 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:58:17.083 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:16 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.agent.smithi099", "caps": []}]: dispatch 2024-03-30T13:58:17.083 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:16 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.agent.smithi099", "caps": []}]: dispatch 2024-03-30T13:58:17.083 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:16 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.agent.smithi181", "caps": []}]: dispatch 2024-03-30T13:58:17.083 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:16 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.agent.smithi181", "caps": []}]: dispatch 2024-03-30T13:58:17.084 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:16 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T13:58:17.084 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:16 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-03-30T13:58:17.084 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:16 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-03-30T13:58:17.084 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:16 smithi099 ceph-mon[29691]: from='mgr.24890 ' entity='mgr.x' cmd='[{"prefix": "mgr fail", "who": "x"}]': finished 2024-03-30T13:58:17.084 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:16 smithi099 ceph-mon[29691]: mgrmap e36: y(active, starting, since 1.00436s) 2024-03-30T13:58:17.084 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:16 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-03-30T13:58:17.084 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:16 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-30T13:58:17.084 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:16 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-30T13:58:17.085 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:16 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-03-30T13:58:17.085 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:16 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-03-30T13:58:17.085 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:16 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-03-30T13:58:17.085 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:16 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-03-30T13:58:17.085 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:16 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-03-30T13:58:17.085 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:16 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-03-30T13:58:17.085 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:16 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-03-30T13:58:17.085 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:16 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-03-30T13:58:17.085 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:16 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-03-30T13:58:17.085 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:16 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-03-30T13:58:17.085 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:16 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-03-30T13:58:17.085 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:16 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-03-30T13:58:17.085 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:16 smithi099 ceph-mon[29691]: Manager daemon y is now available 2024-03-30T13:58:17.085 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:16 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:58:17.085 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:16 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.agent.smithi099", "caps": []}]: dispatch 2024-03-30T13:58:17.086 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:16 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.agent.smithi099", "caps": []}]: dispatch 2024-03-30T13:58:17.086 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:16 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.agent.smithi181", "caps": []}]: dispatch 2024-03-30T13:58:17.086 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:16 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.agent.smithi181", "caps": []}]: dispatch 2024-03-30T13:58:17.086 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:16 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T13:58:17.086 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:16 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-03-30T13:58:17.086 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:16 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-03-30T13:58:17.086 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:16 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-03-30T13:58:17.086 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:16 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-03-30T13:58:17.086 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:16 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd/host:smithi181", "name": "osd_memory_target"}]: dispatch 2024-03-30T13:58:17.087 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:16 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd/host:smithi181", "name": "osd_memory_target"}]: dispatch 2024-03-30T13:58:17.087 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:16 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-03-30T13:58:17.087 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:16 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-03-30T13:58:17.087 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:16 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd/host:smithi181", "name": "osd_memory_target"}]: dispatch 2024-03-30T13:58:17.087 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:16 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd/host:smithi181", "name": "osd_memory_target"}]: dispatch 2024-03-30T13:58:17.150 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 13:58:16 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-x[50211]: 2024-03-30T13:58:16.967+0000 7ff7502df200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-03-30T13:58:17.151 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 13:58:17 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-x[50211]: 2024-03-30T13:58:17.064+0000 7ff7502df200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-03-30T13:58:17.297 INFO:teuthology.orchestra.run.smithi099.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-03-30T13:58:17.298 INFO:teuthology.orchestra.run.smithi099.stdout:agent.smithi099 smithi099 running 13s ago 26m - - 2024-03-30T13:58:17.298 INFO:teuthology.orchestra.run.smithi099.stdout:agent.smithi181 smithi181 running 12s ago 26m - - 2024-03-30T13:58:17.298 INFO:teuthology.orchestra.run.smithi099.stdout:alertmanager.a smithi099 *:9093,9094 running (12m) 13s ago 20m 23.3M - 0.23.0 ba2b418f427c 0f1be3801027 2024-03-30T13:58:17.298 INFO:teuthology.orchestra.run.smithi099.stdout:grafana.a smithi181 *:3000 error 12s ago 20m - - 2024-03-30T13:58:17.298 INFO:teuthology.orchestra.run.smithi099.stdout:iscsi.foo.smithi099.qyjuvr smithi099 running (3m) 13s ago 19m 55.4M - 3.5 e1d6a67b021e 409e508beaae 2024-03-30T13:58:17.298 INFO:teuthology.orchestra.run.smithi099.stdout:mgr.x smithi181 *:8443,9283 running (15m) 12s ago 25m 510M - 19.0.0-1967-g4e50bbcd b0c4478f1d83 f3d971ab3b10 2024-03-30T13:58:17.298 INFO:teuthology.orchestra.run.smithi099.stdout:mgr.y smithi099 *:8443,9283,8765 running (9m) 13s ago 27m 449M - 19.0.0-1967-g4e50bbcd b0c4478f1d83 0d464b8c1d18 2024-03-30T13:58:17.298 INFO:teuthology.orchestra.run.smithi099.stdout:mon.a smithi099 running (27m) 13s ago 27m 86.0M 2048M 17.2.0 e1d6a67b021e af06ebb19fd8 2024-03-30T13:58:17.298 INFO:teuthology.orchestra.run.smithi099.stdout:mon.b smithi181 running (26m) 12s ago 26m 61.3M 2048M 17.2.0 e1d6a67b021e e678a2a25c90 2024-03-30T13:58:17.298 INFO:teuthology.orchestra.run.smithi099.stdout:mon.c smithi099 running (26m) 13s ago 26m 57.5M 2048M 17.2.0 e1d6a67b021e 0f1e98917718 2024-03-30T13:58:17.298 INFO:teuthology.orchestra.run.smithi099.stdout:node-exporter.a smithi099 *:9100 running (13m) 13s ago 21m 18.7M - 1.3.1 1dbe0e931976 76284405d5f5 2024-03-30T13:58:17.298 INFO:teuthology.orchestra.run.smithi099.stdout:node-exporter.b smithi181 *:9100 running (12m) 12s ago 21m 16.8M - 1.3.1 1dbe0e931976 90245951476f 2024-03-30T13:58:17.299 INFO:teuthology.orchestra.run.smithi099.stdout:osd.0 smithi099 running (25m) 13s ago 25m 53.6M 4096M 17.2.0 e1d6a67b021e 3158ee1b0c67 2024-03-30T13:58:17.299 INFO:teuthology.orchestra.run.smithi099.stdout:osd.1 smithi099 running (25m) 13s ago 25m 56.4M 4096M 17.2.0 e1d6a67b021e c4af0fd7071a 2024-03-30T13:58:17.299 INFO:teuthology.orchestra.run.smithi099.stdout:osd.2 smithi099 running (24m) 13s ago 24m 49.3M 4096M 17.2.0 e1d6a67b021e 8e4e805a7e20 2024-03-30T13:58:17.299 INFO:teuthology.orchestra.run.smithi099.stdout:osd.3 smithi099 running (24m) 13s ago 24m 52.5M 4096M 17.2.0 e1d6a67b021e 718812bcf065 2024-03-30T13:58:17.299 INFO:teuthology.orchestra.run.smithi099.stdout:osd.4 smithi181 running (23m) 12s ago 23m 52.9M 4096M 17.2.0 e1d6a67b021e 5e205434e973 2024-03-30T13:58:17.299 INFO:teuthology.orchestra.run.smithi099.stdout:osd.5 smithi181 running (23m) 12s ago 23m 51.8M 4096M 17.2.0 e1d6a67b021e e330c920f152 2024-03-30T13:58:17.299 INFO:teuthology.orchestra.run.smithi099.stdout:osd.6 smithi181 running (23m) 12s ago 23m 50.8M 4096M 17.2.0 e1d6a67b021e 81d889ea213d 2024-03-30T13:58:17.299 INFO:teuthology.orchestra.run.smithi099.stdout:osd.7 smithi181 running (22m) 12s ago 22m 51.5M 4096M 17.2.0 e1d6a67b021e c08b1839dd7e 2024-03-30T13:58:17.299 INFO:teuthology.orchestra.run.smithi099.stdout:prometheus.a smithi181 *:9095 running (3m) 12s ago 21m 69.7M - 2.33.4 514e6a882f6e 54e4324e49e3 2024-03-30T13:58:17.299 INFO:teuthology.orchestra.run.smithi099.stdout:rgw.foo.smithi099.fxjbmp smithi099 *:8000 running (20m) 13s ago 20m 75.2M - 17.2.0 e1d6a67b021e 400b28b3f650 2024-03-30T13:58:17.299 INFO:teuthology.orchestra.run.smithi099.stdout:rgw.foo.smithi181.wfqwti smithi181 *:8000 running (20m) 12s ago 20m 75.0M - 17.2.0 e1d6a67b021e 97e1b130f9d4 2024-03-30T13:58:17.500 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 13:58:17 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-x[50211]: 2024-03-30T13:58:17.213+0000 7ff7502df200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-03-30T13:58:17.501 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 13:58:17 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-x[50211]: 2024-03-30T13:58:17.310+0000 7ff7502df200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-03-30T13:58:17.501 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 13:58:17 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-x[50211]: 2024-03-30T13:58:17.393+0000 7ff7502df200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-03-30T13:58:17.759 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-03-30T13:58:17.759 INFO:teuthology.orchestra.run.smithi099.stdout: "mon": { 2024-03-30T13:58:17.759 INFO:teuthology.orchestra.run.smithi099.stdout: "ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)": 3 2024-03-30T13:58:17.759 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:58:17.759 INFO:teuthology.orchestra.run.smithi099.stdout: "mgr": { 2024-03-30T13:58:17.760 INFO:teuthology.orchestra.run.smithi099.stdout: "ceph version 19.0.0-1967-g4e50bbcd (4e50bbcdd1630c7760b708f3a5b4d38a121e66cb) squid (dev)": 1 2024-03-30T13:58:17.760 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:58:17.760 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": { 2024-03-30T13:58:17.760 INFO:teuthology.orchestra.run.smithi099.stdout: "ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)": 8 2024-03-30T13:58:17.760 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:58:17.760 INFO:teuthology.orchestra.run.smithi099.stdout: "mds": {}, 2024-03-30T13:58:17.760 INFO:teuthology.orchestra.run.smithi099.stdout: "rgw": { 2024-03-30T13:58:17.760 INFO:teuthology.orchestra.run.smithi099.stdout: "ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)": 2 2024-03-30T13:58:17.760 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:58:17.760 INFO:teuthology.orchestra.run.smithi099.stdout: "overall": { 2024-03-30T13:58:17.760 INFO:teuthology.orchestra.run.smithi099.stdout: "ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)": 13, 2024-03-30T13:58:17.760 INFO:teuthology.orchestra.run.smithi099.stdout: "ceph version 19.0.0-1967-g4e50bbcd (4e50bbcdd1630c7760b708f3a5b4d38a121e66cb) squid (dev)": 1 2024-03-30T13:58:17.760 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-03-30T13:58:17.760 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-03-30T13:58:17.804 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 13:58:17 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-x[50211]: 2024-03-30T13:58:17.677+0000 7ff7502df200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-03-30T13:58:17.804 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 13:58:17 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-x[50211]: 2024-03-30T13:58:17.808+0000 7ff7502df200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-03-30T13:58:17.805 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:17 smithi181 ceph-mon[25762]: mgrmap e37: y(active, since 2s) 2024-03-30T13:58:17.805 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:17 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:58:17.805 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:17 smithi181 ceph-mon[25762]: [30/Mar/2024:13:58:16] ENGINE Bus STARTING 2024-03-30T13:58:17.805 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:17 smithi181 ceph-mon[25762]: [30/Mar/2024:13:58:16] ENGINE Serving on http://172.21.15.99:8765 2024-03-30T13:58:17.805 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:17 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:58:17.805 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:17 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd/host:smithi099", "name": "osd_memory_target"}]: dispatch 2024-03-30T13:58:17.805 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:17 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd/host:smithi099", "name": "osd_memory_target"}]: dispatch 2024-03-30T13:58:17.805 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:17 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:58:17.805 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:17 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:58:17.831 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:17 smithi099 ceph-mon[24912]: mgrmap e37: y(active, since 2s) 2024-03-30T13:58:17.831 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:17 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:58:17.831 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:17 smithi099 ceph-mon[24912]: [30/Mar/2024:13:58:16] ENGINE Bus STARTING 2024-03-30T13:58:17.831 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:17 smithi099 ceph-mon[24912]: [30/Mar/2024:13:58:16] ENGINE Serving on http://172.21.15.99:8765 2024-03-30T13:58:17.831 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:17 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:58:17.831 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:17 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd/host:smithi099", "name": "osd_memory_target"}]: dispatch 2024-03-30T13:58:17.832 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:17 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd/host:smithi099", "name": "osd_memory_target"}]: dispatch 2024-03-30T13:58:17.832 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:17 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:58:17.832 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:17 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:58:17.832 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:17 smithi099 ceph-mon[29691]: mgrmap e37: y(active, since 2s) 2024-03-30T13:58:17.832 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:17 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:58:17.832 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:17 smithi099 ceph-mon[29691]: [30/Mar/2024:13:58:16] ENGINE Bus STARTING 2024-03-30T13:58:17.832 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:17 smithi099 ceph-mon[29691]: [30/Mar/2024:13:58:16] ENGINE Serving on http://172.21.15.99:8765 2024-03-30T13:58:17.832 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:17 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:58:17.832 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:17 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd/host:smithi099", "name": "osd_memory_target"}]: dispatch 2024-03-30T13:58:17.833 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:17 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd/host:smithi099", "name": "osd_memory_target"}]: dispatch 2024-03-30T13:58:17.833 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:17 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:58:17.833 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:17 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:58:18.096 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 13:58:17 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-x[50211]: 2024-03-30T13:58:17.903+0000 7ff7502df200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-03-30T13:58:18.096 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 13:58:18 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-x[50211]: 2024-03-30T13:58:18.018+0000 7ff7502df200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-03-30T13:58:18.177 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-03-30T13:58:18.177 INFO:teuthology.orchestra.run.smithi099.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph:4e50bbcdd1630c7760b708f3a5b4d38a121e66cb", 2024-03-30T13:58:18.178 INFO:teuthology.orchestra.run.smithi099.stdout: "in_progress": true, 2024-03-30T13:58:18.178 INFO:teuthology.orchestra.run.smithi099.stdout: "which": "Upgrading daemons of type(s) mgr", 2024-03-30T13:58:18.178 INFO:teuthology.orchestra.run.smithi099.stdout: "services_complete": [ 2024-03-30T13:58:18.178 INFO:teuthology.orchestra.run.smithi099.stdout: "mgr" 2024-03-30T13:58:18.178 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-03-30T13:58:18.178 INFO:teuthology.orchestra.run.smithi099.stdout: "progress": "2/2 daemons upgraded", 2024-03-30T13:58:18.178 INFO:teuthology.orchestra.run.smithi099.stdout: "message": "", 2024-03-30T13:58:18.178 INFO:teuthology.orchestra.run.smithi099.stdout: "is_paused": false 2024-03-30T13:58:18.178 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-03-30T13:58:18.401 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 13:58:18 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-x[50211]: 2024-03-30T13:58:18.208+0000 7ff7502df200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-03-30T13:58:18.750 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:18 smithi181 ceph-mon[25762]: [30/Mar/2024:13:58:16] ENGINE Serving on https://172.21.15.99:7150 2024-03-30T13:58:18.750 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:18 smithi181 ceph-mon[25762]: [30/Mar/2024:13:58:16] ENGINE Bus STARTED 2024-03-30T13:58:18.751 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:18 smithi181 ceph-mon[25762]: from='client.15429 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T13:58:18.751 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:18 smithi181 ceph-mon[25762]: from='client.15435 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T13:58:18.751 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:18 smithi181 ceph-mon[25762]: Updating smithi099:/etc/ceph/ceph.conf 2024-03-30T13:58:18.751 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:18 smithi181 ceph-mon[25762]: Updating smithi181:/etc/ceph/ceph.conf 2024-03-30T13:58:18.751 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:18 smithi181 ceph-mon[25762]: Health check cleared: CEPHADM_FAILED_DAEMON (was: 1 failed cephadm daemon(s)) 2024-03-30T13:58:18.751 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:18 smithi181 ceph-mon[25762]: Cluster is now healthy 2024-03-30T13:58:18.751 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:18 smithi181 ceph-mon[25762]: pgmap v4: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:58:18.751 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:18 smithi181 ceph-mon[25762]: from='client.? 172.21.15.99:0/2325506475' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:58:18.751 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:18 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:58:18.751 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:18 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:58:18.751 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:18 smithi181 ceph-mon[25762]: mgrmap e38: y(active, since 3s) 2024-03-30T13:58:18.751 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:18 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:58:18.752 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:18 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:58:18.918 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:18 smithi099 ceph-mon[29691]: [30/Mar/2024:13:58:16] ENGINE Serving on https://172.21.15.99:7150 2024-03-30T13:58:18.918 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:18 smithi099 ceph-mon[29691]: [30/Mar/2024:13:58:16] ENGINE Bus STARTED 2024-03-30T13:58:18.918 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:18 smithi099 ceph-mon[29691]: from='client.15429 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T13:58:18.919 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:18 smithi099 ceph-mon[29691]: from='client.15435 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T13:58:18.919 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:18 smithi099 ceph-mon[29691]: Updating smithi099:/etc/ceph/ceph.conf 2024-03-30T13:58:18.919 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:18 smithi099 ceph-mon[29691]: Updating smithi181:/etc/ceph/ceph.conf 2024-03-30T13:58:18.919 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:18 smithi099 ceph-mon[29691]: Health check cleared: CEPHADM_FAILED_DAEMON (was: 1 failed cephadm daemon(s)) 2024-03-30T13:58:18.919 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:18 smithi099 ceph-mon[29691]: Cluster is now healthy 2024-03-30T13:58:18.919 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:18 smithi099 ceph-mon[29691]: pgmap v4: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:58:18.919 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:18 smithi099 ceph-mon[29691]: from='client.? 172.21.15.99:0/2325506475' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:58:18.919 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:18 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:58:18.919 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:18 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:58:18.919 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:18 smithi099 ceph-mon[29691]: mgrmap e38: y(active, since 3s) 2024-03-30T13:58:18.919 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:18 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:58:18.919 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:18 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:58:18.920 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:18 smithi099 ceph-mon[24912]: [30/Mar/2024:13:58:16] ENGINE Serving on https://172.21.15.99:7150 2024-03-30T13:58:18.920 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:18 smithi099 ceph-mon[24912]: [30/Mar/2024:13:58:16] ENGINE Bus STARTED 2024-03-30T13:58:18.920 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:18 smithi099 ceph-mon[24912]: from='client.15429 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T13:58:18.920 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:18 smithi099 ceph-mon[24912]: from='client.15435 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T13:58:18.920 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:18 smithi099 ceph-mon[24912]: Updating smithi099:/etc/ceph/ceph.conf 2024-03-30T13:58:18.920 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:18 smithi099 ceph-mon[24912]: Updating smithi181:/etc/ceph/ceph.conf 2024-03-30T13:58:18.920 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:18 smithi099 ceph-mon[24912]: Health check cleared: CEPHADM_FAILED_DAEMON (was: 1 failed cephadm daemon(s)) 2024-03-30T13:58:18.920 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:18 smithi099 ceph-mon[24912]: Cluster is now healthy 2024-03-30T13:58:18.920 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:18 smithi099 ceph-mon[24912]: pgmap v4: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:58:18.920 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:18 smithi099 ceph-mon[24912]: from='client.? 172.21.15.99:0/2325506475' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:58:18.920 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:18 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:58:18.920 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:18 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:58:18.920 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:18 smithi099 ceph-mon[24912]: mgrmap e38: y(active, since 3s) 2024-03-30T13:58:18.921 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:18 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:58:18.921 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:18 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:58:19.481 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 13:58:19 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-x[50211]: 2024-03-30T13:58:19.272+0000 7ff7502df200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-03-30T13:58:19.481 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 13:58:19 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-x[50211]: 2024-03-30T13:58:19.406+0000 7ff7502df200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-03-30T13:58:19.750 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:19 smithi181 ceph-mon[25762]: Updating smithi099:/var/lib/ceph/98ebaeb8-ee99-11ee-b647-cb9ed24678a4/config/ceph.conf 2024-03-30T13:58:19.751 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:19 smithi181 ceph-mon[25762]: Updating smithi181:/var/lib/ceph/98ebaeb8-ee99-11ee-b647-cb9ed24678a4/config/ceph.conf 2024-03-30T13:58:19.751 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:19 smithi181 ceph-mon[25762]: from='client.25094 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T13:58:19.751 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:19 smithi181 ceph-mon[25762]: Updating smithi099:/etc/ceph/ceph.client.admin.keyring 2024-03-30T13:58:19.751 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:19 smithi181 ceph-mon[25762]: Updating smithi181:/etc/ceph/ceph.client.admin.keyring 2024-03-30T13:58:19.751 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:19 smithi181 ceph-mon[25762]: Updating smithi099:/var/lib/ceph/98ebaeb8-ee99-11ee-b647-cb9ed24678a4/config/ceph.client.admin.keyring 2024-03-30T13:58:19.751 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:19 smithi181 ceph-mon[25762]: Updating smithi181:/var/lib/ceph/98ebaeb8-ee99-11ee-b647-cb9ed24678a4/config/ceph.client.admin.keyring 2024-03-30T13:58:19.751 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:19 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:58:19.751 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:19 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:58:19.751 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:19 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:58:19.751 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:19 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:58:19.751 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:19 smithi181 ceph-mon[25762]: pgmap v5: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:58:19.751 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:19 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:58:19.751 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:19 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:58:19.752 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:19 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:58:19.752 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:19 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:58:19.752 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:19 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:58:19.752 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:19 smithi181 ceph-mon[25762]: pgmap v6: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:58:19.752 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:19 smithi181 ceph-mon[25762]: pgmap v7: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:58:19.752 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:19 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:58:19.752 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:19 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:58:19.752 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:19 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.iscsi.foo.smithi099.qyjuvr", "caps": ["mon", "profile rbd, allow command \"osd blocklist\", allow command \"config-key get\" with \"key\" prefix \"iscsi/\"", "mgr", "allow command \"service status\"", "osd", "allow rwx"]}]: dispatch 2024-03-30T13:58:19.752 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:19 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.iscsi.foo.smithi099.qyjuvr", "caps": ["mon", "profile rbd, allow command \"osd blocklist\", allow command \"config-key get\" with \"key\" prefix \"iscsi/\"", "mgr", "allow command \"service status\"", "osd", "allow rwx"]}]: dispatch 2024-03-30T13:58:19.752 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:19 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:58:19.752 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:19 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:58:19.752 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:19 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:58:19.752 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:19 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:58:19.831 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:19 smithi099 ceph-mon[29691]: Updating smithi099:/var/lib/ceph/98ebaeb8-ee99-11ee-b647-cb9ed24678a4/config/ceph.conf 2024-03-30T13:58:19.832 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:19 smithi099 ceph-mon[29691]: Updating smithi181:/var/lib/ceph/98ebaeb8-ee99-11ee-b647-cb9ed24678a4/config/ceph.conf 2024-03-30T13:58:19.832 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:19 smithi099 ceph-mon[29691]: from='client.25094 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T13:58:19.832 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:19 smithi099 ceph-mon[29691]: Updating smithi099:/etc/ceph/ceph.client.admin.keyring 2024-03-30T13:58:19.832 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:19 smithi099 ceph-mon[29691]: Updating smithi181:/etc/ceph/ceph.client.admin.keyring 2024-03-30T13:58:19.832 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:19 smithi099 ceph-mon[29691]: Updating smithi099:/var/lib/ceph/98ebaeb8-ee99-11ee-b647-cb9ed24678a4/config/ceph.client.admin.keyring 2024-03-30T13:58:19.832 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:19 smithi099 ceph-mon[29691]: Updating smithi181:/var/lib/ceph/98ebaeb8-ee99-11ee-b647-cb9ed24678a4/config/ceph.client.admin.keyring 2024-03-30T13:58:19.832 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:19 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:58:19.832 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:19 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:58:19.832 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:19 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:58:19.832 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:19 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:58:19.832 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:19 smithi099 ceph-mon[29691]: pgmap v5: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:58:19.832 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:19 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:58:19.832 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:19 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:58:19.832 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:19 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:58:19.833 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:19 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:58:19.833 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:19 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:58:19.833 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:19 smithi099 ceph-mon[29691]: pgmap v6: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:58:19.833 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:19 smithi099 ceph-mon[29691]: pgmap v7: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:58:19.833 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:19 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:58:19.833 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:19 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:58:19.833 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:19 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.iscsi.foo.smithi099.qyjuvr", "caps": ["mon", "profile rbd, allow command \"osd blocklist\", allow command \"config-key get\" with \"key\" prefix \"iscsi/\"", "mgr", "allow command \"service status\"", "osd", "allow rwx"]}]: dispatch 2024-03-30T13:58:19.833 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:19 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.iscsi.foo.smithi099.qyjuvr", "caps": ["mon", "profile rbd, allow command \"osd blocklist\", allow command \"config-key get\" with \"key\" prefix \"iscsi/\"", "mgr", "allow command \"service status\"", "osd", "allow rwx"]}]: dispatch 2024-03-30T13:58:19.833 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:19 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:58:19.833 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:19 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:58:19.833 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:19 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:58:19.833 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:19 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:58:19.833 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:19 smithi099 ceph-mon[24912]: Updating smithi099:/var/lib/ceph/98ebaeb8-ee99-11ee-b647-cb9ed24678a4/config/ceph.conf 2024-03-30T13:58:19.834 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:19 smithi099 ceph-mon[24912]: Updating smithi181:/var/lib/ceph/98ebaeb8-ee99-11ee-b647-cb9ed24678a4/config/ceph.conf 2024-03-30T13:58:19.834 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:19 smithi099 ceph-mon[24912]: from='client.25094 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T13:58:19.834 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:19 smithi099 ceph-mon[24912]: Updating smithi099:/etc/ceph/ceph.client.admin.keyring 2024-03-30T13:58:19.834 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:19 smithi099 ceph-mon[24912]: Updating smithi181:/etc/ceph/ceph.client.admin.keyring 2024-03-30T13:58:19.834 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:19 smithi099 ceph-mon[24912]: Updating smithi099:/var/lib/ceph/98ebaeb8-ee99-11ee-b647-cb9ed24678a4/config/ceph.client.admin.keyring 2024-03-30T13:58:19.834 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:19 smithi099 ceph-mon[24912]: Updating smithi181:/var/lib/ceph/98ebaeb8-ee99-11ee-b647-cb9ed24678a4/config/ceph.client.admin.keyring 2024-03-30T13:58:19.834 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:19 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:58:19.834 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:19 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:58:19.834 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:19 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:58:19.834 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:19 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:58:19.834 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:19 smithi099 ceph-mon[24912]: pgmap v5: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:58:19.834 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:19 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:58:19.834 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:19 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:58:19.834 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:19 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:58:19.835 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:19 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:58:19.835 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:19 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:58:19.835 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:19 smithi099 ceph-mon[24912]: pgmap v6: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:58:19.835 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:19 smithi099 ceph-mon[24912]: pgmap v7: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:58:19.835 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:19 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:58:19.835 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:19 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:58:19.835 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:19 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.iscsi.foo.smithi099.qyjuvr", "caps": ["mon", "profile rbd, allow command \"osd blocklist\", allow command \"config-key get\" with \"key\" prefix \"iscsi/\"", "mgr", "allow command \"service status\"", "osd", "allow rwx"]}]: dispatch 2024-03-30T13:58:19.835 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:19 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.iscsi.foo.smithi099.qyjuvr", "caps": ["mon", "profile rbd, allow command \"osd blocklist\", allow command \"config-key get\" with \"key\" prefix \"iscsi/\"", "mgr", "allow command \"service status\"", "osd", "allow rwx"]}]: dispatch 2024-03-30T13:58:19.835 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:19 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:58:19.835 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:19 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:58:19.835 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:19 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:58:19.835 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:19 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:58:20.073 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 13:58:19 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-x[50211]: 2024-03-30T13:58:19.757+0000 7ff7502df200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-03-30T13:58:20.073 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 13:58:19 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-x[50211]: 2024-03-30T13:58:19.867+0000 7ff7502df200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-03-30T13:58:20.500 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 13:58:20 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-x[50211]: 2024-03-30T13:58:20.079+0000 7ff7502df200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-03-30T13:58:20.500 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 13:58:20 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-x[50211]: 2024-03-30T13:58:20.277+0000 7ff7502df200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-03-30T13:58:20.811 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:20 smithi099 ceph-mon[24912]: Reconfiguring iscsi.foo.smithi099.qyjuvr (dependencies changed)... 2024-03-30T13:58:20.811 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:20 smithi099 ceph-mon[24912]: Reconfiguring daemon iscsi.foo.smithi099.qyjuvr on smithi099 2024-03-30T13:58:20.811 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:20 smithi099 ceph-mon[24912]: pgmap v8: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:58:20.811 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:20 smithi099 ceph-mon[24912]: pgmap v9: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:58:20.811 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:20 smithi099 ceph-mon[24912]: Health check failed: 1 failed cephadm daemon(s) (CEPHADM_FAILED_DAEMON) 2024-03-30T13:58:20.812 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:20 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:58:20.812 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:20 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:58:20.812 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:20 smithi099 ceph-mon[24912]: pgmap v10: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:58:20.812 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:20 smithi099 ceph-mon[24912]: pgmap v11: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:58:20.812 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:20 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:58:20.812 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:20 smithi099 ceph-mon[24912]: mgrmap e39: y(active, since 5s) 2024-03-30T13:58:20.812 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:20 smithi099 ceph-mon[29691]: Reconfiguring iscsi.foo.smithi099.qyjuvr (dependencies changed)... 2024-03-30T13:58:20.812 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:20 smithi099 ceph-mon[29691]: Reconfiguring daemon iscsi.foo.smithi099.qyjuvr on smithi099 2024-03-30T13:58:20.812 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:20 smithi099 ceph-mon[29691]: pgmap v8: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:58:20.812 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:20 smithi099 ceph-mon[29691]: pgmap v9: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:58:20.812 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:20 smithi099 ceph-mon[29691]: Health check failed: 1 failed cephadm daemon(s) (CEPHADM_FAILED_DAEMON) 2024-03-30T13:58:20.812 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:20 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:58:20.813 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:20 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:58:20.813 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:20 smithi099 ceph-mon[29691]: pgmap v10: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:58:20.813 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:20 smithi099 ceph-mon[29691]: pgmap v11: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:58:20.813 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:20 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:58:20.813 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:20 smithi099 ceph-mon[29691]: mgrmap e39: y(active, since 5s) 2024-03-30T13:58:20.846 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 13:58:20 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-x[50211]: 2024-03-30T13:58:20.576+0000 7ff7502df200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-03-30T13:58:20.846 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 13:58:20 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-x[50211]: 2024-03-30T13:58:20.850+0000 7ff7502df200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-03-30T13:58:20.847 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:20 smithi181 ceph-mon[25762]: Reconfiguring iscsi.foo.smithi099.qyjuvr (dependencies changed)... 2024-03-30T13:58:20.847 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:20 smithi181 ceph-mon[25762]: Reconfiguring daemon iscsi.foo.smithi099.qyjuvr on smithi099 2024-03-30T13:58:20.847 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:20 smithi181 ceph-mon[25762]: pgmap v8: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:58:20.847 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:20 smithi181 ceph-mon[25762]: pgmap v9: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:58:20.847 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:20 smithi181 ceph-mon[25762]: Health check failed: 1 failed cephadm daemon(s) (CEPHADM_FAILED_DAEMON) 2024-03-30T13:58:20.847 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:20 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:58:20.847 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:20 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:58:20.847 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:20 smithi181 ceph-mon[25762]: pgmap v10: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:58:20.847 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:20 smithi181 ceph-mon[25762]: pgmap v11: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:58:20.847 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:20 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:58:20.847 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:20 smithi181 ceph-mon[25762]: mgrmap e39: y(active, since 5s) 2024-03-30T13:58:21.426 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 13:58:21 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-x[50211]: 2024-03-30T13:58:21.122+0000 7ff7502df200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-03-30T13:58:22.081 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:21 smithi099 ceph-mon[24912]: from='client.15324 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T13:58:22.082 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:21 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:58:22.082 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:21 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:58:22.082 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:21 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:58:22.082 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:21 smithi099 ceph-mon[29691]: from='client.15324 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T13:58:22.082 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:21 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:58:22.082 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:21 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:58:22.082 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:21 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:58:22.167 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 13:58:21 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-x[50211]: 2024-03-30T13:58:21.979+0000 7ff7502df200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-03-30T13:58:22.168 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:21 smithi181 ceph-mon[25762]: from='client.15324 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T13:58:22.168 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:21 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:58:22.168 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:21 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:58:22.168 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:21 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:58:22.750 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 13:58:22 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-x[50211]: 2024-03-30T13:58:22.574+0000 7ff7502df200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-03-30T13:58:22.750 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 13:58:22 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-x[50211]: 2024-03-30T13:58:22.675+0000 7ff7502df200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-03-30T13:58:23.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:22 smithi181 ceph-mon[25762]: pgmap v12: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:58:23.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:22 smithi181 ceph-mon[25762]: pgmap v13: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:58:23.251 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 13:58:22 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-x[50211]: 2024-03-30T13:58:22.904+0000 7ff7502df200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-03-30T13:58:23.251 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 13:58:22 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-x[50211]: [30/Mar/2024:13:58:22] ENGINE Bus STARTING 2024-03-30T13:58:23.251 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 13:58:23 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-x[50211]: CherryPy Checker: 2024-03-30T13:58:23.251 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 13:58:23 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-x[50211]: The Application mounted at '' has an empty config. 2024-03-30T13:58:23.251 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 13:58:23 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-x[50211]: 2024-03-30T13:58:23.251 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 13:58:23 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-x[50211]: [30/Mar/2024:13:58:23] ENGINE Serving on http://:::9283 2024-03-30T13:58:23.251 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 13:58:23 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-x[50211]: [30/Mar/2024:13:58:23] ENGINE Bus STARTED 2024-03-30T13:58:23.278 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:22 smithi099 ceph-mon[24912]: pgmap v12: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:58:23.278 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:22 smithi099 ceph-mon[24912]: pgmap v13: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:58:23.278 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:22 smithi099 ceph-mon[29691]: pgmap v12: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:58:23.278 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:22 smithi099 ceph-mon[29691]: pgmap v13: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:58:24.049 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:23 smithi099 ceph-mon[24912]: Standby manager daemon x started 2024-03-30T13:58:24.049 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:23 smithi099 ceph-mon[24912]: from='mgr.? 172.21.15.181:0/1508425110' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/crt"}]: dispatch 2024-03-30T13:58:24.049 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:23 smithi099 ceph-mon[24912]: from='mgr.? 172.21.15.181:0/1508425110' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-03-30T13:58:24.049 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:23 smithi099 ceph-mon[24912]: from='mgr.? 172.21.15.181:0/1508425110' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/key"}]: dispatch 2024-03-30T13:58:24.049 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:23 smithi099 ceph-mon[24912]: from='mgr.? 172.21.15.181:0/1508425110' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-03-30T13:58:24.049 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:23 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:58:24.049 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:23 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:58:24.049 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:23 smithi099 ceph-mon[24912]: mgrmap e40: y(active, since 8s), standbys: x 2024-03-30T13:58:24.049 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:23 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-03-30T13:58:24.049 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:23 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:58:24.050 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:23 smithi099 ceph-mon[29691]: Standby manager daemon x started 2024-03-30T13:58:24.050 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:23 smithi099 ceph-mon[29691]: from='mgr.? 172.21.15.181:0/1508425110' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/crt"}]: dispatch 2024-03-30T13:58:24.050 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:23 smithi099 ceph-mon[29691]: from='mgr.? 172.21.15.181:0/1508425110' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-03-30T13:58:24.050 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:23 smithi099 ceph-mon[29691]: from='mgr.? 172.21.15.181:0/1508425110' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/key"}]: dispatch 2024-03-30T13:58:24.050 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:23 smithi099 ceph-mon[29691]: from='mgr.? 172.21.15.181:0/1508425110' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-03-30T13:58:24.050 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:23 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:58:24.050 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:23 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:58:24.050 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:23 smithi099 ceph-mon[29691]: mgrmap e40: y(active, since 8s), standbys: x 2024-03-30T13:58:24.050 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:23 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-03-30T13:58:24.050 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:23 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:58:24.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:23 smithi181 ceph-mon[25762]: Standby manager daemon x started 2024-03-30T13:58:24.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:23 smithi181 ceph-mon[25762]: from='mgr.? 172.21.15.181:0/1508425110' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/crt"}]: dispatch 2024-03-30T13:58:24.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:23 smithi181 ceph-mon[25762]: from='mgr.? 172.21.15.181:0/1508425110' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-03-30T13:58:24.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:23 smithi181 ceph-mon[25762]: from='mgr.? 172.21.15.181:0/1508425110' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/key"}]: dispatch 2024-03-30T13:58:24.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:23 smithi181 ceph-mon[25762]: from='mgr.? 172.21.15.181:0/1508425110' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-03-30T13:58:24.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:23 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:58:24.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:23 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:58:24.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:23 smithi181 ceph-mon[25762]: mgrmap e40: y(active, since 8s), standbys: x 2024-03-30T13:58:24.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:23 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-03-30T13:58:24.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:23 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:58:25.081 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:24 smithi099 ceph-mon[24912]: pgmap v14: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 59 KiB/s rd, 0 B/s wr, 33 op/s 2024-03-30T13:58:25.081 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:24 smithi099 ceph-mon[24912]: pgmap v15: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 59 KiB/s rd, 0 B/s wr, 33 op/s 2024-03-30T13:58:25.082 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:24 smithi099 ceph-mon[29691]: pgmap v14: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 59 KiB/s rd, 0 B/s wr, 33 op/s 2024-03-30T13:58:25.082 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:24 smithi099 ceph-mon[29691]: pgmap v15: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 59 KiB/s rd, 0 B/s wr, 33 op/s 2024-03-30T13:58:25.082 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:58:24 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[71049]: 2024-03-30T13:58:24.907+0000 7f5f7e1d7700 -1 log_channel(cephadm) log [ERR] : cephadm exited with an error code: 1, stderr: Reconfig daemon iscsi.foo.smithi099.qyjuvr ... 2024-03-30T13:58:25.082 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:58:24 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[71049]: Creating ceph-iscsi config... 2024-03-30T13:58:25.082 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:58:24 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[71049]: Write file: /var/lib/ceph/98ebaeb8-ee99-11ee-b647-cb9ed24678a4/iscsi.foo.smithi099.qyjuvr/iscsi-gateway.cfg 2024-03-30T13:58:25.083 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:58:24 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[71049]: Write file: /var/lib/ceph/98ebaeb8-ee99-11ee-b647-cb9ed24678a4/iscsi.foo.smithi099.qyjuvr/tcmu-runner-entrypoint.sh 2024-03-30T13:58:25.083 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:58:24 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[71049]: Non-zero exit code 1 from systemctl restart ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4@iscsi.foo.smithi099.qyjuvr 2024-03-30T13:58:25.083 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:58:24 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[71049]: systemctl: stderr Job for ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4@iscsi.foo.smithi099.qyjuvr.service failed because the control process exited with error code. 2024-03-30T13:58:25.083 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:58:24 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[71049]: systemctl: stderr See "systemctl status ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4@iscsi.foo.smithi099.qyjuvr.service" and "journalctl -xeu ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4@iscsi.foo.smithi099.qyjuvr.service" for details. 2024-03-30T13:58:25.083 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:58:24 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[71049]: Traceback (most recent call last): 2024-03-30T13:58:25.083 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:58:24 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[71049]: File "/usr/lib64/python3.9/runpy.py", line 197, in _run_module_as_main 2024-03-30T13:58:25.083 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:58:24 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[71049]: return _run_code(code, main_globals, None, 2024-03-30T13:58:25.083 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:58:24 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[71049]: File "/usr/lib64/python3.9/runpy.py", line 87, in _run_code 2024-03-30T13:58:25.083 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:58:24 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[71049]: exec(code, run_globals) 2024-03-30T13:58:25.083 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:58:24 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[71049]: File "/var/lib/ceph/98ebaeb8-ee99-11ee-b647-cb9ed24678a4/cephadm.a8f553f8c0a1bbbd91f4e60c8e13381b6fabffa3561f875fe77bb96af479b3ca/__main__.py", line 5528, in 2024-03-30T13:58:25.083 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:58:24 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[71049]: File "/var/lib/ceph/98ebaeb8-ee99-11ee-b647-cb9ed24678a4/cephadm.a8f553f8c0a1bbbd91f4e60c8e13381b6fabffa3561f875fe77bb96af479b3ca/__main__.py", line 5516, in main 2024-03-30T13:58:25.083 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:58:24 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[71049]: File "/var/lib/ceph/98ebaeb8-ee99-11ee-b647-cb9ed24678a4/cephadm.a8f553f8c0a1bbbd91f4e60c8e13381b6fabffa3561f875fe77bb96af479b3ca/__main__.py", line 3040, in command_deploy_from 2024-03-30T13:58:25.083 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:58:24 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[71049]: File "/var/lib/ceph/98ebaeb8-ee99-11ee-b647-cb9ed24678a4/cephadm.a8f553f8c0a1bbbd91f4e60c8e13381b6fabffa3561f875fe77bb96af479b3ca/__main__.py", line 3075, in _common_deploy 2024-03-30T13:58:25.084 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:58:24 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[71049]: File "/var/lib/ceph/98ebaeb8-ee99-11ee-b647-cb9ed24678a4/cephadm.a8f553f8c0a1bbbd91f4e60c8e13381b6fabffa3561f875fe77bb96af479b3ca/__main__.py", line 3095, in _deploy_daemon_container 2024-03-30T13:58:25.084 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:58:24 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[71049]: File "/var/lib/ceph/98ebaeb8-ee99-11ee-b647-cb9ed24678a4/cephadm.a8f553f8c0a1bbbd91f4e60c8e13381b6fabffa3561f875fe77bb96af479b3ca/__main__.py", line 1067, in deploy_daemon 2024-03-30T13:58:25.084 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:58:24 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[71049]: File "/var/lib/ceph/98ebaeb8-ee99-11ee-b647-cb9ed24678a4/cephadm.a8f553f8c0a1bbbd91f4e60c8e13381b6fabffa3561f875fe77bb96af479b3ca/cephadmlib/call_wrappers.py", line 307, in call_throws 2024-03-30T13:58:25.084 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:58:24 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[71049]: RuntimeError: Failed command: systemctl restart ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4@iscsi.foo.smithi099.qyjuvr: Job for ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4@iscsi.foo.smithi099.qyjuvr.service failed because the control process exited with error code. 2024-03-30T13:58:25.084 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:58:24 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[71049]: See "systemctl status ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4@iscsi.foo.smithi099.qyjuvr.service" and "journalctl -xeu ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4@iscsi.foo.smithi099.qyjuvr.service" for details. 2024-03-30T13:58:25.084 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:58:24 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[71049]: Traceback (most recent call last): 2024-03-30T13:58:25.084 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:58:24 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[71049]: File "/usr/share/ceph/mgr/cephadm/serve.py", line 1114, in _check_daemons 2024-03-30T13:58:25.084 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:58:24 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[71049]: self.mgr._daemon_action(daemon_spec, action=action) 2024-03-30T13:58:25.084 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:58:24 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[71049]: File "/usr/share/ceph/mgr/cephadm/module.py", line 2390, in _daemon_action 2024-03-30T13:58:25.084 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:58:24 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[71049]: CephadmServe(self)._create_daemon(daemon_spec, reconfig=(action == 'reconfig'))) 2024-03-30T13:58:25.084 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:58:24 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[71049]: File "/usr/share/ceph/mgr/cephadm/module.py", line 747, in wait_async 2024-03-30T13:58:25.084 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:58:24 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[71049]: return self.event_loop.get_result(coro, timeout) 2024-03-30T13:58:25.084 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:58:24 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[71049]: File "/usr/share/ceph/mgr/cephadm/ssh.py", line 136, in get_result 2024-03-30T13:58:25.085 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:58:24 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[71049]: return future.result(timeout) 2024-03-30T13:58:25.085 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:58:24 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[71049]: File "/lib64/python3.6/concurrent/futures/_base.py", line 432, in result 2024-03-30T13:58:25.085 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:58:24 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[71049]: return self.__get_result() 2024-03-30T13:58:25.085 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:58:24 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[71049]: File "/lib64/python3.6/concurrent/futures/_base.py", line 384, in __get_result 2024-03-30T13:58:25.085 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:58:24 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[71049]: raise self._exception 2024-03-30T13:58:25.085 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:58:24 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[71049]: File "/usr/share/ceph/mgr/cephadm/serve.py", line 1374, in _create_daemon 2024-03-30T13:58:25.085 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:58:24 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[71049]: config_blobs=daemon_spec.final_config, 2024-03-30T13:58:25.085 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:58:24 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[71049]: File "/usr/share/ceph/mgr/cephadm/serve.py", line 1685, in _run_cephadm 2024-03-30T13:58:25.085 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:58:24 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[71049]: f'cephadm exited with an error code: {code}, stderr: {err}') 2024-03-30T13:58:25.085 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:58:24 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[71049]: orchestrator._interface.OrchestratorError: cephadm exited with an error code: 1, stderr: Reconfig daemon iscsi.foo.smithi099.qyjuvr ... 2024-03-30T13:58:25.085 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:58:24 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[71049]: Creating ceph-iscsi config... 2024-03-30T13:58:25.085 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:58:24 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[71049]: Write file: /var/lib/ceph/98ebaeb8-ee99-11ee-b647-cb9ed24678a4/iscsi.foo.smithi099.qyjuvr/iscsi-gateway.cfg 2024-03-30T13:58:25.085 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:58:24 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[71049]: Write file: /var/lib/ceph/98ebaeb8-ee99-11ee-b647-cb9ed24678a4/iscsi.foo.smithi099.qyjuvr/tcmu-runner-entrypoint.sh 2024-03-30T13:58:25.085 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:58:24 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[71049]: Non-zero exit code 1 from systemctl restart ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4@iscsi.foo.smithi099.qyjuvr 2024-03-30T13:58:25.086 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:58:24 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[71049]: systemctl: stderr Job for ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4@iscsi.foo.smithi099.qyjuvr.service failed because the control process exited with error code. 2024-03-30T13:58:25.086 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:58:24 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[71049]: systemctl: stderr See "systemctl status ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4@iscsi.foo.smithi099.qyjuvr.service" and "journalctl -xeu ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4@iscsi.foo.smithi099.qyjuvr.service" for details. 2024-03-30T13:58:25.086 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:58:24 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[71049]: Traceback (most recent call last): 2024-03-30T13:58:25.086 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:58:24 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[71049]: File "/usr/lib64/python3.9/runpy.py", line 197, in _run_module_as_main 2024-03-30T13:58:25.086 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:58:24 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[71049]: return _run_code(code, main_globals, None, 2024-03-30T13:58:25.086 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:58:24 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[71049]: File "/usr/lib64/python3.9/runpy.py", line 87, in _run_code 2024-03-30T13:58:25.086 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:58:24 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[71049]: exec(code, run_globals) 2024-03-30T13:58:25.086 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:58:24 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[71049]: File "/var/lib/ceph/98ebaeb8-ee99-11ee-b647-cb9ed24678a4/cephadm.a8f553f8c0a1bbbd91f4e60c8e13381b6fabffa3561f875fe77bb96af479b3ca/__main__.py", line 5528, in 2024-03-30T13:58:25.086 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:58:24 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[71049]: File "/var/lib/ceph/98ebaeb8-ee99-11ee-b647-cb9ed24678a4/cephadm.a8f553f8c0a1bbbd91f4e60c8e13381b6fabffa3561f875fe77bb96af479b3ca/__main__.py", line 5516, in main 2024-03-30T13:58:25.086 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:58:24 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[71049]: File "/var/lib/ceph/98ebaeb8-ee99-11ee-b647-cb9ed24678a4/cephadm.a8f553f8c0a1bbbd91f4e60c8e13381b6fabffa3561f875fe77bb96af479b3ca/__main__.py", line 3040, in command_deploy_from 2024-03-30T13:58:25.087 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:58:24 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[71049]: File "/var/lib/ceph/98ebaeb8-ee99-11ee-b647-cb9ed24678a4/cephadm.a8f553f8c0a1bbbd91f4e60c8e13381b6fabffa3561f875fe77bb96af479b3ca/__main__.py", line 3075, in _common_deploy 2024-03-30T13:58:25.087 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:58:24 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[71049]: File "/var/lib/ceph/98ebaeb8-ee99-11ee-b647-cb9ed24678a4/cephadm.a8f553f8c0a1bbbd91f4e60c8e13381b6fabffa3561f875fe77bb96af479b3ca/__main__.py", line 3095, in _deploy_daemon_container 2024-03-30T13:58:25.087 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:58:24 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[71049]: File "/var/lib/ceph/98ebaeb8-ee99-11ee-b647-cb9ed24678a4/cephadm.a8f553f8c0a1bbbd91f4e60c8e13381b6fabffa3561f875fe77bb96af479b3ca/__main__.py", line 1067, in deploy_daemon 2024-03-30T13:58:25.087 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:58:24 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[71049]: File "/var/lib/ceph/98ebaeb8-ee99-11ee-b647-cb9ed24678a4/cephadm.a8f553f8c0a1bbbd91f4e60c8e13381b6fabffa3561f875fe77bb96af479b3ca/cephadmlib/call_wrappers.py", line 307, in call_throws 2024-03-30T13:58:25.087 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:58:24 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[71049]: RuntimeError: Failed command: systemctl restart ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4@iscsi.foo.smithi099.qyjuvr: Job for ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4@iscsi.foo.smithi099.qyjuvr.service failed because the control process exited with error code. 2024-03-30T13:58:25.087 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:58:24 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[71049]: See "systemctl status ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4@iscsi.foo.smithi099.qyjuvr.service" and "journalctl -xeu ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4@iscsi.foo.smithi099.qyjuvr.service" for details. 2024-03-30T13:58:25.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:24 smithi181 ceph-mon[25762]: pgmap v14: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 59 KiB/s rd, 0 B/s wr, 33 op/s 2024-03-30T13:58:25.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:24 smithi181 ceph-mon[25762]: pgmap v15: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 59 KiB/s rd, 0 B/s wr, 33 op/s 2024-03-30T13:58:26.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:25 smithi181 ceph-mon[25762]: cephadm exited with an error code: 1, stderr: Reconfig daemon iscsi.foo.smithi099.qyjuvr ... 2024-03-30T13:58:26.001 INFO:journalctl@ceph.mon.b.smithi181.stdout: Creating ceph-iscsi config... 2024-03-30T13:58:26.001 INFO:journalctl@ceph.mon.b.smithi181.stdout: Write file: /var/lib/ceph/98ebaeb8-ee99-11ee-b647-cb9ed24678a4/iscsi.foo.smithi099.qyjuvr/iscsi-gateway.cfg 2024-03-30T13:58:26.001 INFO:journalctl@ceph.mon.b.smithi181.stdout: Write file: /var/lib/ceph/98ebaeb8-ee99-11ee-b647-cb9ed24678a4/iscsi.foo.smithi099.qyjuvr/tcmu-runner-entrypoint.sh 2024-03-30T13:58:26.001 INFO:journalctl@ceph.mon.b.smithi181.stdout: Non-zero exit code 1 from systemctl restart ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4@iscsi.foo.smithi099.qyjuvr 2024-03-30T13:58:26.001 INFO:journalctl@ceph.mon.b.smithi181.stdout: systemctl: stderr Job for ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4@iscsi.foo.smithi099.qyjuvr.service failed because the control process exited with error code. 2024-03-30T13:58:26.001 INFO:journalctl@ceph.mon.b.smithi181.stdout: systemctl: stderr See "systemctl status ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4@iscsi.foo.smithi099.qyjuvr.service" and "journalctl -xeu ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4@iscsi.foo.smithi099.qyjuvr.service" for details. 2024-03-30T13:58:26.001 INFO:journalctl@ceph.mon.b.smithi181.stdout: Traceback (most recent call last): 2024-03-30T13:58:26.001 INFO:journalctl@ceph.mon.b.smithi181.stdout: File "/usr/lib64/python3.9/runpy.py", line 197, in _run_module_as_main 2024-03-30T13:58:26.001 INFO:journalctl@ceph.mon.b.smithi181.stdout: return _run_code(code, main_globals, None, 2024-03-30T13:58:26.001 INFO:journalctl@ceph.mon.b.smithi181.stdout: File "/usr/lib64/python3.9/runpy.py", line 87, in _run_code 2024-03-30T13:58:26.001 INFO:journalctl@ceph.mon.b.smithi181.stdout: exec(code, run_globals) 2024-03-30T13:58:26.001 INFO:journalctl@ceph.mon.b.smithi181.stdout: File "/var/lib/ceph/98ebaeb8-ee99-11ee-b647-cb9ed24678a4/cephadm.a8f553f8c0a1bbbd91f4e60c8e13381b6fabffa3561f875fe77bb96af479b3ca/__main__.py", line 5528, in 2024-03-30T13:58:26.001 INFO:journalctl@ceph.mon.b.smithi181.stdout: File "/var/lib/ceph/98ebaeb8-ee99-11ee-b647-cb9ed24678a4/cephadm.a8f553f8c0a1bbbd91f4e60c8e13381b6fabffa3561f875fe77bb96af479b3ca/__main__.py", line 5516, in main 2024-03-30T13:58:26.002 INFO:journalctl@ceph.mon.b.smithi181.stdout: File "/var/lib/ceph/98ebaeb8-ee99-11ee-b647-cb9ed24678a4/cephadm.a8f553f8c0a1bbbd91f4e60c8e13381b6fabffa3561f875fe77bb96af479b3ca/__main__.py", line 3040, in command_deploy_from 2024-03-30T13:58:26.002 INFO:journalctl@ceph.mon.b.smithi181.stdout: File "/var/lib/ceph/98ebaeb8-ee99-11ee-b647-cb9ed24678a4/cephadm.a8f553f8c0a1bbbd91f4e60c8e13381b6fabffa3561f875fe77bb96af479b3ca/__main__.py", line 3075, in _common_deploy 2024-03-30T13:58:26.002 INFO:journalctl@ceph.mon.b.smithi181.stdout: File "/var/lib/ceph/98ebaeb8-ee99-11ee-b647-cb9ed24678a4/cephadm.a8f553f8c0a1bbbd91f4e60c8e13381b6fabffa3561f875fe77bb96af479b3ca/__main__.py", line 3095, in _deploy_daemon_container 2024-03-30T13:58:26.002 INFO:journalctl@ceph.mon.b.smithi181.stdout: File "/var/lib/ceph/98ebaeb8-ee99-11ee-b647-cb9ed24678a4/cephadm.a8f553f8c0a1bbbd91f4e60c8e13381b6fabffa3561f875fe77bb96af479b3ca/__main__.py", line 1067, in deploy_daemon 2024-03-30T13:58:26.002 INFO:journalctl@ceph.mon.b.smithi181.stdout: File "/var/lib/ceph/98ebaeb8-ee99-11ee-b647-cb9ed24678a4/cephadm.a8f553f8c0a1bbbd91f4e60c8e13381b6fabffa3561f875fe77bb96af479b3ca/cephadmlib/call_wrappers.py", line 307, in call_throws 2024-03-30T13:58:26.002 INFO:journalctl@ceph.mon.b.smithi181.stdout: RuntimeError: Failed command: systemctl restart ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4@iscsi.foo.smithi099.qyjuvr: Job for ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4@iscsi.foo.smithi099.qyjuvr.service failed because the control process exited with error code. 2024-03-30T13:58:26.002 INFO:journalctl@ceph.mon.b.smithi181.stdout: See "systemctl status ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4@iscsi.foo.smithi099.qyjuvr.service" and "journalctl -xeu ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4@iscsi.foo.smithi099.qyjuvr.service" for details. 2024-03-30T13:58:26.002 INFO:journalctl@ceph.mon.b.smithi181.stdout: Traceback (most recent call last): 2024-03-30T13:58:26.002 INFO:journalctl@ceph.mon.b.smithi181.stdout: File "/usr/share/ceph/mgr/cephadm/serve.py", line 1114, in _check_daemons 2024-03-30T13:58:26.002 INFO:journalctl@ceph.mon.b.smithi181.stdout: self.mgr._daemon_action(daemon_spec, action=action) 2024-03-30T13:58:26.002 INFO:journalctl@ceph.mon.b.smithi181.stdout: File "/usr/share/ceph/mgr/cephadm/module.py", line 2390, in _daemon_action 2024-03-30T13:58:26.002 INFO:journalctl@ceph.mon.b.smithi181.stdout: CephadmServe(self)._create_daemon(daemon_spec, reconfig=(action == 'reconfig'))) 2024-03-30T13:58:26.002 INFO:journalctl@ceph.mon.b.smithi181.stdout: File "/usr/share/ceph/mgr/cephadm/module.py", line 747, in wait_async 2024-03-30T13:58:26.002 INFO:journalctl@ceph.mon.b.smithi181.stdout: return self.event_loop.get_result(coro, timeout) 2024-03-30T13:58:26.003 INFO:journalctl@ceph.mon.b.smithi181.stdout: File "/usr/share/ceph/mgr/cephadm/ssh.py", line 136, in get_result 2024-03-30T13:58:26.003 INFO:journalctl@ceph.mon.b.smithi181.stdout: return future.result(timeout) 2024-03-30T13:58:26.003 INFO:journalctl@ceph.mon.b.smithi181.stdout: File "/lib64/python3.6/concurrent/futures/_base.py", line 432, in result 2024-03-30T13:58:26.003 INFO:journalctl@ceph.mon.b.smithi181.stdout: return self.__get_result() 2024-03-30T13:58:26.003 INFO:journalctl@ceph.mon.b.smithi181.stdout: File "/lib64/python3.6/concurrent/futures/_base.py", line 384, in __get_result 2024-03-30T13:58:26.003 INFO:journalctl@ceph.mon.b.smithi181.stdout: raise self._exception 2024-03-30T13:58:26.003 INFO:journalctl@ceph.mon.b.smithi181.stdout: File "/usr/share/ceph/mgr/cephadm/serve.py", line 1374, in _create_daemon 2024-03-30T13:58:26.003 INFO:journalctl@ceph.mon.b.smithi181.stdout: config_blobs=daemon_spec.final_config, 2024-03-30T13:58:26.003 INFO:journalctl@ceph.mon.b.smithi181.stdout: File "/usr/share/ceph/mgr/cephadm/serve.py", line 1685, in _run_cephadm 2024-03-30T13:58:26.003 INFO:journalctl@ceph.mon.b.smithi181.stdout: f'cephadm exited with an error code: {code}, stderr: {err}') 2024-03-30T13:58:26.003 INFO:journalctl@ceph.mon.b.smithi181.stdout: orchestrator._interface.OrchestratorError: cephadm exited with an error code: 1, stderr: Reconfig daemon iscsi.foo.smithi099.qyjuvr ... 2024-03-30T13:58:26.003 INFO:journalctl@ceph.mon.b.smithi181.stdout: Creating ceph-iscsi config... 2024-03-30T13:58:26.003 INFO:journalctl@ceph.mon.b.smithi181.stdout: Write file: /var/lib/ceph/98ebaeb8-ee99-11ee-b647-cb9ed24678a4/iscsi.foo.smithi099.qyjuvr/iscsi-gateway.cfg 2024-03-30T13:58:26.003 INFO:journalctl@ceph.mon.b.smithi181.stdout: Write file: /var/lib/ceph/98ebaeb8-ee99-11ee-b647-cb9ed24678a4/iscsi.foo.smithi099.qyjuvr/tcmu-runner-entrypoint.sh 2024-03-30T13:58:26.003 INFO:journalctl@ceph.mon.b.smithi181.stdout: Non-zero exit code 1 from systemctl restart ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4@iscsi.foo.smithi099.qyjuvr 2024-03-30T13:58:26.003 INFO:journalctl@ceph.mon.b.smithi181.stdout: systemctl: stderr Job for ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4@iscsi.foo.smithi099.qyjuvr.service failed because the control process exited with error code. 2024-03-30T13:58:26.004 INFO:journalctl@ceph.mon.b.smithi181.stdout: systemctl: stderr See "systemctl status ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4@iscsi.foo.smithi099.qyjuvr.service" and "journalctl -xeu ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4@iscsi.foo.smithi099.qyjuvr.service" for details. 2024-03-30T13:58:26.004 INFO:journalctl@ceph.mon.b.smithi181.stdout: Traceback (most recent call last): 2024-03-30T13:58:26.004 INFO:journalctl@ceph.mon.b.smithi181.stdout: File "/usr/lib64/python3.9/runpy.py", line 197, in _run_module_as_main 2024-03-30T13:58:26.004 INFO:journalctl@ceph.mon.b.smithi181.stdout: return _run_code(code, main_globals, None, 2024-03-30T13:58:26.004 INFO:journalctl@ceph.mon.b.smithi181.stdout: File "/usr/lib64/python3.9/runpy.py", line 87, in _run_code 2024-03-30T13:58:26.004 INFO:journalctl@ceph.mon.b.smithi181.stdout: exec(code, run_globals) 2024-03-30T13:58:26.004 INFO:journalctl@ceph.mon.b.smithi181.stdout: File "/var/lib/ceph/98ebaeb8-ee99-11ee-b647-cb9ed24678a4/cephadm.a8f553f8c0a1bbbd91f4e60c8e13381b6fabffa3561f875fe77bb96af479b3ca/__main__.py", line 5528, in 2024-03-30T13:58:26.004 INFO:journalctl@ceph.mon.b.smithi181.stdout: File "/var/lib/ceph/98ebaeb8-ee99-11ee-b647-cb9ed24678a4/cephadm.a8f553f8c0a1bbbd91f4e60c8e13381b6fabffa3561f875fe77bb96af479b3ca/__main__.py", line 5516, in main 2024-03-30T13:58:26.004 INFO:journalctl@ceph.mon.b.smithi181.stdout: File "/var/lib/ceph/98ebaeb8-ee99-11ee-b647-cb9ed24678a4/cephadm.a8f553f8c0a1bbbd91f4e60c8e13381b6fabffa3561f875fe77bb96af479b3ca/__main__.py", line 3040, in command_deploy_from 2024-03-30T13:58:26.004 INFO:journalctl@ceph.mon.b.smithi181.stdout: File "/var/lib/ceph/98ebaeb8-ee99-11ee-b647-cb9ed24678a4/cephadm.a8f553f8c0a1bbbd91f4e60c8e13381b6fabffa3561f875fe77bb96af479b3ca/__main__.py", line 3075, in _common_deploy 2024-03-30T13:58:26.004 INFO:journalctl@ceph.mon.b.smithi181.stdout: File "/var/lib/ceph/98ebaeb8-ee99-11ee-b647-cb9ed24678a4/cephadm.a8f553f8c0a1bbbd91f4e60c8e13381b6fabffa3561f875fe77bb96af479b3ca/__main__.py", line 3095, in _deploy_daemon_container 2024-03-30T13:58:26.004 INFO:journalctl@ceph.mon.b.smithi181.stdout: File "/var/lib/ceph/98ebaeb8-ee99-11ee-b647-cb9ed24678a4/cephadm.a8f553f8c0a1bbbd91f4e60c8e13381b6fabffa3561f875fe77bb96af479b3ca/__main__.py", line 1067, in deploy_daemon 2024-03-30T13:58:26.004 INFO:journalctl@ceph.mon.b.smithi181.stdout: File "/var/lib/ceph/98ebaeb8-ee99-11ee-b647-cb9ed24678a4/cephadm.a8f553f8c0a1bbbd91f4e60c8e13381b6fabffa3561f875fe77bb96af479b3ca/cephadmlib/call_wrappers.py", line 307, in call_throws 2024-03-30T13:58:26.004 INFO:journalctl@ceph.mon.b.smithi181.stdout: RuntimeError: Failed command: systemctl restart ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4@iscsi.foo.smithi099.qyjuvr: Job for ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4@iscsi.foo.smithi099.qyjuvr.service failed because the control process exited with error code. 2024-03-30T13:58:26.005 INFO:journalctl@ceph.mon.b.smithi181.stdout: See "systemctl status ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4@iscsi.foo.smithi099.qyjuvr.service" and "journalctl -xeu ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4@iscsi.foo.smithi099.qyjuvr.service" for details. 2024-03-30T13:58:26.005 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:25 smithi181 ceph-mon[25762]: Reconfiguring prometheus.a (dependencies changed)... 2024-03-30T13:58:26.331 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:25 smithi099 ceph-mon[29691]: cephadm exited with an error code: 1, stderr: Reconfig daemon iscsi.foo.smithi099.qyjuvr ... 2024-03-30T13:58:26.331 INFO:journalctl@ceph.mon.c.smithi099.stdout: Creating ceph-iscsi config... 2024-03-30T13:58:26.331 INFO:journalctl@ceph.mon.c.smithi099.stdout: Write file: /var/lib/ceph/98ebaeb8-ee99-11ee-b647-cb9ed24678a4/iscsi.foo.smithi099.qyjuvr/iscsi-gateway.cfg 2024-03-30T13:58:26.331 INFO:journalctl@ceph.mon.c.smithi099.stdout: Write file: /var/lib/ceph/98ebaeb8-ee99-11ee-b647-cb9ed24678a4/iscsi.foo.smithi099.qyjuvr/tcmu-runner-entrypoint.sh 2024-03-30T13:58:26.331 INFO:journalctl@ceph.mon.c.smithi099.stdout: Non-zero exit code 1 from systemctl restart ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4@iscsi.foo.smithi099.qyjuvr 2024-03-30T13:58:26.332 INFO:journalctl@ceph.mon.c.smithi099.stdout: systemctl: stderr Job for ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4@iscsi.foo.smithi099.qyjuvr.service failed because the control process exited with error code. 2024-03-30T13:58:26.332 INFO:journalctl@ceph.mon.c.smithi099.stdout: systemctl: stderr See "systemctl status ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4@iscsi.foo.smithi099.qyjuvr.service" and "journalctl -xeu ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4@iscsi.foo.smithi099.qyjuvr.service" for details. 2024-03-30T13:58:26.332 INFO:journalctl@ceph.mon.c.smithi099.stdout: Traceback (most recent call last): 2024-03-30T13:58:26.332 INFO:journalctl@ceph.mon.c.smithi099.stdout: File "/usr/lib64/python3.9/runpy.py", line 197, in _run_module_as_main 2024-03-30T13:58:26.332 INFO:journalctl@ceph.mon.c.smithi099.stdout: return _run_code(code, main_globals, None, 2024-03-30T13:58:26.332 INFO:journalctl@ceph.mon.c.smithi099.stdout: File "/usr/lib64/python3.9/runpy.py", line 87, in _run_code 2024-03-30T13:58:26.332 INFO:journalctl@ceph.mon.c.smithi099.stdout: exec(code, run_globals) 2024-03-30T13:58:26.333 INFO:journalctl@ceph.mon.c.smithi099.stdout: File "/var/lib/ceph/98ebaeb8-ee99-11ee-b647-cb9ed24678a4/cephadm.a8f553f8c0a1bbbd91f4e60c8e13381b6fabffa3561f875fe77bb96af479b3ca/__main__.py", line 5528, in 2024-03-30T13:58:26.333 INFO:journalctl@ceph.mon.c.smithi099.stdout: File "/var/lib/ceph/98ebaeb8-ee99-11ee-b647-cb9ed24678a4/cephadm.a8f553f8c0a1bbbd91f4e60c8e13381b6fabffa3561f875fe77bb96af479b3ca/__main__.py", line 5516, in main 2024-03-30T13:58:26.333 INFO:journalctl@ceph.mon.c.smithi099.stdout: File "/var/lib/ceph/98ebaeb8-ee99-11ee-b647-cb9ed24678a4/cephadm.a8f553f8c0a1bbbd91f4e60c8e13381b6fabffa3561f875fe77bb96af479b3ca/__main__.py", line 3040, in command_deploy_from 2024-03-30T13:58:26.333 INFO:journalctl@ceph.mon.c.smithi099.stdout: File "/var/lib/ceph/98ebaeb8-ee99-11ee-b647-cb9ed24678a4/cephadm.a8f553f8c0a1bbbd91f4e60c8e13381b6fabffa3561f875fe77bb96af479b3ca/__main__.py", line 3075, in _common_deploy 2024-03-30T13:58:26.333 INFO:journalctl@ceph.mon.c.smithi099.stdout: File "/var/lib/ceph/98ebaeb8-ee99-11ee-b647-cb9ed24678a4/cephadm.a8f553f8c0a1bbbd91f4e60c8e13381b6fabffa3561f875fe77bb96af479b3ca/__main__.py", line 3095, in _deploy_daemon_container 2024-03-30T13:58:26.333 INFO:journalctl@ceph.mon.c.smithi099.stdout: File "/var/lib/ceph/98ebaeb8-ee99-11ee-b647-cb9ed24678a4/cephadm.a8f553f8c0a1bbbd91f4e60c8e13381b6fabffa3561f875fe77bb96af479b3ca/__main__.py", line 1067, in deploy_daemon 2024-03-30T13:58:26.333 INFO:journalctl@ceph.mon.c.smithi099.stdout: File "/var/lib/ceph/98ebaeb8-ee99-11ee-b647-cb9ed24678a4/cephadm.a8f553f8c0a1bbbd91f4e60c8e13381b6fabffa3561f875fe77bb96af479b3ca/cephadmlib/call_wrappers.py", line 307, in call_throws 2024-03-30T13:58:26.334 INFO:journalctl@ceph.mon.c.smithi099.stdout: RuntimeError: Failed command: systemctl restart ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4@iscsi.foo.smithi099.qyjuvr: Job for ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4@iscsi.foo.smithi099.qyjuvr.service failed because the control process exited with error code. 2024-03-30T13:58:26.334 INFO:journalctl@ceph.mon.c.smithi099.stdout: See "systemctl status ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4@iscsi.foo.smithi099.qyjuvr.service" and "journalctl -xeu ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4@iscsi.foo.smithi099.qyjuvr.service" for details. 2024-03-30T13:58:26.334 INFO:journalctl@ceph.mon.c.smithi099.stdout: Traceback (most recent call last): 2024-03-30T13:58:26.334 INFO:journalctl@ceph.mon.c.smithi099.stdout: File "/usr/share/ceph/mgr/cephadm/serve.py", line 1114, in _check_daemons 2024-03-30T13:58:26.334 INFO:journalctl@ceph.mon.c.smithi099.stdout: self.mgr._daemon_action(daemon_spec, action=action) 2024-03-30T13:58:26.334 INFO:journalctl@ceph.mon.c.smithi099.stdout: File "/usr/share/ceph/mgr/cephadm/module.py", line 2390, in _daemon_action 2024-03-30T13:58:26.334 INFO:journalctl@ceph.mon.c.smithi099.stdout: CephadmServe(self)._create_daemon(daemon_spec, reconfig=(action == 'reconfig'))) 2024-03-30T13:58:26.334 INFO:journalctl@ceph.mon.c.smithi099.stdout: File "/usr/share/ceph/mgr/cephadm/module.py", line 747, in wait_async 2024-03-30T13:58:26.335 INFO:journalctl@ceph.mon.c.smithi099.stdout: return self.event_loop.get_result(coro, timeout) 2024-03-30T13:58:26.335 INFO:journalctl@ceph.mon.c.smithi099.stdout: File "/usr/share/ceph/mgr/cephadm/ssh.py", line 136, in get_result 2024-03-30T13:58:26.335 INFO:journalctl@ceph.mon.c.smithi099.stdout: return future.result(timeout) 2024-03-30T13:58:26.335 INFO:journalctl@ceph.mon.c.smithi099.stdout: File "/lib64/python3.6/concurrent/futures/_base.py", line 432, in result 2024-03-30T13:58:26.335 INFO:journalctl@ceph.mon.c.smithi099.stdout: return self.__get_result() 2024-03-30T13:58:26.335 INFO:journalctl@ceph.mon.c.smithi099.stdout: File "/lib64/python3.6/concurrent/futures/_base.py", line 384, in __get_result 2024-03-30T13:58:26.336 INFO:journalctl@ceph.mon.c.smithi099.stdout: raise self._exception 2024-03-30T13:58:26.336 INFO:journalctl@ceph.mon.c.smithi099.stdout: File "/usr/share/ceph/mgr/cephadm/serve.py", line 1374, in _create_daemon 2024-03-30T13:58:26.336 INFO:journalctl@ceph.mon.c.smithi099.stdout: config_blobs=daemon_spec.final_config, 2024-03-30T13:58:26.336 INFO:journalctl@ceph.mon.c.smithi099.stdout: File "/usr/share/ceph/mgr/cephadm/serve.py", line 1685, in _run_cephadm 2024-03-30T13:58:26.336 INFO:journalctl@ceph.mon.c.smithi099.stdout: f'cephadm exited with an error code: {code}, stderr: {err}') 2024-03-30T13:58:26.336 INFO:journalctl@ceph.mon.c.smithi099.stdout: orchestrator._interface.OrchestratorError: cephadm exited with an error code: 1, stderr: Reconfig daemon iscsi.foo.smithi099.qyjuvr ... 2024-03-30T13:58:26.336 INFO:journalctl@ceph.mon.c.smithi099.stdout: Creating ceph-iscsi config... 2024-03-30T13:58:26.337 INFO:journalctl@ceph.mon.c.smithi099.stdout: Write file: /var/lib/ceph/98ebaeb8-ee99-11ee-b647-cb9ed24678a4/iscsi.foo.smithi099.qyjuvr/iscsi-gateway.cfg 2024-03-30T13:58:26.337 INFO:journalctl@ceph.mon.c.smithi099.stdout: Write file: /var/lib/ceph/98ebaeb8-ee99-11ee-b647-cb9ed24678a4/iscsi.foo.smithi099.qyjuvr/tcmu-runner-entrypoint.sh 2024-03-30T13:58:26.337 INFO:journalctl@ceph.mon.c.smithi099.stdout: Non-zero exit code 1 from systemctl restart ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4@iscsi.foo.smithi099.qyjuvr 2024-03-30T13:58:26.337 INFO:journalctl@ceph.mon.c.smithi099.stdout: systemctl: stderr Job for ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4@iscsi.foo.smithi099.qyjuvr.service failed because the control process exited with error code. 2024-03-30T13:58:26.337 INFO:journalctl@ceph.mon.c.smithi099.stdout: systemctl: stderr See "systemctl status ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4@iscsi.foo.smithi099.qyjuvr.service" and "journalctl -xeu ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4@iscsi.foo.smithi099.qyjuvr.service" for details. 2024-03-30T13:58:26.338 INFO:journalctl@ceph.mon.c.smithi099.stdout: Traceback (most recent call last): 2024-03-30T13:58:26.338 INFO:journalctl@ceph.mon.c.smithi099.stdout: File "/usr/lib64/python3.9/runpy.py", line 197, in _run_module_as_main 2024-03-30T13:58:26.338 INFO:journalctl@ceph.mon.c.smithi099.stdout: return _run_code(code, main_globals, None, 2024-03-30T13:58:26.338 INFO:journalctl@ceph.mon.c.smithi099.stdout: File "/usr/lib64/python3.9/runpy.py", line 87, in _run_code 2024-03-30T13:58:26.338 INFO:journalctl@ceph.mon.c.smithi099.stdout: exec(code, run_globals) 2024-03-30T13:58:26.338 INFO:journalctl@ceph.mon.c.smithi099.stdout: File "/var/lib/ceph/98ebaeb8-ee99-11ee-b647-cb9ed24678a4/cephadm.a8f553f8c0a1bbbd91f4e60c8e13381b6fabffa3561f875fe77bb96af479b3ca/__main__.py", line 5528, in 2024-03-30T13:58:26.338 INFO:journalctl@ceph.mon.c.smithi099.stdout: File "/var/lib/ceph/98ebaeb8-ee99-11ee-b647-cb9ed24678a4/cephadm.a8f553f8c0a1bbbd91f4e60c8e13381b6fabffa3561f875fe77bb96af479b3ca/__main__.py", line 5516, in main 2024-03-30T13:58:26.338 INFO:journalctl@ceph.mon.c.smithi099.stdout: File "/var/lib/ceph/98ebaeb8-ee99-11ee-b647-cb9ed24678a4/cephadm.a8f553f8c0a1bbbd91f4e60c8e13381b6fabffa3561f875fe77bb96af479b3ca/__main__.py", line 3040, in command_deploy_from 2024-03-30T13:58:26.339 INFO:journalctl@ceph.mon.c.smithi099.stdout: File "/var/lib/ceph/98ebaeb8-ee99-11ee-b647-cb9ed24678a4/cephadm.a8f553f8c0a1bbbd91f4e60c8e13381b6fabffa3561f875fe77bb96af479b3ca/__main__.py", line 3075, in _common_deploy 2024-03-30T13:58:26.339 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:25 smithi099 ceph-mon[24912]: cephadm exited with an error code: 1, stderr: Reconfig daemon iscsi.foo.smithi099.qyjuvr ... 2024-03-30T13:58:26.339 INFO:journalctl@ceph.mon.a.smithi099.stdout: Creating ceph-iscsi config... 2024-03-30T13:58:26.339 INFO:journalctl@ceph.mon.a.smithi099.stdout: Write file: /var/lib/ceph/98ebaeb8-ee99-11ee-b647-cb9ed24678a4/iscsi.foo.smithi099.qyjuvr/iscsi-gateway.cfg 2024-03-30T13:58:26.340 INFO:journalctl@ceph.mon.a.smithi099.stdout: Write file: /var/lib/ceph/98ebaeb8-ee99-11ee-b647-cb9ed24678a4/iscsi.foo.smithi099.qyjuvr/tcmu-runner-entrypoint.sh 2024-03-30T13:58:26.340 INFO:journalctl@ceph.mon.a.smithi099.stdout: Non-zero exit code 1 from systemctl restart ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4@iscsi.foo.smithi099.qyjuvr 2024-03-30T13:58:26.340 INFO:journalctl@ceph.mon.a.smithi099.stdout: systemctl: stderr Job for ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4@iscsi.foo.smithi099.qyjuvr.service failed because the control process exited with error code. 2024-03-30T13:58:26.340 INFO:journalctl@ceph.mon.a.smithi099.stdout: systemctl: stderr See "systemctl status ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4@iscsi.foo.smithi099.qyjuvr.service" and "journalctl -xeu ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4@iscsi.foo.smithi099.qyjuvr.service" for details. 2024-03-30T13:58:26.340 INFO:journalctl@ceph.mon.a.smithi099.stdout: Traceback (most recent call last): 2024-03-30T13:58:26.340 INFO:journalctl@ceph.mon.a.smithi099.stdout: File "/usr/lib64/python3.9/runpy.py", line 197, in _run_module_as_main 2024-03-30T13:58:26.341 INFO:journalctl@ceph.mon.a.smithi099.stdout: return _run_code(code, main_globals, None, 2024-03-30T13:58:26.341 INFO:journalctl@ceph.mon.a.smithi099.stdout: File "/usr/lib64/python3.9/runpy.py", line 87, in _run_code 2024-03-30T13:58:26.341 INFO:journalctl@ceph.mon.a.smithi099.stdout: exec(code, run_globals) 2024-03-30T13:58:26.341 INFO:journalctl@ceph.mon.a.smithi099.stdout: File "/var/lib/ceph/98ebaeb8-ee99-11ee-b647-cb9ed24678a4/cephadm.a8f553f8c0a1bbbd91f4e60c8e13381b6fabffa3561f875fe77bb96af479b3ca/__main__.py", line 5528, in 2024-03-30T13:58:26.341 INFO:journalctl@ceph.mon.a.smithi099.stdout: File "/var/lib/ceph/98ebaeb8-ee99-11ee-b647-cb9ed24678a4/cephadm.a8f553f8c0a1bbbd91f4e60c8e13381b6fabffa3561f875fe77bb96af479b3ca/__main__.py", line 5516, in main 2024-03-30T13:58:26.341 INFO:journalctl@ceph.mon.a.smithi099.stdout: File "/var/lib/ceph/98ebaeb8-ee99-11ee-b647-cb9ed24678a4/cephadm.a8f553f8c0a1bbbd91f4e60c8e13381b6fabffa3561f875fe77bb96af479b3ca/__main__.py", line 3040, in command_deploy_from 2024-03-30T13:58:26.342 INFO:journalctl@ceph.mon.a.smithi099.stdout: File "/var/lib/ceph/98ebaeb8-ee99-11ee-b647-cb9ed24678a4/cephadm.a8f553f8c0a1bbbd91f4e60c8e13381b6fabffa3561f875fe77bb96af479b3ca/__main__.py", line 3075, in _common_deploy 2024-03-30T13:58:26.342 INFO:journalctl@ceph.mon.a.smithi099.stdout: File "/var/lib/ceph/98ebaeb8-ee99-11ee-b647-cb9ed24678a4/cephadm.a8f553f8c0a1bbbd91f4e60c8e13381b6fabffa3561f875fe77bb96af479b3ca/__main__.py", line 3095, in _deploy_daemon_container 2024-03-30T13:58:26.342 INFO:journalctl@ceph.mon.a.smithi099.stdout: File "/var/lib/ceph/98ebaeb8-ee99-11ee-b647-cb9ed24678a4/cephadm.a8f553f8c0a1bbbd91f4e60c8e13381b6fabffa3561f875fe77bb96af479b3ca/__main__.py", line 1067, in deploy_daemon 2024-03-30T13:58:26.342 INFO:journalctl@ceph.mon.a.smithi099.stdout: File "/var/lib/ceph/98ebaeb8-ee99-11ee-b647-cb9ed24678a4/cephadm.a8f553f8c0a1bbbd91f4e60c8e13381b6fabffa3561f875fe77bb96af479b3ca/cephadmlib/call_wrappers.py", line 307, in call_throws 2024-03-30T13:58:26.342 INFO:journalctl@ceph.mon.a.smithi099.stdout: RuntimeError: Failed command: systemctl restart ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4@iscsi.foo.smithi099.qyjuvr: Job for ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4@iscsi.foo.smithi099.qyjuvr.service failed because the control process exited with error code. 2024-03-30T13:58:26.342 INFO:journalctl@ceph.mon.a.smithi099.stdout: See "systemctl status ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4@iscsi.foo.smithi099.qyjuvr.service" and "journalctl -xeu ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4@iscsi.foo.smithi099.qyjuvr.service" for details. 2024-03-30T13:58:26.342 INFO:journalctl@ceph.mon.a.smithi099.stdout: Traceback (most recent call last): 2024-03-30T13:58:26.342 INFO:journalctl@ceph.mon.a.smithi099.stdout: File "/usr/share/ceph/mgr/cephadm/serve.py", line 1114, in _check_daemons 2024-03-30T13:58:26.342 INFO:journalctl@ceph.mon.a.smithi099.stdout: self.mgr._daemon_action(daemon_spec, action=action) 2024-03-30T13:58:26.343 INFO:journalctl@ceph.mon.a.smithi099.stdout: File "/usr/share/ceph/mgr/cephadm/module.py", line 2390, in _daemon_action 2024-03-30T13:58:26.343 INFO:journalctl@ceph.mon.a.smithi099.stdout: CephadmServe(self)._create_daemon(daemon_spec, reconfig=(action == 'reconfig'))) 2024-03-30T13:58:26.343 INFO:journalctl@ceph.mon.a.smithi099.stdout: File "/usr/share/ceph/mgr/cephadm/module.py", line 747, in wait_async 2024-03-30T13:58:26.343 INFO:journalctl@ceph.mon.a.smithi099.stdout: return self.event_loop.get_result(coro, timeout) 2024-03-30T13:58:26.343 INFO:journalctl@ceph.mon.a.smithi099.stdout: File "/usr/share/ceph/mgr/cephadm/ssh.py", line 136, in get_result 2024-03-30T13:58:26.343 INFO:journalctl@ceph.mon.a.smithi099.stdout: return future.result(timeout) 2024-03-30T13:58:26.343 INFO:journalctl@ceph.mon.a.smithi099.stdout: File "/lib64/python3.6/concurrent/futures/_base.py", line 432, in result 2024-03-30T13:58:26.344 INFO:journalctl@ceph.mon.a.smithi099.stdout: return self.__get_result() 2024-03-30T13:58:26.344 INFO:journalctl@ceph.mon.a.smithi099.stdout: File "/lib64/python3.6/concurrent/futures/_base.py", line 384, in __get_result 2024-03-30T13:58:26.344 INFO:journalctl@ceph.mon.a.smithi099.stdout: raise self._exception 2024-03-30T13:58:26.344 INFO:journalctl@ceph.mon.a.smithi099.stdout: File "/usr/share/ceph/mgr/cephadm/serve.py", line 1374, in _create_daemon 2024-03-30T13:58:26.344 INFO:journalctl@ceph.mon.a.smithi099.stdout: config_blobs=daemon_spec.final_config, 2024-03-30T13:58:26.344 INFO:journalctl@ceph.mon.a.smithi099.stdout: File "/usr/share/ceph/mgr/cephadm/serve.py", line 1685, in _run_cephadm 2024-03-30T13:58:26.345 INFO:journalctl@ceph.mon.a.smithi099.stdout: f'cephadm exited with an error code: {code}, stderr: {err}') 2024-03-30T13:58:26.345 INFO:journalctl@ceph.mon.a.smithi099.stdout: orchestrator._interface.OrchestratorError: cephadm exited with an error code: 1, stderr: Reconfig daemon iscsi.foo.smithi099.qyjuvr ... 2024-03-30T13:58:26.345 INFO:journalctl@ceph.mon.a.smithi099.stdout: Creating ceph-iscsi config... 2024-03-30T13:58:26.345 INFO:journalctl@ceph.mon.a.smithi099.stdout: Write file: /var/lib/ceph/98ebaeb8-ee99-11ee-b647-cb9ed24678a4/iscsi.foo.smithi099.qyjuvr/iscsi-gateway.cfg 2024-03-30T13:58:26.345 INFO:journalctl@ceph.mon.a.smithi099.stdout: Write file: /var/lib/ceph/98ebaeb8-ee99-11ee-b647-cb9ed24678a4/iscsi.foo.smithi099.qyjuvr/tcmu-runner-entrypoint.sh 2024-03-30T13:58:26.345 INFO:journalctl@ceph.mon.a.smithi099.stdout: Non-zero exit code 1 from systemctl restart ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4@iscsi.foo.smithi099.qyjuvr 2024-03-30T13:58:26.346 INFO:journalctl@ceph.mon.a.smithi099.stdout: systemctl: stderr Job for ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4@iscsi.foo.smithi099.qyjuvr.service failed because the control process exited with error code. 2024-03-30T13:58:26.346 INFO:journalctl@ceph.mon.a.smithi099.stdout: systemctl: stderr See "systemctl status ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4@iscsi.foo.smithi099.qyjuvr.service" and "journalctl -xeu ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4@iscsi.foo.smithi099.qyjuvr.service" for details. 2024-03-30T13:58:26.346 INFO:journalctl@ceph.mon.a.smithi099.stdout: Traceback (most recent call last): 2024-03-30T13:58:26.346 INFO:journalctl@ceph.mon.a.smithi099.stdout: File "/usr/lib64/python3.9/runpy.py", line 197, in _run_module_as_main 2024-03-30T13:58:26.346 INFO:journalctl@ceph.mon.a.smithi099.stdout: return _run_code(code, main_globals, None, 2024-03-30T13:58:26.346 INFO:journalctl@ceph.mon.a.smithi099.stdout: File "/usr/lib64/python3.9/runpy.py", line 87, in _run_code 2024-03-30T13:58:26.347 INFO:journalctl@ceph.mon.a.smithi099.stdout: exec(code, run_globals) 2024-03-30T13:58:26.347 INFO:journalctl@ceph.mon.a.smithi099.stdout: File "/var/lib/ceph/98ebaeb8-ee99-11ee-b647-cb9ed24678a4/cephadm.a8f553f8c0a1bbbd91f4e60c8e13381b6fabffa3561f875fe77bb96af479b3ca/__main__.py", line 5528, in 2024-03-30T13:58:26.347 INFO:journalctl@ceph.mon.a.smithi099.stdout: File "/var/lib/ceph/98ebaeb8-ee99-11ee-b647-cb9ed24678a4/cephadm.a8f553f8c0a1bbbd91f4e60c8e13381b6fabffa3561f875fe77bb96af479b3ca/__main__.py", line 5516, in main 2024-03-30T13:58:26.347 INFO:journalctl@ceph.mon.a.smithi099.stdout: File "/var/lib/ceph/98ebaeb8-ee99-11ee-b647-cb9ed24678a4/cephadm.a8f553f8c0a1bbbd91f4e60c8e13381b6fabffa3561f875fe77bb96af479b3ca/__main__.py", line 3040, in command_deploy_from 2024-03-30T13:58:26.347 INFO:journalctl@ceph.mon.a.smithi099.stdout: File "/var/lib/ceph/98ebaeb8-ee99-11ee-b647-cb9ed24678a4/cephadm.a8f553f8c0a1bbbd91f4e60c8e13381b6fabffa3561f875fe77bb96af479b3ca/__main__.py", line 3075, in _common_deploy 2024-03-30T13:58:26.348 INFO:journalctl@ceph.mon.a.smithi099.stdout: File "/var/lib/ceph/98ebaeb8-ee99-11ee-b647-cb9ed24678a4/cephadm.a8f553f8c0a1bbbd91f4e60c8e13381b6fabffa3561f875fe77bb96af479b3ca/__main__.py", line 3095, in _deploy_daemon_container 2024-03-30T13:58:26.348 INFO:journalctl@ceph.mon.a.smithi099.stdout: File "/var/lib/ceph/98ebaeb8-ee99-11ee-b647-cb9ed24678a4/cephadm.a8f553f8c0a1bbbd91f4e60c8e13381b6fabffa3561f875fe77bb96af479b3ca/__main__.py", line 1067, in deploy_daemon 2024-03-30T13:58:26.348 INFO:journalctl@ceph.mon.a.smithi099.stdout: File "/var/lib/ceph/98ebaeb8-ee99-11ee-b647-cb9ed24678a4/cephadm.a8f553f8c0a1bbbd91f4e60c8e13381b6fabffa3561f875fe77bb96af479b3ca/cephadmlib/call_wrappers.py", line 307, in call_throws 2024-03-30T13:58:26.348 INFO:journalctl@ceph.mon.a.smithi099.stdout: RuntimeError: Failed command: systemctl restart ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4@iscsi.foo.smithi099.qyjuvr: Job for ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4@iscsi.foo.smithi099.qyjuvr.service failed because the control process exited with error code. 2024-03-30T13:58:26.348 INFO:journalctl@ceph.mon.a.smithi099.stdout: See "systemctl status ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4@iscsi.foo.smithi099.qyjuvr.service" and "journalctl -xeu ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4@iscsi.foo.smithi099.qyjuvr.service" for details. 2024-03-30T13:58:26.348 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:25 smithi099 ceph-mon[24912]: Reconfiguring prometheus.a (dependencies changed)... 2024-03-30T13:58:26.349 INFO:journalctl@ceph.mon.c.smithi099.stdout: File "/var/lib/ceph/98ebaeb8-ee99-11ee-b647-cb9ed24678a4/cephadm.a8f553f8c0a1bbbd91f4e60c8e13381b6fabffa3561f875fe77bb96af479b3ca/__main__.py", line 3095, in _deploy_daemon_container 2024-03-30T13:58:26.349 INFO:journalctl@ceph.mon.c.smithi099.stdout: File "/var/lib/ceph/98ebaeb8-ee99-11ee-b647-cb9ed24678a4/cephadm.a8f553f8c0a1bbbd91f4e60c8e13381b6fabffa3561f875fe77bb96af479b3ca/__main__.py", line 1067, in deploy_daemon 2024-03-30T13:58:26.349 INFO:journalctl@ceph.mon.c.smithi099.stdout: File "/var/lib/ceph/98ebaeb8-ee99-11ee-b647-cb9ed24678a4/cephadm.a8f553f8c0a1bbbd91f4e60c8e13381b6fabffa3561f875fe77bb96af479b3ca/cephadmlib/call_wrappers.py", line 307, in call_throws 2024-03-30T13:58:26.349 INFO:journalctl@ceph.mon.c.smithi099.stdout: RuntimeError: Failed command: systemctl restart ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4@iscsi.foo.smithi099.qyjuvr: Job for ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4@iscsi.foo.smithi099.qyjuvr.service failed because the control process exited with error code. 2024-03-30T13:58:26.349 INFO:journalctl@ceph.mon.c.smithi099.stdout: See "systemctl status ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4@iscsi.foo.smithi099.qyjuvr.service" and "journalctl -xeu ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4@iscsi.foo.smithi099.qyjuvr.service" for details. 2024-03-30T13:58:26.350 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:25 smithi099 ceph-mon[29691]: Reconfiguring prometheus.a (dependencies changed)... 2024-03-30T13:58:27.117 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:26 smithi181 ceph-mon[25762]: pgmap v16: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 41 KiB/s rd, 0 B/s wr, 23 op/s 2024-03-30T13:58:27.117 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:26 smithi181 ceph-mon[25762]: Reconfiguring daemon prometheus.a on smithi181 2024-03-30T13:58:27.117 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:26 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:58:27.117 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:26 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:58:27.117 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:26 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:58:27.331 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:26 smithi099 ceph-mon[24912]: pgmap v16: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 41 KiB/s rd, 0 B/s wr, 23 op/s 2024-03-30T13:58:27.331 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:26 smithi099 ceph-mon[24912]: Reconfiguring daemon prometheus.a on smithi181 2024-03-30T13:58:27.332 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:26 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:58:27.332 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:26 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:58:27.332 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:26 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:58:27.332 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:26 smithi099 ceph-mon[29691]: pgmap v16: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 41 KiB/s rd, 0 B/s wr, 23 op/s 2024-03-30T13:58:27.332 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:26 smithi099 ceph-mon[29691]: Reconfiguring daemon prometheus.a on smithi181 2024-03-30T13:58:27.332 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:26 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:58:27.332 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:26 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:58:27.332 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:26 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:58:27.750 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 13:58:27 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-x[50211]: ::ffff:172.21.15.181 - - [30/Mar/2024:13:58:27] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-03-30T13:58:28.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:27 smithi181 ceph-mon[25762]: pgmap v17: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 31 KiB/s rd, 0 B/s wr, 18 op/s 2024-03-30T13:58:28.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:27 smithi181 ceph-mon[25762]: pgmap v18: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 38 KiB/s rd, 0 B/s wr, 21 op/s 2024-03-30T13:58:28.331 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:27 smithi099 ceph-mon[24912]: pgmap v17: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 31 KiB/s rd, 0 B/s wr, 18 op/s 2024-03-30T13:58:28.331 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:27 smithi099 ceph-mon[24912]: pgmap v18: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 38 KiB/s rd, 0 B/s wr, 21 op/s 2024-03-30T13:58:28.331 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:27 smithi099 ceph-mon[29691]: pgmap v17: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 31 KiB/s rd, 0 B/s wr, 18 op/s 2024-03-30T13:58:28.331 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:27 smithi099 ceph-mon[29691]: pgmap v18: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 38 KiB/s rd, 0 B/s wr, 21 op/s 2024-03-30T13:58:28.686 INFO:journalctl@ceph.prometheus.a.smithi181.stdout:Mar 30 13:58:28 smithi181 systemd[1]: Stopping Ceph prometheus.a for 98ebaeb8-ee99-11ee-b647-cb9ed24678a4... 2024-03-30T13:58:28.686 INFO:journalctl@ceph.prometheus.a.smithi181.stdout:Mar 30 13:58:28 smithi181 bash[72492]: Error: no container with name or ID "ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-prometheus.a" found: no such container 2024-03-30T13:58:28.945 INFO:journalctl@ceph.prometheus.a.smithi181.stdout:Mar 30 13:58:28 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-prometheus-a[68188]: ts=2024-03-30T13:58:28.691Z caller=main.go:775 level=warn msg="Received SIGTERM, exiting gracefully..." 2024-03-30T13:58:28.962 INFO:journalctl@ceph.prometheus.a.smithi181.stdout:Mar 30 13:58:28 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-prometheus-a[68188]: ts=2024-03-30T13:58:28.691Z caller=main.go:798 level=info msg="Stopping scrape discovery manager..." 2024-03-30T13:58:28.962 INFO:journalctl@ceph.prometheus.a.smithi181.stdout:Mar 30 13:58:28 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-prometheus-a[68188]: ts=2024-03-30T13:58:28.691Z caller=main.go:812 level=info msg="Stopping notify discovery manager..." 2024-03-30T13:58:28.962 INFO:journalctl@ceph.prometheus.a.smithi181.stdout:Mar 30 13:58:28 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-prometheus-a[68188]: ts=2024-03-30T13:58:28.691Z caller=main.go:834 level=info msg="Stopping scrape manager..." 2024-03-30T13:58:28.962 INFO:journalctl@ceph.prometheus.a.smithi181.stdout:Mar 30 13:58:28 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-prometheus-a[68188]: ts=2024-03-30T13:58:28.691Z caller=main.go:794 level=info msg="Scrape discovery manager stopped" 2024-03-30T13:58:28.963 INFO:journalctl@ceph.prometheus.a.smithi181.stdout:Mar 30 13:58:28 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-prometheus-a[68188]: ts=2024-03-30T13:58:28.691Z caller=main.go:808 level=info msg="Notify discovery manager stopped" 2024-03-30T13:58:28.963 INFO:journalctl@ceph.prometheus.a.smithi181.stdout:Mar 30 13:58:28 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-prometheus-a[68188]: ts=2024-03-30T13:58:28.691Z caller=manager.go:945 level=info component="rule manager" msg="Stopping rule manager..." 2024-03-30T13:58:28.963 INFO:journalctl@ceph.prometheus.a.smithi181.stdout:Mar 30 13:58:28 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-prometheus-a[68188]: ts=2024-03-30T13:58:28.691Z caller=manager.go:955 level=info component="rule manager" msg="Rule manager stopped" 2024-03-30T13:58:28.963 INFO:journalctl@ceph.prometheus.a.smithi181.stdout:Mar 30 13:58:28 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-prometheus-a[68188]: ts=2024-03-30T13:58:28.691Z caller=main.go:828 level=info msg="Scrape manager stopped" 2024-03-30T13:58:28.963 INFO:journalctl@ceph.prometheus.a.smithi181.stdout:Mar 30 13:58:28 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-prometheus-a[68188]: ts=2024-03-30T13:58:28.691Z caller=notifier.go:600 level=info component=notifier msg="Stopping notification manager..." 2024-03-30T13:58:28.963 INFO:journalctl@ceph.prometheus.a.smithi181.stdout:Mar 30 13:58:28 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-prometheus-a[68188]: ts=2024-03-30T13:58:28.691Z caller=main.go:1054 level=info msg="Notifier manager stopped" 2024-03-30T13:58:28.963 INFO:journalctl@ceph.prometheus.a.smithi181.stdout:Mar 30 13:58:28 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-prometheus-a[68188]: ts=2024-03-30T13:58:28.691Z caller=main.go:1066 level=info msg="See you next time!" 2024-03-30T13:58:28.963 INFO:journalctl@ceph.prometheus.a.smithi181.stdout:Mar 30 13:58:28 smithi181 podman[72505]: 2024-03-30 13:58:28.70142006 +0000 UTC m=+0.134841017 container died 54e4324e49e367fdc711d55def7aa13f625b776cccad29ec8f161f19a9f90f4f (image=quay.io/prometheus/prometheus:v2.33.4, name=ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-prometheus-a, maintainer=The Prometheus Authors ) 2024-03-30T13:58:29.234 INFO:journalctl@ceph.prometheus.a.smithi181.stdout:Mar 30 13:58:29 smithi181 podman[72505]: 2024-03-30 13:58:29.057274541 +0000 UTC m=+0.490695495 container cleanup 54e4324e49e367fdc711d55def7aa13f625b776cccad29ec8f161f19a9f90f4f (image=quay.io/prometheus/prometheus:v2.33.4, name=ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-prometheus-a, maintainer=The Prometheus Authors ) 2024-03-30T13:58:29.234 INFO:journalctl@ceph.prometheus.a.smithi181.stdout:Mar 30 13:58:29 smithi181 bash[72505]: ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-prometheus-a 2024-03-30T13:58:29.234 INFO:journalctl@ceph.prometheus.a.smithi181.stdout:Mar 30 13:58:29 smithi181 bash[72531]: Error: no container with name or ID "ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-prometheus.a" found: no such container 2024-03-30T13:58:29.500 INFO:journalctl@ceph.prometheus.a.smithi181.stdout:Mar 30 13:58:29 smithi181 podman[72519]: 2024-03-30 13:58:29.359057701 +0000 UTC m=+0.660065874 container remove 54e4324e49e367fdc711d55def7aa13f625b776cccad29ec8f161f19a9f90f4f (image=quay.io/prometheus/prometheus:v2.33.4, name=ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-prometheus-a, maintainer=The Prometheus Authors ) 2024-03-30T13:58:29.501 INFO:journalctl@ceph.prometheus.a.smithi181.stdout:Mar 30 13:58:29 smithi181 systemd[1]: ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4@prometheus.a.service: Deactivated successfully. 2024-03-30T13:58:29.501 INFO:journalctl@ceph.prometheus.a.smithi181.stdout:Mar 30 13:58:29 smithi181 systemd[1]: Stopped Ceph prometheus.a for 98ebaeb8-ee99-11ee-b647-cb9ed24678a4. 2024-03-30T13:58:29.501 INFO:journalctl@ceph.prometheus.a.smithi181.stdout:Mar 30 13:58:29 smithi181 systemd[1]: ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4@prometheus.a.service: Consumed 1.304s CPU time. 2024-03-30T13:58:29.501 INFO:journalctl@ceph.prometheus.a.smithi181.stdout:Mar 30 13:58:29 smithi181 systemd[1]: Starting Ceph prometheus.a for 98ebaeb8-ee99-11ee-b647-cb9ed24678a4... 2024-03-30T13:58:29.832 INFO:journalctl@ceph.prometheus.a.smithi181.stdout:Mar 30 13:58:29 smithi181 podman[72603]: 2024-03-30 13:58:29.488791748 +0000 UTC m=+0.018903966 image pull 514e6a882f6e74806a5856468489eeff8d7106095557578da96935e4d0ba4d9d quay.io/prometheus/prometheus:v2.33.4 2024-03-30T13:58:29.832 INFO:journalctl@ceph.prometheus.a.smithi181.stdout:Mar 30 13:58:29 smithi181 podman[72603]: 2024-03-30 13:58:29.610141491 +0000 UTC m=+0.140253705 container create 6b662de21f27db22102abcccd995bc155eb52b3e58b1195c49737bd73b277519 (image=quay.io/prometheus/prometheus:v2.33.4, name=ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-prometheus-a, maintainer=The Prometheus Authors ) 2024-03-30T13:58:29.832 INFO:journalctl@ceph.prometheus.a.smithi181.stdout:Mar 30 13:58:29 smithi181 podman[72603]: 2024-03-30 13:58:29.837245999 +0000 UTC m=+0.367358227 container init 6b662de21f27db22102abcccd995bc155eb52b3e58b1195c49737bd73b277519 (image=quay.io/prometheus/prometheus:v2.33.4, name=ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-prometheus-a, maintainer=The Prometheus Authors ) 2024-03-30T13:58:30.228 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:29 smithi181 ceph-mon[25762]: pgmap v19: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 28 KiB/s rd, 0 B/s wr, 16 op/s 2024-03-30T13:58:30.228 INFO:journalctl@ceph.prometheus.a.smithi181.stdout:Mar 30 13:58:29 smithi181 podman[72603]: 2024-03-30 13:58:29.840015211 +0000 UTC m=+0.370127426 container start 6b662de21f27db22102abcccd995bc155eb52b3e58b1195c49737bd73b277519 (image=quay.io/prometheus/prometheus:v2.33.4, name=ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-prometheus-a, maintainer=The Prometheus Authors ) 2024-03-30T13:58:30.228 INFO:journalctl@ceph.prometheus.a.smithi181.stdout:Mar 30 13:58:29 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-prometheus-a[72618]: ts=2024-03-30T13:58:29.863Z caller=main.go:475 level=info msg="No time or size retention was set so using the default time retention" duration=15d 2024-03-30T13:58:30.228 INFO:journalctl@ceph.prometheus.a.smithi181.stdout:Mar 30 13:58:29 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-prometheus-a[72618]: ts=2024-03-30T13:58:29.863Z caller=main.go:512 level=info msg="Starting Prometheus" version="(version=2.33.4, branch=HEAD, revision=83032011a5d3e6102624fe58241a374a7201fee8)" 2024-03-30T13:58:30.228 INFO:journalctl@ceph.prometheus.a.smithi181.stdout:Mar 30 13:58:29 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-prometheus-a[72618]: ts=2024-03-30T13:58:29.863Z caller=main.go:517 level=info build_context="(go=go1.17.7, user=root@d13bf69e7be8, date=20220222-16:51:28)" 2024-03-30T13:58:30.228 INFO:journalctl@ceph.prometheus.a.smithi181.stdout:Mar 30 13:58:29 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-prometheus-a[72618]: ts=2024-03-30T13:58:29.863Z caller=main.go:518 level=info host_details="(Linux 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 x86_64 smithi181 (none))" 2024-03-30T13:58:30.228 INFO:journalctl@ceph.prometheus.a.smithi181.stdout:Mar 30 13:58:29 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-prometheus-a[72618]: ts=2024-03-30T13:58:29.863Z caller=main.go:519 level=info fd_limits="(soft=1048576, hard=1048576)" 2024-03-30T13:58:30.228 INFO:journalctl@ceph.prometheus.a.smithi181.stdout:Mar 30 13:58:29 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-prometheus-a[72618]: ts=2024-03-30T13:58:29.863Z caller=main.go:520 level=info vm_limits="(soft=unlimited, hard=unlimited)" 2024-03-30T13:58:30.228 INFO:journalctl@ceph.prometheus.a.smithi181.stdout:Mar 30 13:58:29 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-prometheus-a[72618]: ts=2024-03-30T13:58:29.864Z caller=web.go:570 level=info component=web msg="Start listening for connections" address=:9095 2024-03-30T13:58:30.229 INFO:journalctl@ceph.prometheus.a.smithi181.stdout:Mar 30 13:58:29 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-prometheus-a[72618]: ts=2024-03-30T13:58:29.865Z caller=main.go:923 level=info msg="Starting TSDB ..." 2024-03-30T13:58:30.229 INFO:journalctl@ceph.prometheus.a.smithi181.stdout:Mar 30 13:58:29 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-prometheus-a[72618]: ts=2024-03-30T13:58:29.866Z caller=tls_config.go:195 level=info component=web msg="TLS is disabled." http2=false 2024-03-30T13:58:30.229 INFO:journalctl@ceph.prometheus.a.smithi181.stdout:Mar 30 13:58:29 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-prometheus-a[72618]: ts=2024-03-30T13:58:29.869Z caller=head.go:493 level=info component=tsdb msg="Replaying on-disk memory mappable chunks if any" 2024-03-30T13:58:30.229 INFO:journalctl@ceph.prometheus.a.smithi181.stdout:Mar 30 13:58:29 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-prometheus-a[72618]: ts=2024-03-30T13:58:29.869Z caller=head.go:527 level=info component=tsdb msg="On-disk memory mappable chunks replay completed" duration=1.726µs 2024-03-30T13:58:30.229 INFO:journalctl@ceph.prometheus.a.smithi181.stdout:Mar 30 13:58:29 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-prometheus-a[72618]: ts=2024-03-30T13:58:29.869Z caller=head.go:533 level=info component=tsdb msg="Replaying WAL, this may take a while" 2024-03-30T13:58:30.229 INFO:journalctl@ceph.prometheus.a.smithi181.stdout:Mar 30 13:58:29 smithi181 bash[72603]: 6b662de21f27db22102abcccd995bc155eb52b3e58b1195c49737bd73b277519 2024-03-30T13:58:30.229 INFO:journalctl@ceph.prometheus.a.smithi181.stdout:Mar 30 13:58:29 smithi181 systemd[1]: Started Ceph prometheus.a for 98ebaeb8-ee99-11ee-b647-cb9ed24678a4. 2024-03-30T13:58:30.229 INFO:journalctl@ceph.prometheus.a.smithi181.stdout:Mar 30 13:58:30 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-prometheus-a[72618]: ts=2024-03-30T13:58:30.080Z caller=head.go:604 level=info component=tsdb msg="WAL segment loaded" segment=0 maxSegment=6 2024-03-30T13:58:30.229 INFO:journalctl@ceph.prometheus.a.smithi181.stdout:Mar 30 13:58:30 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-prometheus-a[72618]: ts=2024-03-30T13:58:30.232Z caller=head.go:604 level=info component=tsdb msg="WAL segment loaded" segment=1 maxSegment=6 2024-03-30T13:58:30.331 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:29 smithi099 ceph-mon[24912]: pgmap v19: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 28 KiB/s rd, 0 B/s wr, 16 op/s 2024-03-30T13:58:30.331 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:29 smithi099 ceph-mon[29691]: pgmap v19: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 28 KiB/s rd, 0 B/s wr, 16 op/s 2024-03-30T13:58:30.500 INFO:journalctl@ceph.prometheus.a.smithi181.stdout:Mar 30 13:58:30 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-prometheus-a[72618]: ts=2024-03-30T13:58:30.305Z caller=head.go:604 level=info component=tsdb msg="WAL segment loaded" segment=2 maxSegment=6 2024-03-30T13:58:30.500 INFO:journalctl@ceph.prometheus.a.smithi181.stdout:Mar 30 13:58:30 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-prometheus-a[72618]: ts=2024-03-30T13:58:30.359Z caller=head.go:604 level=info component=tsdb msg="WAL segment loaded" segment=3 maxSegment=6 2024-03-30T13:58:30.501 INFO:journalctl@ceph.prometheus.a.smithi181.stdout:Mar 30 13:58:30 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-prometheus-a[72618]: ts=2024-03-30T13:58:30.410Z caller=head.go:604 level=info component=tsdb msg="WAL segment loaded" segment=4 maxSegment=6 2024-03-30T13:58:30.501 INFO:journalctl@ceph.prometheus.a.smithi181.stdout:Mar 30 13:58:30 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-prometheus-a[72618]: ts=2024-03-30T13:58:30.413Z caller=head.go:604 level=info component=tsdb msg="WAL segment loaded" segment=5 maxSegment=6 2024-03-30T13:58:30.501 INFO:journalctl@ceph.prometheus.a.smithi181.stdout:Mar 30 13:58:30 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-prometheus-a[72618]: ts=2024-03-30T13:58:30.413Z caller=head.go:604 level=info component=tsdb msg="WAL segment loaded" segment=6 maxSegment=6 2024-03-30T13:58:30.501 INFO:journalctl@ceph.prometheus.a.smithi181.stdout:Mar 30 13:58:30 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-prometheus-a[72618]: ts=2024-03-30T13:58:30.413Z caller=head.go:610 level=info component=tsdb msg="WAL replay completed" checkpoint_replay_duration=45.664µs wal_replay_duration=544.652857ms total_replay_duration=544.712049ms 2024-03-30T13:58:30.501 INFO:journalctl@ceph.prometheus.a.smithi181.stdout:Mar 30 13:58:30 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-prometheus-a[72618]: ts=2024-03-30T13:58:30.417Z caller=main.go:944 level=info fs_type=XFS_SUPER_MAGIC 2024-03-30T13:58:30.501 INFO:journalctl@ceph.prometheus.a.smithi181.stdout:Mar 30 13:58:30 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-prometheus-a[72618]: ts=2024-03-30T13:58:30.417Z caller=main.go:947 level=info msg="TSDB started" 2024-03-30T13:58:30.501 INFO:journalctl@ceph.prometheus.a.smithi181.stdout:Mar 30 13:58:30 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-prometheus-a[72618]: ts=2024-03-30T13:58:30.417Z caller=main.go:1128 level=info msg="Loading configuration file" filename=/etc/prometheus/prometheus.yml 2024-03-30T13:58:30.501 INFO:journalctl@ceph.prometheus.a.smithi181.stdout:Mar 30 13:58:30 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-prometheus-a[72618]: ts=2024-03-30T13:58:30.433Z caller=main.go:1165 level=info msg="Completed loading of configuration file" filename=/etc/prometheus/prometheus.yml totalDuration=16.619997ms db_storage=1.02µs remote_storage=1.618µs web_handler=375ns query_engine=865ns scrape=426.269µs scrape_sd=88.919µs notify=11.599µs notify_sd=19.443µs rules=15.83646ms 2024-03-30T13:58:30.501 INFO:journalctl@ceph.prometheus.a.smithi181.stdout:Mar 30 13:58:30 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-prometheus-a[72618]: ts=2024-03-30T13:58:30.434Z caller=main.go:896 level=info msg="Server is ready to receive web requests." 2024-03-30T13:58:31.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:30 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:58:31.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:30 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:58:31.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:30 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-03-30T13:58:31.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:30 smithi181 ceph-mon[25762]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-03-30T13:58:31.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:30 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:58:31.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:30 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T13:58:31.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:30 smithi181 ceph-mon[25762]: pgmap v20: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 399 B/s rd, 0 op/s 2024-03-30T13:58:31.331 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:30 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:58:31.331 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:30 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:58:31.331 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:30 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-03-30T13:58:31.332 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:30 smithi099 ceph-mon[24912]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-03-30T13:58:31.332 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:30 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:58:31.332 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:30 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T13:58:31.332 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:30 smithi099 ceph-mon[24912]: pgmap v20: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 399 B/s rd, 0 op/s 2024-03-30T13:58:31.332 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:30 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:58:31.332 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:30 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:58:31.332 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:30 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-03-30T13:58:31.332 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:30 smithi099 ceph-mon[29691]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-03-30T13:58:31.332 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:30 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:58:31.332 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:30 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T13:58:31.332 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:30 smithi099 ceph-mon[29691]: pgmap v20: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 399 B/s rd, 0 op/s 2024-03-30T13:58:32.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:31 smithi181 ceph-mon[25762]: Upgrade: Updating mgr.x 2024-03-30T13:58:32.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:31 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-03-30T13:58:32.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:31 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-03-30T13:58:32.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:31 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "mgr services"}]: dispatch 2024-03-30T13:58:32.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:31 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:58:32.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:31 smithi181 ceph-mon[25762]: Deploying daemon mgr.x on smithi181 2024-03-30T13:58:32.331 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:31 smithi099 ceph-mon[29691]: Upgrade: Updating mgr.x 2024-03-30T13:58:32.331 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:31 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-03-30T13:58:32.331 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:31 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-03-30T13:58:32.332 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:31 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "mgr services"}]: dispatch 2024-03-30T13:58:32.332 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:31 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:58:32.332 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:31 smithi099 ceph-mon[29691]: Deploying daemon mgr.x on smithi181 2024-03-30T13:58:32.332 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:31 smithi099 ceph-mon[24912]: Upgrade: Updating mgr.x 2024-03-30T13:58:32.332 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:31 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-03-30T13:58:32.332 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:31 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-03-30T13:58:32.332 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:31 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "mgr services"}]: dispatch 2024-03-30T13:58:32.332 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:31 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:58:32.332 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:31 smithi099 ceph-mon[24912]: Deploying daemon mgr.x on smithi181 2024-03-30T13:58:33.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:32 smithi181 ceph-mon[25762]: pgmap v21: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 316 B/s rd, 0 op/s 2024-03-30T13:58:33.331 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:32 smithi099 ceph-mon[24912]: pgmap v21: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 316 B/s rd, 0 op/s 2024-03-30T13:58:33.331 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:32 smithi099 ceph-mon[29691]: pgmap v21: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 316 B/s rd, 0 op/s 2024-03-30T13:58:33.753 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 13:58:33 smithi181 systemd[1]: Stopping Ceph mgr.x for 98ebaeb8-ee99-11ee-b647-cb9ed24678a4... 2024-03-30T13:58:34.044 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 13:58:33 smithi181 podman[72947]: 2024-03-30 13:58:33.76170058 +0000 UTC m=+0.158738868 container died f3d971ab3b104661aa80c18cc9630ec1442c388f9776aa016a0530e8746eb85c (image=quay.ceph.io/ceph-ci/ceph:4e50bbcdd1630c7760b708f3a5b4d38a121e66cb, name=ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-x, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, org.label-schema.build-date=20240326, RELEASE=squid-4e50bbc, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0) 2024-03-30T13:58:34.419 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 13:58:34 smithi181 podman[72947]: 2024-03-30 13:58:34.114418545 +0000 UTC m=+0.511456830 container cleanup f3d971ab3b104661aa80c18cc9630ec1442c388f9776aa016a0530e8746eb85c (image=quay.ceph.io/ceph-ci/ceph:4e50bbcdd1630c7760b708f3a5b4d38a121e66cb, name=ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-x, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, org.label-schema.build-date=20240326, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-4e50bbc, ceph=True) 2024-03-30T13:58:34.419 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 13:58:34 smithi181 bash[72947]: ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-x 2024-03-30T13:58:34.688 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 13:58:34 smithi181 podman[72961]: 2024-03-30 13:58:34.423873875 +0000 UTC m=+0.662038259 container remove f3d971ab3b104661aa80c18cc9630ec1442c388f9776aa016a0530e8746eb85c (image=quay.ceph.io/ceph-ci/ceph:4e50bbcdd1630c7760b708f3a5b4d38a121e66cb, name=ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-x, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, RELEASE=squid-4e50bbc, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.build-date=20240326, org.label-schema.license=GPLv2, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD) 2024-03-30T13:58:34.688 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 13:58:34 smithi181 systemd[1]: ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4@mgr.x.service: Main process exited, code=exited, status=143/n/a 2024-03-30T13:58:34.688 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 13:58:34 smithi181 systemd[1]: ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4@mgr.x.service: Failed with result 'exit-code'. 2024-03-30T13:58:34.688 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 13:58:34 smithi181 systemd[1]: Stopped Ceph mgr.x for 98ebaeb8-ee99-11ee-b647-cb9ed24678a4. 2024-03-30T13:58:34.688 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 13:58:34 smithi181 systemd[1]: ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4@mgr.x.service: Consumed 1min 4.854s CPU time. 2024-03-30T13:58:34.994 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 13:58:34 smithi181 systemd[1]: Starting Ceph mgr.x for 98ebaeb8-ee99-11ee-b647-cb9ed24678a4... 2024-03-30T13:58:35.250 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 13:58:34 smithi181 podman[73090]: 2024-03-30 13:58:34.902704423 +0000 UTC m=+0.018061336 image pull b0c4478f1d83795df4d538bf108aee5fac57194348fb16dcdbb3115f3e2fe95e quay.ceph.io/ceph-ci/ceph:4e50bbcdd1630c7760b708f3a5b4d38a121e66cb 2024-03-30T13:58:35.250 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 13:58:35 smithi181 podman[73090]: 2024-03-30 13:58:35.050646171 +0000 UTC m=+0.166003071 container create 70a65dda3ab06422340c89bc98bc552444e147f0c88a0c2948bb40280909be40 (image=quay.ceph.io/ceph-ci/ceph:4e50bbcdd1630c7760b708f3a5b4d38a121e66cb, name=ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-x, GIT_CLEAN=True, org.label-schema.build-date=20240326, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, RELEASE=squid-4e50bbc) 2024-03-30T13:58:35.750 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 13:58:35 smithi181 podman[73090]: 2024-03-30 13:58:35.261399335 +0000 UTC m=+0.376756248 container init 70a65dda3ab06422340c89bc98bc552444e147f0c88a0c2948bb40280909be40 (image=quay.ceph.io/ceph-ci/ceph:4e50bbcdd1630c7760b708f3a5b4d38a121e66cb, name=ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-x, GIT_BRANCH=HEAD, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, RELEASE=squid-4e50bbc, org.label-schema.build-date=20240326, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, io.buildah.version=1.33.5, ceph=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS) 2024-03-30T13:58:35.750 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 13:58:35 smithi181 podman[73090]: 2024-03-30 13:58:35.263893018 +0000 UTC m=+0.379249931 container start 70a65dda3ab06422340c89bc98bc552444e147f0c88a0c2948bb40280909be40 (image=quay.ceph.io/ceph-ci/ceph:4e50bbcdd1630c7760b708f3a5b4d38a121e66cb, name=ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-x, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-4e50bbc, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, ceph=True, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240326, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image) 2024-03-30T13:58:35.750 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 13:58:35 smithi181 ceph-mgr[73109]: -- 172.21.15.181:0/2593266083 <== mon.2 v2:172.21.15.181:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5593f4d8a5a0 con 0x5593f4d5f000 2024-03-30T13:58:35.750 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 13:58:35 smithi181 bash[73090]: 70a65dda3ab06422340c89bc98bc552444e147f0c88a0c2948bb40280909be40 2024-03-30T13:58:35.750 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 13:58:35 smithi181 systemd[1]: Started Ceph mgr.x for 98ebaeb8-ee99-11ee-b647-cb9ed24678a4. 2024-03-30T13:58:35.938 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:35 smithi099 ceph-mon[24912]: pgmap v22: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 316 B/s rd, 0 op/s 2024-03-30T13:58:35.938 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:35 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:58:35.938 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:35 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:58:35.938 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:35 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:58:35.938 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:35 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:58:35.938 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:35 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:58:35.938 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:35 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.iscsi.foo.smithi099.qyjuvr", "caps": ["mon", "profile rbd, allow command \"osd blocklist\", allow command \"config-key get\" with \"key\" prefix \"iscsi/\"", "mgr", "allow command \"service status\"", "osd", "allow rwx"]}]: dispatch 2024-03-30T13:58:35.938 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:35 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.iscsi.foo.smithi099.qyjuvr", "caps": ["mon", "profile rbd, allow command \"osd blocklist\", allow command \"config-key get\" with \"key\" prefix \"iscsi/\"", "mgr", "allow command \"service status\"", "osd", "allow rwx"]}]: dispatch 2024-03-30T13:58:35.938 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:35 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:58:35.939 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:35 smithi099 ceph-mon[29691]: pgmap v22: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 316 B/s rd, 0 op/s 2024-03-30T13:58:35.939 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:35 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:58:35.939 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:35 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:58:35.939 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:35 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:58:35.939 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:35 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:58:35.939 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:35 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:58:35.939 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:35 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.iscsi.foo.smithi099.qyjuvr", "caps": ["mon", "profile rbd, allow command \"osd blocklist\", allow command \"config-key get\" with \"key\" prefix \"iscsi/\"", "mgr", "allow command \"service status\"", "osd", "allow rwx"]}]: dispatch 2024-03-30T13:58:35.939 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:35 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.iscsi.foo.smithi099.qyjuvr", "caps": ["mon", "profile rbd, allow command \"osd blocklist\", allow command \"config-key get\" with \"key\" prefix \"iscsi/\"", "mgr", "allow command \"service status\"", "osd", "allow rwx"]}]: dispatch 2024-03-30T13:58:35.939 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:35 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:58:36.250 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 13:58:35 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-x[73105]: 2024-03-30T13:58:35.812+0000 7f077261c200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-03-30T13:58:36.250 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 13:58:35 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-x[73105]: 2024-03-30T13:58:35.908+0000 7f077261c200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-03-30T13:58:36.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:35 smithi181 ceph-mon[25762]: pgmap v22: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 316 B/s rd, 0 op/s 2024-03-30T13:58:36.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:35 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:58:36.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:35 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:58:36.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:35 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:58:36.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:35 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:58:36.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:35 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:58:36.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:35 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.iscsi.foo.smithi099.qyjuvr", "caps": ["mon", "profile rbd, allow command \"osd blocklist\", allow command \"config-key get\" with \"key\" prefix \"iscsi/\"", "mgr", "allow command \"service status\"", "osd", "allow rwx"]}]: dispatch 2024-03-30T13:58:36.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:35 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.iscsi.foo.smithi099.qyjuvr", "caps": ["mon", "profile rbd, allow command \"osd blocklist\", allow command \"config-key get\" with \"key\" prefix \"iscsi/\"", "mgr", "allow command \"service status\"", "osd", "allow rwx"]}]: dispatch 2024-03-30T13:58:36.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:35 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:58:36.845 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 13:58:36 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-x[73105]: 2024-03-30T13:58:36.558+0000 7f077261c200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-03-30T13:58:36.845 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 13:58:36 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-x[73105]: 2024-03-30T13:58:36.651+0000 7f077261c200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-03-30T13:58:36.845 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 13:58:36 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-x[73105]: 2024-03-30T13:58:36.794+0000 7f077261c200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-03-30T13:58:37.081 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:36 smithi099 ceph-mon[24912]: pgmap v23: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:58:37.081 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:36 smithi099 ceph-mon[24912]: pgmap v24: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:58:37.081 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:36 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:58:37.081 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:36 smithi099 ceph-mon[24912]: Reconfiguring iscsi.foo.smithi099.qyjuvr (dependencies changed)... 2024-03-30T13:58:37.081 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:36 smithi099 ceph-mon[24912]: Reconfiguring daemon iscsi.foo.smithi099.qyjuvr on smithi099 2024-03-30T13:58:37.081 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:36 smithi099 ceph-mon[24912]: from='client.? 172.21.15.99:0/3955270470' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-03-30T13:58:37.082 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:36 smithi099 ceph-mon[29691]: pgmap v23: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:58:37.082 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:36 smithi099 ceph-mon[29691]: pgmap v24: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:58:37.082 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:36 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:58:37.082 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:36 smithi099 ceph-mon[29691]: Reconfiguring iscsi.foo.smithi099.qyjuvr (dependencies changed)... 2024-03-30T13:58:37.082 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:36 smithi099 ceph-mon[29691]: Reconfiguring daemon iscsi.foo.smithi099.qyjuvr on smithi099 2024-03-30T13:58:37.082 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:36 smithi099 ceph-mon[29691]: from='client.? 172.21.15.99:0/3955270470' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-03-30T13:58:37.237 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:36 smithi181 ceph-mon[25762]: pgmap v23: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:58:37.237 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:36 smithi181 ceph-mon[25762]: pgmap v24: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:58:37.237 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:36 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:58:37.238 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:36 smithi181 ceph-mon[25762]: Reconfiguring iscsi.foo.smithi099.qyjuvr (dependencies changed)... 2024-03-30T13:58:37.238 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:36 smithi181 ceph-mon[25762]: Reconfiguring daemon iscsi.foo.smithi099.qyjuvr on smithi099 2024-03-30T13:58:37.238 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:36 smithi181 ceph-mon[25762]: from='client.? 172.21.15.99:0/3955270470' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-03-30T13:58:37.238 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 13:58:36 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-x[73105]: 2024-03-30T13:58:36.892+0000 7f077261c200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-03-30T13:58:37.238 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 13:58:36 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-x[73105]: 2024-03-30T13:58:36.975+0000 7f077261c200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-03-30T13:58:37.238 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 13:58:37 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-x[73105]: 2024-03-30T13:58:37.241+0000 7f077261c200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-03-30T13:58:37.500 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 13:58:37 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-x[73105]: 2024-03-30T13:58:37.352+0000 7f077261c200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-03-30T13:58:37.500 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 13:58:37 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-x[73105]: 2024-03-30T13:58:37.438+0000 7f077261c200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-03-30T13:58:38.000 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 13:58:37 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-x[73105]: 2024-03-30T13:58:37.533+0000 7f077261c200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-03-30T13:58:38.000 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 13:58:37 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-x[73105]: 2024-03-30T13:58:37.712+0000 7f077261c200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-03-30T13:58:39.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:38 smithi181 ceph-mon[25762]: pgmap v25: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 116 B/s rd, 0 op/s 2024-03-30T13:58:39.000 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 13:58:38 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-x[73105]: 2024-03-30T13:58:38.688+0000 7f077261c200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-03-30T13:58:39.000 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 13:58:38 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-x[73105]: 2024-03-30T13:58:38.830+0000 7f077261c200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-03-30T13:58:39.077 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:38 smithi099 ceph-mon[24912]: pgmap v25: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 116 B/s rd, 0 op/s 2024-03-30T13:58:39.077 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:38 smithi099 ceph-mon[29691]: pgmap v25: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 116 B/s rd, 0 op/s 2024-03-30T13:58:39.331 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:58:39 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[71049]: 2024-03-30T13:58:39.081+0000 7f5f7e1d7700 -1 log_channel(cephadm) log [ERR] : cephadm exited with an error code: 1, stderr: Reconfig daemon iscsi.foo.smithi099.qyjuvr ... 2024-03-30T13:58:39.331 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:58:39 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[71049]: Creating ceph-iscsi config... 2024-03-30T13:58:39.331 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:58:39 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[71049]: Write file: /var/lib/ceph/98ebaeb8-ee99-11ee-b647-cb9ed24678a4/iscsi.foo.smithi099.qyjuvr/iscsi-gateway.cfg 2024-03-30T13:58:39.332 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:58:39 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[71049]: Write file: /var/lib/ceph/98ebaeb8-ee99-11ee-b647-cb9ed24678a4/iscsi.foo.smithi099.qyjuvr/tcmu-runner-entrypoint.sh 2024-03-30T13:58:39.332 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:58:39 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[71049]: Non-zero exit code 1 from systemctl restart ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4@iscsi.foo.smithi099.qyjuvr 2024-03-30T13:58:39.332 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:58:39 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[71049]: systemctl: stderr Job for ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4@iscsi.foo.smithi099.qyjuvr.service failed because the control process exited with error code. 2024-03-30T13:58:39.332 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:58:39 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[71049]: systemctl: stderr See "systemctl status ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4@iscsi.foo.smithi099.qyjuvr.service" and "journalctl -xeu ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4@iscsi.foo.smithi099.qyjuvr.service" for details. 2024-03-30T13:58:39.332 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:58:39 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[71049]: Traceback (most recent call last): 2024-03-30T13:58:39.332 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:58:39 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[71049]: File "/usr/lib64/python3.9/runpy.py", line 197, in _run_module_as_main 2024-03-30T13:58:39.332 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:58:39 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[71049]: return _run_code(code, main_globals, None, 2024-03-30T13:58:39.332 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:58:39 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[71049]: File "/usr/lib64/python3.9/runpy.py", line 87, in _run_code 2024-03-30T13:58:39.332 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:58:39 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[71049]: exec(code, run_globals) 2024-03-30T13:58:39.332 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:58:39 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[71049]: File "/var/lib/ceph/98ebaeb8-ee99-11ee-b647-cb9ed24678a4/cephadm.a8f553f8c0a1bbbd91f4e60c8e13381b6fabffa3561f875fe77bb96af479b3ca/__main__.py", line 5528, in 2024-03-30T13:58:39.332 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:58:39 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[71049]: File "/var/lib/ceph/98ebaeb8-ee99-11ee-b647-cb9ed24678a4/cephadm.a8f553f8c0a1bbbd91f4e60c8e13381b6fabffa3561f875fe77bb96af479b3ca/__main__.py", line 5516, in main 2024-03-30T13:58:39.332 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:58:39 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[71049]: File "/var/lib/ceph/98ebaeb8-ee99-11ee-b647-cb9ed24678a4/cephadm.a8f553f8c0a1bbbd91f4e60c8e13381b6fabffa3561f875fe77bb96af479b3ca/__main__.py", line 3040, in command_deploy_from 2024-03-30T13:58:39.332 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:58:39 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[71049]: File "/var/lib/ceph/98ebaeb8-ee99-11ee-b647-cb9ed24678a4/cephadm.a8f553f8c0a1bbbd91f4e60c8e13381b6fabffa3561f875fe77bb96af479b3ca/__main__.py", line 3075, in _common_deploy 2024-03-30T13:58:39.332 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:58:39 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[71049]: File "/var/lib/ceph/98ebaeb8-ee99-11ee-b647-cb9ed24678a4/cephadm.a8f553f8c0a1bbbd91f4e60c8e13381b6fabffa3561f875fe77bb96af479b3ca/__main__.py", line 3095, in _deploy_daemon_container 2024-03-30T13:58:39.333 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:58:39 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[71049]: File "/var/lib/ceph/98ebaeb8-ee99-11ee-b647-cb9ed24678a4/cephadm.a8f553f8c0a1bbbd91f4e60c8e13381b6fabffa3561f875fe77bb96af479b3ca/__main__.py", line 1067, in deploy_daemon 2024-03-30T13:58:39.333 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:58:39 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[71049]: File "/var/lib/ceph/98ebaeb8-ee99-11ee-b647-cb9ed24678a4/cephadm.a8f553f8c0a1bbbd91f4e60c8e13381b6fabffa3561f875fe77bb96af479b3ca/cephadmlib/call_wrappers.py", line 307, in call_throws 2024-03-30T13:58:39.333 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:58:39 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[71049]: RuntimeError: Failed command: systemctl restart ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4@iscsi.foo.smithi099.qyjuvr: Job for ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4@iscsi.foo.smithi099.qyjuvr.service failed because the control process exited with error code. 2024-03-30T13:58:39.333 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:58:39 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[71049]: See "systemctl status ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4@iscsi.foo.smithi099.qyjuvr.service" and "journalctl -xeu ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4@iscsi.foo.smithi099.qyjuvr.service" for details. 2024-03-30T13:58:39.333 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:58:39 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[71049]: Traceback (most recent call last): 2024-03-30T13:58:39.333 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:58:39 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[71049]: File "/usr/share/ceph/mgr/cephadm/serve.py", line 1114, in _check_daemons 2024-03-30T13:58:39.333 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:58:39 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[71049]: self.mgr._daemon_action(daemon_spec, action=action) 2024-03-30T13:58:39.333 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:58:39 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[71049]: File "/usr/share/ceph/mgr/cephadm/module.py", line 2390, in _daemon_action 2024-03-30T13:58:39.334 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:58:39 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[71049]: CephadmServe(self)._create_daemon(daemon_spec, reconfig=(action == 'reconfig'))) 2024-03-30T13:58:39.334 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:58:39 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[71049]: File "/usr/share/ceph/mgr/cephadm/module.py", line 747, in wait_async 2024-03-30T13:58:39.334 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:58:39 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[71049]: return self.event_loop.get_result(coro, timeout) 2024-03-30T13:58:39.334 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:58:39 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[71049]: File "/usr/share/ceph/mgr/cephadm/ssh.py", line 136, in get_result 2024-03-30T13:58:39.334 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:58:39 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[71049]: return future.result(timeout) 2024-03-30T13:58:39.334 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:58:39 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[71049]: File "/lib64/python3.6/concurrent/futures/_base.py", line 432, in result 2024-03-30T13:58:39.334 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:58:39 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[71049]: return self.__get_result() 2024-03-30T13:58:39.334 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:58:39 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[71049]: File "/lib64/python3.6/concurrent/futures/_base.py", line 384, in __get_result 2024-03-30T13:58:39.334 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:58:39 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[71049]: raise self._exception 2024-03-30T13:58:39.334 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:58:39 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[71049]: File "/usr/share/ceph/mgr/cephadm/serve.py", line 1374, in _create_daemon 2024-03-30T13:58:39.334 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:58:39 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[71049]: config_blobs=daemon_spec.final_config, 2024-03-30T13:58:39.334 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:58:39 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[71049]: File "/usr/share/ceph/mgr/cephadm/serve.py", line 1685, in _run_cephadm 2024-03-30T13:58:39.334 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:58:39 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[71049]: f'cephadm exited with an error code: {code}, stderr: {err}') 2024-03-30T13:58:39.334 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:58:39 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[71049]: orchestrator._interface.OrchestratorError: cephadm exited with an error code: 1, stderr: Reconfig daemon iscsi.foo.smithi099.qyjuvr ... 2024-03-30T13:58:39.335 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:58:39 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[71049]: Creating ceph-iscsi config... 2024-03-30T13:58:39.335 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:58:39 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[71049]: Write file: /var/lib/ceph/98ebaeb8-ee99-11ee-b647-cb9ed24678a4/iscsi.foo.smithi099.qyjuvr/iscsi-gateway.cfg 2024-03-30T13:58:39.335 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:58:39 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[71049]: Write file: /var/lib/ceph/98ebaeb8-ee99-11ee-b647-cb9ed24678a4/iscsi.foo.smithi099.qyjuvr/tcmu-runner-entrypoint.sh 2024-03-30T13:58:39.335 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:58:39 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[71049]: Non-zero exit code 1 from systemctl restart ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4@iscsi.foo.smithi099.qyjuvr 2024-03-30T13:58:39.335 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:58:39 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[71049]: systemctl: stderr Job for ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4@iscsi.foo.smithi099.qyjuvr.service failed because the control process exited with error code. 2024-03-30T13:58:39.335 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:58:39 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[71049]: systemctl: stderr See "systemctl status ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4@iscsi.foo.smithi099.qyjuvr.service" and "journalctl -xeu ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4@iscsi.foo.smithi099.qyjuvr.service" for details. 2024-03-30T13:58:39.335 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:58:39 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[71049]: Traceback (most recent call last): 2024-03-30T13:58:39.335 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:58:39 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[71049]: File "/usr/lib64/python3.9/runpy.py", line 197, in _run_module_as_main 2024-03-30T13:58:39.335 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:58:39 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[71049]: return _run_code(code, main_globals, None, 2024-03-30T13:58:39.335 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:58:39 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[71049]: File "/usr/lib64/python3.9/runpy.py", line 87, in _run_code 2024-03-30T13:58:39.335 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:58:39 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[71049]: exec(code, run_globals) 2024-03-30T13:58:39.335 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:58:39 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[71049]: File "/var/lib/ceph/98ebaeb8-ee99-11ee-b647-cb9ed24678a4/cephadm.a8f553f8c0a1bbbd91f4e60c8e13381b6fabffa3561f875fe77bb96af479b3ca/__main__.py", line 5528, in 2024-03-30T13:58:39.335 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:58:39 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[71049]: File "/var/lib/ceph/98ebaeb8-ee99-11ee-b647-cb9ed24678a4/cephadm.a8f553f8c0a1bbbd91f4e60c8e13381b6fabffa3561f875fe77bb96af479b3ca/__main__.py", line 5516, in main 2024-03-30T13:58:39.335 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:58:39 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[71049]: File "/var/lib/ceph/98ebaeb8-ee99-11ee-b647-cb9ed24678a4/cephadm.a8f553f8c0a1bbbd91f4e60c8e13381b6fabffa3561f875fe77bb96af479b3ca/__main__.py", line 3040, in command_deploy_from 2024-03-30T13:58:39.335 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:58:39 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[71049]: File "/var/lib/ceph/98ebaeb8-ee99-11ee-b647-cb9ed24678a4/cephadm.a8f553f8c0a1bbbd91f4e60c8e13381b6fabffa3561f875fe77bb96af479b3ca/__main__.py", line 3075, in _common_deploy 2024-03-30T13:58:39.336 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:58:39 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[71049]: File "/var/lib/ceph/98ebaeb8-ee99-11ee-b647-cb9ed24678a4/cephadm.a8f553f8c0a1bbbd91f4e60c8e13381b6fabffa3561f875fe77bb96af479b3ca/__main__.py", line 3095, in _deploy_daemon_container 2024-03-30T13:58:39.336 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:58:39 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[71049]: File "/var/lib/ceph/98ebaeb8-ee99-11ee-b647-cb9ed24678a4/cephadm.a8f553f8c0a1bbbd91f4e60c8e13381b6fabffa3561f875fe77bb96af479b3ca/__main__.py", line 1067, in deploy_daemon 2024-03-30T13:58:39.336 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:58:39 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[71049]: File "/var/lib/ceph/98ebaeb8-ee99-11ee-b647-cb9ed24678a4/cephadm.a8f553f8c0a1bbbd91f4e60c8e13381b6fabffa3561f875fe77bb96af479b3ca/cephadmlib/call_wrappers.py", line 307, in call_throws 2024-03-30T13:58:39.336 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:58:39 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[71049]: RuntimeError: Failed command: systemctl restart ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4@iscsi.foo.smithi099.qyjuvr: Job for ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4@iscsi.foo.smithi099.qyjuvr.service failed because the control process exited with error code. 2024-03-30T13:58:39.336 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:58:39 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[71049]: See "systemctl status ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4@iscsi.foo.smithi099.qyjuvr.service" and "journalctl -xeu ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4@iscsi.foo.smithi099.qyjuvr.service" for details. 2024-03-30T13:58:39.346 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 13:58:39 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-x[73105]: 2024-03-30T13:58:39.249+0000 7f077261c200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-03-30T13:58:39.346 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 13:58:39 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-x[73105]: 2024-03-30T13:58:39.350+0000 7f077261c200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-03-30T13:58:39.607 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 13:58:39 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-x[73105]: 2024-03-30T13:58:39.566+0000 7f077261c200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-03-30T13:58:40.000 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 13:58:39 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-x[73105]: 2024-03-30T13:58:39.768+0000 7f077261c200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-03-30T13:58:40.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:39 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:58:40.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:39 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:58:40.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:39 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:58:40.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:39 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.x"}]: dispatch 2024-03-30T13:58:40.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:39 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.x"}]: dispatch 2024-03-30T13:58:40.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:39 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr.x"}]': finished 2024-03-30T13:58:40.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:39 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.y"}]: dispatch 2024-03-30T13:58:40.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:39 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.y"}]: dispatch 2024-03-30T13:58:40.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:39 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr.y"}]': finished 2024-03-30T13:58:40.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:39 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:58:40.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:39 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:58:40.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:39 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:58:40.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:39 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.iscsi.foo.smithi099.qyjuvr", "caps": ["mon", "profile rbd, allow command \"osd blocklist\", allow command \"config-key get\" with \"key\" prefix \"iscsi/\"", "mgr", "allow command \"service status\"", "osd", "allow rwx"]}]: dispatch 2024-03-30T13:58:40.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:39 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.iscsi.foo.smithi099.qyjuvr", "caps": ["mon", "profile rbd, allow command \"osd blocklist\", allow command \"config-key get\" with \"key\" prefix \"iscsi/\"", "mgr", "allow command \"service status\"", "osd", "allow rwx"]}]: dispatch 2024-03-30T13:58:40.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:39 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:58:40.127 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:39 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:58:40.128 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:39 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:58:40.128 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:39 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:58:40.128 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:39 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.x"}]: dispatch 2024-03-30T13:58:40.128 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:39 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.x"}]: dispatch 2024-03-30T13:58:40.128 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:39 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr.x"}]': finished 2024-03-30T13:58:40.128 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:39 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.y"}]: dispatch 2024-03-30T13:58:40.128 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:39 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.y"}]: dispatch 2024-03-30T13:58:40.128 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:39 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr.y"}]': finished 2024-03-30T13:58:40.128 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:39 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:58:40.128 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:39 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:58:40.128 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:39 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:58:40.128 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:39 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.iscsi.foo.smithi099.qyjuvr", "caps": ["mon", "profile rbd, allow command \"osd blocklist\", allow command \"config-key get\" with \"key\" prefix \"iscsi/\"", "mgr", "allow command \"service status\"", "osd", "allow rwx"]}]: dispatch 2024-03-30T13:58:40.128 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:39 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.iscsi.foo.smithi099.qyjuvr", "caps": ["mon", "profile rbd, allow command \"osd blocklist\", allow command \"config-key get\" with \"key\" prefix \"iscsi/\"", "mgr", "allow command \"service status\"", "osd", "allow rwx"]}]: dispatch 2024-03-30T13:58:40.128 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:39 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:58:40.129 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:39 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:58:40.129 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:39 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:58:40.129 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:39 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:58:40.129 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:39 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.x"}]: dispatch 2024-03-30T13:58:40.129 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:39 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.x"}]: dispatch 2024-03-30T13:58:40.129 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:39 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr.x"}]': finished 2024-03-30T13:58:40.129 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:39 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.y"}]: dispatch 2024-03-30T13:58:40.129 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:39 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.y"}]: dispatch 2024-03-30T13:58:40.129 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:39 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr.y"}]': finished 2024-03-30T13:58:40.129 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:39 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:58:40.129 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:39 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:58:40.129 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:39 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:58:40.129 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:39 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.iscsi.foo.smithi099.qyjuvr", "caps": ["mon", "profile rbd, allow command \"osd blocklist\", allow command \"config-key get\" with \"key\" prefix \"iscsi/\"", "mgr", "allow command \"service status\"", "osd", "allow rwx"]}]: dispatch 2024-03-30T13:58:40.129 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:39 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.iscsi.foo.smithi099.qyjuvr", "caps": ["mon", "profile rbd, allow command \"osd blocklist\", allow command \"config-key get\" with \"key\" prefix \"iscsi/\"", "mgr", "allow command \"service status\"", "osd", "allow rwx"]}]: dispatch 2024-03-30T13:58:40.130 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:39 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:58:40.339 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 13:58:40 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-x[73105]: 2024-03-30T13:58:40.068+0000 7f077261c200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-03-30T13:58:40.339 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 13:58:40 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-x[73105]: 2024-03-30T13:58:40.343+0000 7f077261c200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-03-30T13:58:40.750 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 13:58:40 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-x[73105]: 2024-03-30T13:58:40.589+0000 7f077261c200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-03-30T13:58:41.034 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:40 smithi181 ceph-mon[25762]: cephadm exited with an error code: 1, stderr: Reconfig daemon iscsi.foo.smithi099.qyjuvr ... 2024-03-30T13:58:41.035 INFO:journalctl@ceph.mon.b.smithi181.stdout: Creating ceph-iscsi config... 2024-03-30T13:58:41.035 INFO:journalctl@ceph.mon.b.smithi181.stdout: Write file: /var/lib/ceph/98ebaeb8-ee99-11ee-b647-cb9ed24678a4/iscsi.foo.smithi099.qyjuvr/iscsi-gateway.cfg 2024-03-30T13:58:41.035 INFO:journalctl@ceph.mon.b.smithi181.stdout: Write file: /var/lib/ceph/98ebaeb8-ee99-11ee-b647-cb9ed24678a4/iscsi.foo.smithi099.qyjuvr/tcmu-runner-entrypoint.sh 2024-03-30T13:58:41.035 INFO:journalctl@ceph.mon.b.smithi181.stdout: Non-zero exit code 1 from systemctl restart ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4@iscsi.foo.smithi099.qyjuvr 2024-03-30T13:58:41.035 INFO:journalctl@ceph.mon.b.smithi181.stdout: systemctl: stderr Job for ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4@iscsi.foo.smithi099.qyjuvr.service failed because the control process exited with error code. 2024-03-30T13:58:41.035 INFO:journalctl@ceph.mon.b.smithi181.stdout: systemctl: stderr See "systemctl status ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4@iscsi.foo.smithi099.qyjuvr.service" and "journalctl -xeu ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4@iscsi.foo.smithi099.qyjuvr.service" for details. 2024-03-30T13:58:41.035 INFO:journalctl@ceph.mon.b.smithi181.stdout: Traceback (most recent call last): 2024-03-30T13:58:41.035 INFO:journalctl@ceph.mon.b.smithi181.stdout: File "/usr/lib64/python3.9/runpy.py", line 197, in _run_module_as_main 2024-03-30T13:58:41.035 INFO:journalctl@ceph.mon.b.smithi181.stdout: return _run_code(code, main_globals, None, 2024-03-30T13:58:41.035 INFO:journalctl@ceph.mon.b.smithi181.stdout: File "/usr/lib64/python3.9/runpy.py", line 87, in _run_code 2024-03-30T13:58:41.035 INFO:journalctl@ceph.mon.b.smithi181.stdout: exec(code, run_globals) 2024-03-30T13:58:41.035 INFO:journalctl@ceph.mon.b.smithi181.stdout: File "/var/lib/ceph/98ebaeb8-ee99-11ee-b647-cb9ed24678a4/cephadm.a8f553f8c0a1bbbd91f4e60c8e13381b6fabffa3561f875fe77bb96af479b3ca/__main__.py", line 5528, in 2024-03-30T13:58:41.036 INFO:journalctl@ceph.mon.b.smithi181.stdout: File "/var/lib/ceph/98ebaeb8-ee99-11ee-b647-cb9ed24678a4/cephadm.a8f553f8c0a1bbbd91f4e60c8e13381b6fabffa3561f875fe77bb96af479b3ca/__main__.py", line 5516, in main 2024-03-30T13:58:41.036 INFO:journalctl@ceph.mon.b.smithi181.stdout: File "/var/lib/ceph/98ebaeb8-ee99-11ee-b647-cb9ed24678a4/cephadm.a8f553f8c0a1bbbd91f4e60c8e13381b6fabffa3561f875fe77bb96af479b3ca/__main__.py", line 3040, in command_deploy_from 2024-03-30T13:58:41.036 INFO:journalctl@ceph.mon.b.smithi181.stdout: File "/var/lib/ceph/98ebaeb8-ee99-11ee-b647-cb9ed24678a4/cephadm.a8f553f8c0a1bbbd91f4e60c8e13381b6fabffa3561f875fe77bb96af479b3ca/__main__.py", line 3075, in _common_deploy 2024-03-30T13:58:41.036 INFO:journalctl@ceph.mon.b.smithi181.stdout: File "/var/lib/ceph/98ebaeb8-ee99-11ee-b647-cb9ed24678a4/cephadm.a8f553f8c0a1bbbd91f4e60c8e13381b6fabffa3561f875fe77bb96af479b3ca/__main__.py", line 3095, in _deploy_daemon_container 2024-03-30T13:58:41.036 INFO:journalctl@ceph.mon.b.smithi181.stdout: File "/var/lib/ceph/98ebaeb8-ee99-11ee-b647-cb9ed24678a4/cephadm.a8f553f8c0a1bbbd91f4e60c8e13381b6fabffa3561f875fe77bb96af479b3ca/__main__.py", line 1067, in deploy_daemon 2024-03-30T13:58:41.036 INFO:journalctl@ceph.mon.b.smithi181.stdout: File "/var/lib/ceph/98ebaeb8-ee99-11ee-b647-cb9ed24678a4/cephadm.a8f553f8c0a1bbbd91f4e60c8e13381b6fabffa3561f875fe77bb96af479b3ca/cephadmlib/call_wrappers.py", line 307, in call_throws 2024-03-30T13:58:41.036 INFO:journalctl@ceph.mon.b.smithi181.stdout: RuntimeError: Failed command: systemctl restart ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4@iscsi.foo.smithi099.qyjuvr: Job for ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4@iscsi.foo.smithi099.qyjuvr.service failed because the control process exited with error code. 2024-03-30T13:58:41.036 INFO:journalctl@ceph.mon.b.smithi181.stdout: See "systemctl status ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4@iscsi.foo.smithi099.qyjuvr.service" and "journalctl -xeu ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4@iscsi.foo.smithi099.qyjuvr.service" for details. 2024-03-30T13:58:41.036 INFO:journalctl@ceph.mon.b.smithi181.stdout: Traceback (most recent call last): 2024-03-30T13:58:41.036 INFO:journalctl@ceph.mon.b.smithi181.stdout: File "/usr/share/ceph/mgr/cephadm/serve.py", line 1114, in _check_daemons 2024-03-30T13:58:41.036 INFO:journalctl@ceph.mon.b.smithi181.stdout: self.mgr._daemon_action(daemon_spec, action=action) 2024-03-30T13:58:41.036 INFO:journalctl@ceph.mon.b.smithi181.stdout: File "/usr/share/ceph/mgr/cephadm/module.py", line 2390, in _daemon_action 2024-03-30T13:58:41.036 INFO:journalctl@ceph.mon.b.smithi181.stdout: CephadmServe(self)._create_daemon(daemon_spec, reconfig=(action == 'reconfig'))) 2024-03-30T13:58:41.037 INFO:journalctl@ceph.mon.b.smithi181.stdout: File "/usr/share/ceph/mgr/cephadm/module.py", line 747, in wait_async 2024-03-30T13:58:41.037 INFO:journalctl@ceph.mon.b.smithi181.stdout: return self.event_loop.get_result(coro, timeout) 2024-03-30T13:58:41.037 INFO:journalctl@ceph.mon.b.smithi181.stdout: File "/usr/share/ceph/mgr/cephadm/ssh.py", line 136, in get_result 2024-03-30T13:58:41.037 INFO:journalctl@ceph.mon.b.smithi181.stdout: return future.result(timeout) 2024-03-30T13:58:41.037 INFO:journalctl@ceph.mon.b.smithi181.stdout: File "/lib64/python3.6/concurrent/futures/_base.py", line 432, in result 2024-03-30T13:58:41.037 INFO:journalctl@ceph.mon.b.smithi181.stdout: return self.__get_result() 2024-03-30T13:58:41.037 INFO:journalctl@ceph.mon.b.smithi181.stdout: File "/lib64/python3.6/concurrent/futures/_base.py", line 384, in __get_result 2024-03-30T13:58:41.037 INFO:journalctl@ceph.mon.b.smithi181.stdout: raise self._exception 2024-03-30T13:58:41.037 INFO:journalctl@ceph.mon.b.smithi181.stdout: File "/usr/share/ceph/mgr/cephadm/serve.py", line 1374, in _create_daemon 2024-03-30T13:58:41.037 INFO:journalctl@ceph.mon.b.smithi181.stdout: config_blobs=daemon_spec.final_config, 2024-03-30T13:58:41.037 INFO:journalctl@ceph.mon.b.smithi181.stdout: File "/usr/share/ceph/mgr/cephadm/serve.py", line 1685, in _run_cephadm 2024-03-30T13:58:41.037 INFO:journalctl@ceph.mon.b.smithi181.stdout: f'cephadm exited with an error code: {code}, stderr: {err}') 2024-03-30T13:58:41.037 INFO:journalctl@ceph.mon.b.smithi181.stdout: orchestrator._interface.OrchestratorError: cephadm exited with an error code: 1, stderr: Reconfig daemon iscsi.foo.smithi099.qyjuvr ... 2024-03-30T13:58:41.037 INFO:journalctl@ceph.mon.b.smithi181.stdout: Creating ceph-iscsi config... 2024-03-30T13:58:41.038 INFO:journalctl@ceph.mon.b.smithi181.stdout: Write file: /var/lib/ceph/98ebaeb8-ee99-11ee-b647-cb9ed24678a4/iscsi.foo.smithi099.qyjuvr/iscsi-gateway.cfg 2024-03-30T13:58:41.038 INFO:journalctl@ceph.mon.b.smithi181.stdout: Write file: /var/lib/ceph/98ebaeb8-ee99-11ee-b647-cb9ed24678a4/iscsi.foo.smithi099.qyjuvr/tcmu-runner-entrypoint.sh 2024-03-30T13:58:41.038 INFO:journalctl@ceph.mon.b.smithi181.stdout: Non-zero exit code 1 from systemctl restart ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4@iscsi.foo.smithi099.qyjuvr 2024-03-30T13:58:41.038 INFO:journalctl@ceph.mon.b.smithi181.stdout: systemctl: stderr Job for ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4@iscsi.foo.smithi099.qyjuvr.service failed because the control process exited with error code. 2024-03-30T13:58:41.038 INFO:journalctl@ceph.mon.b.smithi181.stdout: systemctl: stderr See "systemctl status ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4@iscsi.foo.smithi099.qyjuvr.service" and "journalctl -xeu ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4@iscsi.foo.smithi099.qyjuvr.service" for details. 2024-03-30T13:58:41.038 INFO:journalctl@ceph.mon.b.smithi181.stdout: Traceback (most recent call last): 2024-03-30T13:58:41.038 INFO:journalctl@ceph.mon.b.smithi181.stdout: File "/usr/lib64/python3.9/runpy.py", line 197, in _run_module_as_main 2024-03-30T13:58:41.038 INFO:journalctl@ceph.mon.b.smithi181.stdout: return _run_code(code, main_globals, None, 2024-03-30T13:58:41.038 INFO:journalctl@ceph.mon.b.smithi181.stdout: File "/usr/lib64/python3.9/runpy.py", line 87, in _run_code 2024-03-30T13:58:41.038 INFO:journalctl@ceph.mon.b.smithi181.stdout: exec(code, run_globals) 2024-03-30T13:58:41.038 INFO:journalctl@ceph.mon.b.smithi181.stdout: File "/var/lib/ceph/98ebaeb8-ee99-11ee-b647-cb9ed24678a4/cephadm.a8f553f8c0a1bbbd91f4e60c8e13381b6fabffa3561f875fe77bb96af479b3ca/__main__.py", line 5528, in 2024-03-30T13:58:41.038 INFO:journalctl@ceph.mon.b.smithi181.stdout: File "/var/lib/ceph/98ebaeb8-ee99-11ee-b647-cb9ed24678a4/cephadm.a8f553f8c0a1bbbd91f4e60c8e13381b6fabffa3561f875fe77bb96af479b3ca/__main__.py", line 5516, in main 2024-03-30T13:58:41.038 INFO:journalctl@ceph.mon.b.smithi181.stdout: File "/var/lib/ceph/98ebaeb8-ee99-11ee-b647-cb9ed24678a4/cephadm.a8f553f8c0a1bbbd91f4e60c8e13381b6fabffa3561f875fe77bb96af479b3ca/__main__.py", line 3040, in command_deploy_from 2024-03-30T13:58:41.038 INFO:journalctl@ceph.mon.b.smithi181.stdout: File "/var/lib/ceph/98ebaeb8-ee99-11ee-b647-cb9ed24678a4/cephadm.a8f553f8c0a1bbbd91f4e60c8e13381b6fabffa3561f875fe77bb96af479b3ca/__main__.py", line 3075, in _common_deploy 2024-03-30T13:58:41.039 INFO:journalctl@ceph.mon.b.smithi181.stdout: File "/var/lib/ceph/98ebaeb8-ee99-11ee-b647-cb9ed24678a4/cephadm.a8f553f8c0a1bbbd91f4e60c8e13381b6fabffa3561f875fe77bb96af479b3ca/__main__.py", line 3095, in _deploy_daemon_container 2024-03-30T13:58:41.039 INFO:journalctl@ceph.mon.b.smithi181.stdout: File "/var/lib/ceph/98ebaeb8-ee99-11ee-b647-cb9ed24678a4/cephadm.a8f553f8c0a1bbbd91f4e60c8e13381b6fabffa3561f875fe77bb96af479b3ca/__main__.py", line 1067, in deploy_daemon 2024-03-30T13:58:41.039 INFO:journalctl@ceph.mon.b.smithi181.stdout: File "/var/lib/ceph/98ebaeb8-ee99-11ee-b647-cb9ed24678a4/cephadm.a8f553f8c0a1bbbd91f4e60c8e13381b6fabffa3561f875fe77bb96af479b3ca/cephadmlib/call_wrappers.py", line 307, in call_throws 2024-03-30T13:58:41.039 INFO:journalctl@ceph.mon.b.smithi181.stdout: RuntimeError: Failed command: systemctl restart ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4@iscsi.foo.smithi099.qyjuvr: Job for ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4@iscsi.foo.smithi099.qyjuvr.service failed because the control process exited with error code. 2024-03-30T13:58:41.039 INFO:journalctl@ceph.mon.b.smithi181.stdout: See "systemctl status ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4@iscsi.foo.smithi099.qyjuvr.service" and "journalctl -xeu ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4@iscsi.foo.smithi099.qyjuvr.service" for details. 2024-03-30T13:58:41.039 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:40 smithi181 ceph-mon[25762]: Upgrade: Setting container_image for all mgr 2024-03-30T13:58:41.039 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:40 smithi181 ceph-mon[25762]: pgmap v26: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 121 B/s rd, 0 op/s 2024-03-30T13:58:41.039 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:40 smithi181 ceph-mon[25762]: pgmap v27: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 160 B/s rd, 0 op/s 2024-03-30T13:58:41.039 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:40 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:58:41.039 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:40 smithi181 ceph-mon[25762]: Reconfiguring iscsi.foo.smithi099.qyjuvr (dependencies changed)... 2024-03-30T13:58:41.039 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:40 smithi181 ceph-mon[25762]: Reconfiguring daemon iscsi.foo.smithi099.qyjuvr on smithi099 2024-03-30T13:58:41.041 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:40 smithi099 ceph-mon[24912]: cephadm exited with an error code: 1, stderr: Reconfig daemon iscsi.foo.smithi099.qyjuvr ... 2024-03-30T13:58:41.041 INFO:journalctl@ceph.mon.a.smithi099.stdout: Creating ceph-iscsi config... 2024-03-30T13:58:41.041 INFO:journalctl@ceph.mon.a.smithi099.stdout: Write file: /var/lib/ceph/98ebaeb8-ee99-11ee-b647-cb9ed24678a4/iscsi.foo.smithi099.qyjuvr/iscsi-gateway.cfg 2024-03-30T13:58:41.042 INFO:journalctl@ceph.mon.a.smithi099.stdout: Write file: /var/lib/ceph/98ebaeb8-ee99-11ee-b647-cb9ed24678a4/iscsi.foo.smithi099.qyjuvr/tcmu-runner-entrypoint.sh 2024-03-30T13:58:41.042 INFO:journalctl@ceph.mon.a.smithi099.stdout: Non-zero exit code 1 from systemctl restart ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4@iscsi.foo.smithi099.qyjuvr 2024-03-30T13:58:41.042 INFO:journalctl@ceph.mon.a.smithi099.stdout: systemctl: stderr Job for ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4@iscsi.foo.smithi099.qyjuvr.service failed because the control process exited with error code. 2024-03-30T13:58:41.042 INFO:journalctl@ceph.mon.a.smithi099.stdout: systemctl: stderr See "systemctl status ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4@iscsi.foo.smithi099.qyjuvr.service" and "journalctl -xeu ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4@iscsi.foo.smithi099.qyjuvr.service" for details. 2024-03-30T13:58:41.042 INFO:journalctl@ceph.mon.a.smithi099.stdout: Traceback (most recent call last): 2024-03-30T13:58:41.042 INFO:journalctl@ceph.mon.a.smithi099.stdout: File "/usr/lib64/python3.9/runpy.py", line 197, in _run_module_as_main 2024-03-30T13:58:41.042 INFO:journalctl@ceph.mon.a.smithi099.stdout: return _run_code(code, main_globals, None, 2024-03-30T13:58:41.042 INFO:journalctl@ceph.mon.a.smithi099.stdout: File "/usr/lib64/python3.9/runpy.py", line 87, in _run_code 2024-03-30T13:58:41.042 INFO:journalctl@ceph.mon.a.smithi099.stdout: exec(code, run_globals) 2024-03-30T13:58:41.042 INFO:journalctl@ceph.mon.a.smithi099.stdout: File "/var/lib/ceph/98ebaeb8-ee99-11ee-b647-cb9ed24678a4/cephadm.a8f553f8c0a1bbbd91f4e60c8e13381b6fabffa3561f875fe77bb96af479b3ca/__main__.py", line 5528, in 2024-03-30T13:58:41.042 INFO:journalctl@ceph.mon.a.smithi099.stdout: File "/var/lib/ceph/98ebaeb8-ee99-11ee-b647-cb9ed24678a4/cephadm.a8f553f8c0a1bbbd91f4e60c8e13381b6fabffa3561f875fe77bb96af479b3ca/__main__.py", line 5516, in main 2024-03-30T13:58:41.042 INFO:journalctl@ceph.mon.a.smithi099.stdout: File "/var/lib/ceph/98ebaeb8-ee99-11ee-b647-cb9ed24678a4/cephadm.a8f553f8c0a1bbbd91f4e60c8e13381b6fabffa3561f875fe77bb96af479b3ca/__main__.py", line 3040, in command_deploy_from 2024-03-30T13:58:41.042 INFO:journalctl@ceph.mon.a.smithi099.stdout: File "/var/lib/ceph/98ebaeb8-ee99-11ee-b647-cb9ed24678a4/cephadm.a8f553f8c0a1bbbd91f4e60c8e13381b6fabffa3561f875fe77bb96af479b3ca/__main__.py", line 3075, in _common_deploy 2024-03-30T13:58:41.042 INFO:journalctl@ceph.mon.a.smithi099.stdout: File "/var/lib/ceph/98ebaeb8-ee99-11ee-b647-cb9ed24678a4/cephadm.a8f553f8c0a1bbbd91f4e60c8e13381b6fabffa3561f875fe77bb96af479b3ca/__main__.py", line 3095, in _deploy_daemon_container 2024-03-30T13:58:41.043 INFO:journalctl@ceph.mon.a.smithi099.stdout: File "/var/lib/ceph/98ebaeb8-ee99-11ee-b647-cb9ed24678a4/cephadm.a8f553f8c0a1bbbd91f4e60c8e13381b6fabffa3561f875fe77bb96af479b3ca/__main__.py", line 1067, in deploy_daemon 2024-03-30T13:58:41.043 INFO:journalctl@ceph.mon.a.smithi099.stdout: File "/var/lib/ceph/98ebaeb8-ee99-11ee-b647-cb9ed24678a4/cephadm.a8f553f8c0a1bbbd91f4e60c8e13381b6fabffa3561f875fe77bb96af479b3ca/cephadmlib/call_wrappers.py", line 307, in call_throws 2024-03-30T13:58:41.043 INFO:journalctl@ceph.mon.a.smithi099.stdout: RuntimeError: Failed command: systemctl restart ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4@iscsi.foo.smithi099.qyjuvr: Job for ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4@iscsi.foo.smithi099.qyjuvr.service failed because the control process exited with error code. 2024-03-30T13:58:41.043 INFO:journalctl@ceph.mon.a.smithi099.stdout: See "systemctl status ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4@iscsi.foo.smithi099.qyjuvr.service" and "journalctl -xeu ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4@iscsi.foo.smithi099.qyjuvr.service" for details. 2024-03-30T13:58:41.043 INFO:journalctl@ceph.mon.a.smithi099.stdout: Traceback (most recent call last): 2024-03-30T13:58:41.043 INFO:journalctl@ceph.mon.a.smithi099.stdout: File "/usr/share/ceph/mgr/cephadm/serve.py", line 1114, in _check_daemons 2024-03-30T13:58:41.043 INFO:journalctl@ceph.mon.a.smithi099.stdout: self.mgr._daemon_action(daemon_spec, action=action) 2024-03-30T13:58:41.043 INFO:journalctl@ceph.mon.a.smithi099.stdout: File "/usr/share/ceph/mgr/cephadm/module.py", line 2390, in _daemon_action 2024-03-30T13:58:41.043 INFO:journalctl@ceph.mon.a.smithi099.stdout: CephadmServe(self)._create_daemon(daemon_spec, reconfig=(action == 'reconfig'))) 2024-03-30T13:58:41.043 INFO:journalctl@ceph.mon.a.smithi099.stdout: File "/usr/share/ceph/mgr/cephadm/module.py", line 747, in wait_async 2024-03-30T13:58:41.043 INFO:journalctl@ceph.mon.a.smithi099.stdout: return self.event_loop.get_result(coro, timeout) 2024-03-30T13:58:41.043 INFO:journalctl@ceph.mon.a.smithi099.stdout: File "/usr/share/ceph/mgr/cephadm/ssh.py", line 136, in get_result 2024-03-30T13:58:41.043 INFO:journalctl@ceph.mon.a.smithi099.stdout: return future.result(timeout) 2024-03-30T13:58:41.044 INFO:journalctl@ceph.mon.a.smithi099.stdout: File "/lib64/python3.6/concurrent/futures/_base.py", line 432, in result 2024-03-30T13:58:41.044 INFO:journalctl@ceph.mon.a.smithi099.stdout: return self.__get_result() 2024-03-30T13:58:41.044 INFO:journalctl@ceph.mon.a.smithi099.stdout: File "/lib64/python3.6/concurrent/futures/_base.py", line 384, in __get_result 2024-03-30T13:58:41.044 INFO:journalctl@ceph.mon.a.smithi099.stdout: raise self._exception 2024-03-30T13:58:41.044 INFO:journalctl@ceph.mon.a.smithi099.stdout: File "/usr/share/ceph/mgr/cephadm/serve.py", line 1374, in _create_daemon 2024-03-30T13:58:41.044 INFO:journalctl@ceph.mon.a.smithi099.stdout: config_blobs=daemon_spec.final_config, 2024-03-30T13:58:41.044 INFO:journalctl@ceph.mon.a.smithi099.stdout: File "/usr/share/ceph/mgr/cephadm/serve.py", line 1685, in _run_cephadm 2024-03-30T13:58:41.044 INFO:journalctl@ceph.mon.a.smithi099.stdout: f'cephadm exited with an error code: {code}, stderr: {err}') 2024-03-30T13:58:41.044 INFO:journalctl@ceph.mon.a.smithi099.stdout: orchestrator._interface.OrchestratorError: cephadm exited with an error code: 1, stderr: Reconfig daemon iscsi.foo.smithi099.qyjuvr ... 2024-03-30T13:58:41.044 INFO:journalctl@ceph.mon.a.smithi099.stdout: Creating ceph-iscsi config... 2024-03-30T13:58:41.044 INFO:journalctl@ceph.mon.a.smithi099.stdout: Write file: /var/lib/ceph/98ebaeb8-ee99-11ee-b647-cb9ed24678a4/iscsi.foo.smithi099.qyjuvr/iscsi-gateway.cfg 2024-03-30T13:58:41.044 INFO:journalctl@ceph.mon.a.smithi099.stdout: Write file: /var/lib/ceph/98ebaeb8-ee99-11ee-b647-cb9ed24678a4/iscsi.foo.smithi099.qyjuvr/tcmu-runner-entrypoint.sh 2024-03-30T13:58:41.044 INFO:journalctl@ceph.mon.a.smithi099.stdout: Non-zero exit code 1 from systemctl restart ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4@iscsi.foo.smithi099.qyjuvr 2024-03-30T13:58:41.044 INFO:journalctl@ceph.mon.a.smithi099.stdout: systemctl: stderr Job for ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4@iscsi.foo.smithi099.qyjuvr.service failed because the control process exited with error code. 2024-03-30T13:58:41.045 INFO:journalctl@ceph.mon.a.smithi099.stdout: systemctl: stderr See "systemctl status ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4@iscsi.foo.smithi099.qyjuvr.service" and "journalctl -xeu ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4@iscsi.foo.smithi099.qyjuvr.service" for details. 2024-03-30T13:58:41.045 INFO:journalctl@ceph.mon.a.smithi099.stdout: Traceback (most recent call last): 2024-03-30T13:58:41.045 INFO:journalctl@ceph.mon.a.smithi099.stdout: File "/usr/lib64/python3.9/runpy.py", line 197, in _run_module_as_main 2024-03-30T13:58:41.045 INFO:journalctl@ceph.mon.a.smithi099.stdout: return _run_code(code, main_globals, None, 2024-03-30T13:58:41.045 INFO:journalctl@ceph.mon.a.smithi099.stdout: File "/usr/lib64/python3.9/runpy.py", line 87, in _run_code 2024-03-30T13:58:41.045 INFO:journalctl@ceph.mon.a.smithi099.stdout: exec(code, run_globals) 2024-03-30T13:58:41.045 INFO:journalctl@ceph.mon.a.smithi099.stdout: File "/var/lib/ceph/98ebaeb8-ee99-11ee-b647-cb9ed24678a4/cephadm.a8f553f8c0a1bbbd91f4e60c8e13381b6fabffa3561f875fe77bb96af479b3ca/__main__.py", line 5528, in 2024-03-30T13:58:41.045 INFO:journalctl@ceph.mon.a.smithi099.stdout: File "/var/lib/ceph/98ebaeb8-ee99-11ee-b647-cb9ed24678a4/cephadm.a8f553f8c0a1bbbd91f4e60c8e13381b6fabffa3561f875fe77bb96af479b3ca/__main__.py", line 5516, in main 2024-03-30T13:58:41.045 INFO:journalctl@ceph.mon.a.smithi099.stdout: File "/var/lib/ceph/98ebaeb8-ee99-11ee-b647-cb9ed24678a4/cephadm.a8f553f8c0a1bbbd91f4e60c8e13381b6fabffa3561f875fe77bb96af479b3ca/__main__.py", line 3040, in command_deploy_from 2024-03-30T13:58:41.045 INFO:journalctl@ceph.mon.a.smithi099.stdout: File "/var/lib/ceph/98ebaeb8-ee99-11ee-b647-cb9ed24678a4/cephadm.a8f553f8c0a1bbbd91f4e60c8e13381b6fabffa3561f875fe77bb96af479b3ca/__main__.py", line 3075, in _common_deploy 2024-03-30T13:58:41.045 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:40 smithi099 ceph-mon[29691]: cephadm exited with an error code: 1, stderr: Reconfig daemon iscsi.foo.smithi099.qyjuvr ... 2024-03-30T13:58:41.045 INFO:journalctl@ceph.mon.c.smithi099.stdout: Creating ceph-iscsi config... 2024-03-30T13:58:41.046 INFO:journalctl@ceph.mon.c.smithi099.stdout: Write file: /var/lib/ceph/98ebaeb8-ee99-11ee-b647-cb9ed24678a4/iscsi.foo.smithi099.qyjuvr/iscsi-gateway.cfg 2024-03-30T13:58:41.046 INFO:journalctl@ceph.mon.c.smithi099.stdout: Write file: /var/lib/ceph/98ebaeb8-ee99-11ee-b647-cb9ed24678a4/iscsi.foo.smithi099.qyjuvr/tcmu-runner-entrypoint.sh 2024-03-30T13:58:41.046 INFO:journalctl@ceph.mon.c.smithi099.stdout: Non-zero exit code 1 from systemctl restart ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4@iscsi.foo.smithi099.qyjuvr 2024-03-30T13:58:41.046 INFO:journalctl@ceph.mon.c.smithi099.stdout: systemctl: stderr Job for ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4@iscsi.foo.smithi099.qyjuvr.service failed because the control process exited with error code. 2024-03-30T13:58:41.046 INFO:journalctl@ceph.mon.c.smithi099.stdout: systemctl: stderr See "systemctl status ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4@iscsi.foo.smithi099.qyjuvr.service" and "journalctl -xeu ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4@iscsi.foo.smithi099.qyjuvr.service" for details. 2024-03-30T13:58:41.046 INFO:journalctl@ceph.mon.c.smithi099.stdout: Traceback (most recent call last): 2024-03-30T13:58:41.046 INFO:journalctl@ceph.mon.c.smithi099.stdout: File "/usr/lib64/python3.9/runpy.py", line 197, in _run_module_as_main 2024-03-30T13:58:41.046 INFO:journalctl@ceph.mon.c.smithi099.stdout: return _run_code(code, main_globals, None, 2024-03-30T13:58:41.046 INFO:journalctl@ceph.mon.c.smithi099.stdout: File "/usr/lib64/python3.9/runpy.py", line 87, in _run_code 2024-03-30T13:58:41.046 INFO:journalctl@ceph.mon.c.smithi099.stdout: exec(code, run_globals) 2024-03-30T13:58:41.046 INFO:journalctl@ceph.mon.c.smithi099.stdout: File "/var/lib/ceph/98ebaeb8-ee99-11ee-b647-cb9ed24678a4/cephadm.a8f553f8c0a1bbbd91f4e60c8e13381b6fabffa3561f875fe77bb96af479b3ca/__main__.py", line 5528, in 2024-03-30T13:58:41.046 INFO:journalctl@ceph.mon.c.smithi099.stdout: File "/var/lib/ceph/98ebaeb8-ee99-11ee-b647-cb9ed24678a4/cephadm.a8f553f8c0a1bbbd91f4e60c8e13381b6fabffa3561f875fe77bb96af479b3ca/__main__.py", line 5516, in main 2024-03-30T13:58:41.046 INFO:journalctl@ceph.mon.c.smithi099.stdout: File "/var/lib/ceph/98ebaeb8-ee99-11ee-b647-cb9ed24678a4/cephadm.a8f553f8c0a1bbbd91f4e60c8e13381b6fabffa3561f875fe77bb96af479b3ca/__main__.py", line 3040, in command_deploy_from 2024-03-30T13:58:41.046 INFO:journalctl@ceph.mon.c.smithi099.stdout: File "/var/lib/ceph/98ebaeb8-ee99-11ee-b647-cb9ed24678a4/cephadm.a8f553f8c0a1bbbd91f4e60c8e13381b6fabffa3561f875fe77bb96af479b3ca/__main__.py", line 3075, in _common_deploy 2024-03-30T13:58:41.047 INFO:journalctl@ceph.mon.c.smithi099.stdout: File "/var/lib/ceph/98ebaeb8-ee99-11ee-b647-cb9ed24678a4/cephadm.a8f553f8c0a1bbbd91f4e60c8e13381b6fabffa3561f875fe77bb96af479b3ca/__main__.py", line 3095, in _deploy_daemon_container 2024-03-30T13:58:41.047 INFO:journalctl@ceph.mon.c.smithi099.stdout: File "/var/lib/ceph/98ebaeb8-ee99-11ee-b647-cb9ed24678a4/cephadm.a8f553f8c0a1bbbd91f4e60c8e13381b6fabffa3561f875fe77bb96af479b3ca/__main__.py", line 1067, in deploy_daemon 2024-03-30T13:58:41.047 INFO:journalctl@ceph.mon.c.smithi099.stdout: File "/var/lib/ceph/98ebaeb8-ee99-11ee-b647-cb9ed24678a4/cephadm.a8f553f8c0a1bbbd91f4e60c8e13381b6fabffa3561f875fe77bb96af479b3ca/cephadmlib/call_wrappers.py", line 307, in call_throws 2024-03-30T13:58:41.047 INFO:journalctl@ceph.mon.c.smithi099.stdout: RuntimeError: Failed command: systemctl restart ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4@iscsi.foo.smithi099.qyjuvr: Job for ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4@iscsi.foo.smithi099.qyjuvr.service failed because the control process exited with error code. 2024-03-30T13:58:41.047 INFO:journalctl@ceph.mon.c.smithi099.stdout: See "systemctl status ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4@iscsi.foo.smithi099.qyjuvr.service" and "journalctl -xeu ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4@iscsi.foo.smithi099.qyjuvr.service" for details. 2024-03-30T13:58:41.047 INFO:journalctl@ceph.mon.c.smithi099.stdout: Traceback (most recent call last): 2024-03-30T13:58:41.047 INFO:journalctl@ceph.mon.c.smithi099.stdout: File "/usr/share/ceph/mgr/cephadm/serve.py", line 1114, in _check_daemons 2024-03-30T13:58:41.047 INFO:journalctl@ceph.mon.c.smithi099.stdout: self.mgr._daemon_action(daemon_spec, action=action) 2024-03-30T13:58:41.047 INFO:journalctl@ceph.mon.c.smithi099.stdout: File "/usr/share/ceph/mgr/cephadm/module.py", line 2390, in _daemon_action 2024-03-30T13:58:41.047 INFO:journalctl@ceph.mon.c.smithi099.stdout: CephadmServe(self)._create_daemon(daemon_spec, reconfig=(action == 'reconfig'))) 2024-03-30T13:58:41.047 INFO:journalctl@ceph.mon.c.smithi099.stdout: File "/usr/share/ceph/mgr/cephadm/module.py", line 747, in wait_async 2024-03-30T13:58:41.047 INFO:journalctl@ceph.mon.c.smithi099.stdout: return self.event_loop.get_result(coro, timeout) 2024-03-30T13:58:41.047 INFO:journalctl@ceph.mon.c.smithi099.stdout: File "/usr/share/ceph/mgr/cephadm/ssh.py", line 136, in get_result 2024-03-30T13:58:41.047 INFO:journalctl@ceph.mon.c.smithi099.stdout: return future.result(timeout) 2024-03-30T13:58:41.047 INFO:journalctl@ceph.mon.c.smithi099.stdout: File "/lib64/python3.6/concurrent/futures/_base.py", line 432, in result 2024-03-30T13:58:41.048 INFO:journalctl@ceph.mon.c.smithi099.stdout: return self.__get_result() 2024-03-30T13:58:41.048 INFO:journalctl@ceph.mon.c.smithi099.stdout: File "/lib64/python3.6/concurrent/futures/_base.py", line 384, in __get_result 2024-03-30T13:58:41.048 INFO:journalctl@ceph.mon.c.smithi099.stdout: raise self._exception 2024-03-30T13:58:41.048 INFO:journalctl@ceph.mon.c.smithi099.stdout: File "/usr/share/ceph/mgr/cephadm/serve.py", line 1374, in _create_daemon 2024-03-30T13:58:41.048 INFO:journalctl@ceph.mon.c.smithi099.stdout: config_blobs=daemon_spec.final_config, 2024-03-30T13:58:41.048 INFO:journalctl@ceph.mon.c.smithi099.stdout: File "/usr/share/ceph/mgr/cephadm/serve.py", line 1685, in _run_cephadm 2024-03-30T13:58:41.048 INFO:journalctl@ceph.mon.c.smithi099.stdout: f'cephadm exited with an error code: {code}, stderr: {err}') 2024-03-30T13:58:41.048 INFO:journalctl@ceph.mon.c.smithi099.stdout: orchestrator._interface.OrchestratorError: cephadm exited with an error code: 1, stderr: Reconfig daemon iscsi.foo.smithi099.qyjuvr ... 2024-03-30T13:58:41.048 INFO:journalctl@ceph.mon.c.smithi099.stdout: Creating ceph-iscsi config... 2024-03-30T13:58:41.048 INFO:journalctl@ceph.mon.c.smithi099.stdout: Write file: /var/lib/ceph/98ebaeb8-ee99-11ee-b647-cb9ed24678a4/iscsi.foo.smithi099.qyjuvr/iscsi-gateway.cfg 2024-03-30T13:58:41.048 INFO:journalctl@ceph.mon.c.smithi099.stdout: Write file: /var/lib/ceph/98ebaeb8-ee99-11ee-b647-cb9ed24678a4/iscsi.foo.smithi099.qyjuvr/tcmu-runner-entrypoint.sh 2024-03-30T13:58:41.048 INFO:journalctl@ceph.mon.c.smithi099.stdout: Non-zero exit code 1 from systemctl restart ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4@iscsi.foo.smithi099.qyjuvr 2024-03-30T13:58:41.048 INFO:journalctl@ceph.mon.c.smithi099.stdout: systemctl: stderr Job for ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4@iscsi.foo.smithi099.qyjuvr.service failed because the control process exited with error code. 2024-03-30T13:58:41.048 INFO:journalctl@ceph.mon.c.smithi099.stdout: systemctl: stderr See "systemctl status ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4@iscsi.foo.smithi099.qyjuvr.service" and "journalctl -xeu ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4@iscsi.foo.smithi099.qyjuvr.service" for details. 2024-03-30T13:58:41.048 INFO:journalctl@ceph.mon.c.smithi099.stdout: Traceback (most recent call last): 2024-03-30T13:58:41.049 INFO:journalctl@ceph.mon.c.smithi099.stdout: File "/usr/lib64/python3.9/runpy.py", line 197, in _run_module_as_main 2024-03-30T13:58:41.049 INFO:journalctl@ceph.mon.c.smithi099.stdout: return _run_code(code, main_globals, None, 2024-03-30T13:58:41.049 INFO:journalctl@ceph.mon.c.smithi099.stdout: File "/usr/lib64/python3.9/runpy.py", line 87, in _run_code 2024-03-30T13:58:41.049 INFO:journalctl@ceph.mon.c.smithi099.stdout: exec(code, run_globals) 2024-03-30T13:58:41.049 INFO:journalctl@ceph.mon.c.smithi099.stdout: File "/var/lib/ceph/98ebaeb8-ee99-11ee-b647-cb9ed24678a4/cephadm.a8f553f8c0a1bbbd91f4e60c8e13381b6fabffa3561f875fe77bb96af479b3ca/__main__.py", line 5528, in 2024-03-30T13:58:41.049 INFO:journalctl@ceph.mon.c.smithi099.stdout: File "/var/lib/ceph/98ebaeb8-ee99-11ee-b647-cb9ed24678a4/cephadm.a8f553f8c0a1bbbd91f4e60c8e13381b6fabffa3561f875fe77bb96af479b3ca/__main__.py", line 5516, in main 2024-03-30T13:58:41.049 INFO:journalctl@ceph.mon.c.smithi099.stdout: File "/var/lib/ceph/98ebaeb8-ee99-11ee-b647-cb9ed24678a4/cephadm.a8f553f8c0a1bbbd91f4e60c8e13381b6fabffa3561f875fe77bb96af479b3ca/__main__.py", line 3040, in command_deploy_from 2024-03-30T13:58:41.049 INFO:journalctl@ceph.mon.c.smithi099.stdout: File "/var/lib/ceph/98ebaeb8-ee99-11ee-b647-cb9ed24678a4/cephadm.a8f553f8c0a1bbbd91f4e60c8e13381b6fabffa3561f875fe77bb96af479b3ca/__main__.py", line 3075, in _common_deploy 2024-03-30T13:58:41.049 INFO:journalctl@ceph.mon.a.smithi099.stdout: File "/var/lib/ceph/98ebaeb8-ee99-11ee-b647-cb9ed24678a4/cephadm.a8f553f8c0a1bbbd91f4e60c8e13381b6fabffa3561f875fe77bb96af479b3ca/__main__.py", line 3095, in _deploy_daemon_container 2024-03-30T13:58:41.049 INFO:journalctl@ceph.mon.a.smithi099.stdout: File "/var/lib/ceph/98ebaeb8-ee99-11ee-b647-cb9ed24678a4/cephadm.a8f553f8c0a1bbbd91f4e60c8e13381b6fabffa3561f875fe77bb96af479b3ca/__main__.py", line 1067, in deploy_daemon 2024-03-30T13:58:41.050 INFO:journalctl@ceph.mon.a.smithi099.stdout: File "/var/lib/ceph/98ebaeb8-ee99-11ee-b647-cb9ed24678a4/cephadm.a8f553f8c0a1bbbd91f4e60c8e13381b6fabffa3561f875fe77bb96af479b3ca/cephadmlib/call_wrappers.py", line 307, in call_throws 2024-03-30T13:58:41.050 INFO:journalctl@ceph.mon.a.smithi099.stdout: RuntimeError: Failed command: systemctl restart ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4@iscsi.foo.smithi099.qyjuvr: Job for ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4@iscsi.foo.smithi099.qyjuvr.service failed because the control process exited with error code. 2024-03-30T13:58:41.050 INFO:journalctl@ceph.mon.a.smithi099.stdout: See "systemctl status ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4@iscsi.foo.smithi099.qyjuvr.service" and "journalctl -xeu ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4@iscsi.foo.smithi099.qyjuvr.service" for details. 2024-03-30T13:58:41.050 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:40 smithi099 ceph-mon[24912]: Upgrade: Setting container_image for all mgr 2024-03-30T13:58:41.050 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:40 smithi099 ceph-mon[24912]: pgmap v26: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 121 B/s rd, 0 op/s 2024-03-30T13:58:41.050 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:40 smithi099 ceph-mon[24912]: pgmap v27: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 160 B/s rd, 0 op/s 2024-03-30T13:58:41.050 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:40 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:58:41.050 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:40 smithi099 ceph-mon[24912]: Reconfiguring iscsi.foo.smithi099.qyjuvr (dependencies changed)... 2024-03-30T13:58:41.050 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:40 smithi099 ceph-mon[24912]: Reconfiguring daemon iscsi.foo.smithi099.qyjuvr on smithi099 2024-03-30T13:58:41.050 INFO:journalctl@ceph.mon.c.smithi099.stdout: File "/var/lib/ceph/98ebaeb8-ee99-11ee-b647-cb9ed24678a4/cephadm.a8f553f8c0a1bbbd91f4e60c8e13381b6fabffa3561f875fe77bb96af479b3ca/__main__.py", line 3095, in _deploy_daemon_container 2024-03-30T13:58:41.051 INFO:journalctl@ceph.mon.c.smithi099.stdout: File "/var/lib/ceph/98ebaeb8-ee99-11ee-b647-cb9ed24678a4/cephadm.a8f553f8c0a1bbbd91f4e60c8e13381b6fabffa3561f875fe77bb96af479b3ca/__main__.py", line 1067, in deploy_daemon 2024-03-30T13:58:41.051 INFO:journalctl@ceph.mon.c.smithi099.stdout: File "/var/lib/ceph/98ebaeb8-ee99-11ee-b647-cb9ed24678a4/cephadm.a8f553f8c0a1bbbd91f4e60c8e13381b6fabffa3561f875fe77bb96af479b3ca/cephadmlib/call_wrappers.py", line 307, in call_throws 2024-03-30T13:58:41.051 INFO:journalctl@ceph.mon.c.smithi099.stdout: RuntimeError: Failed command: systemctl restart ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4@iscsi.foo.smithi099.qyjuvr: Job for ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4@iscsi.foo.smithi099.qyjuvr.service failed because the control process exited with error code. 2024-03-30T13:58:41.051 INFO:journalctl@ceph.mon.c.smithi099.stdout: See "systemctl status ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4@iscsi.foo.smithi099.qyjuvr.service" and "journalctl -xeu ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4@iscsi.foo.smithi099.qyjuvr.service" for details. 2024-03-30T13:58:41.051 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:40 smithi099 ceph-mon[29691]: Upgrade: Setting container_image for all mgr 2024-03-30T13:58:41.051 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:40 smithi099 ceph-mon[29691]: pgmap v26: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 121 B/s rd, 0 op/s 2024-03-30T13:58:41.051 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:40 smithi099 ceph-mon[29691]: pgmap v27: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 160 B/s rd, 0 op/s 2024-03-30T13:58:41.051 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:40 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:58:41.051 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:40 smithi099 ceph-mon[29691]: Reconfiguring iscsi.foo.smithi099.qyjuvr (dependencies changed)... 2024-03-30T13:58:41.051 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:40 smithi099 ceph-mon[29691]: Reconfiguring daemon iscsi.foo.smithi099.qyjuvr on smithi099 2024-03-30T13:58:41.656 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 13:58:41 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-x[73105]: 2024-03-30T13:58:41.449+0000 7f077261c200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-03-30T13:58:42.346 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 13:58:42 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-x[73105]: 2024-03-30T13:58:42.054+0000 7f077261c200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-03-30T13:58:42.347 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 13:58:42 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-x[73105]: 2024-03-30T13:58:42.171+0000 7f077261c200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-03-30T13:58:42.632 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 13:58:42 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-x[73105]: 2024-03-30T13:58:42.444+0000 7f077261c200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-03-30T13:58:42.632 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 13:58:42 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-x[73105]: [30/Mar/2024:13:58:42] ENGINE Bus STARTING 2024-03-30T13:58:42.632 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 13:58:42 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-x[73105]: CherryPy Checker: 2024-03-30T13:58:42.633 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 13:58:42 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-x[73105]: The Application mounted at '' has an empty config. 2024-03-30T13:58:42.633 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 13:58:42 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-x[73105]: 2024-03-30T13:58:42.633 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 13:58:42 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-x[73105]: [30/Mar/2024:13:58:42] ENGINE Serving on http://:::9283 2024-03-30T13:58:42.633 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 13:58:42 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-x[73105]: [30/Mar/2024:13:58:42] ENGINE Bus STARTED 2024-03-30T13:58:42.994 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:42 smithi099 ceph-mon[24912]: pgmap v28: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 160 B/s rd, 0 op/s 2024-03-30T13:58:42.994 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:42 smithi099 ceph-mon[24912]: Standby manager daemon x restarted 2024-03-30T13:58:42.994 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:42 smithi099 ceph-mon[24912]: Standby manager daemon x started 2024-03-30T13:58:42.994 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:42 smithi099 ceph-mon[24912]: from='mgr.? 172.21.15.181:0/1297493026' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/crt"}]: dispatch 2024-03-30T13:58:42.994 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:42 smithi099 ceph-mon[24912]: from='mgr.? 172.21.15.181:0/1297493026' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-03-30T13:58:42.994 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:42 smithi099 ceph-mon[24912]: from='mgr.? 172.21.15.181:0/1297493026' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/key"}]: dispatch 2024-03-30T13:58:42.994 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:42 smithi099 ceph-mon[24912]: from='mgr.? 172.21.15.181:0/1297493026' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-03-30T13:58:42.995 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:42 smithi099 ceph-mon[29691]: pgmap v28: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 160 B/s rd, 0 op/s 2024-03-30T13:58:42.995 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:42 smithi099 ceph-mon[29691]: Standby manager daemon x restarted 2024-03-30T13:58:42.995 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:42 smithi099 ceph-mon[29691]: Standby manager daemon x started 2024-03-30T13:58:42.995 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:42 smithi099 ceph-mon[29691]: from='mgr.? 172.21.15.181:0/1297493026' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/crt"}]: dispatch 2024-03-30T13:58:42.995 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:42 smithi099 ceph-mon[29691]: from='mgr.? 172.21.15.181:0/1297493026' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-03-30T13:58:42.995 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:42 smithi099 ceph-mon[29691]: from='mgr.? 172.21.15.181:0/1297493026' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/key"}]: dispatch 2024-03-30T13:58:42.995 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:42 smithi099 ceph-mon[29691]: from='mgr.? 172.21.15.181:0/1297493026' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-03-30T13:58:43.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:42 smithi181 ceph-mon[25762]: pgmap v28: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 160 B/s rd, 0 op/s 2024-03-30T13:58:43.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:42 smithi181 ceph-mon[25762]: Standby manager daemon x restarted 2024-03-30T13:58:43.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:42 smithi181 ceph-mon[25762]: Standby manager daemon x started 2024-03-30T13:58:43.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:42 smithi181 ceph-mon[25762]: from='mgr.? 172.21.15.181:0/1297493026' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/crt"}]: dispatch 2024-03-30T13:58:43.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:42 smithi181 ceph-mon[25762]: from='mgr.? 172.21.15.181:0/1297493026' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-03-30T13:58:43.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:42 smithi181 ceph-mon[25762]: from='mgr.? 172.21.15.181:0/1297493026' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/key"}]: dispatch 2024-03-30T13:58:43.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:42 smithi181 ceph-mon[25762]: from='mgr.? 172.21.15.181:0/1297493026' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-03-30T13:58:44.139 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:43 smithi181 ceph-mon[25762]: mgrmap e41: y(active, since 28s), standbys: x 2024-03-30T13:58:44.139 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:43 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:58:44.139 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:43 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:58:44.139 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:43 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "dashboard iscsi-gateway-list"}]: dispatch 2024-03-30T13:58:44.139 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:43 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "dashboard set-iscsi-api-ssl-verification", "value": "true"}]: dispatch 2024-03-30T13:58:44.139 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:43 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:58:44.139 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:43 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:58:44.139 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:43 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:58:44.139 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:43 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:58:44.140 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:43 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:58:44.140 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:43 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:58:44.140 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:43 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:58:44.140 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:43 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:58:44.140 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:43 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:58:44.140 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:43 smithi181 ceph-mon[25762]: from='client.? 172.21.15.99:0/2133125663' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-03-30T13:58:44.218 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:43 smithi099 ceph-mon[24912]: mgrmap e41: y(active, since 28s), standbys: x 2024-03-30T13:58:44.219 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:43 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:58:44.219 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:43 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:58:44.219 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:43 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "dashboard iscsi-gateway-list"}]: dispatch 2024-03-30T13:58:44.219 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:43 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "dashboard set-iscsi-api-ssl-verification", "value": "true"}]: dispatch 2024-03-30T13:58:44.219 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:43 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:58:44.219 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:43 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:58:44.219 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:43 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:58:44.219 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:43 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:58:44.219 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:43 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:58:44.219 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:43 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:58:44.219 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:43 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:58:44.219 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:43 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:58:44.220 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:43 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:58:44.220 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:43 smithi099 ceph-mon[24912]: from='client.? 172.21.15.99:0/2133125663' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-03-30T13:58:44.220 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:43 smithi099 ceph-mon[29691]: mgrmap e41: y(active, since 28s), standbys: x 2024-03-30T13:58:44.220 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:43 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:58:44.220 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:43 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:58:44.220 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:43 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "dashboard iscsi-gateway-list"}]: dispatch 2024-03-30T13:58:44.220 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:43 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "dashboard set-iscsi-api-ssl-verification", "value": "true"}]: dispatch 2024-03-30T13:58:44.220 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:43 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:58:44.220 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:43 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:58:44.220 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:43 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:58:44.220 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:43 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:58:44.221 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:43 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:58:44.221 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:43 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:58:44.221 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:43 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:58:44.221 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:43 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:58:44.221 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:43 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:58:44.221 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:43 smithi099 ceph-mon[29691]: from='client.? 172.21.15.99:0/2133125663' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-03-30T13:58:45.056 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:44 smithi099 ceph-mon[29691]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard iscsi-gateway-list"}]: dispatch 2024-03-30T13:58:45.056 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:44 smithi099 ceph-mon[29691]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard set-iscsi-api-ssl-verification", "value": "true"}]: dispatch 2024-03-30T13:58:45.056 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:44 smithi099 ceph-mon[29691]: pgmap v29: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 404 B/s rd, 0 op/s 2024-03-30T13:58:45.056 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:44 smithi099 ceph-mon[29691]: pgmap v30: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 404 B/s rd, 0 op/s 2024-03-30T13:58:45.057 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:44 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:58:45.057 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:44 smithi099 ceph-mon[29691]: pgmap v31: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 359 B/s rd, 0 op/s 2024-03-30T13:58:45.057 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:44 smithi099 ceph-mon[29691]: pgmap v32: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 505 B/s rd, 0 op/s 2024-03-30T13:58:45.057 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:44 smithi099 ceph-mon[24912]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard iscsi-gateway-list"}]: dispatch 2024-03-30T13:58:45.057 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:44 smithi099 ceph-mon[24912]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard set-iscsi-api-ssl-verification", "value": "true"}]: dispatch 2024-03-30T13:58:45.057 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:44 smithi099 ceph-mon[24912]: pgmap v29: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 404 B/s rd, 0 op/s 2024-03-30T13:58:45.057 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:44 smithi099 ceph-mon[24912]: pgmap v30: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 404 B/s rd, 0 op/s 2024-03-30T13:58:45.057 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:44 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:58:45.057 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:44 smithi099 ceph-mon[24912]: pgmap v31: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 359 B/s rd, 0 op/s 2024-03-30T13:58:45.057 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:44 smithi099 ceph-mon[24912]: pgmap v32: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 505 B/s rd, 0 op/s 2024-03-30T13:58:45.058 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:58:44 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[71049]: ::ffff:172.21.15.181 - - [30/Mar/2024:13:58:44] "GET /metrics HTTP/1.1" 200 37995 "" "Prometheus/2.33.4" 2024-03-30T13:58:45.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:44 smithi181 ceph-mon[25762]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard iscsi-gateway-list"}]: dispatch 2024-03-30T13:58:45.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:44 smithi181 ceph-mon[25762]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard set-iscsi-api-ssl-verification", "value": "true"}]: dispatch 2024-03-30T13:58:45.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:44 smithi181 ceph-mon[25762]: pgmap v29: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 404 B/s rd, 0 op/s 2024-03-30T13:58:45.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:44 smithi181 ceph-mon[25762]: pgmap v30: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 404 B/s rd, 0 op/s 2024-03-30T13:58:45.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:44 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:58:45.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:44 smithi181 ceph-mon[25762]: pgmap v31: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 359 B/s rd, 0 op/s 2024-03-30T13:58:45.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:44 smithi181 ceph-mon[25762]: pgmap v32: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 505 B/s rd, 0 op/s 2024-03-30T13:58:46.081 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:45 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T13:58:46.081 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:45 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T13:58:46.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:45 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T13:58:47.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:46 smithi181 ceph-mon[25762]: pgmap v33: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 338 B/s rd, 0 op/s 2024-03-30T13:58:47.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:46 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:58:47.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:46 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:58:47.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:46 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:58:47.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:46 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-03-30T13:58:47.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:46 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-03-30T13:58:47.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:46 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "mgr services"}]: dispatch 2024-03-30T13:58:47.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:46 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:58:47.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:46 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:58:47.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:46 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:58:47.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:46 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:58:47.137 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:46 smithi099 ceph-mon[24912]: pgmap v33: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 338 B/s rd, 0 op/s 2024-03-30T13:58:47.138 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:46 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:58:47.138 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:46 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:58:47.138 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:46 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:58:47.138 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:46 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-03-30T13:58:47.138 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:46 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-03-30T13:58:47.138 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:46 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "mgr services"}]: dispatch 2024-03-30T13:58:47.138 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:46 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:58:47.138 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:46 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:58:47.138 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:46 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:58:47.138 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:46 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:58:47.138 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:46 smithi099 ceph-mon[29691]: pgmap v33: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 338 B/s rd, 0 op/s 2024-03-30T13:58:47.139 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:46 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:58:47.139 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:46 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:58:47.139 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:46 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:58:47.139 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:46 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-03-30T13:58:47.139 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:46 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-03-30T13:58:47.139 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:46 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "mgr services"}]: dispatch 2024-03-30T13:58:47.139 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:46 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:58:47.139 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:46 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:58:47.139 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:46 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:58:47.139 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:46 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:58:47.988 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:47 smithi181 ceph-mon[25762]: pgmap v34: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 421 B/s rd, 0 op/s 2024-03-30T13:58:47.988 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:47 smithi181 ceph-mon[25762]: pgmap v35: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:58:47.988 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:47 smithi181 ceph-mon[25762]: Upgrade: Updating mgr.x 2024-03-30T13:58:47.988 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:47 smithi181 ceph-mon[25762]: Deploying daemon mgr.x on smithi181 2024-03-30T13:58:47.988 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:47 smithi181 ceph-mon[25762]: pgmap v36: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-03-30T13:58:47.988 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:47 smithi181 ceph-mon[25762]: pgmap v37: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-03-30T13:58:47.988 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:47 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:58:47.988 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:47 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:58:47.988 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:47 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:58:47.988 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:47 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:58:47.988 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:47 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:58:47.988 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:47 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:58:48.082 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:47 smithi099 ceph-mon[29691]: pgmap v34: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 421 B/s rd, 0 op/s 2024-03-30T13:58:48.082 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:47 smithi099 ceph-mon[29691]: pgmap v35: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:58:48.082 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:47 smithi099 ceph-mon[29691]: Upgrade: Updating mgr.x 2024-03-30T13:58:48.082 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:47 smithi099 ceph-mon[29691]: Deploying daemon mgr.x on smithi181 2024-03-30T13:58:48.083 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:47 smithi099 ceph-mon[29691]: pgmap v36: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-03-30T13:58:48.083 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:47 smithi099 ceph-mon[29691]: pgmap v37: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-03-30T13:58:48.083 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:47 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:58:48.083 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:47 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:58:48.083 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:47 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:58:48.083 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:47 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:58:48.083 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:47 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:58:48.083 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:47 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:58:48.084 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:47 smithi099 ceph-mon[24912]: pgmap v34: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 421 B/s rd, 0 op/s 2024-03-30T13:58:48.084 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:47 smithi099 ceph-mon[24912]: pgmap v35: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:58:48.084 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:47 smithi099 ceph-mon[24912]: Upgrade: Updating mgr.x 2024-03-30T13:58:48.084 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:47 smithi099 ceph-mon[24912]: Deploying daemon mgr.x on smithi181 2024-03-30T13:58:48.084 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:47 smithi099 ceph-mon[24912]: pgmap v36: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-03-30T13:58:48.084 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:47 smithi099 ceph-mon[24912]: pgmap v37: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-03-30T13:58:48.084 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:47 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:58:48.084 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:47 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:58:48.084 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:47 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:58:48.084 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:47 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:58:48.084 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:47 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:58:48.084 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:47 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:58:48.530 INFO:teuthology.orchestra.run.smithi099.stdout:true 2024-03-30T13:58:49.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:48 smithi181 ceph-mon[25762]: pgmap v38: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 974 B/s rd, 1 op/s 2024-03-30T13:58:49.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:48 smithi181 ceph-mon[25762]: pgmap v39: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 1.8 KiB/s rd, 2 op/s 2024-03-30T13:58:49.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:48 smithi181 ceph-mon[25762]: pgmap v40: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-03-30T13:58:49.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:48 smithi181 ceph-mon[25762]: pgmap v41: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-03-30T13:58:49.173 INFO:teuthology.orchestra.run.smithi099.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-03-30T13:58:49.173 INFO:teuthology.orchestra.run.smithi099.stdout:agent.smithi099 smithi099 running 1s ago 27m - - 2024-03-30T13:58:49.173 INFO:teuthology.orchestra.run.smithi099.stdout:agent.smithi181 smithi181 running 1s ago 26m - - 2024-03-30T13:58:49.173 INFO:teuthology.orchestra.run.smithi099.stdout:alertmanager.a smithi099 *:9093,9094 running (13m) 1s ago 21m 23.4M - 0.23.0 ba2b418f427c 0f1be3801027 2024-03-30T13:58:49.173 INFO:teuthology.orchestra.run.smithi099.stdout:grafana.a smithi181 *:3000 error 1s ago 20m - - 2024-03-30T13:58:49.173 INFO:teuthology.orchestra.run.smithi099.stdout:iscsi.foo.smithi099.qyjuvr smithi099 running (6s) 1s ago 20m - - 3.5 e1d6a67b021e 2f859af6bc2a 2024-03-30T13:58:49.173 INFO:teuthology.orchestra.run.smithi099.stdout:mgr.x smithi181 *:8443,9283,8765 running (14s) 1s ago 26m 448M - 19.0.0-1967-g4e50bbcd b0c4478f1d83 70a65dda3ab0 2024-03-30T13:58:49.173 INFO:teuthology.orchestra.run.smithi099.stdout:mgr.y smithi099 *:8443,9283,8765 running (10m) 1s ago 27m 502M - 19.0.0-1967-g4e50bbcd b0c4478f1d83 0d464b8c1d18 2024-03-30T13:58:49.173 INFO:teuthology.orchestra.run.smithi099.stdout:mon.a smithi099 running (27m) 1s ago 28m 88.5M 2048M 17.2.0 e1d6a67b021e af06ebb19fd8 2024-03-30T13:58:49.173 INFO:teuthology.orchestra.run.smithi099.stdout:mon.b smithi181 running (26m) 1s ago 26m 67.9M 2048M 17.2.0 e1d6a67b021e e678a2a25c90 2024-03-30T13:58:49.173 INFO:teuthology.orchestra.run.smithi099.stdout:mon.c smithi099 running (26m) 1s ago 26m 60.9M 2048M 17.2.0 e1d6a67b021e 0f1e98917718 2024-03-30T13:58:49.173 INFO:teuthology.orchestra.run.smithi099.stdout:node-exporter.a smithi099 *:9100 running (13m) 1s ago 22m 18.3M - 1.3.1 1dbe0e931976 76284405d5f5 2024-03-30T13:58:49.173 INFO:teuthology.orchestra.run.smithi099.stdout:node-exporter.b smithi181 *:9100 running (13m) 1s ago 22m 16.9M - 1.3.1 1dbe0e931976 90245951476f 2024-03-30T13:58:49.174 INFO:teuthology.orchestra.run.smithi099.stdout:osd.0 smithi099 running (26m) 1s ago 25m 54.4M 4096M 17.2.0 e1d6a67b021e 3158ee1b0c67 2024-03-30T13:58:49.174 INFO:teuthology.orchestra.run.smithi099.stdout:osd.1 smithi099 running (25m) 1s ago 25m 57.5M 4096M 17.2.0 e1d6a67b021e c4af0fd7071a 2024-03-30T13:58:49.174 INFO:teuthology.orchestra.run.smithi099.stdout:osd.2 smithi099 running (25m) 1s ago 25m 49.5M 4096M 17.2.0 e1d6a67b021e 8e4e805a7e20 2024-03-30T13:58:49.174 INFO:teuthology.orchestra.run.smithi099.stdout:osd.3 smithi099 running (24m) 1s ago 24m 53.5M 4096M 17.2.0 e1d6a67b021e 718812bcf065 2024-03-30T13:58:49.174 INFO:teuthology.orchestra.run.smithi099.stdout:osd.4 smithi181 running (24m) 1s ago 24m 55.2M 4096M 17.2.0 e1d6a67b021e 5e205434e973 2024-03-30T13:58:49.174 INFO:teuthology.orchestra.run.smithi099.stdout:osd.5 smithi181 running (24m) 1s ago 24m 52.8M 4096M 17.2.0 e1d6a67b021e e330c920f152 2024-03-30T13:58:49.174 INFO:teuthology.orchestra.run.smithi099.stdout:osd.6 smithi181 running (23m) 1s ago 23m 52.0M 4096M 17.2.0 e1d6a67b021e 81d889ea213d 2024-03-30T13:58:49.174 INFO:teuthology.orchestra.run.smithi099.stdout:osd.7 smithi181 running (23m) 1s ago 23m 53.0M 4096M 17.2.0 e1d6a67b021e c08b1839dd7e 2024-03-30T13:58:49.174 INFO:teuthology.orchestra.run.smithi099.stdout:prometheus.a smithi181 *:9095 running (19s) 1s ago 22m 59.6M - 2.33.4 514e6a882f6e 6b662de21f27 2024-03-30T13:58:49.174 INFO:teuthology.orchestra.run.smithi099.stdout:rgw.foo.smithi099.fxjbmp smithi099 *:8000 running (20m) 1s ago 20m 75.4M - 17.2.0 e1d6a67b021e 400b28b3f650 2024-03-30T13:58:49.174 INFO:teuthology.orchestra.run.smithi099.stdout:rgw.foo.smithi181.wfqwti smithi181 *:8000 running (20m) 1s ago 20m 75.4M - 17.2.0 e1d6a67b021e 97e1b130f9d4 2024-03-30T13:58:49.175 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:48 smithi099 ceph-mon[24912]: pgmap v38: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 974 B/s rd, 1 op/s 2024-03-30T13:58:49.175 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:48 smithi099 ceph-mon[24912]: pgmap v39: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 1.8 KiB/s rd, 2 op/s 2024-03-30T13:58:49.175 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:48 smithi099 ceph-mon[24912]: pgmap v40: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-03-30T13:58:49.175 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:48 smithi099 ceph-mon[24912]: pgmap v41: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-03-30T13:58:49.175 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:48 smithi099 ceph-mon[29691]: pgmap v38: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 974 B/s rd, 1 op/s 2024-03-30T13:58:49.175 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:48 smithi099 ceph-mon[29691]: pgmap v39: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 1.8 KiB/s rd, 2 op/s 2024-03-30T13:58:49.175 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:48 smithi099 ceph-mon[29691]: pgmap v40: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-03-30T13:58:49.175 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:48 smithi099 ceph-mon[29691]: pgmap v41: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-03-30T13:58:49.561 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-03-30T13:58:49.561 INFO:teuthology.orchestra.run.smithi099.stdout: "mon": { 2024-03-30T13:58:49.561 INFO:teuthology.orchestra.run.smithi099.stdout: "ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)": 3 2024-03-30T13:58:49.562 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:58:49.562 INFO:teuthology.orchestra.run.smithi099.stdout: "mgr": { 2024-03-30T13:58:49.562 INFO:teuthology.orchestra.run.smithi099.stdout: "ceph version 19.0.0-1967-g4e50bbcd (4e50bbcdd1630c7760b708f3a5b4d38a121e66cb) squid (dev)": 2 2024-03-30T13:58:49.562 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:58:49.562 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": { 2024-03-30T13:58:49.562 INFO:teuthology.orchestra.run.smithi099.stdout: "ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)": 8 2024-03-30T13:58:49.562 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:58:49.562 INFO:teuthology.orchestra.run.smithi099.stdout: "mds": {}, 2024-03-30T13:58:49.562 INFO:teuthology.orchestra.run.smithi099.stdout: "rgw": { 2024-03-30T13:58:49.562 INFO:teuthology.orchestra.run.smithi099.stdout: "ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)": 2 2024-03-30T13:58:49.562 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:58:49.562 INFO:teuthology.orchestra.run.smithi099.stdout: "overall": { 2024-03-30T13:58:49.562 INFO:teuthology.orchestra.run.smithi099.stdout: "ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)": 13, 2024-03-30T13:58:49.563 INFO:teuthology.orchestra.run.smithi099.stdout: "ceph version 19.0.0-1967-g4e50bbcd (4e50bbcdd1630c7760b708f3a5b4d38a121e66cb) squid (dev)": 2 2024-03-30T13:58:49.563 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-03-30T13:58:49.563 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-03-30T13:58:49.890 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-03-30T13:58:49.891 INFO:teuthology.orchestra.run.smithi099.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph:4e50bbcdd1630c7760b708f3a5b4d38a121e66cb", 2024-03-30T13:58:49.891 INFO:teuthology.orchestra.run.smithi099.stdout: "in_progress": true, 2024-03-30T13:58:49.891 INFO:teuthology.orchestra.run.smithi099.stdout: "which": "Upgrading daemons of type(s) mgr", 2024-03-30T13:58:49.891 INFO:teuthology.orchestra.run.smithi099.stdout: "services_complete": [ 2024-03-30T13:58:49.891 INFO:teuthology.orchestra.run.smithi099.stdout: "mgr" 2024-03-30T13:58:49.891 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-03-30T13:58:49.892 INFO:teuthology.orchestra.run.smithi099.stdout: "progress": "2/2 daemons upgraded", 2024-03-30T13:58:49.892 INFO:teuthology.orchestra.run.smithi099.stdout: "message": "Currently upgrading mgr daemons", 2024-03-30T13:58:49.892 INFO:teuthology.orchestra.run.smithi099.stdout: "is_paused": false 2024-03-30T13:58:49.892 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-03-30T13:58:50.198 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 13:58:49 smithi181 systemd[1]: Stopping Ceph mgr.x for 98ebaeb8-ee99-11ee-b647-cb9ed24678a4... 2024-03-30T13:58:50.198 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:49 smithi181 ceph-mon[25762]: from='client.25402 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T13:58:50.198 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:49 smithi181 ceph-mon[25762]: from='client.15516 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T13:58:50.199 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:49 smithi181 ceph-mon[25762]: from='client.? 172.21.15.99:0/142207141' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:58:50.319 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:49 smithi099 ceph-mon[24912]: from='client.25402 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T13:58:50.319 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:49 smithi099 ceph-mon[24912]: from='client.15516 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T13:58:50.319 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:49 smithi099 ceph-mon[24912]: from='client.? 172.21.15.99:0/142207141' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:58:50.320 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:49 smithi099 ceph-mon[29691]: from='client.25402 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T13:58:50.320 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:49 smithi099 ceph-mon[29691]: from='client.15516 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T13:58:50.320 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:49 smithi099 ceph-mon[29691]: from='client.? 172.21.15.99:0/142207141' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:58:50.460 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 13:58:50 smithi181 podman[74538]: 2024-03-30 13:58:50.202901276 +0000 UTC m=+0.139283243 container died 70a65dda3ab06422340c89bc98bc552444e147f0c88a0c2948bb40280909be40 (image=quay.ceph.io/ceph-ci/ceph:4e50bbcdd1630c7760b708f3a5b4d38a121e66cb, name=ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-x, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240326, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_CLEAN=True, RELEASE=squid-4e50bbc, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, ceph=True, org.label-schema.schema-version=1.0) 2024-03-30T13:58:50.750 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 13:58:50 smithi181 podman[74538]: 2024-03-30 13:58:50.546942201 +0000 UTC m=+0.483324171 container cleanup 70a65dda3ab06422340c89bc98bc552444e147f0c88a0c2948bb40280909be40 (image=quay.ceph.io/ceph-ci/ceph:4e50bbcdd1630c7760b708f3a5b4d38a121e66cb, name=ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-x, GIT_BRANCH=HEAD, RELEASE=squid-4e50bbc, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240326, ceph=True, GIT_CLEAN=True) 2024-03-30T13:58:50.750 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 13:58:50 smithi181 bash[74538]: ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-x 2024-03-30T13:58:51.115 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:50 smithi181 ceph-mon[25762]: from='client.15522 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T13:58:51.116 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:50 smithi181 ceph-mon[25762]: pgmap v42: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:58:51.116 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:50 smithi181 ceph-mon[25762]: from='client.15534 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T13:58:51.116 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 13:58:50 smithi181 podman[74552]: 2024-03-30 13:58:50.848388968 +0000 UTC m=+0.646788542 container remove 70a65dda3ab06422340c89bc98bc552444e147f0c88a0c2948bb40280909be40 (image=quay.ceph.io/ceph-ci/ceph:4e50bbcdd1630c7760b708f3a5b4d38a121e66cb, name=ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-x, GIT_CLEAN=True, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.vendor=CentOS, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, RELEASE=squid-4e50bbc, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.build-date=20240326, org.label-schema.name=CentOS Stream 8 Base Image) 2024-03-30T13:58:51.116 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 13:58:50 smithi181 systemd[1]: ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4@mgr.x.service: Main process exited, code=exited, status=143/n/a 2024-03-30T13:58:51.116 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 13:58:51 smithi181 systemd[1]: ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4@mgr.x.service: Failed with result 'exit-code'. 2024-03-30T13:58:51.116 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 13:58:51 smithi181 systemd[1]: Stopped Ceph mgr.x for 98ebaeb8-ee99-11ee-b647-cb9ed24678a4. 2024-03-30T13:58:51.116 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 13:58:51 smithi181 systemd[1]: ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4@mgr.x.service: Consumed 8.666s CPU time. 2024-03-30T13:58:51.331 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:50 smithi099 ceph-mon[29691]: from='client.15522 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T13:58:51.331 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:50 smithi099 ceph-mon[29691]: pgmap v42: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:58:51.331 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:50 smithi099 ceph-mon[29691]: from='client.15534 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T13:58:51.331 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:50 smithi099 ceph-mon[24912]: from='client.15522 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T13:58:51.331 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:50 smithi099 ceph-mon[24912]: pgmap v42: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:58:51.331 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:50 smithi099 ceph-mon[24912]: from='client.15534 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T13:58:51.441 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 13:58:51 smithi181 systemd[1]: Starting Ceph mgr.x for 98ebaeb8-ee99-11ee-b647-cb9ed24678a4... 2024-03-30T13:58:51.747 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 13:58:51 smithi181 podman[74686]: 2024-03-30 13:58:51.349657088 +0000 UTC m=+0.018671870 image pull e1d6a67b021eb077ee22bf650f1a9fb1980a2cf5c36bdb9cba9eac6de8f702d9 quay.io/ceph/ceph@sha256:12a0a4f43413fd97a14a3d47a3451b2d2df50020835bb93db666209f3f77617a 2024-03-30T13:58:51.748 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 13:58:51 smithi181 podman[74686]: 2024-03-30 13:58:51.449866622 +0000 UTC m=+0.118881401 container create 2a85ec6e53f1115fc9b406ae72703a32e65aadd83f8f953fbd4fa8a82d64735f (image=quay.io/ceph/ceph@sha256:12a0a4f43413fd97a14a3d47a3451b2d2df50020835bb93db666209f3f77617a, name=ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-x, build-date=2022-05-03T08:36:31.336870, version=8, io.k8s.display-name=CentOS Stream 8, GIT_COMMIT=b613db0f44179c0940781c1c7fe04e1acb7093ac, io.buildah.version=1.19.8, io.openshift.tags=base centos centos-stream, GIT_CLEAN=True, release=754, vcs-ref=f1ee6e37554363ec55e0035aba1a693d3627fdeb, summary=Provides a CentOS Stream container based on the Red Hat Universal Base Image, distribution-scope=public, maintainer=Guillaume Abrioux , io.k8s.description=The Universal Base Image is designed and engineered to be the base layer for all of your containerized applications, middleware and utilities. This base image is freely redistributable, but Red Hat only supports Red Hat technologies through subscriptions for Red Hat products. This image is maintained by Red Hat and updated regularly., io.openshift.expose-services=, com.redhat.build-host=cpt-1002.osbs.prod.upshift.rdu2.redhat.com, url=https://access.redhat.com/containers/#/registry.access.redhat.com/ubi8/images/8.6-754, com.redhat.license_terms=https://centos.org/legal/licensing-policy/, name=centos-stream, vendor=Red Hat, Inc., architecture=x86_64, GIT_BRANCH=HEAD, vcs-type=git, CEPH_POINT_RELEASE=-17.2.0, description=CentOS Stream is a continuously delivered distro that tracks just ahead of Red Hat Enterprise Linux development. This image takes the Red Hat UBI and layers on content from CentOS Stream, GIT_REPO=https://github.com/ceph/ceph-container.git, ceph=True, RELEASE=HEAD, com.redhat.component=centos-stream-container) 2024-03-30T13:58:51.748 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 13:58:51 smithi181 podman[74686]: 2024-03-30 13:58:51.660835426 +0000 UTC m=+0.329850197 container init 2a85ec6e53f1115fc9b406ae72703a32e65aadd83f8f953fbd4fa8a82d64735f (image=quay.io/ceph/ceph@sha256:12a0a4f43413fd97a14a3d47a3451b2d2df50020835bb93db666209f3f77617a, name=ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-x, io.openshift.expose-services=, description=CentOS Stream is a continuously delivered distro that tracks just ahead of Red Hat Enterprise Linux development. This image takes the Red Hat UBI and layers on content from CentOS Stream, url=https://access.redhat.com/containers/#/registry.access.redhat.com/ubi8/images/8.6-754, maintainer=Guillaume Abrioux , name=centos-stream, io.buildah.version=1.19.8, architecture=x86_64, build-date=2022-05-03T08:36:31.336870, GIT_CLEAN=True, GIT_REPO=https://github.com/ceph/ceph-container.git, com.redhat.build-host=cpt-1002.osbs.prod.upshift.rdu2.redhat.com, version=8, release=754, GIT_COMMIT=b613db0f44179c0940781c1c7fe04e1acb7093ac, GIT_BRANCH=HEAD, vcs-type=git, vcs-ref=f1ee6e37554363ec55e0035aba1a693d3627fdeb, RELEASE=HEAD, summary=Provides a CentOS Stream container based on the Red Hat Universal Base Image, distribution-scope=public, io.k8s.display-name=CentOS Stream 8, io.k8s.description=The Universal Base Image is designed and engineered to be the base layer for all of your containerized applications, middleware and utilities. This base image is freely redistributable, but Red Hat only supports Red Hat technologies through subscriptions for Red Hat products. This image is maintained by Red Hat and updated regularly., io.openshift.tags=base centos centos-stream, com.redhat.component=centos-stream-container, com.redhat.license_terms=https://centos.org/legal/licensing-policy/, CEPH_POINT_RELEASE=-17.2.0, vendor=Red Hat, Inc., ceph=True) 2024-03-30T13:58:51.748 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 13:58:51 smithi181 podman[74686]: 2024-03-30 13:58:51.663538563 +0000 UTC m=+0.332553338 container start 2a85ec6e53f1115fc9b406ae72703a32e65aadd83f8f953fbd4fa8a82d64735f (image=quay.io/ceph/ceph@sha256:12a0a4f43413fd97a14a3d47a3451b2d2df50020835bb93db666209f3f77617a, name=ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-x, CEPH_POINT_RELEASE=-17.2.0, url=https://access.redhat.com/containers/#/registry.access.redhat.com/ubi8/images/8.6-754, distribution-scope=public, build-date=2022-05-03T08:36:31.336870, com.redhat.component=centos-stream-container, GIT_BRANCH=HEAD, vcs-type=git, name=centos-stream, GIT_COMMIT=b613db0f44179c0940781c1c7fe04e1acb7093ac, vcs-ref=f1ee6e37554363ec55e0035aba1a693d3627fdeb, io.openshift.expose-services=, io.openshift.tags=base centos centos-stream, GIT_CLEAN=True, release=754, com.redhat.license_terms=https://centos.org/legal/licensing-policy/, GIT_REPO=https://github.com/ceph/ceph-container.git, io.buildah.version=1.19.8, com.redhat.build-host=cpt-1002.osbs.prod.upshift.rdu2.redhat.com, description=CentOS Stream is a continuously delivered distro that tracks just ahead of Red Hat Enterprise Linux development. This image takes the Red Hat UBI and layers on content from CentOS Stream, io.k8s.display-name=CentOS Stream 8, ceph=True, summary=Provides a CentOS Stream container based on the Red Hat Universal Base Image, RELEASE=HEAD, architecture=x86_64, maintainer=Guillaume Abrioux , vendor=Red Hat, Inc., version=8, io.k8s.description=The Universal Base Image is designed and engineered to be the base layer for all of your containerized applications, middleware and utilities. This base image is freely redistributable, but Red Hat only supports Red Hat technologies through subscriptions for Red Hat products. This image is maintained by Red Hat and updated regularly.) 2024-03-30T13:58:51.748 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 13:58:51 smithi181 ceph-mgr[74705]: -- 172.21.15.181:0/2986318432 <== mon.2 v2:172.21.15.181:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55ca3c116340 con 0x55ca3c0ef000 2024-03-30T13:58:52.000 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 13:58:51 smithi181 bash[74686]: 2a85ec6e53f1115fc9b406ae72703a32e65aadd83f8f953fbd4fa8a82d64735f 2024-03-30T13:58:52.000 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 13:58:51 smithi181 systemd[1]: Started Ceph mgr.x for 98ebaeb8-ee99-11ee-b647-cb9ed24678a4. 2024-03-30T13:58:52.500 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 13:58:52 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-x[74701]: 2024-03-30T13:58:52.153+0000 7fea3e0dd000 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-03-30T13:58:52.500 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 13:58:52 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-x[74701]: 2024-03-30T13:58:52.246+0000 7fea3e0dd000 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-03-30T13:58:52.868 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:52 smithi181 ceph-mon[25762]: pgmap v43: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 1.0 KiB/s rd, 1 op/s 2024-03-30T13:58:52.868 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:52 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:58:52.868 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:52 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:58:52.868 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:52 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:58:52.869 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:52 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:58:52.869 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:52 smithi181 ceph-mon[25762]: pgmap v44: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-03-30T13:58:52.869 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:52 smithi181 ceph-mon[25762]: pgmap v45: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-03-30T13:58:52.869 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:52 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:58:52.869 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:52 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:58:52.869 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:52 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:58:52.869 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:52 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:58:52.869 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:52 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:58:52.869 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:52 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:58:52.869 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:52 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:58:52.869 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:52 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:58:52.869 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:52 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:58:52.869 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:52 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:58:52.869 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:52 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:58:52.869 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:52 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:58:52.870 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:52 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:58:52.870 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:52 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:58:52.870 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:52 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:58:52.870 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:52 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:58:52.870 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:52 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:58:52.870 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:52 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:58:52.870 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:52 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:58:52.870 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:52 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:58:52.870 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:52 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:58:52.870 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:52 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:58:52.871 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:52 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:58:52.871 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:52 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:58:52.871 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:52 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:58:52.871 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:52 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:58:52.871 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:52 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:58:52.871 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:52 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:58:52.871 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:52 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:58:52.871 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:52 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:58:52.871 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:52 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:58:52.871 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:52 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:58:52.871 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:52 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:58:52.871 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:52 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:58:52.871 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:52 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:58:52.871 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:52 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:58:52.871 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:52 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:58:52.872 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:52 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:58:52.872 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:52 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:58:52.872 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:52 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:58:52.872 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:52 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:58:52.872 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:52 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:58:52.872 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:52 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:58:52.872 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:52 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:58:52.872 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:52 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:58:52.872 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:52 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:58:52.872 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:52 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:58:52.872 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:52 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:58:52.872 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:52 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:58:52.872 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:52 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:58:52.873 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:52 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:58:52.873 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:52 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:58:53.081 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:52 smithi099 ceph-mon[24912]: pgmap v43: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 1.0 KiB/s rd, 1 op/s 2024-03-30T13:58:53.081 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:52 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:58:53.081 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:52 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:58:53.081 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:52 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:58:53.082 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:52 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:58:53.082 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:52 smithi099 ceph-mon[24912]: pgmap v44: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-03-30T13:58:53.082 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:52 smithi099 ceph-mon[24912]: pgmap v45: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-03-30T13:58:53.082 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:52 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:58:53.082 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:52 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:58:53.082 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:52 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:58:53.082 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:52 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:58:53.082 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:52 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:58:53.082 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:52 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:58:53.082 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:52 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:58:53.082 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:52 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:58:53.082 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:52 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:58:53.082 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:52 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:58:53.082 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:52 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:58:53.083 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:52 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:58:53.083 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:52 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:58:53.083 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:52 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:58:53.083 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:52 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:58:53.083 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:52 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:58:53.083 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:52 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:58:53.083 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:52 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:58:53.083 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:52 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:58:53.083 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:52 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:58:53.083 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:52 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:58:53.083 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:52 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:58:53.084 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:52 smithi099 ceph-mon[29691]: pgmap v43: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 1.0 KiB/s rd, 1 op/s 2024-03-30T13:58:53.084 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:52 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:58:53.084 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:52 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:58:53.084 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:52 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:58:53.084 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:52 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:58:53.084 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:52 smithi099 ceph-mon[29691]: pgmap v44: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-03-30T13:58:53.084 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:52 smithi099 ceph-mon[29691]: pgmap v45: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-03-30T13:58:53.084 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:52 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:58:53.084 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:52 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:58:53.085 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:52 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:58:53.085 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:52 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:58:53.085 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:52 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:58:53.085 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:52 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:58:53.085 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:52 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:58:53.085 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:52 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:58:53.085 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:52 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:58:53.085 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:52 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:58:53.085 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:52 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:58:53.085 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:52 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:58:53.085 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:52 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:58:53.085 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:52 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:58:53.085 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:52 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:58:53.086 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:52 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:58:53.086 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:52 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:58:53.086 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:52 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:58:53.086 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:52 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:58:53.086 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:52 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:58:53.086 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:52 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:58:53.086 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:52 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:58:53.087 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:52 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:58:53.087 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:52 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:58:53.087 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:52 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:58:53.087 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:52 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:58:53.087 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:52 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:58:53.087 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:52 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:58:53.087 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:52 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:58:53.087 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:52 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:58:53.087 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:52 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:58:53.087 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:52 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:58:53.087 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:52 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:58:53.087 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:52 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:58:53.087 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:52 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:58:53.087 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:52 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:58:53.088 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:52 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:58:53.088 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:52 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:58:53.088 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:52 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:58:53.088 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:52 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:58:53.088 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:52 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:58:53.088 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:52 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:58:53.088 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:52 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:58:53.088 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:52 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:58:53.088 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:52 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:58:53.088 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:52 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:58:53.088 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:52 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:58:53.088 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:52 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:58:53.088 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:52 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:58:53.088 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:52 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:58:53.088 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:52 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:58:53.089 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:52 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:58:53.089 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:52 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:58:53.089 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:52 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:58:53.089 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:52 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:58:53.089 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:52 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:58:53.089 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:52 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:58:53.089 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:52 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:58:53.089 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:52 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:58:53.089 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:52 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:58:53.089 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:52 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:58:53.089 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:52 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:58:53.089 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:52 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:58:53.090 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:52 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:58:53.090 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:52 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:58:53.090 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:52 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:58:53.090 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:52 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:58:53.090 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:52 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:58:53.090 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:52 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:58:53.090 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:52 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:58:53.090 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:52 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:58:53.090 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:52 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:58:53.090 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:52 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:58:53.091 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:52 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:58:53.091 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:52 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:58:53.091 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:52 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:58:53.091 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:52 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:58:53.091 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:52 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:58:53.091 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:52 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:58:53.091 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:52 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:58:53.091 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:52 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:58:53.091 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:52 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:58:53.218 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 13:58:52 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-x[74701]: 2024-03-30T13:58:52.883+0000 7fea3e0dd000 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-03-30T13:58:53.218 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 13:58:52 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-x[74701]: 2024-03-30T13:58:52.976+0000 7fea3e0dd000 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-03-30T13:58:53.218 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 13:58:53 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-x[74701]: 2024-03-30T13:58:53.065+0000 7fea3e0dd000 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-03-30T13:58:53.500 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 13:58:53 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-x[74701]: 2024-03-30T13:58:53.222+0000 7fea3e0dd000 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-03-30T13:58:53.500 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 13:58:53 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-x[74701]: 2024-03-30T13:58:53.311+0000 7fea3e0dd000 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-03-30T13:58:53.500 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 13:58:53 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-x[74701]: 2024-03-30T13:58:53.433+0000 7fea3e0dd000 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-03-30T13:58:53.778 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 13:58:53 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-x[74701]: 2024-03-30T13:58:53.521+0000 7fea3e0dd000 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-03-30T13:58:53.779 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 13:58:53 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-x[74701]: 2024-03-30T13:58:53.691+0000 7fea3e0dd000 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-03-30T13:58:53.779 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 13:58:53 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-x[74701]: 2024-03-30T13:58:53.783+0000 7fea3e0dd000 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-03-30T13:58:54.033 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:53 smithi181 ceph-mon[25762]: pgmap v46: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T13:58:54.033 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:53 smithi181 ceph-mon[25762]: pgmap v47: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T13:58:54.033 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:53 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:58:54.034 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:53 smithi181 ceph-mon[25762]: pgmap v48: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 2.1 KiB/s rd, 2 op/s 2024-03-30T13:58:54.034 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:53 smithi181 ceph-mon[25762]: pgmap v49: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:58:54.034 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:53 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:58:54.034 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:53 smithi181 ceph-mon[25762]: pgmap v50: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:58:54.034 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:53 smithi181 ceph-mon[25762]: pgmap v51: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:58:54.034 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:53 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:58:54.034 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:53 smithi181 ceph-mon[25762]: pgmap v52: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:58:54.034 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:53 smithi181 ceph-mon[25762]: pgmap v53: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:58:54.034 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:53 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:58:54.034 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:53 smithi181 ceph-mon[25762]: pgmap v54: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:58:54.034 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:53 smithi181 ceph-mon[25762]: pgmap v55: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:58:54.034 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:53 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:58:54.034 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:53 smithi181 ceph-mon[25762]: pgmap v56: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:58:54.035 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:53 smithi181 ceph-mon[25762]: pgmap v57: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:58:54.035 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:53 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:58:54.035 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:53 smithi181 ceph-mon[25762]: pgmap v58: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:58:54.035 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:53 smithi181 ceph-mon[25762]: pgmap v59: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:58:54.035 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:53 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:58:54.035 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:53 smithi181 ceph-mon[25762]: pgmap v60: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:58:54.035 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:53 smithi181 ceph-mon[25762]: pgmap v61: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:58:54.035 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:53 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:58:54.035 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:53 smithi181 ceph-mon[25762]: pgmap v62: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:58:54.035 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:53 smithi181 ceph-mon[25762]: pgmap v63: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:58:54.035 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:53 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:58:54.035 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:53 smithi181 ceph-mon[25762]: pgmap v64: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:58:54.035 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:53 smithi181 ceph-mon[25762]: pgmap v65: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:58:54.035 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:53 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:58:54.036 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:53 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:58:54.036 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:53 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:58:54.036 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:53 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:58:54.036 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:53 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:58:54.036 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:53 smithi181 ceph-mon[25762]: pgmap v66: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:58:54.036 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:53 smithi181 ceph-mon[25762]: pgmap v67: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:58:54.036 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:53 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:58:54.037 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:53 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:58:54.037 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:53 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:58:54.037 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:53 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:58:54.037 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:53 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:58:54.037 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:53 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:58:54.037 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:53 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:58:54.037 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:53 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:58:54.037 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:53 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:58:54.037 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:53 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:58:54.037 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:53 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:58:54.037 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:53 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:58:54.037 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:53 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:58:54.037 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:53 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:58:54.037 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:53 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:58:54.037 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:53 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:58:54.038 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:53 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:58:54.038 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:53 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:58:54.038 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:53 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:58:54.038 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:53 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:58:54.038 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:53 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:58:54.038 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:53 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:58:54.038 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:53 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:58:54.038 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:53 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:58:54.038 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:53 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:58:54.038 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:53 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:58:54.038 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:53 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:58:54.038 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:53 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:58:54.038 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:53 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:58:54.038 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:53 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:58:54.039 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:53 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:58:54.039 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:53 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:58:54.039 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:53 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:58:54.039 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:53 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:58:54.039 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:53 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:58:54.039 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:53 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:58:54.039 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:53 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:58:54.039 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:53 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:58:54.039 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:53 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:58:54.039 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:53 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:58:54.040 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:53 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:58:54.040 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:53 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:58:54.040 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:53 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:58:54.040 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:53 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:58:54.040 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:53 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:58:54.040 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:53 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:58:54.040 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:53 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:58:54.257 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:53 smithi099 ceph-mon[24912]: pgmap v46: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T13:58:54.257 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:53 smithi099 ceph-mon[24912]: pgmap v47: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T13:58:54.257 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:53 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:58:54.258 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:53 smithi099 ceph-mon[24912]: pgmap v48: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 2.1 KiB/s rd, 2 op/s 2024-03-30T13:58:54.258 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:53 smithi099 ceph-mon[24912]: pgmap v49: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:58:54.258 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:53 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:58:54.258 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:53 smithi099 ceph-mon[24912]: pgmap v50: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:58:54.258 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:53 smithi099 ceph-mon[24912]: pgmap v51: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:58:54.258 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:53 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:58:54.258 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:53 smithi099 ceph-mon[24912]: pgmap v52: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:58:54.258 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:53 smithi099 ceph-mon[24912]: pgmap v53: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:58:54.258 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:53 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:58:54.258 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:53 smithi099 ceph-mon[24912]: pgmap v54: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:58:54.258 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:53 smithi099 ceph-mon[24912]: pgmap v55: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:58:54.258 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:53 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:58:54.258 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:53 smithi099 ceph-mon[24912]: pgmap v56: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:58:54.258 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:53 smithi099 ceph-mon[24912]: pgmap v57: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:58:54.259 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:53 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:58:54.259 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:53 smithi099 ceph-mon[24912]: pgmap v58: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:58:54.259 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:53 smithi099 ceph-mon[24912]: pgmap v59: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:58:54.259 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:53 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:58:54.259 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:53 smithi099 ceph-mon[24912]: pgmap v60: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:58:54.259 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:53 smithi099 ceph-mon[24912]: pgmap v61: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:58:54.259 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:53 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:58:54.259 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:53 smithi099 ceph-mon[24912]: pgmap v62: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:58:54.259 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:53 smithi099 ceph-mon[24912]: pgmap v63: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:58:54.259 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:53 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:58:54.259 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:53 smithi099 ceph-mon[24912]: pgmap v64: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:58:54.259 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:53 smithi099 ceph-mon[24912]: pgmap v65: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:58:54.259 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:53 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:58:54.259 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:53 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:58:54.259 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:53 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:58:54.260 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:53 smithi099 ceph-mon[29691]: pgmap v46: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T13:58:54.260 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:53 smithi099 ceph-mon[29691]: pgmap v47: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T13:58:54.260 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:53 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:58:54.260 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:53 smithi099 ceph-mon[29691]: pgmap v48: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 2.1 KiB/s rd, 2 op/s 2024-03-30T13:58:54.260 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:53 smithi099 ceph-mon[29691]: pgmap v49: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:58:54.260 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:53 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:58:54.260 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:53 smithi099 ceph-mon[29691]: pgmap v50: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:58:54.260 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:53 smithi099 ceph-mon[29691]: pgmap v51: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:58:54.260 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:53 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:58:54.260 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:53 smithi099 ceph-mon[29691]: pgmap v52: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:58:54.260 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:53 smithi099 ceph-mon[29691]: pgmap v53: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:58:54.261 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:53 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:58:54.261 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:53 smithi099 ceph-mon[29691]: pgmap v54: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:58:54.261 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:53 smithi099 ceph-mon[29691]: pgmap v55: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:58:54.261 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:53 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:58:54.261 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:53 smithi099 ceph-mon[29691]: pgmap v56: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:58:54.261 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:53 smithi099 ceph-mon[29691]: pgmap v57: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:58:54.261 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:53 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:58:54.261 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:53 smithi099 ceph-mon[29691]: pgmap v58: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:58:54.261 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:53 smithi099 ceph-mon[29691]: pgmap v59: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:58:54.261 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:53 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:58:54.261 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:53 smithi099 ceph-mon[29691]: pgmap v60: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:58:54.261 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:53 smithi099 ceph-mon[29691]: pgmap v61: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:58:54.261 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:53 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:58:54.261 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:53 smithi099 ceph-mon[29691]: pgmap v62: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:58:54.261 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:53 smithi099 ceph-mon[29691]: pgmap v63: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:58:54.261 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:53 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:58:54.262 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:53 smithi099 ceph-mon[29691]: pgmap v64: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:58:54.262 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:53 smithi099 ceph-mon[29691]: pgmap v65: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:58:54.262 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:53 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:58:54.262 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:53 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:58:54.262 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:53 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:58:54.262 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:53 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:58:54.262 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:53 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:58:54.262 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:53 smithi099 ceph-mon[24912]: pgmap v66: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:58:54.262 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:53 smithi099 ceph-mon[24912]: pgmap v67: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:58:54.262 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:53 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:58:54.263 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:53 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:58:54.263 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:53 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:58:54.263 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:53 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:58:54.263 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:53 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:58:54.263 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:53 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:58:54.263 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:53 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:58:54.263 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:53 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:58:54.263 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:53 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:58:54.263 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:53 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:58:54.263 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:53 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:58:54.263 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:53 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:58:54.263 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:53 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:58:54.263 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:53 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:58:54.263 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:53 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:58:54.263 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:53 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:58:54.264 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:53 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:58:54.264 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:53 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:58:54.264 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:53 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:58:54.264 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:53 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:58:54.264 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:53 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:58:54.264 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:53 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:58:54.264 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:53 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:58:54.264 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:53 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:58:54.264 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:53 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:58:54.265 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:53 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:58:54.265 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:53 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:58:54.265 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:53 smithi099 ceph-mon[29691]: pgmap v66: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:58:54.265 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:53 smithi099 ceph-mon[29691]: pgmap v67: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:58:54.265 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:53 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:58:54.265 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:53 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:58:54.265 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:53 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:58:54.265 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:53 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:58:54.265 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:53 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:58:54.265 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:53 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:58:54.265 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:53 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:58:54.265 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:53 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:58:54.266 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:53 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:58:54.266 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:53 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:58:54.266 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:53 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:58:54.266 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:53 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:58:54.266 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:53 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:58:54.266 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:53 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:58:54.266 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:53 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:58:54.266 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:53 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:58:54.266 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:53 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:58:54.266 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:53 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:58:54.266 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:53 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:58:54.266 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:53 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:58:54.266 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:53 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:58:54.266 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:53 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:58:54.266 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:53 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:58:54.267 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:53 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:58:54.267 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:53 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:58:54.267 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:53 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:58:54.267 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:53 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:58:54.267 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:53 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:58:54.267 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:53 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:58:54.267 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:53 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:58:54.267 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:53 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:58:54.267 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:53 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:58:54.267 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:53 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:58:54.267 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:53 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:58:54.268 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:53 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:58:54.268 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:53 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:58:54.268 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:53 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:58:54.268 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:53 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:58:54.268 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:53 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:58:54.268 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:53 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:58:54.268 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:53 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:58:54.268 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:53 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:58:54.268 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:53 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:58:54.268 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:53 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:58:54.268 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:53 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:58:54.268 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:53 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:58:54.268 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:53 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:58:54.268 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:53 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:58:54.269 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:53 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:58:54.269 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:53 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:58:54.269 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:53 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:58:54.269 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:53 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:58:54.269 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:53 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:58:54.269 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:53 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:58:54.269 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:53 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:58:54.269 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:53 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:58:54.269 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:53 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:58:54.269 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:53 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:58:54.269 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:53 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:58:54.269 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:53 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:58:54.270 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:53 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:58:54.270 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:53 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:58:54.270 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:53 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:58:54.270 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:53 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:58:54.270 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:53 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:58:54.270 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:53 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:58:54.270 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:53 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:58:54.270 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:53 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:58:54.270 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:53 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:58:54.581 INFO:journalctl@ceph.alertmanager.a.smithi099.stdout:Mar 30 13:58:54 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-alertmanager-a[64884]: level=warn ts=2024-03-30T13:58:54.262Z caller=notify.go:724 component=dispatcher receiver=ceph-dashboard integration=webhook[0] msg="Notify attempt failed, will retry later" attempts=1 err="Post \"https://smithi181.front.sepia.ceph.com:8443/api/prometheus_receiver\": dial tcp 172.21.15.181:8443: connect: connection refused" 2024-03-30T13:58:55.081 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:58:54 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[71049]: ::ffff:172.21.15.181 - - [30/Mar/2024:13:58:54] "GET /metrics HTTP/1.1" 200 37991 "" "Prometheus/2.33.4" 2024-03-30T13:58:55.081 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:54 smithi099 ceph-mon[29691]: pgmap v68: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:58:55.081 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:54 smithi099 ceph-mon[29691]: pgmap v69: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:58:55.081 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:54 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:58:55.081 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:54 smithi099 ceph-mon[29691]: pgmap v70: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:58:55.082 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:54 smithi099 ceph-mon[29691]: pgmap v71: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:58:55.082 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:54 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:58:55.082 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:54 smithi099 ceph-mon[29691]: from='client.25136 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T13:58:55.082 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:54 smithi099 ceph-mon[29691]: pgmap v72: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:58:55.082 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:54 smithi099 ceph-mon[29691]: pgmap v73: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:58:55.082 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:54 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:58:55.082 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:54 smithi099 ceph-mon[29691]: pgmap v74: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:58:55.082 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:54 smithi099 ceph-mon[29691]: pgmap v75: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:58:55.082 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:54 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:58:55.082 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:54 smithi099 ceph-mon[29691]: pgmap v76: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:58:55.082 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:54 smithi099 ceph-mon[29691]: pgmap v77: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:58:55.082 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:54 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:58:55.082 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:54 smithi099 ceph-mon[29691]: pgmap v78: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:58:55.083 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:54 smithi099 ceph-mon[29691]: pgmap v79: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:58:55.083 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:54 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:58:55.083 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:54 smithi099 ceph-mon[29691]: pgmap v80: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:58:55.083 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:54 smithi099 ceph-mon[29691]: pgmap v81: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:58:55.083 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:54 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:58:55.083 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:54 smithi099 ceph-mon[29691]: pgmap v82: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:58:55.083 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:54 smithi099 ceph-mon[29691]: pgmap v83: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:58:55.083 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:54 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:58:55.083 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:54 smithi099 ceph-mon[29691]: pgmap v84: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:58:55.083 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:54 smithi099 ceph-mon[29691]: pgmap v85: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:58:55.083 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:54 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:58:55.083 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:54 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:58:55.083 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:54 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:58:55.083 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:54 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:58:55.084 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:54 smithi099 ceph-mon[24912]: pgmap v68: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:58:55.084 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:54 smithi099 ceph-mon[24912]: pgmap v69: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:58:55.084 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:54 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:58:55.084 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:54 smithi099 ceph-mon[24912]: pgmap v70: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:58:55.084 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:54 smithi099 ceph-mon[24912]: pgmap v71: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:58:55.084 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:54 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:58:55.084 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:54 smithi099 ceph-mon[24912]: from='client.25136 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T13:58:55.084 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:54 smithi099 ceph-mon[24912]: pgmap v72: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:58:55.084 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:54 smithi099 ceph-mon[24912]: pgmap v73: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:58:55.084 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:54 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:58:55.084 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:54 smithi099 ceph-mon[24912]: pgmap v74: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:58:55.084 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:54 smithi099 ceph-mon[24912]: pgmap v75: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:58:55.085 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:54 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:58:55.085 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:54 smithi099 ceph-mon[24912]: pgmap v76: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:58:55.085 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:54 smithi099 ceph-mon[24912]: pgmap v77: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:58:55.085 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:54 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:58:55.085 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:54 smithi099 ceph-mon[24912]: pgmap v78: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:58:55.085 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:54 smithi099 ceph-mon[24912]: pgmap v79: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:58:55.085 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:54 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:58:55.085 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:54 smithi099 ceph-mon[24912]: pgmap v80: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:58:55.085 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:54 smithi099 ceph-mon[24912]: pgmap v81: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:58:55.085 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:54 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:58:55.085 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:54 smithi099 ceph-mon[24912]: pgmap v82: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:58:55.085 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:54 smithi099 ceph-mon[24912]: pgmap v83: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:58:55.085 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:54 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:58:55.085 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:54 smithi099 ceph-mon[24912]: pgmap v84: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:58:55.085 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:54 smithi099 ceph-mon[24912]: pgmap v85: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:58:55.086 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:54 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:58:55.086 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:54 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:58:55.086 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:54 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:58:55.086 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:54 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:58:55.086 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:54 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:58:55.086 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:54 smithi099 ceph-mon[29691]: pgmap v86: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:58:55.086 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:54 smithi099 ceph-mon[29691]: pgmap v87: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:58:55.087 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:54 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:58:55.087 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:54 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:58:55.087 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:54 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:58:55.087 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:54 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:58:55.087 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:54 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:58:55.087 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:54 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:58:55.087 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:54 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:58:55.087 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:54 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:58:55.087 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:54 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:58:55.087 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:54 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:58:55.087 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:54 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:58:55.087 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:54 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:58:55.087 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:54 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:58:55.088 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:54 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:58:55.088 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:54 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:58:55.088 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:54 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:58:55.088 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:54 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:58:55.088 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:54 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:58:55.088 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:54 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:58:55.088 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:54 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:58:55.088 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:54 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:58:55.088 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:54 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:58:55.088 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:54 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:58:55.088 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:54 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:58:55.088 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:54 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:58:55.088 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:54 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:58:55.088 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:54 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:58:55.089 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:54 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:58:55.089 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:54 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:58:55.089 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:54 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:58:55.089 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:54 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:58:55.089 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:54 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:58:55.089 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:54 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:58:55.089 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:54 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:58:55.089 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:54 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:58:55.089 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:54 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:58:55.089 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:54 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:58:55.089 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:54 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:58:55.089 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:54 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:58:55.089 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:54 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:58:55.089 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:54 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:58:55.090 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:54 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:58:55.090 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:54 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:58:55.090 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:54 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:58:55.090 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:54 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:58:55.090 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:54 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:58:55.090 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:54 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:58:55.090 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:54 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:58:55.090 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:54 smithi099 ceph-mon[24912]: pgmap v86: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:58:55.090 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:54 smithi099 ceph-mon[24912]: pgmap v87: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:58:55.091 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:54 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:58:55.091 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:54 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:58:55.091 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:54 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:58:55.091 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:54 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:58:55.091 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:54 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:58:55.091 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:54 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:58:55.091 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:54 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:58:55.091 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:54 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:58:55.091 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:54 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:58:55.091 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:54 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:58:55.091 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:54 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:58:55.091 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:54 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:58:55.091 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:54 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:58:55.091 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:54 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:58:55.092 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:54 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:58:55.092 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:54 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:58:55.092 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:54 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:58:55.092 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:54 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:58:55.092 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:54 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:58:55.092 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:54 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:58:55.092 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:54 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:58:55.092 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:54 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:58:55.092 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:54 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:58:55.092 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:54 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:58:55.092 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:54 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:58:55.092 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:54 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:58:55.092 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:54 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:58:55.092 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:54 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:58:55.092 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:54 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:58:55.093 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:54 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:58:55.093 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:54 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:58:55.093 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:54 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:58:55.093 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:54 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:58:55.093 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:54 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:58:55.093 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:54 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:58:55.093 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:54 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:58:55.093 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:54 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:58:55.093 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:54 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:58:55.093 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:54 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:58:55.093 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:54 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:58:55.093 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:54 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:58:55.093 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:54 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:58:55.093 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:54 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:58:55.093 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:54 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:58:55.094 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:54 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:58:55.094 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:54 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:58:55.094 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:54 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:58:55.250 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 13:58:54 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-x[74701]: 2024-03-30T13:58:54.916+0000 7fea3e0dd000 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-03-30T13:58:55.250 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 13:58:55 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-x[74701]: 2024-03-30T13:58:55.062+0000 7fea3e0dd000 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-03-30T13:58:55.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:54 smithi181 ceph-mon[25762]: pgmap v68: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:58:55.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:54 smithi181 ceph-mon[25762]: pgmap v69: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:58:55.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:54 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:58:55.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:54 smithi181 ceph-mon[25762]: pgmap v70: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:58:55.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:54 smithi181 ceph-mon[25762]: pgmap v71: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:58:55.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:54 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:58:55.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:54 smithi181 ceph-mon[25762]: from='client.25136 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T13:58:55.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:54 smithi181 ceph-mon[25762]: pgmap v72: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:58:55.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:54 smithi181 ceph-mon[25762]: pgmap v73: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:58:55.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:54 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:58:55.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:54 smithi181 ceph-mon[25762]: pgmap v74: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:58:55.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:54 smithi181 ceph-mon[25762]: pgmap v75: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:58:55.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:54 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:58:55.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:54 smithi181 ceph-mon[25762]: pgmap v76: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:58:55.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:54 smithi181 ceph-mon[25762]: pgmap v77: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:58:55.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:54 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:58:55.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:54 smithi181 ceph-mon[25762]: pgmap v78: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:58:55.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:54 smithi181 ceph-mon[25762]: pgmap v79: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:58:55.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:54 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:58:55.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:54 smithi181 ceph-mon[25762]: pgmap v80: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:58:55.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:54 smithi181 ceph-mon[25762]: pgmap v81: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:58:55.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:54 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:58:55.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:54 smithi181 ceph-mon[25762]: pgmap v82: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:58:55.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:54 smithi181 ceph-mon[25762]: pgmap v83: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:58:55.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:54 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:58:55.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:54 smithi181 ceph-mon[25762]: pgmap v84: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:58:55.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:54 smithi181 ceph-mon[25762]: pgmap v85: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:58:55.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:54 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:58:55.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:54 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:58:55.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:54 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:58:55.253 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:54 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:58:55.253 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:54 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:58:55.253 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:54 smithi181 ceph-mon[25762]: pgmap v86: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:58:55.253 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:54 smithi181 ceph-mon[25762]: pgmap v87: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:58:55.253 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:54 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:58:55.253 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:54 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:58:55.253 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:54 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:58:55.253 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:54 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:58:55.254 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:54 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:58:55.254 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:54 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:58:55.254 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:54 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:58:55.254 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:54 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:58:55.254 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:54 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:58:55.254 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:54 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:58:55.254 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:54 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:58:55.254 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:54 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:58:55.254 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:54 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:58:55.254 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:54 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:58:55.254 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:54 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:58:55.254 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:54 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:58:55.254 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:54 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:58:55.254 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:54 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:58:55.255 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:54 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:58:55.255 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:54 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:58:55.255 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:54 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:58:55.255 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:54 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:58:55.255 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:54 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:58:55.255 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:54 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:58:55.255 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:54 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:58:55.255 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:54 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:58:55.255 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:54 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:58:55.255 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:54 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:58:55.255 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:54 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:58:55.255 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:54 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:58:55.255 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:54 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:58:55.255 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:54 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:58:55.255 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:54 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:58:55.256 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:54 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:58:55.256 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:54 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:58:55.256 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:54 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:58:55.256 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:54 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:58:55.256 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:54 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:58:55.256 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:54 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:58:55.256 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:54 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:58:55.256 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:54 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:58:55.256 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:54 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:58:55.256 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:54 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:58:55.256 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:54 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:58:55.256 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:54 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:58:55.256 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:54 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:58:55.256 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:54 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:58:55.750 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 13:58:55 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-x[74701]: 2024-03-30T13:58:55.267+0000 7fea3e0dd000 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-03-30T13:58:55.750 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 13:58:55 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-x[74701]: 2024-03-30T13:58:55.360+0000 7fea3e0dd000 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-03-30T13:58:55.750 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 13:58:55 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-x[74701]: 2024-03-30T13:58:55.502+0000 7fea3e0dd000 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-03-30T13:58:56.079 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 13:58:55 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-x[74701]: 2024-03-30T13:58:55.844+0000 7fea3e0dd000 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-03-30T13:58:56.080 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:55 smithi181 ceph-mon[25762]: pgmap v88: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:58:56.080 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:55 smithi181 ceph-mon[25762]: pgmap v89: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:58:56.080 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:55 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:58:56.080 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:55 smithi181 ceph-mon[25762]: pgmap v90: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:58:56.080 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:55 smithi181 ceph-mon[25762]: pgmap v91: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:58:56.081 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:55 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:58:56.081 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:55 smithi181 ceph-mon[25762]: pgmap v92: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:58:56.081 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:55 smithi181 ceph-mon[25762]: pgmap v93: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:58:56.081 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:55 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:58:56.081 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:55 smithi181 ceph-mon[25762]: pgmap v94: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:58:56.081 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:55 smithi181 ceph-mon[25762]: pgmap v95: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:58:56.081 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:55 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:58:56.081 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:55 smithi181 ceph-mon[25762]: pgmap v96: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:58:56.081 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:55 smithi181 ceph-mon[25762]: pgmap v97: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:58:56.081 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:55 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:58:56.081 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:55 smithi181 ceph-mon[25762]: pgmap v98: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:58:56.081 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:55 smithi181 ceph-mon[25762]: pgmap v99: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:58:56.081 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:55 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:58:56.081 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:55 smithi181 ceph-mon[25762]: pgmap v100: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:58:56.081 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:55 smithi181 ceph-mon[25762]: pgmap v101: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:58:56.082 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:55 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:58:56.082 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:55 smithi181 ceph-mon[25762]: pgmap v102: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:58:56.082 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:55 smithi181 ceph-mon[25762]: pgmap v103: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:58:56.082 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:55 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:58:56.082 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:55 smithi181 ceph-mon[25762]: pgmap v104: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:58:56.082 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:55 smithi181 ceph-mon[25762]: pgmap v105: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:58:56.082 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:55 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:58:56.082 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:55 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:58:56.082 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:55 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:58:56.082 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:55 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:58:56.082 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:55 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:58:56.082 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:55 smithi181 ceph-mon[25762]: pgmap v106: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:58:56.082 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:55 smithi181 ceph-mon[25762]: pgmap v107: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:58:56.082 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:55 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:58:56.083 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:55 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:58:56.083 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:55 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:58:56.083 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:55 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:58:56.083 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:55 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:58:56.083 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:55 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:58:56.083 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:55 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:58:56.083 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:55 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:58:56.083 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:55 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:58:56.083 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:55 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:58:56.083 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:55 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:58:56.083 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:55 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:58:56.083 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:55 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:58:56.083 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:55 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:58:56.083 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:55 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:58:56.083 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:55 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:58:56.083 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:55 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:58:56.084 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:55 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:58:56.084 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:55 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:58:56.084 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:55 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:58:56.084 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:55 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:58:56.084 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:55 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:58:56.084 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:55 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:58:56.084 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:55 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:58:56.084 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:55 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:58:56.084 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:55 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:58:56.084 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:55 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:58:56.084 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:55 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:58:56.085 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:55 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:58:56.085 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:55 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:58:56.085 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:55 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:58:56.085 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:55 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:58:56.085 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:55 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:58:56.085 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:55 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:58:56.085 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:55 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:58:56.085 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:55 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:58:56.085 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:55 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:58:56.085 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:55 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:58:56.085 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:55 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:58:56.085 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:55 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:58:56.086 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:55 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:58:56.086 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:55 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:58:56.086 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:55 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:58:56.086 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:55 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:58:56.086 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:55 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:58:56.086 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:55 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:58:56.086 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:55 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:58:56.086 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:55 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:58:56.086 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:55 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:58:56.086 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:55 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:58:56.086 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:55 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:58:56.331 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:55 smithi099 ceph-mon[24912]: pgmap v88: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:58:56.331 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:55 smithi099 ceph-mon[24912]: pgmap v89: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:58:56.331 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:55 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:58:56.331 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:55 smithi099 ceph-mon[24912]: pgmap v90: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:58:56.332 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:55 smithi099 ceph-mon[24912]: pgmap v91: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:58:56.332 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:55 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:58:56.332 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:55 smithi099 ceph-mon[24912]: pgmap v92: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:58:56.332 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:55 smithi099 ceph-mon[24912]: pgmap v93: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:58:56.332 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:55 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:58:56.332 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:55 smithi099 ceph-mon[24912]: pgmap v94: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:58:56.332 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:55 smithi099 ceph-mon[24912]: pgmap v95: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:58:56.332 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:55 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:58:56.332 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:55 smithi099 ceph-mon[24912]: pgmap v96: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:58:56.332 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:55 smithi099 ceph-mon[24912]: pgmap v97: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:58:56.332 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:55 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:58:56.332 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:55 smithi099 ceph-mon[24912]: pgmap v98: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:58:56.332 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:55 smithi099 ceph-mon[24912]: pgmap v99: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:58:56.332 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:55 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:58:56.332 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:55 smithi099 ceph-mon[24912]: pgmap v100: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:58:56.333 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:55 smithi099 ceph-mon[24912]: pgmap v101: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:58:56.333 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:55 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:58:56.333 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:55 smithi099 ceph-mon[24912]: pgmap v102: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:58:56.333 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:55 smithi099 ceph-mon[24912]: pgmap v103: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:58:56.333 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:55 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:58:56.333 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:55 smithi099 ceph-mon[24912]: pgmap v104: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:58:56.333 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:55 smithi099 ceph-mon[24912]: pgmap v105: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:58:56.333 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:55 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:58:56.333 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:55 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:58:56.333 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:55 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:58:56.333 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:55 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:58:56.333 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:55 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:58:56.333 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:55 smithi099 ceph-mon[24912]: pgmap v106: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:58:56.334 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:55 smithi099 ceph-mon[29691]: pgmap v88: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:58:56.334 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:55 smithi099 ceph-mon[29691]: pgmap v89: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:58:56.334 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:55 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:58:56.334 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:55 smithi099 ceph-mon[29691]: pgmap v90: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:58:56.334 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:55 smithi099 ceph-mon[29691]: pgmap v91: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:58:56.334 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:55 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:58:56.334 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:55 smithi099 ceph-mon[29691]: pgmap v92: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:58:56.334 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:55 smithi099 ceph-mon[29691]: pgmap v93: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:58:56.334 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:55 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:58:56.334 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:55 smithi099 ceph-mon[29691]: pgmap v94: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:58:56.334 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:55 smithi099 ceph-mon[29691]: pgmap v95: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:58:56.334 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:55 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:58:56.335 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:55 smithi099 ceph-mon[29691]: pgmap v96: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:58:56.335 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:55 smithi099 ceph-mon[29691]: pgmap v97: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:58:56.335 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:55 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:58:56.335 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:55 smithi099 ceph-mon[29691]: pgmap v98: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:58:56.335 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:55 smithi099 ceph-mon[29691]: pgmap v99: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:58:56.335 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:55 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:58:56.335 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:55 smithi099 ceph-mon[29691]: pgmap v100: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:58:56.335 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:55 smithi099 ceph-mon[29691]: pgmap v101: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:58:56.335 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:55 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:58:56.335 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:55 smithi099 ceph-mon[29691]: pgmap v102: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:58:56.335 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:55 smithi099 ceph-mon[29691]: pgmap v103: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:58:56.335 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:55 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:58:56.335 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:55 smithi099 ceph-mon[29691]: pgmap v104: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:58:56.335 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:55 smithi099 ceph-mon[29691]: pgmap v105: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:58:56.335 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:55 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:58:56.336 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:55 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:58:56.336 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:55 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:58:56.336 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:55 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:58:56.336 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:55 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:58:56.336 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:55 smithi099 ceph-mon[29691]: pgmap v106: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:58:56.336 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:55 smithi099 ceph-mon[24912]: pgmap v107: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:58:56.336 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:55 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:58:56.336 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:55 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:58:56.336 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:55 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:58:56.336 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:55 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:58:56.336 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:55 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:58:56.337 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:55 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:58:56.337 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:55 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:58:56.337 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:55 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:58:56.337 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:55 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:58:56.337 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:55 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:58:56.337 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:55 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:58:56.337 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:55 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:58:56.337 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:55 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:58:56.337 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:55 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:58:56.337 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:55 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:58:56.337 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:55 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:58:56.338 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:55 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:58:56.338 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:55 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:58:56.338 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:55 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:58:56.338 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:55 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:58:56.338 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:55 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:58:56.338 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:55 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:58:56.338 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:55 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:58:56.338 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:55 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:58:56.338 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:55 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:58:56.338 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:55 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:58:56.338 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:55 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:58:56.338 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:55 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:58:56.339 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:55 smithi099 ceph-mon[29691]: pgmap v107: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:58:56.339 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:55 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:58:56.339 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:55 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:58:56.339 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:55 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:58:56.339 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:55 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:58:56.339 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:55 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:58:56.339 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:55 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:58:56.339 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:55 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:58:56.339 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:55 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:58:56.339 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:55 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:58:56.339 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:55 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:58:56.339 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:55 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:58:56.339 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:55 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:58:56.340 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:55 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:58:56.340 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:55 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:58:56.340 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:55 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:58:56.340 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:55 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:58:56.340 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:55 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:58:56.340 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:55 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:58:56.340 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:55 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:58:56.340 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:55 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:58:56.340 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:55 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:58:56.340 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:55 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:58:56.340 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:55 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:58:56.340 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:55 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:58:56.340 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:55 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:58:56.340 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:55 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:58:56.340 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:55 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:58:56.340 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:55 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:58:56.341 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:55 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:58:56.341 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:55 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:58:56.341 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:55 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:58:56.341 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:55 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:58:56.341 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:55 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:58:56.341 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:55 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:58:56.341 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:55 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:58:56.341 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:55 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:58:56.341 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:55 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:58:56.341 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:55 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:58:56.341 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:55 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:58:56.342 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:55 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:58:56.342 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:55 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:58:56.342 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:55 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:58:56.342 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:55 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:58:56.342 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:55 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:58:56.342 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:55 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:58:56.342 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:55 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:58:56.342 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:55 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:58:56.342 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:55 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:58:56.342 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:55 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:58:56.342 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:55 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:58:56.342 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:55 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:58:56.342 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:55 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:58:56.343 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:55 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:58:56.343 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:55 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:58:56.343 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:55 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:58:56.343 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:55 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:58:56.343 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:55 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:58:56.343 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:55 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:58:56.343 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:55 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:58:56.343 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:55 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:58:56.343 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:55 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:58:56.343 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:55 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:58:56.343 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:55 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:58:56.343 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:55 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:58:56.343 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:55 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:58:56.343 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:55 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:58:56.344 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:55 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:58:56.344 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:55 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:58:56.344 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:55 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:58:56.344 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:55 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:58:56.344 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:55 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:58:56.344 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:55 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:58:56.344 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:55 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:58:56.344 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:55 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:58:56.362 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 13:58:56 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-x[74701]: 2024-03-30T13:58:56.084+0000 7fea3e0dd000 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-03-30T13:58:56.363 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 13:58:56 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-x[74701]: 2024-03-30T13:58:56.182+0000 7fea3e0dd000 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-03-30T13:58:56.363 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 13:58:56 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-x[74701]: 2024-03-30T13:58:56.367+0000 7fea3e0dd000 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-03-30T13:58:57.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:56 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:58:57.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:56 smithi181 ceph-mon[25762]: pgmap v108: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:58:57.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:56 smithi181 ceph-mon[25762]: pgmap v109: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:58:57.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:56 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:58:57.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:56 smithi181 ceph-mon[25762]: pgmap v110: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:58:57.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:56 smithi181 ceph-mon[25762]: pgmap v111: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:58:57.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:56 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:58:57.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:56 smithi181 ceph-mon[25762]: pgmap v112: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:58:57.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:56 smithi181 ceph-mon[25762]: pgmap v113: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:58:57.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:56 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:58:57.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:56 smithi181 ceph-mon[25762]: pgmap v114: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:58:57.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:56 smithi181 ceph-mon[25762]: pgmap v115: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:58:57.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:56 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:58:57.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:56 smithi181 ceph-mon[25762]: pgmap v116: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:58:57.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:56 smithi181 ceph-mon[25762]: pgmap v117: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:58:57.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:56 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:58:57.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:56 smithi181 ceph-mon[25762]: pgmap v118: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:58:57.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:56 smithi181 ceph-mon[25762]: pgmap v119: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:58:57.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:56 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:58:57.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:56 smithi181 ceph-mon[25762]: pgmap v120: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:58:57.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:56 smithi181 ceph-mon[25762]: pgmap v121: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:58:57.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:56 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:58:57.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:56 smithi181 ceph-mon[25762]: pgmap v122: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:58:57.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:56 smithi181 ceph-mon[25762]: pgmap v123: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:58:57.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:56 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:58:57.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:56 smithi181 ceph-mon[25762]: pgmap v124: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:58:57.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:56 smithi181 ceph-mon[25762]: pgmap v125: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:58:57.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:56 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:58:57.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:56 smithi181 ceph-mon[25762]: pgmap v126: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:58:57.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:56 smithi181 ceph-mon[25762]: pgmap v127: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:58:57.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:56 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:58:57.253 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:56 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:58:57.253 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:56 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:58:57.253 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:56 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:58:57.253 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:56 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:58:57.253 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:56 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:58:57.253 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:56 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:58:57.253 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:56 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:58:57.254 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:56 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:58:57.254 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:56 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:58:57.254 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:56 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:58:57.254 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:56 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:58:57.254 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:56 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:58:57.254 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:56 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:58:57.254 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:56 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:58:57.254 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:56 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:58:57.254 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:56 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:58:57.254 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:56 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:58:57.254 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:56 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:58:57.254 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:56 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:58:57.254 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:56 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:58:57.254 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:56 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:58:57.255 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:56 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:58:57.255 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:56 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:58:57.255 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:56 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:58:57.255 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:56 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:58:57.255 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:56 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:58:57.256 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:56 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:58:57.256 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:56 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:58:57.256 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:56 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:58:57.256 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:56 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:58:57.256 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:56 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:58:57.256 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:56 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:58:57.257 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:56 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:58:57.257 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:56 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:58:57.257 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:56 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:58:57.257 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:56 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:58:57.257 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:56 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:58:57.257 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:56 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:58:57.257 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:56 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:58:57.257 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:56 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:58:57.257 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:56 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:58:57.257 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:56 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:58:57.257 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:56 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:58:57.257 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:56 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:58:57.257 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:56 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:58:57.257 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:56 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:58:57.258 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:56 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:58:57.258 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:56 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:58:57.258 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:56 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:58:57.258 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:56 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:58:57.258 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:56 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:58:57.258 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:56 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:58:57.258 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:56 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:58:57.258 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:56 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:58:57.258 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:56 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:58:57.331 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:56 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:58:57.331 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:56 smithi099 ceph-mon[24912]: pgmap v108: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:58:57.331 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:56 smithi099 ceph-mon[24912]: pgmap v109: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:58:57.332 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:56 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:58:57.332 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:56 smithi099 ceph-mon[24912]: pgmap v110: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:58:57.332 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:56 smithi099 ceph-mon[24912]: pgmap v111: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:58:57.332 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:56 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:58:57.332 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:56 smithi099 ceph-mon[24912]: pgmap v112: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:58:57.332 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:56 smithi099 ceph-mon[24912]: pgmap v113: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:58:57.332 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:56 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:58:57.332 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:56 smithi099 ceph-mon[24912]: pgmap v114: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:58:57.332 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:56 smithi099 ceph-mon[24912]: pgmap v115: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:58:57.332 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:56 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:58:57.332 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:56 smithi099 ceph-mon[24912]: pgmap v116: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:58:57.332 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:56 smithi099 ceph-mon[24912]: pgmap v117: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:58:57.332 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:56 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:58:57.332 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:56 smithi099 ceph-mon[24912]: pgmap v118: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:58:57.332 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:56 smithi099 ceph-mon[24912]: pgmap v119: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:58:57.333 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:56 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:58:57.333 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:56 smithi099 ceph-mon[24912]: pgmap v120: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:58:57.333 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:56 smithi099 ceph-mon[24912]: pgmap v121: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:58:57.333 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:56 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:58:57.333 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:56 smithi099 ceph-mon[24912]: pgmap v122: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:58:57.333 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:56 smithi099 ceph-mon[24912]: pgmap v123: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:58:57.333 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:56 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:58:57.333 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:56 smithi099 ceph-mon[24912]: pgmap v124: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:58:57.333 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:56 smithi099 ceph-mon[24912]: pgmap v125: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:58:57.333 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:56 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:58:57.333 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:56 smithi099 ceph-mon[24912]: pgmap v126: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:58:57.333 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:56 smithi099 ceph-mon[24912]: pgmap v127: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:58:57.333 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:56 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:58:57.333 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:56 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:58:57.334 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:56 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:58:57.334 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:56 smithi099 ceph-mon[29691]: pgmap v108: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:58:57.334 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:56 smithi099 ceph-mon[29691]: pgmap v109: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:58:57.334 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:56 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:58:57.334 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:56 smithi099 ceph-mon[29691]: pgmap v110: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:58:57.334 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:56 smithi099 ceph-mon[29691]: pgmap v111: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:58:57.334 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:56 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:58:57.334 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:56 smithi099 ceph-mon[29691]: pgmap v112: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:58:57.334 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:56 smithi099 ceph-mon[29691]: pgmap v113: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:58:57.334 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:56 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:58:57.335 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:56 smithi099 ceph-mon[29691]: pgmap v114: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:58:57.335 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:56 smithi099 ceph-mon[29691]: pgmap v115: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:58:57.335 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:56 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:58:57.335 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:56 smithi099 ceph-mon[29691]: pgmap v116: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:58:57.335 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:56 smithi099 ceph-mon[29691]: pgmap v117: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:58:57.335 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:56 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:58:57.335 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:56 smithi099 ceph-mon[29691]: pgmap v118: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:58:57.335 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:56 smithi099 ceph-mon[29691]: pgmap v119: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:58:57.335 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:56 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:58:57.335 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:56 smithi099 ceph-mon[29691]: pgmap v120: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:58:57.335 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:56 smithi099 ceph-mon[29691]: pgmap v121: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:58:57.335 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:56 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:58:57.335 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:56 smithi099 ceph-mon[29691]: pgmap v122: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:58:57.335 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:56 smithi099 ceph-mon[29691]: pgmap v123: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:58:57.335 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:56 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:58:57.336 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:56 smithi099 ceph-mon[29691]: pgmap v124: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:58:57.336 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:56 smithi099 ceph-mon[29691]: pgmap v125: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:58:57.336 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:56 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:58:57.336 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:56 smithi099 ceph-mon[29691]: pgmap v126: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:58:57.336 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:56 smithi099 ceph-mon[29691]: pgmap v127: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:58:57.336 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:56 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:58:57.336 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:56 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:58:57.336 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:56 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:58:57.336 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:56 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:58:57.337 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:56 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:58:57.337 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:56 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:58:57.337 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:56 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:58:57.337 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:56 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:58:57.337 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:56 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:58:57.337 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:56 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:58:57.337 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:56 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:58:57.337 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:56 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:58:57.337 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:56 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:58:57.337 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:56 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:58:57.337 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:56 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:58:57.337 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:56 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:58:57.337 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:56 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:58:57.337 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:56 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:58:57.337 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:56 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:58:57.338 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:56 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:58:57.338 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:56 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:58:57.338 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:56 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:58:57.338 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:56 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:58:57.338 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:56 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:58:57.338 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:56 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:58:57.338 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:56 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:58:57.338 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:56 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:58:57.338 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:56 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:58:57.338 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:56 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:58:57.338 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:56 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:58:57.338 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:56 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:58:57.338 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:56 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:58:57.338 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:56 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:58:57.339 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:56 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:58:57.339 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:56 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:58:57.339 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:56 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:58:57.339 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:56 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:58:57.339 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:56 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:58:57.339 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:56 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:58:57.339 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:56 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:58:57.339 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:56 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:58:57.339 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:56 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:58:57.339 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:56 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:58:57.339 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:56 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:58:57.339 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:56 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:58:57.339 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:56 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:58:57.339 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:56 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:58:57.339 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:56 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:58:57.339 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:56 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:58:57.340 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:56 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:58:57.340 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:56 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:58:57.340 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:56 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:58:57.340 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:56 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:58:57.340 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:56 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:58:57.340 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:56 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:58:57.340 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:56 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:58:57.340 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:56 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:58:57.340 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:56 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:58:57.340 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:56 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:58:57.341 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:56 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:58:57.341 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:56 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:58:57.341 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:56 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:58:57.341 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:56 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:58:57.341 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:56 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:58:57.341 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:56 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:58:57.341 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:56 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:58:57.341 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:56 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:58:57.341 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:56 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:58:57.341 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:56 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:58:57.341 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:56 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:58:57.341 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:56 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:58:57.341 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:56 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:58:57.341 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:56 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:58:57.341 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:56 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:58:57.342 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:56 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:58:57.342 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:56 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:58:57.342 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:56 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:58:57.342 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:56 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:58:57.342 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:56 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:58:57.342 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:56 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:58:57.342 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:56 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:58:57.342 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:56 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:58:57.342 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:56 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:58:57.342 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:56 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:58:57.342 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:56 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:58:57.342 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:56 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:58:57.342 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:56 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:58:57.342 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:56 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:58:57.342 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:56 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:58:57.343 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:56 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:58:57.343 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:56 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:58:57.343 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:56 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:58:57.343 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:56 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:58:57.343 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:56 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:58:57.343 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:56 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:58:57.343 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:56 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:58:57.343 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:56 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:58:57.343 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:56 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:58:57.343 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:56 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:58:57.343 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:56 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:58:57.343 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:56 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:58:57.343 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:56 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:58:57.343 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:56 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:58:57.343 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:56 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:58:57.344 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:56 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:58:57.344 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:56 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:58:57.344 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:56 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:58:57.344 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:56 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:58:57.344 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:56 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:58:57.344 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:56 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:58:57.615 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 13:58:57 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-x[74701]: 2024-03-30T13:58:57.353+0000 7fea3e0dd000 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-03-30T13:58:57.869 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 13:58:57 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-x[74701]: 2024-03-30T13:58:57.675+0000 7fea3e0dd000 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-03-30T13:58:57.870 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 13:58:57 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-x[74701]: 2024-03-30T13:58:57.788+0000 7fea3e0dd000 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-03-30T13:58:58.250 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 13:58:57 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-x[74701]: 2024-03-30T13:58:57.948+0000 7fea3e0dd000 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-03-30T13:58:58.250 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 13:58:57 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-x[74701]: [30/Mar/2024:13:58:57] ENGINE Bus STARTING 2024-03-30T13:58:58.250 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 13:58:58 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-x[74701]: CherryPy Checker: 2024-03-30T13:58:58.250 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 13:58:58 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-x[74701]: The Application mounted at '' has an empty config. 2024-03-30T13:58:58.250 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 13:58:58 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-x[74701]: 2024-03-30T13:58:58.250 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 13:58:58 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-x[74701]: [30/Mar/2024:13:58:58] ENGINE Serving on http://:::9283 2024-03-30T13:58:58.251 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 13:58:58 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-x[74701]: [30/Mar/2024:13:58:58] ENGINE Bus STARTED 2024-03-30T13:58:58.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:57 smithi181 ceph-mon[25762]: pgmap v128: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:58:58.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:57 smithi181 ceph-mon[25762]: pgmap v129: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:58:58.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:57 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:58:58.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:57 smithi181 ceph-mon[25762]: pgmap v130: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:58:58.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:57 smithi181 ceph-mon[25762]: pgmap v131: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:58:58.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:57 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:58:58.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:57 smithi181 ceph-mon[25762]: pgmap v132: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:58:58.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:57 smithi181 ceph-mon[25762]: pgmap v133: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:58:58.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:57 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:58:58.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:57 smithi181 ceph-mon[25762]: pgmap v134: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:58:58.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:57 smithi181 ceph-mon[25762]: pgmap v135: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:58:58.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:57 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:58:58.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:57 smithi181 ceph-mon[25762]: pgmap v136: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:58:58.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:57 smithi181 ceph-mon[25762]: pgmap v137: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:58:58.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:57 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:58:58.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:57 smithi181 ceph-mon[25762]: pgmap v138: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:58:58.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:57 smithi181 ceph-mon[25762]: pgmap v139: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:58:58.253 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:57 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:58:58.253 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:57 smithi181 ceph-mon[25762]: pgmap v140: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:58:58.253 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:57 smithi181 ceph-mon[25762]: pgmap v141: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:58:58.253 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:57 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:58:58.253 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:57 smithi181 ceph-mon[25762]: pgmap v142: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:58:58.253 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:57 smithi181 ceph-mon[25762]: pgmap v143: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:58:58.253 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:57 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:58:58.253 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:57 smithi181 ceph-mon[25762]: pgmap v144: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 20 KiB/s rd, 19 op/s 2024-03-30T13:58:58.253 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:57 smithi181 ceph-mon[25762]: pgmap v145: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 20 KiB/s rd, 19 op/s 2024-03-30T13:58:58.253 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:57 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:58:58.253 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:57 smithi181 ceph-mon[25762]: pgmap v146: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 19 KiB/s rd, 19 op/s 2024-03-30T13:58:58.253 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:57 smithi181 ceph-mon[25762]: pgmap v147: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 19 KiB/s rd, 19 op/s 2024-03-30T13:58:58.253 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:57 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:58:58.253 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:57 smithi181 ceph-mon[25762]: pgmap v148: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 20 KiB/s rd, 19 op/s 2024-03-30T13:58:58.254 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:57 smithi181 ceph-mon[25762]: pgmap v149: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 20 KiB/s rd, 19 op/s 2024-03-30T13:58:58.254 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:57 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:58:58.254 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:57 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:58:58.254 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:57 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:58:58.254 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:57 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:58:58.254 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:57 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:58:58.254 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:57 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:58:58.254 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:57 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:58:58.254 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:57 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:58:58.254 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:57 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:58:58.254 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:57 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:58:58.254 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:57 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:58:58.255 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:57 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:58:58.255 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:57 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:58:58.255 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:57 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:58:58.255 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:57 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:58:58.255 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:57 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:58:58.255 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:57 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:58:58.255 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:57 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:58:58.255 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:57 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:58:58.255 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:57 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:58:58.255 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:57 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:58:58.255 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:57 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:58:58.255 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:57 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:58:58.256 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:57 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:58:58.256 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:57 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:58:58.256 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:57 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:58:58.256 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:57 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:58:58.256 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:57 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:58:58.256 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:57 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:58:58.256 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:57 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:58:58.257 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:57 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:58:58.257 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:57 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:58:58.257 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:57 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:58:58.257 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:57 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:58:58.257 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:57 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:58:58.257 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:57 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:58:58.257 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:57 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:58:58.257 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:57 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:58:58.257 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:57 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:58:58.257 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:57 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:58:58.257 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:57 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:58:58.257 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:57 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:58:58.258 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:57 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:58:58.258 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:57 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:58:58.258 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:57 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:58:58.258 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:57 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:58:58.258 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:57 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:58:58.258 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:57 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:58:58.258 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:57 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:58:58.258 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:57 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:58:58.258 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:57 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:58:58.258 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:57 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:58:58.258 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:57 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:58:58.258 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:57 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:58:58.259 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:57 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:58:58.259 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:57 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:58:58.259 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:57 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:58:58.259 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:57 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:58:58.259 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:57 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:58:58.259 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:57 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:58:58.259 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:57 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:58:58.331 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:57 smithi099 ceph-mon[24912]: pgmap v128: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:58:58.331 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:57 smithi099 ceph-mon[24912]: pgmap v129: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:58:58.331 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:57 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:58:58.331 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:57 smithi099 ceph-mon[24912]: pgmap v130: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:58:58.331 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:57 smithi099 ceph-mon[24912]: pgmap v131: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:58:58.332 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:57 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:58:58.332 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:57 smithi099 ceph-mon[24912]: pgmap v132: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:58:58.332 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:57 smithi099 ceph-mon[24912]: pgmap v133: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:58:58.332 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:57 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:58:58.332 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:57 smithi099 ceph-mon[24912]: pgmap v134: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:58:58.332 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:57 smithi099 ceph-mon[24912]: pgmap v135: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:58:58.332 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:57 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:58:58.332 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:57 smithi099 ceph-mon[24912]: pgmap v136: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:58:58.332 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:57 smithi099 ceph-mon[24912]: pgmap v137: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:58:58.332 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:57 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:58:58.332 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:57 smithi099 ceph-mon[24912]: pgmap v138: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:58:58.332 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:57 smithi099 ceph-mon[24912]: pgmap v139: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:58:58.332 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:57 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:58:58.332 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:57 smithi099 ceph-mon[24912]: pgmap v140: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:58:58.333 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:57 smithi099 ceph-mon[24912]: pgmap v141: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:58:58.333 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:57 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:58:58.333 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:57 smithi099 ceph-mon[24912]: pgmap v142: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:58:58.333 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:57 smithi099 ceph-mon[24912]: pgmap v143: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:58:58.333 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:57 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:58:58.333 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:57 smithi099 ceph-mon[24912]: pgmap v144: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 20 KiB/s rd, 19 op/s 2024-03-30T13:58:58.333 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:57 smithi099 ceph-mon[24912]: pgmap v145: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 20 KiB/s rd, 19 op/s 2024-03-30T13:58:58.333 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:57 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:58:58.333 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:57 smithi099 ceph-mon[24912]: pgmap v146: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 19 KiB/s rd, 19 op/s 2024-03-30T13:58:58.333 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:57 smithi099 ceph-mon[24912]: pgmap v147: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 19 KiB/s rd, 19 op/s 2024-03-30T13:58:58.333 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:57 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:58:58.333 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:57 smithi099 ceph-mon[24912]: pgmap v148: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 20 KiB/s rd, 19 op/s 2024-03-30T13:58:58.334 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:57 smithi099 ceph-mon[29691]: pgmap v128: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:58:58.334 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:57 smithi099 ceph-mon[29691]: pgmap v129: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:58:58.334 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:57 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:58:58.334 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:57 smithi099 ceph-mon[29691]: pgmap v130: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:58:58.334 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:57 smithi099 ceph-mon[29691]: pgmap v131: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:58:58.334 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:57 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:58:58.334 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:57 smithi099 ceph-mon[29691]: pgmap v132: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:58:58.334 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:57 smithi099 ceph-mon[29691]: pgmap v133: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:58:58.335 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:57 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:58:58.335 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:57 smithi099 ceph-mon[29691]: pgmap v134: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:58:58.335 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:57 smithi099 ceph-mon[29691]: pgmap v135: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:58:58.335 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:57 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:58:58.335 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:57 smithi099 ceph-mon[29691]: pgmap v136: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:58:58.335 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:57 smithi099 ceph-mon[29691]: pgmap v137: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:58:58.335 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:57 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:58:58.335 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:57 smithi099 ceph-mon[29691]: pgmap v138: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:58:58.335 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:57 smithi099 ceph-mon[29691]: pgmap v139: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:58:58.335 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:57 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:58:58.335 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:57 smithi099 ceph-mon[29691]: pgmap v140: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:58:58.335 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:57 smithi099 ceph-mon[29691]: pgmap v141: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:58:58.335 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:57 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:58:58.335 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:57 smithi099 ceph-mon[29691]: pgmap v142: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:58:58.336 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:57 smithi099 ceph-mon[29691]: pgmap v143: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:58:58.336 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:57 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:58:58.336 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:57 smithi099 ceph-mon[29691]: pgmap v144: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 20 KiB/s rd, 19 op/s 2024-03-30T13:58:58.336 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:57 smithi099 ceph-mon[29691]: pgmap v145: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 20 KiB/s rd, 19 op/s 2024-03-30T13:58:58.336 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:57 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:58:58.336 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:57 smithi099 ceph-mon[29691]: pgmap v146: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 19 KiB/s rd, 19 op/s 2024-03-30T13:58:58.336 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:57 smithi099 ceph-mon[29691]: pgmap v147: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 19 KiB/s rd, 19 op/s 2024-03-30T13:58:58.336 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:57 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:58:58.336 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:57 smithi099 ceph-mon[29691]: pgmap v148: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 20 KiB/s rd, 19 op/s 2024-03-30T13:58:58.336 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:57 smithi099 ceph-mon[29691]: pgmap v149: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 20 KiB/s rd, 19 op/s 2024-03-30T13:58:58.336 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:57 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:58:58.336 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:57 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:58:58.336 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:57 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:58:58.336 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:57 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:58:58.336 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:57 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:58:58.337 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:57 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:58:58.337 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:57 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:58:58.337 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:57 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:58:58.337 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:57 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:58:58.337 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:57 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:58:58.337 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:57 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:58:58.337 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:57 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:58:58.337 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:57 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:58:58.337 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:57 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:58:58.337 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:57 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:58:58.337 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:57 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:58:58.337 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:57 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:58:58.337 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:57 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:58:58.337 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:57 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:58:58.338 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:57 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:58:58.338 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:57 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:58:58.338 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:57 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:58:58.338 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:57 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:58:58.338 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:57 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:58:58.338 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:57 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:58:58.338 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:57 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:58:58.338 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:57 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:58:58.338 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:57 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:58:58.339 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:57 smithi099 ceph-mon[24912]: pgmap v149: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 20 KiB/s rd, 19 op/s 2024-03-30T13:58:58.339 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:57 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:58:58.339 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:57 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:58:58.339 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:57 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:58:58.339 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:57 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:58:58.339 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:57 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:58:58.339 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:57 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:58:58.339 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:57 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:58:58.339 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:57 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:58:58.339 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:57 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:58:58.339 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:57 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:58:58.339 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:57 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:58:58.340 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:57 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:58:58.340 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:57 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:58:58.340 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:57 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:58:58.340 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:57 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:58:58.340 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:57 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:58:58.340 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:57 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:58:58.340 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:57 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:58:58.340 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:57 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:58:58.340 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:57 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:58:58.340 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:57 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:58:58.340 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:57 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:58:58.340 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:57 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:58:58.340 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:57 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:58:58.340 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:57 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:58:58.341 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:57 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:58:58.341 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:57 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:58:58.341 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:57 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:58:58.341 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:57 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:58:58.341 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:57 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:58:58.341 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:57 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:58:58.341 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:57 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:58:58.341 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:57 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:58:58.341 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:57 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:58:58.341 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:57 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:58:58.341 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:57 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:58:58.342 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:57 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:58:58.342 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:57 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:58:58.342 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:57 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:58:58.342 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:57 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:58:58.342 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:57 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:58:58.342 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:57 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:58:58.342 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:57 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:58:58.342 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:57 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:58:58.342 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:57 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:58:58.342 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:57 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:58:58.342 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:57 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:58:58.342 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:57 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:58:58.342 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:57 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:58:58.342 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:57 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:58:58.343 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:57 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:58:58.343 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:57 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:58:58.343 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:57 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:58:58.343 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:57 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:58:58.343 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:57 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:58:58.343 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:57 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:58:58.343 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:57 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:58:58.343 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:57 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:58:58.343 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:57 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:58:58.343 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:57 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:58:58.343 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:57 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:58:58.344 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:57 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:58:58.344 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:57 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:58:58.344 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:57 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:58:58.344 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:57 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:58:58.344 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:57 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:58:58.344 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:57 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:58:58.344 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:57 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:58:58.344 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:57 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:58:58.344 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:57 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:58:58.344 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:57 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:58:58.344 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:57 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:58:58.344 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:57 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:58:58.344 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:57 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:58:58.344 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:57 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:58:58.344 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:57 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:58:58.345 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:57 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:58:58.345 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:57 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:58:58.345 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:57 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:58:58.345 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:57 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:58:58.345 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:57 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:58:58.345 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:57 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:58:58.345 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:57 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:58:58.345 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:57 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:58:58.345 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:57 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:58:58.345 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:57 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:58:58.345 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:57 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:58:58.345 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:57 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:58:58.346 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:57 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:58:58.346 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:57 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:58:58.346 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:57 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:58:58.346 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:57 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:58:58.346 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:57 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:58:58.346 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:57 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:58:59.137 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:58 smithi181 ceph-mon[25762]: pgmap v150: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:58:59.137 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:58 smithi181 ceph-mon[25762]: pgmap v151: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:58:59.137 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:58 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:58:59.137 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:58 smithi181 ceph-mon[25762]: pgmap v152: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:58:59.137 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:58 smithi181 ceph-mon[25762]: pgmap v153: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:58:59.137 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:58 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:58:59.138 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:58 smithi181 ceph-mon[25762]: pgmap v154: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:58:59.138 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:58 smithi181 ceph-mon[25762]: pgmap v155: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:58:59.138 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:58 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:58:59.138 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:58 smithi181 ceph-mon[25762]: pgmap v156: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:58:59.138 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:58 smithi181 ceph-mon[25762]: pgmap v157: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:58:59.138 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:58 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:58:59.138 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:58 smithi181 ceph-mon[25762]: pgmap v158: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:58:59.138 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:58 smithi181 ceph-mon[25762]: pgmap v159: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:58:59.138 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:58 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:58:59.138 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:58 smithi181 ceph-mon[25762]: pgmap v160: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:58:59.138 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:58 smithi181 ceph-mon[25762]: pgmap v161: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:58:59.138 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:58 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:58:59.139 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:58 smithi181 ceph-mon[25762]: pgmap v162: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:58:59.139 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:58 smithi181 ceph-mon[25762]: pgmap v163: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:58:59.139 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:58 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:58:59.139 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:58 smithi181 ceph-mon[25762]: pgmap v164: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:58:59.139 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:58 smithi181 ceph-mon[25762]: pgmap v165: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:58:59.139 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:58 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:58:59.139 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:58 smithi181 ceph-mon[25762]: pgmap v166: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:58:59.139 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:58 smithi181 ceph-mon[25762]: pgmap v167: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:58:59.139 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:58 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:58:59.139 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:58 smithi181 ceph-mon[25762]: pgmap v168: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:58:59.139 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:58 smithi181 ceph-mon[25762]: pgmap v169: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:58:59.139 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:58 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:58:59.139 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:58 smithi181 ceph-mon[25762]: pgmap v170: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:58:59.139 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:58 smithi181 ceph-mon[25762]: pgmap v171: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:58:59.139 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:58 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:58:59.140 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:58 smithi181 ceph-mon[25762]: pgmap v172: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:58:59.140 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:58 smithi181 ceph-mon[25762]: pgmap v173: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:58:59.140 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:58 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:58:59.140 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:58 smithi181 ceph-mon[25762]: from='mgr.? 172.21.15.181:0/2' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/crt"}]: dispatch 2024-03-30T13:58:59.140 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:58 smithi181 ceph-mon[25762]: Standby manager daemon x restarted 2024-03-30T13:58:59.140 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:58 smithi181 ceph-mon[25762]: Standby manager daemon x started 2024-03-30T13:58:59.140 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:58 smithi181 ceph-mon[25762]: from='mgr.? 172.21.15.181:0/2' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-03-30T13:58:59.140 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:58 smithi181 ceph-mon[25762]: from='mgr.? 172.21.15.181:0/2' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/key"}]: dispatch 2024-03-30T13:58:59.140 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:58 smithi181 ceph-mon[25762]: from='mgr.? 172.21.15.181:0/2' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-03-30T13:58:59.140 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:58 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:58:59.140 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:58 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:58:59.140 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:58 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:58:59.140 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:58 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:58:59.140 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:58 smithi181 ceph-mon[25762]: pgmap v174: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:58:59.141 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:58 smithi181 ceph-mon[25762]: pgmap v175: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:58:59.141 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:58 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:58:59.141 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:58 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:58:59.141 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:58 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:58:59.141 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:58 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:58:59.141 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:58 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:58:59.141 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:58 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:58:59.142 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:58 smithi181 ceph-mon[25762]: pgmap v176: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:58:59.142 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:58 smithi181 ceph-mon[25762]: pgmap v177: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:58:59.142 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:58 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:58:59.142 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:58 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:58:59.142 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:58 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:58:59.142 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:58 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:58:59.142 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:58 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:58:59.142 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:58 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:58:59.143 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:58 smithi181 ceph-mon[25762]: pgmap v178: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:58:59.143 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:58 smithi181 ceph-mon[25762]: pgmap v179: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:58:59.143 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:58 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:58:59.143 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:58 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:58:59.144 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:58 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:58:59.144 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:58 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:58:59.144 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:58 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:58:59.144 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:58 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:58:59.144 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:58 smithi181 ceph-mon[25762]: pgmap v180: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:58:59.144 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:58 smithi181 ceph-mon[25762]: pgmap v181: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:58:59.144 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:58 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:58:59.144 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:58 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:58:59.144 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:58 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:58:59.144 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:58 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:58:59.144 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:58 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:58:59.144 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:58 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:58:59.144 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:58 smithi181 ceph-mon[25762]: pgmap v182: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:58:59.144 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:58 smithi181 ceph-mon[25762]: pgmap v183: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:58:59.145 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:58 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:58:59.145 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:58 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:58:59.145 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:58 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:58:59.145 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:58 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:58:59.145 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:58 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:58:59.145 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:58 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:58:59.145 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:58 smithi181 ceph-mon[25762]: pgmap v184: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:58:59.145 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:58 smithi181 ceph-mon[25762]: pgmap v185: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:58:59.145 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:58 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:58:59.145 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:58 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:58:59.145 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:58 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:58:59.145 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:58 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:58:59.145 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:58 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:58:59.145 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:58 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:58:59.145 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:58 smithi181 ceph-mon[25762]: pgmap v186: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:58:59.146 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:58 smithi181 ceph-mon[25762]: pgmap v187: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:58:59.146 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:58 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:58:59.146 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:58 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:58:59.146 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:58 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:58:59.146 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:58 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:58:59.146 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:58 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:58:59.146 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:58 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:58:59.146 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:58 smithi181 ceph-mon[25762]: pgmap v188: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:58:59.146 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:58 smithi181 ceph-mon[25762]: pgmap v189: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:58:59.146 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:58 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:58:59.146 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:58 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:58:59.146 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:58 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:58:59.146 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:58 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:58:59.146 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:58 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:58:59.147 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:58 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:58:59.147 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:58 smithi181 ceph-mon[25762]: pgmap v190: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:58:59.147 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:58 smithi181 ceph-mon[25762]: pgmap v191: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:58:59.147 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:58 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:58:59.147 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:58 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:58:59.147 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:58 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:58:59.147 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:58 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:58:59.147 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:58 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:58:59.147 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:58 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:58:59.147 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:58 smithi181 ceph-mon[25762]: pgmap v192: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:58:59.147 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:58 smithi181 ceph-mon[25762]: pgmap v193: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:58:59.147 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:58 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:58:59.147 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:58 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:58:59.148 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:58 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:58:59.148 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:58 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:58:59.148 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:58 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:58:59.148 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:58 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:58:59.148 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:58 smithi181 ceph-mon[25762]: pgmap v194: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:58:59.148 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:58 smithi181 ceph-mon[25762]: pgmap v195: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:58:59.148 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:58 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:58:59.148 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:58 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:58:59.148 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:58 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:58:59.148 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:58 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:58:59.148 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:58 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:58:59.148 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:58 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:58:59.332 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:58 smithi099 ceph-mon[24912]: pgmap v150: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:58:59.332 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:58 smithi099 ceph-mon[24912]: pgmap v151: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:58:59.332 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:58 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:58:59.332 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:58 smithi099 ceph-mon[24912]: pgmap v152: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:58:59.332 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:58 smithi099 ceph-mon[24912]: pgmap v153: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:58:59.332 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:58 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:58:59.332 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:58 smithi099 ceph-mon[24912]: pgmap v154: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:58:59.332 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:58 smithi099 ceph-mon[24912]: pgmap v155: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:58:59.332 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:58 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:58:59.332 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:58 smithi099 ceph-mon[24912]: pgmap v156: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:58:59.332 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:58 smithi099 ceph-mon[24912]: pgmap v157: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:58:59.333 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:58 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:58:59.333 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:58 smithi099 ceph-mon[24912]: pgmap v158: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:58:59.333 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:58 smithi099 ceph-mon[24912]: pgmap v159: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:58:59.333 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:58 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:58:59.333 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:58 smithi099 ceph-mon[24912]: pgmap v160: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:58:59.333 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:58 smithi099 ceph-mon[24912]: pgmap v161: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:58:59.333 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:58 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:58:59.333 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:58 smithi099 ceph-mon[24912]: pgmap v162: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:58:59.333 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:58 smithi099 ceph-mon[24912]: pgmap v163: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:58:59.333 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:58 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:58:59.333 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:58 smithi099 ceph-mon[24912]: pgmap v164: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:58:59.333 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:58 smithi099 ceph-mon[24912]: pgmap v165: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:58:59.333 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:58 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:58:59.333 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:58 smithi099 ceph-mon[24912]: pgmap v166: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:58:59.334 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:58 smithi099 ceph-mon[24912]: pgmap v167: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:58:59.334 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:58 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:58:59.334 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:58 smithi099 ceph-mon[24912]: pgmap v168: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:58:59.334 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:58 smithi099 ceph-mon[24912]: pgmap v169: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:58:59.334 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:58 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:58:59.334 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:58 smithi099 ceph-mon[24912]: pgmap v170: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:58:59.334 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:58 smithi099 ceph-mon[24912]: pgmap v171: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:58:59.334 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:58 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:58:59.335 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:58 smithi099 ceph-mon[29691]: pgmap v150: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:58:59.335 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:58 smithi099 ceph-mon[29691]: pgmap v151: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:58:59.335 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:58 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:58:59.335 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:58 smithi099 ceph-mon[29691]: pgmap v152: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:58:59.335 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:58 smithi099 ceph-mon[29691]: pgmap v153: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:58:59.335 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:58 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:58:59.335 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:58 smithi099 ceph-mon[29691]: pgmap v154: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:58:59.335 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:58 smithi099 ceph-mon[29691]: pgmap v155: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:58:59.335 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:58 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:58:59.335 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:58 smithi099 ceph-mon[29691]: pgmap v156: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:58:59.335 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:58 smithi099 ceph-mon[29691]: pgmap v157: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:58:59.335 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:58 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:58:59.335 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:58 smithi099 ceph-mon[29691]: pgmap v158: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:58:59.336 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:58 smithi099 ceph-mon[29691]: pgmap v159: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:58:59.336 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:58 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:58:59.336 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:58 smithi099 ceph-mon[29691]: pgmap v160: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:58:59.336 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:58 smithi099 ceph-mon[29691]: pgmap v161: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:58:59.336 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:58 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:58:59.336 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:58 smithi099 ceph-mon[29691]: pgmap v162: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:58:59.336 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:58 smithi099 ceph-mon[29691]: pgmap v163: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:58:59.336 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:58 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:58:59.336 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:58 smithi099 ceph-mon[29691]: pgmap v164: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:58:59.336 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:58 smithi099 ceph-mon[29691]: pgmap v165: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:58:59.336 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:58 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:58:59.336 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:58 smithi099 ceph-mon[29691]: pgmap v166: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:58:59.336 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:58 smithi099 ceph-mon[29691]: pgmap v167: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:58:59.336 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:58 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:58:59.337 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:58 smithi099 ceph-mon[29691]: pgmap v168: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:58:59.337 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:58 smithi099 ceph-mon[29691]: pgmap v169: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:58:59.337 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:58 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:58:59.337 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:58 smithi099 ceph-mon[29691]: pgmap v170: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:58:59.337 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:58 smithi099 ceph-mon[29691]: pgmap v171: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:58:59.337 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:58 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:58:59.337 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:58 smithi099 ceph-mon[29691]: pgmap v172: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:58:59.337 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:58 smithi099 ceph-mon[29691]: pgmap v173: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:58:59.337 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:58 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:58:59.337 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:58 smithi099 ceph-mon[29691]: from='mgr.? 172.21.15.181:0/2' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/crt"}]: dispatch 2024-03-30T13:58:59.337 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:58 smithi099 ceph-mon[29691]: Standby manager daemon x restarted 2024-03-30T13:58:59.337 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:58 smithi099 ceph-mon[29691]: Standby manager daemon x started 2024-03-30T13:58:59.337 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:58 smithi099 ceph-mon[29691]: from='mgr.? 172.21.15.181:0/2' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-03-30T13:58:59.337 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:58 smithi099 ceph-mon[29691]: from='mgr.? 172.21.15.181:0/2' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/key"}]: dispatch 2024-03-30T13:58:59.338 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:58 smithi099 ceph-mon[29691]: from='mgr.? 172.21.15.181:0/2' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-03-30T13:58:59.338 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:58 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:58:59.338 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:58 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:58:59.338 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:58 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:58:59.338 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:58 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:58:59.338 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:58 smithi099 ceph-mon[29691]: pgmap v174: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:58:59.338 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:58 smithi099 ceph-mon[29691]: pgmap v175: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:58:59.338 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:58 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:58:59.338 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:58 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:58:59.338 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:58 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:58:59.338 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:58 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:58:59.338 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:58 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:58:59.338 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:58 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:58:59.338 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:58 smithi099 ceph-mon[29691]: pgmap v176: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:58:59.338 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:58 smithi099 ceph-mon[29691]: pgmap v177: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:58:59.339 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:58 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:58:59.339 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:58 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:58:59.339 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:58 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:58:59.339 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:58 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:58:59.339 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:58 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:58:59.339 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:58 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:58:59.339 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:58 smithi099 ceph-mon[29691]: pgmap v178: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:58:59.339 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:58 smithi099 ceph-mon[24912]: pgmap v172: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:58:59.339 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:58 smithi099 ceph-mon[24912]: pgmap v173: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:58:59.339 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:58 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:58:59.340 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:58 smithi099 ceph-mon[24912]: from='mgr.? 172.21.15.181:0/2' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/crt"}]: dispatch 2024-03-30T13:58:59.340 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:58 smithi099 ceph-mon[24912]: Standby manager daemon x restarted 2024-03-30T13:58:59.340 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:58 smithi099 ceph-mon[24912]: Standby manager daemon x started 2024-03-30T13:58:59.340 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:58 smithi099 ceph-mon[24912]: from='mgr.? 172.21.15.181:0/2' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-03-30T13:58:59.340 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:58 smithi099 ceph-mon[24912]: from='mgr.? 172.21.15.181:0/2' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/key"}]: dispatch 2024-03-30T13:58:59.340 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:58 smithi099 ceph-mon[24912]: from='mgr.? 172.21.15.181:0/2' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-03-30T13:58:59.340 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:58 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:58:59.340 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:58 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:58:59.340 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:58 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:58:59.340 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:58 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:58:59.340 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:58 smithi099 ceph-mon[24912]: pgmap v174: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:58:59.340 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:58 smithi099 ceph-mon[24912]: pgmap v175: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:58:59.340 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:58 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:58:59.340 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:58 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:58:59.341 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:58 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:58:59.341 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:58 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:58:59.341 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:58 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:58:59.341 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:58 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:58:59.341 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:58 smithi099 ceph-mon[24912]: pgmap v176: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:58:59.341 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:58 smithi099 ceph-mon[24912]: pgmap v177: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:58:59.341 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:58 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:58:59.341 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:58 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:58:59.341 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:58 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:58:59.341 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:58 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:58:59.341 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:58 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:58:59.341 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:58 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:58:59.341 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:58 smithi099 ceph-mon[24912]: pgmap v178: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:58:59.342 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:58 smithi099 ceph-mon[29691]: pgmap v179: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:58:59.342 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:58 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:58:59.342 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:58 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:58:59.342 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:58 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:58:59.342 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:58 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:58:59.342 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:58 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:58:59.342 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:58 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:58:59.342 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:58 smithi099 ceph-mon[29691]: pgmap v180: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:58:59.342 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:58 smithi099 ceph-mon[29691]: pgmap v181: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:58:59.342 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:58 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:58:59.342 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:58 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:58:59.342 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:58 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:58:59.343 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:58 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:58:59.343 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:58 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:58:59.343 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:58 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:58:59.343 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:58 smithi099 ceph-mon[29691]: pgmap v182: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:58:59.343 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:58 smithi099 ceph-mon[29691]: pgmap v183: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:58:59.343 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:58 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:58:59.343 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:58 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:58:59.343 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:58 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:58:59.343 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:58 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:58:59.343 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:58 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:58:59.343 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:58 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:58:59.343 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:58 smithi099 ceph-mon[29691]: pgmap v184: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:58:59.343 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:58 smithi099 ceph-mon[29691]: pgmap v185: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:58:59.343 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:58 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:58:59.344 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:58 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:58:59.344 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:58 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:58:59.344 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:58 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:58:59.344 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:58 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:58:59.344 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:58 smithi099 ceph-mon[24912]: pgmap v179: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:58:59.344 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:58 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:58:59.344 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:58 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:58:59.344 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:58 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:58:59.344 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:58 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:58:59.344 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:58 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:58:59.345 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:58 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:58:59.345 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:58 smithi099 ceph-mon[24912]: pgmap v180: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:58:59.345 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:58 smithi099 ceph-mon[24912]: pgmap v181: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:58:59.345 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:58 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:58:59.345 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:58 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:58:59.345 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:58 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:58:59.345 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:58 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:58:59.345 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:58 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:58:59.345 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:58 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:58:59.345 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:58 smithi099 ceph-mon[24912]: pgmap v182: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:58:59.345 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:58 smithi099 ceph-mon[24912]: pgmap v183: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:58:59.345 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:58 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:58:59.345 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:58 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:58:59.346 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:58 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:58:59.346 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:58 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:58:59.346 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:58 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:58:59.346 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:58 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:58:59.346 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:58 smithi099 ceph-mon[24912]: pgmap v184: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:58:59.346 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:58 smithi099 ceph-mon[24912]: pgmap v185: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:58:59.346 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:58 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:58:59.346 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:58 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:58:59.346 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:58 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:58:59.346 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:58 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:58:59.346 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:58 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:58:59.347 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:58 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:58:59.347 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:58 smithi099 ceph-mon[29691]: pgmap v186: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:58:59.347 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:58 smithi099 ceph-mon[29691]: pgmap v187: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:58:59.347 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:58 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:58:59.347 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:58 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:58:59.347 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:58 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:58:59.347 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:58 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:58:59.347 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:58 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:58:59.347 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:58 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:58:59.347 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:58 smithi099 ceph-mon[29691]: pgmap v188: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:58:59.347 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:58 smithi099 ceph-mon[29691]: pgmap v189: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:58:59.347 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:58 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:58:59.347 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:58 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:58:59.348 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:58 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:58:59.348 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:58 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:58:59.348 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:58 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:58:59.348 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:58 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:58:59.348 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:58 smithi099 ceph-mon[29691]: pgmap v190: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:58:59.348 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:58 smithi099 ceph-mon[29691]: pgmap v191: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:58:59.348 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:58 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:58:59.348 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:58 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:58:59.348 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:58 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:58:59.348 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:58 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:58:59.348 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:58 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:58:59.348 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:58 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:58:59.348 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:58 smithi099 ceph-mon[29691]: pgmap v192: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:58:59.348 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:58 smithi099 ceph-mon[29691]: pgmap v193: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:58:59.348 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:58 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:58:59.349 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:58 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:58:59.349 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:58 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:58:59.349 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:58 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:58:59.349 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:58 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:58:59.349 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:58 smithi099 ceph-mon[24912]: pgmap v186: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:58:59.349 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:58 smithi099 ceph-mon[24912]: pgmap v187: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:58:59.349 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:58 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:58:59.349 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:58 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:58:59.349 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:58 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:58:59.349 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:58 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:58:59.349 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:58 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:58:59.350 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:58 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:58:59.350 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:58 smithi099 ceph-mon[24912]: pgmap v188: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:58:59.350 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:58 smithi099 ceph-mon[24912]: pgmap v189: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:58:59.350 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:58 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:58:59.350 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:58 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:58:59.350 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:58 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:58:59.350 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:58 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:58:59.350 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:58 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:58:59.350 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:58 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:58:59.350 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:58 smithi099 ceph-mon[24912]: pgmap v190: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:58:59.350 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:58 smithi099 ceph-mon[24912]: pgmap v191: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:58:59.350 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:58 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:58:59.350 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:58 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:58:59.351 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:58 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:58:59.351 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:58 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:58:59.351 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:58 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:58:59.351 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:58 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:58:59.351 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:58 smithi099 ceph-mon[24912]: pgmap v192: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:58:59.351 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:58 smithi099 ceph-mon[24912]: pgmap v193: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:58:59.351 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:58 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:58:59.351 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:58 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:58:59.351 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:58 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:58:59.351 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:58 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:58:59.351 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:58 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:58:59.352 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:58 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:58:59.352 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:58 smithi099 ceph-mon[29691]: pgmap v194: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:58:59.352 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:58 smithi099 ceph-mon[29691]: pgmap v195: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:58:59.352 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:58 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:58:59.352 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:58 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:58:59.352 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:58 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:58:59.352 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:58 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:58:59.352 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:58 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:58:59.352 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:58 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:58:59.352 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:58 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:58:59.352 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:58 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:58:59.353 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:58 smithi099 ceph-mon[24912]: pgmap v194: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:58:59.353 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:58 smithi099 ceph-mon[24912]: pgmap v195: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:58:59.353 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:58 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:58:59.353 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:58 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:58:59.353 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:58 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:58:59.353 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:58 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:58:59.353 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:58 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:58:59.353 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:58 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:00.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:59 smithi181 ceph-mon[25762]: pgmap v196: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:00.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:59 smithi181 ceph-mon[25762]: pgmap v197: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:00.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:59 smithi181 ceph-mon[25762]: Health check cleared: CEPHADM_FAILED_DAEMON (was: 1 failed cephadm daemon(s)) 2024-03-30T13:59:00.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:59 smithi181 ceph-mon[25762]: Cluster is now healthy 2024-03-30T13:59:00.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:59 smithi181 ceph-mon[25762]: mgrmap e42: y(active, since 44s), standbys: x 2024-03-30T13:59:00.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:59 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:00.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:59 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:00.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:59 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:00.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:59 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:00.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:59 smithi181 ceph-mon[25762]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-1967-g4e50bbcd 2024-03-30T13:59:00.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:59 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:00.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:59 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:00.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:59 smithi181 ceph-mon[25762]: pgmap v198: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:00.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:59 smithi181 ceph-mon[25762]: pgmap v199: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:00.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:59 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:00.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:59 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:00.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:59 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:00.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:59 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:00.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:59 smithi181 ceph-mon[25762]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-1967-g4e50bbcd 2024-03-30T13:59:00.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:59 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:00.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:59 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:00.253 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:59 smithi181 ceph-mon[25762]: pgmap v200: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:00.253 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:59 smithi181 ceph-mon[25762]: pgmap v201: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:00.253 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:59 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:00.253 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:59 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:00.253 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:59 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:00.253 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:59 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:00.253 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:59 smithi181 ceph-mon[25762]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-1967-g4e50bbcd 2024-03-30T13:59:00.253 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:59 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:00.254 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:59 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:00.254 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:59 smithi181 ceph-mon[25762]: pgmap v202: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:00.254 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:59 smithi181 ceph-mon[25762]: pgmap v203: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:00.254 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:59 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:00.255 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:59 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:00.255 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:59 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:00.255 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:59 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:00.255 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:59 smithi181 ceph-mon[25762]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-1967-g4e50bbcd 2024-03-30T13:59:00.255 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:59 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:00.255 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:59 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:00.255 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:59 smithi181 ceph-mon[25762]: pgmap v204: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:00.255 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:59 smithi181 ceph-mon[25762]: pgmap v205: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:00.255 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:59 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:00.255 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:59 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:00.255 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:59 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:00.255 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:59 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:00.256 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:59 smithi181 ceph-mon[25762]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-1967-g4e50bbcd 2024-03-30T13:59:00.256 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:59 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:00.256 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:59 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:00.256 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:59 smithi181 ceph-mon[25762]: pgmap v206: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:00.256 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:59 smithi181 ceph-mon[25762]: pgmap v207: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:00.256 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:59 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:00.256 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:59 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:00.256 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:59 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:00.256 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:59 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:00.256 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:59 smithi181 ceph-mon[25762]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-1967-g4e50bbcd 2024-03-30T13:59:00.256 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:59 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:00.256 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:59 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:00.256 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:59 smithi181 ceph-mon[25762]: pgmap v208: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:00.257 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:59 smithi181 ceph-mon[25762]: pgmap v209: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:00.257 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:59 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:00.257 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:59 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:00.257 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:59 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:00.257 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:59 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:00.257 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:59 smithi181 ceph-mon[25762]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-1967-g4e50bbcd 2024-03-30T13:59:00.257 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:59 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:00.257 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:59 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:00.257 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:59 smithi181 ceph-mon[25762]: pgmap v210: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:00.257 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:59 smithi181 ceph-mon[25762]: pgmap v211: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:00.257 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:59 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:00.257 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:59 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:00.257 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:59 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:00.258 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:59 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:00.258 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:59 smithi181 ceph-mon[25762]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-1967-g4e50bbcd 2024-03-30T13:59:00.258 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:59 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:00.258 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:59 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:00.258 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:59 smithi181 ceph-mon[25762]: pgmap v212: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:00.258 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:59 smithi181 ceph-mon[25762]: pgmap v213: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:00.258 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:59 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:00.258 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:59 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:00.258 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:59 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:00.258 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:59 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:00.258 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:59 smithi181 ceph-mon[25762]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-1967-g4e50bbcd 2024-03-30T13:59:00.258 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:59 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:00.259 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:59 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:00.259 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:59 smithi181 ceph-mon[25762]: pgmap v214: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:00.259 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:59 smithi181 ceph-mon[25762]: pgmap v215: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:00.259 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:59 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:00.259 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:59 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:00.259 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:59 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:00.259 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:59 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:00.259 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:59 smithi181 ceph-mon[25762]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-1967-g4e50bbcd 2024-03-30T13:59:00.259 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:59 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:00.259 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:59 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:00.259 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:59 smithi181 ceph-mon[25762]: pgmap v216: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:00.259 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:59 smithi181 ceph-mon[25762]: pgmap v217: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:00.259 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:59 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:00.260 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:59 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:00.260 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:59 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:00.260 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:59 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:00.260 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:59 smithi181 ceph-mon[25762]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-1967-g4e50bbcd 2024-03-30T13:59:00.260 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:59 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:00.260 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:59 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:00.260 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:59 smithi181 ceph-mon[25762]: pgmap v218: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:00.260 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:59 smithi181 ceph-mon[25762]: pgmap v219: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:00.260 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:59 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:00.260 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:59 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:00.260 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:58:59 smithi181 ceph-mon[25762]: Health check failed: 1 failed cephadm daemon(s) (CEPHADM_FAILED_DAEMON) 2024-03-30T13:59:00.331 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:59 smithi099 ceph-mon[24912]: pgmap v196: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:00.331 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:59 smithi099 ceph-mon[24912]: pgmap v197: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:00.331 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:59 smithi099 ceph-mon[24912]: Health check cleared: CEPHADM_FAILED_DAEMON (was: 1 failed cephadm daemon(s)) 2024-03-30T13:59:00.331 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:59 smithi099 ceph-mon[24912]: Cluster is now healthy 2024-03-30T13:59:00.332 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:59 smithi099 ceph-mon[24912]: mgrmap e42: y(active, since 44s), standbys: x 2024-03-30T13:59:00.332 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:59 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:00.332 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:59 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:00.332 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:59 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:00.332 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:59 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:00.332 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:59 smithi099 ceph-mon[24912]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-1967-g4e50bbcd 2024-03-30T13:59:00.332 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:59 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:00.332 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:59 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:00.332 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:59 smithi099 ceph-mon[24912]: pgmap v198: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:00.332 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:59 smithi099 ceph-mon[24912]: pgmap v199: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:00.332 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:59 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:00.332 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:59 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:00.332 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:59 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:00.333 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:59 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:00.333 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:59 smithi099 ceph-mon[24912]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-1967-g4e50bbcd 2024-03-30T13:59:00.333 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:59 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:00.333 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:59 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:00.333 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:59 smithi099 ceph-mon[24912]: pgmap v200: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:00.333 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:59 smithi099 ceph-mon[24912]: pgmap v201: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:00.333 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:59 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:00.333 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:59 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:00.333 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:59 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:00.333 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:59 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:00.333 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:59 smithi099 ceph-mon[24912]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-1967-g4e50bbcd 2024-03-30T13:59:00.333 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:59 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:00.334 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:59 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:00.334 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:59 smithi099 ceph-mon[24912]: pgmap v202: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:00.334 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:59 smithi099 ceph-mon[29691]: pgmap v196: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:00.334 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:59 smithi099 ceph-mon[29691]: pgmap v197: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:00.335 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:59 smithi099 ceph-mon[29691]: Health check cleared: CEPHADM_FAILED_DAEMON (was: 1 failed cephadm daemon(s)) 2024-03-30T13:59:00.335 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:59 smithi099 ceph-mon[29691]: Cluster is now healthy 2024-03-30T13:59:00.335 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:59 smithi099 ceph-mon[29691]: mgrmap e42: y(active, since 44s), standbys: x 2024-03-30T13:59:00.335 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:59 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:00.335 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:59 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:00.335 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:59 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:00.335 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:59 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:00.335 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:59 smithi099 ceph-mon[29691]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-1967-g4e50bbcd 2024-03-30T13:59:00.335 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:59 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:00.335 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:59 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:00.335 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:59 smithi099 ceph-mon[29691]: pgmap v198: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:00.335 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:59 smithi099 ceph-mon[29691]: pgmap v199: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:00.336 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:59 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:00.336 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:59 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:00.336 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:59 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:00.336 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:59 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:00.336 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:59 smithi099 ceph-mon[29691]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-1967-g4e50bbcd 2024-03-30T13:59:00.336 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:59 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:00.336 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:59 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:00.336 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:59 smithi099 ceph-mon[29691]: pgmap v200: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:00.336 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:59 smithi099 ceph-mon[29691]: pgmap v201: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:00.336 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:59 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:00.336 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:59 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:00.336 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:59 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:00.336 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:59 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:00.337 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:59 smithi099 ceph-mon[29691]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-1967-g4e50bbcd 2024-03-30T13:59:00.337 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:59 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:00.337 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:59 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:00.337 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:59 smithi099 ceph-mon[29691]: pgmap v202: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:00.337 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:59 smithi099 ceph-mon[24912]: pgmap v203: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:00.337 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:59 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:00.337 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:59 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:00.337 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:59 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:00.337 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:59 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:00.338 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:59 smithi099 ceph-mon[24912]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-1967-g4e50bbcd 2024-03-30T13:59:00.338 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:59 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:00.338 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:59 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:00.338 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:59 smithi099 ceph-mon[24912]: pgmap v204: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:00.338 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:59 smithi099 ceph-mon[24912]: pgmap v205: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:00.338 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:59 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:00.338 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:59 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:00.338 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:59 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:00.338 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:59 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:00.338 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:59 smithi099 ceph-mon[24912]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-1967-g4e50bbcd 2024-03-30T13:59:00.339 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:59 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:00.339 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:59 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:00.339 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:59 smithi099 ceph-mon[24912]: pgmap v206: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:00.339 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:59 smithi099 ceph-mon[24912]: pgmap v207: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:00.339 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:59 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:00.339 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:59 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:00.339 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:59 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:00.339 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:59 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:00.339 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:59 smithi099 ceph-mon[24912]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-1967-g4e50bbcd 2024-03-30T13:59:00.339 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:59 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:00.339 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:59 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:00.339 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:59 smithi099 ceph-mon[24912]: pgmap v208: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:00.339 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:59 smithi099 ceph-mon[24912]: pgmap v209: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:00.340 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:59 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:00.340 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:59 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:00.340 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:59 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:00.340 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:59 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:00.340 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:59 smithi099 ceph-mon[29691]: pgmap v203: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:00.340 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:59 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:00.340 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:59 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:00.340 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:59 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:00.340 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:59 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:00.340 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:59 smithi099 ceph-mon[29691]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-1967-g4e50bbcd 2024-03-30T13:59:00.341 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:59 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:00.341 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:59 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:00.341 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:59 smithi099 ceph-mon[29691]: pgmap v204: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:00.341 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:59 smithi099 ceph-mon[29691]: pgmap v205: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:00.341 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:59 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:00.341 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:59 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:00.341 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:59 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:00.341 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:59 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:00.341 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:59 smithi099 ceph-mon[29691]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-1967-g4e50bbcd 2024-03-30T13:59:00.341 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:59 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:00.341 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:59 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:00.341 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:59 smithi099 ceph-mon[29691]: pgmap v206: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:00.341 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:59 smithi099 ceph-mon[29691]: pgmap v207: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:00.342 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:59 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:00.342 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:59 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:00.342 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:59 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:00.342 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:59 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:00.342 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:59 smithi099 ceph-mon[29691]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-1967-g4e50bbcd 2024-03-30T13:59:00.342 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:59 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:00.342 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:59 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:00.342 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:59 smithi099 ceph-mon[29691]: pgmap v208: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:00.342 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:59 smithi099 ceph-mon[29691]: pgmap v209: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:00.342 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:59 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:00.342 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:59 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:00.342 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:59 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:00.343 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:59 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:00.343 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:59 smithi099 ceph-mon[24912]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-1967-g4e50bbcd 2024-03-30T13:59:00.343 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:59 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:00.343 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:59 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:00.343 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:59 smithi099 ceph-mon[24912]: pgmap v210: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:00.343 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:59 smithi099 ceph-mon[24912]: pgmap v211: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:00.343 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:59 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:00.343 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:59 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:00.344 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:59 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:00.344 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:59 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:00.344 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:59 smithi099 ceph-mon[24912]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-1967-g4e50bbcd 2024-03-30T13:59:00.344 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:59 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:00.344 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:59 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:00.344 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:59 smithi099 ceph-mon[24912]: pgmap v212: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:00.344 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:59 smithi099 ceph-mon[24912]: pgmap v213: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:00.344 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:59 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:00.344 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:59 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:00.344 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:59 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:00.344 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:59 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:00.345 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:59 smithi099 ceph-mon[24912]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-1967-g4e50bbcd 2024-03-30T13:59:00.345 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:59 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:00.345 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:59 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:00.345 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:59 smithi099 ceph-mon[24912]: pgmap v214: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:00.345 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:59 smithi099 ceph-mon[24912]: pgmap v215: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:00.345 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:59 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:00.345 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:59 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:00.345 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:59 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:00.345 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:59 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:00.345 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:59 smithi099 ceph-mon[24912]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-1967-g4e50bbcd 2024-03-30T13:59:00.346 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:59 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:00.346 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:59 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:00.346 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:59 smithi099 ceph-mon[24912]: pgmap v216: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:00.346 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:59 smithi099 ceph-mon[24912]: pgmap v217: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:00.346 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:59 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:00.346 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:59 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:00.346 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:59 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:00.346 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:59 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:00.346 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:59 smithi099 ceph-mon[24912]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-1967-g4e50bbcd 2024-03-30T13:59:00.346 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:59 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:00.347 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:59 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:00.347 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:59 smithi099 ceph-mon[24912]: pgmap v218: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:00.347 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:59 smithi099 ceph-mon[24912]: pgmap v219: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:00.347 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:59 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:00.347 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:59 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:00.347 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:58:59 smithi099 ceph-mon[24912]: Health check failed: 1 failed cephadm daemon(s) (CEPHADM_FAILED_DAEMON) 2024-03-30T13:59:00.347 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:59 smithi099 ceph-mon[29691]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-1967-g4e50bbcd 2024-03-30T13:59:00.347 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:59 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:00.348 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:59 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:00.348 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:59 smithi099 ceph-mon[29691]: pgmap v210: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:00.348 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:59 smithi099 ceph-mon[29691]: pgmap v211: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:00.348 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:59 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:00.348 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:59 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:00.348 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:59 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:00.348 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:59 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:00.348 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:59 smithi099 ceph-mon[29691]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-1967-g4e50bbcd 2024-03-30T13:59:00.348 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:59 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:00.348 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:59 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:00.349 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:59 smithi099 ceph-mon[29691]: pgmap v212: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:00.349 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:59 smithi099 ceph-mon[29691]: pgmap v213: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:00.349 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:59 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:00.349 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:59 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:00.349 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:59 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:00.349 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:59 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:00.349 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:59 smithi099 ceph-mon[29691]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-1967-g4e50bbcd 2024-03-30T13:59:00.349 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:59 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:00.349 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:59 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:00.349 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:59 smithi099 ceph-mon[29691]: pgmap v214: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:00.349 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:59 smithi099 ceph-mon[29691]: pgmap v215: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:00.349 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:59 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:00.350 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:59 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:00.350 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:59 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:00.350 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:59 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:00.350 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:59 smithi099 ceph-mon[29691]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-1967-g4e50bbcd 2024-03-30T13:59:00.350 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:59 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:00.350 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:59 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:00.350 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:59 smithi099 ceph-mon[29691]: pgmap v216: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:00.350 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:59 smithi099 ceph-mon[29691]: pgmap v217: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:00.350 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:59 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:00.350 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:59 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:00.350 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:59 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:00.350 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:59 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:00.351 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:59 smithi099 ceph-mon[29691]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-1967-g4e50bbcd 2024-03-30T13:59:00.351 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:59 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:00.351 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:59 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:00.351 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:59 smithi099 ceph-mon[29691]: pgmap v218: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:00.351 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:59 smithi099 ceph-mon[29691]: pgmap v219: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:00.351 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:59 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:00.351 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:59 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:00.351 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:58:59 smithi099 ceph-mon[29691]: Health check failed: 1 failed cephadm daemon(s) (CEPHADM_FAILED_DAEMON) 2024-03-30T13:59:01.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:00 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:01.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:00 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:01.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:00 smithi181 ceph-mon[25762]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-1967-g4e50bbcd 2024-03-30T13:59:01.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:00 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:01.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:00 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:01.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:00 smithi181 ceph-mon[25762]: pgmap v220: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:01.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:00 smithi181 ceph-mon[25762]: pgmap v221: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:01.002 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:00 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:01.002 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:00 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:01.002 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:00 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:01.002 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:00 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:01.002 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:00 smithi181 ceph-mon[25762]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-1967-g4e50bbcd 2024-03-30T13:59:01.002 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:00 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:01.002 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:00 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:01.002 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:00 smithi181 ceph-mon[25762]: pgmap v222: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:01.002 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:00 smithi181 ceph-mon[25762]: pgmap v223: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:01.002 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:00 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:01.002 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:00 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:01.002 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:00 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:01.002 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:00 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:01.002 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:00 smithi181 ceph-mon[25762]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-1967-g4e50bbcd 2024-03-30T13:59:01.002 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:00 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:01.003 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:00 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:01.003 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:00 smithi181 ceph-mon[25762]: pgmap v224: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:01.003 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:00 smithi181 ceph-mon[25762]: pgmap v225: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:01.003 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:00 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:01.003 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:00 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:01.003 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:00 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:01.003 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:00 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:01.003 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:00 smithi181 ceph-mon[25762]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-1967-g4e50bbcd 2024-03-30T13:59:01.003 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:00 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:01.003 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:00 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:01.003 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:00 smithi181 ceph-mon[25762]: pgmap v226: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:01.003 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:00 smithi181 ceph-mon[25762]: pgmap v227: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:01.003 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:00 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:01.003 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:00 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:01.004 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:00 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:01.004 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:00 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:01.004 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:00 smithi181 ceph-mon[25762]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-1967-g4e50bbcd 2024-03-30T13:59:01.004 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:00 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:01.004 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:00 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:01.004 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:00 smithi181 ceph-mon[25762]: pgmap v228: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:01.004 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:00 smithi181 ceph-mon[25762]: pgmap v229: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:01.004 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:00 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:01.004 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:00 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:01.004 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:00 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:01.004 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:00 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:01.004 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:00 smithi181 ceph-mon[25762]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-1967-g4e50bbcd 2024-03-30T13:59:01.004 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:00 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:01.005 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:00 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:01.005 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:00 smithi181 ceph-mon[25762]: pgmap v230: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:01.005 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:00 smithi181 ceph-mon[25762]: pgmap v231: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:01.005 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:00 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:01.005 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:00 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:01.005 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:00 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:01.005 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:00 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:01.005 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:00 smithi181 ceph-mon[25762]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-1967-g4e50bbcd 2024-03-30T13:59:01.005 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:00 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:01.005 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:00 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:01.005 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:00 smithi181 ceph-mon[25762]: pgmap v232: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:01.005 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:00 smithi181 ceph-mon[25762]: pgmap v233: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:01.006 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:00 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:01.006 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:00 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:01.006 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:00 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:01.006 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:00 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:01.006 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:00 smithi181 ceph-mon[25762]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-1967-g4e50bbcd 2024-03-30T13:59:01.006 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:00 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:01.006 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:00 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:01.006 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:00 smithi181 ceph-mon[25762]: pgmap v234: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:01.007 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:00 smithi181 ceph-mon[25762]: pgmap v235: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:01.007 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:00 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:01.007 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:00 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:01.007 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:00 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:01.007 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:00 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:01.007 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:00 smithi181 ceph-mon[25762]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-1967-g4e50bbcd 2024-03-30T13:59:01.007 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:00 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:01.007 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:00 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:01.007 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:00 smithi181 ceph-mon[25762]: pgmap v236: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:01.007 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:00 smithi181 ceph-mon[25762]: pgmap v237: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:01.007 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:00 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:01.007 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:00 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:01.007 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:00 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T13:59:01.007 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:00 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:01.008 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:00 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:01.008 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:00 smithi181 ceph-mon[25762]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-1967-g4e50bbcd 2024-03-30T13:59:01.008 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:00 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:01.008 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:00 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:01.008 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:00 smithi181 ceph-mon[25762]: pgmap v238: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:01.008 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:00 smithi181 ceph-mon[25762]: pgmap v239: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:01.008 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:00 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:01.008 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:00 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:01.008 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:00 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:01.008 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:00 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:01.008 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:00 smithi181 ceph-mon[25762]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-1967-g4e50bbcd 2024-03-30T13:59:01.008 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:00 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:01.008 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:00 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:01.008 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:00 smithi181 ceph-mon[25762]: pgmap v240: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:01.008 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:00 smithi181 ceph-mon[25762]: pgmap v241: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:01.008 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:00 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:01.009 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:00 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:01.009 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:00 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:01.009 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:00 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:01.009 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:00 smithi181 ceph-mon[25762]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-1967-g4e50bbcd 2024-03-30T13:59:01.009 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:00 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:01.009 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:00 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:01.009 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:00 smithi181 ceph-mon[25762]: pgmap v242: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:01.009 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:00 smithi181 ceph-mon[25762]: pgmap v243: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:01.009 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:00 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:01.009 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:00 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:01.331 INFO:journalctl@ceph.alertmanager.a.smithi099.stdout:Mar 30 13:59:01 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-alertmanager-a[64884]: level=info ts=2024-03-30T13:59:01.193Z caller=notify.go:735 component=dispatcher receiver=ceph-dashboard integration=webhook[0] msg="Notify success" attempts=6 2024-03-30T13:59:01.332 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:00 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:01.332 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:00 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:01.332 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:00 smithi099 ceph-mon[24912]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-1967-g4e50bbcd 2024-03-30T13:59:01.332 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:00 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:01.332 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:00 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:01.332 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:00 smithi099 ceph-mon[24912]: pgmap v220: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:01.332 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:00 smithi099 ceph-mon[24912]: pgmap v221: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:01.332 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:00 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:01.332 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:00 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:01.332 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:00 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:01.333 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:00 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:01.333 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:00 smithi099 ceph-mon[24912]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-1967-g4e50bbcd 2024-03-30T13:59:01.333 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:00 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:01.333 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:00 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:01.333 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:00 smithi099 ceph-mon[24912]: pgmap v222: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:01.333 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:00 smithi099 ceph-mon[24912]: pgmap v223: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:01.333 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:00 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:01.333 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:00 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:01.333 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:00 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:01.333 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:00 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:01.333 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:00 smithi099 ceph-mon[24912]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-1967-g4e50bbcd 2024-03-30T13:59:01.333 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:00 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:01.333 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:00 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:01.333 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:00 smithi099 ceph-mon[24912]: pgmap v224: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:01.333 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:00 smithi099 ceph-mon[24912]: pgmap v225: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:01.334 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:00 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:01.334 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:00 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:01.334 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:00 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:01.334 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:00 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:01.334 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:00 smithi099 ceph-mon[24912]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-1967-g4e50bbcd 2024-03-30T13:59:01.334 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:00 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:01.335 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:00 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:01.335 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:00 smithi099 ceph-mon[29691]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-1967-g4e50bbcd 2024-03-30T13:59:01.335 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:00 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:01.335 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:00 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:01.335 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:00 smithi099 ceph-mon[29691]: pgmap v220: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:01.335 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:00 smithi099 ceph-mon[29691]: pgmap v221: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:01.335 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:00 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:01.335 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:00 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:01.335 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:00 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:01.335 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:00 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:01.335 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:00 smithi099 ceph-mon[29691]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-1967-g4e50bbcd 2024-03-30T13:59:01.335 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:00 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:01.335 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:00 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:01.335 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:00 smithi099 ceph-mon[29691]: pgmap v222: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:01.336 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:00 smithi099 ceph-mon[29691]: pgmap v223: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:01.336 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:00 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:01.336 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:00 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:01.336 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:00 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:01.336 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:00 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:01.336 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:00 smithi099 ceph-mon[29691]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-1967-g4e50bbcd 2024-03-30T13:59:01.336 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:00 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:01.336 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:00 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:01.336 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:00 smithi099 ceph-mon[29691]: pgmap v224: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:01.336 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:00 smithi099 ceph-mon[29691]: pgmap v225: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:01.336 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:00 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:01.336 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:00 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:01.336 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:00 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:01.336 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:00 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:01.336 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:00 smithi099 ceph-mon[29691]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-1967-g4e50bbcd 2024-03-30T13:59:01.337 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:00 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:01.337 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:00 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:01.337 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:00 smithi099 ceph-mon[29691]: pgmap v226: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:01.337 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:00 smithi099 ceph-mon[29691]: pgmap v227: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:01.337 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:00 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:01.337 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:00 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:01.337 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:00 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:01.337 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:00 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:01.337 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:00 smithi099 ceph-mon[29691]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-1967-g4e50bbcd 2024-03-30T13:59:01.337 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:00 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:01.337 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:00 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:01.337 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:00 smithi099 ceph-mon[29691]: pgmap v228: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:01.337 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:00 smithi099 ceph-mon[29691]: pgmap v229: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:01.337 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:00 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:01.338 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:00 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:01.338 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:00 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:01.338 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:00 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:01.338 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:00 smithi099 ceph-mon[29691]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-1967-g4e50bbcd 2024-03-30T13:59:01.338 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:00 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:01.338 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:00 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:01.338 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:00 smithi099 ceph-mon[29691]: pgmap v230: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:01.338 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:00 smithi099 ceph-mon[29691]: pgmap v231: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:01.338 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:00 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:01.338 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:00 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:01.338 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:00 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:01.338 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:00 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:01.338 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:00 smithi099 ceph-mon[29691]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-1967-g4e50bbcd 2024-03-30T13:59:01.338 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:00 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:01.339 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:00 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:01.339 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:00 smithi099 ceph-mon[29691]: pgmap v232: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:01.339 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:00 smithi099 ceph-mon[29691]: pgmap v233: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:01.339 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:00 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:01.339 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:00 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:01.339 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:00 smithi099 ceph-mon[24912]: pgmap v226: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:01.339 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:00 smithi099 ceph-mon[24912]: pgmap v227: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:01.339 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:00 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:01.339 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:00 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:01.339 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:00 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:01.339 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:00 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:01.340 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:00 smithi099 ceph-mon[24912]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-1967-g4e50bbcd 2024-03-30T13:59:01.340 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:00 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:01.340 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:00 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:01.340 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:00 smithi099 ceph-mon[24912]: pgmap v228: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:01.340 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:00 smithi099 ceph-mon[24912]: pgmap v229: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:01.340 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:00 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:01.340 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:00 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:01.340 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:00 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:01.340 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:00 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:01.340 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:00 smithi099 ceph-mon[24912]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-1967-g4e50bbcd 2024-03-30T13:59:01.340 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:00 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:01.340 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:00 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:01.340 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:00 smithi099 ceph-mon[24912]: pgmap v230: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:01.340 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:00 smithi099 ceph-mon[24912]: pgmap v231: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:01.341 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:00 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:01.341 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:00 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:01.341 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:00 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:01.341 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:00 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:01.341 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:00 smithi099 ceph-mon[24912]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-1967-g4e50bbcd 2024-03-30T13:59:01.341 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:00 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:01.341 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:00 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:01.341 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:00 smithi099 ceph-mon[24912]: pgmap v232: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:01.341 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:00 smithi099 ceph-mon[24912]: pgmap v233: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:01.341 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:00 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:01.341 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:00 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:01.342 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:00 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:01.342 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:00 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:01.342 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:00 smithi099 ceph-mon[29691]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-1967-g4e50bbcd 2024-03-30T13:59:01.342 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:00 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:01.342 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:00 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:01.342 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:00 smithi099 ceph-mon[29691]: pgmap v234: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:01.342 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:00 smithi099 ceph-mon[29691]: pgmap v235: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:01.342 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:00 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:01.342 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:00 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:01.342 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:00 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:01.342 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:00 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:01.342 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:00 smithi099 ceph-mon[29691]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-1967-g4e50bbcd 2024-03-30T13:59:01.342 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:00 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:01.342 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:00 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:01.342 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:00 smithi099 ceph-mon[29691]: pgmap v236: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:01.343 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:00 smithi099 ceph-mon[29691]: pgmap v237: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:01.343 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:00 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:01.343 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:00 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:01.343 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:00 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T13:59:01.343 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:00 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:01.343 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:00 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:01.343 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:00 smithi099 ceph-mon[29691]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-1967-g4e50bbcd 2024-03-30T13:59:01.343 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:00 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:01.343 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:00 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:01.343 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:00 smithi099 ceph-mon[29691]: pgmap v238: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:01.343 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:00 smithi099 ceph-mon[29691]: pgmap v239: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:01.343 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:00 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:01.343 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:00 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:01.343 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:00 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:01.344 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:00 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:01.344 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:00 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:01.344 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:00 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:01.344 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:00 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:01.344 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:00 smithi099 ceph-mon[24912]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-1967-g4e50bbcd 2024-03-30T13:59:01.344 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:00 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:01.344 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:00 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:01.344 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:00 smithi099 ceph-mon[24912]: pgmap v234: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:01.344 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:00 smithi099 ceph-mon[24912]: pgmap v235: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:01.344 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:00 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:01.344 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:00 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:01.344 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:00 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:01.345 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:00 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:01.345 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:00 smithi099 ceph-mon[24912]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-1967-g4e50bbcd 2024-03-30T13:59:01.345 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:00 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:01.345 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:00 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:01.345 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:00 smithi099 ceph-mon[24912]: pgmap v236: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:01.345 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:00 smithi099 ceph-mon[24912]: pgmap v237: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:01.345 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:00 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:01.345 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:00 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:01.345 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:00 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T13:59:01.345 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:00 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:01.345 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:00 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:01.345 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:00 smithi099 ceph-mon[24912]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-1967-g4e50bbcd 2024-03-30T13:59:01.345 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:00 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:01.345 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:00 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:01.345 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:00 smithi099 ceph-mon[24912]: pgmap v238: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:01.346 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:00 smithi099 ceph-mon[24912]: pgmap v239: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:01.346 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:00 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:01.346 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:00 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:01.346 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:00 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:01.346 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:00 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:01.346 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:00 smithi099 ceph-mon[29691]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-1967-g4e50bbcd 2024-03-30T13:59:01.346 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:00 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:01.346 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:00 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:01.346 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:00 smithi099 ceph-mon[29691]: pgmap v240: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:01.346 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:00 smithi099 ceph-mon[29691]: pgmap v241: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:01.346 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:00 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:01.347 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:00 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:01.347 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:00 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:01.347 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:00 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:01.347 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:00 smithi099 ceph-mon[29691]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-1967-g4e50bbcd 2024-03-30T13:59:01.347 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:00 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:01.347 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:00 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:01.347 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:00 smithi099 ceph-mon[29691]: pgmap v242: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:01.347 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:00 smithi099 ceph-mon[29691]: pgmap v243: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:01.347 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:00 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:01.347 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:00 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:01.347 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:00 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:01.347 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:00 smithi099 ceph-mon[24912]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-1967-g4e50bbcd 2024-03-30T13:59:01.348 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:00 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:01.348 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:00 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:01.348 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:00 smithi099 ceph-mon[24912]: pgmap v240: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:01.348 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:00 smithi099 ceph-mon[24912]: pgmap v241: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:01.348 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:00 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:01.348 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:00 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:01.348 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:00 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:01.348 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:00 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:01.348 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:00 smithi099 ceph-mon[24912]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-1967-g4e50bbcd 2024-03-30T13:59:01.348 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:00 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:01.348 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:00 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:01.348 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:00 smithi099 ceph-mon[24912]: pgmap v242: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:01.348 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:00 smithi099 ceph-mon[24912]: pgmap v243: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:01.348 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:00 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:01.348 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:00 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:02.187 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:01 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:02.188 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:01 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:02.188 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:01 smithi181 ceph-mon[25762]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-1967-g4e50bbcd 2024-03-30T13:59:02.188 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:01 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:02.188 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:01 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:02.188 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:01 smithi181 ceph-mon[25762]: pgmap v244: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:02.188 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:01 smithi181 ceph-mon[25762]: pgmap v245: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:02.188 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:01 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:02.188 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:01 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:02.188 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:01 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:02.188 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:01 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:02.188 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:01 smithi181 ceph-mon[25762]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-1967-g4e50bbcd 2024-03-30T13:59:02.188 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:01 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:02.189 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:01 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:02.189 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:01 smithi181 ceph-mon[25762]: pgmap v246: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:02.189 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:01 smithi181 ceph-mon[25762]: pgmap v247: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:02.189 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:01 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:02.189 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:01 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:02.189 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:01 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:02.189 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:01 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:02.189 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:01 smithi181 ceph-mon[25762]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-1967-g4e50bbcd 2024-03-30T13:59:02.189 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:01 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:02.189 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:01 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:02.189 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:01 smithi181 ceph-mon[25762]: pgmap v248: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:02.189 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:01 smithi181 ceph-mon[25762]: pgmap v249: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:02.189 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:01 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:02.189 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:01 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:02.189 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:01 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:02.190 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:01 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:02.190 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:01 smithi181 ceph-mon[25762]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-1967-g4e50bbcd 2024-03-30T13:59:02.190 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:01 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:02.190 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:01 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:02.190 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:01 smithi181 ceph-mon[25762]: pgmap v250: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:02.190 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:01 smithi181 ceph-mon[25762]: pgmap v251: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:02.190 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:01 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:02.190 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:01 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:02.190 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:01 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:02.190 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:01 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:02.190 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:01 smithi181 ceph-mon[25762]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-1967-g4e50bbcd 2024-03-30T13:59:02.190 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:01 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:02.190 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:01 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:02.190 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:01 smithi181 ceph-mon[25762]: pgmap v252: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:02.191 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:01 smithi181 ceph-mon[25762]: pgmap v253: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:02.191 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:01 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:02.191 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:01 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:02.191 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:01 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:02.191 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:01 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:02.191 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:01 smithi181 ceph-mon[25762]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-1967-g4e50bbcd 2024-03-30T13:59:02.191 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:01 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:02.191 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:01 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:02.191 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:01 smithi181 ceph-mon[25762]: pgmap v254: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:02.191 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:01 smithi181 ceph-mon[25762]: pgmap v255: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:02.191 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:01 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:02.191 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:01 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:02.191 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:01 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:02.191 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:01 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:02.192 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:01 smithi181 ceph-mon[25762]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-1967-g4e50bbcd 2024-03-30T13:59:02.192 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:01 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:02.192 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:01 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:02.192 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:01 smithi181 ceph-mon[25762]: pgmap v256: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:02.192 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:01 smithi181 ceph-mon[25762]: pgmap v257: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:02.192 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:01 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:02.192 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:01 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:02.192 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:01 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:02.192 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:01 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:02.192 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:01 smithi181 ceph-mon[25762]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-1967-g4e50bbcd 2024-03-30T13:59:02.192 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:01 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:02.192 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:01 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:02.192 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:01 smithi181 ceph-mon[25762]: pgmap v258: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 20 KiB/s rd, 20 op/s 2024-03-30T13:59:02.192 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:01 smithi181 ceph-mon[25762]: pgmap v259: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 20 KiB/s rd, 20 op/s 2024-03-30T13:59:02.193 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:01 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:02.193 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:01 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:02.193 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:01 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:02.193 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:01 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:02.193 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:01 smithi181 ceph-mon[25762]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-1967-g4e50bbcd 2024-03-30T13:59:02.193 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:01 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:02.193 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:01 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:02.193 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:01 smithi181 ceph-mon[25762]: pgmap v260: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 18 KiB/s rd, 17 op/s 2024-03-30T13:59:02.193 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:01 smithi181 ceph-mon[25762]: pgmap v261: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 18 KiB/s rd, 17 op/s 2024-03-30T13:59:02.193 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:01 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:02.193 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:01 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:02.194 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:01 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:02.194 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:01 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:02.194 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:01 smithi181 ceph-mon[25762]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-1967-g4e50bbcd 2024-03-30T13:59:02.194 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:01 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:02.194 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:01 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:02.194 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:01 smithi181 ceph-mon[25762]: pgmap v262: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 18 KiB/s rd, 17 op/s 2024-03-30T13:59:02.194 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:01 smithi181 ceph-mon[25762]: pgmap v263: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 18 KiB/s rd, 17 op/s 2024-03-30T13:59:02.194 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:01 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:02.194 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:01 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:02.194 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:01 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:02.194 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:01 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:02.194 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:01 smithi181 ceph-mon[25762]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-1967-g4e50bbcd 2024-03-30T13:59:02.194 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:01 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:02.195 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:01 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:02.195 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:01 smithi181 ceph-mon[25762]: pgmap v264: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:02.195 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:01 smithi181 ceph-mon[25762]: pgmap v265: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:02.195 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:01 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:02.195 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:01 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:02.235 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:01 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:02.235 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:01 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:02.235 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:01 smithi099 ceph-mon[24912]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-1967-g4e50bbcd 2024-03-30T13:59:02.236 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:01 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:02.236 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:01 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:02.236 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:01 smithi099 ceph-mon[24912]: pgmap v244: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:02.236 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:01 smithi099 ceph-mon[24912]: pgmap v245: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:02.236 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:01 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:02.236 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:01 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:02.236 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:01 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:02.236 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:01 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:02.236 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:01 smithi099 ceph-mon[24912]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-1967-g4e50bbcd 2024-03-30T13:59:02.236 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:01 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:02.236 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:01 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:02.237 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:01 smithi099 ceph-mon[24912]: pgmap v246: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:02.237 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:01 smithi099 ceph-mon[24912]: pgmap v247: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:02.237 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:01 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:02.237 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:01 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:02.237 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:01 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:02.237 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:01 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:02.237 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:01 smithi099 ceph-mon[24912]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-1967-g4e50bbcd 2024-03-30T13:59:02.237 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:01 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:02.237 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:01 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:02.237 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:01 smithi099 ceph-mon[24912]: pgmap v248: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:02.237 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:01 smithi099 ceph-mon[24912]: pgmap v249: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:02.237 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:01 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:02.237 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:01 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:02.237 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:01 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:02.238 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:01 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:02.238 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:01 smithi099 ceph-mon[24912]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-1967-g4e50bbcd 2024-03-30T13:59:02.238 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:01 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:02.238 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:01 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:02.238 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:01 smithi099 ceph-mon[29691]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-1967-g4e50bbcd 2024-03-30T13:59:02.238 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:01 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:02.238 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:01 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:02.238 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:01 smithi099 ceph-mon[29691]: pgmap v244: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:02.238 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:01 smithi099 ceph-mon[29691]: pgmap v245: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:02.238 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:01 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:02.239 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:01 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:02.239 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:01 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:02.239 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:01 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:02.239 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:01 smithi099 ceph-mon[29691]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-1967-g4e50bbcd 2024-03-30T13:59:02.239 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:01 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:02.239 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:01 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:02.239 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:01 smithi099 ceph-mon[29691]: pgmap v246: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:02.239 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:01 smithi099 ceph-mon[29691]: pgmap v247: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:02.239 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:01 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:02.239 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:01 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:02.239 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:01 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:02.239 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:01 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:02.239 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:01 smithi099 ceph-mon[29691]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-1967-g4e50bbcd 2024-03-30T13:59:02.239 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:01 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:02.240 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:01 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:02.240 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:01 smithi099 ceph-mon[29691]: pgmap v248: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:02.240 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:01 smithi099 ceph-mon[29691]: pgmap v249: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:02.240 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:01 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:02.240 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:01 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:02.240 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:01 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:02.240 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:01 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:02.240 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:01 smithi099 ceph-mon[29691]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-1967-g4e50bbcd 2024-03-30T13:59:02.240 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:01 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:02.240 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:01 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:02.240 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:01 smithi099 ceph-mon[24912]: pgmap v250: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:02.240 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:01 smithi099 ceph-mon[24912]: pgmap v251: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:02.241 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:01 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:02.241 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:01 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:02.241 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:01 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:02.241 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:01 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:02.241 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:01 smithi099 ceph-mon[24912]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-1967-g4e50bbcd 2024-03-30T13:59:02.241 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:01 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:02.241 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:01 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:02.241 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:01 smithi099 ceph-mon[24912]: pgmap v252: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:02.241 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:01 smithi099 ceph-mon[24912]: pgmap v253: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:02.241 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:01 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:02.241 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:01 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:02.241 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:01 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:02.241 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:01 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:02.241 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:01 smithi099 ceph-mon[24912]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-1967-g4e50bbcd 2024-03-30T13:59:02.241 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:01 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:02.242 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:01 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:02.242 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:01 smithi099 ceph-mon[24912]: pgmap v254: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:02.242 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:01 smithi099 ceph-mon[24912]: pgmap v255: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:02.242 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:01 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:02.242 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:01 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:02.242 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:01 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:02.242 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:01 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:02.242 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:01 smithi099 ceph-mon[24912]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-1967-g4e50bbcd 2024-03-30T13:59:02.242 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:01 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:02.242 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:01 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:02.242 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:01 smithi099 ceph-mon[24912]: pgmap v256: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:02.242 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:01 smithi099 ceph-mon[24912]: pgmap v257: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:02.243 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:01 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:02.243 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:01 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:02.243 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:01 smithi099 ceph-mon[29691]: pgmap v250: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:02.243 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:01 smithi099 ceph-mon[29691]: pgmap v251: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:02.243 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:01 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:02.243 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:01 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:02.243 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:01 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:02.243 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:01 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:02.243 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:01 smithi099 ceph-mon[29691]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-1967-g4e50bbcd 2024-03-30T13:59:02.243 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:01 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:02.243 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:01 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:02.245 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:01 smithi099 ceph-mon[29691]: pgmap v252: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:02.245 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:01 smithi099 ceph-mon[29691]: pgmap v253: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:02.245 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:01 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:02.245 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:01 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:02.245 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:01 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:02.245 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:01 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:02.245 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:01 smithi099 ceph-mon[29691]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-1967-g4e50bbcd 2024-03-30T13:59:02.246 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:01 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:02.246 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:01 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:02.246 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:01 smithi099 ceph-mon[29691]: pgmap v254: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:02.246 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:01 smithi099 ceph-mon[29691]: pgmap v255: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:02.246 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:01 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:02.246 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:01 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:02.246 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:01 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:02.246 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:01 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:02.246 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:01 smithi099 ceph-mon[29691]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-1967-g4e50bbcd 2024-03-30T13:59:02.246 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:01 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:02.246 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:01 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:02.246 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:01 smithi099 ceph-mon[29691]: pgmap v256: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:02.246 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:01 smithi099 ceph-mon[29691]: pgmap v257: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:02.247 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:01 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:02.247 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:01 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:02.247 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:01 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:02.247 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:01 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:02.247 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:01 smithi099 ceph-mon[24912]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-1967-g4e50bbcd 2024-03-30T13:59:02.247 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:01 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:02.247 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:01 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:02.247 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:01 smithi099 ceph-mon[24912]: pgmap v258: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 20 KiB/s rd, 20 op/s 2024-03-30T13:59:02.248 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:01 smithi099 ceph-mon[24912]: pgmap v259: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 20 KiB/s rd, 20 op/s 2024-03-30T13:59:02.248 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:01 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:02.248 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:01 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:02.248 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:01 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:02.248 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:01 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:02.248 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:01 smithi099 ceph-mon[24912]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-1967-g4e50bbcd 2024-03-30T13:59:02.248 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:01 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:02.248 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:01 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:02.248 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:01 smithi099 ceph-mon[24912]: pgmap v260: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 18 KiB/s rd, 17 op/s 2024-03-30T13:59:02.248 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:01 smithi099 ceph-mon[24912]: pgmap v261: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 18 KiB/s rd, 17 op/s 2024-03-30T13:59:02.248 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:01 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:02.248 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:01 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:02.248 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:01 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:02.248 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:01 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:02.248 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:01 smithi099 ceph-mon[24912]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-1967-g4e50bbcd 2024-03-30T13:59:02.248 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:01 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:02.249 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:01 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:02.249 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:01 smithi099 ceph-mon[24912]: pgmap v262: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 18 KiB/s rd, 17 op/s 2024-03-30T13:59:02.249 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:01 smithi099 ceph-mon[24912]: pgmap v263: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 18 KiB/s rd, 17 op/s 2024-03-30T13:59:02.249 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:01 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:02.249 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:01 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:02.249 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:01 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:02.249 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:01 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:02.249 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:01 smithi099 ceph-mon[24912]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-1967-g4e50bbcd 2024-03-30T13:59:02.249 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:01 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:02.249 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:01 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:02.249 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:01 smithi099 ceph-mon[24912]: pgmap v264: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:02.249 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:01 smithi099 ceph-mon[24912]: pgmap v265: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:02.249 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:01 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:02.250 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:01 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:02.250 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:01 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:02.250 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:01 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:02.250 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:01 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:02.250 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:01 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:02.250 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:01 smithi099 ceph-mon[29691]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-1967-g4e50bbcd 2024-03-30T13:59:02.250 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:01 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:02.250 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:01 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:02.250 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:01 smithi099 ceph-mon[29691]: pgmap v258: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 20 KiB/s rd, 20 op/s 2024-03-30T13:59:02.250 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:01 smithi099 ceph-mon[29691]: pgmap v259: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 20 KiB/s rd, 20 op/s 2024-03-30T13:59:02.251 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:01 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:02.251 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:01 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:02.251 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:01 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:02.251 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:01 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:02.251 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:01 smithi099 ceph-mon[29691]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-1967-g4e50bbcd 2024-03-30T13:59:02.251 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:01 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:02.251 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:01 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:02.251 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:01 smithi099 ceph-mon[29691]: pgmap v260: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 18 KiB/s rd, 17 op/s 2024-03-30T13:59:02.251 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:01 smithi099 ceph-mon[29691]: pgmap v261: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 18 KiB/s rd, 17 op/s 2024-03-30T13:59:02.251 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:01 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:02.251 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:01 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:02.251 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:01 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:02.251 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:01 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:02.251 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:01 smithi099 ceph-mon[29691]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-1967-g4e50bbcd 2024-03-30T13:59:02.252 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:01 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:02.252 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:01 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:02.252 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:01 smithi099 ceph-mon[29691]: pgmap v262: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 18 KiB/s rd, 17 op/s 2024-03-30T13:59:02.252 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:01 smithi099 ceph-mon[29691]: pgmap v263: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 18 KiB/s rd, 17 op/s 2024-03-30T13:59:02.252 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:01 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:02.252 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:01 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:02.252 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:01 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:02.252 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:01 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:02.252 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:01 smithi099 ceph-mon[29691]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-1967-g4e50bbcd 2024-03-30T13:59:02.252 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:01 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:02.252 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:01 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:02.252 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:01 smithi099 ceph-mon[29691]: pgmap v264: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:02.252 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:01 smithi099 ceph-mon[29691]: pgmap v265: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:02.252 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:01 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:02.253 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:01 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:03.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:02 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:03.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:02 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:03.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:02 smithi181 ceph-mon[25762]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-1967-g4e50bbcd 2024-03-30T13:59:03.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:02 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:03.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:02 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:03.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:02 smithi181 ceph-mon[25762]: pgmap v266: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:03.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:02 smithi181 ceph-mon[25762]: pgmap v267: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:03.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:02 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:03.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:02 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:03.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:02 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:03.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:02 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:03.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:02 smithi181 ceph-mon[25762]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-1967-g4e50bbcd 2024-03-30T13:59:03.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:02 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:03.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:02 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:03.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:02 smithi181 ceph-mon[25762]: pgmap v268: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:03.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:02 smithi181 ceph-mon[25762]: pgmap v269: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:03.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:02 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:03.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:02 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:03.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:02 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:03.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:02 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:03.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:02 smithi181 ceph-mon[25762]: pgmap v270: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:03.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:02 smithi181 ceph-mon[25762]: pgmap v271: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:03.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:02 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:03.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:02 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:03.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:02 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:03.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:02 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:03.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:02 smithi181 ceph-mon[25762]: pgmap v272: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:03.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:02 smithi181 ceph-mon[25762]: pgmap v273: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:03.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:02 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:03.317 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:02 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:03.317 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:02 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:03.317 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:02 smithi099 ceph-mon[29691]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-1967-g4e50bbcd 2024-03-30T13:59:03.317 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:02 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:03.317 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:02 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:03.317 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:02 smithi099 ceph-mon[29691]: pgmap v266: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:03.317 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:02 smithi099 ceph-mon[29691]: pgmap v267: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:03.317 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:02 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:03.317 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:02 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:03.317 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:02 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:03.317 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:02 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:03.318 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:02 smithi099 ceph-mon[29691]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-1967-g4e50bbcd 2024-03-30T13:59:03.318 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:02 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:03.318 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:02 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:03.318 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:02 smithi099 ceph-mon[29691]: pgmap v268: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:03.318 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:02 smithi099 ceph-mon[29691]: pgmap v269: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:03.318 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:02 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:03.318 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:02 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:03.318 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:02 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:03.318 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:02 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:03.318 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:02 smithi099 ceph-mon[29691]: pgmap v270: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:03.318 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:02 smithi099 ceph-mon[29691]: pgmap v271: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:03.318 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:02 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:03.318 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:02 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:03.318 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:02 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:03.319 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:02 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:03.319 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:02 smithi099 ceph-mon[29691]: pgmap v272: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:03.319 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:02 smithi099 ceph-mon[29691]: pgmap v273: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:03.319 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:02 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:03.319 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:02 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:03.319 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:02 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:03.319 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:02 smithi099 ceph-mon[24912]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-1967-g4e50bbcd 2024-03-30T13:59:03.319 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:02 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:03.319 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:02 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:03.320 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:02 smithi099 ceph-mon[24912]: pgmap v266: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:03.320 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:02 smithi099 ceph-mon[24912]: pgmap v267: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:03.320 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:02 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:03.320 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:02 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:03.320 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:02 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:03.320 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:02 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:03.320 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:02 smithi099 ceph-mon[24912]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-1967-g4e50bbcd 2024-03-30T13:59:03.320 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:02 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:03.320 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:02 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:03.320 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:02 smithi099 ceph-mon[24912]: pgmap v268: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:03.320 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:02 smithi099 ceph-mon[24912]: pgmap v269: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:03.320 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:02 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:03.320 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:02 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:03.320 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:02 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:03.320 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:02 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:03.321 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:02 smithi099 ceph-mon[24912]: pgmap v270: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:03.321 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:02 smithi099 ceph-mon[24912]: pgmap v271: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:03.321 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:02 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:03.321 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:02 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:03.321 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:02 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:03.321 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:02 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:03.321 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:02 smithi099 ceph-mon[24912]: pgmap v272: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:03.321 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:02 smithi099 ceph-mon[24912]: pgmap v273: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:03.321 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:02 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:04.948 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:04 smithi099 ceph-mon[24912]: from='client.25136 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T13:59:04.949 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:59:04 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[71049]: ::ffff:172.21.15.181 - - [30/Mar/2024:13:59:04] "GET /metrics HTTP/1.1" 200 37988 "" "Prometheus/2.33.4" 2024-03-30T13:59:04.949 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:04 smithi099 ceph-mon[29691]: from='client.25136 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T13:59:05.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:04 smithi181 ceph-mon[25762]: from='client.25136 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T13:59:06.084 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:05 smithi181 ceph-mon[25762]: pgmap v274: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:06.084 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:05 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:06.084 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:05 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-03-30T13:59:06.084 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:05 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-03-30T13:59:06.084 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:05 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:06.084 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:05 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "mgr services"}]: dispatch 2024-03-30T13:59:06.084 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:05 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:06.084 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:05 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:06.084 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:05 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:06.331 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:05 smithi099 ceph-mon[24912]: pgmap v274: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:06.331 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:05 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:06.331 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:05 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-03-30T13:59:06.331 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:05 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-03-30T13:59:06.332 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:05 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:06.332 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:05 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "mgr services"}]: dispatch 2024-03-30T13:59:06.332 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:05 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:06.332 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:05 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:06.332 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:05 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:06.332 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:05 smithi099 ceph-mon[29691]: pgmap v274: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:06.332 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:05 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:06.332 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:05 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-03-30T13:59:06.332 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:05 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-03-30T13:59:06.332 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:05 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:06.332 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:05 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "mgr services"}]: dispatch 2024-03-30T13:59:06.332 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:05 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:06.333 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:05 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:06.333 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:05 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:07.166 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:06 smithi181 ceph-mon[25762]: Upgrade: Updating mgr.x 2024-03-30T13:59:07.167 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:06 smithi181 ceph-mon[25762]: Deploying daemon mgr.x on smithi181 2024-03-30T13:59:07.167 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:06 smithi181 ceph-mon[25762]: pgmap v275: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:07.167 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:06 smithi181 ceph-mon[25762]: pgmap v276: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:07.331 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:06 smithi099 ceph-mon[24912]: Upgrade: Updating mgr.x 2024-03-30T13:59:07.331 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:06 smithi099 ceph-mon[24912]: Deploying daemon mgr.x on smithi181 2024-03-30T13:59:07.331 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:06 smithi099 ceph-mon[24912]: pgmap v275: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:07.331 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:06 smithi099 ceph-mon[24912]: pgmap v276: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:07.331 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:06 smithi099 ceph-mon[29691]: Upgrade: Updating mgr.x 2024-03-30T13:59:07.331 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:06 smithi099 ceph-mon[29691]: Deploying daemon mgr.x on smithi181 2024-03-30T13:59:07.331 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:06 smithi099 ceph-mon[29691]: pgmap v275: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:07.331 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:06 smithi099 ceph-mon[29691]: pgmap v276: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:09.168 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:08 smithi181 ceph-mon[25762]: pgmap v277: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 1003 B/s rd, 0 op/s 2024-03-30T13:59:09.169 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 13:59:08 smithi181 systemd[1]: Stopping Ceph mgr.x for 98ebaeb8-ee99-11ee-b647-cb9ed24678a4... 2024-03-30T13:59:09.331 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:08 smithi099 ceph-mon[24912]: pgmap v277: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 1003 B/s rd, 0 op/s 2024-03-30T13:59:09.331 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:08 smithi099 ceph-mon[29691]: pgmap v277: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 1003 B/s rd, 0 op/s 2024-03-30T13:59:09.470 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 13:59:09 smithi181 podman[79858]: 2024-03-30 13:59:09.172513632 +0000 UTC m=+0.145617463 container died 2a85ec6e53f1115fc9b406ae72703a32e65aadd83f8f953fbd4fa8a82d64735f (image=quay.io/ceph/ceph@sha256:12a0a4f43413fd97a14a3d47a3451b2d2df50020835bb93db666209f3f77617a, name=ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-x, summary=Provides a CentOS Stream container based on the Red Hat Universal Base Image, GIT_BRANCH=HEAD, GIT_REPO=https://github.com/ceph/ceph-container.git, io.openshift.expose-services=, name=centos-stream, ceph=True, vcs-ref=f1ee6e37554363ec55e0035aba1a693d3627fdeb, com.redhat.build-host=cpt-1002.osbs.prod.upshift.rdu2.redhat.com, io.buildah.version=1.19.8, GIT_CLEAN=True, vendor=Red Hat, Inc., io.k8s.description=The Universal Base Image is designed and engineered to be the base layer for all of your containerized applications, middleware and utilities. This base image is freely redistributable, but Red Hat only supports Red Hat technologies through subscriptions for Red Hat products. This image is maintained by Red Hat and updated regularly., CEPH_POINT_RELEASE=-17.2.0, distribution-scope=public, com.redhat.license_terms=https://centos.org/legal/licensing-policy/, com.redhat.component=centos-stream-container, io.k8s.display-name=CentOS Stream 8, vcs-type=git, description=CentOS Stream is a continuously delivered distro that tracks just ahead of Red Hat Enterprise Linux development. This image takes the Red Hat UBI and layers on content from CentOS Stream, url=https://access.redhat.com/containers/#/registry.access.redhat.com/ubi8/images/8.6-754, build-date=2022-05-03T08:36:31.336870, release=754, GIT_COMMIT=b613db0f44179c0940781c1c7fe04e1acb7093ac, io.openshift.tags=base centos centos-stream, version=8, RELEASE=HEAD, maintainer=Guillaume Abrioux , architecture=x86_64) 2024-03-30T13:59:09.750 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 13:59:09 smithi181 podman[79858]: 2024-03-30 13:59:09.549787326 +0000 UTC m=+0.522891139 container cleanup 2a85ec6e53f1115fc9b406ae72703a32e65aadd83f8f953fbd4fa8a82d64735f (image=quay.io/ceph/ceph@sha256:12a0a4f43413fd97a14a3d47a3451b2d2df50020835bb93db666209f3f77617a, name=ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-x, summary=Provides a CentOS Stream container based on the Red Hat Universal Base Image, GIT_COMMIT=b613db0f44179c0940781c1c7fe04e1acb7093ac, name=centos-stream, io.openshift.expose-services=, url=https://access.redhat.com/containers/#/registry.access.redhat.com/ubi8/images/8.6-754, CEPH_POINT_RELEASE=-17.2.0, io.buildah.version=1.19.8, description=CentOS Stream is a continuously delivered distro that tracks just ahead of Red Hat Enterprise Linux development. This image takes the Red Hat UBI and layers on content from CentOS Stream, com.redhat.component=centos-stream-container, io.k8s.description=The Universal Base Image is designed and engineered to be the base layer for all of your containerized applications, middleware and utilities. This base image is freely redistributable, but Red Hat only supports Red Hat technologies through subscriptions for Red Hat products. This image is maintained by Red Hat and updated regularly., build-date=2022-05-03T08:36:31.336870, version=8, vendor=Red Hat, Inc., RELEASE=HEAD, io.k8s.display-name=CentOS Stream 8, GIT_REPO=https://github.com/ceph/ceph-container.git, com.redhat.license_terms=https://centos.org/legal/licensing-policy/, release=754, architecture=x86_64, vcs-type=git, io.openshift.tags=base centos centos-stream, GIT_CLEAN=True, GIT_BRANCH=HEAD, distribution-scope=public, maintainer=Guillaume Abrioux , ceph=True, vcs-ref=f1ee6e37554363ec55e0035aba1a693d3627fdeb, com.redhat.build-host=cpt-1002.osbs.prod.upshift.rdu2.redhat.com) 2024-03-30T13:59:09.750 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 13:59:09 smithi181 bash[79858]: ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-x 2024-03-30T13:59:10.110 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 13:59:09 smithi181 podman[79872]: 2024-03-30 13:59:09.792670864 +0000 UTC m=+0.618388850 container remove 2a85ec6e53f1115fc9b406ae72703a32e65aadd83f8f953fbd4fa8a82d64735f (image=quay.io/ceph/ceph@sha256:12a0a4f43413fd97a14a3d47a3451b2d2df50020835bb93db666209f3f77617a, name=ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-x, ceph=True, GIT_CLEAN=True, com.redhat.component=centos-stream-container, io.k8s.display-name=CentOS Stream 8, io.buildah.version=1.19.8, vendor=Red Hat, Inc., name=centos-stream, io.k8s.description=The Universal Base Image is designed and engineered to be the base layer for all of your containerized applications, middleware and utilities. This base image is freely redistributable, but Red Hat only supports Red Hat technologies through subscriptions for Red Hat products. This image is maintained by Red Hat and updated regularly., version=8, GIT_REPO=https://github.com/ceph/ceph-container.git, io.openshift.expose-services=, vcs-ref=f1ee6e37554363ec55e0035aba1a693d3627fdeb, url=https://access.redhat.com/containers/#/registry.access.redhat.com/ubi8/images/8.6-754, release=754, description=CentOS Stream is a continuously delivered distro that tracks just ahead of Red Hat Enterprise Linux development. This image takes the Red Hat UBI and layers on content from CentOS Stream, maintainer=Guillaume Abrioux , vcs-type=git, io.openshift.tags=base centos centos-stream, build-date=2022-05-03T08:36:31.336870, GIT_COMMIT=b613db0f44179c0940781c1c7fe04e1acb7093ac, com.redhat.build-host=cpt-1002.osbs.prod.upshift.rdu2.redhat.com, RELEASE=HEAD, CEPH_POINT_RELEASE=-17.2.0, distribution-scope=public, architecture=x86_64, summary=Provides a CentOS Stream container based on the Red Hat Universal Base Image, com.redhat.license_terms=https://centos.org/legal/licensing-policy/, GIT_BRANCH=HEAD) 2024-03-30T13:59:10.110 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 13:59:09 smithi181 systemd[1]: ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4@mgr.x.service: Main process exited, code=exited, status=143/n/a 2024-03-30T13:59:10.110 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 13:59:09 smithi181 systemd[1]: ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4@mgr.x.service: Failed with result 'exit-code'. 2024-03-30T13:59:10.110 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 13:59:09 smithi181 systemd[1]: Stopped Ceph mgr.x for 98ebaeb8-ee99-11ee-b647-cb9ed24678a4. 2024-03-30T13:59:10.110 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 13:59:09 smithi181 systemd[1]: ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4@mgr.x.service: Consumed 7.657s CPU time. 2024-03-30T13:59:10.110 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 13:59:10 smithi181 systemd[1]: Starting Ceph mgr.x for 98ebaeb8-ee99-11ee-b647-cb9ed24678a4... 2024-03-30T13:59:10.443 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 13:59:10 smithi181 podman[80005]: 2024-03-30 13:59:10.232737419 +0000 UTC m=+0.017815928 image pull b0c4478f1d83795df4d538bf108aee5fac57194348fb16dcdbb3115f3e2fe95e quay.ceph.io/ceph-ci/ceph:4e50bbcdd1630c7760b708f3a5b4d38a121e66cb 2024-03-30T13:59:10.443 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 13:59:10 smithi181 podman[80005]: 2024-03-30 13:59:10.344108681 +0000 UTC m=+0.129187190 container create 4216ebd39746cd8a32a3ced07848151df02360ee0cd8b9174699a2458ea7dcb4 (image=quay.ceph.io/ceph-ci/ceph:4e50bbcdd1630c7760b708f3a5b4d38a121e66cb, name=ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-x, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, ceph=True, RELEASE=squid-4e50bbc, org.label-schema.build-date=20240326, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2) 2024-03-30T13:59:10.750 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 13:59:10 smithi181 podman[80005]: 2024-03-30 13:59:10.571500025 +0000 UTC m=+0.356578533 container init 4216ebd39746cd8a32a3ced07848151df02360ee0cd8b9174699a2458ea7dcb4 (image=quay.ceph.io/ceph-ci/ceph:4e50bbcdd1630c7760b708f3a5b4d38a121e66cb, name=ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-x, org.label-schema.vendor=CentOS, RELEASE=squid-4e50bbc, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, GIT_BRANCH=HEAD, org.label-schema.build-date=20240326, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, GIT_CLEAN=True, org.label-schema.schema-version=1.0, ceph=True) 2024-03-30T13:59:10.750 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 13:59:10 smithi181 podman[80005]: 2024-03-30 13:59:10.574213948 +0000 UTC m=+0.359292456 container start 4216ebd39746cd8a32a3ced07848151df02360ee0cd8b9174699a2458ea7dcb4 (image=quay.ceph.io/ceph-ci/ceph:4e50bbcdd1630c7760b708f3a5b4d38a121e66cb, name=ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-x, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-4e50bbc, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , ceph=True, GIT_BRANCH=HEAD, org.label-schema.build-date=20240326, CEPH_POINT_RELEASE=) 2024-03-30T13:59:10.751 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 13:59:10 smithi181 ceph-mgr[80024]: -- 172.21.15.181:0/2969863508 <== mon.2 v2:172.21.15.181:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5639a34fe5a0 con 0x5639a34d2800 2024-03-30T13:59:10.751 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 13:59:10 smithi181 bash[80005]: 4216ebd39746cd8a32a3ced07848151df02360ee0cd8b9174699a2458ea7dcb4 2024-03-30T13:59:10.751 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 13:59:10 smithi181 systemd[1]: Started Ceph mgr.x for 98ebaeb8-ee99-11ee-b647-cb9ed24678a4. 2024-03-30T13:59:11.132 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:10 smithi099 ceph-mon[24912]: pgmap v278: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 744 B/s rd, 0 op/s 2024-03-30T13:59:11.133 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:10 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:11.133 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:10 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:11.133 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:10 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:11.133 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:10 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:11.133 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:10 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:11.133 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:10 smithi099 ceph-mon[29691]: pgmap v278: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 744 B/s rd, 0 op/s 2024-03-30T13:59:11.133 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:10 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:11.133 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:10 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:11.133 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:10 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:11.133 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:10 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:11.133 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:10 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:11.134 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:10 smithi181 ceph-mon[25762]: pgmap v278: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 744 B/s rd, 0 op/s 2024-03-30T13:59:11.134 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:10 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:11.134 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:10 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:11.134 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:10 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:11.134 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:10 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:11.135 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:10 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:11.415 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 13:59:11 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-x[80020]: 2024-03-30T13:59:11.139+0000 7fb2e25bc200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-03-30T13:59:11.415 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 13:59:11 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-x[80020]: 2024-03-30T13:59:11.250+0000 7fb2e25bc200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-03-30T13:59:12.196 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 13:59:11 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-x[80020]: 2024-03-30T13:59:11.944+0000 7fb2e25bc200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-03-30T13:59:12.196 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 13:59:12 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-x[80020]: 2024-03-30T13:59:12.052+0000 7fb2e25bc200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-03-30T13:59:12.197 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:11 smithi181 ceph-mon[25762]: pgmap v279: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 616 B/s rd, 0 op/s 2024-03-30T13:59:12.197 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:11 smithi181 ceph-mon[25762]: pgmap v280: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 812 B/s rd, 0 op/s 2024-03-30T13:59:12.197 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:11 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:12.197 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:11 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:12.197 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:11 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:12.197 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:11 smithi181 ceph-mon[25762]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-1967-g4e50bbcd 2024-03-30T13:59:12.197 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:11 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.x"}]: dispatch 2024-03-30T13:59:12.198 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:11 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.x"}]: dispatch 2024-03-30T13:59:12.198 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:11 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr.x"}]': finished 2024-03-30T13:59:12.198 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:11 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:12.198 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:11 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:12.198 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:11 smithi181 ceph-mon[25762]: pgmap v281: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 917 B/s rd, 0 op/s 2024-03-30T13:59:12.198 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:11 smithi181 ceph-mon[25762]: pgmap v282: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 917 B/s rd, 0 op/s 2024-03-30T13:59:12.198 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:11 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:12.198 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:11 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:12.198 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:11 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:12.198 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:11 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:12.198 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:11 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:12.198 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:11 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:12.198 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:11 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:12.198 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:11 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:12.198 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:11 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:12.199 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:11 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:12.199 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:11 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:12.199 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:11 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:12.199 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:11 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:12.199 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:11 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:12.199 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:11 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:12.199 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:11 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:12.199 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:11 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:12.199 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:11 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:12.199 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:11 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:12.199 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:11 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:12.199 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:11 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:12.199 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:11 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:12.199 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:11 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:12.199 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:11 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:12.200 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:11 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:12.200 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:11 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:12.200 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:11 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:12.200 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:11 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:12.200 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:11 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:12.200 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:11 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:12.200 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:11 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:12.200 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:11 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:12.200 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:11 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:12.200 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:11 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:12.200 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:11 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:12.200 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:11 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:12.200 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:11 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:12.200 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:11 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:12.200 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:11 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:12.201 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:11 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:12.201 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:11 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:12.201 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:11 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:12.201 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:11 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:12.201 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:11 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:12.201 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:11 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:12.201 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:11 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:12.331 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:11 smithi099 ceph-mon[24912]: pgmap v279: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 616 B/s rd, 0 op/s 2024-03-30T13:59:12.331 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:11 smithi099 ceph-mon[24912]: pgmap v280: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 812 B/s rd, 0 op/s 2024-03-30T13:59:12.331 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:11 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:12.331 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:11 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:12.331 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:11 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:12.331 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:11 smithi099 ceph-mon[24912]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-1967-g4e50bbcd 2024-03-30T13:59:12.331 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:11 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.x"}]: dispatch 2024-03-30T13:59:12.332 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:11 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.x"}]: dispatch 2024-03-30T13:59:12.332 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:11 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr.x"}]': finished 2024-03-30T13:59:12.332 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:11 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:12.332 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:11 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:12.332 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:11 smithi099 ceph-mon[24912]: pgmap v281: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 917 B/s rd, 0 op/s 2024-03-30T13:59:12.332 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:11 smithi099 ceph-mon[24912]: pgmap v282: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 917 B/s rd, 0 op/s 2024-03-30T13:59:12.332 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:11 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:12.332 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:11 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:12.332 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:11 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:12.332 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:11 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:12.332 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:11 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:12.332 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:11 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:12.332 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:11 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:12.332 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:11 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:12.332 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:11 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:12.333 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:11 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:12.333 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:11 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:12.333 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:11 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:12.333 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:11 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:12.333 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:11 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:12.333 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:11 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:12.333 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:11 smithi099 ceph-mon[29691]: pgmap v279: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 616 B/s rd, 0 op/s 2024-03-30T13:59:12.333 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:11 smithi099 ceph-mon[29691]: pgmap v280: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 812 B/s rd, 0 op/s 2024-03-30T13:59:12.333 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:11 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:12.333 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:11 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:12.333 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:11 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:12.334 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:11 smithi099 ceph-mon[29691]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-1967-g4e50bbcd 2024-03-30T13:59:12.334 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:11 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.x"}]: dispatch 2024-03-30T13:59:12.334 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:11 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.x"}]: dispatch 2024-03-30T13:59:12.334 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:11 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr.x"}]': finished 2024-03-30T13:59:12.334 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:11 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:12.334 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:11 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:12.334 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:11 smithi099 ceph-mon[29691]: pgmap v281: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 917 B/s rd, 0 op/s 2024-03-30T13:59:12.334 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:11 smithi099 ceph-mon[29691]: pgmap v282: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 917 B/s rd, 0 op/s 2024-03-30T13:59:12.334 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:11 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:12.334 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:11 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:12.334 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:11 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:12.334 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:11 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:12.334 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:11 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:12.334 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:11 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:12.335 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:11 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:12.335 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:11 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:12.335 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:11 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:12.335 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:11 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:12.335 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:11 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:12.335 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:11 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:12.335 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:11 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:12.335 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:11 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:12.335 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:11 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:12.335 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:11 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:12.336 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:11 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:12.336 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:11 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:12.336 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:11 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:12.336 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:11 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:12.336 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:11 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:12.336 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:11 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:12.336 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:11 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:12.336 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:11 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:12.336 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:11 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:12.336 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:11 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:12.336 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:11 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:12.336 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:11 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:12.336 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:11 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:12.336 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:11 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:12.336 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:11 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:12.337 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:11 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:12.337 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:11 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:12.337 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:11 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:12.337 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:11 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:12.337 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:11 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:12.337 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:11 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:12.337 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:11 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:12.337 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:11 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:12.337 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:11 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:12.337 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:11 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:12.337 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:11 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:12.337 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:11 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:12.337 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:11 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:12.337 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:11 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:12.337 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:11 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:12.338 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:11 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:12.338 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:11 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:12.338 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:11 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:12.338 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:11 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:12.338 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:11 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:12.338 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:11 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:12.338 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:11 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:12.338 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:11 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:12.338 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:11 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:12.338 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:11 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:12.339 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:11 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:12.339 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:11 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:12.339 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:11 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:12.339 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:11 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:12.339 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:11 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:12.339 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:11 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:12.339 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:11 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:12.339 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:11 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:12.339 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:11 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:12.339 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:11 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:12.339 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:11 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:12.339 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:11 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:12.339 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:11 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:12.339 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:11 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:12.339 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:11 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:12.340 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:11 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:12.340 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:11 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:12.340 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:11 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:12.340 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:11 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:12.340 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:11 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:12.340 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:11 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:12.500 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 13:59:12 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-x[80020]: 2024-03-30T13:59:12.201+0000 7fb2e25bc200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-03-30T13:59:12.500 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 13:59:12 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-x[80020]: 2024-03-30T13:59:12.301+0000 7fb2e25bc200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-03-30T13:59:12.500 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 13:59:12 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-x[80020]: 2024-03-30T13:59:12.392+0000 7fb2e25bc200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-03-30T13:59:12.802 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 13:59:12 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-x[80020]: 2024-03-30T13:59:12.689+0000 7fb2e25bc200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-03-30T13:59:12.802 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 13:59:12 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-x[80020]: 2024-03-30T13:59:12.806+0000 7fb2e25bc200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-03-30T13:59:13.220 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 13:59:12 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-x[80020]: 2024-03-30T13:59:12.901+0000 7fb2e25bc200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-03-30T13:59:13.220 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 13:59:13 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-x[80020]: 2024-03-30T13:59:13.006+0000 7fb2e25bc200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-03-30T13:59:13.220 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:12 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:13.221 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:12 smithi181 ceph-mon[25762]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-1967-g4e50bbcd 2024-03-30T13:59:13.221 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:12 smithi181 ceph-mon[25762]: pgmap v283: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:13.221 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:12 smithi181 ceph-mon[25762]: pgmap v284: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:13.221 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:12 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:13.221 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:12 smithi181 ceph-mon[25762]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-1967-g4e50bbcd 2024-03-30T13:59:13.221 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:12 smithi181 ceph-mon[25762]: pgmap v285: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:13.221 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:12 smithi181 ceph-mon[25762]: pgmap v286: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:13.221 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:12 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:13.221 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:12 smithi181 ceph-mon[25762]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-1967-g4e50bbcd 2024-03-30T13:59:13.221 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:12 smithi181 ceph-mon[25762]: pgmap v287: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:13.221 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:12 smithi181 ceph-mon[25762]: pgmap v288: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:13.221 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:12 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:13.221 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:12 smithi181 ceph-mon[25762]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-1967-g4e50bbcd 2024-03-30T13:59:13.222 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:12 smithi181 ceph-mon[25762]: pgmap v289: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:13.222 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:12 smithi181 ceph-mon[25762]: pgmap v290: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:13.222 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:12 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:13.222 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:12 smithi181 ceph-mon[25762]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-1967-g4e50bbcd 2024-03-30T13:59:13.222 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:12 smithi181 ceph-mon[25762]: pgmap v291: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:13.222 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:12 smithi181 ceph-mon[25762]: pgmap v292: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:13.222 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:12 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:13.222 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:12 smithi181 ceph-mon[25762]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-1967-g4e50bbcd 2024-03-30T13:59:13.222 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:12 smithi181 ceph-mon[25762]: pgmap v293: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:13.222 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:12 smithi181 ceph-mon[25762]: pgmap v294: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:13.222 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:12 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:13.222 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:12 smithi181 ceph-mon[25762]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-1967-g4e50bbcd 2024-03-30T13:59:13.222 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:12 smithi181 ceph-mon[25762]: pgmap v295: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 18 KiB/s rd, 17 op/s 2024-03-30T13:59:13.222 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:12 smithi181 ceph-mon[25762]: pgmap v296: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 17 KiB/s rd, 17 op/s 2024-03-30T13:59:13.222 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:12 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:13.223 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:12 smithi181 ceph-mon[25762]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-1967-g4e50bbcd 2024-03-30T13:59:13.223 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:12 smithi181 ceph-mon[25762]: pgmap v297: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 17 KiB/s rd, 17 op/s 2024-03-30T13:59:13.223 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:12 smithi181 ceph-mon[25762]: pgmap v298: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 17 KiB/s rd, 17 op/s 2024-03-30T13:59:13.223 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:12 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:13.223 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:12 smithi181 ceph-mon[25762]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-1967-g4e50bbcd 2024-03-30T13:59:13.223 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:12 smithi181 ceph-mon[25762]: pgmap v299: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 20 KiB/s rd, 20 op/s 2024-03-30T13:59:13.223 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:12 smithi181 ceph-mon[25762]: pgmap v300: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 20 KiB/s rd, 20 op/s 2024-03-30T13:59:13.223 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:12 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:13.223 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:12 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:13.223 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:12 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:13.223 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:12 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:13.223 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:12 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:13.223 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:12 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:13.223 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:12 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:13.224 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:12 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:13.224 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:12 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:13.224 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:12 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:13.224 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:12 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:13.224 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:12 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:13.224 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:12 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:13.224 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:12 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:13.224 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:12 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:13.224 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:12 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:13.224 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:12 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:13.224 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:12 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:13.224 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:12 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:13.224 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:12 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:13.224 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:12 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:13.224 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:12 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:13.225 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:12 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:13.225 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:12 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:13.225 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:12 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:13.225 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:12 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:13.225 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:12 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:13.225 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:12 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:13.225 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:12 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:13.225 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:12 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:13.225 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:12 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:13.225 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:12 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:13.225 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:12 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:13.225 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:12 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:13.225 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:12 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:13.225 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:12 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:13.226 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:12 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:13.226 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:12 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:13.226 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:12 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:13.226 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:12 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:13.226 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:12 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:13.226 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:12 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:13.226 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:12 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:13.226 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:12 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:13.226 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:12 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:13.226 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:12 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:13.226 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:12 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:13.226 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:12 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:13.226 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:12 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:13.226 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:12 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:13.226 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:12 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:13.227 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:12 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:13.227 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:12 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:13.227 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:12 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:13.227 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:12 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:13.227 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:12 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:13.227 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:12 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:13.227 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:12 smithi099 ceph-mon[24912]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-1967-g4e50bbcd 2024-03-30T13:59:13.227 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:12 smithi099 ceph-mon[24912]: pgmap v283: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:13.228 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:12 smithi099 ceph-mon[24912]: pgmap v284: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:13.228 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:12 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:13.228 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:12 smithi099 ceph-mon[24912]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-1967-g4e50bbcd 2024-03-30T13:59:13.228 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:12 smithi099 ceph-mon[24912]: pgmap v285: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:13.228 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:12 smithi099 ceph-mon[24912]: pgmap v286: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:13.228 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:12 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:13.228 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:12 smithi099 ceph-mon[24912]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-1967-g4e50bbcd 2024-03-30T13:59:13.228 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:12 smithi099 ceph-mon[24912]: pgmap v287: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:13.228 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:12 smithi099 ceph-mon[24912]: pgmap v288: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:13.228 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:12 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:13.228 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:12 smithi099 ceph-mon[24912]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-1967-g4e50bbcd 2024-03-30T13:59:13.228 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:12 smithi099 ceph-mon[24912]: pgmap v289: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:13.228 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:12 smithi099 ceph-mon[24912]: pgmap v290: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:13.228 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:12 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:13.228 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:12 smithi099 ceph-mon[24912]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-1967-g4e50bbcd 2024-03-30T13:59:13.229 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:12 smithi099 ceph-mon[24912]: pgmap v291: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:13.229 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:12 smithi099 ceph-mon[24912]: pgmap v292: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:13.229 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:12 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:13.229 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:12 smithi099 ceph-mon[24912]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-1967-g4e50bbcd 2024-03-30T13:59:13.229 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:12 smithi099 ceph-mon[24912]: pgmap v293: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:13.229 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:12 smithi099 ceph-mon[24912]: pgmap v294: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:13.229 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:12 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:13.229 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:12 smithi099 ceph-mon[24912]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-1967-g4e50bbcd 2024-03-30T13:59:13.229 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:12 smithi099 ceph-mon[24912]: pgmap v295: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 18 KiB/s rd, 17 op/s 2024-03-30T13:59:13.229 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:12 smithi099 ceph-mon[24912]: pgmap v296: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 17 KiB/s rd, 17 op/s 2024-03-30T13:59:13.229 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:12 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:13.229 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:12 smithi099 ceph-mon[24912]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-1967-g4e50bbcd 2024-03-30T13:59:13.229 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:12 smithi099 ceph-mon[24912]: pgmap v297: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 17 KiB/s rd, 17 op/s 2024-03-30T13:59:13.229 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:12 smithi099 ceph-mon[24912]: pgmap v298: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 17 KiB/s rd, 17 op/s 2024-03-30T13:59:13.230 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:12 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:13.230 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:12 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:13.230 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:12 smithi099 ceph-mon[29691]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-1967-g4e50bbcd 2024-03-30T13:59:13.230 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:12 smithi099 ceph-mon[29691]: pgmap v283: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:13.230 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:12 smithi099 ceph-mon[29691]: pgmap v284: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:13.230 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:12 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:13.230 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:12 smithi099 ceph-mon[29691]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-1967-g4e50bbcd 2024-03-30T13:59:13.231 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:12 smithi099 ceph-mon[29691]: pgmap v285: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:13.231 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:12 smithi099 ceph-mon[29691]: pgmap v286: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:13.231 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:12 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:13.231 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:12 smithi099 ceph-mon[29691]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-1967-g4e50bbcd 2024-03-30T13:59:13.231 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:12 smithi099 ceph-mon[29691]: pgmap v287: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:13.231 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:12 smithi099 ceph-mon[29691]: pgmap v288: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:13.231 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:12 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:13.231 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:12 smithi099 ceph-mon[29691]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-1967-g4e50bbcd 2024-03-30T13:59:13.231 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:12 smithi099 ceph-mon[29691]: pgmap v289: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:13.231 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:12 smithi099 ceph-mon[29691]: pgmap v290: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:13.231 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:12 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:13.231 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:12 smithi099 ceph-mon[29691]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-1967-g4e50bbcd 2024-03-30T13:59:13.231 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:12 smithi099 ceph-mon[29691]: pgmap v291: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:13.231 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:12 smithi099 ceph-mon[29691]: pgmap v292: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:13.232 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:12 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:13.232 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:12 smithi099 ceph-mon[29691]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-1967-g4e50bbcd 2024-03-30T13:59:13.232 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:12 smithi099 ceph-mon[29691]: pgmap v293: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:13.232 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:12 smithi099 ceph-mon[29691]: pgmap v294: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:13.232 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:12 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:13.232 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:12 smithi099 ceph-mon[29691]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-1967-g4e50bbcd 2024-03-30T13:59:13.232 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:12 smithi099 ceph-mon[29691]: pgmap v295: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 18 KiB/s rd, 17 op/s 2024-03-30T13:59:13.232 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:12 smithi099 ceph-mon[29691]: pgmap v296: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 17 KiB/s rd, 17 op/s 2024-03-30T13:59:13.232 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:12 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:13.232 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:12 smithi099 ceph-mon[29691]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-1967-g4e50bbcd 2024-03-30T13:59:13.232 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:12 smithi099 ceph-mon[29691]: pgmap v297: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 17 KiB/s rd, 17 op/s 2024-03-30T13:59:13.232 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:12 smithi099 ceph-mon[29691]: pgmap v298: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 17 KiB/s rd, 17 op/s 2024-03-30T13:59:13.232 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:12 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:13.233 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:12 smithi099 ceph-mon[24912]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-1967-g4e50bbcd 2024-03-30T13:59:13.233 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:12 smithi099 ceph-mon[24912]: pgmap v299: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 20 KiB/s rd, 20 op/s 2024-03-30T13:59:13.233 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:12 smithi099 ceph-mon[24912]: pgmap v300: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 20 KiB/s rd, 20 op/s 2024-03-30T13:59:13.233 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:12 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:13.233 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:12 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:13.233 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:12 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:13.233 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:12 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:13.233 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:12 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:13.233 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:12 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:13.233 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:12 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:13.234 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:12 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:13.234 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:12 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:13.234 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:12 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:13.234 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:12 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:13.234 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:12 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:13.234 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:12 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:13.234 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:12 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:13.234 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:12 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:13.234 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:12 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:13.234 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:12 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:13.235 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:12 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:13.235 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:12 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:13.235 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:12 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:13.235 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:12 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:13.235 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:12 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:13.235 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:12 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:13.235 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:12 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:13.235 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:12 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:13.235 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:12 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:13.235 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:12 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:13.235 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:12 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:13.235 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:12 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:13.235 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:12 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:13.235 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:12 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:13.235 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:12 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:13.236 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:12 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:13.236 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:12 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:13.236 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:12 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:13.236 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:12 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:13.236 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:12 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:13.236 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:12 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:13.236 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:12 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:13.236 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:12 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:13.236 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:12 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:13.236 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:12 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:13.236 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:12 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:13.236 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:12 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:13.236 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:12 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:13.236 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:12 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:13.237 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:12 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:13.237 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:12 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:13.237 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:12 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:13.237 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:12 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:13.237 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:12 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:13.237 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:12 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:13.237 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:12 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:13.237 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:12 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:13.237 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:12 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:13.237 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:12 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:13.238 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:12 smithi099 ceph-mon[29691]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-1967-g4e50bbcd 2024-03-30T13:59:13.238 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:12 smithi099 ceph-mon[29691]: pgmap v299: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 20 KiB/s rd, 20 op/s 2024-03-30T13:59:13.238 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:12 smithi099 ceph-mon[29691]: pgmap v300: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 20 KiB/s rd, 20 op/s 2024-03-30T13:59:13.238 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:12 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:13.238 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:12 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:13.238 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:12 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:13.238 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:12 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:13.238 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:12 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:13.239 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:12 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:13.239 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:12 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:13.239 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:12 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:13.239 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:12 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:13.239 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:12 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:13.239 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:12 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:13.239 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:12 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:13.239 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:12 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:13.239 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:12 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:13.239 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:12 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:13.239 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:12 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:13.239 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:12 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:13.239 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:12 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:13.239 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:12 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:13.239 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:12 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:13.240 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:12 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:13.240 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:12 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:13.240 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:12 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:13.240 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:12 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:13.240 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:12 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:13.240 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:12 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:13.240 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:12 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:13.240 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:12 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:13.240 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:12 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:13.240 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:12 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:13.240 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:12 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:13.240 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:12 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:13.240 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:12 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:13.240 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:12 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:13.240 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:12 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:13.241 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:12 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:13.241 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:12 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:13.241 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:12 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:13.241 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:12 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:13.241 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:12 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:13.241 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:12 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:13.241 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:12 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:13.241 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:12 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:13.241 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:12 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:13.241 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:12 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:13.241 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:12 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:13.241 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:12 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:13.241 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:12 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:13.241 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:12 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:13.241 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:12 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:13.242 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:12 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:13.242 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:12 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:13.242 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:12 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:13.242 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:12 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:13.242 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:12 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:13.242 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:12 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:13.484 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 13:59:13 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-x[80020]: 2024-03-30T13:59:13.223+0000 7fb2e25bc200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-03-30T13:59:13.831 INFO:journalctl@ceph.alertmanager.a.smithi099.stdout:Mar 30 13:59:13 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-alertmanager-a[64884]: level=warn ts=2024-03-30T13:59:13.553Z caller=notify.go:724 component=dispatcher receiver=ceph-dashboard integration=webhook[0] msg="Notify attempt failed, will retry later" attempts=1 err="Post \"https://smithi181.front.sepia.ceph.com:8443/api/prometheus_receiver\": dial tcp 172.21.15.181:8443: connect: connection refused" 2024-03-30T13:59:14.245 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:13 smithi181 ceph-mon[25762]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-1967-g4e50bbcd 2024-03-30T13:59:14.245 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:13 smithi181 ceph-mon[25762]: pgmap v301: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:14.245 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:13 smithi181 ceph-mon[25762]: pgmap v302: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:14.245 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:13 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:14.245 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:13 smithi181 ceph-mon[25762]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-1967-g4e50bbcd 2024-03-30T13:59:14.245 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:13 smithi181 ceph-mon[25762]: pgmap v303: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:14.246 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:13 smithi181 ceph-mon[25762]: pgmap v304: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:14.246 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:13 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:14.246 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:13 smithi181 ceph-mon[25762]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-1967-g4e50bbcd 2024-03-30T13:59:14.246 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:13 smithi181 ceph-mon[25762]: pgmap v305: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:14.246 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:13 smithi181 ceph-mon[25762]: pgmap v306: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:14.246 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:13 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:14.247 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:13 smithi181 ceph-mon[25762]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-1967-g4e50bbcd 2024-03-30T13:59:14.247 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:13 smithi181 ceph-mon[25762]: pgmap v307: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:14.247 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:13 smithi181 ceph-mon[25762]: pgmap v308: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:14.247 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:13 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:14.247 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:13 smithi181 ceph-mon[25762]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-1967-g4e50bbcd 2024-03-30T13:59:14.247 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:13 smithi181 ceph-mon[25762]: pgmap v309: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:14.247 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:13 smithi181 ceph-mon[25762]: pgmap v310: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:14.247 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:13 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:14.248 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:13 smithi181 ceph-mon[25762]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-1967-g4e50bbcd 2024-03-30T13:59:14.248 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:13 smithi181 ceph-mon[25762]: pgmap v311: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:14.248 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:13 smithi181 ceph-mon[25762]: pgmap v312: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:14.248 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:13 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:14.248 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:13 smithi181 ceph-mon[25762]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-1967-g4e50bbcd 2024-03-30T13:59:14.249 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:13 smithi181 ceph-mon[25762]: pgmap v313: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:14.249 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:13 smithi181 ceph-mon[25762]: pgmap v314: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:14.249 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:13 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:14.249 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:13 smithi181 ceph-mon[25762]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-1967-g4e50bbcd 2024-03-30T13:59:14.249 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:13 smithi181 ceph-mon[25762]: pgmap v315: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:14.249 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:13 smithi181 ceph-mon[25762]: pgmap v316: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:14.249 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:13 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:14.249 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:13 smithi181 ceph-mon[25762]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-1967-g4e50bbcd 2024-03-30T13:59:14.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:13 smithi181 ceph-mon[25762]: pgmap v317: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:14.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:13 smithi181 ceph-mon[25762]: pgmap v318: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:14.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:13 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:14.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:13 smithi181 ceph-mon[25762]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-1967-g4e50bbcd 2024-03-30T13:59:14.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:13 smithi181 ceph-mon[25762]: pgmap v319: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:14.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:13 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:14.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:13 smithi181 ceph-mon[25762]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-1967-g4e50bbcd 2024-03-30T13:59:14.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:13 smithi181 ceph-mon[25762]: pgmap v320: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:14.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:13 smithi181 ceph-mon[25762]: pgmap v321: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:14.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:13 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:14.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:13 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:14.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:13 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:14.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:13 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:14.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:13 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:14.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:13 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:14.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:13 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:14.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:13 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:14.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:13 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:14.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:13 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:14.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:13 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:14.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:13 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:14.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:13 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:14.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:13 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:14.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:13 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:14.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:13 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:14.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:13 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:14.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:13 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:14.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:13 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:14.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:13 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:14.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:13 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:14.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:13 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:14.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:13 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:14.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:13 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:14.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:13 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:14.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:13 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:14.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:13 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:14.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:13 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:14.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:13 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:14.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:13 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:14.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:13 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:14.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:13 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:14.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:13 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:14.253 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:13 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:14.253 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:13 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:14.253 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:13 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:14.253 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:13 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:14.253 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:13 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:14.253 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:13 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:14.253 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:13 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:14.253 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:13 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:14.253 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:13 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:14.253 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:13 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:14.253 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:13 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:14.253 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:13 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:14.253 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:13 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:14.331 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:13 smithi099 ceph-mon[24912]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-1967-g4e50bbcd 2024-03-30T13:59:14.331 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:13 smithi099 ceph-mon[24912]: pgmap v301: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:14.331 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:13 smithi099 ceph-mon[24912]: pgmap v302: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:14.331 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:13 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:14.331 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:13 smithi099 ceph-mon[24912]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-1967-g4e50bbcd 2024-03-30T13:59:14.332 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:13 smithi099 ceph-mon[24912]: pgmap v303: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:14.333 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:13 smithi099 ceph-mon[24912]: pgmap v304: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:14.333 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:13 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:14.333 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:13 smithi099 ceph-mon[24912]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-1967-g4e50bbcd 2024-03-30T13:59:14.333 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:13 smithi099 ceph-mon[24912]: pgmap v305: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:14.334 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:13 smithi099 ceph-mon[24912]: pgmap v306: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:14.334 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:13 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:14.334 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:13 smithi099 ceph-mon[24912]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-1967-g4e50bbcd 2024-03-30T13:59:14.334 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:13 smithi099 ceph-mon[24912]: pgmap v307: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:14.334 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:13 smithi099 ceph-mon[24912]: pgmap v308: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:14.334 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:13 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:14.334 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:13 smithi099 ceph-mon[24912]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-1967-g4e50bbcd 2024-03-30T13:59:14.334 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:13 smithi099 ceph-mon[24912]: pgmap v309: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:14.334 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:13 smithi099 ceph-mon[24912]: pgmap v310: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:14.334 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:13 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:14.334 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:13 smithi099 ceph-mon[24912]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-1967-g4e50bbcd 2024-03-30T13:59:14.334 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:13 smithi099 ceph-mon[24912]: pgmap v311: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:14.334 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:13 smithi099 ceph-mon[24912]: pgmap v312: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:14.334 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:13 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:14.334 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:13 smithi099 ceph-mon[24912]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-1967-g4e50bbcd 2024-03-30T13:59:14.335 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:13 smithi099 ceph-mon[24912]: pgmap v313: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:14.335 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:13 smithi099 ceph-mon[24912]: pgmap v314: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:14.335 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:13 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:14.335 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:13 smithi099 ceph-mon[24912]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-1967-g4e50bbcd 2024-03-30T13:59:14.335 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:13 smithi099 ceph-mon[24912]: pgmap v315: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:14.335 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:13 smithi099 ceph-mon[24912]: pgmap v316: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:14.335 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:13 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:14.335 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:13 smithi099 ceph-mon[24912]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-1967-g4e50bbcd 2024-03-30T13:59:14.335 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:13 smithi099 ceph-mon[29691]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-1967-g4e50bbcd 2024-03-30T13:59:14.336 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:13 smithi099 ceph-mon[29691]: pgmap v301: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:14.336 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:13 smithi099 ceph-mon[29691]: pgmap v302: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:14.336 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:13 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:14.336 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:13 smithi099 ceph-mon[29691]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-1967-g4e50bbcd 2024-03-30T13:59:14.336 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:13 smithi099 ceph-mon[29691]: pgmap v303: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:14.336 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:13 smithi099 ceph-mon[29691]: pgmap v304: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:14.336 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:13 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:14.336 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:13 smithi099 ceph-mon[29691]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-1967-g4e50bbcd 2024-03-30T13:59:14.336 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:13 smithi099 ceph-mon[29691]: pgmap v305: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:14.336 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:13 smithi099 ceph-mon[29691]: pgmap v306: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:14.336 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:13 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:14.336 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:13 smithi099 ceph-mon[29691]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-1967-g4e50bbcd 2024-03-30T13:59:14.336 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:13 smithi099 ceph-mon[29691]: pgmap v307: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:14.336 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:13 smithi099 ceph-mon[29691]: pgmap v308: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:14.336 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:13 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:14.337 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:13 smithi099 ceph-mon[29691]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-1967-g4e50bbcd 2024-03-30T13:59:14.337 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:13 smithi099 ceph-mon[29691]: pgmap v309: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:14.337 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:13 smithi099 ceph-mon[29691]: pgmap v310: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:14.337 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:13 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:14.337 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:13 smithi099 ceph-mon[29691]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-1967-g4e50bbcd 2024-03-30T13:59:14.337 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:13 smithi099 ceph-mon[29691]: pgmap v311: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:14.337 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:13 smithi099 ceph-mon[29691]: pgmap v312: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:14.337 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:13 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:14.337 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:13 smithi099 ceph-mon[29691]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-1967-g4e50bbcd 2024-03-30T13:59:14.337 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:13 smithi099 ceph-mon[29691]: pgmap v313: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:14.337 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:13 smithi099 ceph-mon[29691]: pgmap v314: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:14.337 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:13 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:14.337 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:13 smithi099 ceph-mon[29691]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-1967-g4e50bbcd 2024-03-30T13:59:14.337 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:13 smithi099 ceph-mon[29691]: pgmap v315: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:14.338 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:13 smithi099 ceph-mon[29691]: pgmap v316: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:14.338 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:13 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:14.338 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:13 smithi099 ceph-mon[29691]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-1967-g4e50bbcd 2024-03-30T13:59:14.338 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:13 smithi099 ceph-mon[24912]: pgmap v317: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:14.338 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:13 smithi099 ceph-mon[24912]: pgmap v318: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:14.338 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:13 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:14.338 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:13 smithi099 ceph-mon[24912]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-1967-g4e50bbcd 2024-03-30T13:59:14.338 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:13 smithi099 ceph-mon[24912]: pgmap v319: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:14.339 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:13 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:14.339 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:13 smithi099 ceph-mon[24912]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-1967-g4e50bbcd 2024-03-30T13:59:14.339 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:13 smithi099 ceph-mon[24912]: pgmap v320: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:14.339 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:13 smithi099 ceph-mon[24912]: pgmap v321: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:14.339 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:13 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:14.339 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:13 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:14.339 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:13 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:14.339 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:13 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:14.339 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:13 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:14.339 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:13 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:14.339 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:13 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:14.339 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:13 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:14.339 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:13 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:14.339 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:13 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:14.340 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:13 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:14.340 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:13 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:14.340 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:13 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:14.340 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:13 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:14.340 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:13 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:14.340 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:13 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:14.340 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:13 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:14.340 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:13 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:14.340 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:13 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:14.340 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:13 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:14.340 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:13 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:14.340 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:13 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:14.340 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:13 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:14.340 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:13 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:14.341 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:13 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:14.341 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:13 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:14.341 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:13 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:14.341 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:13 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:14.341 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:13 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:14.341 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:13 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:14.341 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:13 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:14.341 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:13 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:14.341 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:13 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:14.341 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:13 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:14.341 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:13 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:14.341 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:13 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:14.341 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:13 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:14.341 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:13 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:14.341 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:13 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:14.342 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:13 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:14.342 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:13 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:14.342 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:13 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:14.342 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:13 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:14.342 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:13 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:14.342 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:13 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:14.342 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:13 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:14.342 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:13 smithi099 ceph-mon[29691]: pgmap v317: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:14.342 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:13 smithi099 ceph-mon[29691]: pgmap v318: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:14.343 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:13 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:14.343 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:13 smithi099 ceph-mon[29691]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-1967-g4e50bbcd 2024-03-30T13:59:14.343 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:13 smithi099 ceph-mon[29691]: pgmap v319: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:14.343 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:13 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:14.343 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:13 smithi099 ceph-mon[29691]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-1967-g4e50bbcd 2024-03-30T13:59:14.343 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:13 smithi099 ceph-mon[29691]: pgmap v320: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:14.343 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:13 smithi099 ceph-mon[29691]: pgmap v321: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:14.343 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:13 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:14.343 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:13 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:14.343 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:13 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:14.343 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:13 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:14.343 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:13 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:14.343 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:13 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:14.343 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:13 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:14.344 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:13 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:14.344 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:13 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:14.344 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:13 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:14.344 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:13 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:14.344 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:13 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:14.344 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:13 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:14.344 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:13 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:14.344 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:13 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:14.344 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:13 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:14.344 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:13 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:14.344 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:13 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:14.344 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:13 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:14.344 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:13 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:14.344 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:13 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:14.344 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:13 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:14.345 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:13 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:14.345 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:13 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:14.345 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:13 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:14.345 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:13 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:14.345 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:13 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:14.345 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:13 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:14.345 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:13 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:14.345 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:13 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:14.345 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:13 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:14.345 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:13 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:14.345 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:13 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:14.345 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:13 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:14.345 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:13 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:14.345 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:13 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:14.345 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:13 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:14.346 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:13 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:14.346 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:13 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:14.346 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:13 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:14.346 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:13 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:14.346 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:13 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:14.346 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:13 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:14.346 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:13 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:14.346 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:13 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:14.346 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:13 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:14.500 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 13:59:14 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-x[80020]: 2024-03-30T13:59:14.352+0000 7fb2e25bc200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-03-30T13:59:14.500 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 13:59:14 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-x[80020]: 2024-03-30T13:59:14.492+0000 7fb2e25bc200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-03-30T13:59:15.081 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:59:14 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[71049]: ::ffff:172.21.15.181 - - [30/Mar/2024:13:59:14] "GET /metrics HTTP/1.1" 200 37988 "" "Prometheus/2.33.4" 2024-03-30T13:59:15.081 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:14 smithi099 ceph-mon[29691]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-1967-g4e50bbcd 2024-03-30T13:59:15.081 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:14 smithi099 ceph-mon[29691]: pgmap v322: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:15.081 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:14 smithi099 ceph-mon[29691]: pgmap v323: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:15.081 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:14 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:15.081 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:14 smithi099 ceph-mon[29691]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-1967-g4e50bbcd 2024-03-30T13:59:15.082 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:14 smithi099 ceph-mon[29691]: pgmap v324: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:15.082 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:14 smithi099 ceph-mon[29691]: pgmap v325: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:15.082 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:14 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:15.082 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:14 smithi099 ceph-mon[29691]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-1967-g4e50bbcd 2024-03-30T13:59:15.082 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:14 smithi099 ceph-mon[29691]: pgmap v326: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:15.082 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:14 smithi099 ceph-mon[29691]: pgmap v327: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:15.082 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:14 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:15.082 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:14 smithi099 ceph-mon[29691]: from='client.25136 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T13:59:15.082 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:14 smithi099 ceph-mon[29691]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-1967-g4e50bbcd 2024-03-30T13:59:15.082 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:14 smithi099 ceph-mon[29691]: pgmap v328: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:15.082 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:14 smithi099 ceph-mon[29691]: pgmap v329: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:15.082 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:14 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:15.082 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:14 smithi099 ceph-mon[29691]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-1967-g4e50bbcd 2024-03-30T13:59:15.082 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:14 smithi099 ceph-mon[29691]: pgmap v330: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:15.083 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:14 smithi099 ceph-mon[29691]: pgmap v331: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:15.083 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:14 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:15.083 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:14 smithi099 ceph-mon[29691]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-1967-g4e50bbcd 2024-03-30T13:59:15.083 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:14 smithi099 ceph-mon[29691]: pgmap v332: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:15.083 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:14 smithi099 ceph-mon[29691]: pgmap v333: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:15.083 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:14 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:15.083 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:14 smithi099 ceph-mon[29691]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-1967-g4e50bbcd 2024-03-30T13:59:15.083 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:14 smithi099 ceph-mon[29691]: pgmap v334: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:15.083 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:14 smithi099 ceph-mon[29691]: pgmap v335: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:15.083 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:14 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:15.083 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:14 smithi099 ceph-mon[29691]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-1967-g4e50bbcd 2024-03-30T13:59:15.083 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:14 smithi099 ceph-mon[29691]: pgmap v336: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:15.083 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:14 smithi099 ceph-mon[29691]: pgmap v337: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:15.084 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:14 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:15.084 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:14 smithi099 ceph-mon[24912]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-1967-g4e50bbcd 2024-03-30T13:59:15.084 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:14 smithi099 ceph-mon[24912]: pgmap v322: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:15.085 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:14 smithi099 ceph-mon[24912]: pgmap v323: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:15.085 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:14 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:15.085 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:14 smithi099 ceph-mon[24912]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-1967-g4e50bbcd 2024-03-30T13:59:15.085 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:14 smithi099 ceph-mon[24912]: pgmap v324: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:15.085 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:14 smithi099 ceph-mon[24912]: pgmap v325: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:15.085 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:14 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:15.085 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:14 smithi099 ceph-mon[24912]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-1967-g4e50bbcd 2024-03-30T13:59:15.085 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:14 smithi099 ceph-mon[24912]: pgmap v326: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:15.085 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:14 smithi099 ceph-mon[24912]: pgmap v327: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:15.085 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:14 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:15.085 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:14 smithi099 ceph-mon[24912]: from='client.25136 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T13:59:15.085 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:14 smithi099 ceph-mon[24912]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-1967-g4e50bbcd 2024-03-30T13:59:15.085 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:14 smithi099 ceph-mon[24912]: pgmap v328: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:15.086 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:14 smithi099 ceph-mon[24912]: pgmap v329: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:15.086 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:14 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:15.086 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:14 smithi099 ceph-mon[24912]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-1967-g4e50bbcd 2024-03-30T13:59:15.086 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:14 smithi099 ceph-mon[24912]: pgmap v330: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:15.086 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:14 smithi099 ceph-mon[24912]: pgmap v331: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:15.086 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:14 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:15.086 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:14 smithi099 ceph-mon[24912]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-1967-g4e50bbcd 2024-03-30T13:59:15.086 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:14 smithi099 ceph-mon[24912]: pgmap v332: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:15.086 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:14 smithi099 ceph-mon[24912]: pgmap v333: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:15.086 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:14 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:15.086 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:14 smithi099 ceph-mon[24912]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-1967-g4e50bbcd 2024-03-30T13:59:15.086 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:14 smithi099 ceph-mon[24912]: pgmap v334: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:15.086 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:14 smithi099 ceph-mon[24912]: pgmap v335: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:15.086 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:14 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:15.086 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:14 smithi099 ceph-mon[24912]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-1967-g4e50bbcd 2024-03-30T13:59:15.087 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:14 smithi099 ceph-mon[24912]: pgmap v336: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:15.087 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:14 smithi099 ceph-mon[24912]: pgmap v337: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:15.087 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:14 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:15.087 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:14 smithi099 ceph-mon[29691]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-1967-g4e50bbcd 2024-03-30T13:59:15.087 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:14 smithi099 ceph-mon[29691]: pgmap v338: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:15.087 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:14 smithi099 ceph-mon[29691]: pgmap v339: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:15.087 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:14 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:15.087 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:14 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:15.087 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:14 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:15.087 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:14 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:15.088 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:14 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:15.088 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:14 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:15.088 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:14 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:15.088 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:14 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:15.088 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:14 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:15.088 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:14 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:15.088 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:14 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:15.088 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:14 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:15.088 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:14 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:15.088 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:14 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:15.088 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:14 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:15.088 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:14 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:15.088 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:14 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:15.088 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:14 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:15.088 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:14 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:15.089 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:14 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:15.089 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:14 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:15.089 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:14 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:15.089 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:14 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:15.089 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:14 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:15.089 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:14 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:15.089 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:14 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:15.089 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:14 smithi099 ceph-mon[24912]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-1967-g4e50bbcd 2024-03-30T13:59:15.089 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:14 smithi099 ceph-mon[24912]: pgmap v338: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:15.089 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:14 smithi099 ceph-mon[24912]: pgmap v339: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:15.089 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:14 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:15.090 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:14 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:15.090 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:14 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:15.090 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:14 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:15.090 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:14 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:15.090 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:14 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:15.090 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:14 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:15.090 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:14 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:15.090 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:14 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:15.090 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:14 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:15.090 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:14 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:15.090 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:14 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:15.090 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:14 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:15.090 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:14 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:15.090 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:14 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:15.091 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:14 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:15.091 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:14 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:15.091 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:14 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:15.091 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:14 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:15.091 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:14 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:15.091 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:14 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:15.091 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:14 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:15.091 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:14 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:15.091 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:14 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:15.091 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:14 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:15.091 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:14 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:15.092 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:14 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:15.092 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:14 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:15.092 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:14 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:15.092 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:14 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:15.092 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:14 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:15.092 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:14 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:15.092 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:14 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:15.092 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:14 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:15.092 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:14 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:15.092 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:14 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:15.092 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:14 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:15.092 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:14 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:15.092 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:14 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:15.092 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:14 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:15.092 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:14 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:15.093 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:14 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:15.093 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:14 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:15.093 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:14 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:15.093 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:14 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:15.093 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:14 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:15.093 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:14 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:15.093 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:14 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:15.093 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:14 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:15.093 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:14 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:15.093 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:14 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:15.093 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:14 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:15.093 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:14 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:15.093 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:14 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:15.093 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:14 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:15.093 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:14 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:15.094 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:14 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:15.094 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:14 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:15.094 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:14 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:15.094 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:14 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:15.094 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:14 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:15.094 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:14 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:15.094 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:14 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:15.094 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:14 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:15.094 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:14 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:15.094 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:14 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:15.094 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:14 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:15.095 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:14 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:15.095 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:14 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:15.095 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:14 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:15.095 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:14 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:15.095 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:14 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:15.095 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:14 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:15.095 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:14 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:15.095 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:14 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:15.095 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:14 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:15.095 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:14 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:15.095 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:14 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:15.095 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:14 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:15.095 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:14 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:15.095 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:14 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:15.095 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:14 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:15.096 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:14 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:15.096 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:14 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:15.096 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:14 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:15.096 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:14 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:15.162 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 13:59:14 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-x[80020]: 2024-03-30T13:59:14.854+0000 7fb2e25bc200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-03-30T13:59:15.163 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 13:59:14 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-x[80020]: 2024-03-30T13:59:14.955+0000 7fb2e25bc200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-03-30T13:59:15.163 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 13:59:15 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-x[80020]: 2024-03-30T13:59:15.167+0000 7fb2e25bc200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-03-30T13:59:15.163 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:14 smithi181 ceph-mon[25762]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-1967-g4e50bbcd 2024-03-30T13:59:15.163 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:14 smithi181 ceph-mon[25762]: pgmap v322: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:15.163 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:14 smithi181 ceph-mon[25762]: pgmap v323: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:15.163 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:14 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:15.163 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:14 smithi181 ceph-mon[25762]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-1967-g4e50bbcd 2024-03-30T13:59:15.163 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:14 smithi181 ceph-mon[25762]: pgmap v324: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:15.164 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:14 smithi181 ceph-mon[25762]: pgmap v325: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:15.164 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:14 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:15.164 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:14 smithi181 ceph-mon[25762]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-1967-g4e50bbcd 2024-03-30T13:59:15.164 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:14 smithi181 ceph-mon[25762]: pgmap v326: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:15.164 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:14 smithi181 ceph-mon[25762]: pgmap v327: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:15.164 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:14 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:15.164 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:14 smithi181 ceph-mon[25762]: from='client.25136 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T13:59:15.164 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:14 smithi181 ceph-mon[25762]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-1967-g4e50bbcd 2024-03-30T13:59:15.164 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:14 smithi181 ceph-mon[25762]: pgmap v328: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:15.164 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:14 smithi181 ceph-mon[25762]: pgmap v329: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:15.164 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:14 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:15.164 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:14 smithi181 ceph-mon[25762]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-1967-g4e50bbcd 2024-03-30T13:59:15.164 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:14 smithi181 ceph-mon[25762]: pgmap v330: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:15.164 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:14 smithi181 ceph-mon[25762]: pgmap v331: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:15.164 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:14 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:15.165 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:14 smithi181 ceph-mon[25762]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-1967-g4e50bbcd 2024-03-30T13:59:15.165 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:14 smithi181 ceph-mon[25762]: pgmap v332: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:15.165 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:14 smithi181 ceph-mon[25762]: pgmap v333: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:15.165 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:14 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:15.165 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:14 smithi181 ceph-mon[25762]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-1967-g4e50bbcd 2024-03-30T13:59:15.165 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:14 smithi181 ceph-mon[25762]: pgmap v334: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:15.165 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:14 smithi181 ceph-mon[25762]: pgmap v335: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:15.165 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:14 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:15.165 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:14 smithi181 ceph-mon[25762]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-1967-g4e50bbcd 2024-03-30T13:59:15.165 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:14 smithi181 ceph-mon[25762]: pgmap v336: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:15.165 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:14 smithi181 ceph-mon[25762]: pgmap v337: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:15.165 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:14 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:15.166 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:14 smithi181 ceph-mon[25762]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-1967-g4e50bbcd 2024-03-30T13:59:15.166 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:14 smithi181 ceph-mon[25762]: pgmap v338: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:15.166 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:14 smithi181 ceph-mon[25762]: pgmap v339: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:15.166 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:14 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:15.166 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:14 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:15.166 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:14 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:15.166 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:14 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:15.166 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:14 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:15.166 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:14 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:15.167 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:14 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:15.167 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:14 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:15.167 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:14 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:15.167 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:14 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:15.167 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:14 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:15.167 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:14 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:15.167 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:14 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:15.167 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:14 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:15.167 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:14 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:15.167 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:14 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:15.167 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:14 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:15.167 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:14 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:15.167 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:14 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:15.167 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:14 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:15.167 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:14 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:15.168 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:14 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:15.168 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:14 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:15.168 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:14 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:15.168 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:14 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:15.168 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:14 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:15.168 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:14 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:15.168 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:14 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:15.168 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:14 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:15.168 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:14 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:15.168 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:14 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:15.168 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:14 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:15.168 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:14 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:15.168 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:14 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:15.168 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:14 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:15.168 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:14 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:15.169 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:14 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:15.169 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:14 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:15.169 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:14 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:15.169 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:14 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:15.169 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:14 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:15.169 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:14 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:15.169 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:14 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:15.169 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:14 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:15.169 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:14 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:15.169 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:14 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:15.169 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:14 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:15.169 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:14 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:15.169 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:14 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:15.169 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:14 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:15.169 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:14 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:15.170 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:14 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:15.170 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:14 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:15.170 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:14 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:15.170 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:14 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:15.170 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:14 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:15.500 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 13:59:15 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-x[80020]: 2024-03-30T13:59:15.367+0000 7fb2e25bc200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-03-30T13:59:15.960 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 13:59:15 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-x[80020]: 2024-03-30T13:59:15.683+0000 7fb2e25bc200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-03-30T13:59:15.960 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 13:59:15 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-x[80020]: 2024-03-30T13:59:15.964+0000 7fb2e25bc200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-03-30T13:59:15.961 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:15 smithi181 ceph-mon[25762]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-1967-g4e50bbcd 2024-03-30T13:59:15.961 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:15 smithi181 ceph-mon[25762]: pgmap v340: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:15.961 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:15 smithi181 ceph-mon[25762]: pgmap v341: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:15.961 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:15 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:15.961 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:15 smithi181 ceph-mon[25762]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-1967-g4e50bbcd 2024-03-30T13:59:15.961 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:15 smithi181 ceph-mon[25762]: pgmap v342: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:15.961 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:15 smithi181 ceph-mon[25762]: pgmap v343: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:15.962 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:15 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:15.962 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:15 smithi181 ceph-mon[25762]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-1967-g4e50bbcd 2024-03-30T13:59:15.962 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:15 smithi181 ceph-mon[25762]: pgmap v344: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:15.962 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:15 smithi181 ceph-mon[25762]: pgmap v345: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:15.962 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:15 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:15.962 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:15 smithi181 ceph-mon[25762]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-1967-g4e50bbcd 2024-03-30T13:59:15.962 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:15 smithi181 ceph-mon[25762]: pgmap v346: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:15.962 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:15 smithi181 ceph-mon[25762]: pgmap v347: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:15.962 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:15 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:15.962 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:15 smithi181 ceph-mon[25762]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-1967-g4e50bbcd 2024-03-30T13:59:15.962 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:15 smithi181 ceph-mon[25762]: pgmap v348: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:15.962 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:15 smithi181 ceph-mon[25762]: pgmap v349: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:15.962 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:15 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:15.962 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:15 smithi181 ceph-mon[25762]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-1967-g4e50bbcd 2024-03-30T13:59:15.963 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:15 smithi181 ceph-mon[25762]: pgmap v350: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:15.963 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:15 smithi181 ceph-mon[25762]: pgmap v351: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:15.963 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:15 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:15.963 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:15 smithi181 ceph-mon[25762]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-1967-g4e50bbcd 2024-03-30T13:59:15.963 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:15 smithi181 ceph-mon[25762]: pgmap v352: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:15.963 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:15 smithi181 ceph-mon[25762]: pgmap v353: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:15.963 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:15 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:15.963 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:15 smithi181 ceph-mon[25762]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-1967-g4e50bbcd 2024-03-30T13:59:15.963 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:15 smithi181 ceph-mon[25762]: pgmap v354: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:15.963 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:15 smithi181 ceph-mon[25762]: pgmap v355: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:15.963 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:15 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:15.963 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:15 smithi181 ceph-mon[25762]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-1967-g4e50bbcd 2024-03-30T13:59:15.963 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:15 smithi181 ceph-mon[25762]: pgmap v356: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:15.963 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:15 smithi181 ceph-mon[25762]: pgmap v357: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:15.963 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:15 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:15.964 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:15 smithi181 ceph-mon[25762]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-1967-g4e50bbcd 2024-03-30T13:59:15.964 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:15 smithi181 ceph-mon[25762]: pgmap v358: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:15.964 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:15 smithi181 ceph-mon[25762]: pgmap v359: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:15.964 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:15 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:15.964 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:15 smithi181 ceph-mon[25762]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-1967-g4e50bbcd 2024-03-30T13:59:15.964 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:15 smithi181 ceph-mon[25762]: pgmap v360: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:15.964 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:15 smithi181 ceph-mon[25762]: pgmap v361: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:15.964 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:15 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:15.964 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:15 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:15.964 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:15 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:15.964 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:15 smithi181 ceph-mon[25762]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-1967-g4e50bbcd 2024-03-30T13:59:15.964 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:15 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:15.964 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:15 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:15.964 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:15 smithi181 ceph-mon[25762]: pgmap v362: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:15.965 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:15 smithi181 ceph-mon[25762]: pgmap v363: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:15.965 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:15 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:15.965 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:15 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:15.965 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:15 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:15.965 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:15 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:15.965 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:15 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:15.965 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:15 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:15.965 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:15 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:15.965 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:15 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:15.965 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:15 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:15.965 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:15 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:15.965 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:15 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:15.965 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:15 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:15.965 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:15 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:15.965 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:15 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:15.965 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:15 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:15.966 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:15 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:15.966 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:15 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:15.966 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:15 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:15.966 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:15 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:15.966 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:15 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:15.966 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:15 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:15.966 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:15 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:15.966 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:15 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:15.966 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:15 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:15.966 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:15 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:15.966 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:15 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:15.966 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:15 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:15.966 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:15 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:15.966 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:15 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:15.967 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:15 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:15.967 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:15 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:15.967 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:15 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:15.967 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:15 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:15.967 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:15 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:15.967 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:15 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:15.967 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:15 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:15.967 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:15 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:15.967 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:15 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:15.967 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:15 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:15.967 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:15 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:15.967 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:15 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:15.967 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:15 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:15.967 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:15 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:15.968 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:15 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:15.968 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:15 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:15.968 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:15 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:15.968 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:15 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:15.968 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:15 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T13:59:15.968 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:15 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:15.968 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:15 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:15.968 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:15 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:15.968 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:15 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:15.968 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:15 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:16.331 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:15 smithi099 ceph-mon[24912]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-1967-g4e50bbcd 2024-03-30T13:59:16.331 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:15 smithi099 ceph-mon[24912]: pgmap v340: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:16.331 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:15 smithi099 ceph-mon[24912]: pgmap v341: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:16.331 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:15 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:16.332 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:15 smithi099 ceph-mon[24912]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-1967-g4e50bbcd 2024-03-30T13:59:16.332 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:15 smithi099 ceph-mon[24912]: pgmap v342: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:16.332 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:15 smithi099 ceph-mon[24912]: pgmap v343: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:16.332 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:15 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:16.332 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:15 smithi099 ceph-mon[24912]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-1967-g4e50bbcd 2024-03-30T13:59:16.332 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:15 smithi099 ceph-mon[24912]: pgmap v344: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:16.332 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:15 smithi099 ceph-mon[24912]: pgmap v345: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:16.332 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:15 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:16.332 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:15 smithi099 ceph-mon[24912]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-1967-g4e50bbcd 2024-03-30T13:59:16.332 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:15 smithi099 ceph-mon[24912]: pgmap v346: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:16.332 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:15 smithi099 ceph-mon[24912]: pgmap v347: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:16.332 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:15 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:16.333 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:15 smithi099 ceph-mon[24912]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-1967-g4e50bbcd 2024-03-30T13:59:16.333 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:15 smithi099 ceph-mon[24912]: pgmap v348: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:16.333 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:15 smithi099 ceph-mon[24912]: pgmap v349: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:16.333 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:15 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:16.333 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:15 smithi099 ceph-mon[24912]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-1967-g4e50bbcd 2024-03-30T13:59:16.333 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:15 smithi099 ceph-mon[24912]: pgmap v350: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:16.333 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:15 smithi099 ceph-mon[24912]: pgmap v351: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:16.333 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:15 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:16.333 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:15 smithi099 ceph-mon[24912]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-1967-g4e50bbcd 2024-03-30T13:59:16.333 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:15 smithi099 ceph-mon[24912]: pgmap v352: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:16.333 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:15 smithi099 ceph-mon[24912]: pgmap v353: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:16.333 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:15 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:16.333 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:15 smithi099 ceph-mon[24912]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-1967-g4e50bbcd 2024-03-30T13:59:16.333 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:15 smithi099 ceph-mon[24912]: pgmap v354: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:16.334 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:15 smithi099 ceph-mon[24912]: pgmap v355: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:16.334 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:15 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:16.334 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:15 smithi099 ceph-mon[24912]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-1967-g4e50bbcd 2024-03-30T13:59:16.334 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:15 smithi099 ceph-mon[29691]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-1967-g4e50bbcd 2024-03-30T13:59:16.334 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:15 smithi099 ceph-mon[29691]: pgmap v340: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:16.334 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:15 smithi099 ceph-mon[29691]: pgmap v341: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:16.334 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:15 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:16.334 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:15 smithi099 ceph-mon[29691]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-1967-g4e50bbcd 2024-03-30T13:59:16.334 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:15 smithi099 ceph-mon[29691]: pgmap v342: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:16.334 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:15 smithi099 ceph-mon[29691]: pgmap v343: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:16.335 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:15 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:16.335 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:15 smithi099 ceph-mon[29691]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-1967-g4e50bbcd 2024-03-30T13:59:16.335 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:15 smithi099 ceph-mon[29691]: pgmap v344: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:16.335 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:15 smithi099 ceph-mon[29691]: pgmap v345: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:16.335 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:15 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:16.335 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:15 smithi099 ceph-mon[29691]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-1967-g4e50bbcd 2024-03-30T13:59:16.335 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:15 smithi099 ceph-mon[29691]: pgmap v346: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:16.335 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:15 smithi099 ceph-mon[29691]: pgmap v347: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:16.335 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:15 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:16.335 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:15 smithi099 ceph-mon[29691]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-1967-g4e50bbcd 2024-03-30T13:59:16.335 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:15 smithi099 ceph-mon[29691]: pgmap v348: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:16.335 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:15 smithi099 ceph-mon[29691]: pgmap v349: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:16.335 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:15 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:16.335 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:15 smithi099 ceph-mon[29691]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-1967-g4e50bbcd 2024-03-30T13:59:16.336 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:15 smithi099 ceph-mon[29691]: pgmap v350: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:16.336 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:15 smithi099 ceph-mon[29691]: pgmap v351: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:16.336 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:15 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:16.336 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:15 smithi099 ceph-mon[29691]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-1967-g4e50bbcd 2024-03-30T13:59:16.336 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:15 smithi099 ceph-mon[29691]: pgmap v352: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:16.336 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:15 smithi099 ceph-mon[29691]: pgmap v353: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:16.336 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:15 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:16.336 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:15 smithi099 ceph-mon[29691]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-1967-g4e50bbcd 2024-03-30T13:59:16.336 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:15 smithi099 ceph-mon[29691]: pgmap v354: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:16.336 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:15 smithi099 ceph-mon[29691]: pgmap v355: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:16.336 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:15 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:16.336 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:15 smithi099 ceph-mon[29691]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-1967-g4e50bbcd 2024-03-30T13:59:16.337 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:15 smithi099 ceph-mon[24912]: pgmap v356: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:16.337 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:15 smithi099 ceph-mon[24912]: pgmap v357: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:16.337 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:15 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:16.337 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:15 smithi099 ceph-mon[24912]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-1967-g4e50bbcd 2024-03-30T13:59:16.337 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:15 smithi099 ceph-mon[24912]: pgmap v358: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:16.337 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:15 smithi099 ceph-mon[24912]: pgmap v359: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:16.337 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:15 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:16.337 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:15 smithi099 ceph-mon[24912]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-1967-g4e50bbcd 2024-03-30T13:59:16.338 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:15 smithi099 ceph-mon[24912]: pgmap v360: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:16.338 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:15 smithi099 ceph-mon[24912]: pgmap v361: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:16.338 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:15 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:16.338 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:15 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:16.338 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:15 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:16.338 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:15 smithi099 ceph-mon[24912]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-1967-g4e50bbcd 2024-03-30T13:59:16.338 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:15 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:16.338 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:15 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:16.338 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:15 smithi099 ceph-mon[24912]: pgmap v362: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:16.339 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:15 smithi099 ceph-mon[24912]: pgmap v363: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:16.339 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:15 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:16.339 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:15 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:16.339 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:15 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:16.339 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:15 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:16.339 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:15 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:16.339 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:15 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:16.339 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:15 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:16.339 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:15 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:16.339 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:15 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:16.339 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:15 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:16.339 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:15 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:16.339 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:15 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:16.339 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:15 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:16.339 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:15 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:16.340 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:15 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:16.340 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:15 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:16.340 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:15 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:16.340 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:15 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:16.340 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:15 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:16.340 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:15 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:16.340 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:15 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:16.340 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:15 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:16.340 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:15 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:16.340 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:15 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:16.340 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:15 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:16.340 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:15 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:16.341 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:15 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:16.341 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:15 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:16.341 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:15 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:16.341 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:15 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:16.341 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:15 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:16.341 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:15 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:16.341 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:15 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:16.341 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:15 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:16.341 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:15 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:16.341 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:15 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:16.341 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:15 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:16.341 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:15 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:16.341 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:15 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:16.341 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:15 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:16.342 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:15 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:16.342 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:15 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:16.342 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:15 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:16.342 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:15 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:16.342 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:15 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:16.342 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:15 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:16.342 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:15 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:16.342 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:15 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T13:59:16.342 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:15 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:16.342 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:15 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:16.342 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:15 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:16.342 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:15 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:16.342 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:15 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:16.343 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:15 smithi099 ceph-mon[29691]: pgmap v356: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:16.343 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:15 smithi099 ceph-mon[29691]: pgmap v357: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:16.343 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:15 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:16.343 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:15 smithi099 ceph-mon[29691]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-1967-g4e50bbcd 2024-03-30T13:59:16.343 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:15 smithi099 ceph-mon[29691]: pgmap v358: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:16.343 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:15 smithi099 ceph-mon[29691]: pgmap v359: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:16.343 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:15 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:16.343 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:15 smithi099 ceph-mon[29691]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-1967-g4e50bbcd 2024-03-30T13:59:16.344 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:15 smithi099 ceph-mon[29691]: pgmap v360: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:16.344 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:15 smithi099 ceph-mon[29691]: pgmap v361: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:16.344 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:15 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:16.344 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:15 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:16.344 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:15 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:16.344 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:15 smithi099 ceph-mon[29691]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-1967-g4e50bbcd 2024-03-30T13:59:16.344 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:15 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:16.344 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:15 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:16.344 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:15 smithi099 ceph-mon[29691]: pgmap v362: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:16.344 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:15 smithi099 ceph-mon[29691]: pgmap v363: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:16.344 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:15 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:16.344 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:15 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:16.344 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:15 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:16.344 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:15 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:16.344 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:15 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:16.345 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:15 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:16.345 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:15 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:16.345 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:15 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:16.345 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:15 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:16.345 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:15 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:16.345 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:15 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:16.345 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:15 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:16.345 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:15 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:16.345 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:15 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:16.345 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:15 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:16.345 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:15 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:16.345 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:15 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:16.345 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:15 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:16.345 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:15 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:16.345 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:15 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:16.346 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:15 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:16.346 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:15 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:16.346 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:15 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:16.346 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:15 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:16.346 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:15 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:16.346 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:15 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:16.346 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:15 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:16.346 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:15 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:16.346 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:15 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:16.346 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:15 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:16.346 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:15 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:16.346 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:15 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:16.346 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:15 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:16.346 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:15 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:16.347 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:15 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:16.347 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:15 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:16.347 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:15 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:16.347 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:15 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:16.347 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:15 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:16.348 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:15 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:16.348 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:15 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:16.348 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:15 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:16.348 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:15 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:16.348 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:15 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:16.348 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:15 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:16.348 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:15 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:16.349 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:15 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:16.349 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:15 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T13:59:16.349 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:15 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:16.349 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:15 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:16.349 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:15 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:16.349 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:15 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:16.349 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:15 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:16.494 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 13:59:16 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-x[80020]: 2024-03-30T13:59:16.232+0000 7fb2e25bc200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-03-30T13:59:17.138 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:16 smithi181 ceph-mon[25762]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-1967-g4e50bbcd 2024-03-30T13:59:17.138 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:16 smithi181 ceph-mon[25762]: pgmap v364: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:17.138 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:16 smithi181 ceph-mon[25762]: pgmap v365: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:17.138 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:16 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:17.138 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:16 smithi181 ceph-mon[25762]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-1967-g4e50bbcd 2024-03-30T13:59:17.138 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:16 smithi181 ceph-mon[25762]: pgmap v366: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:17.138 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:16 smithi181 ceph-mon[25762]: pgmap v367: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:17.138 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:16 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:17.138 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:16 smithi181 ceph-mon[25762]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-1967-g4e50bbcd 2024-03-30T13:59:17.138 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:16 smithi181 ceph-mon[25762]: pgmap v368: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:17.138 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:16 smithi181 ceph-mon[25762]: pgmap v369: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:17.139 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:16 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:17.139 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:16 smithi181 ceph-mon[25762]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-1967-g4e50bbcd 2024-03-30T13:59:17.139 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:16 smithi181 ceph-mon[25762]: pgmap v370: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:17.139 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:16 smithi181 ceph-mon[25762]: pgmap v371: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:17.139 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:16 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:17.139 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:16 smithi181 ceph-mon[25762]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-1967-g4e50bbcd 2024-03-30T13:59:17.139 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:16 smithi181 ceph-mon[25762]: pgmap v372: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:17.139 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:16 smithi181 ceph-mon[25762]: pgmap v373: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:17.139 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:16 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:17.139 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:16 smithi181 ceph-mon[25762]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-1967-g4e50bbcd 2024-03-30T13:59:17.139 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:16 smithi181 ceph-mon[25762]: pgmap v374: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:17.139 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:16 smithi181 ceph-mon[25762]: pgmap v375: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:17.139 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:16 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:17.139 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:16 smithi181 ceph-mon[25762]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-1967-g4e50bbcd 2024-03-30T13:59:17.139 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:16 smithi181 ceph-mon[25762]: pgmap v376: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:17.140 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:16 smithi181 ceph-mon[25762]: pgmap v377: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:17.140 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:16 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:17.140 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:16 smithi181 ceph-mon[25762]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-1967-g4e50bbcd 2024-03-30T13:59:17.140 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:16 smithi181 ceph-mon[25762]: pgmap v378: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:17.140 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:16 smithi181 ceph-mon[25762]: pgmap v379: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:17.140 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:16 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:17.140 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:16 smithi181 ceph-mon[25762]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-1967-g4e50bbcd 2024-03-30T13:59:17.140 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:16 smithi181 ceph-mon[25762]: pgmap v380: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:17.140 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:16 smithi181 ceph-mon[25762]: pgmap v381: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:17.140 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:16 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:17.140 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:16 smithi181 ceph-mon[25762]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-1967-g4e50bbcd 2024-03-30T13:59:17.140 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:16 smithi181 ceph-mon[25762]: pgmap v382: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:17.140 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:16 smithi181 ceph-mon[25762]: pgmap v383: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:17.140 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:16 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:17.140 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:16 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:17.141 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:16 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:17.141 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:16 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:17.141 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:16 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:17.141 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:16 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:17.141 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:16 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:17.141 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:16 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:17.141 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:16 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:17.141 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:16 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:17.141 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:16 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:17.141 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:16 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:17.141 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:16 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:17.141 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:16 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:17.141 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:16 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:17.141 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:16 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:17.141 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:16 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:17.142 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:16 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:17.142 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:16 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:17.142 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:16 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:17.142 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:16 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:17.142 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:16 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:17.142 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:16 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:17.142 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:16 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:17.142 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:16 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:17.142 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:16 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:17.142 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:16 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:17.142 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:16 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:17.142 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:16 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:17.142 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:16 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:17.142 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:16 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:17.142 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:16 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:17.143 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:16 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:17.143 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:16 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:17.143 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:16 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:17.143 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:16 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:17.143 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:16 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:17.143 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:16 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:17.143 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:16 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:17.143 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:16 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:17.143 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:16 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:17.143 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:16 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:17.143 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:16 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:17.143 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:16 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:17.143 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:16 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:17.143 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:16 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:17.331 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:16 smithi099 ceph-mon[24912]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-1967-g4e50bbcd 2024-03-30T13:59:17.331 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:16 smithi099 ceph-mon[24912]: pgmap v364: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:17.331 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:16 smithi099 ceph-mon[24912]: pgmap v365: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:17.331 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:16 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:17.332 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:16 smithi099 ceph-mon[24912]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-1967-g4e50bbcd 2024-03-30T13:59:17.332 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:16 smithi099 ceph-mon[24912]: pgmap v366: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:17.332 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:16 smithi099 ceph-mon[24912]: pgmap v367: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:17.332 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:16 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:17.332 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:16 smithi099 ceph-mon[24912]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-1967-g4e50bbcd 2024-03-30T13:59:17.332 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:16 smithi099 ceph-mon[24912]: pgmap v368: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:17.332 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:16 smithi099 ceph-mon[24912]: pgmap v369: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:17.332 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:16 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:17.332 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:16 smithi099 ceph-mon[24912]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-1967-g4e50bbcd 2024-03-30T13:59:17.332 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:16 smithi099 ceph-mon[24912]: pgmap v370: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:17.332 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:16 smithi099 ceph-mon[24912]: pgmap v371: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:17.332 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:16 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:17.332 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:16 smithi099 ceph-mon[24912]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-1967-g4e50bbcd 2024-03-30T13:59:17.332 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:16 smithi099 ceph-mon[24912]: pgmap v372: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:17.333 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:16 smithi099 ceph-mon[24912]: pgmap v373: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:17.333 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:16 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:17.333 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:16 smithi099 ceph-mon[24912]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-1967-g4e50bbcd 2024-03-30T13:59:17.333 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:16 smithi099 ceph-mon[24912]: pgmap v374: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:17.333 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:16 smithi099 ceph-mon[24912]: pgmap v375: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:17.333 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:16 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:17.333 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:16 smithi099 ceph-mon[24912]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-1967-g4e50bbcd 2024-03-30T13:59:17.333 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:16 smithi099 ceph-mon[24912]: pgmap v376: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:17.333 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:16 smithi099 ceph-mon[24912]: pgmap v377: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:17.333 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:16 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:17.333 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:16 smithi099 ceph-mon[24912]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-1967-g4e50bbcd 2024-03-30T13:59:17.333 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:16 smithi099 ceph-mon[24912]: pgmap v378: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:17.333 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:16 smithi099 ceph-mon[24912]: pgmap v379: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:17.333 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:16 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:17.334 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:16 smithi099 ceph-mon[24912]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-1967-g4e50bbcd 2024-03-30T13:59:17.334 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:16 smithi099 ceph-mon[24912]: pgmap v380: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:17.334 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:16 smithi099 ceph-mon[24912]: pgmap v381: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:17.334 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:16 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:17.334 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:16 smithi099 ceph-mon[24912]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-1967-g4e50bbcd 2024-03-30T13:59:17.334 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:16 smithi099 ceph-mon[24912]: pgmap v382: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:17.334 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:16 smithi099 ceph-mon[24912]: pgmap v383: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:17.334 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:16 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:17.334 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:16 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:17.334 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:16 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:17.334 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:16 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:17.334 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:16 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:17.334 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:16 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:17.334 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:16 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:17.335 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:16 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:17.335 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:16 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:17.335 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:16 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:17.335 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:16 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:17.335 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:16 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:17.335 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:16 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:17.335 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:16 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:17.335 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:16 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:17.335 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:16 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:17.335 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:16 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:17.335 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:16 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:17.335 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:16 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:17.335 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:16 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:17.335 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:16 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:17.336 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:16 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:17.336 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:16 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:17.336 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:16 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:17.336 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:16 smithi099 ceph-mon[29691]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-1967-g4e50bbcd 2024-03-30T13:59:17.336 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:16 smithi099 ceph-mon[29691]: pgmap v364: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:17.336 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:16 smithi099 ceph-mon[29691]: pgmap v365: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:17.336 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:16 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:17.336 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:16 smithi099 ceph-mon[29691]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-1967-g4e50bbcd 2024-03-30T13:59:17.336 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:16 smithi099 ceph-mon[29691]: pgmap v366: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:17.336 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:16 smithi099 ceph-mon[29691]: pgmap v367: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:17.337 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:16 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:17.337 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:16 smithi099 ceph-mon[29691]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-1967-g4e50bbcd 2024-03-30T13:59:17.337 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:16 smithi099 ceph-mon[29691]: pgmap v368: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:17.337 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:16 smithi099 ceph-mon[29691]: pgmap v369: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:17.337 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:16 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:17.337 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:16 smithi099 ceph-mon[29691]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-1967-g4e50bbcd 2024-03-30T13:59:17.337 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:16 smithi099 ceph-mon[29691]: pgmap v370: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:17.337 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:16 smithi099 ceph-mon[29691]: pgmap v371: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:17.337 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:16 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:17.337 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:16 smithi099 ceph-mon[29691]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-1967-g4e50bbcd 2024-03-30T13:59:17.337 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:16 smithi099 ceph-mon[29691]: pgmap v372: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:17.337 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:16 smithi099 ceph-mon[29691]: pgmap v373: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:17.337 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:16 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:17.337 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:16 smithi099 ceph-mon[29691]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-1967-g4e50bbcd 2024-03-30T13:59:17.338 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:16 smithi099 ceph-mon[29691]: pgmap v374: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:17.338 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:16 smithi099 ceph-mon[29691]: pgmap v375: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:17.338 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:16 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:17.338 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:16 smithi099 ceph-mon[29691]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-1967-g4e50bbcd 2024-03-30T13:59:17.338 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:16 smithi099 ceph-mon[29691]: pgmap v376: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:17.338 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:16 smithi099 ceph-mon[29691]: pgmap v377: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:17.338 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:16 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:17.338 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:16 smithi099 ceph-mon[29691]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-1967-g4e50bbcd 2024-03-30T13:59:17.342 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:16 smithi099 ceph-mon[29691]: pgmap v378: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:17.342 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:16 smithi099 ceph-mon[29691]: pgmap v379: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:17.343 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:16 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:17.343 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:16 smithi099 ceph-mon[29691]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-1967-g4e50bbcd 2024-03-30T13:59:17.343 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:16 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:17.343 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:16 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:17.343 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:16 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:17.343 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:16 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:17.343 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:16 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:17.343 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:16 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:17.344 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:16 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:17.344 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:16 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:17.344 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:16 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:17.344 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:16 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:17.344 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:16 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:17.344 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:16 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:17.344 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:16 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:17.344 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:16 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:17.344 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:16 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:17.344 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:16 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:17.344 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:16 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:17.344 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:16 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:17.344 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:16 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:17.344 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:16 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:17.345 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:16 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:17.345 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:16 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:17.345 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:16 smithi099 ceph-mon[29691]: pgmap v380: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:17.345 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:16 smithi099 ceph-mon[29691]: pgmap v381: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:17.345 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:16 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:17.345 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:16 smithi099 ceph-mon[29691]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-1967-g4e50bbcd 2024-03-30T13:59:17.345 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:16 smithi099 ceph-mon[29691]: pgmap v382: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:17.345 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:16 smithi099 ceph-mon[29691]: pgmap v383: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:17.345 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:16 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:17.345 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:16 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:17.346 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:16 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:17.346 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:16 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:17.346 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:16 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:17.346 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:16 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:17.346 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:16 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:17.346 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:16 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:17.346 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:16 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:17.346 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:16 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:17.346 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:16 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:17.346 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:16 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:17.346 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:16 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:17.346 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:16 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:17.346 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:16 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:17.346 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:16 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:17.347 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:16 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:17.347 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:16 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:17.347 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:16 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:17.347 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:16 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:17.347 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:16 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:17.347 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:16 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:17.347 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:16 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:17.347 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:16 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:17.347 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:16 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:17.347 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:16 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:17.347 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:16 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:17.347 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:16 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:17.347 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:16 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:17.347 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:16 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:17.348 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:16 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:17.348 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:16 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:17.348 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:16 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:17.348 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:16 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:17.348 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:16 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:17.348 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:16 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:17.348 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:16 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:17.348 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:16 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:17.348 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:16 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:17.348 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:16 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:17.348 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:16 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:17.348 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:16 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:17.348 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:16 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:17.348 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:16 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:17.348 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:16 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:17.348 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:16 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:17.500 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 13:59:17 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-x[80020]: 2024-03-30T13:59:17.141+0000 7fb2e25bc200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-03-30T13:59:18.001 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 13:59:17 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-x[80020]: 2024-03-30T13:59:17.768+0000 7fb2e25bc200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-03-30T13:59:18.001 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 13:59:17 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-x[80020]: 2024-03-30T13:59:17.875+0000 7fb2e25bc200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-03-30T13:59:18.002 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:17 smithi181 ceph-mon[25762]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-1967-g4e50bbcd 2024-03-30T13:59:18.002 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:17 smithi181 ceph-mon[25762]: pgmap v384: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:18.002 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:17 smithi181 ceph-mon[25762]: pgmap v385: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:18.003 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:17 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:18.003 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:17 smithi181 ceph-mon[25762]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-1967-g4e50bbcd 2024-03-30T13:59:18.003 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:17 smithi181 ceph-mon[25762]: pgmap v386: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:18.003 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:17 smithi181 ceph-mon[25762]: pgmap v387: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:18.003 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:17 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:18.003 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:17 smithi181 ceph-mon[25762]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-1967-g4e50bbcd 2024-03-30T13:59:18.003 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:17 smithi181 ceph-mon[25762]: pgmap v388: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:18.003 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:17 smithi181 ceph-mon[25762]: pgmap v389: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:18.004 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:17 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:18.004 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:17 smithi181 ceph-mon[25762]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-1967-g4e50bbcd 2024-03-30T13:59:18.004 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:17 smithi181 ceph-mon[25762]: pgmap v390: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:18.004 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:17 smithi181 ceph-mon[25762]: pgmap v391: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:18.004 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:17 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:18.004 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:17 smithi181 ceph-mon[25762]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-1967-g4e50bbcd 2024-03-30T13:59:18.004 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:17 smithi181 ceph-mon[25762]: pgmap v392: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:18.005 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:17 smithi181 ceph-mon[25762]: pgmap v393: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:18.005 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:17 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:18.005 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:17 smithi181 ceph-mon[25762]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-1967-g4e50bbcd 2024-03-30T13:59:18.005 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:17 smithi181 ceph-mon[25762]: pgmap v394: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:18.005 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:17 smithi181 ceph-mon[25762]: pgmap v395: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:18.005 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:17 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:18.005 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:17 smithi181 ceph-mon[25762]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-1967-g4e50bbcd 2024-03-30T13:59:18.005 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:17 smithi181 ceph-mon[25762]: pgmap v396: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:18.005 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:17 smithi181 ceph-mon[25762]: pgmap v397: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:18.006 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:17 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:18.006 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:17 smithi181 ceph-mon[25762]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-1967-g4e50bbcd 2024-03-30T13:59:18.006 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:17 smithi181 ceph-mon[25762]: pgmap v398: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 18 KiB/s rd, 17 op/s 2024-03-30T13:59:18.006 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:17 smithi181 ceph-mon[25762]: pgmap v399: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 18 KiB/s rd, 17 op/s 2024-03-30T13:59:18.006 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:17 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:18.006 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:17 smithi181 ceph-mon[25762]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-1967-g4e50bbcd 2024-03-30T13:59:18.006 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:17 smithi181 ceph-mon[25762]: pgmap v400: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 16 KiB/s rd, 16 op/s 2024-03-30T13:59:18.006 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:17 smithi181 ceph-mon[25762]: pgmap v401: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 16 KiB/s rd, 16 op/s 2024-03-30T13:59:18.007 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:17 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:18.007 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:17 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:18.007 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:17 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:18.007 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:17 smithi181 ceph-mon[25762]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-1967-g4e50bbcd 2024-03-30T13:59:18.007 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:17 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:18.007 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:17 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:18.007 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:17 smithi181 ceph-mon[25762]: pgmap v402: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 16 KiB/s rd, 15 op/s 2024-03-30T13:59:18.007 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:17 smithi181 ceph-mon[25762]: pgmap v403: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 16 KiB/s rd, 15 op/s 2024-03-30T13:59:18.007 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:17 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:18.008 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:17 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:18.008 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:17 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:18.008 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:17 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:18.008 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:17 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:18.008 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:17 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:18.008 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:17 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:18.008 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:17 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:18.008 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:17 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:18.008 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:17 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:18.008 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:17 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:18.008 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:17 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:18.008 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:17 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:18.008 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:17 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:18.008 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:17 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:18.008 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:17 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:18.009 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:17 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:18.009 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:17 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:18.009 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:17 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:18.009 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:17 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:18.009 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:17 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:18.009 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:17 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:18.009 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:17 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:18.009 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:17 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:18.009 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:17 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:18.009 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:17 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:18.009 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:17 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:18.009 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:17 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:18.009 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:17 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:18.009 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:17 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:18.010 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:17 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:18.010 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:17 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:18.010 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:17 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:18.010 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:17 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:18.010 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:17 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:18.010 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:17 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:18.010 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:17 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:18.010 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:17 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:18.010 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:17 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:18.010 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:17 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:18.010 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:17 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:18.010 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:17 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:18.010 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:17 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:18.010 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:17 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:18.011 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:17 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:18.011 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:17 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:18.011 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:17 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:18.011 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:17 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:18.011 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:17 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:18.011 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:17 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:18.011 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:17 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:18.011 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:17 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:18.011 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:17 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:18.011 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:17 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:18.011 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:17 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:18.011 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:17 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:18.011 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:17 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:18.256 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 13:59:18 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-x[80020]: 2024-03-30T13:59:18.118+0000 7fb2e25bc200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-03-30T13:59:18.256 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 13:59:18 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-x[80020]: [30/Mar/2024:13:59:18] ENGINE Bus STARTING 2024-03-30T13:59:18.256 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 13:59:18 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-x[80020]: CherryPy Checker: 2024-03-30T13:59:18.256 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 13:59:18 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-x[80020]: The Application mounted at '' has an empty config. 2024-03-30T13:59:18.256 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 13:59:18 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-x[80020]: 2024-03-30T13:59:18.256 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 13:59:18 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-x[80020]: [30/Mar/2024:13:59:18] ENGINE Serving on http://:::9283 2024-03-30T13:59:18.256 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 13:59:18 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-x[80020]: [30/Mar/2024:13:59:18] ENGINE Bus STARTED 2024-03-30T13:59:18.331 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:17 smithi099 ceph-mon[29691]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-1967-g4e50bbcd 2024-03-30T13:59:18.331 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:17 smithi099 ceph-mon[29691]: pgmap v384: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:18.331 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:17 smithi099 ceph-mon[29691]: pgmap v385: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:18.332 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:17 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:18.332 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:17 smithi099 ceph-mon[29691]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-1967-g4e50bbcd 2024-03-30T13:59:18.332 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:17 smithi099 ceph-mon[29691]: pgmap v386: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:18.332 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:17 smithi099 ceph-mon[29691]: pgmap v387: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:18.332 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:17 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:18.332 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:17 smithi099 ceph-mon[29691]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-1967-g4e50bbcd 2024-03-30T13:59:18.332 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:17 smithi099 ceph-mon[29691]: pgmap v388: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:18.332 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:17 smithi099 ceph-mon[29691]: pgmap v389: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:18.332 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:17 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:18.332 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:17 smithi099 ceph-mon[29691]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-1967-g4e50bbcd 2024-03-30T13:59:18.332 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:17 smithi099 ceph-mon[29691]: pgmap v390: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:18.333 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:17 smithi099 ceph-mon[29691]: pgmap v391: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:18.333 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:17 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:18.333 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:17 smithi099 ceph-mon[29691]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-1967-g4e50bbcd 2024-03-30T13:59:18.333 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:17 smithi099 ceph-mon[29691]: pgmap v392: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:18.333 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:17 smithi099 ceph-mon[29691]: pgmap v393: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:18.333 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:17 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:18.333 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:17 smithi099 ceph-mon[29691]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-1967-g4e50bbcd 2024-03-30T13:59:18.333 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:17 smithi099 ceph-mon[29691]: pgmap v394: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:18.333 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:17 smithi099 ceph-mon[29691]: pgmap v395: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:18.333 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:17 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:18.334 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:17 smithi099 ceph-mon[29691]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-1967-g4e50bbcd 2024-03-30T13:59:18.334 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:17 smithi099 ceph-mon[29691]: pgmap v396: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:18.334 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:17 smithi099 ceph-mon[29691]: pgmap v397: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:18.334 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:17 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:18.334 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:17 smithi099 ceph-mon[29691]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-1967-g4e50bbcd 2024-03-30T13:59:18.334 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:17 smithi099 ceph-mon[29691]: pgmap v398: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 18 KiB/s rd, 17 op/s 2024-03-30T13:59:18.334 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:17 smithi099 ceph-mon[29691]: pgmap v399: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 18 KiB/s rd, 17 op/s 2024-03-30T13:59:18.334 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:17 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:18.334 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:17 smithi099 ceph-mon[29691]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-1967-g4e50bbcd 2024-03-30T13:59:18.335 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:17 smithi099 ceph-mon[24912]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-1967-g4e50bbcd 2024-03-30T13:59:18.335 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:17 smithi099 ceph-mon[24912]: pgmap v384: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:18.335 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:17 smithi099 ceph-mon[24912]: pgmap v385: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:18.335 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:17 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:18.335 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:17 smithi099 ceph-mon[24912]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-1967-g4e50bbcd 2024-03-30T13:59:18.335 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:17 smithi099 ceph-mon[24912]: pgmap v386: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:18.335 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:17 smithi099 ceph-mon[24912]: pgmap v387: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:18.335 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:17 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:18.335 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:17 smithi099 ceph-mon[24912]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-1967-g4e50bbcd 2024-03-30T13:59:18.335 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:17 smithi099 ceph-mon[24912]: pgmap v388: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:18.335 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:17 smithi099 ceph-mon[24912]: pgmap v389: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:18.336 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:17 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:18.336 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:17 smithi099 ceph-mon[24912]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-1967-g4e50bbcd 2024-03-30T13:59:18.336 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:17 smithi099 ceph-mon[24912]: pgmap v390: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:18.336 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:17 smithi099 ceph-mon[24912]: pgmap v391: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:18.336 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:17 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:18.336 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:17 smithi099 ceph-mon[24912]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-1967-g4e50bbcd 2024-03-30T13:59:18.336 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:17 smithi099 ceph-mon[24912]: pgmap v392: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:18.336 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:17 smithi099 ceph-mon[24912]: pgmap v393: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:18.336 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:17 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:18.336 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:17 smithi099 ceph-mon[24912]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-1967-g4e50bbcd 2024-03-30T13:59:18.336 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:17 smithi099 ceph-mon[24912]: pgmap v394: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:18.336 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:17 smithi099 ceph-mon[24912]: pgmap v395: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:18.337 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:17 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:18.337 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:17 smithi099 ceph-mon[24912]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-1967-g4e50bbcd 2024-03-30T13:59:18.337 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:17 smithi099 ceph-mon[24912]: pgmap v396: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:18.337 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:17 smithi099 ceph-mon[24912]: pgmap v397: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:18.337 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:17 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:18.337 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:17 smithi099 ceph-mon[24912]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-1967-g4e50bbcd 2024-03-30T13:59:18.337 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:17 smithi099 ceph-mon[24912]: pgmap v398: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 18 KiB/s rd, 17 op/s 2024-03-30T13:59:18.337 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:17 smithi099 ceph-mon[24912]: pgmap v399: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 18 KiB/s rd, 17 op/s 2024-03-30T13:59:18.337 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:17 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:18.337 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:17 smithi099 ceph-mon[24912]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-1967-g4e50bbcd 2024-03-30T13:59:18.338 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:17 smithi099 ceph-mon[29691]: pgmap v400: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 16 KiB/s rd, 16 op/s 2024-03-30T13:59:18.338 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:17 smithi099 ceph-mon[29691]: pgmap v401: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 16 KiB/s rd, 16 op/s 2024-03-30T13:59:18.338 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:17 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:18.338 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:17 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:18.338 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:17 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:18.338 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:17 smithi099 ceph-mon[29691]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-1967-g4e50bbcd 2024-03-30T13:59:18.338 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:17 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:18.338 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:17 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:18.338 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:17 smithi099 ceph-mon[29691]: pgmap v402: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 16 KiB/s rd, 15 op/s 2024-03-30T13:59:18.338 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:17 smithi099 ceph-mon[29691]: pgmap v403: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 16 KiB/s rd, 15 op/s 2024-03-30T13:59:18.339 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:17 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:18.339 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:17 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:18.339 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:17 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:18.339 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:17 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:18.339 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:17 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:18.339 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:17 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:18.339 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:17 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:18.339 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:17 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:18.339 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:17 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:18.339 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:17 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:18.339 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:17 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:18.339 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:17 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:18.340 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:17 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:18.340 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:17 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:18.340 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:17 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:18.340 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:17 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:18.340 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:17 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:18.340 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:17 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:18.340 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:17 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:18.340 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:17 smithi099 ceph-mon[24912]: pgmap v400: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 16 KiB/s rd, 16 op/s 2024-03-30T13:59:18.340 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:17 smithi099 ceph-mon[24912]: pgmap v401: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 16 KiB/s rd, 16 op/s 2024-03-30T13:59:18.341 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:17 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:18.341 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:17 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:18.341 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:17 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:18.341 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:17 smithi099 ceph-mon[24912]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-1967-g4e50bbcd 2024-03-30T13:59:18.341 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:17 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:18.341 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:17 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:18.341 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:17 smithi099 ceph-mon[24912]: pgmap v402: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 16 KiB/s rd, 15 op/s 2024-03-30T13:59:18.341 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:17 smithi099 ceph-mon[24912]: pgmap v403: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 16 KiB/s rd, 15 op/s 2024-03-30T13:59:18.341 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:17 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:18.341 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:17 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:18.341 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:17 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:18.342 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:17 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:18.342 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:17 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:18.342 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:17 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:18.342 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:17 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:18.342 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:17 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:18.342 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:17 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:18.342 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:17 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:18.342 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:17 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:18.342 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:17 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:18.342 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:17 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:18.342 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:17 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:18.343 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:17 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:18.343 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:17 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:18.343 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:17 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:18.343 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:17 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:18.343 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:17 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:18.343 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:17 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:18.343 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:17 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:18.344 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:17 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:18.344 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:17 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:18.344 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:17 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:18.344 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:17 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:18.344 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:17 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:18.344 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:17 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:18.344 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:17 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:18.344 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:17 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:18.344 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:17 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:18.344 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:17 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:18.344 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:17 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:18.344 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:17 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:18.344 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:17 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:18.345 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:17 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:18.345 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:17 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:18.345 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:17 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:18.345 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:17 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:18.345 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:17 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:18.345 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:17 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:18.345 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:17 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:18.345 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:17 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:18.345 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:17 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:18.345 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:17 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:18.345 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:17 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:18.345 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:17 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:18.345 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:17 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:18.345 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:17 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:18.346 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:17 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:18.346 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:17 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:18.346 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:17 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:18.346 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:17 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:18.346 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:17 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:18.346 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:17 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:18.346 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:17 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:18.346 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:17 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:18.346 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:17 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:18.347 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:17 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:18.347 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:17 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:18.347 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:17 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:18.347 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:17 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:18.347 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:17 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:18.347 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:17 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:18.347 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:17 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:18.347 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:17 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:18.347 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:17 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:18.347 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:17 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:18.347 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:17 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:18.348 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:17 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:18.348 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:17 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:18.348 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:17 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:18.348 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:17 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:18.348 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:17 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:18.348 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:17 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:18.348 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:17 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:18.348 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:17 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:18.348 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:17 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:18.348 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:17 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:18.348 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:17 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:18.348 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:17 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:18.349 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:17 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:18.349 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:17 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:18.349 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:17 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:18.349 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:17 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:18.349 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:17 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:18.349 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:17 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:18.349 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:17 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:18.349 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:17 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:18.349 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:17 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:18.349 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:17 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:18.349 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:17 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:18.349 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:17 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:18.349 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:17 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:18.350 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:17 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:18.350 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:17 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:19.253 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:18 smithi181 ceph-mon[25762]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-1967-g4e50bbcd 2024-03-30T13:59:19.253 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:18 smithi181 ceph-mon[25762]: pgmap v404: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:19.253 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:18 smithi181 ceph-mon[25762]: pgmap v405: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:19.253 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:18 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:19.253 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:18 smithi181 ceph-mon[25762]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-1967-g4e50bbcd 2024-03-30T13:59:19.254 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:18 smithi181 ceph-mon[25762]: pgmap v406: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:19.254 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:18 smithi181 ceph-mon[25762]: pgmap v407: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:19.254 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:18 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:19.254 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:18 smithi181 ceph-mon[25762]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-1967-g4e50bbcd 2024-03-30T13:59:19.254 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:18 smithi181 ceph-mon[25762]: pgmap v408: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:19.254 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:18 smithi181 ceph-mon[25762]: pgmap v409: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:19.254 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:18 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:19.254 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:18 smithi181 ceph-mon[25762]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-1967-g4e50bbcd 2024-03-30T13:59:19.254 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:18 smithi181 ceph-mon[25762]: pgmap v410: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:19.254 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:18 smithi181 ceph-mon[25762]: pgmap v411: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:19.254 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:18 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:19.254 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:18 smithi181 ceph-mon[25762]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-1967-g4e50bbcd 2024-03-30T13:59:19.254 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:18 smithi181 ceph-mon[25762]: pgmap v412: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:19.255 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:18 smithi181 ceph-mon[25762]: pgmap v413: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:19.255 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:18 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:19.255 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:18 smithi181 ceph-mon[25762]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-1967-g4e50bbcd 2024-03-30T13:59:19.255 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:18 smithi181 ceph-mon[25762]: pgmap v414: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:19.255 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:18 smithi181 ceph-mon[25762]: pgmap v415: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:19.255 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:18 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:19.255 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:18 smithi181 ceph-mon[25762]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-1967-g4e50bbcd 2024-03-30T13:59:19.255 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:18 smithi181 ceph-mon[25762]: pgmap v416: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:19.255 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:18 smithi181 ceph-mon[25762]: pgmap v417: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:19.255 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:18 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:19.255 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:18 smithi181 ceph-mon[25762]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-1967-g4e50bbcd 2024-03-30T13:59:19.255 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:18 smithi181 ceph-mon[25762]: pgmap v418: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:19.255 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:18 smithi181 ceph-mon[25762]: pgmap v419: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:19.255 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:18 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:19.256 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:18 smithi181 ceph-mon[25762]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-1967-g4e50bbcd 2024-03-30T13:59:19.256 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:18 smithi181 ceph-mon[25762]: pgmap v420: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:19.256 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:18 smithi181 ceph-mon[25762]: pgmap v421: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:19.256 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:18 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:19.256 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:18 smithi181 ceph-mon[25762]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-1967-g4e50bbcd 2024-03-30T13:59:19.256 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:18 smithi181 ceph-mon[25762]: pgmap v422: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:19.256 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:18 smithi181 ceph-mon[25762]: pgmap v423: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:19.256 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:18 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:19.256 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:18 smithi181 ceph-mon[25762]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-1967-g4e50bbcd 2024-03-30T13:59:19.256 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:18 smithi181 ceph-mon[25762]: pgmap v424: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:19.256 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:18 smithi181 ceph-mon[25762]: pgmap v425: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:19.256 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:18 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:19.256 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:18 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:19.256 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:18 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:19.256 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:18 smithi181 ceph-mon[25762]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-1967-g4e50bbcd 2024-03-30T13:59:19.257 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:18 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:19.257 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:18 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:19.257 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:18 smithi181 ceph-mon[25762]: pgmap v426: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:19.257 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:18 smithi181 ceph-mon[25762]: pgmap v427: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:19.257 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:18 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:19.257 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:18 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:19.257 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:18 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:19.257 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:18 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:19.257 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:18 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:19.257 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:18 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:19.257 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:18 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:19.257 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:18 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:19.257 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:18 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:19.257 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:18 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:19.258 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:18 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:19.258 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:18 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:19.258 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:18 smithi181 ceph-mon[25762]: Standby manager daemon x restarted 2024-03-30T13:59:19.258 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:18 smithi181 ceph-mon[25762]: Standby manager daemon x started 2024-03-30T13:59:19.258 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:18 smithi181 ceph-mon[25762]: from='mgr.? 172.21.15.181:0/1225774388' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/crt"}]: dispatch 2024-03-30T13:59:19.258 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:18 smithi181 ceph-mon[25762]: from='mgr.? 172.21.15.181:0/1225774388' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-03-30T13:59:19.259 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:18 smithi181 ceph-mon[25762]: from='mgr.? 172.21.15.181:0/1225774388' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/key"}]: dispatch 2024-03-30T13:59:19.259 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:18 smithi181 ceph-mon[25762]: from='mgr.? 172.21.15.181:0/1225774388' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-03-30T13:59:19.259 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:18 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:19.259 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:18 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:19.259 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:18 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:19.259 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:18 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:19.259 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:18 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:19.259 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:18 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:19.259 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:18 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:19.259 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:18 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:19.259 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:18 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:19.259 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:18 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:19.259 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:18 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:19.260 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:18 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:19.260 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:18 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:19.260 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:18 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:19.260 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:18 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:19.260 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:18 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:19.260 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:18 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:19.260 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:18 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:19.260 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:18 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:19.260 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:18 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:19.260 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:18 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:19.260 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:18 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:19.260 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:18 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:19.260 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:18 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:19.260 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:18 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:19.260 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:18 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:19.260 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:18 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:19.261 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:18 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:19.261 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:18 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:19.261 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:18 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:19.261 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:18 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:19.261 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:18 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:19.261 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:18 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:19.261 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:18 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:19.261 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:18 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:19.261 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:18 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:19.261 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:18 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:19.261 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:18 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:19.261 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:18 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:19.261 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:18 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:19.261 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:18 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:19.262 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:18 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:19.262 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:18 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:19.262 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:18 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:19.262 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:18 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:19.331 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:18 smithi099 ceph-mon[29691]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-1967-g4e50bbcd 2024-03-30T13:59:19.331 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:18 smithi099 ceph-mon[29691]: pgmap v404: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:19.331 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:18 smithi099 ceph-mon[29691]: pgmap v405: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:19.331 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:18 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:19.331 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:18 smithi099 ceph-mon[29691]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-1967-g4e50bbcd 2024-03-30T13:59:19.331 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:18 smithi099 ceph-mon[29691]: pgmap v406: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:19.332 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:18 smithi099 ceph-mon[29691]: pgmap v407: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:19.332 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:18 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:19.332 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:18 smithi099 ceph-mon[29691]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-1967-g4e50bbcd 2024-03-30T13:59:19.332 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:18 smithi099 ceph-mon[29691]: pgmap v408: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:19.332 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:18 smithi099 ceph-mon[29691]: pgmap v409: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:19.332 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:18 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:19.332 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:18 smithi099 ceph-mon[29691]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-1967-g4e50bbcd 2024-03-30T13:59:19.332 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:18 smithi099 ceph-mon[29691]: pgmap v410: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:19.332 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:18 smithi099 ceph-mon[29691]: pgmap v411: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:19.332 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:18 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:19.332 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:18 smithi099 ceph-mon[29691]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-1967-g4e50bbcd 2024-03-30T13:59:19.332 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:18 smithi099 ceph-mon[29691]: pgmap v412: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:19.332 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:18 smithi099 ceph-mon[29691]: pgmap v413: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:19.332 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:18 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:19.332 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:18 smithi099 ceph-mon[29691]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-1967-g4e50bbcd 2024-03-30T13:59:19.333 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:18 smithi099 ceph-mon[29691]: pgmap v414: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:19.333 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:18 smithi099 ceph-mon[29691]: pgmap v415: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:19.333 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:18 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:19.333 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:18 smithi099 ceph-mon[29691]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-1967-g4e50bbcd 2024-03-30T13:59:19.333 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:18 smithi099 ceph-mon[29691]: pgmap v416: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:19.333 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:18 smithi099 ceph-mon[29691]: pgmap v417: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:19.333 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:18 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:19.333 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:18 smithi099 ceph-mon[29691]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-1967-g4e50bbcd 2024-03-30T13:59:19.333 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:18 smithi099 ceph-mon[29691]: pgmap v418: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:19.333 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:18 smithi099 ceph-mon[29691]: pgmap v419: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:19.333 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:18 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:19.333 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:18 smithi099 ceph-mon[29691]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-1967-g4e50bbcd 2024-03-30T13:59:19.334 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:18 smithi099 ceph-mon[24912]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-1967-g4e50bbcd 2024-03-30T13:59:19.334 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:18 smithi099 ceph-mon[24912]: pgmap v404: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:19.334 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:18 smithi099 ceph-mon[24912]: pgmap v405: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:19.334 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:18 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:19.334 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:18 smithi099 ceph-mon[24912]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-1967-g4e50bbcd 2024-03-30T13:59:19.334 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:18 smithi099 ceph-mon[24912]: pgmap v406: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:19.334 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:18 smithi099 ceph-mon[24912]: pgmap v407: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:19.334 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:18 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:19.334 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:18 smithi099 ceph-mon[24912]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-1967-g4e50bbcd 2024-03-30T13:59:19.334 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:18 smithi099 ceph-mon[24912]: pgmap v408: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:19.334 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:18 smithi099 ceph-mon[24912]: pgmap v409: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:19.334 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:18 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:19.334 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:18 smithi099 ceph-mon[24912]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-1967-g4e50bbcd 2024-03-30T13:59:19.335 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:18 smithi099 ceph-mon[24912]: pgmap v410: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:19.335 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:18 smithi099 ceph-mon[24912]: pgmap v411: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:19.335 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:18 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:19.335 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:18 smithi099 ceph-mon[24912]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-1967-g4e50bbcd 2024-03-30T13:59:19.335 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:18 smithi099 ceph-mon[24912]: pgmap v412: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:19.335 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:18 smithi099 ceph-mon[24912]: pgmap v413: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:19.335 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:18 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:19.335 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:18 smithi099 ceph-mon[24912]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-1967-g4e50bbcd 2024-03-30T13:59:19.335 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:18 smithi099 ceph-mon[24912]: pgmap v414: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:19.335 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:18 smithi099 ceph-mon[24912]: pgmap v415: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:19.335 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:18 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:19.335 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:18 smithi099 ceph-mon[24912]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-1967-g4e50bbcd 2024-03-30T13:59:19.335 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:18 smithi099 ceph-mon[24912]: pgmap v416: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:19.335 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:18 smithi099 ceph-mon[24912]: pgmap v417: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:19.335 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:18 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:19.336 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:18 smithi099 ceph-mon[24912]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-1967-g4e50bbcd 2024-03-30T13:59:19.336 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:18 smithi099 ceph-mon[24912]: pgmap v418: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:19.336 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:18 smithi099 ceph-mon[24912]: pgmap v419: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:19.336 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:18 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:19.336 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:18 smithi099 ceph-mon[24912]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-1967-g4e50bbcd 2024-03-30T13:59:19.336 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:18 smithi099 ceph-mon[29691]: pgmap v420: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:19.336 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:18 smithi099 ceph-mon[29691]: pgmap v421: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:19.337 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:18 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:19.337 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:18 smithi099 ceph-mon[29691]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-1967-g4e50bbcd 2024-03-30T13:59:19.337 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:18 smithi099 ceph-mon[29691]: pgmap v422: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:19.337 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:18 smithi099 ceph-mon[29691]: pgmap v423: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:19.337 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:18 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:19.337 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:18 smithi099 ceph-mon[29691]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-1967-g4e50bbcd 2024-03-30T13:59:19.337 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:18 smithi099 ceph-mon[29691]: pgmap v424: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:19.337 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:18 smithi099 ceph-mon[29691]: pgmap v425: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:19.338 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:18 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:19.338 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:18 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:19.338 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:18 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:19.338 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:18 smithi099 ceph-mon[29691]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-1967-g4e50bbcd 2024-03-30T13:59:19.338 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:18 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:19.338 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:18 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:19.338 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:18 smithi099 ceph-mon[29691]: pgmap v426: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:19.338 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:18 smithi099 ceph-mon[29691]: pgmap v427: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:19.338 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:18 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:19.338 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:18 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:19.338 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:18 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:19.338 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:18 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:19.338 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:18 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:19.338 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:18 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:19.339 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:18 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:19.339 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:18 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:19.339 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:18 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:19.339 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:18 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:19.339 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:18 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:19.339 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:18 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:19.339 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:18 smithi099 ceph-mon[29691]: Standby manager daemon x restarted 2024-03-30T13:59:19.339 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:18 smithi099 ceph-mon[29691]: Standby manager daemon x started 2024-03-30T13:59:19.339 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:18 smithi099 ceph-mon[29691]: from='mgr.? 172.21.15.181:0/1225774388' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/crt"}]: dispatch 2024-03-30T13:59:19.339 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:18 smithi099 ceph-mon[29691]: from='mgr.? 172.21.15.181:0/1225774388' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-03-30T13:59:19.339 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:18 smithi099 ceph-mon[29691]: from='mgr.? 172.21.15.181:0/1225774388' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/key"}]: dispatch 2024-03-30T13:59:19.339 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:18 smithi099 ceph-mon[29691]: from='mgr.? 172.21.15.181:0/1225774388' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-03-30T13:59:19.339 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:18 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:19.339 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:18 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:19.339 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:18 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:19.340 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:18 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:19.340 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:18 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:19.340 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:18 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:19.340 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:18 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:19.340 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:18 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:19.340 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:18 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:19.340 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:18 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:19.340 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:18 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:19.340 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:18 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:19.340 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:18 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:19.340 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:18 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:19.340 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:18 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:19.340 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:18 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:19.340 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:18 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:19.340 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:18 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:19.341 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:18 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:19.341 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:18 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:19.341 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:18 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:19.341 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:18 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:19.341 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:18 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:19.341 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:18 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:19.341 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:18 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:19.341 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:18 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:19.341 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:18 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:19.341 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:18 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:19.341 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:18 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:19.341 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:18 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:19.341 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:18 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:19.341 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:18 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:19.342 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:18 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:19.342 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:18 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:19.342 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:18 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:19.342 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:18 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:19.342 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:18 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:19.342 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:18 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:19.342 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:18 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:19.342 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:18 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:19.342 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:18 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:19.342 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:18 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:19.342 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:18 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:19.342 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:18 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:19.342 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:18 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:19.343 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:18 smithi099 ceph-mon[24912]: pgmap v420: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:19.343 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:18 smithi099 ceph-mon[24912]: pgmap v421: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:19.343 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:18 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:19.343 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:18 smithi099 ceph-mon[24912]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-1967-g4e50bbcd 2024-03-30T13:59:19.343 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:18 smithi099 ceph-mon[24912]: pgmap v422: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:19.343 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:18 smithi099 ceph-mon[24912]: pgmap v423: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:19.343 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:18 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:19.343 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:18 smithi099 ceph-mon[24912]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-1967-g4e50bbcd 2024-03-30T13:59:19.343 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:18 smithi099 ceph-mon[24912]: pgmap v424: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:19.344 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:18 smithi099 ceph-mon[24912]: pgmap v425: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:19.344 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:18 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:19.344 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:18 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:19.344 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:18 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:19.344 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:18 smithi099 ceph-mon[24912]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-1967-g4e50bbcd 2024-03-30T13:59:19.344 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:18 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:19.344 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:18 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:19.344 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:18 smithi099 ceph-mon[24912]: pgmap v426: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:19.344 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:18 smithi099 ceph-mon[24912]: pgmap v427: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:19.344 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:18 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:19.344 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:18 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:19.344 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:18 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:19.344 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:18 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:19.344 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:18 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:19.344 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:18 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:19.345 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:18 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:19.345 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:18 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:19.345 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:18 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:19.345 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:18 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:19.345 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:18 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:19.345 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:18 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:19.345 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:18 smithi099 ceph-mon[24912]: Standby manager daemon x restarted 2024-03-30T13:59:19.345 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:18 smithi099 ceph-mon[24912]: Standby manager daemon x started 2024-03-30T13:59:19.345 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:18 smithi099 ceph-mon[24912]: from='mgr.? 172.21.15.181:0/1225774388' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/crt"}]: dispatch 2024-03-30T13:59:19.345 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:18 smithi099 ceph-mon[24912]: from='mgr.? 172.21.15.181:0/1225774388' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-03-30T13:59:19.345 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:18 smithi099 ceph-mon[24912]: from='mgr.? 172.21.15.181:0/1225774388' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/key"}]: dispatch 2024-03-30T13:59:19.345 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:18 smithi099 ceph-mon[24912]: from='mgr.? 172.21.15.181:0/1225774388' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-03-30T13:59:19.345 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:18 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:19.345 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:18 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:19.345 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:18 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:19.346 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:18 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:19.346 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:18 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:19.346 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:18 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:19.346 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:18 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:19.346 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:18 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:19.346 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:18 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:19.346 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:18 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:19.346 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:18 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:19.346 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:18 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:19.346 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:18 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:19.346 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:18 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:19.346 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:18 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:19.346 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:18 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:19.346 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:18 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:19.346 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:18 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:19.347 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:18 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:19.347 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:18 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:19.347 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:18 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:19.347 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:18 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:19.347 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:18 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:19.347 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:18 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:19.347 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:18 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:19.347 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:18 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:19.347 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:18 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:19.347 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:18 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:19.347 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:18 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:19.347 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:18 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:19.347 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:18 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:19.347 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:18 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:19.348 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:18 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:19.348 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:18 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:19.348 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:18 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:19.348 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:18 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:19.348 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:18 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:19.348 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:18 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:19.348 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:18 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:19.348 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:18 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:19.348 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:18 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:19.349 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:18 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:19.349 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:18 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:19.349 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:18 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:19.349 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:18 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:20.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:19 smithi181 ceph-mon[25762]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-1967-g4e50bbcd 2024-03-30T13:59:20.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:19 smithi181 ceph-mon[25762]: pgmap v428: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:20.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:19 smithi181 ceph-mon[25762]: pgmap v429: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:20.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:19 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:20.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:19 smithi181 ceph-mon[25762]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-1967-g4e50bbcd 2024-03-30T13:59:20.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:19 smithi181 ceph-mon[25762]: pgmap v430: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:20.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:19 smithi181 ceph-mon[25762]: pgmap v431: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:20.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:19 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:20.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:19 smithi181 ceph-mon[25762]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-1967-g4e50bbcd 2024-03-30T13:59:20.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:19 smithi181 ceph-mon[25762]: pgmap v432: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:20.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:19 smithi181 ceph-mon[25762]: pgmap v433: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:20.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:19 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:20.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:19 smithi181 ceph-mon[25762]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-1967-g4e50bbcd 2024-03-30T13:59:20.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:19 smithi181 ceph-mon[25762]: pgmap v434: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:20.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:19 smithi181 ceph-mon[25762]: pgmap v435: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:20.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:19 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:20.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:19 smithi181 ceph-mon[25762]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-1967-g4e50bbcd 2024-03-30T13:59:20.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:19 smithi181 ceph-mon[25762]: pgmap v436: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:20.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:19 smithi181 ceph-mon[25762]: pgmap v437: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:20.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:19 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:20.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:19 smithi181 ceph-mon[25762]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-1967-g4e50bbcd 2024-03-30T13:59:20.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:19 smithi181 ceph-mon[25762]: pgmap v438: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:20.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:19 smithi181 ceph-mon[25762]: pgmap v439: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:20.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:19 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:20.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:19 smithi181 ceph-mon[25762]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-1967-g4e50bbcd 2024-03-30T13:59:20.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:19 smithi181 ceph-mon[25762]: pgmap v440: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:20.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:19 smithi181 ceph-mon[25762]: pgmap v441: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:20.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:19 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:20.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:19 smithi181 ceph-mon[25762]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-1967-g4e50bbcd 2024-03-30T13:59:20.253 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:19 smithi181 ceph-mon[25762]: pgmap v442: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:20.253 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:19 smithi181 ceph-mon[25762]: pgmap v443: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:20.253 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:19 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:20.253 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:19 smithi181 ceph-mon[25762]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-1967-g4e50bbcd 2024-03-30T13:59:20.253 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:19 smithi181 ceph-mon[25762]: pgmap v444: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:20.253 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:19 smithi181 ceph-mon[25762]: pgmap v445: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:20.253 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:19 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:20.253 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:19 smithi181 ceph-mon[25762]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-1967-g4e50bbcd 2024-03-30T13:59:20.253 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:19 smithi181 ceph-mon[25762]: pgmap v446: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:20.253 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:19 smithi181 ceph-mon[25762]: pgmap v447: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:20.253 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:19 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:20.253 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:19 smithi181 ceph-mon[25762]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-1967-g4e50bbcd 2024-03-30T13:59:20.253 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:19 smithi181 ceph-mon[25762]: pgmap v448: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:20.253 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:19 smithi181 ceph-mon[25762]: pgmap v449: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:20.254 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:19 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:20.254 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:19 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:20.254 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:19 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:20.254 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:19 smithi181 ceph-mon[25762]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-1967-g4e50bbcd 2024-03-30T13:59:20.254 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:19 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:20.254 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:19 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:20.254 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:19 smithi181 ceph-mon[25762]: pgmap v450: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:20.254 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:19 smithi181 ceph-mon[25762]: pgmap v451: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:20.254 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:19 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:20.254 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:19 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:20.254 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:19 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:20.254 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:19 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:20.254 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:19 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:20.255 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:19 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:20.255 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:19 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:20.255 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:19 smithi181 ceph-mon[25762]: mgrmap e43: y(active, since 64s), standbys: x 2024-03-30T13:59:20.255 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:19 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:20.255 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:19 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:20.255 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:19 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:20.255 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:19 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:20.255 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:19 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:20.255 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:19 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:20.256 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:19 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:20.256 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:19 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:20.256 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:19 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:20.256 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:19 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:20.256 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:19 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:20.256 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:19 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:20.256 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:19 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:20.256 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:19 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:20.256 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:19 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:20.256 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:19 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:20.256 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:19 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:20.256 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:19 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:20.257 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:19 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:20.257 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:19 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:20.257 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:19 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:20.257 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:19 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:20.257 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:19 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:20.257 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:19 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:20.257 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:19 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:20.257 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:19 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:20.257 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:19 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:20.257 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:19 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:20.257 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:19 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:20.257 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:19 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:20.257 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:19 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:20.257 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:19 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:20.258 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:19 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:20.258 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:19 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:20.258 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:19 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:20.258 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:19 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:20.258 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:19 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:20.258 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:19 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:20.258 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:19 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:20.258 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:19 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:20.258 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:19 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:20.258 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:19 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:20.258 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:19 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:20.258 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:19 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:20.258 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:19 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:20.264 INFO:teuthology.orchestra.run.smithi099.stdout:true 2024-03-30T13:59:20.265 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:19 smithi099 ceph-mon[24912]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-1967-g4e50bbcd 2024-03-30T13:59:20.265 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:19 smithi099 ceph-mon[24912]: pgmap v428: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:20.265 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:19 smithi099 ceph-mon[24912]: pgmap v429: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:20.265 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:19 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:20.265 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:19 smithi099 ceph-mon[24912]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-1967-g4e50bbcd 2024-03-30T13:59:20.265 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:19 smithi099 ceph-mon[24912]: pgmap v430: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:20.265 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:19 smithi099 ceph-mon[24912]: pgmap v431: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:20.265 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:19 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:20.265 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:19 smithi099 ceph-mon[24912]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-1967-g4e50bbcd 2024-03-30T13:59:20.265 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:19 smithi099 ceph-mon[24912]: pgmap v432: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:20.266 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:19 smithi099 ceph-mon[24912]: pgmap v433: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:20.266 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:19 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:20.266 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:19 smithi099 ceph-mon[24912]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-1967-g4e50bbcd 2024-03-30T13:59:20.266 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:19 smithi099 ceph-mon[24912]: pgmap v434: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:20.266 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:19 smithi099 ceph-mon[24912]: pgmap v435: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:20.266 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:19 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:20.266 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:19 smithi099 ceph-mon[24912]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-1967-g4e50bbcd 2024-03-30T13:59:20.266 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:19 smithi099 ceph-mon[24912]: pgmap v436: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:20.266 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:19 smithi099 ceph-mon[24912]: pgmap v437: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:20.266 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:19 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:20.266 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:19 smithi099 ceph-mon[24912]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-1967-g4e50bbcd 2024-03-30T13:59:20.266 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:19 smithi099 ceph-mon[24912]: pgmap v438: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:20.266 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:19 smithi099 ceph-mon[24912]: pgmap v439: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:20.267 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:19 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:20.267 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:19 smithi099 ceph-mon[24912]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-1967-g4e50bbcd 2024-03-30T13:59:20.267 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:19 smithi099 ceph-mon[24912]: pgmap v440: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:20.267 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:19 smithi099 ceph-mon[24912]: pgmap v441: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:20.267 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:19 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:20.267 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:19 smithi099 ceph-mon[24912]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-1967-g4e50bbcd 2024-03-30T13:59:20.267 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:19 smithi099 ceph-mon[24912]: pgmap v442: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:20.267 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:19 smithi099 ceph-mon[24912]: pgmap v443: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:20.267 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:19 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:20.267 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:19 smithi099 ceph-mon[24912]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-1967-g4e50bbcd 2024-03-30T13:59:20.267 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:19 smithi099 ceph-mon[29691]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-1967-g4e50bbcd 2024-03-30T13:59:20.267 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:19 smithi099 ceph-mon[29691]: pgmap v428: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:20.268 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:19 smithi099 ceph-mon[29691]: pgmap v429: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:20.268 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:19 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:20.268 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:19 smithi099 ceph-mon[29691]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-1967-g4e50bbcd 2024-03-30T13:59:20.268 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:19 smithi099 ceph-mon[29691]: pgmap v430: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:20.268 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:19 smithi099 ceph-mon[29691]: pgmap v431: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:20.268 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:19 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:20.268 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:19 smithi099 ceph-mon[29691]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-1967-g4e50bbcd 2024-03-30T13:59:20.268 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:19 smithi099 ceph-mon[29691]: pgmap v432: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:20.268 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:19 smithi099 ceph-mon[29691]: pgmap v433: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:20.268 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:19 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:20.268 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:19 smithi099 ceph-mon[29691]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-1967-g4e50bbcd 2024-03-30T13:59:20.269 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:19 smithi099 ceph-mon[29691]: pgmap v434: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:20.269 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:19 smithi099 ceph-mon[29691]: pgmap v435: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:20.269 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:19 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:20.269 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:19 smithi099 ceph-mon[29691]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-1967-g4e50bbcd 2024-03-30T13:59:20.269 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:19 smithi099 ceph-mon[29691]: pgmap v436: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:20.269 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:19 smithi099 ceph-mon[29691]: pgmap v437: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:20.269 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:19 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:20.269 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:19 smithi099 ceph-mon[29691]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-1967-g4e50bbcd 2024-03-30T13:59:20.269 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:19 smithi099 ceph-mon[29691]: pgmap v438: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:20.269 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:19 smithi099 ceph-mon[29691]: pgmap v439: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:20.269 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:19 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:20.269 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:19 smithi099 ceph-mon[29691]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-1967-g4e50bbcd 2024-03-30T13:59:20.269 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:19 smithi099 ceph-mon[29691]: pgmap v440: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:20.269 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:19 smithi099 ceph-mon[29691]: pgmap v441: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:20.270 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:19 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:20.270 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:19 smithi099 ceph-mon[29691]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-1967-g4e50bbcd 2024-03-30T13:59:20.270 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:19 smithi099 ceph-mon[29691]: pgmap v442: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:20.270 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:19 smithi099 ceph-mon[29691]: pgmap v443: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:20.270 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:19 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:20.270 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:19 smithi099 ceph-mon[29691]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-1967-g4e50bbcd 2024-03-30T13:59:20.270 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:19 smithi099 ceph-mon[24912]: pgmap v444: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:20.270 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:19 smithi099 ceph-mon[24912]: pgmap v445: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:20.270 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:19 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:20.271 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:19 smithi099 ceph-mon[24912]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-1967-g4e50bbcd 2024-03-30T13:59:20.271 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:19 smithi099 ceph-mon[24912]: pgmap v446: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:20.271 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:19 smithi099 ceph-mon[24912]: pgmap v447: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:20.271 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:19 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:20.271 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:19 smithi099 ceph-mon[24912]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-1967-g4e50bbcd 2024-03-30T13:59:20.271 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:19 smithi099 ceph-mon[24912]: pgmap v448: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:20.271 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:19 smithi099 ceph-mon[24912]: pgmap v449: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:20.271 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:19 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:20.271 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:19 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:20.271 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:19 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:20.271 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:19 smithi099 ceph-mon[24912]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-1967-g4e50bbcd 2024-03-30T13:59:20.271 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:19 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:20.271 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:19 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:20.271 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:19 smithi099 ceph-mon[24912]: pgmap v450: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:20.271 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:19 smithi099 ceph-mon[24912]: pgmap v451: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:20.272 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:19 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:20.272 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:19 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:20.272 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:19 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:20.272 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:19 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:20.272 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:19 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:20.272 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:19 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:20.272 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:19 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:20.272 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:19 smithi099 ceph-mon[24912]: mgrmap e43: y(active, since 64s), standbys: x 2024-03-30T13:59:20.272 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:19 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:20.272 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:19 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:20.273 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:19 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:20.273 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:19 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:20.273 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:19 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:20.273 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:19 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:20.273 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:19 smithi099 ceph-mon[29691]: pgmap v444: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:20.273 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:19 smithi099 ceph-mon[29691]: pgmap v445: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:20.273 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:19 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:20.273 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:19 smithi099 ceph-mon[29691]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-1967-g4e50bbcd 2024-03-30T13:59:20.273 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:19 smithi099 ceph-mon[29691]: pgmap v446: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:20.273 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:19 smithi099 ceph-mon[29691]: pgmap v447: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:20.273 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:19 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:20.274 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:19 smithi099 ceph-mon[29691]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-1967-g4e50bbcd 2024-03-30T13:59:20.274 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:19 smithi099 ceph-mon[29691]: pgmap v448: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:20.274 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:19 smithi099 ceph-mon[29691]: pgmap v449: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:20.274 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:19 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:20.274 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:19 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:20.274 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:19 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:20.274 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:19 smithi099 ceph-mon[29691]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-1967-g4e50bbcd 2024-03-30T13:59:20.274 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:19 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:20.274 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:19 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:20.274 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:19 smithi099 ceph-mon[29691]: pgmap v450: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:20.275 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:19 smithi099 ceph-mon[29691]: pgmap v451: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:20.275 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:19 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:20.275 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:19 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:20.275 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:19 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:20.275 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:19 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:20.275 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:19 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:20.275 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:19 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:20.275 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:19 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:20.275 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:19 smithi099 ceph-mon[29691]: mgrmap e43: y(active, since 64s), standbys: x 2024-03-30T13:59:20.275 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:19 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:20.275 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:19 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:20.275 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:19 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:20.275 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:19 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:20.275 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:19 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:20.275 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:19 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:20.276 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:19 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:20.276 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:19 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:20.276 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:19 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:20.276 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:19 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:20.276 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:19 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:20.276 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:19 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:20.276 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:19 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:20.276 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:19 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:20.276 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:19 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:20.277 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:19 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:20.277 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:19 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:20.277 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:19 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:20.277 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:19 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:20.277 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:19 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:20.277 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:19 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:20.277 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:19 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:20.277 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:19 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:20.277 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:19 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:20.277 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:19 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:20.277 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:19 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:20.277 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:19 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:20.277 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:19 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:20.277 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:19 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:20.277 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:19 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:20.278 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:19 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:20.278 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:19 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:20.278 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:19 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:20.278 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:19 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:20.278 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:19 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:20.278 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:19 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:20.278 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:19 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:20.278 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:19 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:20.278 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:19 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:20.278 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:19 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:20.278 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:19 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:20.278 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:19 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:20.278 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:19 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:20.278 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:19 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:20.279 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:19 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:20.281 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:19 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:20.281 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:19 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:20.282 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:19 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:20.282 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:19 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:20.282 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:19 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:20.282 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:19 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:20.282 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:19 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:20.282 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:19 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:20.282 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:19 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:20.282 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:19 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:20.282 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:19 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:20.282 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:19 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:20.282 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:19 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:20.282 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:19 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:20.282 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:19 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:20.282 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:19 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:20.283 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:19 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:20.283 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:19 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:20.283 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:19 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:20.283 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:19 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:20.283 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:19 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:20.283 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:19 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:20.283 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:19 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:20.283 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:19 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:20.283 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:19 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:20.283 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:19 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:20.283 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:19 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:20.283 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:19 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:20.283 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:19 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:20.283 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:19 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:20.283 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:19 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:20.284 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:19 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:20.284 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:19 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:20.284 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:19 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:20.284 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:19 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:20.284 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:19 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:20.284 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:19 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:20.284 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:19 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:20.284 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:19 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:20.990 INFO:teuthology.orchestra.run.smithi099.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-03-30T13:59:20.990 INFO:teuthology.orchestra.run.smithi099.stdout:agent.smithi099 smithi099 running 15s ago 27m - - 2024-03-30T13:59:20.990 INFO:teuthology.orchestra.run.smithi099.stdout:agent.smithi181 smithi181 running 18s ago 27m - - 2024-03-30T13:59:20.990 INFO:teuthology.orchestra.run.smithi099.stdout:alertmanager.a smithi099 *:9093,9094 running (14m) 15s ago 21m 23.5M - 0.23.0 ba2b418f427c 0f1be3801027 2024-03-30T13:59:20.990 INFO:teuthology.orchestra.run.smithi099.stdout:grafana.a smithi181 *:3000 error 18s ago 21m - - 2024-03-30T13:59:20.990 INFO:teuthology.orchestra.run.smithi099.stdout:iscsi.foo.smithi099.qyjuvr smithi099 running (38s) 15s ago 20m 46.1M - 3.5 e1d6a67b021e 2f859af6bc2a 2024-03-30T13:59:20.990 INFO:teuthology.orchestra.run.smithi099.stdout:mgr.x smithi181 *:8443,9283,8765 starting - - - - 2024-03-30T13:59:20.990 INFO:teuthology.orchestra.run.smithi099.stdout:mgr.y smithi099 *:8443,9283,8765 running (10m) 15s ago 28m 507M - 19.0.0-1967-g4e50bbcd b0c4478f1d83 0d464b8c1d18 2024-03-30T13:59:20.991 INFO:teuthology.orchestra.run.smithi099.stdout:mon.a smithi099 running (28m) 15s ago 28m 98.8M 2048M 17.2.0 e1d6a67b021e af06ebb19fd8 2024-03-30T13:59:20.991 INFO:teuthology.orchestra.run.smithi099.stdout:mon.b smithi181 running (27m) 18s ago 27m 68.1M 2048M 17.2.0 e1d6a67b021e e678a2a25c90 2024-03-30T13:59:20.991 INFO:teuthology.orchestra.run.smithi099.stdout:mon.c smithi099 running (27m) 15s ago 27m 65.0M 2048M 17.2.0 e1d6a67b021e 0f1e98917718 2024-03-30T13:59:20.991 INFO:teuthology.orchestra.run.smithi099.stdout:node-exporter.a smithi099 *:9100 running (14m) 15s ago 22m 18.1M - 1.3.1 1dbe0e931976 76284405d5f5 2024-03-30T13:59:20.991 INFO:teuthology.orchestra.run.smithi099.stdout:node-exporter.b smithi181 *:9100 running (13m) 18s ago 22m 17.4M - 1.3.1 1dbe0e931976 90245951476f 2024-03-30T13:59:20.991 INFO:teuthology.orchestra.run.smithi099.stdout:osd.0 smithi099 running (26m) 15s ago 26m 54.6M 4096M 17.2.0 e1d6a67b021e 3158ee1b0c67 2024-03-30T13:59:20.991 INFO:teuthology.orchestra.run.smithi099.stdout:osd.1 smithi099 running (26m) 15s ago 26m 57.7M 4096M 17.2.0 e1d6a67b021e c4af0fd7071a 2024-03-30T13:59:20.991 INFO:teuthology.orchestra.run.smithi099.stdout:osd.2 smithi099 running (25m) 15s ago 25m 49.6M 4096M 17.2.0 e1d6a67b021e 8e4e805a7e20 2024-03-30T13:59:20.991 INFO:teuthology.orchestra.run.smithi099.stdout:osd.3 smithi099 running (25m) 15s ago 25m 53.7M 4096M 17.2.0 e1d6a67b021e 718812bcf065 2024-03-30T13:59:20.991 INFO:teuthology.orchestra.run.smithi099.stdout:osd.4 smithi181 running (24m) 18s ago 24m 55.3M 4096M 17.2.0 e1d6a67b021e 5e205434e973 2024-03-30T13:59:20.991 INFO:teuthology.orchestra.run.smithi099.stdout:osd.5 smithi181 running (24m) 18s ago 24m 52.9M 4096M 17.2.0 e1d6a67b021e e330c920f152 2024-03-30T13:59:20.991 INFO:teuthology.orchestra.run.smithi099.stdout:osd.6 smithi181 running (24m) 18s ago 24m 52.1M 4096M 17.2.0 e1d6a67b021e 81d889ea213d 2024-03-30T13:59:20.991 INFO:teuthology.orchestra.run.smithi099.stdout:osd.7 smithi181 running (23m) 18s ago 23m 53.0M 4096M 17.2.0 e1d6a67b021e c08b1839dd7e 2024-03-30T13:59:20.991 INFO:teuthology.orchestra.run.smithi099.stdout:prometheus.a smithi181 *:9095 running (51s) 18s ago 23m 59.7M - 2.33.4 514e6a882f6e 6b662de21f27 2024-03-30T13:59:20.992 INFO:teuthology.orchestra.run.smithi099.stdout:rgw.foo.smithi099.fxjbmp smithi099 *:8000 running (21m) 15s ago 21m 75.9M - 17.2.0 e1d6a67b021e 400b28b3f650 2024-03-30T13:59:20.992 INFO:teuthology.orchestra.run.smithi099.stdout:rgw.foo.smithi181.wfqwti smithi181 *:8000 running (21m) 18s ago 21m 75.7M - 17.2.0 e1d6a67b021e 97e1b130f9d4 2024-03-30T13:59:21.189 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:20 smithi181 ceph-mon[25762]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-1967-g4e50bbcd 2024-03-30T13:59:21.190 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:20 smithi181 ceph-mon[25762]: pgmap v452: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:21.190 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:20 smithi181 ceph-mon[25762]: pgmap v453: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:21.190 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:20 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:21.190 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:20 smithi181 ceph-mon[25762]: pgmap v454: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:21.190 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:20 smithi181 ceph-mon[25762]: pgmap v455: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:21.190 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:20 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:21.190 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:20 smithi181 ceph-mon[25762]: pgmap v456: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:21.190 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:20 smithi181 ceph-mon[25762]: pgmap v457: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:21.190 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:20 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:21.190 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:20 smithi181 ceph-mon[25762]: pgmap v458: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:21.190 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:20 smithi181 ceph-mon[25762]: pgmap v459: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:21.190 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:20 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:21.190 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:20 smithi181 ceph-mon[25762]: pgmap v460: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:21.191 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:20 smithi181 ceph-mon[25762]: pgmap v461: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:21.191 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:20 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:21.191 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:20 smithi181 ceph-mon[25762]: pgmap v462: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:21.191 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:20 smithi181 ceph-mon[25762]: pgmap v463: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:21.191 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:20 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:21.191 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:20 smithi181 ceph-mon[25762]: pgmap v464: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:21.191 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:20 smithi181 ceph-mon[25762]: pgmap v465: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:21.191 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:20 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:21.191 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:20 smithi181 ceph-mon[25762]: pgmap v466: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:21.191 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:20 smithi181 ceph-mon[25762]: pgmap v467: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:21.191 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:20 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:21.191 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:20 smithi181 ceph-mon[25762]: pgmap v468: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:21.191 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:20 smithi181 ceph-mon[25762]: pgmap v469: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:21.191 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:20 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:21.191 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:20 smithi181 ceph-mon[25762]: pgmap v470: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:21.192 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:20 smithi181 ceph-mon[25762]: pgmap v471: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:21.192 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:20 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:21.192 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:20 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:21.192 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:20 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:21.192 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:20 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:21.192 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:20 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:21.192 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:20 smithi181 ceph-mon[25762]: pgmap v472: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:21.192 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:20 smithi181 ceph-mon[25762]: pgmap v473: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:21.192 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:20 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:21.192 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:20 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:21.192 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:20 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:21.192 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:20 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:21.192 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:20 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:21.192 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:20 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:21.193 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:20 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:21.193 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:20 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:21.193 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:20 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:21.193 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:20 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:21.193 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:20 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:21.193 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:20 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:21.193 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:20 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:21.193 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:20 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:21.193 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:20 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:21.193 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:20 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:21.193 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:20 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:21.193 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:20 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:21.193 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:20 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:21.193 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:20 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:21.193 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:20 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:21.194 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:20 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:21.194 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:20 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:21.194 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:20 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:21.194 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:20 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:21.194 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:20 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:21.194 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:20 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:21.194 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:20 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:21.194 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:20 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:21.194 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:20 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:21.194 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:20 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:21.194 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:20 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:21.194 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:20 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:21.194 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:20 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:21.194 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:20 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:21.195 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:20 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:21.195 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:20 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:21.195 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:20 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:21.195 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:20 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:21.195 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:20 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:21.195 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:20 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:21.195 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:20 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:21.195 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:20 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:21.195 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:20 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:21.195 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:20 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:21.195 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:20 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:21.195 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:20 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:21.222 INFO:journalctl@ceph.alertmanager.a.smithi099.stdout:Mar 30 13:59:20 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-alertmanager-a[64884]: level=info ts=2024-03-30T13:59:20.901Z caller=notify.go:735 component=dispatcher receiver=ceph-dashboard integration=webhook[0] msg="Notify success" attempts=6 2024-03-30T13:59:21.222 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:20 smithi099 ceph-mon[29691]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-1967-g4e50bbcd 2024-03-30T13:59:21.223 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:20 smithi099 ceph-mon[29691]: pgmap v452: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:21.223 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:20 smithi099 ceph-mon[29691]: pgmap v453: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:21.223 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:20 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:21.223 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:20 smithi099 ceph-mon[29691]: pgmap v454: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:21.223 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:20 smithi099 ceph-mon[29691]: pgmap v455: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:21.223 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:20 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:21.223 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:20 smithi099 ceph-mon[29691]: pgmap v456: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:21.223 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:20 smithi099 ceph-mon[29691]: pgmap v457: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:21.223 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:20 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:21.223 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:20 smithi099 ceph-mon[29691]: pgmap v458: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:21.223 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:20 smithi099 ceph-mon[29691]: pgmap v459: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:21.224 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:20 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:21.224 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:20 smithi099 ceph-mon[29691]: pgmap v460: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:21.224 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:20 smithi099 ceph-mon[29691]: pgmap v461: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:21.224 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:20 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:21.224 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:20 smithi099 ceph-mon[29691]: pgmap v462: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:21.224 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:20 smithi099 ceph-mon[29691]: pgmap v463: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:21.224 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:20 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:21.224 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:20 smithi099 ceph-mon[29691]: pgmap v464: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:21.224 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:20 smithi099 ceph-mon[29691]: pgmap v465: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:21.224 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:20 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:21.224 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:20 smithi099 ceph-mon[29691]: pgmap v466: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:21.224 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:20 smithi099 ceph-mon[29691]: pgmap v467: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:21.224 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:20 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:21.224 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:20 smithi099 ceph-mon[29691]: pgmap v468: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:21.224 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:20 smithi099 ceph-mon[29691]: pgmap v469: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:21.225 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:20 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:21.225 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:20 smithi099 ceph-mon[29691]: pgmap v470: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:21.225 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:20 smithi099 ceph-mon[29691]: pgmap v471: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:21.225 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:20 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:21.225 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:20 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:21.225 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:20 smithi099 ceph-mon[24912]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-1967-g4e50bbcd 2024-03-30T13:59:21.225 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:20 smithi099 ceph-mon[24912]: pgmap v452: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:21.225 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:20 smithi099 ceph-mon[24912]: pgmap v453: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:21.226 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:20 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:21.226 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:20 smithi099 ceph-mon[24912]: pgmap v454: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:21.226 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:20 smithi099 ceph-mon[24912]: pgmap v455: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:21.226 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:20 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:21.226 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:20 smithi099 ceph-mon[24912]: pgmap v456: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:21.226 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:20 smithi099 ceph-mon[24912]: pgmap v457: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:21.226 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:20 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:21.226 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:20 smithi099 ceph-mon[24912]: pgmap v458: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:21.226 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:20 smithi099 ceph-mon[24912]: pgmap v459: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:21.226 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:20 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:21.226 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:20 smithi099 ceph-mon[24912]: pgmap v460: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:21.227 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:20 smithi099 ceph-mon[24912]: pgmap v461: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:21.227 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:20 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:21.227 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:20 smithi099 ceph-mon[24912]: pgmap v462: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:21.227 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:20 smithi099 ceph-mon[24912]: pgmap v463: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:21.227 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:20 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:21.227 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:20 smithi099 ceph-mon[24912]: pgmap v464: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:21.227 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:20 smithi099 ceph-mon[24912]: pgmap v465: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:21.227 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:20 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:21.227 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:20 smithi099 ceph-mon[24912]: pgmap v466: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:21.227 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:20 smithi099 ceph-mon[24912]: pgmap v467: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:21.227 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:20 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:21.228 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:20 smithi099 ceph-mon[24912]: pgmap v468: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:21.228 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:20 smithi099 ceph-mon[24912]: pgmap v469: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:21.228 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:20 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:21.228 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:20 smithi099 ceph-mon[24912]: pgmap v470: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:21.228 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:20 smithi099 ceph-mon[24912]: pgmap v471: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:21.228 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:20 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:21.228 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:20 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:21.228 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:20 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:21.229 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:20 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:21.229 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:20 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:21.229 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:20 smithi099 ceph-mon[29691]: pgmap v472: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:21.229 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:20 smithi099 ceph-mon[29691]: pgmap v473: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:21.229 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:20 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:21.229 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:20 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:21.229 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:20 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:21.229 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:20 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:21.229 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:20 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:21.229 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:20 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:21.229 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:20 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:21.229 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:20 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:21.230 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:20 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:21.230 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:20 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:21.230 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:20 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:21.230 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:20 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:21.230 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:20 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:21.230 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:20 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:21.230 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:20 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:21.230 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:20 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:21.230 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:20 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:21.230 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:20 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:21.230 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:20 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:21.230 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:20 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:21.231 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:20 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:21.231 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:20 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:21.231 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:20 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:21.231 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:20 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:21.231 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:20 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:21.231 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:20 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:21.231 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:20 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:21.231 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:20 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:21.231 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:20 smithi099 ceph-mon[24912]: pgmap v472: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:21.232 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:20 smithi099 ceph-mon[24912]: pgmap v473: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:21.232 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:20 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:21.232 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:20 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:21.232 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:20 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:21.232 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:20 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:21.232 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:20 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:21.232 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:20 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:21.232 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:20 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:21.232 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:20 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:21.232 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:20 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:21.232 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:20 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:21.232 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:20 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:21.233 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:20 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:21.233 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:20 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:21.233 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:20 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:21.233 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:20 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:21.233 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:20 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:21.233 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:20 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:21.233 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:20 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:21.233 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:20 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:21.233 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:20 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:21.233 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:20 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:21.233 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:20 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:21.233 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:20 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:21.234 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:20 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:21.234 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:20 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:21.234 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:20 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:21.234 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:20 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:21.234 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:20 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:21.234 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:20 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:21.235 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:20 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:21.235 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:20 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:21.235 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:20 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:21.235 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:20 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:21.235 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:20 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:21.235 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:20 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:21.235 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:20 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:21.235 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:20 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:21.235 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:20 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:21.235 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:20 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:21.235 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:20 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:21.235 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:20 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:21.236 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:20 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:21.236 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:20 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:21.236 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:20 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:21.236 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:20 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:21.236 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:20 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:21.236 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:20 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:21.236 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:20 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:21.236 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:20 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:21.236 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:20 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:21.237 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:20 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:21.237 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:20 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:21.237 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:20 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:21.237 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:20 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:21.237 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:20 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:21.237 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:20 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:21.237 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:20 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:21.237 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:20 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:21.237 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:20 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:21.237 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:20 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:21.237 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:20 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:21.238 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:20 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:21.238 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:20 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:21.238 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:20 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:21.238 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:20 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:21.238 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:20 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:21.238 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:20 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:21.238 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:20 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:21.238 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:20 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:21.457 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-03-30T13:59:21.457 INFO:teuthology.orchestra.run.smithi099.stdout: "mon": { 2024-03-30T13:59:21.457 INFO:teuthology.orchestra.run.smithi099.stdout: "ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)": 3 2024-03-30T13:59:21.457 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:59:21.457 INFO:teuthology.orchestra.run.smithi099.stdout: "mgr": { 2024-03-30T13:59:21.457 INFO:teuthology.orchestra.run.smithi099.stdout: "ceph version 19.0.0-1967-g4e50bbcd (4e50bbcdd1630c7760b708f3a5b4d38a121e66cb) squid (dev)": 2 2024-03-30T13:59:21.458 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:59:21.458 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": { 2024-03-30T13:59:21.458 INFO:teuthology.orchestra.run.smithi099.stdout: "ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)": 8 2024-03-30T13:59:21.458 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:59:21.458 INFO:teuthology.orchestra.run.smithi099.stdout: "mds": {}, 2024-03-30T13:59:21.458 INFO:teuthology.orchestra.run.smithi099.stdout: "rgw": { 2024-03-30T13:59:21.458 INFO:teuthology.orchestra.run.smithi099.stdout: "ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)": 2 2024-03-30T13:59:21.458 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:59:21.458 INFO:teuthology.orchestra.run.smithi099.stdout: "overall": { 2024-03-30T13:59:21.458 INFO:teuthology.orchestra.run.smithi099.stdout: "ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)": 13, 2024-03-30T13:59:21.458 INFO:teuthology.orchestra.run.smithi099.stdout: "ceph version 19.0.0-1967-g4e50bbcd (4e50bbcdd1630c7760b708f3a5b4d38a121e66cb) squid (dev)": 2 2024-03-30T13:59:21.458 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-03-30T13:59:21.458 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-03-30T13:59:21.852 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-03-30T13:59:21.852 INFO:teuthology.orchestra.run.smithi099.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph:4e50bbcdd1630c7760b708f3a5b4d38a121e66cb", 2024-03-30T13:59:21.853 INFO:teuthology.orchestra.run.smithi099.stdout: "in_progress": true, 2024-03-30T13:59:21.853 INFO:teuthology.orchestra.run.smithi099.stdout: "which": "Upgrading daemons of type(s) mgr", 2024-03-30T13:59:21.853 INFO:teuthology.orchestra.run.smithi099.stdout: "services_complete": [], 2024-03-30T13:59:21.853 INFO:teuthology.orchestra.run.smithi099.stdout: "progress": "", 2024-03-30T13:59:21.853 INFO:teuthology.orchestra.run.smithi099.stdout: "message": "Currently upgrading mgr daemons", 2024-03-30T13:59:21.853 INFO:teuthology.orchestra.run.smithi099.stdout: "is_paused": false 2024-03-30T13:59:21.853 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-03-30T13:59:22.081 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:21 smithi099 ceph-mon[24912]: pgmap v474: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:22.082 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:21 smithi099 ceph-mon[24912]: pgmap v475: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:22.082 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:21 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:22.082 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:21 smithi099 ceph-mon[24912]: pgmap v476: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:22.082 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:21 smithi099 ceph-mon[24912]: pgmap v477: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:22.082 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:21 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:22.082 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:21 smithi099 ceph-mon[24912]: pgmap v478: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:22.082 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:21 smithi099 ceph-mon[24912]: pgmap v479: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:22.082 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:21 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:22.082 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:21 smithi099 ceph-mon[24912]: from='client.25438 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T13:59:22.082 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:21 smithi099 ceph-mon[24912]: pgmap v480: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:22.082 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:21 smithi099 ceph-mon[24912]: pgmap v481: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:22.082 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:21 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:22.082 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:21 smithi099 ceph-mon[24912]: pgmap v482: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:22.082 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:21 smithi099 ceph-mon[24912]: pgmap v483: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:22.083 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:21 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:22.083 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:21 smithi099 ceph-mon[24912]: pgmap v484: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:22.083 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:21 smithi099 ceph-mon[24912]: pgmap v485: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:22.083 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:21 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:22.083 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:21 smithi099 ceph-mon[24912]: from='client.25444 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T13:59:22.083 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:21 smithi099 ceph-mon[24912]: pgmap v486: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:22.083 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:21 smithi099 ceph-mon[24912]: pgmap v487: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:22.083 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:21 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:22.083 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:21 smithi099 ceph-mon[24912]: pgmap v488: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:22.083 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:21 smithi099 ceph-mon[24912]: pgmap v489: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:22.083 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:21 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:22.083 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:21 smithi099 ceph-mon[24912]: pgmap v490: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:22.083 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:21 smithi099 ceph-mon[24912]: pgmap v491: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:22.083 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:21 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:22.083 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:21 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:22.084 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:21 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:22.084 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:21 smithi099 ceph-mon[29691]: pgmap v474: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:22.084 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:21 smithi099 ceph-mon[29691]: pgmap v475: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:22.084 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:21 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:22.084 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:21 smithi099 ceph-mon[29691]: pgmap v476: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:22.084 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:21 smithi099 ceph-mon[29691]: pgmap v477: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:22.084 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:21 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:22.084 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:21 smithi099 ceph-mon[29691]: pgmap v478: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:22.084 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:21 smithi099 ceph-mon[29691]: pgmap v479: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:22.085 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:21 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:22.085 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:21 smithi099 ceph-mon[29691]: from='client.25438 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T13:59:22.085 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:21 smithi099 ceph-mon[29691]: pgmap v480: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:22.085 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:21 smithi099 ceph-mon[29691]: pgmap v481: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:22.085 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:21 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:22.085 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:21 smithi099 ceph-mon[29691]: pgmap v482: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:22.085 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:21 smithi099 ceph-mon[29691]: pgmap v483: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:22.085 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:21 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:22.085 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:21 smithi099 ceph-mon[29691]: pgmap v484: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:22.085 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:21 smithi099 ceph-mon[29691]: pgmap v485: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:22.085 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:21 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:22.085 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:21 smithi099 ceph-mon[29691]: from='client.25444 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T13:59:22.085 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:21 smithi099 ceph-mon[29691]: pgmap v486: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:22.085 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:21 smithi099 ceph-mon[29691]: pgmap v487: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:22.085 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:21 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:22.085 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:21 smithi099 ceph-mon[29691]: pgmap v488: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:22.086 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:21 smithi099 ceph-mon[29691]: pgmap v489: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:22.086 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:21 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:22.086 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:21 smithi099 ceph-mon[29691]: pgmap v490: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:22.086 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:21 smithi099 ceph-mon[29691]: pgmap v491: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:22.086 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:21 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:22.086 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:21 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:22.086 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:21 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:22.086 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:21 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:22.086 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:21 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:22.086 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:21 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:22.086 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:21 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:22.086 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:21 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:22.086 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:21 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:22.086 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:21 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:22.086 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:21 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:22.087 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:21 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:22.087 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:21 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:22.087 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:21 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:22.087 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:21 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:22.087 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:21 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:22.087 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:21 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:22.087 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:21 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:22.087 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:21 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:22.087 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:21 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:22.087 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:21 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:22.087 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:21 smithi099 ceph-mon[29691]: from='client.? 172.21.15.99:0/3117067693' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:22.087 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:21 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:22.087 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:21 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:22.087 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:21 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:22.087 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:21 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:22.087 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:21 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:22.088 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:21 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:22.088 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:21 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:22.088 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:21 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:22.088 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:21 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:22.088 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:21 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:22.088 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:21 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:22.088 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:21 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:22.088 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:21 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:22.088 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:21 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:22.088 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:21 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:22.088 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:21 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:22.089 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:21 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:22.089 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:21 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:22.089 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:21 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:22.089 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:21 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:22.089 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:21 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:22.089 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:21 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:22.089 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:21 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:22.089 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:21 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:22.089 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:21 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:22.089 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:21 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:22.089 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:21 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:22.089 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:21 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:22.089 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:21 smithi099 ceph-mon[24912]: from='client.? 172.21.15.99:0/3117067693' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:22.089 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:21 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:22.089 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:21 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:22.090 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:21 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:22.090 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:21 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:22.090 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:21 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:22.090 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:21 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:22.090 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:21 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:22.090 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:21 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:22.090 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:21 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:22.090 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:21 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:22.090 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:21 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:22.090 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:21 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:22.090 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:21 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:22.090 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:21 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:22.091 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:21 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:22.091 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:21 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:22.091 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:21 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:22.091 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:21 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:22.091 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:21 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:22.091 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:21 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:22.091 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:21 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:22.091 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:21 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:22.092 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:21 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:22.092 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:21 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:22.092 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:21 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:22.092 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:21 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:22.092 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:21 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:22.092 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:21 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:22.092 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:21 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:22.092 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:21 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:22.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:21 smithi181 ceph-mon[25762]: pgmap v474: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:22.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:21 smithi181 ceph-mon[25762]: pgmap v475: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:22.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:21 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:22.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:21 smithi181 ceph-mon[25762]: pgmap v476: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:22.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:21 smithi181 ceph-mon[25762]: pgmap v477: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:22.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:21 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:22.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:21 smithi181 ceph-mon[25762]: pgmap v478: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:22.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:21 smithi181 ceph-mon[25762]: pgmap v479: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:22.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:21 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:22.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:21 smithi181 ceph-mon[25762]: from='client.25438 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T13:59:22.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:21 smithi181 ceph-mon[25762]: pgmap v480: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:22.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:21 smithi181 ceph-mon[25762]: pgmap v481: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:22.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:21 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:22.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:21 smithi181 ceph-mon[25762]: pgmap v482: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:22.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:21 smithi181 ceph-mon[25762]: pgmap v483: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:22.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:21 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:22.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:21 smithi181 ceph-mon[25762]: pgmap v484: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:22.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:21 smithi181 ceph-mon[25762]: pgmap v485: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:22.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:21 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:22.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:21 smithi181 ceph-mon[25762]: from='client.25444 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T13:59:22.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:21 smithi181 ceph-mon[25762]: pgmap v486: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:22.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:21 smithi181 ceph-mon[25762]: pgmap v487: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:22.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:21 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:22.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:21 smithi181 ceph-mon[25762]: pgmap v488: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:22.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:21 smithi181 ceph-mon[25762]: pgmap v489: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:22.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:21 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:22.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:21 smithi181 ceph-mon[25762]: pgmap v490: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:22.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:21 smithi181 ceph-mon[25762]: pgmap v491: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:22.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:21 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:22.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:21 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:22.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:21 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:22.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:21 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:22.253 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:21 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:22.253 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:21 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:22.253 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:21 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:22.253 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:21 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:22.253 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:21 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:22.253 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:21 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:22.253 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:21 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:22.253 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:21 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:22.253 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:21 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:22.253 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:21 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:22.253 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:21 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:22.253 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:21 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:22.253 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:21 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:22.253 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:21 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:22.253 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:21 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:22.254 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:21 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:22.254 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:21 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:22.254 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:21 smithi181 ceph-mon[25762]: from='client.? 172.21.15.99:0/3117067693' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:22.254 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:21 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:22.254 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:21 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:22.254 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:21 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:22.254 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:21 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:22.254 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:21 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:22.254 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:21 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:22.254 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:21 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:22.254 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:21 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:22.254 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:21 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:22.254 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:21 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:22.254 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:21 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:22.255 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:21 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:22.255 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:21 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:22.255 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:21 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:22.255 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:21 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:22.255 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:21 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:22.255 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:21 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:22.255 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:21 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:22.255 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:21 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:22.255 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:21 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:23.081 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:22 smithi099 ceph-mon[24912]: pgmap v492: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:23.081 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:22 smithi099 ceph-mon[24912]: pgmap v493: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:23.081 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:22 smithi099 ceph-mon[24912]: from='client.25450 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T13:59:23.081 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:22 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:23.081 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:22 smithi099 ceph-mon[24912]: pgmap v494: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:23.082 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:22 smithi099 ceph-mon[24912]: pgmap v495: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:23.082 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:22 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:23.082 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:22 smithi099 ceph-mon[24912]: pgmap v496: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:23.082 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:22 smithi099 ceph-mon[24912]: pgmap v497: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:23.082 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:22 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:23.082 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:22 smithi099 ceph-mon[24912]: pgmap v498: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:23.082 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:22 smithi099 ceph-mon[24912]: pgmap v499: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:23.082 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:22 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:23.082 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:22 smithi099 ceph-mon[24912]: pgmap v500: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:23.082 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:22 smithi099 ceph-mon[24912]: pgmap v501: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:23.082 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:22 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:23.082 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:22 smithi099 ceph-mon[24912]: pgmap v502: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 11 KiB/s rd, 11 op/s 2024-03-30T13:59:23.082 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:22 smithi099 ceph-mon[24912]: pgmap v503: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 11 KiB/s rd, 11 op/s 2024-03-30T13:59:23.082 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:22 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:23.082 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:22 smithi099 ceph-mon[24912]: pgmap v504: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 13 KiB/s rd, 12 op/s 2024-03-30T13:59:23.083 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:22 smithi099 ceph-mon[24912]: pgmap v505: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 13 KiB/s rd, 12 op/s 2024-03-30T13:59:23.083 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:22 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:23.083 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:22 smithi099 ceph-mon[24912]: from='client.15570 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T13:59:23.083 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:22 smithi099 ceph-mon[24912]: pgmap v506: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 13 KiB/s rd, 12 op/s 2024-03-30T13:59:23.083 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:22 smithi099 ceph-mon[24912]: pgmap v507: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 13 KiB/s rd, 12 op/s 2024-03-30T13:59:23.083 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:22 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:23.083 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:22 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:23.083 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:22 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:23.083 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:22 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:23.083 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:22 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:23.083 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:22 smithi099 ceph-mon[29691]: pgmap v492: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:23.084 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:22 smithi099 ceph-mon[29691]: pgmap v493: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:23.084 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:22 smithi099 ceph-mon[29691]: from='client.25450 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T13:59:23.084 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:22 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:23.084 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:22 smithi099 ceph-mon[29691]: pgmap v494: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:23.084 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:22 smithi099 ceph-mon[29691]: pgmap v495: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:23.084 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:22 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:23.084 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:22 smithi099 ceph-mon[29691]: pgmap v496: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:23.084 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:22 smithi099 ceph-mon[29691]: pgmap v497: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:23.084 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:22 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:23.084 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:22 smithi099 ceph-mon[29691]: pgmap v498: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:23.084 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:22 smithi099 ceph-mon[29691]: pgmap v499: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:23.084 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:22 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:23.084 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:22 smithi099 ceph-mon[29691]: pgmap v500: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:23.084 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:22 smithi099 ceph-mon[29691]: pgmap v501: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:23.085 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:22 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:23.085 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:22 smithi099 ceph-mon[29691]: pgmap v502: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 11 KiB/s rd, 11 op/s 2024-03-30T13:59:23.085 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:22 smithi099 ceph-mon[29691]: pgmap v503: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 11 KiB/s rd, 11 op/s 2024-03-30T13:59:23.085 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:22 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:23.085 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:22 smithi099 ceph-mon[29691]: pgmap v504: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 13 KiB/s rd, 12 op/s 2024-03-30T13:59:23.085 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:22 smithi099 ceph-mon[29691]: pgmap v505: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 13 KiB/s rd, 12 op/s 2024-03-30T13:59:23.085 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:22 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:23.085 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:22 smithi099 ceph-mon[29691]: from='client.15570 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T13:59:23.085 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:22 smithi099 ceph-mon[29691]: pgmap v506: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 13 KiB/s rd, 12 op/s 2024-03-30T13:59:23.085 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:22 smithi099 ceph-mon[29691]: pgmap v507: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 13 KiB/s rd, 12 op/s 2024-03-30T13:59:23.085 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:22 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:23.085 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:22 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:23.085 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:22 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:23.085 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:22 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:23.086 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:22 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:23.086 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:22 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:23.086 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:22 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:23.086 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:22 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:23.086 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:22 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:23.086 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:22 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:23.087 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:22 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:23.087 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:22 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:23.087 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:22 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:23.087 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:22 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:23.087 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:22 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:23.087 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:22 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:23.087 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:22 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:23.087 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:22 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:23.087 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:22 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:23.087 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:22 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:23.087 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:22 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:23.087 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:22 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:23.087 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:22 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:23.087 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:22 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:23.088 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:22 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:23.088 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:22 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:23.088 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:22 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:23.088 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:22 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:23.088 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:22 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:23.088 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:22 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:23.088 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:22 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:23.088 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:22 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:23.088 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:22 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:23.088 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:22 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:23.088 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:22 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:23.088 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:22 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:23.088 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:22 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:23.088 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:22 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:23.088 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:22 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:23.089 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:22 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:23.089 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:22 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:23.089 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:22 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:23.089 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:22 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:23.089 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:22 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:23.089 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:22 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:23.089 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:22 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:23.089 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:22 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:23.089 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:22 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:23.089 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:22 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:23.090 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:22 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:23.090 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:22 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:23.090 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:22 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:23.090 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:22 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:23.090 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:22 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:23.090 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:22 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:23.090 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:22 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:23.090 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:22 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:23.090 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:22 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:23.090 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:22 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:23.090 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:22 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:23.090 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:22 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:23.090 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:22 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:23.090 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:22 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:23.091 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:22 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:23.091 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:22 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:23.091 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:22 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:23.091 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:22 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:23.091 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:22 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:23.091 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:22 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:23.091 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:22 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:23.091 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:22 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:23.091 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:22 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:23.091 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:22 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:23.091 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:22 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:23.091 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:22 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:23.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:22 smithi181 ceph-mon[25762]: pgmap v492: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:23.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:22 smithi181 ceph-mon[25762]: pgmap v493: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:23.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:22 smithi181 ceph-mon[25762]: from='client.25450 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T13:59:23.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:22 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:23.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:22 smithi181 ceph-mon[25762]: pgmap v494: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:23.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:22 smithi181 ceph-mon[25762]: pgmap v495: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:23.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:22 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:23.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:22 smithi181 ceph-mon[25762]: pgmap v496: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:23.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:22 smithi181 ceph-mon[25762]: pgmap v497: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:23.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:22 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:23.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:22 smithi181 ceph-mon[25762]: pgmap v498: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:23.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:22 smithi181 ceph-mon[25762]: pgmap v499: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:23.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:22 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:23.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:22 smithi181 ceph-mon[25762]: pgmap v500: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:23.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:22 smithi181 ceph-mon[25762]: pgmap v501: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:23.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:22 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:23.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:22 smithi181 ceph-mon[25762]: pgmap v502: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 11 KiB/s rd, 11 op/s 2024-03-30T13:59:23.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:22 smithi181 ceph-mon[25762]: pgmap v503: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 11 KiB/s rd, 11 op/s 2024-03-30T13:59:23.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:22 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:23.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:22 smithi181 ceph-mon[25762]: pgmap v504: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 13 KiB/s rd, 12 op/s 2024-03-30T13:59:23.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:22 smithi181 ceph-mon[25762]: pgmap v505: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 13 KiB/s rd, 12 op/s 2024-03-30T13:59:23.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:22 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:23.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:22 smithi181 ceph-mon[25762]: from='client.15570 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T13:59:23.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:22 smithi181 ceph-mon[25762]: pgmap v506: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 13 KiB/s rd, 12 op/s 2024-03-30T13:59:23.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:22 smithi181 ceph-mon[25762]: pgmap v507: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 13 KiB/s rd, 12 op/s 2024-03-30T13:59:23.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:22 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:23.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:22 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:23.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:22 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:23.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:22 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:23.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:22 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:23.253 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:22 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:23.253 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:22 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:23.253 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:22 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:23.253 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:22 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:23.253 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:22 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:23.253 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:22 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:23.253 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:22 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:23.253 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:22 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:23.253 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:22 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:23.253 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:22 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:23.253 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:22 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:23.253 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:22 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:23.253 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:22 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:23.253 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:22 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:23.253 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:22 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:23.254 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:22 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:23.254 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:22 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:23.254 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:22 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:23.254 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:22 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:23.254 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:22 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:23.254 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:22 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:23.254 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:22 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:23.254 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:22 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:23.254 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:22 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:23.254 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:22 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:23.254 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:22 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:23.254 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:22 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:23.254 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:22 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:23.255 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:22 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:23.255 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:22 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:23.255 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:22 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:23.255 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:22 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:23.255 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:22 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:23.255 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:22 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:23.255 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:22 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:24.167 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:23 smithi181 ceph-mon[25762]: pgmap v508: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:24.167 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:23 smithi181 ceph-mon[25762]: pgmap v509: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:24.167 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:23 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:24.167 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:23 smithi181 ceph-mon[25762]: pgmap v510: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:24.167 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:23 smithi181 ceph-mon[25762]: pgmap v511: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:24.167 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:23 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:24.167 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:23 smithi181 ceph-mon[25762]: pgmap v512: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:24.167 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:23 smithi181 ceph-mon[25762]: pgmap v513: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:24.167 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:23 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:24.167 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:23 smithi181 ceph-mon[25762]: pgmap v514: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:24.167 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:23 smithi181 ceph-mon[25762]: pgmap v515: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:24.167 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:23 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:24.167 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:23 smithi181 ceph-mon[25762]: pgmap v516: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:24.168 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:23 smithi181 ceph-mon[25762]: pgmap v517: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:24.168 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:23 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:24.168 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:23 smithi181 ceph-mon[25762]: pgmap v518: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:24.168 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:23 smithi181 ceph-mon[25762]: pgmap v519: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:24.168 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:23 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:24.168 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:23 smithi181 ceph-mon[25762]: pgmap v520: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:24.168 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:23 smithi181 ceph-mon[25762]: pgmap v521: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:24.168 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:23 smithi181 ceph-mon[25762]: pgmap v522: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:24.168 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:23 smithi181 ceph-mon[25762]: pgmap v523: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:24.331 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:23 smithi099 ceph-mon[29691]: pgmap v508: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:24.331 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:23 smithi099 ceph-mon[29691]: pgmap v509: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:24.331 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:23 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:24.331 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:23 smithi099 ceph-mon[29691]: pgmap v510: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:24.331 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:23 smithi099 ceph-mon[29691]: pgmap v511: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:24.332 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:23 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:24.332 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:23 smithi099 ceph-mon[29691]: pgmap v512: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:24.332 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:23 smithi099 ceph-mon[29691]: pgmap v513: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:24.332 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:23 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:24.332 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:23 smithi099 ceph-mon[29691]: pgmap v514: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:24.332 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:23 smithi099 ceph-mon[29691]: pgmap v515: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:24.332 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:23 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:24.332 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:23 smithi099 ceph-mon[29691]: pgmap v516: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:24.332 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:23 smithi099 ceph-mon[29691]: pgmap v517: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:24.332 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:23 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:24.332 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:23 smithi099 ceph-mon[29691]: pgmap v518: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:24.332 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:23 smithi099 ceph-mon[29691]: pgmap v519: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:24.332 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:23 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:24.332 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:23 smithi099 ceph-mon[29691]: pgmap v520: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:24.333 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:23 smithi099 ceph-mon[29691]: pgmap v521: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:24.333 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:23 smithi099 ceph-mon[29691]: pgmap v522: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:24.333 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:23 smithi099 ceph-mon[29691]: pgmap v523: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:24.333 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:23 smithi099 ceph-mon[24912]: pgmap v508: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:24.333 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:23 smithi099 ceph-mon[24912]: pgmap v509: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:24.333 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:23 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:24.333 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:23 smithi099 ceph-mon[24912]: pgmap v510: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:24.333 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:23 smithi099 ceph-mon[24912]: pgmap v511: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:24.333 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:23 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:24.333 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:23 smithi099 ceph-mon[24912]: pgmap v512: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:24.334 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:23 smithi099 ceph-mon[24912]: pgmap v513: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:24.334 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:23 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:24.334 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:23 smithi099 ceph-mon[24912]: pgmap v514: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:24.334 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:23 smithi099 ceph-mon[24912]: pgmap v515: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:24.334 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:23 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:24.334 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:23 smithi099 ceph-mon[24912]: pgmap v516: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:24.334 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:23 smithi099 ceph-mon[24912]: pgmap v517: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:24.334 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:23 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:24.334 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:23 smithi099 ceph-mon[24912]: pgmap v518: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:24.334 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:23 smithi099 ceph-mon[24912]: pgmap v519: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:24.334 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:23 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:24.334 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:23 smithi099 ceph-mon[24912]: pgmap v520: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:24.334 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:23 smithi099 ceph-mon[24912]: pgmap v521: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:24.335 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:23 smithi099 ceph-mon[24912]: pgmap v522: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:24.335 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:23 smithi099 ceph-mon[24912]: pgmap v523: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:25.081 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:24 smithi099 ceph-mon[24912]: from='client.25136 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T13:59:25.081 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:24 smithi099 ceph-mon[29691]: from='client.25136 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T13:59:25.081 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:59:24 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[71049]: ::ffff:172.21.15.181 - - [30/Mar/2024:13:59:24] "GET /metrics HTTP/1.1" 200 37981 "" "Prometheus/2.33.4" 2024-03-30T13:59:25.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:24 smithi181 ceph-mon[25762]: from='client.25136 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T13:59:26.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:25 smithi181 ceph-mon[25762]: pgmap v524: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:26.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:25 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:26.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:25 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:26.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:25 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:26.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:25 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:26.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:25 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:26.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:25 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:26.331 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:25 smithi099 ceph-mon[24912]: pgmap v524: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:26.331 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:25 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:26.331 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:25 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:26.331 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:25 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:26.331 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:25 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:26.331 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:25 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:26.331 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:25 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:26.332 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:25 smithi099 ceph-mon[29691]: pgmap v524: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:26.332 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:25 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:26.332 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:25 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:26.332 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:25 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:26.332 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:25 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:26.332 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:25 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:26.332 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:25 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:27.178 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:26 smithi181 ceph-mon[25762]: pgmap v525: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:27.178 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:26 smithi181 ceph-mon[25762]: pgmap v526: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:27.178 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:26 smithi181 ceph-mon[25762]: pgmap v527: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:27.178 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:26 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:27.178 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:26 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-03-30T13:59:27.178 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:26 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-03-30T13:59:27.178 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:26 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "mgr services"}]: dispatch 2024-03-30T13:59:27.178 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:26 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:27.332 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:26 smithi099 ceph-mon[24912]: pgmap v525: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:27.332 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:26 smithi099 ceph-mon[24912]: pgmap v526: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:27.332 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:26 smithi099 ceph-mon[24912]: pgmap v527: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:27.332 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:26 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:27.332 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:26 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-03-30T13:59:27.332 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:26 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-03-30T13:59:27.332 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:26 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "mgr services"}]: dispatch 2024-03-30T13:59:27.332 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:26 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:27.333 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:26 smithi099 ceph-mon[29691]: pgmap v525: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:27.333 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:26 smithi099 ceph-mon[29691]: pgmap v526: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:27.333 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:26 smithi099 ceph-mon[29691]: pgmap v527: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:27.333 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:26 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:27.333 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:26 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-03-30T13:59:27.333 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:26 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-03-30T13:59:27.333 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:26 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "mgr services"}]: dispatch 2024-03-30T13:59:27.333 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:26 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:28.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:27 smithi181 ceph-mon[25762]: Upgrade: Updating mgr.x 2024-03-30T13:59:28.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:27 smithi181 ceph-mon[25762]: Deploying daemon mgr.x on smithi181 2024-03-30T13:59:28.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:27 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:28.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:27 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:28.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:27 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:28.331 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:27 smithi099 ceph-mon[24912]: Upgrade: Updating mgr.x 2024-03-30T13:59:28.331 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:27 smithi099 ceph-mon[24912]: Deploying daemon mgr.x on smithi181 2024-03-30T13:59:28.331 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:27 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:28.331 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:27 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:28.331 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:27 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:28.331 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:27 smithi099 ceph-mon[29691]: Upgrade: Updating mgr.x 2024-03-30T13:59:28.332 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:27 smithi099 ceph-mon[29691]: Deploying daemon mgr.x on smithi181 2024-03-30T13:59:28.332 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:27 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:28.332 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:27 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:28.332 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:27 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:29.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:28 smithi181 ceph-mon[25762]: pgmap v528: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-03-30T13:59:29.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:28 smithi181 ceph-mon[25762]: pgmap v529: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-03-30T13:59:29.331 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:28 smithi099 ceph-mon[24912]: pgmap v528: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-03-30T13:59:29.331 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:28 smithi099 ceph-mon[24912]: pgmap v529: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-03-30T13:59:29.331 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:28 smithi099 ceph-mon[29691]: pgmap v528: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-03-30T13:59:29.331 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:28 smithi099 ceph-mon[29691]: pgmap v529: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-03-30T13:59:30.357 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 13:59:30 smithi181 systemd[1]: Stopping Ceph mgr.x for 98ebaeb8-ee99-11ee-b647-cb9ed24678a4... 2024-03-30T13:59:30.627 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 13:59:30 smithi181 podman[85587]: 2024-03-30 13:59:30.362385894 +0000 UTC m=+0.139753145 container died 4216ebd39746cd8a32a3ced07848151df02360ee0cd8b9174699a2458ea7dcb4 (image=quay.ceph.io/ceph-ci/ceph:4e50bbcdd1630c7760b708f3a5b4d38a121e66cb, name=ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-x, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, RELEASE=squid-4e50bbc, ceph=True, org.label-schema.build-date=20240326, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, maintainer=Guillaume Abrioux ) 2024-03-30T13:59:30.893 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 13:59:30 smithi181 podman[85587]: 2024-03-30 13:59:30.706321714 +0000 UTC m=+0.483688959 container cleanup 4216ebd39746cd8a32a3ced07848151df02360ee0cd8b9174699a2458ea7dcb4 (image=quay.ceph.io/ceph-ci/ceph:4e50bbcdd1630c7760b708f3a5b4d38a121e66cb, name=ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-x, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, RELEASE=squid-4e50bbc, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.build-date=20240326, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, GIT_CLEAN=True, ceph=True) 2024-03-30T13:59:30.894 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 13:59:30 smithi181 bash[85587]: ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-x 2024-03-30T13:59:31.225 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:30 smithi181 ceph-mon[25762]: pgmap v530: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-03-30T13:59:31.225 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:30 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T13:59:31.226 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 13:59:30 smithi181 podman[85601]: 2024-03-30 13:59:30.899095003 +0000 UTC m=+0.533249958 container remove 4216ebd39746cd8a32a3ced07848151df02360ee0cd8b9174699a2458ea7dcb4 (image=quay.ceph.io/ceph-ci/ceph:4e50bbcdd1630c7760b708f3a5b4d38a121e66cb, name=ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-x, maintainer=Guillaume Abrioux , ceph=True, RELEASE=squid-4e50bbc, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, org.label-schema.build-date=20240326, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.vendor=CentOS) 2024-03-30T13:59:31.226 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 13:59:30 smithi181 systemd[1]: ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4@mgr.x.service: Main process exited, code=exited, status=143/n/a 2024-03-30T13:59:31.226 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 13:59:31 smithi181 systemd[1]: ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4@mgr.x.service: Failed with result 'exit-code'. 2024-03-30T13:59:31.226 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 13:59:31 smithi181 systemd[1]: Stopped Ceph mgr.x for 98ebaeb8-ee99-11ee-b647-cb9ed24678a4. 2024-03-30T13:59:31.226 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 13:59:31 smithi181 systemd[1]: ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4@mgr.x.service: Consumed 8.894s CPU time. 2024-03-30T13:59:31.331 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:30 smithi099 ceph-mon[24912]: pgmap v530: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-03-30T13:59:31.331 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:30 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T13:59:31.331 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:30 smithi099 ceph-mon[29691]: pgmap v530: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-03-30T13:59:31.331 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:30 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T13:59:31.500 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 13:59:31 smithi181 systemd[1]: Starting Ceph mgr.x for 98ebaeb8-ee99-11ee-b647-cb9ed24678a4... 2024-03-30T13:59:31.833 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 13:59:31 smithi181 podman[85733]: 2024-03-30 13:59:31.533691655 +0000 UTC m=+0.105785686 container create f269106f7913e6f6e452ac36855055176d6269bc34accbaf1826e21b6952c745 (image=quay.ceph.io/ceph-ci/ceph:4e50bbcdd1630c7760b708f3a5b4d38a121e66cb, name=ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-x, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240326, ceph=True, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, RELEASE=squid-4e50bbc) 2024-03-30T13:59:31.833 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 13:59:31 smithi181 podman[85733]: 2024-03-30 13:59:31.445504478 +0000 UTC m=+0.017598516 image pull b0c4478f1d83795df4d538bf108aee5fac57194348fb16dcdbb3115f3e2fe95e quay.ceph.io/ceph-ci/ceph:4e50bbcdd1630c7760b708f3a5b4d38a121e66cb 2024-03-30T13:59:31.834 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 13:59:31 smithi181 podman[85733]: 2024-03-30 13:59:31.746873354 +0000 UTC m=+0.318967384 container init f269106f7913e6f6e452ac36855055176d6269bc34accbaf1826e21b6952c745 (image=quay.ceph.io/ceph-ci/ceph:4e50bbcdd1630c7760b708f3a5b4d38a121e66cb, name=ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-x, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, org.label-schema.build-date=20240326, RELEASE=squid-4e50bbc, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, org.label-schema.license=GPLv2, ceph=True, CEPH_POINT_RELEASE=) 2024-03-30T13:59:31.834 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 13:59:31 smithi181 podman[85733]: 2024-03-30 13:59:31.749541845 +0000 UTC m=+0.321635885 container start f269106f7913e6f6e452ac36855055176d6269bc34accbaf1826e21b6952c745 (image=quay.ceph.io/ceph-ci/ceph:4e50bbcdd1630c7760b708f3a5b4d38a121e66cb, name=ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-x, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240326, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=squid-4e50bbc, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, ceph=True, org.label-schema.vendor=CentOS, GIT_CLEAN=True) 2024-03-30T13:59:31.834 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 13:59:31 smithi181 ceph-mgr[85753]: -- 172.21.15.181:0/1416537075 <== mon.2 v2:172.21.15.181:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x562db96c85a0 con 0x562db969d000 2024-03-30T13:59:31.834 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 13:59:31 smithi181 bash[85733]: f269106f7913e6f6e452ac36855055176d6269bc34accbaf1826e21b6952c745 2024-03-30T13:59:32.250 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 13:59:31 smithi181 systemd[1]: Started Ceph mgr.x for 98ebaeb8-ee99-11ee-b647-cb9ed24678a4. 2024-03-30T13:59:32.670 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 13:59:32 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-x[85749]: 2024-03-30T13:59:32.333+0000 7efedf1ba200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-03-30T13:59:32.670 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 13:59:32 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-x[85749]: 2024-03-30T13:59:32.434+0000 7efedf1ba200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-03-30T13:59:32.994 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:32 smithi181 ceph-mon[25762]: pgmap v531: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 886 B/s rd, 0 op/s 2024-03-30T13:59:32.994 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:32 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:32.994 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:32 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:32.994 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:32 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:32.994 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:32 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:32.995 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:32 smithi181 ceph-mon[25762]: pgmap v532: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-03-30T13:59:32.995 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:32 smithi181 ceph-mon[25762]: pgmap v533: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-03-30T13:59:32.995 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:32 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:32.995 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:32 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:32.995 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:32 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:32.995 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:32 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:32.995 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:32 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.x"}]: dispatch 2024-03-30T13:59:32.995 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:32 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.x"}]: dispatch 2024-03-30T13:59:32.995 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:32 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr.x"}]': finished 2024-03-30T13:59:32.995 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:32 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:32.995 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:32 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:32.995 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:32 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:32.996 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:32 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:32.996 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:32 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:32.996 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:32 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:32.996 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:32 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:32.996 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:32 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:32.996 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:32 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:32.996 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:32 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:32.996 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:32 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:32.996 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:32 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:32.996 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:32 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:32.997 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:32 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:32.997 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:32 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:32.997 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:32 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:32.997 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:32 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:32.997 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:32 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:32.997 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:32 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:32.997 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:32 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:32.997 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:32 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:32.997 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:32 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:32.997 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:32 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:32.997 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:32 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:32.997 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:32 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:32.997 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:32 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:32.997 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:32 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:32.998 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:32 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:32.998 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:32 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:32.998 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:32 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:32.998 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:32 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:32.998 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:32 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:32.998 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:32 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:32.998 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:32 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:32.998 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:32 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:32.998 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:32 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:32.998 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:32 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:32.998 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:32 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:32.998 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:32 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:32.998 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:32 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:32.998 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:32 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:32.998 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:32 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:32.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:32 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:33.243 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:32 smithi099 ceph-mon[29691]: pgmap v531: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 886 B/s rd, 0 op/s 2024-03-30T13:59:33.244 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:32 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:33.244 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:32 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:33.244 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:32 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:33.244 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:32 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:33.244 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:32 smithi099 ceph-mon[29691]: pgmap v532: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-03-30T13:59:33.244 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:32 smithi099 ceph-mon[29691]: pgmap v533: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-03-30T13:59:33.244 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:32 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:33.244 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:32 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:33.244 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:32 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:33.244 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:32 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:33.244 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:32 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.x"}]: dispatch 2024-03-30T13:59:33.244 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:32 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.x"}]: dispatch 2024-03-30T13:59:33.244 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:32 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr.x"}]': finished 2024-03-30T13:59:33.244 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:32 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:33.245 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:32 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:33.245 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:32 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:33.245 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:32 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:33.245 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:32 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:33.245 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:32 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:33.245 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:32 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:33.245 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:32 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:33.245 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:32 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:33.245 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:32 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:33.245 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:32 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:33.245 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:32 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:33.245 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:32 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:33.245 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:32 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:33.245 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:32 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:33.246 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:32 smithi099 ceph-mon[24912]: pgmap v531: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 886 B/s rd, 0 op/s 2024-03-30T13:59:33.246 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:32 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:33.246 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:32 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:33.246 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:32 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:33.246 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:32 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:33.246 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:32 smithi099 ceph-mon[24912]: pgmap v532: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-03-30T13:59:33.246 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:32 smithi099 ceph-mon[24912]: pgmap v533: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-03-30T13:59:33.246 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:32 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:33.246 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:32 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:33.246 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:32 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:33.246 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:32 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:33.247 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:32 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.x"}]: dispatch 2024-03-30T13:59:33.247 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:32 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.x"}]: dispatch 2024-03-30T13:59:33.247 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:32 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr.x"}]': finished 2024-03-30T13:59:33.247 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:32 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:33.247 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:32 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:33.247 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:32 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:33.247 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:32 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:33.247 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:32 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:33.247 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:32 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:33.247 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:32 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:33.247 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:32 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:33.247 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:32 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:33.247 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:32 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:33.247 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:32 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:33.248 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:32 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:33.248 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:32 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:33.248 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:32 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:33.248 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:32 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:33.248 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:32 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:33.248 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:32 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:33.248 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:32 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:33.248 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:32 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:33.248 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:32 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:33.248 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:32 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:33.249 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:32 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:33.249 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:32 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:33.249 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:32 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:33.249 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:32 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:33.249 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:32 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:33.249 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:32 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:33.249 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:32 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:33.249 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:32 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:33.249 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:32 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:33.249 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:32 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:33.249 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:32 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:33.249 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:32 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:33.250 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:32 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:33.250 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:32 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:33.250 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:32 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:33.250 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:32 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:33.250 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:32 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:33.250 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:32 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:33.250 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:32 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:33.250 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:32 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:33.250 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:32 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:33.250 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:32 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:33.250 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:32 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:33.251 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:32 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:33.251 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:32 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:33.251 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:32 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:33.251 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:32 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:33.251 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:32 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:33.251 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:32 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:33.251 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:32 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:33.251 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:32 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:33.251 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:32 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:33.251 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:32 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:33.251 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:32 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:33.251 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:32 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:33.251 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:32 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:33.251 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:32 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:33.252 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:32 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:33.252 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:32 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:33.252 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:32 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:33.252 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:32 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:33.252 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:32 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:33.252 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:32 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:33.252 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:32 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:33.252 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:32 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:33.252 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:32 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:33.252 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:32 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:33.252 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:32 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:33.252 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:32 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:33.252 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:32 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:33.253 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 13:59:33 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-x[85749]: 2024-03-30T13:59:33.155+0000 7efedf1ba200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-03-30T13:59:33.596 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 13:59:33 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-x[85749]: 2024-03-30T13:59:33.256+0000 7efedf1ba200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-03-30T13:59:33.596 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 13:59:33 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-x[85749]: 2024-03-30T13:59:33.405+0000 7efedf1ba200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-03-30T13:59:33.596 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 13:59:33 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-x[85749]: 2024-03-30T13:59:33.506+0000 7efedf1ba200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-03-30T13:59:33.597 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 13:59:33 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-x[85749]: 2024-03-30T13:59:33.599+0000 7efedf1ba200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-03-30T13:59:34.214 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 13:59:33 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-x[85749]: 2024-03-30T13:59:33.880+0000 7efedf1ba200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-03-30T13:59:34.214 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 13:59:34 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-x[85749]: 2024-03-30T13:59:34.002+0000 7efedf1ba200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-03-30T13:59:34.214 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 13:59:34 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-x[85749]: 2024-03-30T13:59:34.102+0000 7efedf1ba200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-03-30T13:59:34.214 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 13:59:34 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-x[85749]: 2024-03-30T13:59:34.217+0000 7efedf1ba200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-03-30T13:59:34.218 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:33 smithi181 ceph-mon[25762]: pgmap v534: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 1.0 KiB/s rd, 1 op/s 2024-03-30T13:59:34.218 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:33 smithi181 ceph-mon[25762]: pgmap v535: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 1.0 KiB/s rd, 1 op/s 2024-03-30T13:59:34.218 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:33 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:34.218 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:33 smithi181 ceph-mon[25762]: pgmap v536: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-03-30T13:59:34.218 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:33 smithi181 ceph-mon[25762]: pgmap v537: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 5.1 KiB/s rd, 5 op/s 2024-03-30T13:59:34.218 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:33 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:34.218 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:33 smithi181 ceph-mon[25762]: pgmap v538: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:34.218 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:33 smithi181 ceph-mon[25762]: pgmap v539: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:34.218 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:33 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:34.218 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:33 smithi181 ceph-mon[25762]: pgmap v540: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:34.219 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:33 smithi181 ceph-mon[25762]: pgmap v541: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:34.219 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:33 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:34.219 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:33 smithi181 ceph-mon[25762]: pgmap v542: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:34.219 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:33 smithi181 ceph-mon[25762]: pgmap v543: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:34.219 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:33 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:34.219 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:33 smithi181 ceph-mon[25762]: pgmap v544: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:34.219 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:33 smithi181 ceph-mon[25762]: pgmap v545: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:34.219 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:33 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:34.219 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:33 smithi181 ceph-mon[25762]: pgmap v546: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:34.219 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:33 smithi181 ceph-mon[25762]: pgmap v547: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:34.219 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:33 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:34.219 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:33 smithi181 ceph-mon[25762]: pgmap v548: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:34.219 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:33 smithi181 ceph-mon[25762]: pgmap v549: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:34.219 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:33 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:34.219 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:33 smithi181 ceph-mon[25762]: pgmap v550: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:34.220 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:33 smithi181 ceph-mon[25762]: pgmap v551: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:34.220 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:33 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:34.220 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:33 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:34.220 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:33 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:34.220 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:33 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:34.220 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:33 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:34.220 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:33 smithi181 ceph-mon[25762]: pgmap v552: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:34.220 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:33 smithi181 ceph-mon[25762]: pgmap v553: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:34.220 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:33 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:34.220 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:33 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:34.220 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:33 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:34.220 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:33 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:34.220 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:33 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:34.220 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:33 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:34.220 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:33 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:34.221 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:33 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:34.221 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:33 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:34.221 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:33 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:34.221 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:33 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:34.221 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:33 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:34.221 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:33 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:34.221 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:33 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:34.221 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:33 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:34.221 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:33 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:34.221 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:33 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:34.221 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:33 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:34.221 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:33 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:34.221 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:33 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:34.221 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:33 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:34.221 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:33 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:34.222 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:33 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:34.222 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:33 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:34.222 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:33 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:34.222 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:33 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:34.222 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:33 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:34.222 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:33 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:34.222 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:33 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:34.222 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:33 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:34.222 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:33 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:34.223 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:33 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:34.223 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:33 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:34.223 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:33 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:34.223 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:33 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:34.223 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:33 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:34.223 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:33 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:34.223 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:33 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:34.223 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:33 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:34.223 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:33 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:34.223 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:33 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:34.223 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:33 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:34.223 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:33 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:34.223 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:33 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:34.223 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:33 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:34.223 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:33 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:34.224 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:33 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:34.224 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:33 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:34.224 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:33 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:34.224 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:33 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:34.224 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:33 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:34.224 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:33 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:34.231 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:33 smithi099 ceph-mon[24912]: pgmap v534: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 1.0 KiB/s rd, 1 op/s 2024-03-30T13:59:34.231 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:33 smithi099 ceph-mon[24912]: pgmap v535: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 1.0 KiB/s rd, 1 op/s 2024-03-30T13:59:34.231 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:33 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:34.231 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:33 smithi099 ceph-mon[24912]: pgmap v536: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-03-30T13:59:34.231 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:33 smithi099 ceph-mon[24912]: pgmap v537: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 5.1 KiB/s rd, 5 op/s 2024-03-30T13:59:34.231 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:33 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:34.231 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:33 smithi099 ceph-mon[24912]: pgmap v538: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:34.231 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:33 smithi099 ceph-mon[24912]: pgmap v539: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:34.231 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:33 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:34.231 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:33 smithi099 ceph-mon[24912]: pgmap v540: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:34.232 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:33 smithi099 ceph-mon[24912]: pgmap v541: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:34.232 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:33 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:34.232 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:33 smithi099 ceph-mon[24912]: pgmap v542: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:34.232 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:33 smithi099 ceph-mon[24912]: pgmap v543: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:34.232 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:33 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:34.232 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:33 smithi099 ceph-mon[24912]: pgmap v544: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:34.233 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:33 smithi099 ceph-mon[24912]: pgmap v545: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:34.233 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:33 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:34.233 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:33 smithi099 ceph-mon[24912]: pgmap v546: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:34.233 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:33 smithi099 ceph-mon[24912]: pgmap v547: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:34.233 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:33 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:34.233 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:33 smithi099 ceph-mon[24912]: pgmap v548: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:34.233 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:33 smithi099 ceph-mon[24912]: pgmap v549: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:34.233 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:33 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:34.233 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:33 smithi099 ceph-mon[24912]: pgmap v550: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:34.233 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:33 smithi099 ceph-mon[24912]: pgmap v551: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:34.233 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:33 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:34.234 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:33 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:34.234 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:33 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:34.234 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:33 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:34.234 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:33 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:34.234 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:33 smithi099 ceph-mon[29691]: pgmap v534: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 1.0 KiB/s rd, 1 op/s 2024-03-30T13:59:34.234 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:33 smithi099 ceph-mon[29691]: pgmap v535: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 1.0 KiB/s rd, 1 op/s 2024-03-30T13:59:34.234 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:33 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:34.234 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:33 smithi099 ceph-mon[29691]: pgmap v536: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-03-30T13:59:34.234 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:33 smithi099 ceph-mon[29691]: pgmap v537: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 5.1 KiB/s rd, 5 op/s 2024-03-30T13:59:34.234 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:33 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:34.235 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:33 smithi099 ceph-mon[29691]: pgmap v538: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:34.235 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:33 smithi099 ceph-mon[29691]: pgmap v539: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:34.235 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:33 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:34.235 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:33 smithi099 ceph-mon[29691]: pgmap v540: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:34.235 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:33 smithi099 ceph-mon[29691]: pgmap v541: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:34.235 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:33 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:34.236 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:33 smithi099 ceph-mon[29691]: pgmap v542: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:34.236 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:33 smithi099 ceph-mon[29691]: pgmap v543: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:34.236 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:33 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:34.236 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:33 smithi099 ceph-mon[29691]: pgmap v544: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:34.236 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:33 smithi099 ceph-mon[29691]: pgmap v545: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:34.236 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:33 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:34.236 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:33 smithi099 ceph-mon[29691]: pgmap v546: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:34.236 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:33 smithi099 ceph-mon[29691]: pgmap v547: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:34.236 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:33 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:34.236 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:33 smithi099 ceph-mon[29691]: pgmap v548: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:34.236 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:33 smithi099 ceph-mon[29691]: pgmap v549: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:34.236 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:33 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:34.236 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:33 smithi099 ceph-mon[29691]: pgmap v550: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:34.236 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:33 smithi099 ceph-mon[29691]: pgmap v551: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:34.237 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:33 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:34.237 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:33 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:34.237 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:33 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:34.237 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:33 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:34.237 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:33 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:34.237 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:33 smithi099 ceph-mon[24912]: pgmap v552: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:34.238 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:33 smithi099 ceph-mon[24912]: pgmap v553: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:34.238 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:33 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:34.238 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:33 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:34.238 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:33 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:34.238 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:33 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:34.238 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:33 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:34.238 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:33 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:34.238 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:33 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:34.238 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:33 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:34.238 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:33 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:34.238 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:33 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:34.239 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:33 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:34.239 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:33 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:34.239 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:33 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:34.239 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:33 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:34.239 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:33 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:34.239 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:33 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:34.239 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:33 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:34.239 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:33 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:34.239 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:33 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:34.239 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:33 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:34.239 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:33 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:34.239 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:33 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:34.240 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:33 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:34.240 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:33 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:34.240 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:33 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:34.240 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:33 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:34.240 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:33 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:34.240 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:33 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:34.240 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:33 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:34.240 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:33 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:34.240 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:33 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:34.240 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:33 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:34.240 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:33 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:34.240 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:33 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:34.240 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:33 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:34.240 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:33 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:34.240 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:33 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:34.241 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:33 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:34.241 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:33 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:34.241 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:33 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:34.241 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:33 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:34.242 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:33 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:34.242 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:33 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:34.242 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:33 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:34.242 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:33 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:34.242 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:33 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:34.242 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:33 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:34.242 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:33 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:34.242 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:33 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:34.242 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:33 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:34.242 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:33 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:34.242 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:33 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:34.243 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:33 smithi099 ceph-mon[29691]: pgmap v552: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:34.243 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:33 smithi099 ceph-mon[29691]: pgmap v553: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:34.243 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:33 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:34.243 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:33 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:34.243 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:33 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:34.243 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:33 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:34.243 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:33 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:34.243 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:33 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:34.243 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:33 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:34.244 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:33 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:34.244 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:33 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:34.244 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:33 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:34.244 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:33 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:34.244 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:33 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:34.244 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:33 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:34.244 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:33 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:34.244 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:33 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:34.244 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:33 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:34.244 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:33 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:34.244 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:33 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:34.244 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:33 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:34.244 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:33 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:34.245 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:33 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:34.245 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:33 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:34.245 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:33 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:34.245 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:33 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:34.245 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:33 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:34.245 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:33 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:34.245 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:33 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:34.245 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:33 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:34.245 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:33 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:34.245 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:33 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:34.245 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:33 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:34.245 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:33 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:34.245 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:33 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:34.245 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:33 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:34.245 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:33 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:34.246 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:33 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:34.246 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:33 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:34.246 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:33 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:34.246 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:33 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:34.246 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:33 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:34.246 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:33 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:34.246 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:33 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:34.246 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:33 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:34.246 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:33 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:34.246 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:33 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:34.247 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:33 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:34.247 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:33 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:34.247 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:33 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:34.247 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:33 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:34.247 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:33 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:34.247 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:33 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:34.247 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:33 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:34.500 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 13:59:34 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-x[85749]: 2024-03-30T13:59:34.428+0000 7efedf1ba200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-03-30T13:59:34.546 INFO:journalctl@ceph.alertmanager.a.smithi099.stdout:Mar 30 13:59:34 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-alertmanager-a[64884]: level=warn ts=2024-03-30T13:59:34.236Z caller=notify.go:724 component=dispatcher receiver=ceph-dashboard integration=webhook[0] msg="Notify attempt failed, will retry later" attempts=1 err="Post \"https://smithi181.front.sepia.ceph.com:8443/api/prometheus_receiver\": dial tcp 172.21.15.181:8443: connect: connection refused" 2024-03-30T13:59:34.830 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:59:34 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[71049]: ::ffff:172.21.15.181 - - [30/Mar/2024:13:59:34] "GET /metrics HTTP/1.1" 200 37988 "" "Prometheus/2.33.4" 2024-03-30T13:59:35.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:34 smithi181 ceph-mon[25762]: pgmap v554: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:35.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:34 smithi181 ceph-mon[25762]: pgmap v555: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:35.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:34 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:35.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:34 smithi181 ceph-mon[25762]: pgmap v556: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:35.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:34 smithi181 ceph-mon[25762]: pgmap v557: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:35.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:34 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:35.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:34 smithi181 ceph-mon[25762]: pgmap v558: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:35.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:34 smithi181 ceph-mon[25762]: pgmap v559: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:35.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:34 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:35.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:34 smithi181 ceph-mon[25762]: from='client.25136 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T13:59:35.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:34 smithi181 ceph-mon[25762]: pgmap v560: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:35.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:34 smithi181 ceph-mon[25762]: pgmap v561: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:35.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:34 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:35.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:34 smithi181 ceph-mon[25762]: pgmap v562: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:35.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:34 smithi181 ceph-mon[25762]: pgmap v563: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:35.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:34 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:35.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:34 smithi181 ceph-mon[25762]: pgmap v564: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:35.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:34 smithi181 ceph-mon[25762]: pgmap v565: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:35.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:34 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:35.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:34 smithi181 ceph-mon[25762]: pgmap v566: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:35.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:34 smithi181 ceph-mon[25762]: pgmap v567: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:35.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:34 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:35.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:34 smithi181 ceph-mon[25762]: pgmap v568: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:35.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:34 smithi181 ceph-mon[25762]: pgmap v569: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:35.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:34 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:35.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:34 smithi181 ceph-mon[25762]: pgmap v570: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:35.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:34 smithi181 ceph-mon[25762]: pgmap v571: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:35.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:34 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:35.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:34 smithi181 ceph-mon[25762]: pgmap v572: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:35.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:34 smithi181 ceph-mon[25762]: pgmap v573: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:35.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:34 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:35.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:34 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:35.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:34 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:35.253 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:34 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:35.253 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:34 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:35.253 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:34 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:35.253 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:34 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:35.253 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:34 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:35.253 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:34 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:35.253 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:34 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:35.253 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:34 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:35.253 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:34 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:35.253 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:34 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:35.253 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:34 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:35.253 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:34 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:35.253 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:34 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:35.253 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:34 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:35.253 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:34 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:35.254 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:34 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:35.254 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:34 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:35.254 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:34 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:35.254 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:34 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:35.254 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:34 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:35.254 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:34 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:35.254 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:34 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:35.254 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:34 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:35.254 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:34 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:35.254 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:34 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:35.254 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:34 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:35.254 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:34 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:35.254 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:34 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:35.254 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:34 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:35.255 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:34 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:35.255 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:34 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:35.255 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:34 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:35.255 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:34 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:35.255 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:34 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:35.255 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:34 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:35.255 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:34 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:35.255 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:34 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:35.255 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:34 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:35.255 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:34 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:35.255 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:34 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:35.255 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:34 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:35.255 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:34 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:35.255 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:34 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:35.331 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:34 smithi099 ceph-mon[24912]: pgmap v554: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:35.331 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:34 smithi099 ceph-mon[24912]: pgmap v555: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:35.331 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:34 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:35.331 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:34 smithi099 ceph-mon[24912]: pgmap v556: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:35.331 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:34 smithi099 ceph-mon[24912]: pgmap v557: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:35.331 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:34 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:35.331 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:34 smithi099 ceph-mon[24912]: pgmap v558: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:35.332 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:34 smithi099 ceph-mon[24912]: pgmap v559: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:35.332 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:34 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:35.332 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:34 smithi099 ceph-mon[24912]: from='client.25136 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T13:59:35.332 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:34 smithi099 ceph-mon[24912]: pgmap v560: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:35.332 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:34 smithi099 ceph-mon[24912]: pgmap v561: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:35.332 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:34 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:35.332 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:34 smithi099 ceph-mon[24912]: pgmap v562: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:35.332 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:34 smithi099 ceph-mon[24912]: pgmap v563: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:35.332 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:34 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:35.332 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:34 smithi099 ceph-mon[24912]: pgmap v564: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:35.332 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:34 smithi099 ceph-mon[24912]: pgmap v565: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:35.332 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:34 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:35.332 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:34 smithi099 ceph-mon[24912]: pgmap v566: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:35.332 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:34 smithi099 ceph-mon[24912]: pgmap v567: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:35.332 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:34 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:35.333 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:34 smithi099 ceph-mon[24912]: pgmap v568: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:35.333 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:34 smithi099 ceph-mon[24912]: pgmap v569: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:35.333 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:34 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:35.333 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:34 smithi099 ceph-mon[24912]: pgmap v570: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:35.333 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:34 smithi099 ceph-mon[24912]: pgmap v571: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:35.333 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:34 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:35.333 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:34 smithi099 ceph-mon[24912]: pgmap v572: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:35.333 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:34 smithi099 ceph-mon[24912]: pgmap v573: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:35.333 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:34 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:35.333 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:34 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:35.333 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:34 smithi099 ceph-mon[29691]: pgmap v554: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:35.334 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:34 smithi099 ceph-mon[29691]: pgmap v555: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:35.334 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:34 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:35.334 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:34 smithi099 ceph-mon[29691]: pgmap v556: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:35.334 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:34 smithi099 ceph-mon[29691]: pgmap v557: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:35.334 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:34 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:35.334 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:34 smithi099 ceph-mon[29691]: pgmap v558: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:35.334 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:34 smithi099 ceph-mon[29691]: pgmap v559: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:35.334 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:34 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:35.334 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:34 smithi099 ceph-mon[29691]: from='client.25136 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T13:59:35.334 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:34 smithi099 ceph-mon[29691]: pgmap v560: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:35.334 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:34 smithi099 ceph-mon[29691]: pgmap v561: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:35.335 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:34 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:35.335 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:34 smithi099 ceph-mon[29691]: pgmap v562: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:35.335 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:34 smithi099 ceph-mon[29691]: pgmap v563: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:35.335 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:34 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:35.335 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:34 smithi099 ceph-mon[29691]: pgmap v564: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:35.335 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:34 smithi099 ceph-mon[29691]: pgmap v565: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:35.335 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:34 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:35.335 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:34 smithi099 ceph-mon[29691]: pgmap v566: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:35.335 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:34 smithi099 ceph-mon[29691]: pgmap v567: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:35.335 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:34 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:35.335 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:34 smithi099 ceph-mon[29691]: pgmap v568: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:35.336 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:34 smithi099 ceph-mon[29691]: pgmap v569: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:35.336 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:34 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:35.336 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:34 smithi099 ceph-mon[29691]: pgmap v570: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:35.336 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:34 smithi099 ceph-mon[29691]: pgmap v571: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:35.336 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:34 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:35.336 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:34 smithi099 ceph-mon[29691]: pgmap v572: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:35.336 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:34 smithi099 ceph-mon[29691]: pgmap v573: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:35.336 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:34 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:35.336 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:34 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:35.337 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:34 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:35.337 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:34 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:35.337 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:34 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:35.337 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:34 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:35.337 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:34 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:35.337 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:34 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:35.337 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:34 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:35.337 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:34 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:35.337 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:34 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:35.337 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:34 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:35.337 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:34 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:35.337 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:34 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:35.337 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:34 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:35.337 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:34 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:35.338 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:34 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:35.338 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:34 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:35.338 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:34 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:35.338 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:34 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:35.338 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:34 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:35.338 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:34 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:35.338 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:34 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:35.338 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:34 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:35.338 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:34 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:35.338 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:34 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:35.338 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:34 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:35.338 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:34 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:35.338 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:34 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:35.338 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:34 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:35.339 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:34 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:35.339 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:34 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:35.339 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:34 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:35.339 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:34 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:35.339 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:34 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:35.339 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:34 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:35.339 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:34 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:35.339 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:34 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:35.339 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:34 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:35.339 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:34 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:35.339 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:34 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:35.339 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:34 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:35.340 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:34 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:35.340 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:34 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:35.340 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:34 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:35.340 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:34 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:35.340 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:34 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:35.340 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:34 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:35.340 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:34 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:35.340 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:34 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:35.340 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:34 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:35.340 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:34 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:35.340 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:34 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:35.340 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:34 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:35.340 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:34 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:35.340 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:34 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:35.340 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:34 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:35.340 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:34 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:35.341 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:34 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:35.341 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:34 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:35.341 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:34 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:35.341 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:34 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:35.341 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:34 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:35.341 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:34 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:35.341 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:34 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:35.341 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:34 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:35.341 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:34 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:35.341 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:34 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:35.341 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:34 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:35.342 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:34 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:35.342 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:34 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:35.342 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:34 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:35.342 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:34 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:35.342 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:34 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:35.342 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:34 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:35.342 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:34 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:35.342 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:34 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:35.342 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:34 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:35.342 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:34 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:35.342 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:34 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:35.342 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:34 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:35.343 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:34 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:35.343 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:34 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:35.343 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:34 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:35.343 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:34 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:35.343 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:34 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:35.343 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:34 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:35.343 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:34 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:35.343 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:34 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:35.343 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:34 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:35.749 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 13:59:35 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-x[85749]: 2024-03-30T13:59:35.477+0000 7efedf1ba200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-03-30T13:59:35.750 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 13:59:35 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-x[85749]: 2024-03-30T13:59:35.616+0000 7efedf1ba200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-03-30T13:59:36.118 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 13:59:35 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-x[85749]: 2024-03-30T13:59:35.988+0000 7efedf1ba200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-03-30T13:59:36.118 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 13:59:36 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-x[85749]: 2024-03-30T13:59:36.088+0000 7efedf1ba200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-03-30T13:59:36.119 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:35 smithi181 ceph-mon[25762]: pgmap v574: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:36.119 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:35 smithi181 ceph-mon[25762]: pgmap v575: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:36.119 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:35 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:36.119 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:35 smithi181 ceph-mon[25762]: pgmap v576: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:36.119 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:35 smithi181 ceph-mon[25762]: pgmap v577: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:36.119 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:35 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:36.120 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:35 smithi181 ceph-mon[25762]: pgmap v578: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:36.120 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:35 smithi181 ceph-mon[25762]: pgmap v579: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:36.120 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:35 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:36.120 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:35 smithi181 ceph-mon[25762]: pgmap v580: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:36.120 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:35 smithi181 ceph-mon[25762]: pgmap v581: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:36.120 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:35 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:36.120 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:35 smithi181 ceph-mon[25762]: pgmap v582: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:36.120 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:35 smithi181 ceph-mon[25762]: pgmap v583: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:36.120 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:35 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:36.120 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:35 smithi181 ceph-mon[25762]: pgmap v584: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:36.120 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:35 smithi181 ceph-mon[25762]: pgmap v585: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:36.120 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:35 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:36.120 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:35 smithi181 ceph-mon[25762]: pgmap v586: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:36.121 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:35 smithi181 ceph-mon[25762]: pgmap v587: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:36.121 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:35 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:36.121 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:35 smithi181 ceph-mon[25762]: pgmap v588: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:36.121 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:35 smithi181 ceph-mon[25762]: pgmap v589: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:36.121 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:35 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:36.121 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:35 smithi181 ceph-mon[25762]: pgmap v590: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:36.121 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:35 smithi181 ceph-mon[25762]: pgmap v591: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:36.121 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:35 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:36.121 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:35 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:36.121 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:35 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:36.122 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:35 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:36.122 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:35 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:36.122 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:35 smithi181 ceph-mon[25762]: pgmap v592: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:36.122 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:35 smithi181 ceph-mon[25762]: pgmap v593: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:36.122 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:35 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:36.122 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:35 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:36.123 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:35 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:36.123 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:35 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:36.123 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:35 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:36.123 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:35 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:36.123 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:35 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:36.123 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:35 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:36.124 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:35 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:36.124 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:35 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:36.124 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:35 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:36.124 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:35 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:36.124 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:35 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:36.124 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:35 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:36.124 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:35 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:36.125 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:35 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:36.125 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:35 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:36.125 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:35 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:36.125 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:35 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:36.125 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:35 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:36.125 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:35 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:36.125 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:35 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:36.125 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:35 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:36.125 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:35 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:36.126 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:35 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:36.126 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:35 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:36.126 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:35 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:36.126 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:35 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:36.126 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:35 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:36.126 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:35 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:36.126 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:35 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:36.126 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:35 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:36.126 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:35 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:36.127 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:35 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:36.127 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:35 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:36.127 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:35 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:36.127 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:35 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:36.127 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:35 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:36.127 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:35 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:36.127 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:35 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:36.127 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:35 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:36.127 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:35 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:36.127 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:35 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:36.127 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:35 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:36.127 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:35 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:36.127 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:35 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:36.127 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:35 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:36.127 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:35 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:36.128 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:35 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:36.128 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:35 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:36.128 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:35 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:36.331 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:35 smithi099 ceph-mon[24912]: pgmap v574: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:36.331 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:35 smithi099 ceph-mon[24912]: pgmap v575: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:36.331 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:35 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:36.331 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:35 smithi099 ceph-mon[24912]: pgmap v576: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:36.331 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:35 smithi099 ceph-mon[24912]: pgmap v577: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:36.331 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:35 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:36.332 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:35 smithi099 ceph-mon[24912]: pgmap v578: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:36.332 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:35 smithi099 ceph-mon[24912]: pgmap v579: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:36.332 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:35 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:36.332 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:35 smithi099 ceph-mon[24912]: pgmap v580: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:36.332 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:35 smithi099 ceph-mon[24912]: pgmap v581: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:36.332 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:35 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:36.332 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:35 smithi099 ceph-mon[24912]: pgmap v582: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:36.332 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:35 smithi099 ceph-mon[24912]: pgmap v583: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:36.332 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:35 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:36.332 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:35 smithi099 ceph-mon[24912]: pgmap v584: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:36.332 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:35 smithi099 ceph-mon[24912]: pgmap v585: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:36.333 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:35 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:36.333 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:35 smithi099 ceph-mon[24912]: pgmap v586: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:36.333 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:35 smithi099 ceph-mon[24912]: pgmap v587: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:36.333 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:35 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:36.333 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:35 smithi099 ceph-mon[24912]: pgmap v588: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:36.333 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:35 smithi099 ceph-mon[24912]: pgmap v589: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:36.333 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:35 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:36.333 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:35 smithi099 ceph-mon[24912]: pgmap v590: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:36.333 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:35 smithi099 ceph-mon[24912]: pgmap v591: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:36.333 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:35 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:36.333 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:35 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:36.333 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:35 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:36.333 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:35 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:36.333 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:35 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:36.334 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:35 smithi099 ceph-mon[29691]: pgmap v574: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:36.334 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:35 smithi099 ceph-mon[29691]: pgmap v575: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:36.334 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:35 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:36.334 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:35 smithi099 ceph-mon[29691]: pgmap v576: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:36.334 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:35 smithi099 ceph-mon[29691]: pgmap v577: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:36.334 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:35 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:36.334 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:35 smithi099 ceph-mon[29691]: pgmap v578: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:36.334 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:35 smithi099 ceph-mon[29691]: pgmap v579: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:36.335 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:35 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:36.335 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:35 smithi099 ceph-mon[29691]: pgmap v580: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:36.335 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:35 smithi099 ceph-mon[29691]: pgmap v581: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:36.335 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:35 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:36.335 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:35 smithi099 ceph-mon[29691]: pgmap v582: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:36.335 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:35 smithi099 ceph-mon[29691]: pgmap v583: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:36.335 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:35 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:36.335 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:35 smithi099 ceph-mon[29691]: pgmap v584: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:36.335 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:35 smithi099 ceph-mon[29691]: pgmap v585: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:36.335 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:35 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:36.335 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:35 smithi099 ceph-mon[29691]: pgmap v586: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:36.335 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:35 smithi099 ceph-mon[29691]: pgmap v587: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:36.335 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:35 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:36.335 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:35 smithi099 ceph-mon[29691]: pgmap v588: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:36.336 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:35 smithi099 ceph-mon[29691]: pgmap v589: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:36.336 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:35 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:36.336 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:35 smithi099 ceph-mon[29691]: pgmap v590: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:36.336 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:35 smithi099 ceph-mon[29691]: pgmap v591: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:36.336 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:35 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:36.336 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:35 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:36.336 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:35 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:36.336 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:35 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:36.336 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:35 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:36.337 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:35 smithi099 ceph-mon[24912]: pgmap v592: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:36.337 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:35 smithi099 ceph-mon[24912]: pgmap v593: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:36.337 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:35 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:36.337 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:35 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:36.337 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:35 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:36.337 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:35 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:36.337 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:35 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:36.337 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:35 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:36.337 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:35 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:36.337 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:35 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:36.337 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:35 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:36.338 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:35 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:36.338 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:35 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:36.338 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:35 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:36.338 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:35 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:36.338 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:35 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:36.338 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:35 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:36.339 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:35 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:36.339 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:35 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:36.339 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:35 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:36.339 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:35 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:36.339 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:35 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:36.339 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:35 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:36.339 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:35 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:36.339 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:35 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:36.340 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:35 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:36.340 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:35 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:36.340 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:35 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:36.340 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:35 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:36.340 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:35 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:36.340 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:35 smithi099 ceph-mon[29691]: pgmap v592: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:36.340 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:35 smithi099 ceph-mon[29691]: pgmap v593: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:36.340 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:35 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:36.340 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:35 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:36.340 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:35 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:36.341 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:35 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:36.341 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:35 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:36.341 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:35 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:36.341 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:35 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:36.341 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:35 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:36.341 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:35 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:36.341 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:35 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:36.341 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:35 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:36.341 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:35 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:36.341 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:35 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:36.341 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:35 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:36.341 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:35 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:36.342 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:35 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:36.342 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:35 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:36.342 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:35 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:36.342 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:35 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:36.342 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:35 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:36.342 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:35 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:36.342 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:35 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:36.342 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:35 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:36.342 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:35 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:36.342 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:35 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:36.342 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:35 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:36.342 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:35 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:36.343 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:35 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:36.343 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:35 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:36.343 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:35 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:36.343 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:35 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:36.343 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:35 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:36.343 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:35 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:36.343 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:35 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:36.343 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:35 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:36.344 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:35 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:36.344 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:35 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:36.344 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:35 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:36.344 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:35 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:36.344 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:35 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:36.344 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:35 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:36.344 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:35 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:36.344 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:35 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:36.344 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:35 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:36.344 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:35 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:36.344 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:35 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:36.344 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:35 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:36.344 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:35 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:36.344 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:35 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:36.344 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:35 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:36.345 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:35 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:36.345 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:35 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:36.345 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:35 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:36.345 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:35 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:36.345 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:35 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:36.345 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:35 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:36.345 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:35 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:36.345 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:35 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:36.345 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:35 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:36.345 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:35 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:36.345 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:35 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:36.345 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:35 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:36.346 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:35 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:36.346 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:35 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:36.346 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:35 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:36.346 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:35 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:36.346 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:35 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:36.346 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:35 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:36.346 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:35 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:36.346 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:35 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:36.346 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:35 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:36.346 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:35 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:36.346 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:35 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:36.346 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:35 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:36.499 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 13:59:36 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-x[85749]: 2024-03-30T13:59:36.307+0000 7efedf1ba200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-03-30T13:59:36.817 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 13:59:36 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-x[85749]: 2024-03-30T13:59:36.510+0000 7efedf1ba200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-03-30T13:59:36.817 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 13:59:36 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-x[85749]: 2024-03-30T13:59:36.820+0000 7efedf1ba200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-03-30T13:59:37.101 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:36 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:37.101 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:36 smithi181 ceph-mon[25762]: pgmap v594: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:37.101 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:36 smithi181 ceph-mon[25762]: pgmap v595: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:37.102 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:36 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:37.102 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:36 smithi181 ceph-mon[25762]: pgmap v596: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:37.102 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:36 smithi181 ceph-mon[25762]: pgmap v597: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:37.102 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:36 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:37.102 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:36 smithi181 ceph-mon[25762]: pgmap v598: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:37.102 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:36 smithi181 ceph-mon[25762]: pgmap v599: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:37.102 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:36 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:37.102 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:36 smithi181 ceph-mon[25762]: pgmap v600: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:37.102 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:36 smithi181 ceph-mon[25762]: pgmap v601: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:37.103 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:36 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:37.103 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:36 smithi181 ceph-mon[25762]: pgmap v602: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:37.103 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:36 smithi181 ceph-mon[25762]: pgmap v603: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:37.103 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:36 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:37.103 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:36 smithi181 ceph-mon[25762]: pgmap v604: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:37.103 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:36 smithi181 ceph-mon[25762]: pgmap v605: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:37.104 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:36 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:37.104 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:36 smithi181 ceph-mon[25762]: pgmap v606: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:37.104 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:36 smithi181 ceph-mon[25762]: pgmap v607: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:37.104 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:36 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:37.104 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:36 smithi181 ceph-mon[25762]: pgmap v608: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:37.104 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:36 smithi181 ceph-mon[25762]: pgmap v609: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:37.104 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:36 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:37.104 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:36 smithi181 ceph-mon[25762]: pgmap v610: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:37.104 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:36 smithi181 ceph-mon[25762]: pgmap v611: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:37.104 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:36 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:37.104 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:36 smithi181 ceph-mon[25762]: pgmap v612: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:37.104 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:36 smithi181 ceph-mon[25762]: pgmap v613: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:37.105 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:36 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:37.105 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:36 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:37.105 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:36 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:37.105 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:36 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:37.105 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:36 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:37.105 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:36 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:37.105 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:36 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:37.105 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:36 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:37.106 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:36 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:37.106 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:36 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:37.106 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:36 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:37.106 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:36 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:37.106 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:36 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:37.106 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:36 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:37.106 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:36 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:37.106 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:36 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:37.106 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:36 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:37.106 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:36 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:37.106 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:36 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:37.106 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:36 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:37.107 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:36 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:37.107 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:36 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:37.107 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:36 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:37.107 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:36 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:37.107 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:36 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:37.107 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:36 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:37.107 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:36 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:37.107 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:36 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:37.107 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:36 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:37.107 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:36 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:37.107 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:36 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:37.107 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:36 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:37.107 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:36 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:37.108 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:36 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:37.108 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:36 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:37.108 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:36 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:37.108 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:36 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:37.108 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:36 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:37.108 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:36 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:37.108 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:36 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:37.108 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:36 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:37.108 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:36 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:37.108 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:36 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:37.108 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:36 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:37.108 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:36 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:37.108 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:36 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:37.109 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:36 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:37.109 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:36 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:37.109 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:36 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:37.109 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:36 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:37.109 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:36 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:37.109 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:36 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:37.109 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:36 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:37.109 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:36 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:37.109 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:36 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:37.109 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:36 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:37.331 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:36 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:37.331 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:36 smithi099 ceph-mon[24912]: pgmap v594: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:37.331 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:36 smithi099 ceph-mon[24912]: pgmap v595: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:37.332 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:36 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:37.332 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:36 smithi099 ceph-mon[24912]: pgmap v596: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:37.332 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:36 smithi099 ceph-mon[24912]: pgmap v597: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:37.332 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:36 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:37.332 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:36 smithi099 ceph-mon[24912]: pgmap v598: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:37.332 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:36 smithi099 ceph-mon[24912]: pgmap v599: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:37.332 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:36 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:37.332 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:36 smithi099 ceph-mon[24912]: pgmap v600: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:37.332 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:36 smithi099 ceph-mon[24912]: pgmap v601: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:37.332 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:36 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:37.332 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:36 smithi099 ceph-mon[24912]: pgmap v602: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:37.332 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:36 smithi099 ceph-mon[24912]: pgmap v603: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:37.332 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:36 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:37.333 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:36 smithi099 ceph-mon[24912]: pgmap v604: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:37.333 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:36 smithi099 ceph-mon[24912]: pgmap v605: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:37.333 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:36 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:37.333 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:36 smithi099 ceph-mon[24912]: pgmap v606: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:37.333 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:36 smithi099 ceph-mon[24912]: pgmap v607: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:37.333 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:36 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:37.333 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:36 smithi099 ceph-mon[24912]: pgmap v608: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:37.333 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:36 smithi099 ceph-mon[24912]: pgmap v609: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:37.333 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:36 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:37.333 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:36 smithi099 ceph-mon[24912]: pgmap v610: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:37.333 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:36 smithi099 ceph-mon[24912]: pgmap v611: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:37.333 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:36 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:37.333 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:36 smithi099 ceph-mon[24912]: pgmap v612: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:37.333 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:36 smithi099 ceph-mon[24912]: pgmap v613: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:37.334 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:36 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:37.334 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:36 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:37.334 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:36 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:37.334 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:36 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:37.334 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:36 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:37.334 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:36 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:37.334 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:36 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:37.334 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:36 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:37.334 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:36 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:37.334 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:36 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:37.334 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:36 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:37.334 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:36 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:37.334 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:36 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:37.335 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:36 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:37.335 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:36 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:37.335 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:36 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:37.335 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:36 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:37.335 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:36 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:37.335 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:36 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:37.335 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:36 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:37.335 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:36 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:37.335 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:36 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:37.335 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:36 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:37.335 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:36 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:37.335 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:36 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:37.335 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:36 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:37.335 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:36 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:37.336 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:36 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:37.336 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:36 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:37.336 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:36 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:37.336 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:36 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:37.336 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:36 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:37.336 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:36 smithi099 ceph-mon[29691]: pgmap v594: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:37.336 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:36 smithi099 ceph-mon[29691]: pgmap v595: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:37.336 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:36 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:37.337 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:36 smithi099 ceph-mon[29691]: pgmap v596: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:37.337 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:36 smithi099 ceph-mon[29691]: pgmap v597: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:37.337 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:36 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:37.337 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:36 smithi099 ceph-mon[29691]: pgmap v598: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:37.337 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:36 smithi099 ceph-mon[29691]: pgmap v599: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:37.337 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:36 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:37.337 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:36 smithi099 ceph-mon[29691]: pgmap v600: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:37.337 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:36 smithi099 ceph-mon[29691]: pgmap v601: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:37.337 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:36 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:37.337 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:36 smithi099 ceph-mon[29691]: pgmap v602: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:37.337 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:36 smithi099 ceph-mon[29691]: pgmap v603: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:37.337 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:36 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:37.338 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:36 smithi099 ceph-mon[29691]: pgmap v604: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:37.338 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:36 smithi099 ceph-mon[29691]: pgmap v605: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:37.338 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:36 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:37.338 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:36 smithi099 ceph-mon[29691]: pgmap v606: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:37.338 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:36 smithi099 ceph-mon[29691]: pgmap v607: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:37.338 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:36 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:37.338 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:36 smithi099 ceph-mon[29691]: pgmap v608: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:37.338 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:36 smithi099 ceph-mon[29691]: pgmap v609: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:37.338 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:36 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:37.338 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:36 smithi099 ceph-mon[29691]: pgmap v610: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:37.338 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:36 smithi099 ceph-mon[29691]: pgmap v611: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:37.338 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:36 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:37.338 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:36 smithi099 ceph-mon[29691]: pgmap v612: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:37.338 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:36 smithi099 ceph-mon[29691]: pgmap v613: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:37.339 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:36 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:37.339 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:36 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:37.339 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:36 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:37.339 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:36 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:37.339 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:36 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:37.339 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:36 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:37.339 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:36 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:37.339 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:36 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:37.339 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:36 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:37.340 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:36 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:37.340 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:36 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:37.340 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:36 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:37.340 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:36 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:37.340 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:36 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:37.340 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:36 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:37.340 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:36 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:37.340 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:36 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:37.340 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:36 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:37.340 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:36 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:37.340 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:36 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:37.341 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:36 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:37.341 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:36 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:37.341 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:36 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:37.341 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:36 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:37.341 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:36 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:37.341 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:36 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:37.341 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:36 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:37.341 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:36 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:37.341 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:36 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:37.341 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:36 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:37.342 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:36 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:37.342 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:36 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:37.342 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:36 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:37.342 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:36 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:37.342 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:36 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:37.342 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:36 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:37.342 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:36 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:37.342 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:36 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:37.342 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:36 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:37.342 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:36 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:37.342 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:36 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:37.342 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:36 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:37.342 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:36 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:37.342 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:36 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:37.342 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:36 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:37.343 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:36 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:37.343 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:36 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:37.343 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:36 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:37.343 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:36 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:37.343 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:36 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:37.343 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:36 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:37.343 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:36 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:37.343 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:36 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:37.343 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:36 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:37.343 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:36 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:37.343 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:36 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:37.343 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:36 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:37.343 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:36 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:37.343 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:36 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:37.343 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:36 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:37.344 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:36 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:37.344 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:36 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:37.344 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:36 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:37.344 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:36 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:37.344 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:36 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:37.344 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:36 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:37.344 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:36 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:37.344 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:36 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:37.344 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:36 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:37.344 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:36 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:37.344 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:36 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:37.344 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:36 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:37.344 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:36 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:37.344 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:36 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:37.344 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:36 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:37.344 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:36 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:37.345 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:36 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:37.345 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:36 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:37.345 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:36 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:37.345 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:36 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:37.345 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:36 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:37.357 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 13:59:37 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-x[85749]: 2024-03-30T13:59:37.104+0000 7efedf1ba200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-03-30T13:59:37.358 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 13:59:37 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-x[85749]: 2024-03-30T13:59:37.361+0000 7efedf1ba200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-03-30T13:59:38.125 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:37 smithi181 ceph-mon[25762]: pgmap v614: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:38.126 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:37 smithi181 ceph-mon[25762]: pgmap v615: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:38.126 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:37 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:38.126 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:37 smithi181 ceph-mon[25762]: pgmap v616: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:38.126 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:37 smithi181 ceph-mon[25762]: pgmap v617: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:38.126 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:37 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:38.126 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:37 smithi181 ceph-mon[25762]: pgmap v618: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:38.126 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:37 smithi181 ceph-mon[25762]: pgmap v619: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:38.126 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:37 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:38.126 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:37 smithi181 ceph-mon[25762]: pgmap v620: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:38.126 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:37 smithi181 ceph-mon[25762]: pgmap v621: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:38.126 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:37 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:38.127 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:37 smithi181 ceph-mon[25762]: pgmap v622: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:38.127 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:37 smithi181 ceph-mon[25762]: pgmap v623: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:38.127 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:37 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:38.127 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:37 smithi181 ceph-mon[25762]: pgmap v624: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:38.127 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:37 smithi181 ceph-mon[25762]: pgmap v625: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:38.127 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:37 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:38.127 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:37 smithi181 ceph-mon[25762]: pgmap v626: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:38.127 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:37 smithi181 ceph-mon[25762]: pgmap v627: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:38.127 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:37 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:38.127 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:37 smithi181 ceph-mon[25762]: pgmap v628: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:38.127 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:37 smithi181 ceph-mon[25762]: pgmap v629: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:38.127 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:37 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:38.127 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:37 smithi181 ceph-mon[25762]: pgmap v630: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 21 KiB/s rd, 20 op/s 2024-03-30T13:59:38.128 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:37 smithi181 ceph-mon[25762]: pgmap v631: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 21 KiB/s rd, 20 op/s 2024-03-30T13:59:38.128 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:37 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:38.128 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:37 smithi181 ceph-mon[25762]: pgmap v632: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 18 KiB/s rd, 18 op/s 2024-03-30T13:59:38.128 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:37 smithi181 ceph-mon[25762]: pgmap v633: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 18 KiB/s rd, 18 op/s 2024-03-30T13:59:38.128 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:37 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:38.128 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:37 smithi181 ceph-mon[25762]: pgmap v634: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 18 KiB/s rd, 18 op/s 2024-03-30T13:59:38.128 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:37 smithi181 ceph-mon[25762]: pgmap v635: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 18 KiB/s rd, 18 op/s 2024-03-30T13:59:38.128 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:37 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:38.128 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:37 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:38.128 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:37 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:38.128 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:37 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:38.128 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:37 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:38.128 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:37 smithi181 ceph-mon[25762]: pgmap v636: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:38.129 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:37 smithi181 ceph-mon[25762]: pgmap v637: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:38.129 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:37 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:38.129 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:37 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:38.129 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:37 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:38.129 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:37 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:38.129 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:37 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:38.129 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:37 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:38.129 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:37 smithi181 ceph-mon[25762]: pgmap v638: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:38.129 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:37 smithi181 ceph-mon[25762]: pgmap v639: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:38.129 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:37 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:38.129 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:37 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:38.129 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:37 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:38.129 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:37 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:38.130 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:37 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:38.130 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:37 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:38.130 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:37 smithi181 ceph-mon[25762]: pgmap v640: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:38.130 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:37 smithi181 ceph-mon[25762]: pgmap v641: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:38.130 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:37 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:38.130 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:37 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:38.130 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:37 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:38.130 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:37 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:38.130 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:37 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:38.130 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:37 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:38.130 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:37 smithi181 ceph-mon[25762]: pgmap v642: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:38.130 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:37 smithi181 ceph-mon[25762]: pgmap v643: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:38.130 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:37 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:38.130 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:37 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:38.131 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:37 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:38.131 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:37 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:38.131 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:37 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:38.131 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:37 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:38.131 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:37 smithi181 ceph-mon[25762]: pgmap v644: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:38.131 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:37 smithi181 ceph-mon[25762]: pgmap v645: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:38.131 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:37 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:38.131 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:37 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:38.131 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:37 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:38.131 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:37 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:38.131 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:37 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:38.131 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:37 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:38.132 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:37 smithi181 ceph-mon[25762]: pgmap v646: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:38.132 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:37 smithi181 ceph-mon[25762]: pgmap v647: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:38.132 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:37 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:38.132 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:37 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:38.132 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:37 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:38.132 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:37 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:38.132 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:37 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:38.132 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:37 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:38.132 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:37 smithi181 ceph-mon[25762]: pgmap v648: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:38.132 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:37 smithi181 ceph-mon[25762]: pgmap v649: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:38.132 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:37 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:38.133 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:37 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:38.133 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:37 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:38.133 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:37 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:38.133 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:37 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:38.133 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:37 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:38.133 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:37 smithi181 ceph-mon[25762]: pgmap v650: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:38.133 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:37 smithi181 ceph-mon[25762]: pgmap v651: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:38.133 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:37 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:38.134 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:37 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:38.134 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:37 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:38.134 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:37 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:38.134 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:37 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:38.134 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:37 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:38.134 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:37 smithi181 ceph-mon[25762]: pgmap v652: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:38.134 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:37 smithi181 ceph-mon[25762]: pgmap v653: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:38.134 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:37 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:38.134 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:37 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:38.134 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:37 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:38.134 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:37 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:38.134 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:37 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:38.134 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:37 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:38.135 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:37 smithi181 ceph-mon[25762]: pgmap v654: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:38.135 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:37 smithi181 ceph-mon[25762]: pgmap v655: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:38.135 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:37 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:38.135 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:37 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:38.135 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:37 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:38.135 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:37 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:38.135 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:37 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:38.135 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:37 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:38.135 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:37 smithi181 ceph-mon[25762]: pgmap v656: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:38.135 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:37 smithi181 ceph-mon[25762]: pgmap v657: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:38.135 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:37 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:38.135 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:37 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:38.136 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:37 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:38.136 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:37 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:38.136 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:37 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:38.136 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:37 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:38.136 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:37 smithi181 ceph-mon[25762]: pgmap v658: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:38.136 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:37 smithi181 ceph-mon[25762]: pgmap v659: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:38.136 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:37 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:38.136 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:37 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:38.331 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:37 smithi099 ceph-mon[24912]: pgmap v614: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:38.331 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:37 smithi099 ceph-mon[24912]: pgmap v615: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:38.331 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:37 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:38.331 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:37 smithi099 ceph-mon[24912]: pgmap v616: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:38.331 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:37 smithi099 ceph-mon[24912]: pgmap v617: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:38.331 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:37 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:38.332 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:37 smithi099 ceph-mon[24912]: pgmap v618: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:38.332 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:37 smithi099 ceph-mon[24912]: pgmap v619: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:38.332 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:37 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:38.332 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:37 smithi099 ceph-mon[24912]: pgmap v620: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:38.332 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:37 smithi099 ceph-mon[24912]: pgmap v621: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:38.332 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:37 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:38.332 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:37 smithi099 ceph-mon[24912]: pgmap v622: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:38.332 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:37 smithi099 ceph-mon[24912]: pgmap v623: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:38.332 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:37 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:38.333 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:37 smithi099 ceph-mon[24912]: pgmap v624: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:38.333 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:37 smithi099 ceph-mon[24912]: pgmap v625: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:38.333 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:37 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:38.333 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:37 smithi099 ceph-mon[24912]: pgmap v626: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:38.333 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:37 smithi099 ceph-mon[24912]: pgmap v627: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:38.333 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:37 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:38.333 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:37 smithi099 ceph-mon[24912]: pgmap v628: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:38.333 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:37 smithi099 ceph-mon[24912]: pgmap v629: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:38.333 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:37 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:38.333 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:37 smithi099 ceph-mon[24912]: pgmap v630: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 21 KiB/s rd, 20 op/s 2024-03-30T13:59:38.334 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:37 smithi099 ceph-mon[24912]: pgmap v631: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 21 KiB/s rd, 20 op/s 2024-03-30T13:59:38.334 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:37 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:38.334 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:37 smithi099 ceph-mon[24912]: pgmap v632: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 18 KiB/s rd, 18 op/s 2024-03-30T13:59:38.334 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:37 smithi099 ceph-mon[24912]: pgmap v633: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 18 KiB/s rd, 18 op/s 2024-03-30T13:59:38.334 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:37 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:38.334 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:37 smithi099 ceph-mon[24912]: pgmap v634: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 18 KiB/s rd, 18 op/s 2024-03-30T13:59:38.334 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:37 smithi099 ceph-mon[29691]: pgmap v614: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:38.335 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:37 smithi099 ceph-mon[29691]: pgmap v615: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:38.335 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:37 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:38.335 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:37 smithi099 ceph-mon[29691]: pgmap v616: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:38.335 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:37 smithi099 ceph-mon[29691]: pgmap v617: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:38.335 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:37 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:38.335 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:37 smithi099 ceph-mon[29691]: pgmap v618: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:38.335 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:37 smithi099 ceph-mon[29691]: pgmap v619: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:38.335 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:37 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:38.335 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:37 smithi099 ceph-mon[29691]: pgmap v620: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:38.336 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:37 smithi099 ceph-mon[29691]: pgmap v621: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:38.336 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:37 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:38.336 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:37 smithi099 ceph-mon[29691]: pgmap v622: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:38.336 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:37 smithi099 ceph-mon[29691]: pgmap v623: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:38.336 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:37 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:38.336 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:37 smithi099 ceph-mon[29691]: pgmap v624: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:38.336 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:37 smithi099 ceph-mon[29691]: pgmap v625: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:38.337 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:37 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:38.337 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:37 smithi099 ceph-mon[29691]: pgmap v626: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:38.337 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:37 smithi099 ceph-mon[29691]: pgmap v627: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:38.337 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:37 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:38.337 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:37 smithi099 ceph-mon[29691]: pgmap v628: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:38.337 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:37 smithi099 ceph-mon[29691]: pgmap v629: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:38.337 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:37 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:38.337 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:37 smithi099 ceph-mon[29691]: pgmap v630: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 21 KiB/s rd, 20 op/s 2024-03-30T13:59:38.337 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:37 smithi099 ceph-mon[29691]: pgmap v631: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 21 KiB/s rd, 20 op/s 2024-03-30T13:59:38.337 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:37 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:38.337 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:37 smithi099 ceph-mon[29691]: pgmap v632: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 18 KiB/s rd, 18 op/s 2024-03-30T13:59:38.337 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:37 smithi099 ceph-mon[29691]: pgmap v633: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 18 KiB/s rd, 18 op/s 2024-03-30T13:59:38.337 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:37 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:38.338 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:37 smithi099 ceph-mon[29691]: pgmap v634: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 18 KiB/s rd, 18 op/s 2024-03-30T13:59:38.338 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:37 smithi099 ceph-mon[24912]: pgmap v635: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 18 KiB/s rd, 18 op/s 2024-03-30T13:59:38.338 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:37 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:38.338 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:37 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:38.338 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:37 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:38.339 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:37 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:38.339 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:37 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:38.339 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:37 smithi099 ceph-mon[24912]: pgmap v636: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:38.339 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:37 smithi099 ceph-mon[24912]: pgmap v637: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:38.339 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:37 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:38.339 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:37 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:38.339 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:37 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:38.339 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:37 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:38.340 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:37 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:38.340 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:37 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:38.340 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:37 smithi099 ceph-mon[24912]: pgmap v638: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:38.340 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:37 smithi099 ceph-mon[24912]: pgmap v639: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:38.340 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:37 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:38.340 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:37 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:38.340 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:37 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:38.340 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:37 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:38.340 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:37 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:38.340 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:37 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:38.341 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:37 smithi099 ceph-mon[24912]: pgmap v640: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:38.341 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:37 smithi099 ceph-mon[24912]: pgmap v641: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:38.341 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:37 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:38.341 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:37 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:38.341 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:37 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:38.341 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:37 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:38.341 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:37 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:38.341 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:37 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:38.341 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:37 smithi099 ceph-mon[24912]: pgmap v642: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:38.341 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:37 smithi099 ceph-mon[24912]: pgmap v643: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:38.341 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:37 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:38.341 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:37 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:38.342 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:37 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:38.342 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:37 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:38.342 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:37 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:38.342 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:37 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:38.342 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:37 smithi099 ceph-mon[24912]: pgmap v644: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:38.342 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:37 smithi099 ceph-mon[24912]: pgmap v645: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:38.342 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:37 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:38.342 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:37 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:38.342 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:37 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:38.342 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:37 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:38.342 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:37 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:38.342 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:37 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:38.342 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:37 smithi099 ceph-mon[24912]: pgmap v646: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:38.342 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:37 smithi099 ceph-mon[24912]: pgmap v647: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:38.342 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:37 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:38.343 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:37 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:38.343 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:37 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:38.343 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:37 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:38.343 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:37 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:38.343 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:37 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:38.343 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:37 smithi099 ceph-mon[24912]: pgmap v648: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:38.343 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:37 smithi099 ceph-mon[24912]: pgmap v649: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:38.343 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:37 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:38.343 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:37 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:38.343 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:37 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:38.344 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:37 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:38.344 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:37 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:38.344 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:37 smithi099 ceph-mon[29691]: pgmap v635: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 18 KiB/s rd, 18 op/s 2024-03-30T13:59:38.344 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:37 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:38.344 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:37 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:38.344 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:37 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:38.344 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:37 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:38.344 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:37 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:38.344 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:37 smithi099 ceph-mon[29691]: pgmap v636: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:38.344 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:37 smithi099 ceph-mon[29691]: pgmap v637: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:38.345 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:37 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:38.345 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:37 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:38.345 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:37 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:38.345 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:37 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:38.345 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:37 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:38.345 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:37 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:38.345 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:37 smithi099 ceph-mon[29691]: pgmap v638: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:38.345 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:37 smithi099 ceph-mon[29691]: pgmap v639: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:38.345 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:37 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:38.345 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:37 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:38.345 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:37 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:38.345 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:37 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:38.345 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:37 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:38.345 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:37 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:38.345 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:37 smithi099 ceph-mon[29691]: pgmap v640: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:38.346 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:37 smithi099 ceph-mon[29691]: pgmap v641: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:38.346 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:37 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:38.346 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:37 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:38.346 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:37 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:38.346 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:37 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:38.346 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:37 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:38.346 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:37 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:38.346 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:37 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:38.347 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:37 smithi099 ceph-mon[24912]: pgmap v650: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:38.347 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:37 smithi099 ceph-mon[24912]: pgmap v651: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:38.347 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:37 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:38.347 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:37 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:38.347 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:37 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:38.347 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:37 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:38.347 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:37 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:38.347 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:37 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:38.347 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:37 smithi099 ceph-mon[24912]: pgmap v652: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:38.347 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:37 smithi099 ceph-mon[24912]: pgmap v653: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:38.347 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:37 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:38.347 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:37 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:38.347 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:37 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:38.348 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:37 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:38.348 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:37 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:38.348 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:37 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:38.348 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:37 smithi099 ceph-mon[24912]: pgmap v654: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:38.348 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:37 smithi099 ceph-mon[24912]: pgmap v655: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:38.348 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:37 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:38.348 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:37 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:38.348 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:37 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:38.348 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:37 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:38.348 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:37 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:38.348 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:37 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:38.348 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:37 smithi099 ceph-mon[24912]: pgmap v656: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:38.348 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:37 smithi099 ceph-mon[24912]: pgmap v657: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:38.349 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:37 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:38.349 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:37 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:38.349 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:37 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:38.349 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:37 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:38.349 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:37 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:38.349 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:37 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:38.349 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:37 smithi099 ceph-mon[24912]: pgmap v658: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:38.349 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:37 smithi099 ceph-mon[24912]: pgmap v659: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:38.349 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:37 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:38.349 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:37 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:38.350 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:37 smithi099 ceph-mon[29691]: pgmap v642: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:38.350 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:37 smithi099 ceph-mon[29691]: pgmap v643: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:38.350 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:37 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:38.350 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:37 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:38.350 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:37 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:38.350 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:37 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:38.350 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:37 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:38.350 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:37 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:38.350 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:37 smithi099 ceph-mon[29691]: pgmap v644: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:38.350 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:37 smithi099 ceph-mon[29691]: pgmap v645: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:38.350 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:37 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:38.351 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:37 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:38.351 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:37 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:38.351 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:37 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:38.351 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:37 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:38.351 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:37 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:38.351 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:37 smithi099 ceph-mon[29691]: pgmap v646: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:38.351 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:37 smithi099 ceph-mon[29691]: pgmap v647: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:38.351 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:37 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:38.351 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:37 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:38.351 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:37 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:38.351 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:37 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:38.351 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:37 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:38.351 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:37 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:38.352 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:37 smithi099 ceph-mon[29691]: pgmap v648: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:38.352 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:37 smithi099 ceph-mon[29691]: pgmap v649: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:38.352 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:37 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:38.352 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:37 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:38.352 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:37 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:38.352 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:37 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:38.352 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:37 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:38.352 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:37 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:38.352 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:37 smithi099 ceph-mon[29691]: pgmap v650: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:38.352 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:37 smithi099 ceph-mon[29691]: pgmap v651: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:38.352 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:37 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:38.352 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:37 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:38.352 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:37 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:38.352 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:37 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:38.353 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:37 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:38.353 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:37 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:38.353 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:37 smithi099 ceph-mon[29691]: pgmap v652: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:38.353 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:37 smithi099 ceph-mon[29691]: pgmap v653: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:38.353 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:37 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:38.353 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:37 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:38.353 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:37 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:38.353 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:37 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:38.353 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:37 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:38.353 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:37 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:38.353 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:37 smithi099 ceph-mon[29691]: pgmap v654: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:38.353 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:37 smithi099 ceph-mon[29691]: pgmap v655: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:38.353 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:37 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:38.353 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:37 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:38.353 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:37 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:38.354 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:37 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:38.354 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:37 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:38.354 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:37 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:38.354 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:37 smithi099 ceph-mon[29691]: pgmap v656: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:38.354 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:37 smithi099 ceph-mon[29691]: pgmap v657: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:38.354 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:37 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:38.354 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:37 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:38.354 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:37 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:38.354 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:37 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:38.354 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:37 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:38.354 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:37 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:38.354 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:37 smithi099 ceph-mon[29691]: pgmap v658: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:38.355 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:37 smithi099 ceph-mon[29691]: pgmap v659: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:38.355 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:37 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:38.355 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:37 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:38.500 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 13:59:38 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-x[85749]: 2024-03-30T13:59:38.251+0000 7efedf1ba200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-03-30T13:59:39.201 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 13:59:38 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-x[85749]: 2024-03-30T13:59:38.856+0000 7efedf1ba200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-03-30T13:59:39.201 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 13:59:38 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-x[85749]: 2024-03-30T13:59:38.966+0000 7efedf1ba200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-03-30T13:59:39.201 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:38 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:39.201 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:38 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:39.202 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:38 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:39.202 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:38 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:39.202 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:38 smithi181 ceph-mon[25762]: pgmap v660: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:39.202 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:38 smithi181 ceph-mon[25762]: pgmap v661: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:39.202 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:38 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:39.202 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:38 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:39.202 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:38 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:39.202 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:38 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:39.202 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:38 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:39.202 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:38 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:39.202 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:38 smithi181 ceph-mon[25762]: pgmap v662: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:39.202 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:38 smithi181 ceph-mon[25762]: pgmap v663: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:39.203 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:38 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:39.203 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:38 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:39.203 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:38 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:39.203 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:38 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:39.203 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:38 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:39.203 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:38 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:39.203 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:38 smithi181 ceph-mon[25762]: pgmap v664: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:39.203 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:38 smithi181 ceph-mon[25762]: pgmap v665: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:39.203 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:38 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:39.203 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:38 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:39.203 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:38 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:39.203 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:38 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:39.203 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:38 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:39.203 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:38 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:39.203 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:38 smithi181 ceph-mon[25762]: pgmap v666: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:39.204 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:38 smithi181 ceph-mon[25762]: pgmap v667: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:39.204 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:38 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:39.204 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:38 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:39.204 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:38 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:39.204 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:38 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:39.204 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:38 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:39.204 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:38 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:39.204 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:38 smithi181 ceph-mon[25762]: pgmap v668: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:39.204 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:38 smithi181 ceph-mon[25762]: pgmap v669: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:39.204 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:38 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:39.204 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:38 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:39.204 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:38 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:39.204 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:38 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:39.204 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:38 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:39.204 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:38 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:39.205 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:38 smithi181 ceph-mon[25762]: pgmap v670: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:39.205 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:38 smithi181 ceph-mon[25762]: pgmap v671: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:39.205 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:38 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:39.205 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:38 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:39.205 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:38 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:39.205 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:38 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:39.205 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:38 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:39.205 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:38 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:39.205 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:38 smithi181 ceph-mon[25762]: pgmap v672: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:39.205 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:38 smithi181 ceph-mon[25762]: pgmap v673: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:39.205 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:38 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:39.205 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:38 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:39.205 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:38 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:39.205 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:38 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:39.205 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:38 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:39.206 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:38 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:39.206 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:38 smithi181 ceph-mon[25762]: pgmap v674: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:39.206 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:38 smithi181 ceph-mon[25762]: pgmap v675: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:39.206 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:38 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:39.206 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:38 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:39.206 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:38 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:39.206 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:38 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:39.206 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:38 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:39.206 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:38 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:39.206 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:38 smithi181 ceph-mon[25762]: pgmap v676: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:39.206 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:38 smithi181 ceph-mon[25762]: pgmap v677: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:39.206 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:38 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:39.206 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:38 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:39.206 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:38 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:39.207 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:38 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:39.207 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:38 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:39.207 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:38 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:39.207 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:38 smithi181 ceph-mon[25762]: pgmap v678: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:39.207 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:38 smithi181 ceph-mon[25762]: pgmap v679: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:39.207 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:38 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:39.207 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:38 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:39.207 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:38 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:39.207 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:38 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:39.207 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:38 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:39.207 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:38 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:39.207 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:38 smithi181 ceph-mon[25762]: pgmap v680: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:39.207 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:38 smithi181 ceph-mon[25762]: pgmap v681: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:39.207 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:38 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:39.207 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:38 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:39.331 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:38 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:39.331 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:38 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:39.331 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:38 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:39.331 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:38 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:39.331 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:38 smithi099 ceph-mon[24912]: pgmap v660: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:39.331 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:38 smithi099 ceph-mon[24912]: pgmap v661: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:39.331 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:38 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:39.331 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:38 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:39.332 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:38 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:39.332 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:38 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:39.332 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:38 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:39.332 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:38 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:39.332 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:38 smithi099 ceph-mon[24912]: pgmap v662: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:39.332 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:38 smithi099 ceph-mon[24912]: pgmap v663: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:39.332 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:38 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:39.332 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:38 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:39.332 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:38 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:39.332 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:38 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:39.332 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:38 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:39.332 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:38 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:39.332 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:38 smithi099 ceph-mon[24912]: pgmap v664: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:39.333 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:38 smithi099 ceph-mon[24912]: pgmap v665: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:39.333 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:38 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:39.333 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:38 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:39.333 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:38 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:39.333 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:38 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:39.333 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:38 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:39.333 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:38 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:39.333 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:38 smithi099 ceph-mon[24912]: pgmap v666: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:39.333 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:38 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:39.333 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:38 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:39.333 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:38 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:39.334 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:38 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:39.334 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:38 smithi099 ceph-mon[29691]: pgmap v660: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:39.334 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:38 smithi099 ceph-mon[29691]: pgmap v661: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:39.334 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:38 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:39.334 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:38 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:39.334 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:38 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:39.334 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:38 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:39.334 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:38 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:39.334 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:38 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:39.334 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:38 smithi099 ceph-mon[29691]: pgmap v662: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:39.334 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:38 smithi099 ceph-mon[29691]: pgmap v663: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:39.334 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:38 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:39.334 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:38 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:39.334 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:38 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:39.335 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:38 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:39.335 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:38 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:39.335 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:38 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:39.335 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:38 smithi099 ceph-mon[29691]: pgmap v664: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:39.335 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:38 smithi099 ceph-mon[29691]: pgmap v665: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:39.335 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:38 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:39.335 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:38 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:39.335 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:38 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:39.335 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:38 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:39.335 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:38 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:39.336 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:38 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:39.336 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:38 smithi099 ceph-mon[29691]: pgmap v666: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:39.336 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:38 smithi099 ceph-mon[24912]: pgmap v667: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:39.336 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:38 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:39.336 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:38 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:39.336 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:38 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:39.336 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:38 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:39.336 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:38 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:39.337 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:38 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:39.337 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:38 smithi099 ceph-mon[24912]: pgmap v668: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:39.337 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:38 smithi099 ceph-mon[24912]: pgmap v669: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:39.337 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:38 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:39.337 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:38 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:39.337 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:38 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:39.337 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:38 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:39.337 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:38 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:39.337 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:38 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:39.337 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:38 smithi099 ceph-mon[24912]: pgmap v670: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:39.337 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:38 smithi099 ceph-mon[24912]: pgmap v671: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:39.337 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:38 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:39.337 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:38 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:39.337 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:38 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:39.337 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:38 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:39.338 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:38 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:39.338 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:38 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:39.338 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:38 smithi099 ceph-mon[24912]: pgmap v672: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:39.338 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:38 smithi099 ceph-mon[24912]: pgmap v673: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:39.338 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:38 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:39.338 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:38 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:39.338 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:38 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:39.338 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:38 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:39.338 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:38 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:39.338 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:38 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:39.338 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:38 smithi099 ceph-mon[24912]: pgmap v674: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:39.338 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:38 smithi099 ceph-mon[24912]: pgmap v675: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:39.338 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:38 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:39.339 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:38 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:39.339 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:38 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:39.339 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:38 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:39.339 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:38 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:39.339 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:38 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:39.339 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:38 smithi099 ceph-mon[24912]: pgmap v676: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:39.339 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:38 smithi099 ceph-mon[24912]: pgmap v677: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:39.339 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:38 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:39.339 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:38 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:39.339 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:38 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:39.339 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:38 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:39.339 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:38 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:39.339 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:38 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:39.339 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:38 smithi099 ceph-mon[24912]: pgmap v678: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:39.339 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:38 smithi099 ceph-mon[24912]: pgmap v679: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:39.340 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:38 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:39.340 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:38 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:39.340 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:38 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:39.340 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:38 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:39.340 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:38 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:39.340 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:38 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:39.340 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:38 smithi099 ceph-mon[24912]: pgmap v680: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:39.340 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:38 smithi099 ceph-mon[24912]: pgmap v681: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:39.340 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:38 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:39.340 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:38 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:39.341 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:38 smithi099 ceph-mon[29691]: pgmap v667: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:39.341 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:38 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:39.341 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:38 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:39.341 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:38 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:39.341 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:38 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:39.341 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:38 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:39.341 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:38 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:39.341 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:38 smithi099 ceph-mon[29691]: pgmap v668: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:39.341 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:38 smithi099 ceph-mon[29691]: pgmap v669: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:39.341 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:38 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:39.341 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:38 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:39.341 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:38 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:39.341 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:38 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:39.342 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:38 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:39.342 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:38 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:39.342 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:38 smithi099 ceph-mon[29691]: pgmap v670: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:39.342 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:38 smithi099 ceph-mon[29691]: pgmap v671: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:39.342 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:38 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:39.342 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:38 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:39.342 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:38 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:39.342 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:38 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:39.342 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:38 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:39.342 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:38 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:39.342 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:38 smithi099 ceph-mon[29691]: pgmap v672: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:39.342 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:38 smithi099 ceph-mon[29691]: pgmap v673: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:39.342 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:38 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:39.342 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:38 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:39.343 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:38 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:39.343 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:38 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:39.343 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:38 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:39.343 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:38 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:39.343 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:38 smithi099 ceph-mon[29691]: pgmap v674: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:39.343 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:38 smithi099 ceph-mon[29691]: pgmap v675: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:39.343 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:38 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:39.343 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:38 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:39.343 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:38 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:39.343 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:38 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:39.343 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:38 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:39.343 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:38 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:39.343 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:38 smithi099 ceph-mon[29691]: pgmap v676: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:39.343 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:38 smithi099 ceph-mon[29691]: pgmap v677: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:39.344 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:38 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:39.344 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:38 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:39.344 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:38 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:39.344 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:38 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:39.344 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:38 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:39.344 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:38 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:39.344 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:38 smithi099 ceph-mon[29691]: pgmap v678: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:39.344 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:38 smithi099 ceph-mon[29691]: pgmap v679: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:39.344 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:38 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:39.344 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:38 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:39.344 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:38 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:39.344 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:38 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:39.344 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:38 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:39.344 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:38 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:39.344 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:38 smithi099 ceph-mon[29691]: pgmap v680: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:39.345 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:38 smithi099 ceph-mon[29691]: pgmap v681: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:39.345 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:38 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:39.345 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:38 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:39.459 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 13:59:39 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-x[85749]: 2024-03-30T13:59:39.207+0000 7efedf1ba200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-03-30T13:59:39.460 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 13:59:39 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-x[85749]: [30/Mar/2024:13:59:39] ENGINE Bus STARTING 2024-03-30T13:59:39.460 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 13:59:39 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-x[85749]: CherryPy Checker: 2024-03-30T13:59:39.460 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 13:59:39 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-x[85749]: The Application mounted at '' has an empty config. 2024-03-30T13:59:39.460 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 13:59:39 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-x[85749]: 2024-03-30T13:59:39.460 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 13:59:39 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-x[85749]: [30/Mar/2024:13:59:39] ENGINE Serving on http://:::9283 2024-03-30T13:59:39.460 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 13:59:39 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-x[85749]: [30/Mar/2024:13:59:39] ENGINE Bus STARTED 2024-03-30T13:59:40.064 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:39 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:40.064 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:39 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:40.064 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:39 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:40.064 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:39 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:40.064 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:39 smithi181 ceph-mon[25762]: pgmap v682: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:40.064 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:39 smithi181 ceph-mon[25762]: pgmap v683: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:40.065 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:39 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:40.065 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:39 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:40.065 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:39 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:40.065 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:39 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:40.065 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:39 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:40.065 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:39 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:40.065 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:39 smithi181 ceph-mon[25762]: pgmap v684: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:40.065 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:39 smithi181 ceph-mon[25762]: pgmap v685: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:40.065 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:39 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:40.065 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:39 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:40.065 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:39 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:40.065 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:39 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:40.065 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:39 smithi181 ceph-mon[25762]: Standby manager daemon x restarted 2024-03-30T13:59:40.065 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:39 smithi181 ceph-mon[25762]: Standby manager daemon x started 2024-03-30T13:59:40.066 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:39 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:40.066 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:39 smithi181 ceph-mon[25762]: from='mgr.? 172.21.15.181:0/2959469637' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/crt"}]: dispatch 2024-03-30T13:59:40.066 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:39 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:40.066 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:39 smithi181 ceph-mon[25762]: from='mgr.? 172.21.15.181:0/2959469637' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-03-30T13:59:40.066 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:39 smithi181 ceph-mon[25762]: pgmap v686: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:40.066 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:39 smithi181 ceph-mon[25762]: pgmap v687: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:40.066 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:39 smithi181 ceph-mon[25762]: from='mgr.? 172.21.15.181:0/2959469637' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/key"}]: dispatch 2024-03-30T13:59:40.066 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:39 smithi181 ceph-mon[25762]: from='mgr.? 172.21.15.181:0/2959469637' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-03-30T13:59:40.066 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:39 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:40.066 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:39 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:40.067 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:39 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:40.067 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:39 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:40.067 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:39 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:40.067 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:39 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:40.067 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:39 smithi181 ceph-mon[25762]: pgmap v688: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:40.067 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:39 smithi181 ceph-mon[25762]: pgmap v689: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:40.067 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:39 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:40.067 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:39 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:40.067 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:39 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:40.067 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:39 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:40.068 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:39 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:40.068 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:39 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:40.068 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:39 smithi181 ceph-mon[25762]: pgmap v690: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:40.068 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:39 smithi181 ceph-mon[25762]: pgmap v691: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:40.068 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:39 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:40.068 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:39 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:40.068 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:39 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:40.068 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:39 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:40.068 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:39 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:40.068 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:39 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:40.068 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:39 smithi181 ceph-mon[25762]: pgmap v692: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:40.068 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:39 smithi181 ceph-mon[25762]: pgmap v693: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:40.068 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:39 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:40.068 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:39 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:40.069 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:39 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:40.069 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:39 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:40.069 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:39 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:40.069 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:39 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:40.069 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:39 smithi181 ceph-mon[25762]: pgmap v694: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:40.069 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:39 smithi181 ceph-mon[25762]: pgmap v695: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:40.069 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:39 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:40.069 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:39 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:40.069 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:39 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:40.069 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:39 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:40.069 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:39 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:40.069 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:39 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:40.069 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:39 smithi181 ceph-mon[25762]: pgmap v696: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:40.069 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:39 smithi181 ceph-mon[25762]: pgmap v697: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:40.070 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:39 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:40.070 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:39 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:40.070 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:39 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:40.070 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:39 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:40.070 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:39 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:40.070 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:39 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:40.070 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:39 smithi181 ceph-mon[25762]: pgmap v698: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:40.070 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:39 smithi181 ceph-mon[25762]: pgmap v699: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:40.070 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:39 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:40.070 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:39 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:40.070 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:39 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:40.070 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:39 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:40.070 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:39 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:40.070 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:39 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:40.070 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:39 smithi181 ceph-mon[25762]: pgmap v700: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:40.071 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:39 smithi181 ceph-mon[25762]: pgmap v701: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:40.071 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:39 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:40.071 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:39 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:40.071 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:39 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:40.071 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:39 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:40.071 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:39 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:40.071 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:39 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:40.071 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:39 smithi181 ceph-mon[25762]: pgmap v702: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:40.071 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:39 smithi181 ceph-mon[25762]: pgmap v703: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:40.071 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:39 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:40.071 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:39 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:40.331 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:39 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:40.331 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:39 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:40.332 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:39 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:40.332 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:39 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:40.332 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:39 smithi099 ceph-mon[24912]: pgmap v682: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:40.332 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:39 smithi099 ceph-mon[24912]: pgmap v683: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:40.332 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:39 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:40.332 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:39 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:40.332 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:39 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:40.332 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:39 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:40.332 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:39 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:40.332 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:39 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:40.332 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:39 smithi099 ceph-mon[24912]: pgmap v684: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:40.332 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:39 smithi099 ceph-mon[24912]: pgmap v685: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:40.332 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:39 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:40.333 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:39 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:40.333 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:39 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:40.333 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:39 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:40.333 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:39 smithi099 ceph-mon[24912]: Standby manager daemon x restarted 2024-03-30T13:59:40.333 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:39 smithi099 ceph-mon[24912]: Standby manager daemon x started 2024-03-30T13:59:40.333 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:39 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:40.333 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:39 smithi099 ceph-mon[24912]: from='mgr.? 172.21.15.181:0/2959469637' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/crt"}]: dispatch 2024-03-30T13:59:40.333 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:39 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:40.333 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:39 smithi099 ceph-mon[24912]: from='mgr.? 172.21.15.181:0/2959469637' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-03-30T13:59:40.333 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:39 smithi099 ceph-mon[24912]: pgmap v686: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:40.333 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:39 smithi099 ceph-mon[24912]: pgmap v687: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:40.333 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:39 smithi099 ceph-mon[24912]: from='mgr.? 172.21.15.181:0/2959469637' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/key"}]: dispatch 2024-03-30T13:59:40.333 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:39 smithi099 ceph-mon[24912]: from='mgr.? 172.21.15.181:0/2959469637' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-03-30T13:59:40.333 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:39 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:40.333 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:39 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:40.334 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:39 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:40.334 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:39 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:40.334 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:39 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:40.334 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:39 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:40.334 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:39 smithi099 ceph-mon[29691]: pgmap v682: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:40.334 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:39 smithi099 ceph-mon[29691]: pgmap v683: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:40.334 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:39 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:40.334 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:39 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:40.335 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:39 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:40.335 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:39 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:40.335 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:39 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:40.335 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:39 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:40.335 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:39 smithi099 ceph-mon[29691]: pgmap v684: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:40.335 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:39 smithi099 ceph-mon[29691]: pgmap v685: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:40.335 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:39 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:40.335 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:39 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:40.335 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:39 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:40.335 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:39 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:40.335 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:39 smithi099 ceph-mon[29691]: Standby manager daemon x restarted 2024-03-30T13:59:40.335 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:39 smithi099 ceph-mon[29691]: Standby manager daemon x started 2024-03-30T13:59:40.335 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:39 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:40.335 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:39 smithi099 ceph-mon[29691]: from='mgr.? 172.21.15.181:0/2959469637' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/crt"}]: dispatch 2024-03-30T13:59:40.336 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:39 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:40.336 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:39 smithi099 ceph-mon[29691]: from='mgr.? 172.21.15.181:0/2959469637' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-03-30T13:59:40.336 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:39 smithi099 ceph-mon[29691]: pgmap v686: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:40.336 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:39 smithi099 ceph-mon[29691]: pgmap v687: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:40.336 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:39 smithi099 ceph-mon[29691]: from='mgr.? 172.21.15.181:0/2959469637' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/key"}]: dispatch 2024-03-30T13:59:40.336 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:39 smithi099 ceph-mon[29691]: from='mgr.? 172.21.15.181:0/2959469637' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-03-30T13:59:40.336 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:39 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:40.336 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:39 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:40.336 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:39 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:40.336 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:39 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:40.336 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:39 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:40.337 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:39 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:40.337 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:39 smithi099 ceph-mon[24912]: pgmap v688: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:40.337 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:39 smithi099 ceph-mon[24912]: pgmap v689: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:40.337 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:39 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:40.337 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:39 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:40.337 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:39 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:40.337 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:39 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:40.337 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:39 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:40.337 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:39 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:40.337 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:39 smithi099 ceph-mon[24912]: pgmap v690: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:40.337 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:39 smithi099 ceph-mon[24912]: pgmap v691: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:40.337 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:39 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:40.337 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:39 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:40.337 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:39 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:40.338 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:39 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:40.338 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:39 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:40.338 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:39 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:40.338 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:39 smithi099 ceph-mon[24912]: pgmap v692: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:40.338 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:39 smithi099 ceph-mon[24912]: pgmap v693: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:40.338 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:39 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:40.338 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:39 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:40.338 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:39 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:40.338 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:39 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:40.338 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:39 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:40.338 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:39 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:40.338 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:39 smithi099 ceph-mon[24912]: pgmap v694: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:40.338 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:39 smithi099 ceph-mon[24912]: pgmap v695: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:40.339 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:39 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:40.339 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:39 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:40.339 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:39 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:40.339 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:39 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:40.339 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:39 smithi099 ceph-mon[29691]: pgmap v688: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:40.339 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:39 smithi099 ceph-mon[29691]: pgmap v689: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:40.339 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:39 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:40.339 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:39 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:40.339 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:39 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:40.339 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:39 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:40.339 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:39 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:40.340 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:39 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:40.340 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:39 smithi099 ceph-mon[29691]: pgmap v690: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:40.340 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:39 smithi099 ceph-mon[29691]: pgmap v691: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:40.340 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:39 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:40.340 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:39 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:40.340 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:39 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:40.340 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:39 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:40.340 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:39 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:40.340 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:39 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:40.340 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:39 smithi099 ceph-mon[29691]: pgmap v692: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:40.340 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:39 smithi099 ceph-mon[29691]: pgmap v693: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:40.340 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:39 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:40.340 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:39 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:40.341 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:39 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:40.341 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:39 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:40.341 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:39 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:40.341 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:39 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:40.341 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:39 smithi099 ceph-mon[29691]: pgmap v694: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:40.341 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:39 smithi099 ceph-mon[29691]: pgmap v695: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:40.341 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:39 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:40.341 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:39 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:40.341 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:39 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:40.341 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:39 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:40.341 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:39 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:40.342 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:39 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:40.342 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:39 smithi099 ceph-mon[24912]: pgmap v696: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:40.342 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:39 smithi099 ceph-mon[24912]: pgmap v697: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:40.342 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:39 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:40.342 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:39 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:40.342 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:39 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:40.342 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:39 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:40.342 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:39 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:40.342 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:39 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:40.342 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:39 smithi099 ceph-mon[24912]: pgmap v698: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:40.342 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:39 smithi099 ceph-mon[24912]: pgmap v699: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:40.342 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:39 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:40.342 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:39 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:40.342 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:39 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:40.343 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:39 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:40.343 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:39 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:40.343 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:39 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:40.343 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:39 smithi099 ceph-mon[24912]: pgmap v700: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:40.343 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:39 smithi099 ceph-mon[24912]: pgmap v701: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:40.343 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:39 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:40.343 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:39 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:40.343 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:39 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:40.343 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:39 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:40.343 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:39 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:40.343 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:39 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:40.343 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:39 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:40.344 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:39 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:40.344 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:39 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:40.344 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:39 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:40.344 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:39 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:40.344 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:39 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:40.344 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:39 smithi099 ceph-mon[29691]: pgmap v696: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:40.344 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:39 smithi099 ceph-mon[29691]: pgmap v697: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:40.344 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:39 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:40.344 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:39 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:40.344 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:39 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:40.344 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:39 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:40.344 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:39 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:40.345 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:39 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:40.345 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:39 smithi099 ceph-mon[29691]: pgmap v698: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:40.345 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:39 smithi099 ceph-mon[29691]: pgmap v699: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:40.345 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:39 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:40.345 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:39 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:40.345 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:39 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:40.345 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:39 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:40.345 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:39 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:40.345 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:39 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:40.345 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:39 smithi099 ceph-mon[29691]: pgmap v700: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:40.345 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:39 smithi099 ceph-mon[29691]: pgmap v701: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:40.346 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:39 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:40.346 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:39 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:40.346 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:39 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:40.346 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:39 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:40.346 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:39 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:40.346 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:39 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:40.346 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:39 smithi099 ceph-mon[24912]: pgmap v702: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:40.346 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:39 smithi099 ceph-mon[24912]: pgmap v703: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:40.346 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:39 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:40.346 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:39 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:40.347 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:39 smithi099 ceph-mon[29691]: pgmap v702: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:40.347 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:39 smithi099 ceph-mon[29691]: pgmap v703: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:40.347 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:39 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:40.347 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:39 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:41.231 INFO:journalctl@ceph.alertmanager.a.smithi099.stdout:Mar 30 13:59:41 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-alertmanager-a[64884]: level=info ts=2024-03-30T13:59:41.010Z caller=notify.go:735 component=dispatcher receiver=ceph-dashboard integration=webhook[0] msg="Notify success" attempts=6 2024-03-30T13:59:41.232 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:40 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:41.232 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:40 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:41.232 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:40 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:41.232 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:40 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:41.232 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:40 smithi099 ceph-mon[24912]: pgmap v704: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:41.232 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:40 smithi099 ceph-mon[24912]: pgmap v705: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:41.232 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:40 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:41.233 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:40 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:41.233 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:40 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:41.233 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:40 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:41.233 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:40 smithi099 ceph-mon[24912]: mgrmap e44: y(active, since 85s), standbys: x 2024-03-30T13:59:41.233 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:40 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:41.233 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:40 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:41.233 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:40 smithi099 ceph-mon[24912]: pgmap v706: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:41.233 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:40 smithi099 ceph-mon[24912]: pgmap v707: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:41.233 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:40 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:41.233 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:40 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:41.233 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:40 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:41.233 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:40 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:41.234 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:40 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:41.234 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:40 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:41.234 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:40 smithi099 ceph-mon[24912]: pgmap v708: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:41.234 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:40 smithi099 ceph-mon[24912]: pgmap v709: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:41.234 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:40 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:41.234 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:40 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:41.234 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:40 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:41.234 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:40 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:41.234 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:40 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:41.234 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:40 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:41.234 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:40 smithi099 ceph-mon[24912]: pgmap v710: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:41.235 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:40 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:41.235 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:40 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:41.235 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:40 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:41.235 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:40 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:41.235 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:40 smithi099 ceph-mon[29691]: pgmap v704: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:41.235 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:40 smithi099 ceph-mon[29691]: pgmap v705: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:41.235 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:40 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:41.235 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:40 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:41.235 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:40 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:41.236 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:40 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:41.236 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:40 smithi099 ceph-mon[29691]: mgrmap e44: y(active, since 85s), standbys: x 2024-03-30T13:59:41.236 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:40 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:41.236 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:40 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:41.236 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:40 smithi099 ceph-mon[29691]: pgmap v706: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:41.236 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:40 smithi099 ceph-mon[29691]: pgmap v707: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:41.236 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:40 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:41.236 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:40 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:41.236 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:40 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:41.236 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:40 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:41.236 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:40 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:41.236 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:40 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:41.237 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:40 smithi099 ceph-mon[29691]: pgmap v708: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:41.237 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:40 smithi099 ceph-mon[29691]: pgmap v709: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:41.237 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:40 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:41.237 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:40 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:41.237 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:40 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:41.237 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:40 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:41.237 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:40 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:41.237 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:40 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:41.237 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:40 smithi099 ceph-mon[29691]: pgmap v710: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:41.238 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:40 smithi099 ceph-mon[24912]: pgmap v711: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:41.238 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:40 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:41.238 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:40 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:41.238 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:40 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:41.238 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:40 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:41.238 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:40 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:41.238 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:40 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:41.238 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:40 smithi099 ceph-mon[24912]: pgmap v712: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:41.238 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:40 smithi099 ceph-mon[24912]: pgmap v713: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:41.238 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:40 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:41.238 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:40 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:41.239 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:40 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:41.239 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:40 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:41.239 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:40 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:41.239 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:40 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:41.239 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:40 smithi099 ceph-mon[24912]: pgmap v714: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:41.239 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:40 smithi099 ceph-mon[24912]: pgmap v715: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:41.239 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:40 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:41.239 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:40 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:41.239 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:40 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:41.239 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:40 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:41.239 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:40 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:41.239 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:40 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:41.240 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:40 smithi099 ceph-mon[24912]: pgmap v716: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:41.240 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:40 smithi099 ceph-mon[24912]: pgmap v717: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:41.240 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:40 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:41.240 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:40 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:41.240 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:40 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:41.240 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:40 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:41.241 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:40 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:41.241 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:40 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:41.241 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:40 smithi099 ceph-mon[24912]: pgmap v718: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:41.241 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:40 smithi099 ceph-mon[24912]: pgmap v719: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:41.241 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:40 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:41.241 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:40 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:41.241 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:40 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:41.241 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:40 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:41.241 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:40 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:41.241 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:40 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:41.241 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:40 smithi099 ceph-mon[24912]: pgmap v720: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:41.241 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:40 smithi099 ceph-mon[24912]: pgmap v721: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:41.241 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:40 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:41.241 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:40 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:41.242 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:40 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:41.242 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:40 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:41.242 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:40 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:41.242 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:40 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:41.242 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:40 smithi099 ceph-mon[24912]: pgmap v722: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:41.242 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:40 smithi099 ceph-mon[24912]: pgmap v723: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:41.242 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:40 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:41.242 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:40 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:41.243 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:40 smithi099 ceph-mon[29691]: pgmap v711: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:41.243 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:40 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:41.243 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:40 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:41.243 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:40 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:41.243 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:40 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:41.243 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:40 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:41.243 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:40 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:41.243 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:40 smithi099 ceph-mon[29691]: pgmap v712: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:41.243 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:40 smithi099 ceph-mon[29691]: pgmap v713: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:41.243 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:40 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:41.244 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:40 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:41.244 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:40 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:41.244 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:40 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:41.244 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:40 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:41.244 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:40 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:41.244 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:40 smithi099 ceph-mon[29691]: pgmap v714: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:41.244 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:40 smithi099 ceph-mon[29691]: pgmap v715: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:41.244 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:40 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:41.244 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:40 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:41.244 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:40 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:41.244 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:40 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:41.244 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:40 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:41.244 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:40 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:41.245 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:40 smithi099 ceph-mon[29691]: pgmap v716: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:41.245 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:40 smithi099 ceph-mon[29691]: pgmap v717: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:41.245 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:40 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:41.245 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:40 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:41.245 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:40 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:41.245 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:40 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:41.245 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:40 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:41.245 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:40 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:41.245 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:40 smithi099 ceph-mon[29691]: pgmap v718: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:41.245 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:40 smithi099 ceph-mon[29691]: pgmap v719: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:41.245 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:40 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:41.245 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:40 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:41.246 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:40 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:41.246 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:40 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:41.246 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:40 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:41.246 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:40 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:41.246 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:40 smithi099 ceph-mon[29691]: pgmap v720: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:41.246 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:40 smithi099 ceph-mon[29691]: pgmap v721: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:41.246 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:40 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:41.246 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:40 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:41.246 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:40 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:41.246 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:40 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:41.246 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:40 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:41.246 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:40 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:41.246 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:40 smithi099 ceph-mon[29691]: pgmap v722: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:41.246 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:40 smithi099 ceph-mon[29691]: pgmap v723: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:41.247 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:40 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:41.247 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:40 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:41.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:40 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:41.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:40 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:41.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:40 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:41.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:40 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:41.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:40 smithi181 ceph-mon[25762]: pgmap v704: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:41.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:40 smithi181 ceph-mon[25762]: pgmap v705: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:41.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:40 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:41.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:40 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:41.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:40 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:41.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:40 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:41.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:40 smithi181 ceph-mon[25762]: mgrmap e44: y(active, since 85s), standbys: x 2024-03-30T13:59:41.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:40 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:41.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:40 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:41.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:40 smithi181 ceph-mon[25762]: pgmap v706: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:41.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:40 smithi181 ceph-mon[25762]: pgmap v707: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:41.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:40 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:41.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:40 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:41.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:40 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:41.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:40 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:41.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:40 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:41.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:40 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:41.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:40 smithi181 ceph-mon[25762]: pgmap v708: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:41.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:40 smithi181 ceph-mon[25762]: pgmap v709: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:41.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:40 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:41.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:40 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:41.253 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:40 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:41.253 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:40 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:41.253 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:40 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:41.253 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:40 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:41.253 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:40 smithi181 ceph-mon[25762]: pgmap v710: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:41.253 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:40 smithi181 ceph-mon[25762]: pgmap v711: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:41.253 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:40 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:41.253 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:40 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:41.253 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:40 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:41.253 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:40 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:41.253 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:40 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:41.254 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:40 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:41.254 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:40 smithi181 ceph-mon[25762]: pgmap v712: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:41.254 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:40 smithi181 ceph-mon[25762]: pgmap v713: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:41.254 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:40 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:41.254 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:40 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:41.254 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:40 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:41.254 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:40 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:41.254 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:40 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:41.254 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:40 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:41.254 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:40 smithi181 ceph-mon[25762]: pgmap v714: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:41.254 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:40 smithi181 ceph-mon[25762]: pgmap v715: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:41.254 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:40 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:41.254 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:40 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:41.254 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:40 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:41.255 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:40 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:41.255 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:40 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:41.255 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:40 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:41.255 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:40 smithi181 ceph-mon[25762]: pgmap v716: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:41.255 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:40 smithi181 ceph-mon[25762]: pgmap v717: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:41.255 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:40 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:41.255 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:40 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:41.255 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:40 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:41.255 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:40 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:41.255 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:40 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:41.255 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:40 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:41.256 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:40 smithi181 ceph-mon[25762]: pgmap v718: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:41.256 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:40 smithi181 ceph-mon[25762]: pgmap v719: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:41.256 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:40 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:41.256 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:40 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:41.256 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:40 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:41.256 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:40 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:41.256 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:40 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:41.256 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:40 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:41.256 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:40 smithi181 ceph-mon[25762]: pgmap v720: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:41.256 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:40 smithi181 ceph-mon[25762]: pgmap v721: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:41.256 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:40 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:41.256 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:40 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:41.257 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:40 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:41.257 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:40 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:41.257 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:40 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:41.257 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:40 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:41.257 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:40 smithi181 ceph-mon[25762]: pgmap v722: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:41.257 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:40 smithi181 ceph-mon[25762]: pgmap v723: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:41.257 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:40 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:41.257 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:40 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:42.161 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:41 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:42.161 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:41 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:42.161 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:41 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:42.161 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:41 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:42.161 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:41 smithi181 ceph-mon[25762]: pgmap v724: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:42.161 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:41 smithi181 ceph-mon[25762]: pgmap v725: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:42.161 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:41 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:42.162 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:41 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:42.162 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:41 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:42.162 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:41 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:42.162 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:41 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:42.162 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:41 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:42.162 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:41 smithi181 ceph-mon[25762]: pgmap v726: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:42.162 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:41 smithi181 ceph-mon[25762]: pgmap v727: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:42.162 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:41 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:42.162 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:41 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:42.162 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:41 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:42.162 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:41 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:42.162 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:41 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:42.162 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:41 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:42.163 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:41 smithi181 ceph-mon[25762]: pgmap v728: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:42.163 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:41 smithi181 ceph-mon[25762]: pgmap v729: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:42.163 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:41 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:42.163 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:41 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:42.163 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:41 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:42.163 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:41 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:42.163 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:41 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:42.163 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:41 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:42.163 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:41 smithi181 ceph-mon[25762]: pgmap v730: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:42.164 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:41 smithi181 ceph-mon[25762]: pgmap v731: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:42.164 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:41 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:42.164 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:41 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:42.164 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:41 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:42.164 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:41 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:42.164 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:41 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:42.164 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:41 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:42.165 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:41 smithi181 ceph-mon[25762]: pgmap v732: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:42.165 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:41 smithi181 ceph-mon[25762]: pgmap v733: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:42.165 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:41 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:42.165 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:41 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:42.165 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:41 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:42.165 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:41 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:42.165 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:41 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:42.165 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:41 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:42.165 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:41 smithi181 ceph-mon[25762]: pgmap v734: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 12 KiB/s rd, 12 op/s 2024-03-30T13:59:42.165 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:41 smithi181 ceph-mon[25762]: pgmap v735: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 12 KiB/s rd, 12 op/s 2024-03-30T13:59:42.165 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:41 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:42.165 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:41 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:42.165 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:41 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:42.166 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:41 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:42.166 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:41 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:42.166 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:41 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:42.166 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:41 smithi181 ceph-mon[25762]: pgmap v736: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 11 KiB/s rd, 11 op/s 2024-03-30T13:59:42.166 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:41 smithi181 ceph-mon[25762]: pgmap v737: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 11 KiB/s rd, 11 op/s 2024-03-30T13:59:42.166 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:41 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:42.166 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:41 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:42.166 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:41 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:42.166 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:41 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:42.166 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:41 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:42.166 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:41 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:42.166 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:41 smithi181 ceph-mon[25762]: pgmap v738: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 13 KiB/s rd, 13 op/s 2024-03-30T13:59:42.167 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:41 smithi181 ceph-mon[25762]: pgmap v739: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 13 KiB/s rd, 13 op/s 2024-03-30T13:59:42.167 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:41 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:42.167 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:41 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:42.331 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:41 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:42.331 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:41 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:42.331 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:41 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:42.331 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:41 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:42.331 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:41 smithi099 ceph-mon[24912]: pgmap v724: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:42.331 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:41 smithi099 ceph-mon[24912]: pgmap v725: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:42.331 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:41 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:42.332 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:41 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:42.332 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:41 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:42.332 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:41 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:42.332 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:41 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:42.332 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:41 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:42.332 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:41 smithi099 ceph-mon[24912]: pgmap v726: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:42.332 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:41 smithi099 ceph-mon[24912]: pgmap v727: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:42.332 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:41 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:42.332 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:41 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:42.332 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:41 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:42.332 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:41 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:42.332 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:41 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:42.332 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:41 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:42.332 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:41 smithi099 ceph-mon[24912]: pgmap v728: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:42.333 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:41 smithi099 ceph-mon[24912]: pgmap v729: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:42.333 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:41 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:42.333 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:41 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:42.333 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:41 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:42.333 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:41 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:42.333 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:41 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:42.333 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:41 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:42.333 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:41 smithi099 ceph-mon[24912]: pgmap v730: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:42.333 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:41 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:42.333 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:41 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:42.333 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:41 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:42.334 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:41 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:42.334 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:41 smithi099 ceph-mon[29691]: pgmap v724: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:42.334 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:41 smithi099 ceph-mon[29691]: pgmap v725: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:42.334 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:41 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:42.334 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:41 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:42.334 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:41 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:42.334 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:41 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:42.334 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:41 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:42.334 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:41 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:42.334 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:41 smithi099 ceph-mon[29691]: pgmap v726: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:42.334 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:41 smithi099 ceph-mon[29691]: pgmap v727: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:42.334 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:41 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:42.334 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:41 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:42.334 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:41 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:42.335 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:41 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:42.335 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:41 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:42.335 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:41 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:42.335 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:41 smithi099 ceph-mon[29691]: pgmap v728: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:42.335 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:41 smithi099 ceph-mon[29691]: pgmap v729: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:42.335 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:41 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:42.335 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:41 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:42.335 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:41 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:42.335 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:41 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:42.335 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:41 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:42.335 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:41 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:42.335 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:41 smithi099 ceph-mon[29691]: pgmap v730: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:42.336 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:41 smithi099 ceph-mon[24912]: pgmap v731: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:42.336 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:41 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:42.336 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:41 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:42.336 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:41 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:42.336 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:41 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:42.336 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:41 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:42.336 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:41 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:42.336 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:41 smithi099 ceph-mon[24912]: pgmap v732: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:42.336 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:41 smithi099 ceph-mon[24912]: pgmap v733: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:42.336 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:41 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:42.336 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:41 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:42.337 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:41 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:42.337 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:41 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:42.337 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:41 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:42.337 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:41 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:42.337 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:41 smithi099 ceph-mon[24912]: pgmap v734: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 12 KiB/s rd, 12 op/s 2024-03-30T13:59:42.337 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:41 smithi099 ceph-mon[24912]: pgmap v735: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 12 KiB/s rd, 12 op/s 2024-03-30T13:59:42.337 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:41 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:42.337 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:41 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:42.337 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:41 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:42.337 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:41 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:42.337 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:41 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:42.337 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:41 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:42.337 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:41 smithi099 ceph-mon[24912]: pgmap v736: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 11 KiB/s rd, 11 op/s 2024-03-30T13:59:42.337 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:41 smithi099 ceph-mon[24912]: pgmap v737: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 11 KiB/s rd, 11 op/s 2024-03-30T13:59:42.338 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:41 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:42.338 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:41 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:42.338 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:41 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:42.338 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:41 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:42.338 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:41 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:42.338 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:41 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:42.338 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:41 smithi099 ceph-mon[24912]: pgmap v738: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 13 KiB/s rd, 13 op/s 2024-03-30T13:59:42.338 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:41 smithi099 ceph-mon[24912]: pgmap v739: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 13 KiB/s rd, 13 op/s 2024-03-30T13:59:42.338 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:41 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:42.338 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:41 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:42.338 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:41 smithi099 ceph-mon[29691]: pgmap v731: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:42.339 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:41 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:42.339 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:41 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:42.339 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:41 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:42.339 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:41 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:42.339 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:41 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:42.339 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:41 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:42.339 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:41 smithi099 ceph-mon[29691]: pgmap v732: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:42.339 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:41 smithi099 ceph-mon[29691]: pgmap v733: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:42.339 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:41 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:42.339 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:41 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:42.339 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:41 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:42.339 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:41 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:42.339 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:41 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:42.339 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:41 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:42.340 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:41 smithi099 ceph-mon[29691]: pgmap v734: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 12 KiB/s rd, 12 op/s 2024-03-30T13:59:42.340 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:41 smithi099 ceph-mon[29691]: pgmap v735: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 12 KiB/s rd, 12 op/s 2024-03-30T13:59:42.340 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:41 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:42.340 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:41 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:42.340 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:41 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:42.340 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:41 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:42.340 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:41 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:42.340 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:41 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:42.340 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:41 smithi099 ceph-mon[29691]: pgmap v736: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 11 KiB/s rd, 11 op/s 2024-03-30T13:59:42.340 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:41 smithi099 ceph-mon[29691]: pgmap v737: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 11 KiB/s rd, 11 op/s 2024-03-30T13:59:42.340 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:41 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:42.340 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:41 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:42.340 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:41 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:42.340 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:41 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:42.341 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:41 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:42.341 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:41 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:42.341 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:41 smithi099 ceph-mon[29691]: pgmap v738: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 13 KiB/s rd, 13 op/s 2024-03-30T13:59:42.341 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:41 smithi099 ceph-mon[29691]: pgmap v739: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 13 KiB/s rd, 13 op/s 2024-03-30T13:59:42.341 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:41 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:42.341 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:41 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:43.081 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:42 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:43.081 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:42 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:43.081 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:42 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:43.082 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:42 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:43.082 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:42 smithi099 ceph-mon[24912]: pgmap v740: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:43.082 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:42 smithi099 ceph-mon[24912]: pgmap v741: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:43.082 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:42 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:43.082 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:42 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:43.082 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:42 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:43.082 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:42 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:43.082 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:42 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:43.082 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:42 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:43.082 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:42 smithi099 ceph-mon[24912]: pgmap v742: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:43.082 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:42 smithi099 ceph-mon[24912]: pgmap v743: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:43.082 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:42 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:43.082 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:42 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:43.083 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:42 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:43.083 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:42 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:43.083 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:42 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:43.083 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:42 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:43.083 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:42 smithi099 ceph-mon[24912]: pgmap v744: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:43.083 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:42 smithi099 ceph-mon[24912]: pgmap v745: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:43.083 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:42 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:43.083 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:42 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:43.083 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:42 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:43.083 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:42 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:43.083 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:42 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:43.083 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:42 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:43.083 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:42 smithi099 ceph-mon[24912]: pgmap v746: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:43.084 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:42 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:43.084 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:42 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:43.084 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:42 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:43.084 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:42 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:43.084 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:42 smithi099 ceph-mon[29691]: pgmap v740: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:43.084 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:42 smithi099 ceph-mon[29691]: pgmap v741: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:43.084 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:42 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:43.084 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:42 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:43.084 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:42 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:43.084 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:42 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:43.084 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:42 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:43.085 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:42 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:43.085 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:42 smithi099 ceph-mon[29691]: pgmap v742: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:43.085 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:42 smithi099 ceph-mon[29691]: pgmap v743: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:43.085 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:42 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:43.085 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:42 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:43.085 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:42 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:43.085 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:42 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:43.085 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:42 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:43.085 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:42 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:43.086 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:42 smithi099 ceph-mon[29691]: pgmap v744: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:43.086 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:42 smithi099 ceph-mon[29691]: pgmap v745: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:43.086 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:42 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:43.086 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:42 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:43.086 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:42 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:43.086 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:42 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:43.086 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:42 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:43.086 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:42 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:43.086 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:42 smithi099 ceph-mon[29691]: pgmap v746: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:43.086 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:42 smithi099 ceph-mon[24912]: pgmap v747: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:43.087 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:42 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:43.087 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:42 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:43.087 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:42 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:43.087 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:42 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:43.087 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:42 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:43.087 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:42 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:43.087 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:42 smithi099 ceph-mon[24912]: pgmap v748: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:43.087 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:42 smithi099 ceph-mon[24912]: pgmap v749: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:43.087 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:42 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:43.087 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:42 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:43.087 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:42 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:43.087 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:42 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:43.087 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:42 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:43.087 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:42 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:43.088 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:42 smithi099 ceph-mon[24912]: pgmap v750: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:43.088 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:42 smithi099 ceph-mon[24912]: pgmap v751: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:43.088 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:42 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:43.088 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:42 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:43.088 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:42 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:43.088 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:42 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:43.088 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:42 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:43.088 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:42 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:43.088 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:42 smithi099 ceph-mon[24912]: pgmap v752: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:43.088 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:42 smithi099 ceph-mon[24912]: pgmap v753: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:43.088 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:42 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:43.088 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:42 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:43.088 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:42 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:43.088 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:42 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:43.088 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:42 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:43.089 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:42 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:43.089 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:42 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:43.089 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:42 smithi099 ceph-mon[29691]: pgmap v747: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:43.089 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:42 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:43.089 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:42 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:43.089 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:42 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:43.089 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:42 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:43.089 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:42 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:43.089 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:42 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:43.089 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:43 smithi099 ceph-mon[29691]: pgmap v748: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:43.089 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:43 smithi099 ceph-mon[29691]: pgmap v749: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:43.089 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:43 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:43.089 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:43 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:43.090 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:43 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:43.090 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:43 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:43.090 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:43 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:43.090 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:43 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:43.090 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:43 smithi099 ceph-mon[29691]: pgmap v750: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:43.090 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:43 smithi099 ceph-mon[29691]: pgmap v751: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:43.090 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:43 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:43.090 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:43 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:43.090 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:43 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:43.090 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:43 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:43.090 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:43 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:43.090 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:43 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:43.090 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:43 smithi099 ceph-mon[29691]: pgmap v752: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:43.090 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:43 smithi099 ceph-mon[29691]: pgmap v753: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:43.091 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:43 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:43.091 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:43 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:43.091 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:43 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:43.091 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:43 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:43.091 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:43 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:43.091 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:43 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:43.091 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:43 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:43.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:42 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:43.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:42 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:43.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:42 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:43.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:42 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:43.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:42 smithi181 ceph-mon[25762]: pgmap v740: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:43.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:42 smithi181 ceph-mon[25762]: pgmap v741: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:43.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:42 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:43.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:42 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:43.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:42 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:43.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:42 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:43.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:42 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:43.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:42 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:43.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:42 smithi181 ceph-mon[25762]: pgmap v742: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:43.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:42 smithi181 ceph-mon[25762]: pgmap v743: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:43.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:42 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:43.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:42 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:43.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:42 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:43.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:42 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:43.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:42 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:43.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:42 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:43.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:42 smithi181 ceph-mon[25762]: pgmap v744: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:43.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:42 smithi181 ceph-mon[25762]: pgmap v745: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:43.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:42 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:43.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:42 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:43.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:42 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:43.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:42 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:43.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:42 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:43.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:42 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:43.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:42 smithi181 ceph-mon[25762]: pgmap v746: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:43.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:42 smithi181 ceph-mon[25762]: pgmap v747: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:43.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:42 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:43.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:42 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:43.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:42 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:43.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:42 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:43.253 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:42 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:43.253 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:42 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:43.253 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:42 smithi181 ceph-mon[25762]: pgmap v748: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:43.253 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:42 smithi181 ceph-mon[25762]: pgmap v749: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:43.253 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:42 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:43.253 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:42 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:43.253 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:42 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:43.253 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:42 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:43.253 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:42 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:43.253 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:42 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:43.253 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:42 smithi181 ceph-mon[25762]: pgmap v750: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:43.253 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:42 smithi181 ceph-mon[25762]: pgmap v751: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:43.253 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:42 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:43.253 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:42 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:43.254 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:42 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:43.254 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:42 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:43.254 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:42 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:43.254 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:42 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:43.254 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:42 smithi181 ceph-mon[25762]: pgmap v752: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:43.254 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:42 smithi181 ceph-mon[25762]: pgmap v753: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:43.254 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:42 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:43.254 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:42 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:43.254 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:42 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:43.254 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:42 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:43.254 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:42 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:43.254 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:42 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:43.254 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:42 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:44.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:44 smithi181 ceph-mon[25762]: pgmap v754: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:44.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:44 smithi181 ceph-mon[25762]: pgmap v755: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:44.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:44 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:44.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:44 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:44.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:44 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:44.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:44 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:44.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:44 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:44.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:44 smithi181 ceph-mon[25762]: pgmap v756: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:44.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:44 smithi181 ceph-mon[25762]: pgmap v757: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:44.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:44 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:44.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:44 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:44.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:44 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:44.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:44 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:44.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:44 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:44.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:44 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:44.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:44 smithi181 ceph-mon[25762]: pgmap v758: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:44.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:44 smithi181 ceph-mon[25762]: pgmap v759: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:44.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:44 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:44.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:44 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:44.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:44 smithi181 ceph-mon[25762]: from='client.25136 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T13:59:44.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:44 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:44.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:44 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:44.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:44 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:44.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:44 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:44.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:44 smithi181 ceph-mon[25762]: pgmap v760: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:44.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:44 smithi181 ceph-mon[25762]: pgmap v761: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:44.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:44 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:44.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:44 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:44.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:44 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:44.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:44 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:44.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:44 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:44.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:44 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:44.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:44 smithi181 ceph-mon[25762]: pgmap v762: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:44.253 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:44 smithi181 ceph-mon[25762]: pgmap v763: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:44.253 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:44 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:44.253 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:44 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:44.253 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:44 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:44.253 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:44 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:44.253 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:44 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:44.253 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:44 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:44.253 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:44 smithi181 ceph-mon[25762]: pgmap v764: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:44.253 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:44 smithi181 ceph-mon[25762]: pgmap v765: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:44.253 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:44 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:44.253 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:44 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:44.253 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:44 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:44.253 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:44 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:44.253 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:44 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:44.253 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:44 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:44.254 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:44 smithi181 ceph-mon[25762]: pgmap v766: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:44.254 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:44 smithi181 ceph-mon[25762]: pgmap v767: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:44.254 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:44 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:44.254 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:44 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:44.254 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:44 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:44.254 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:44 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:44.254 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:44 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:44.254 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:44 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:44.254 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:44 smithi181 ceph-mon[25762]: pgmap v768: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:44.254 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:44 smithi181 ceph-mon[25762]: pgmap v769: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:44.254 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:44 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:44.254 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:44 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:44.254 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:44 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:44.254 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:44 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:44.255 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:44 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:44.255 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:44 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:44.255 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:44 smithi181 ceph-mon[25762]: pgmap v770: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:44.255 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:44 smithi181 ceph-mon[25762]: pgmap v771: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:44.255 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:44 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:44.255 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:44 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:44.255 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:44 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:44.255 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:44 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:44.255 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:44 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:44.255 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:44 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:44.322 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:44 smithi099 ceph-mon[24912]: pgmap v754: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:44.322 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:44 smithi099 ceph-mon[24912]: pgmap v755: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:44.322 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:44 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:44.322 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:44 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:44.322 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:44 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:44.322 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:44 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:44.322 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:44 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:44.322 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:44 smithi099 ceph-mon[24912]: pgmap v756: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:44.322 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:44 smithi099 ceph-mon[24912]: pgmap v757: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:44.323 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:44 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:44.323 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:44 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:44.323 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:44 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:44.323 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:44 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:44.323 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:44 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:44.323 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:44 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:44.323 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:44 smithi099 ceph-mon[24912]: pgmap v758: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:44.323 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:44 smithi099 ceph-mon[24912]: pgmap v759: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:44.323 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:44 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:44.323 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:44 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:44.323 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:44 smithi099 ceph-mon[24912]: from='client.25136 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T13:59:44.323 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:44 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:44.323 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:44 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:44.323 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:44 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:44.324 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:44 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:44.324 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:44 smithi099 ceph-mon[24912]: pgmap v760: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:44.324 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:44 smithi099 ceph-mon[24912]: pgmap v761: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:44.324 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:44 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:44.324 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:44 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:44.324 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:44 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:44.324 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:44 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:44.324 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:44 smithi099 ceph-mon[29691]: pgmap v754: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:44.324 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:44 smithi099 ceph-mon[29691]: pgmap v755: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:44.324 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:44 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:44.324 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:44 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:44.324 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:44 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:44.325 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:44 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:44.325 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:44 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:44.325 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:44 smithi099 ceph-mon[29691]: pgmap v756: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:44.325 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:44 smithi099 ceph-mon[29691]: pgmap v757: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:44.325 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:44 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:44.325 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:44 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:44.325 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:44 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:44.325 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:44 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:44.325 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:44 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:44.325 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:44 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:44.325 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:44 smithi099 ceph-mon[29691]: pgmap v758: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:44.325 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:44 smithi099 ceph-mon[29691]: pgmap v759: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:44.325 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:44 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:44.325 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:44 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:44.326 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:44 smithi099 ceph-mon[29691]: from='client.25136 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T13:59:44.326 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:44 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:44.326 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:44 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:44.326 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:44 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:44.326 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:44 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:44.326 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:44 smithi099 ceph-mon[29691]: pgmap v760: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:44.326 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:44 smithi099 ceph-mon[29691]: pgmap v761: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:44.326 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:44 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:44.326 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:44 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:44.326 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:44 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:44.326 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:44 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:44.326 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:44 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:44.327 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:44 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:44.327 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:44 smithi099 ceph-mon[24912]: pgmap v762: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:44.327 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:44 smithi099 ceph-mon[24912]: pgmap v763: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:44.327 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:44 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:44.327 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:44 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:44.327 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:44 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:44.327 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:44 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:44.327 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:44 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:44.327 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:44 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:44.327 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:44 smithi099 ceph-mon[24912]: pgmap v764: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:44.327 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:44 smithi099 ceph-mon[24912]: pgmap v765: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:44.327 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:44 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:44.327 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:44 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:44.328 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:44 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:44.328 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:44 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:44.328 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:44 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:44.328 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:44 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:44.328 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:44 smithi099 ceph-mon[24912]: pgmap v766: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:44.328 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:44 smithi099 ceph-mon[24912]: pgmap v767: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:44.328 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:44 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:44.328 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:44 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:44.328 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:44 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:44.328 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:44 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:44.328 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:44 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:44.328 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:44 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:44.328 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:44 smithi099 ceph-mon[24912]: pgmap v768: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:44.329 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:44 smithi099 ceph-mon[24912]: pgmap v769: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:44.329 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:44 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:44.329 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:44 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:44.329 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:44 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:44.329 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:44 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:44.329 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:44 smithi099 ceph-mon[29691]: pgmap v762: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:44.329 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:44 smithi099 ceph-mon[29691]: pgmap v763: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:44.329 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:44 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:44.329 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:44 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:44.329 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:44 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:44.330 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:44 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:44.330 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:44 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:44.330 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:44 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:44.330 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:44 smithi099 ceph-mon[29691]: pgmap v764: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:44.330 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:44 smithi099 ceph-mon[29691]: pgmap v765: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:44.330 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:44 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:44.330 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:44 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:44.330 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:44 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:44.330 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:44 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:44.330 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:44 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:44.330 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:44 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:44.330 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:44 smithi099 ceph-mon[29691]: pgmap v766: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:44.330 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:44 smithi099 ceph-mon[29691]: pgmap v767: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:44.331 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:44 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:44.331 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:44 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:44.331 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:44 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:44.331 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:44 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:44.331 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:44 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:44.331 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:44 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:44.331 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:44 smithi099 ceph-mon[29691]: pgmap v768: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:44.331 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:44 smithi099 ceph-mon[29691]: pgmap v769: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:44.331 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:44 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:44.331 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:44 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:44.331 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:44 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:44.332 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:44 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:44.332 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:44 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:44.332 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:44 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:44.332 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:44 smithi099 ceph-mon[24912]: pgmap v770: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:44.332 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:44 smithi099 ceph-mon[24912]: pgmap v771: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:44.332 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:44 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:44.332 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:44 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:44.332 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:44 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:44.333 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:44 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:44.333 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:44 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:44.333 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:44 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:44.333 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:44 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:44.333 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:44 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:44.333 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:44 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:44.333 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:44 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:44.333 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:44 smithi099 ceph-mon[29691]: pgmap v770: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:44.333 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:44 smithi099 ceph-mon[29691]: pgmap v771: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:44.333 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:44 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:44.333 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:44 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:44.333 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:44 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:44.333 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:44 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:44.334 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:44 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:44.334 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:44 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:45.081 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:59:44 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[71049]: ::ffff:172.21.15.181 - - [30/Mar/2024:13:59:44] "GET /metrics HTTP/1.1" 200 37988 "" "Prometheus/2.33.4" 2024-03-30T13:59:45.082 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:45 smithi099 ceph-mon[24912]: pgmap v772: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:45.082 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:45 smithi099 ceph-mon[24912]: pgmap v773: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:45.082 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:45 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:45.082 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:45 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:45.082 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:45 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:45.082 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:45 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:45.082 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:45 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:45.082 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:45 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:45.082 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:45 smithi099 ceph-mon[24912]: pgmap v774: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:45.082 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:45 smithi099 ceph-mon[24912]: pgmap v775: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:45.082 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:45 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:45.083 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:45 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:45.083 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:45 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:45.083 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:45 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:45.083 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:45 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:45.083 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:45 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:45.083 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:45 smithi099 ceph-mon[24912]: pgmap v776: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:45.083 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:45 smithi099 ceph-mon[24912]: pgmap v777: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:45.083 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:45 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:45.083 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:45 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:45.083 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:45 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:45.083 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:45 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:45.083 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:45 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:45.083 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:45 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:45.083 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:45 smithi099 ceph-mon[24912]: pgmap v778: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:45.084 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:45 smithi099 ceph-mon[24912]: pgmap v779: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:45.084 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:45 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:45.084 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:45 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:45.084 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:45 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:45.084 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:45 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:45.084 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:45 smithi099 ceph-mon[29691]: pgmap v772: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:45.084 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:45 smithi099 ceph-mon[29691]: pgmap v773: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:45.084 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:45 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:45.084 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:45 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:45.084 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:45 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:45.084 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:45 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:45.084 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:45 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:45.085 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:45 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:45.085 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:45 smithi099 ceph-mon[29691]: pgmap v774: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:45.085 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:45 smithi099 ceph-mon[29691]: pgmap v775: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:45.085 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:45 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:45.085 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:45 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:45.085 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:45 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:45.085 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:45 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:45.085 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:45 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:45.085 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:45 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:45.085 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:45 smithi099 ceph-mon[29691]: pgmap v776: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:45.085 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:45 smithi099 ceph-mon[29691]: pgmap v777: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:45.085 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:45 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:45.085 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:45 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:45.085 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:45 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:45.085 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:45 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:45.086 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:45 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:45.086 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:45 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:45.086 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:45 smithi099 ceph-mon[29691]: pgmap v778: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:45.086 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:45 smithi099 ceph-mon[29691]: pgmap v779: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:45.086 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:45 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:45.086 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:45 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:45.086 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:45 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:45.086 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:45 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:45.086 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:45 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:45.087 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:45 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:45.087 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:45 smithi099 ceph-mon[24912]: pgmap v780: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:45.087 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:45 smithi099 ceph-mon[24912]: pgmap v781: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:45.087 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:45 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:45.087 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:45 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:45.087 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:45 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:45.087 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:45 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:45.087 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:45 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:45.087 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:45 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:45.087 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:45 smithi099 ceph-mon[24912]: pgmap v782: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:45.087 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:45 smithi099 ceph-mon[24912]: pgmap v783: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:45.087 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:45 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:45.087 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:45 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:45.087 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:45 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:45.088 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:45 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:45.088 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:45 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:45.088 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:45 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:45.088 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:45 smithi099 ceph-mon[24912]: pgmap v784: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:45.088 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:45 smithi099 ceph-mon[24912]: pgmap v785: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:45.088 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:45 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:45.088 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:45 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:45.088 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:45 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:45.088 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:45 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:45.088 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:45 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:45.088 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:45 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:45.088 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:45 smithi099 ceph-mon[24912]: pgmap v786: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:45.089 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:45 smithi099 ceph-mon[24912]: pgmap v787: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:45.089 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:45 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:45.089 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:45 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:45.089 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:45 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:45.089 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:45 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:45.089 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:45 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:45.089 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:45 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:45.089 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:45 smithi099 ceph-mon[24912]: pgmap v788: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:45.089 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:45 smithi099 ceph-mon[24912]: pgmap v789: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:45.089 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:45 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:45.089 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:45 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:45.089 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:45 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:45.089 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:45 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:45.089 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:45 smithi099 ceph-mon[24912]: pgmap v790: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:45.089 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:45 smithi099 ceph-mon[24912]: pgmap v791: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:45.090 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:45 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:45.090 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:45 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:45.090 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:45 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:45.090 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:45 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:45.090 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:45 smithi099 ceph-mon[24912]: Upgrade: Setting container_image for all crash 2024-03-30T13:59:45.090 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:45 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:45.090 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:45 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:45.090 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:45 smithi099 ceph-mon[24912]: Upgrade: Setting container_image for all mds 2024-03-30T13:59:45.090 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:45 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:45.090 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:45 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:45.090 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:45 smithi099 ceph-mon[24912]: Upgrade: Setting container_image for all rbd-mirror 2024-03-30T13:59:45.090 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:45 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:45.090 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:45 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:45.090 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:45 smithi099 ceph-mon[24912]: Upgrade: Setting container_image for all cephfs-mirror 2024-03-30T13:59:45.090 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:45 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:45.091 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:45 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:45.091 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:45 smithi099 ceph-mon[24912]: Upgrade: Setting container_image for all ceph-exporter 2024-03-30T13:59:45.091 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:45 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:45.091 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:45 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:45.091 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:45 smithi099 ceph-mon[24912]: Upgrade: Setting container_image for all nfs 2024-03-30T13:59:45.091 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:45 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:45.091 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:45 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:45.091 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:45 smithi099 ceph-mon[24912]: Upgrade: Setting container_image for all nvmeof 2024-03-30T13:59:45.091 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:45 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:45.092 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:45 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:45.092 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:45 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:45.092 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:45 smithi099 ceph-mon[29691]: pgmap v780: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:45.092 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:45 smithi099 ceph-mon[29691]: pgmap v781: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:45.092 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:45 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:45.092 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:45 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:45.092 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:45 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:45.092 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:45 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:45.092 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:45 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:45.092 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:45 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:45.092 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:45 smithi099 ceph-mon[29691]: pgmap v782: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:45.092 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:45 smithi099 ceph-mon[29691]: pgmap v783: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:45.092 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:45 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:45.092 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:45 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:45.093 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:45 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:45.093 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:45 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:45.093 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:45 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:45.093 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:45 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:45.093 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:45 smithi099 ceph-mon[29691]: pgmap v784: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:45.093 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:45 smithi099 ceph-mon[29691]: pgmap v785: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:45.093 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:45 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:45.093 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:45 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:45.093 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:45 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:45.093 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:45 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:45.093 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:45 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:45.093 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:45 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:45.093 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:45 smithi099 ceph-mon[29691]: pgmap v786: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:45.093 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:45 smithi099 ceph-mon[29691]: pgmap v787: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:45.093 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:45 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:45.094 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:45 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:45.094 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:45 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:45.094 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:45 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:45.094 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:45 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:45.094 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:45 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:45.094 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:45 smithi099 ceph-mon[29691]: pgmap v788: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:45.094 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:45 smithi099 ceph-mon[29691]: pgmap v789: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:45.094 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:45 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:45.094 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:45 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:45.094 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:45 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:45.094 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:45 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:45.094 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:45 smithi099 ceph-mon[29691]: pgmap v790: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:45.094 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:45 smithi099 ceph-mon[29691]: pgmap v791: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:45.094 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:45 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:45.094 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:45 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:45.095 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:45 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:45.095 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:45 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:45.095 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:45 smithi099 ceph-mon[29691]: Upgrade: Setting container_image for all crash 2024-03-30T13:59:45.095 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:45 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:45.095 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:45 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:45.095 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:45 smithi099 ceph-mon[29691]: Upgrade: Setting container_image for all mds 2024-03-30T13:59:45.095 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:45 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:45.095 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:45 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:45.095 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:45 smithi099 ceph-mon[29691]: Upgrade: Setting container_image for all rbd-mirror 2024-03-30T13:59:45.095 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:45 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:45.095 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:45 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:45.095 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:45 smithi099 ceph-mon[29691]: Upgrade: Setting container_image for all cephfs-mirror 2024-03-30T13:59:45.095 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:45 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:45.095 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:45 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:45.096 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:45 smithi099 ceph-mon[29691]: Upgrade: Setting container_image for all ceph-exporter 2024-03-30T13:59:45.096 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:45 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:45.096 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:45 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:45.096 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:45 smithi099 ceph-mon[29691]: Upgrade: Setting container_image for all nfs 2024-03-30T13:59:45.096 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:45 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:45.096 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:45 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:45.096 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:45 smithi099 ceph-mon[29691]: Upgrade: Setting container_image for all nvmeof 2024-03-30T13:59:45.096 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:45 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:45.500 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:45 smithi181 ceph-mon[25762]: pgmap v772: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:45.500 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:45 smithi181 ceph-mon[25762]: pgmap v773: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:45.500 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:45 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:45.500 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:45 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:45.501 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:45 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:45.501 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:45 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:45.501 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:45 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:45.501 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:45 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:45.501 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:45 smithi181 ceph-mon[25762]: pgmap v774: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:45.501 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:45 smithi181 ceph-mon[25762]: pgmap v775: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:45.501 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:45 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:45.501 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:45 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:45.501 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:45 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:45.501 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:45 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:45.501 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:45 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:45.501 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:45 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:45.501 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:45 smithi181 ceph-mon[25762]: pgmap v776: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:45.501 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:45 smithi181 ceph-mon[25762]: pgmap v777: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:45.502 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:45 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:45.502 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:45 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:45.502 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:45 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:45.502 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:45 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:45.502 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:45 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:45.502 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:45 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:45.502 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:45 smithi181 ceph-mon[25762]: pgmap v778: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:45.502 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:45 smithi181 ceph-mon[25762]: pgmap v779: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:45.502 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:45 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:45.502 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:45 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:45.502 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:45 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:45.502 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:45 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:45.502 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:45 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:45.502 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:45 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:45.503 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:45 smithi181 ceph-mon[25762]: pgmap v780: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:45.503 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:45 smithi181 ceph-mon[25762]: pgmap v781: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:45.503 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:45 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:45.503 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:45 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:45.503 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:45 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:45.503 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:45 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:45.503 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:45 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:45.503 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:45 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:45.503 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:45 smithi181 ceph-mon[25762]: pgmap v782: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:45.503 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:45 smithi181 ceph-mon[25762]: pgmap v783: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:45.503 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:45 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:45.503 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:45 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:45.503 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:45 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:45.503 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:45 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:45.503 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:45 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:45.504 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:45 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:45.504 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:45 smithi181 ceph-mon[25762]: pgmap v784: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:45.504 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:45 smithi181 ceph-mon[25762]: pgmap v785: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:45.504 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:45 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:45.504 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:45 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:45.504 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:45 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:45.504 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:45 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:45.504 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:45 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:45.504 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:45 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:45.504 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:45 smithi181 ceph-mon[25762]: pgmap v786: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:45.504 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:45 smithi181 ceph-mon[25762]: pgmap v787: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:45.504 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:45 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:45.504 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:45 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:45.504 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:45 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:45.504 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:45 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:45.505 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:45 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:45.505 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:45 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:45.505 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:45 smithi181 ceph-mon[25762]: pgmap v788: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:45.505 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:45 smithi181 ceph-mon[25762]: pgmap v789: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:45.505 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:45 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:45.505 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:45 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T13:59:45.505 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:45 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:45.505 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:45 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:45.505 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:45 smithi181 ceph-mon[25762]: pgmap v790: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:45.505 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:45 smithi181 ceph-mon[25762]: pgmap v791: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:45.505 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:45 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:45.506 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:45 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:45.506 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:45 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:45.506 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:45 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:45.506 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:45 smithi181 ceph-mon[25762]: Upgrade: Setting container_image for all crash 2024-03-30T13:59:45.506 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:45 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:45.506 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:45 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:45.506 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:45 smithi181 ceph-mon[25762]: Upgrade: Setting container_image for all mds 2024-03-30T13:59:45.506 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:45 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:45.506 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:45 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:45.506 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:45 smithi181 ceph-mon[25762]: Upgrade: Setting container_image for all rbd-mirror 2024-03-30T13:59:45.506 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:45 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:45.506 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:45 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:45.506 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:45 smithi181 ceph-mon[25762]: Upgrade: Setting container_image for all cephfs-mirror 2024-03-30T13:59:45.506 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:45 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:45.506 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:45 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:45.507 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:45 smithi181 ceph-mon[25762]: Upgrade: Setting container_image for all ceph-exporter 2024-03-30T13:59:45.507 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:45 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:45.507 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:45 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:45.507 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:45 smithi181 ceph-mon[25762]: Upgrade: Setting container_image for all nfs 2024-03-30T13:59:45.507 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:45 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:45.507 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:45 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:45.507 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:45 smithi181 ceph-mon[25762]: Upgrade: Setting container_image for all nvmeof 2024-03-30T13:59:45.507 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:45 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:46.235 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:46 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:46.235 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:46 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:46.235 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:46 smithi181 ceph-mon[25762]: pgmap v792: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:46.235 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:46 smithi181 ceph-mon[25762]: pgmap v793: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:46.235 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:46 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:46.235 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:46 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:46.235 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:46 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:46.235 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:46 smithi181 ceph-mon[25762]: pgmap v794: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:46.235 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:46 smithi181 ceph-mon[25762]: pgmap v795: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:46.235 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:46 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:46.235 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:46 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T13:59:46.493 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:46 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:46.493 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:46 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:46.493 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:46 smithi099 ceph-mon[24912]: pgmap v792: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:46.493 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:46 smithi099 ceph-mon[24912]: pgmap v793: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:46.494 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:46 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:46.494 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:46 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:46.494 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:46 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:46.494 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:46 smithi099 ceph-mon[24912]: pgmap v794: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:46.494 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:46 smithi099 ceph-mon[24912]: pgmap v795: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:46.494 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:46 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:46.494 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:46 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T13:59:46.494 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:46 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:46.494 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:46 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:46.495 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:46 smithi099 ceph-mon[29691]: pgmap v792: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:46.495 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:46 smithi099 ceph-mon[29691]: pgmap v793: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:46.495 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:46 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:46.495 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:46 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:46.495 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:46 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:46.495 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:46 smithi099 ceph-mon[29691]: pgmap v794: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:46.495 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:46 smithi099 ceph-mon[29691]: pgmap v795: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T13:59:46.495 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:46 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:46.495 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:46 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T13:59:47.450 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:47 smithi181 ceph-mon[25762]: Upgrade: Updating node-exporter.a (1/2) 2024-03-30T13:59:47.450 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:47 smithi181 ceph-mon[25762]: Deploying daemon node-exporter.a on smithi099 2024-03-30T13:59:47.581 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:47 smithi099 ceph-mon[24912]: Upgrade: Updating node-exporter.a (1/2) 2024-03-30T13:59:47.581 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:47 smithi099 ceph-mon[24912]: Deploying daemon node-exporter.a on smithi099 2024-03-30T13:59:47.581 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:47 smithi099 ceph-mon[29691]: Upgrade: Updating node-exporter.a (1/2) 2024-03-30T13:59:47.581 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:47 smithi099 ceph-mon[29691]: Deploying daemon node-exporter.a on smithi099 2024-03-30T13:59:47.582 INFO:journalctl@ceph.node-exporter.a.smithi099.stdout:Mar 30 13:59:47 smithi099 systemd[1]: Stopping Ceph node-exporter.a for 98ebaeb8-ee99-11ee-b647-cb9ed24678a4... 2024-03-30T13:59:47.908 INFO:journalctl@ceph.node-exporter.a.smithi099.stdout:Mar 30 13:59:47 smithi099 podman[102450]: 2024-03-30 13:59:47.592023867 +0000 UTC m=+0.134884800 container died 76284405d5f5397efde08e77ed0b49e35917a3dbe4443d0caf881f577e11822e (image=quay.io/prometheus/node-exporter:v1.3.1, name=ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-node-exporter-a, maintainer=The Prometheus Authors ) 2024-03-30T13:59:48.330 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:48 smithi099 ceph-mon[29691]: pgmap v796: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-03-30T13:59:48.331 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:48 smithi099 ceph-mon[24912]: pgmap v796: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-03-30T13:59:48.331 INFO:journalctl@ceph.node-exporter.a.smithi099.stdout:Mar 30 13:59:47 smithi099 podman[102450]: 2024-03-30 13:59:47.914350774 +0000 UTC m=+0.457211692 container cleanup 76284405d5f5397efde08e77ed0b49e35917a3dbe4443d0caf881f577e11822e (image=quay.io/prometheus/node-exporter:v1.3.1, name=ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-node-exporter-a, maintainer=The Prometheus Authors ) 2024-03-30T13:59:48.331 INFO:journalctl@ceph.node-exporter.a.smithi099.stdout:Mar 30 13:59:47 smithi099 bash[102450]: ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-node-exporter-a 2024-03-30T13:59:48.331 INFO:journalctl@ceph.node-exporter.a.smithi099.stdout:Mar 30 13:59:48 smithi099 podman[102464]: 2024-03-30 13:59:48.15729373 +0000 UTC m=+0.564710462 container remove 76284405d5f5397efde08e77ed0b49e35917a3dbe4443d0caf881f577e11822e (image=quay.io/prometheus/node-exporter:v1.3.1, name=ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-node-exporter-a, maintainer=The Prometheus Authors ) 2024-03-30T13:59:48.331 INFO:journalctl@ceph.node-exporter.a.smithi099.stdout:Mar 30 13:59:48 smithi099 systemd[1]: ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4@node-exporter.a.service: Main process exited, code=exited, status=143/n/a 2024-03-30T13:59:48.500 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:48 smithi181 ceph-mon[25762]: pgmap v796: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-03-30T13:59:48.759 INFO:journalctl@ceph.node-exporter.a.smithi099.stdout:Mar 30 13:59:48 smithi099 systemd[1]: ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4@node-exporter.a.service: Failed with result 'exit-code'. 2024-03-30T13:59:48.759 INFO:journalctl@ceph.node-exporter.a.smithi099.stdout:Mar 30 13:59:48 smithi099 systemd[1]: Stopped Ceph node-exporter.a for 98ebaeb8-ee99-11ee-b647-cb9ed24678a4. 2024-03-30T13:59:48.759 INFO:journalctl@ceph.node-exporter.a.smithi099.stdout:Mar 30 13:59:48 smithi099 systemd[1]: ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4@node-exporter.a.service: Consumed 5.262s CPU time. 2024-03-30T13:59:48.759 INFO:journalctl@ceph.node-exporter.a.smithi099.stdout:Mar 30 13:59:48 smithi099 systemd[1]: Starting Ceph node-exporter.a for 98ebaeb8-ee99-11ee-b647-cb9ed24678a4... 2024-03-30T13:59:49.080 INFO:journalctl@ceph.node-exporter.a.smithi099.stdout:Mar 30 13:59:48 smithi099 bash[102594]: Trying to pull quay.io/prometheus/node-exporter:v1.5.0... 2024-03-30T13:59:49.581 INFO:journalctl@ceph.node-exporter.a.smithi099.stdout:Mar 30 13:59:49 smithi099 bash[102594]: Getting image source signatures 2024-03-30T13:59:49.581 INFO:journalctl@ceph.node-exporter.a.smithi099.stdout:Mar 30 13:59:49 smithi099 bash[102594]: Copying blob sha256:c0e87333d3805a7b7e1c25783dd25f27da0fe70a8e262eee7ed190c8dc843fa7 2024-03-30T13:59:49.581 INFO:journalctl@ceph.node-exporter.a.smithi099.stdout:Mar 30 13:59:49 smithi099 bash[102594]: Copying blob sha256:22b70bddd3acadc892fca4c2af4260629bfda5dfd11ebc106a93ce24e752b5ed 2024-03-30T13:59:49.581 INFO:journalctl@ceph.node-exporter.a.smithi099.stdout:Mar 30 13:59:49 smithi099 bash[102594]: Copying blob sha256:5c12815fee558b157dee7f7509dedbaba0a8379098858a65ec869e1f1526ea0c 2024-03-30T13:59:51.080 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:50 smithi099 ceph-mon[24912]: pgmap v797: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 1.0 KiB/s rd, 1 op/s 2024-03-30T13:59:51.081 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:50 smithi099 ceph-mon[29691]: pgmap v797: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 1.0 KiB/s rd, 1 op/s 2024-03-30T13:59:51.081 INFO:journalctl@ceph.node-exporter.a.smithi099.stdout:Mar 30 13:59:50 smithi099 bash[102594]: Copying config sha256:0da6a335fe1356545476b749c68f022c897de3a2139e8f0054f6937349ee2b83 2024-03-30T13:59:51.081 INFO:journalctl@ceph.node-exporter.a.smithi099.stdout:Mar 30 13:59:50 smithi099 bash[102594]: Writing manifest to image destination 2024-03-30T13:59:51.249 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:50 smithi181 ceph-mon[25762]: pgmap v797: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 1.0 KiB/s rd, 1 op/s 2024-03-30T13:59:51.458 INFO:journalctl@ceph.node-exporter.a.smithi099.stdout:Mar 30 13:59:51 smithi099 podman[102594]: 2024-03-30 13:59:51.163140341 +0000 UTC m=+2.492625730 image pull 0da6a335fe1356545476b749c68f022c897de3a2139e8f0054f6937349ee2b83 quay.io/prometheus/node-exporter:v1.5.0 2024-03-30T13:59:51.458 INFO:journalctl@ceph.node-exporter.a.smithi099.stdout:Mar 30 13:59:51 smithi099 podman[102594]: 2024-03-30 13:59:51.269935326 +0000 UTC m=+2.599420712 container create a2d2ea3d25489c249abf5bfbe77f54ea1b78286d7850fa9d8eebc53883f53d31 (image=quay.io/prometheus/node-exporter:v1.5.0, name=ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-node-exporter-a, maintainer=The Prometheus Authors ) 2024-03-30T13:59:51.831 INFO:journalctl@ceph.node-exporter.a.smithi099.stdout:Mar 30 13:59:51 smithi099 podman[102594]: 2024-03-30 13:59:51.464146792 +0000 UTC m=+2.793632207 container init a2d2ea3d25489c249abf5bfbe77f54ea1b78286d7850fa9d8eebc53883f53d31 (image=quay.io/prometheus/node-exporter:v1.5.0, name=ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-node-exporter-a, maintainer=The Prometheus Authors ) 2024-03-30T13:59:51.831 INFO:journalctl@ceph.node-exporter.a.smithi099.stdout:Mar 30 13:59:51 smithi099 podman[102594]: 2024-03-30 13:59:51.466960378 +0000 UTC m=+2.796445766 container start a2d2ea3d25489c249abf5bfbe77f54ea1b78286d7850fa9d8eebc53883f53d31 (image=quay.io/prometheus/node-exporter:v1.5.0, name=ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-node-exporter-a, maintainer=The Prometheus Authors ) 2024-03-30T13:59:51.831 INFO:journalctl@ceph.node-exporter.a.smithi099.stdout:Mar 30 13:59:51 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-node-exporter-a[102645]: ts=2024-03-30T13:59:51.471Z caller=node_exporter.go:180 level=info msg="Starting node_exporter" version="(version=1.5.0, branch=HEAD, revision=1b48970ffcf5630534fb00bb0687d73c66d1c959)" 2024-03-30T13:59:51.831 INFO:journalctl@ceph.node-exporter.a.smithi099.stdout:Mar 30 13:59:51 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-node-exporter-a[102645]: ts=2024-03-30T13:59:51.471Z caller=node_exporter.go:181 level=info msg="Build context" build_context="(go=go1.19.3, user=root@6e7732a7b81b, date=20221129-18:59:09)" 2024-03-30T13:59:51.831 INFO:journalctl@ceph.node-exporter.a.smithi099.stdout:Mar 30 13:59:51 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-node-exporter-a[102645]: ts=2024-03-30T13:59:51.471Z caller=filesystem_common.go:111 level=info collector=filesystem msg="Parsed flag --collector.filesystem.mount-points-exclude" flag=^/(dev|proc|run/credentials/.+|sys|var/lib/docker/.+|var/lib/containers/storage/.+)($|/) 2024-03-30T13:59:51.831 INFO:journalctl@ceph.node-exporter.a.smithi099.stdout:Mar 30 13:59:51 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-node-exporter-a[102645]: ts=2024-03-30T13:59:51.471Z caller=filesystem_common.go:113 level=info collector=filesystem msg="Parsed flag --collector.filesystem.fs-types-exclude" flag=^(autofs|binfmt_misc|bpf|cgroup2?|configfs|debugfs|devpts|devtmpfs|fusectl|hugetlbfs|iso9660|mqueue|nsfs|overlay|proc|procfs|pstore|rpc_pipefs|securityfs|selinuxfs|squashfs|sysfs|tracefs)$ 2024-03-30T13:59:51.831 INFO:journalctl@ceph.node-exporter.a.smithi099.stdout:Mar 30 13:59:51 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-node-exporter-a[102645]: ts=2024-03-30T13:59:51.472Z caller=diskstats_common.go:111 level=info collector=diskstats msg="Parsed flag --collector.diskstats.device-exclude" flag=^(ram|loop|fd|(h|s|v|xv)d[a-z]|nvme\d+n\d+p)\d+$ 2024-03-30T13:59:51.831 INFO:journalctl@ceph.node-exporter.a.smithi099.stdout:Mar 30 13:59:51 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-node-exporter-a[102645]: ts=2024-03-30T13:59:51.472Z caller=diskstats_linux.go:264 level=error collector=diskstats msg="Failed to open directory, disabling udev device properties" path=/run/udev/data 2024-03-30T13:59:51.832 INFO:journalctl@ceph.node-exporter.a.smithi099.stdout:Mar 30 13:59:51 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-node-exporter-a[102645]: ts=2024-03-30T13:59:51.472Z caller=node_exporter.go:110 level=info msg="Enabled collectors" 2024-03-30T13:59:51.832 INFO:journalctl@ceph.node-exporter.a.smithi099.stdout:Mar 30 13:59:51 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-node-exporter-a[102645]: ts=2024-03-30T13:59:51.472Z caller=node_exporter.go:117 level=info collector=arp 2024-03-30T13:59:51.832 INFO:journalctl@ceph.node-exporter.a.smithi099.stdout:Mar 30 13:59:51 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-node-exporter-a[102645]: ts=2024-03-30T13:59:51.472Z caller=node_exporter.go:117 level=info collector=bcache 2024-03-30T13:59:51.832 INFO:journalctl@ceph.node-exporter.a.smithi099.stdout:Mar 30 13:59:51 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-node-exporter-a[102645]: ts=2024-03-30T13:59:51.472Z caller=node_exporter.go:117 level=info collector=bonding 2024-03-30T13:59:51.832 INFO:journalctl@ceph.node-exporter.a.smithi099.stdout:Mar 30 13:59:51 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-node-exporter-a[102645]: ts=2024-03-30T13:59:51.472Z caller=node_exporter.go:117 level=info collector=btrfs 2024-03-30T13:59:51.832 INFO:journalctl@ceph.node-exporter.a.smithi099.stdout:Mar 30 13:59:51 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-node-exporter-a[102645]: ts=2024-03-30T13:59:51.472Z caller=node_exporter.go:117 level=info collector=conntrack 2024-03-30T13:59:51.832 INFO:journalctl@ceph.node-exporter.a.smithi099.stdout:Mar 30 13:59:51 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-node-exporter-a[102645]: ts=2024-03-30T13:59:51.472Z caller=node_exporter.go:117 level=info collector=cpu 2024-03-30T13:59:51.832 INFO:journalctl@ceph.node-exporter.a.smithi099.stdout:Mar 30 13:59:51 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-node-exporter-a[102645]: ts=2024-03-30T13:59:51.472Z caller=node_exporter.go:117 level=info collector=cpufreq 2024-03-30T13:59:51.832 INFO:journalctl@ceph.node-exporter.a.smithi099.stdout:Mar 30 13:59:51 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-node-exporter-a[102645]: ts=2024-03-30T13:59:51.472Z caller=node_exporter.go:117 level=info collector=diskstats 2024-03-30T13:59:51.833 INFO:journalctl@ceph.node-exporter.a.smithi099.stdout:Mar 30 13:59:51 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-node-exporter-a[102645]: ts=2024-03-30T13:59:51.472Z caller=node_exporter.go:117 level=info collector=dmi 2024-03-30T13:59:51.833 INFO:journalctl@ceph.node-exporter.a.smithi099.stdout:Mar 30 13:59:51 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-node-exporter-a[102645]: ts=2024-03-30T13:59:51.472Z caller=node_exporter.go:117 level=info collector=edac 2024-03-30T13:59:51.833 INFO:journalctl@ceph.node-exporter.a.smithi099.stdout:Mar 30 13:59:51 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-node-exporter-a[102645]: ts=2024-03-30T13:59:51.472Z caller=node_exporter.go:117 level=info collector=entropy 2024-03-30T13:59:51.833 INFO:journalctl@ceph.node-exporter.a.smithi099.stdout:Mar 30 13:59:51 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-node-exporter-a[102645]: ts=2024-03-30T13:59:51.472Z caller=node_exporter.go:117 level=info collector=fibrechannel 2024-03-30T13:59:51.833 INFO:journalctl@ceph.node-exporter.a.smithi099.stdout:Mar 30 13:59:51 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-node-exporter-a[102645]: ts=2024-03-30T13:59:51.472Z caller=node_exporter.go:117 level=info collector=filefd 2024-03-30T13:59:51.833 INFO:journalctl@ceph.node-exporter.a.smithi099.stdout:Mar 30 13:59:51 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-node-exporter-a[102645]: ts=2024-03-30T13:59:51.472Z caller=node_exporter.go:117 level=info collector=filesystem 2024-03-30T13:59:51.833 INFO:journalctl@ceph.node-exporter.a.smithi099.stdout:Mar 30 13:59:51 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-node-exporter-a[102645]: ts=2024-03-30T13:59:51.472Z caller=node_exporter.go:117 level=info collector=hwmon 2024-03-30T13:59:51.833 INFO:journalctl@ceph.node-exporter.a.smithi099.stdout:Mar 30 13:59:51 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-node-exporter-a[102645]: ts=2024-03-30T13:59:51.472Z caller=node_exporter.go:117 level=info collector=infiniband 2024-03-30T13:59:51.833 INFO:journalctl@ceph.node-exporter.a.smithi099.stdout:Mar 30 13:59:51 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-node-exporter-a[102645]: ts=2024-03-30T13:59:51.472Z caller=node_exporter.go:117 level=info collector=ipvs 2024-03-30T13:59:51.833 INFO:journalctl@ceph.node-exporter.a.smithi099.stdout:Mar 30 13:59:51 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-node-exporter-a[102645]: ts=2024-03-30T13:59:51.472Z caller=node_exporter.go:117 level=info collector=loadavg 2024-03-30T13:59:51.833 INFO:journalctl@ceph.node-exporter.a.smithi099.stdout:Mar 30 13:59:51 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-node-exporter-a[102645]: ts=2024-03-30T13:59:51.472Z caller=node_exporter.go:117 level=info collector=mdadm 2024-03-30T13:59:51.833 INFO:journalctl@ceph.node-exporter.a.smithi099.stdout:Mar 30 13:59:51 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-node-exporter-a[102645]: ts=2024-03-30T13:59:51.472Z caller=node_exporter.go:117 level=info collector=meminfo 2024-03-30T13:59:51.833 INFO:journalctl@ceph.node-exporter.a.smithi099.stdout:Mar 30 13:59:51 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-node-exporter-a[102645]: ts=2024-03-30T13:59:51.472Z caller=node_exporter.go:117 level=info collector=netclass 2024-03-30T13:59:51.833 INFO:journalctl@ceph.node-exporter.a.smithi099.stdout:Mar 30 13:59:51 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-node-exporter-a[102645]: ts=2024-03-30T13:59:51.472Z caller=node_exporter.go:117 level=info collector=netdev 2024-03-30T13:59:51.834 INFO:journalctl@ceph.node-exporter.a.smithi099.stdout:Mar 30 13:59:51 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-node-exporter-a[102645]: ts=2024-03-30T13:59:51.472Z caller=node_exporter.go:117 level=info collector=netstat 2024-03-30T13:59:51.834 INFO:journalctl@ceph.node-exporter.a.smithi099.stdout:Mar 30 13:59:51 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-node-exporter-a[102645]: ts=2024-03-30T13:59:51.472Z caller=node_exporter.go:117 level=info collector=nfs 2024-03-30T13:59:51.834 INFO:journalctl@ceph.node-exporter.a.smithi099.stdout:Mar 30 13:59:51 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-node-exporter-a[102645]: ts=2024-03-30T13:59:51.472Z caller=node_exporter.go:117 level=info collector=nfsd 2024-03-30T13:59:51.834 INFO:journalctl@ceph.node-exporter.a.smithi099.stdout:Mar 30 13:59:51 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-node-exporter-a[102645]: ts=2024-03-30T13:59:51.472Z caller=node_exporter.go:117 level=info collector=nvme 2024-03-30T13:59:51.834 INFO:journalctl@ceph.node-exporter.a.smithi099.stdout:Mar 30 13:59:51 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-node-exporter-a[102645]: ts=2024-03-30T13:59:51.472Z caller=node_exporter.go:117 level=info collector=os 2024-03-30T13:59:51.834 INFO:journalctl@ceph.node-exporter.a.smithi099.stdout:Mar 30 13:59:51 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-node-exporter-a[102645]: ts=2024-03-30T13:59:51.472Z caller=node_exporter.go:117 level=info collector=powersupplyclass 2024-03-30T13:59:51.834 INFO:journalctl@ceph.node-exporter.a.smithi099.stdout:Mar 30 13:59:51 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-node-exporter-a[102645]: ts=2024-03-30T13:59:51.472Z caller=node_exporter.go:117 level=info collector=pressure 2024-03-30T13:59:51.834 INFO:journalctl@ceph.node-exporter.a.smithi099.stdout:Mar 30 13:59:51 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-node-exporter-a[102645]: ts=2024-03-30T13:59:51.472Z caller=node_exporter.go:117 level=info collector=rapl 2024-03-30T13:59:51.834 INFO:journalctl@ceph.node-exporter.a.smithi099.stdout:Mar 30 13:59:51 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-node-exporter-a[102645]: ts=2024-03-30T13:59:51.472Z caller=node_exporter.go:117 level=info collector=schedstat 2024-03-30T13:59:51.834 INFO:journalctl@ceph.node-exporter.a.smithi099.stdout:Mar 30 13:59:51 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-node-exporter-a[102645]: ts=2024-03-30T13:59:51.472Z caller=node_exporter.go:117 level=info collector=selinux 2024-03-30T13:59:51.834 INFO:journalctl@ceph.node-exporter.a.smithi099.stdout:Mar 30 13:59:51 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-node-exporter-a[102645]: ts=2024-03-30T13:59:51.472Z caller=node_exporter.go:117 level=info collector=sockstat 2024-03-30T13:59:51.834 INFO:journalctl@ceph.node-exporter.a.smithi099.stdout:Mar 30 13:59:51 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-node-exporter-a[102645]: ts=2024-03-30T13:59:51.472Z caller=node_exporter.go:117 level=info collector=softnet 2024-03-30T13:59:51.834 INFO:journalctl@ceph.node-exporter.a.smithi099.stdout:Mar 30 13:59:51 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-node-exporter-a[102645]: ts=2024-03-30T13:59:51.472Z caller=node_exporter.go:117 level=info collector=stat 2024-03-30T13:59:51.834 INFO:journalctl@ceph.node-exporter.a.smithi099.stdout:Mar 30 13:59:51 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-node-exporter-a[102645]: ts=2024-03-30T13:59:51.472Z caller=node_exporter.go:117 level=info collector=tapestats 2024-03-30T13:59:51.834 INFO:journalctl@ceph.node-exporter.a.smithi099.stdout:Mar 30 13:59:51 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-node-exporter-a[102645]: ts=2024-03-30T13:59:51.473Z caller=node_exporter.go:117 level=info collector=textfile 2024-03-30T13:59:51.835 INFO:journalctl@ceph.node-exporter.a.smithi099.stdout:Mar 30 13:59:51 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-node-exporter-a[102645]: ts=2024-03-30T13:59:51.473Z caller=node_exporter.go:117 level=info collector=thermal_zone 2024-03-30T13:59:51.835 INFO:journalctl@ceph.node-exporter.a.smithi099.stdout:Mar 30 13:59:51 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-node-exporter-a[102645]: ts=2024-03-30T13:59:51.473Z caller=node_exporter.go:117 level=info collector=time 2024-03-30T13:59:51.835 INFO:journalctl@ceph.node-exporter.a.smithi099.stdout:Mar 30 13:59:51 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-node-exporter-a[102645]: ts=2024-03-30T13:59:51.473Z caller=node_exporter.go:117 level=info collector=udp_queues 2024-03-30T13:59:51.835 INFO:journalctl@ceph.node-exporter.a.smithi099.stdout:Mar 30 13:59:51 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-node-exporter-a[102645]: ts=2024-03-30T13:59:51.473Z caller=node_exporter.go:117 level=info collector=uname 2024-03-30T13:59:51.835 INFO:journalctl@ceph.node-exporter.a.smithi099.stdout:Mar 30 13:59:51 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-node-exporter-a[102645]: ts=2024-03-30T13:59:51.473Z caller=node_exporter.go:117 level=info collector=vmstat 2024-03-30T13:59:51.835 INFO:journalctl@ceph.node-exporter.a.smithi099.stdout:Mar 30 13:59:51 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-node-exporter-a[102645]: ts=2024-03-30T13:59:51.473Z caller=node_exporter.go:117 level=info collector=xfs 2024-03-30T13:59:51.835 INFO:journalctl@ceph.node-exporter.a.smithi099.stdout:Mar 30 13:59:51 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-node-exporter-a[102645]: ts=2024-03-30T13:59:51.473Z caller=node_exporter.go:117 level=info collector=zfs 2024-03-30T13:59:51.835 INFO:journalctl@ceph.node-exporter.a.smithi099.stdout:Mar 30 13:59:51 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-node-exporter-a[102645]: ts=2024-03-30T13:59:51.473Z caller=tls_config.go:232 level=info msg="Listening on" address=[::]:9100 2024-03-30T13:59:51.835 INFO:journalctl@ceph.node-exporter.a.smithi099.stdout:Mar 30 13:59:51 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-node-exporter-a[102645]: ts=2024-03-30T13:59:51.473Z caller=tls_config.go:235 level=info msg="TLS is disabled." http2=false address=[::]:9100 2024-03-30T13:59:51.835 INFO:journalctl@ceph.node-exporter.a.smithi099.stdout:Mar 30 13:59:51 smithi099 bash[102594]: a2d2ea3d25489c249abf5bfbe77f54ea1b78286d7850fa9d8eebc53883f53d31 2024-03-30T13:59:51.835 INFO:journalctl@ceph.node-exporter.a.smithi099.stdout:Mar 30 13:59:51 smithi099 systemd[1]: Started Ceph node-exporter.a for 98ebaeb8-ee99-11ee-b647-cb9ed24678a4. 2024-03-30T13:59:52.201 INFO:teuthology.orchestra.run.smithi099.stdout:true 2024-03-30T13:59:52.830 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:52 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:52.831 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:52 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:52.831 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:52 smithi099 ceph-mon[24912]: pgmap v798: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 787 B/s rd, 0 op/s 2024-03-30T13:59:52.831 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:52 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:52.831 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:52 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:52.831 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:52 smithi099 ceph-mon[29691]: pgmap v798: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 787 B/s rd, 0 op/s 2024-03-30T13:59:52.846 INFO:teuthology.orchestra.run.smithi099.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-03-30T13:59:52.847 INFO:teuthology.orchestra.run.smithi099.stdout:agent.smithi099 smithi099 running 7s ago 28m - - 2024-03-30T13:59:52.847 INFO:teuthology.orchestra.run.smithi099.stdout:agent.smithi181 smithi181 running 7s ago 27m - - 2024-03-30T13:59:52.847 INFO:teuthology.orchestra.run.smithi099.stdout:alertmanager.a smithi099 *:9093,9094 running (14m) 7s ago 22m 23.6M - 0.23.0 ba2b418f427c 0f1be3801027 2024-03-30T13:59:52.847 INFO:teuthology.orchestra.run.smithi099.stdout:grafana.a smithi181 *:3000 error 7s ago 22m - - 2024-03-30T13:59:52.847 INFO:teuthology.orchestra.run.smithi099.stdout:iscsi.foo.smithi099.qyjuvr smithi099 running (70s) 7s ago 21m 46.5M - 3.5 e1d6a67b021e 2f859af6bc2a 2024-03-30T13:59:52.847 INFO:teuthology.orchestra.run.smithi099.stdout:mgr.x smithi181 *:8443,9283,8765 running (21s) 7s ago 27m 449M - 19.0.0-1967-g4e50bbcd b0c4478f1d83 f269106f7913 2024-03-30T13:59:52.847 INFO:teuthology.orchestra.run.smithi099.stdout:mgr.y smithi099 *:8443,9283,8765 running (11m) 7s ago 28m 512M - 19.0.0-1967-g4e50bbcd b0c4478f1d83 0d464b8c1d18 2024-03-30T13:59:52.847 INFO:teuthology.orchestra.run.smithi099.stdout:mon.a smithi099 running (29m) 7s ago 29m 109M 2048M 17.2.0 e1d6a67b021e af06ebb19fd8 2024-03-30T13:59:52.847 INFO:teuthology.orchestra.run.smithi099.stdout:mon.b smithi181 running (27m) 7s ago 27m 71.5M 2048M 17.2.0 e1d6a67b021e e678a2a25c90 2024-03-30T13:59:52.847 INFO:teuthology.orchestra.run.smithi099.stdout:mon.c smithi099 running (27m) 7s ago 27m 67.8M 2048M 17.2.0 e1d6a67b021e 0f1e98917718 2024-03-30T13:59:52.847 INFO:teuthology.orchestra.run.smithi099.stdout:node-exporter.a smithi099 *:9100 starting - - - - 2024-03-30T13:59:52.847 INFO:teuthology.orchestra.run.smithi099.stdout:node-exporter.b smithi181 *:9100 running (14m) 7s ago 23m 17.0M - 1.3.1 1dbe0e931976 90245951476f 2024-03-30T13:59:52.847 INFO:teuthology.orchestra.run.smithi099.stdout:osd.0 smithi099 running (27m) 7s ago 27m 54.5M 4096M 17.2.0 e1d6a67b021e 3158ee1b0c67 2024-03-30T13:59:52.849 INFO:teuthology.orchestra.run.smithi099.stdout:osd.1 smithi099 running (26m) 7s ago 26m 57.7M 4096M 17.2.0 e1d6a67b021e c4af0fd7071a 2024-03-30T13:59:52.849 INFO:teuthology.orchestra.run.smithi099.stdout:osd.2 smithi099 running (26m) 7s ago 26m 49.6M 4096M 17.2.0 e1d6a67b021e 8e4e805a7e20 2024-03-30T13:59:52.849 INFO:teuthology.orchestra.run.smithi099.stdout:osd.3 smithi099 running (25m) 7s ago 25m 53.8M 4096M 17.2.0 e1d6a67b021e 718812bcf065 2024-03-30T13:59:52.849 INFO:teuthology.orchestra.run.smithi099.stdout:osd.4 smithi181 running (25m) 7s ago 25m 55.3M 4096M 17.2.0 e1d6a67b021e 5e205434e973 2024-03-30T13:59:52.849 INFO:teuthology.orchestra.run.smithi099.stdout:osd.5 smithi181 running (25m) 7s ago 25m 52.9M 4096M 17.2.0 e1d6a67b021e e330c920f152 2024-03-30T13:59:52.849 INFO:teuthology.orchestra.run.smithi099.stdout:osd.6 smithi181 running (24m) 7s ago 24m 52.3M 4096M 17.2.0 e1d6a67b021e 81d889ea213d 2024-03-30T13:59:52.849 INFO:teuthology.orchestra.run.smithi099.stdout:osd.7 smithi181 running (24m) 7s ago 24m 53.0M 4096M 17.2.0 e1d6a67b021e c08b1839dd7e 2024-03-30T13:59:52.849 INFO:teuthology.orchestra.run.smithi099.stdout:prometheus.a smithi181 *:9095 running (83s) 7s ago 23m 60.1M - 2.33.4 514e6a882f6e 6b662de21f27 2024-03-30T13:59:52.849 INFO:teuthology.orchestra.run.smithi099.stdout:rgw.foo.smithi099.fxjbmp smithi099 *:8000 running (21m) 7s ago 21m 76.2M - 17.2.0 e1d6a67b021e 400b28b3f650 2024-03-30T13:59:52.849 INFO:teuthology.orchestra.run.smithi099.stdout:rgw.foo.smithi181.wfqwti smithi181 *:8000 running (21m) 7s ago 21m 75.9M - 17.2.0 e1d6a67b021e 97e1b130f9d4 2024-03-30T13:59:53.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:52 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:53.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:52 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:53.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:52 smithi181 ceph-mon[25762]: pgmap v798: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 787 B/s rd, 0 op/s 2024-03-30T13:59:53.237 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-03-30T13:59:53.238 INFO:teuthology.orchestra.run.smithi099.stdout: "mon": { 2024-03-30T13:59:53.238 INFO:teuthology.orchestra.run.smithi099.stdout: "ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)": 3 2024-03-30T13:59:53.238 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:59:53.238 INFO:teuthology.orchestra.run.smithi099.stdout: "mgr": { 2024-03-30T13:59:53.238 INFO:teuthology.orchestra.run.smithi099.stdout: "ceph version 19.0.0-1967-g4e50bbcd (4e50bbcdd1630c7760b708f3a5b4d38a121e66cb) squid (dev)": 2 2024-03-30T13:59:53.238 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:59:53.238 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": { 2024-03-30T13:59:53.238 INFO:teuthology.orchestra.run.smithi099.stdout: "ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)": 8 2024-03-30T13:59:53.238 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:59:53.238 INFO:teuthology.orchestra.run.smithi099.stdout: "mds": {}, 2024-03-30T13:59:53.238 INFO:teuthology.orchestra.run.smithi099.stdout: "rgw": { 2024-03-30T13:59:53.238 INFO:teuthology.orchestra.run.smithi099.stdout: "ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)": 2 2024-03-30T13:59:53.238 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T13:59:53.239 INFO:teuthology.orchestra.run.smithi099.stdout: "overall": { 2024-03-30T13:59:53.239 INFO:teuthology.orchestra.run.smithi099.stdout: "ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)": 13, 2024-03-30T13:59:53.239 INFO:teuthology.orchestra.run.smithi099.stdout: "ceph version 19.0.0-1967-g4e50bbcd (4e50bbcdd1630c7760b708f3a5b4d38a121e66cb) squid (dev)": 2 2024-03-30T13:59:53.239 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-03-30T13:59:53.239 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-03-30T13:59:53.565 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-03-30T13:59:53.565 INFO:teuthology.orchestra.run.smithi099.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph:4e50bbcdd1630c7760b708f3a5b4d38a121e66cb", 2024-03-30T13:59:53.565 INFO:teuthology.orchestra.run.smithi099.stdout: "in_progress": true, 2024-03-30T13:59:53.565 INFO:teuthology.orchestra.run.smithi099.stdout: "which": "Upgrading daemons of type(s) mgr", 2024-03-30T13:59:53.566 INFO:teuthology.orchestra.run.smithi099.stdout: "services_complete": [ 2024-03-30T13:59:53.566 INFO:teuthology.orchestra.run.smithi099.stdout: "mgr" 2024-03-30T13:59:53.566 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-03-30T13:59:53.566 INFO:teuthology.orchestra.run.smithi099.stdout: "progress": "2/2 daemons upgraded", 2024-03-30T13:59:53.566 INFO:teuthology.orchestra.run.smithi099.stdout: "message": "Currently upgrading node-exporter daemons", 2024-03-30T13:59:53.566 INFO:teuthology.orchestra.run.smithi099.stdout: "is_paused": false 2024-03-30T13:59:53.566 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-03-30T13:59:53.831 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:53 smithi099 ceph-mon[24912]: from='client.15582 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T13:59:53.831 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:53 smithi099 ceph-mon[24912]: from='client.15588 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T13:59:53.831 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:53 smithi099 ceph-mon[24912]: from='client.25486 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T13:59:53.831 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:53 smithi099 ceph-mon[24912]: from='client.? 172.21.15.99:0/1454896830' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:53.831 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:53 smithi099 ceph-mon[29691]: from='client.15582 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T13:59:53.831 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:53 smithi099 ceph-mon[29691]: from='client.15588 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T13:59:53.831 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:53 smithi099 ceph-mon[29691]: from='client.25486 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T13:59:53.831 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:53 smithi099 ceph-mon[29691]: from='client.? 172.21.15.99:0/1454896830' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:53.927 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:53 smithi181 ceph-mon[25762]: from='client.15582 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T13:59:53.927 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:53 smithi181 ceph-mon[25762]: from='client.15588 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T13:59:53.927 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:53 smithi181 ceph-mon[25762]: from='client.25486 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T13:59:53.927 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:53 smithi181 ceph-mon[25762]: from='client.? 172.21.15.99:0/1454896830' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:54.250 INFO:journalctl@ceph.node-exporter.b.smithi181.stdout:Mar 30 13:59:54 smithi181 systemd[1]: Stopping Ceph node-exporter.b for 98ebaeb8-ee99-11ee-b647-cb9ed24678a4... 2024-03-30T13:59:54.560 INFO:journalctl@ceph.node-exporter.b.smithi181.stdout:Mar 30 13:59:54 smithi181 podman[91563]: 2024-03-30 13:59:54.308938906 +0000 UTC m=+0.134960000 container died 90245951476f44ada0b3ceef289c2b657f2166a0275e2de3fefbb70880ab3a0b (image=quay.io/prometheus/node-exporter:v1.3.1, name=ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-node-exporter-b, maintainer=The Prometheus Authors ) 2024-03-30T13:59:54.860 INFO:journalctl@ceph.node-exporter.b.smithi181.stdout:Mar 30 13:59:54 smithi181 podman[91563]: 2024-03-30 13:59:54.673462698 +0000 UTC m=+0.499483800 container cleanup 90245951476f44ada0b3ceef289c2b657f2166a0275e2de3fefbb70880ab3a0b (image=quay.io/prometheus/node-exporter:v1.3.1, name=ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-node-exporter-b, maintainer=The Prometheus Authors ) 2024-03-30T13:59:54.860 INFO:journalctl@ceph.node-exporter.b.smithi181.stdout:Mar 30 13:59:54 smithi181 bash[91563]: ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-node-exporter-b 2024-03-30T13:59:55.080 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 13:59:54 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[71049]: ::ffff:172.21.15.181 - - [30/Mar/2024:13:59:54] "GET /metrics HTTP/1.1" 200 37987 "" "Prometheus/2.33.4" 2024-03-30T13:59:55.081 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:54 smithi099 ceph-mon[24912]: from='client.25136 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T13:59:55.081 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:54 smithi099 ceph-mon[24912]: Upgrade: Updating node-exporter.b (2/2) 2024-03-30T13:59:55.081 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:54 smithi099 ceph-mon[24912]: Deploying daemon node-exporter.b on smithi181 2024-03-30T13:59:55.081 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:54 smithi099 ceph-mon[24912]: from='client.15606 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T13:59:55.081 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:54 smithi099 ceph-mon[24912]: pgmap v799: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T13:59:55.081 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:54 smithi099 ceph-mon[29691]: from='client.25136 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T13:59:55.082 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:54 smithi099 ceph-mon[29691]: Upgrade: Updating node-exporter.b (2/2) 2024-03-30T13:59:55.082 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:54 smithi099 ceph-mon[29691]: Deploying daemon node-exporter.b on smithi181 2024-03-30T13:59:55.082 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:54 smithi099 ceph-mon[29691]: from='client.15606 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T13:59:55.082 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:54 smithi099 ceph-mon[29691]: pgmap v799: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T13:59:55.112 INFO:journalctl@ceph.node-exporter.b.smithi181.stdout:Mar 30 13:59:54 smithi181 podman[91578]: 2024-03-30 13:59:54.949760425 +0000 UTC m=+0.645048118 container remove 90245951476f44ada0b3ceef289c2b657f2166a0275e2de3fefbb70880ab3a0b (image=quay.io/prometheus/node-exporter:v1.3.1, name=ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-node-exporter-b, maintainer=The Prometheus Authors ) 2024-03-30T13:59:55.112 INFO:journalctl@ceph.node-exporter.b.smithi181.stdout:Mar 30 13:59:54 smithi181 systemd[1]: ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4@node-exporter.b.service: Main process exited, code=exited, status=143/n/a 2024-03-30T13:59:55.112 INFO:journalctl@ceph.node-exporter.b.smithi181.stdout:Mar 30 13:59:55 smithi181 systemd[1]: ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4@node-exporter.b.service: Failed with result 'exit-code'. 2024-03-30T13:59:55.112 INFO:journalctl@ceph.node-exporter.b.smithi181.stdout:Mar 30 13:59:55 smithi181 systemd[1]: Stopped Ceph node-exporter.b for 98ebaeb8-ee99-11ee-b647-cb9ed24678a4. 2024-03-30T13:59:55.112 INFO:journalctl@ceph.node-exporter.b.smithi181.stdout:Mar 30 13:59:55 smithi181 systemd[1]: ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4@node-exporter.b.service: Consumed 5.243s CPU time. 2024-03-30T13:59:55.113 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:54 smithi181 ceph-mon[25762]: from='client.25136 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T13:59:55.113 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:54 smithi181 ceph-mon[25762]: Upgrade: Updating node-exporter.b (2/2) 2024-03-30T13:59:55.113 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:54 smithi181 ceph-mon[25762]: Deploying daemon node-exporter.b on smithi181 2024-03-30T13:59:55.113 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:54 smithi181 ceph-mon[25762]: from='client.15606 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T13:59:55.113 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:54 smithi181 ceph-mon[25762]: pgmap v799: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T13:59:55.479 INFO:journalctl@ceph.node-exporter.b.smithi181.stdout:Mar 30 13:59:55 smithi181 systemd[1]: Starting Ceph node-exporter.b for 98ebaeb8-ee99-11ee-b647-cb9ed24678a4... 2024-03-30T13:59:55.749 INFO:journalctl@ceph.node-exporter.b.smithi181.stdout:Mar 30 13:59:55 smithi181 bash[91709]: Trying to pull quay.io/prometheus/node-exporter:v1.5.0... 2024-03-30T13:59:56.249 INFO:journalctl@ceph.node-exporter.b.smithi181.stdout:Mar 30 13:59:55 smithi181 bash[91709]: Getting image source signatures 2024-03-30T13:59:56.250 INFO:journalctl@ceph.node-exporter.b.smithi181.stdout:Mar 30 13:59:55 smithi181 bash[91709]: Copying blob sha256:c0e87333d3805a7b7e1c25783dd25f27da0fe70a8e262eee7ed190c8dc843fa7 2024-03-30T13:59:56.250 INFO:journalctl@ceph.node-exporter.b.smithi181.stdout:Mar 30 13:59:55 smithi181 bash[91709]: Copying blob sha256:5c12815fee558b157dee7f7509dedbaba0a8379098858a65ec869e1f1526ea0c 2024-03-30T13:59:56.250 INFO:journalctl@ceph.node-exporter.b.smithi181.stdout:Mar 30 13:59:55 smithi181 bash[91709]: Copying blob sha256:22b70bddd3acadc892fca4c2af4260629bfda5dfd11ebc106a93ce24e752b5ed 2024-03-30T13:59:57.249 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:56 smithi181 ceph-mon[25762]: pgmap v800: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-03-30T13:59:57.330 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:56 smithi099 ceph-mon[24912]: pgmap v800: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-03-30T13:59:57.331 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:56 smithi099 ceph-mon[29691]: pgmap v800: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-03-30T13:59:57.749 INFO:journalctl@ceph.node-exporter.b.smithi181.stdout:Mar 30 13:59:57 smithi181 bash[91709]: Copying config sha256:0da6a335fe1356545476b749c68f022c897de3a2139e8f0054f6937349ee2b83 2024-03-30T13:59:57.750 INFO:journalctl@ceph.node-exporter.b.smithi181.stdout:Mar 30 13:59:57 smithi181 bash[91709]: Writing manifest to image destination 2024-03-30T13:59:58.109 INFO:journalctl@ceph.node-exporter.b.smithi181.stdout:Mar 30 13:59:57 smithi181 podman[91709]: 2024-03-30 13:59:57.780323144 +0000 UTC m=+2.387779129 image pull 0da6a335fe1356545476b749c68f022c897de3a2139e8f0054f6937349ee2b83 quay.io/prometheus/node-exporter:v1.5.0 2024-03-30T13:59:58.109 INFO:journalctl@ceph.node-exporter.b.smithi181.stdout:Mar 30 13:59:57 smithi181 podman[91709]: 2024-03-30 13:59:57.904182879 +0000 UTC m=+2.511638863 container create e3b1f926703ff0812710d9ce9220a2c25d978ac33a178dd0174693ead4aab4b7 (image=quay.io/prometheus/node-exporter:v1.5.0, name=ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-node-exporter-b, maintainer=The Prometheus Authors ) 2024-03-30T13:59:58.500 INFO:journalctl@ceph.node-exporter.b.smithi181.stdout:Mar 30 13:59:58 smithi181 podman[91709]: 2024-03-30 13:59:58.115014961 +0000 UTC m=+2.722470947 container init e3b1f926703ff0812710d9ce9220a2c25d978ac33a178dd0174693ead4aab4b7 (image=quay.io/prometheus/node-exporter:v1.5.0, name=ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-node-exporter-b, maintainer=The Prometheus Authors ) 2024-03-30T13:59:58.500 INFO:journalctl@ceph.node-exporter.b.smithi181.stdout:Mar 30 13:59:58 smithi181 podman[91709]: 2024-03-30 13:59:58.117483794 +0000 UTC m=+2.724939789 container start e3b1f926703ff0812710d9ce9220a2c25d978ac33a178dd0174693ead4aab4b7 (image=quay.io/prometheus/node-exporter:v1.5.0, name=ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-node-exporter-b, maintainer=The Prometheus Authors ) 2024-03-30T13:59:58.500 INFO:journalctl@ceph.node-exporter.b.smithi181.stdout:Mar 30 13:59:58 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-node-exporter-b[91761]: ts=2024-03-30T13:59:58.121Z caller=node_exporter.go:180 level=info msg="Starting node_exporter" version="(version=1.5.0, branch=HEAD, revision=1b48970ffcf5630534fb00bb0687d73c66d1c959)" 2024-03-30T13:59:58.500 INFO:journalctl@ceph.node-exporter.b.smithi181.stdout:Mar 30 13:59:58 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-node-exporter-b[91761]: ts=2024-03-30T13:59:58.121Z caller=node_exporter.go:181 level=info msg="Build context" build_context="(go=go1.19.3, user=root@6e7732a7b81b, date=20221129-18:59:09)" 2024-03-30T13:59:58.500 INFO:journalctl@ceph.node-exporter.b.smithi181.stdout:Mar 30 13:59:58 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-node-exporter-b[91761]: ts=2024-03-30T13:59:58.122Z caller=filesystem_common.go:111 level=info collector=filesystem msg="Parsed flag --collector.filesystem.mount-points-exclude" flag=^/(dev|proc|run/credentials/.+|sys|var/lib/docker/.+|var/lib/containers/storage/.+)($|/) 2024-03-30T13:59:58.501 INFO:journalctl@ceph.node-exporter.b.smithi181.stdout:Mar 30 13:59:58 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-node-exporter-b[91761]: ts=2024-03-30T13:59:58.122Z caller=filesystem_common.go:113 level=info collector=filesystem msg="Parsed flag --collector.filesystem.fs-types-exclude" flag=^(autofs|binfmt_misc|bpf|cgroup2?|configfs|debugfs|devpts|devtmpfs|fusectl|hugetlbfs|iso9660|mqueue|nsfs|overlay|proc|procfs|pstore|rpc_pipefs|securityfs|selinuxfs|squashfs|sysfs|tracefs)$ 2024-03-30T13:59:58.501 INFO:journalctl@ceph.node-exporter.b.smithi181.stdout:Mar 30 13:59:58 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-node-exporter-b[91761]: ts=2024-03-30T13:59:58.122Z caller=diskstats_common.go:111 level=info collector=diskstats msg="Parsed flag --collector.diskstats.device-exclude" flag=^(ram|loop|fd|(h|s|v|xv)d[a-z]|nvme\d+n\d+p)\d+$ 2024-03-30T13:59:58.501 INFO:journalctl@ceph.node-exporter.b.smithi181.stdout:Mar 30 13:59:58 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-node-exporter-b[91761]: ts=2024-03-30T13:59:58.122Z caller=diskstats_linux.go:264 level=error collector=diskstats msg="Failed to open directory, disabling udev device properties" path=/run/udev/data 2024-03-30T13:59:58.501 INFO:journalctl@ceph.node-exporter.b.smithi181.stdout:Mar 30 13:59:58 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-node-exporter-b[91761]: ts=2024-03-30T13:59:58.122Z caller=node_exporter.go:110 level=info msg="Enabled collectors" 2024-03-30T13:59:58.501 INFO:journalctl@ceph.node-exporter.b.smithi181.stdout:Mar 30 13:59:58 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-node-exporter-b[91761]: ts=2024-03-30T13:59:58.122Z caller=node_exporter.go:117 level=info collector=arp 2024-03-30T13:59:58.501 INFO:journalctl@ceph.node-exporter.b.smithi181.stdout:Mar 30 13:59:58 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-node-exporter-b[91761]: ts=2024-03-30T13:59:58.122Z caller=node_exporter.go:117 level=info collector=bcache 2024-03-30T13:59:58.501 INFO:journalctl@ceph.node-exporter.b.smithi181.stdout:Mar 30 13:59:58 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-node-exporter-b[91761]: ts=2024-03-30T13:59:58.122Z caller=node_exporter.go:117 level=info collector=bonding 2024-03-30T13:59:58.501 INFO:journalctl@ceph.node-exporter.b.smithi181.stdout:Mar 30 13:59:58 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-node-exporter-b[91761]: ts=2024-03-30T13:59:58.122Z caller=node_exporter.go:117 level=info collector=btrfs 2024-03-30T13:59:58.501 INFO:journalctl@ceph.node-exporter.b.smithi181.stdout:Mar 30 13:59:58 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-node-exporter-b[91761]: ts=2024-03-30T13:59:58.122Z caller=node_exporter.go:117 level=info collector=conntrack 2024-03-30T13:59:58.501 INFO:journalctl@ceph.node-exporter.b.smithi181.stdout:Mar 30 13:59:58 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-node-exporter-b[91761]: ts=2024-03-30T13:59:58.122Z caller=node_exporter.go:117 level=info collector=cpu 2024-03-30T13:59:58.501 INFO:journalctl@ceph.node-exporter.b.smithi181.stdout:Mar 30 13:59:58 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-node-exporter-b[91761]: ts=2024-03-30T13:59:58.122Z caller=node_exporter.go:117 level=info collector=cpufreq 2024-03-30T13:59:58.502 INFO:journalctl@ceph.node-exporter.b.smithi181.stdout:Mar 30 13:59:58 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-node-exporter-b[91761]: ts=2024-03-30T13:59:58.122Z caller=node_exporter.go:117 level=info collector=diskstats 2024-03-30T13:59:58.502 INFO:journalctl@ceph.node-exporter.b.smithi181.stdout:Mar 30 13:59:58 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-node-exporter-b[91761]: ts=2024-03-30T13:59:58.122Z caller=node_exporter.go:117 level=info collector=dmi 2024-03-30T13:59:58.502 INFO:journalctl@ceph.node-exporter.b.smithi181.stdout:Mar 30 13:59:58 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-node-exporter-b[91761]: ts=2024-03-30T13:59:58.122Z caller=node_exporter.go:117 level=info collector=edac 2024-03-30T13:59:58.502 INFO:journalctl@ceph.node-exporter.b.smithi181.stdout:Mar 30 13:59:58 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-node-exporter-b[91761]: ts=2024-03-30T13:59:58.122Z caller=node_exporter.go:117 level=info collector=entropy 2024-03-30T13:59:58.502 INFO:journalctl@ceph.node-exporter.b.smithi181.stdout:Mar 30 13:59:58 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-node-exporter-b[91761]: ts=2024-03-30T13:59:58.122Z caller=node_exporter.go:117 level=info collector=fibrechannel 2024-03-30T13:59:58.502 INFO:journalctl@ceph.node-exporter.b.smithi181.stdout:Mar 30 13:59:58 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-node-exporter-b[91761]: ts=2024-03-30T13:59:58.122Z caller=node_exporter.go:117 level=info collector=filefd 2024-03-30T13:59:58.502 INFO:journalctl@ceph.node-exporter.b.smithi181.stdout:Mar 30 13:59:58 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-node-exporter-b[91761]: ts=2024-03-30T13:59:58.122Z caller=node_exporter.go:117 level=info collector=filesystem 2024-03-30T13:59:58.502 INFO:journalctl@ceph.node-exporter.b.smithi181.stdout:Mar 30 13:59:58 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-node-exporter-b[91761]: ts=2024-03-30T13:59:58.122Z caller=node_exporter.go:117 level=info collector=hwmon 2024-03-30T13:59:58.502 INFO:journalctl@ceph.node-exporter.b.smithi181.stdout:Mar 30 13:59:58 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-node-exporter-b[91761]: ts=2024-03-30T13:59:58.122Z caller=node_exporter.go:117 level=info collector=infiniband 2024-03-30T13:59:58.503 INFO:journalctl@ceph.node-exporter.b.smithi181.stdout:Mar 30 13:59:58 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-node-exporter-b[91761]: ts=2024-03-30T13:59:58.123Z caller=node_exporter.go:117 level=info collector=ipvs 2024-03-30T13:59:58.503 INFO:journalctl@ceph.node-exporter.b.smithi181.stdout:Mar 30 13:59:58 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-node-exporter-b[91761]: ts=2024-03-30T13:59:58.123Z caller=node_exporter.go:117 level=info collector=loadavg 2024-03-30T13:59:58.503 INFO:journalctl@ceph.node-exporter.b.smithi181.stdout:Mar 30 13:59:58 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-node-exporter-b[91761]: ts=2024-03-30T13:59:58.123Z caller=node_exporter.go:117 level=info collector=mdadm 2024-03-30T13:59:58.503 INFO:journalctl@ceph.node-exporter.b.smithi181.stdout:Mar 30 13:59:58 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-node-exporter-b[91761]: ts=2024-03-30T13:59:58.123Z caller=node_exporter.go:117 level=info collector=meminfo 2024-03-30T13:59:58.503 INFO:journalctl@ceph.node-exporter.b.smithi181.stdout:Mar 30 13:59:58 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-node-exporter-b[91761]: ts=2024-03-30T13:59:58.123Z caller=node_exporter.go:117 level=info collector=netclass 2024-03-30T13:59:58.503 INFO:journalctl@ceph.node-exporter.b.smithi181.stdout:Mar 30 13:59:58 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-node-exporter-b[91761]: ts=2024-03-30T13:59:58.123Z caller=node_exporter.go:117 level=info collector=netdev 2024-03-30T13:59:58.503 INFO:journalctl@ceph.node-exporter.b.smithi181.stdout:Mar 30 13:59:58 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-node-exporter-b[91761]: ts=2024-03-30T13:59:58.123Z caller=node_exporter.go:117 level=info collector=netstat 2024-03-30T13:59:58.503 INFO:journalctl@ceph.node-exporter.b.smithi181.stdout:Mar 30 13:59:58 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-node-exporter-b[91761]: ts=2024-03-30T13:59:58.123Z caller=node_exporter.go:117 level=info collector=nfs 2024-03-30T13:59:58.503 INFO:journalctl@ceph.node-exporter.b.smithi181.stdout:Mar 30 13:59:58 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-node-exporter-b[91761]: ts=2024-03-30T13:59:58.123Z caller=node_exporter.go:117 level=info collector=nfsd 2024-03-30T13:59:58.503 INFO:journalctl@ceph.node-exporter.b.smithi181.stdout:Mar 30 13:59:58 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-node-exporter-b[91761]: ts=2024-03-30T13:59:58.123Z caller=node_exporter.go:117 level=info collector=nvme 2024-03-30T13:59:58.503 INFO:journalctl@ceph.node-exporter.b.smithi181.stdout:Mar 30 13:59:58 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-node-exporter-b[91761]: ts=2024-03-30T13:59:58.123Z caller=node_exporter.go:117 level=info collector=os 2024-03-30T13:59:58.503 INFO:journalctl@ceph.node-exporter.b.smithi181.stdout:Mar 30 13:59:58 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-node-exporter-b[91761]: ts=2024-03-30T13:59:58.123Z caller=node_exporter.go:117 level=info collector=powersupplyclass 2024-03-30T13:59:58.503 INFO:journalctl@ceph.node-exporter.b.smithi181.stdout:Mar 30 13:59:58 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-node-exporter-b[91761]: ts=2024-03-30T13:59:58.123Z caller=node_exporter.go:117 level=info collector=pressure 2024-03-30T13:59:58.503 INFO:journalctl@ceph.node-exporter.b.smithi181.stdout:Mar 30 13:59:58 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-node-exporter-b[91761]: ts=2024-03-30T13:59:58.123Z caller=node_exporter.go:117 level=info collector=rapl 2024-03-30T13:59:58.503 INFO:journalctl@ceph.node-exporter.b.smithi181.stdout:Mar 30 13:59:58 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-node-exporter-b[91761]: ts=2024-03-30T13:59:58.123Z caller=node_exporter.go:117 level=info collector=schedstat 2024-03-30T13:59:58.504 INFO:journalctl@ceph.node-exporter.b.smithi181.stdout:Mar 30 13:59:58 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-node-exporter-b[91761]: ts=2024-03-30T13:59:58.123Z caller=node_exporter.go:117 level=info collector=selinux 2024-03-30T13:59:58.504 INFO:journalctl@ceph.node-exporter.b.smithi181.stdout:Mar 30 13:59:58 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-node-exporter-b[91761]: ts=2024-03-30T13:59:58.123Z caller=node_exporter.go:117 level=info collector=sockstat 2024-03-30T13:59:58.504 INFO:journalctl@ceph.node-exporter.b.smithi181.stdout:Mar 30 13:59:58 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-node-exporter-b[91761]: ts=2024-03-30T13:59:58.123Z caller=node_exporter.go:117 level=info collector=softnet 2024-03-30T13:59:58.504 INFO:journalctl@ceph.node-exporter.b.smithi181.stdout:Mar 30 13:59:58 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-node-exporter-b[91761]: ts=2024-03-30T13:59:58.123Z caller=node_exporter.go:117 level=info collector=stat 2024-03-30T13:59:58.504 INFO:journalctl@ceph.node-exporter.b.smithi181.stdout:Mar 30 13:59:58 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-node-exporter-b[91761]: ts=2024-03-30T13:59:58.123Z caller=node_exporter.go:117 level=info collector=tapestats 2024-03-30T13:59:58.504 INFO:journalctl@ceph.node-exporter.b.smithi181.stdout:Mar 30 13:59:58 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-node-exporter-b[91761]: ts=2024-03-30T13:59:58.123Z caller=node_exporter.go:117 level=info collector=textfile 2024-03-30T13:59:58.504 INFO:journalctl@ceph.node-exporter.b.smithi181.stdout:Mar 30 13:59:58 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-node-exporter-b[91761]: ts=2024-03-30T13:59:58.123Z caller=node_exporter.go:117 level=info collector=thermal_zone 2024-03-30T13:59:58.504 INFO:journalctl@ceph.node-exporter.b.smithi181.stdout:Mar 30 13:59:58 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-node-exporter-b[91761]: ts=2024-03-30T13:59:58.123Z caller=node_exporter.go:117 level=info collector=time 2024-03-30T13:59:58.504 INFO:journalctl@ceph.node-exporter.b.smithi181.stdout:Mar 30 13:59:58 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-node-exporter-b[91761]: ts=2024-03-30T13:59:58.123Z caller=node_exporter.go:117 level=info collector=udp_queues 2024-03-30T13:59:58.504 INFO:journalctl@ceph.node-exporter.b.smithi181.stdout:Mar 30 13:59:58 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-node-exporter-b[91761]: ts=2024-03-30T13:59:58.123Z caller=node_exporter.go:117 level=info collector=uname 2024-03-30T13:59:58.504 INFO:journalctl@ceph.node-exporter.b.smithi181.stdout:Mar 30 13:59:58 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-node-exporter-b[91761]: ts=2024-03-30T13:59:58.123Z caller=node_exporter.go:117 level=info collector=vmstat 2024-03-30T13:59:58.504 INFO:journalctl@ceph.node-exporter.b.smithi181.stdout:Mar 30 13:59:58 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-node-exporter-b[91761]: ts=2024-03-30T13:59:58.123Z caller=node_exporter.go:117 level=info collector=xfs 2024-03-30T13:59:58.504 INFO:journalctl@ceph.node-exporter.b.smithi181.stdout:Mar 30 13:59:58 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-node-exporter-b[91761]: ts=2024-03-30T13:59:58.123Z caller=node_exporter.go:117 level=info collector=zfs 2024-03-30T13:59:58.504 INFO:journalctl@ceph.node-exporter.b.smithi181.stdout:Mar 30 13:59:58 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-node-exporter-b[91761]: ts=2024-03-30T13:59:58.123Z caller=tls_config.go:232 level=info msg="Listening on" address=[::]:9100 2024-03-30T13:59:58.505 INFO:journalctl@ceph.node-exporter.b.smithi181.stdout:Mar 30 13:59:58 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-node-exporter-b[91761]: ts=2024-03-30T13:59:58.123Z caller=tls_config.go:235 level=info msg="TLS is disabled." http2=false address=[::]:9100 2024-03-30T13:59:58.505 INFO:journalctl@ceph.node-exporter.b.smithi181.stdout:Mar 30 13:59:58 smithi181 bash[91709]: e3b1f926703ff0812710d9ce9220a2c25d978ac33a178dd0174693ead4aab4b7 2024-03-30T13:59:58.505 INFO:journalctl@ceph.node-exporter.b.smithi181.stdout:Mar 30 13:59:58 smithi181 systemd[1]: Started Ceph node-exporter.b for 98ebaeb8-ee99-11ee-b647-cb9ed24678a4. 2024-03-30T13:59:59.217 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:58 smithi099 ceph-mon[24912]: pgmap v801: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T13:59:59.217 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:58 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:59.217 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:58 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:59.217 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:58 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:59.217 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:58 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:59.217 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:58 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:59.217 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:58 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:59.217 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:58 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:59.217 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:58 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:59.217 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:58 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:59.217 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:58 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:59.218 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:58 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:59.218 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:58 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:59.218 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:58 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:59.218 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:58 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:59.218 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:58 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:59.218 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:58 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:59.218 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:58 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:59.218 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:58 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:59.218 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:58 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:59.218 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:58 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:59.218 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:58 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:59.218 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:58 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:59.218 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:58 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:59.218 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:58 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:59.219 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:58 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:59.219 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:58 smithi099 ceph-mon[29691]: pgmap v801: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T13:59:59.219 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:58 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:59.219 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:58 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:59.219 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:58 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:59.219 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:58 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:59.219 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:58 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:59.219 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:58 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:59.219 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:58 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:59.219 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:58 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:59.220 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:58 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:59.220 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:58 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:59.220 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:58 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:59.220 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:58 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:59.220 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:58 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:59.220 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:58 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:59.220 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:58 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:59.220 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:58 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:59.220 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:58 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:59.220 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:58 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:59.220 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:58 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:59.220 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:58 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:59.220 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:58 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:59.220 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:58 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:59.221 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:58 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:59.221 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:58 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:59.221 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:58 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:59.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:58 smithi181 ceph-mon[25762]: pgmap v801: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T13:59:59.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:58 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:59.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:58 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:59.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:58 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:59.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:58 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:59.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:58 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:59.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:58 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:59.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:58 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:59.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:58 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:59.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:58 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:59.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:58 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:59.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:58 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:59.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:58 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:59.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:58 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:59.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:58 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:59.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:58 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:59.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:58 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:59.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:58 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:59.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:58 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:59.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:58 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:59.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:58 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T13:59:59.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:58 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T13:59:59.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:58 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T13:59:59.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:58 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T13:59:59.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:58 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T13:59:59.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:58 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:00.106 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:59 smithi181 ceph-mon[25762]: pgmap v802: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 959 B/s rd, 0 op/s 2024-03-30T14:00:00.106 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:59 smithi181 ceph-mon[25762]: pgmap v803: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T14:00:00.106 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:59 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:00.106 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:59 smithi181 ceph-mon[25762]: pgmap v804: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 1 op/s 2024-03-30T14:00:00.106 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:59 smithi181 ceph-mon[25762]: pgmap v805: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 1.0 KiB/s rd, 1 op/s 2024-03-30T14:00:00.106 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:59 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:00.106 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:59 smithi181 ceph-mon[25762]: pgmap v806: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-03-30T14:00:00.106 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:59 smithi181 ceph-mon[25762]: pgmap v807: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:00.106 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:59 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:00.106 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:59 smithi181 ceph-mon[25762]: pgmap v808: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:00.106 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:59 smithi181 ceph-mon[25762]: pgmap v809: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:00.106 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:59 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:00.107 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:59 smithi181 ceph-mon[25762]: pgmap v810: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:00.107 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:59 smithi181 ceph-mon[25762]: pgmap v811: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:00.107 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:59 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:00.107 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:59 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:00.107 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:59 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:00.107 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:59 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:00.107 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:59 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:00.107 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:59 smithi181 ceph-mon[25762]: pgmap v812: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:00.107 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:59 smithi181 ceph-mon[25762]: pgmap v813: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:00.107 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:59 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:00.107 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:59 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:00.107 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:59 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:00.107 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:59 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:00.108 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:59 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:00.108 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:59 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:00.108 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:59 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:00.108 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:59 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:00.108 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:59 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:00.108 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:59 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:00.108 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:59 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:00.108 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:59 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:00.108 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:59 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:00.108 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:59 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:00.108 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:59 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:00.108 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:59 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:00.108 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:59 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:00.108 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:59 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:00.108 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:59 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:00.108 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:59 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:00.109 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:59 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:00.109 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:59 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:00.109 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:59 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:00.109 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:59 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:00.109 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:59 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:00.109 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:59 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:00.109 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:59 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:00.109 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:59 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:00.109 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:59 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:00.109 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:59 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:00.109 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:59 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:00.109 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:59 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:00.109 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:59 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:00.109 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:59 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:00.109 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:59 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:00.109 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:59 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:00.110 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:59 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:00.110 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:59 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:00.110 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:59 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:00.110 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:59 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:00.110 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:59 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:00.110 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:59 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:00.110 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:59 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:00.110 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:59 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:00.110 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:59 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:00.110 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:59 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:00.110 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 13:59:59 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:00.139 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:59 smithi099 ceph-mon[24912]: pgmap v802: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 959 B/s rd, 0 op/s 2024-03-30T14:00:00.139 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:59 smithi099 ceph-mon[24912]: pgmap v803: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T14:00:00.139 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:59 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:00.139 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:59 smithi099 ceph-mon[24912]: pgmap v804: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 1 op/s 2024-03-30T14:00:00.139 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:59 smithi099 ceph-mon[24912]: pgmap v805: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 1.0 KiB/s rd, 1 op/s 2024-03-30T14:00:00.139 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:59 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:00.139 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:59 smithi099 ceph-mon[24912]: pgmap v806: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-03-30T14:00:00.139 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:59 smithi099 ceph-mon[24912]: pgmap v807: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:00.139 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:59 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:00.140 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:59 smithi099 ceph-mon[24912]: pgmap v808: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:00.140 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:59 smithi099 ceph-mon[24912]: pgmap v809: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:00.140 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:59 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:00.140 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:59 smithi099 ceph-mon[24912]: pgmap v810: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:00.140 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:59 smithi099 ceph-mon[24912]: pgmap v811: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:00.140 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:59 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:00.140 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:59 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:00.140 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:59 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:00.140 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:59 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:00.140 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:59 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:00.140 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:59 smithi099 ceph-mon[24912]: pgmap v812: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:00.140 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:59 smithi099 ceph-mon[24912]: pgmap v813: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:00.140 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:59 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:00.141 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:59 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:00.141 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:59 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:00.141 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:59 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:00.141 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:59 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:00.141 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:59 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:00.141 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:59 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:00.141 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:59 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:00.141 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:59 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:00.141 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:59 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:00.141 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:59 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:00.141 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:59 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:00.141 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:59 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:00.141 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:59 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:00.141 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:59 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:00.142 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:59 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:00.142 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:59 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:00.142 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:59 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:00.142 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:59 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:00.142 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:59 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:00.142 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:59 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:00.142 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:59 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:00.142 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:59 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:00.142 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:59 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:00.142 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:59 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:00.142 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:59 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:00.142 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:59 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:00.142 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:59 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:00.143 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:59 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:00.143 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:59 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:00.143 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:59 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:00.143 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:59 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:00.143 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:59 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:00.143 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:59 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:00.143 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:59 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:00.143 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:59 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:00.143 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:59 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:00.143 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:59 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:00.143 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:59 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:00.143 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:59 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:00.143 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:59 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:00.143 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:59 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:00.144 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:59 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:00.144 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:59 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:00.144 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:59 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:00.144 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:59 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:00.144 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 13:59:59 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:00.144 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:59 smithi099 ceph-mon[29691]: pgmap v802: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 959 B/s rd, 0 op/s 2024-03-30T14:00:00.144 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:59 smithi099 ceph-mon[29691]: pgmap v803: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T14:00:00.144 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:59 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:00.144 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:59 smithi099 ceph-mon[29691]: pgmap v804: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 1 op/s 2024-03-30T14:00:00.144 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:59 smithi099 ceph-mon[29691]: pgmap v805: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 1.0 KiB/s rd, 1 op/s 2024-03-30T14:00:00.144 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:59 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:00.144 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:59 smithi099 ceph-mon[29691]: pgmap v806: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-03-30T14:00:00.145 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:59 smithi099 ceph-mon[29691]: pgmap v807: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:00.145 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:59 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:00.145 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:59 smithi099 ceph-mon[29691]: pgmap v808: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:00.145 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:59 smithi099 ceph-mon[29691]: pgmap v809: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:00.145 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:59 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:00.145 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:59 smithi099 ceph-mon[29691]: pgmap v810: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:00.145 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:59 smithi099 ceph-mon[29691]: pgmap v811: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:00.145 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:59 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:00.145 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:59 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:00.145 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:59 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:00.145 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:59 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:00.145 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:59 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:00.145 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:59 smithi099 ceph-mon[29691]: pgmap v812: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:00.145 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:59 smithi099 ceph-mon[29691]: pgmap v813: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:00.145 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:59 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:00.145 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:59 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:00.146 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:59 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:00.146 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:59 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:00.146 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:59 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:00.146 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:59 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:00.146 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:59 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:00.146 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:59 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:00.146 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:59 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:00.146 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:59 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:00.146 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:59 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:00.146 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:59 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:00.146 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:59 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:00.146 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:59 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:00.146 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:59 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:00.146 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:59 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:00.146 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:59 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:00.147 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:59 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:00.147 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:59 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:00.147 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:59 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:00.147 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:59 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:00.147 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:59 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:00.147 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:59 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:00.147 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:59 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:00.147 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:59 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:00.147 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:59 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:00.147 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:59 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:00.147 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:59 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:00.147 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:59 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:00.147 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:59 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:00.147 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:59 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:00.147 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:59 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:00.147 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:59 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:00.148 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:59 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:00.148 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:59 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:00.148 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:59 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:00.148 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:59 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:00.148 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:59 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:00.148 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:59 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:00.148 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:59 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:00.148 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:59 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:00.148 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:59 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:00.148 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:59 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:00.148 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:59 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:00.148 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:59 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:00.148 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:59 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:00.148 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 13:59:59 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:01.017 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:00 smithi099 ceph-mon[24912]: pgmap v814: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:01.017 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:00 smithi099 ceph-mon[24912]: pgmap v815: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:01.017 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:00 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:01.017 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:00 smithi099 ceph-mon[24912]: pgmap v816: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:01.017 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:00 smithi099 ceph-mon[24912]: pgmap v817: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:01.017 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:00 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:01.017 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:00 smithi099 ceph-mon[24912]: pgmap v818: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:01.017 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:00 smithi099 ceph-mon[24912]: pgmap v819: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:01.018 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:00 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:01.018 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:00 smithi099 ceph-mon[24912]: pgmap v820: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:01.018 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:00 smithi099 ceph-mon[24912]: pgmap v821: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:01.018 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:00 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:01.018 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:00 smithi099 ceph-mon[24912]: pgmap v822: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:01.018 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:00 smithi099 ceph-mon[24912]: pgmap v823: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:01.018 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:00 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:01.018 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:00 smithi099 ceph-mon[24912]: pgmap v824: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:01.018 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:00 smithi099 ceph-mon[24912]: pgmap v825: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:01.018 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:00 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:01.018 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:00 smithi099 ceph-mon[24912]: pgmap v826: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:01.018 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:00 smithi099 ceph-mon[24912]: pgmap v827: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:01.018 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:00 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:01.018 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:00 smithi099 ceph-mon[24912]: pgmap v828: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:01.019 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:00 smithi099 ceph-mon[24912]: pgmap v829: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:01.019 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:00 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:01.019 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:00 smithi099 ceph-mon[24912]: pgmap v830: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:01.019 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:00 smithi099 ceph-mon[24912]: pgmap v831: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:01.019 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:00 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:01.019 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:00 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:01.019 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:00 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:01.019 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:00 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:01.019 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:00 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:01.019 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:00 smithi099 ceph-mon[24912]: pgmap v832: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:01.019 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:00 smithi099 ceph-mon[24912]: pgmap v833: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:01.019 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:00 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:01.019 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:00 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:01.019 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:00 smithi099 ceph-mon[24912]: overall HEALTH_WARN 1 failed cephadm daemon(s) 2024-03-30T14:00:01.020 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:00 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:01.020 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:00 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:01.020 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:00 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:01.020 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:00 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:01.020 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:00 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:01.020 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:00 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:01.020 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:00 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:01.020 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:00 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:01.020 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:00 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:01.020 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:00 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:01.020 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:00 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:01.020 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:00 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:01.020 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:00 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:01.020 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:00 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:01.020 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:00 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:01.021 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:00 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:01.021 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:00 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:01.021 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:00 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:01.021 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:00 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:01.021 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:00 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:01.021 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:00 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:01.021 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:00 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:01.021 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:00 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:01.021 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:00 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:01.021 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:00 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:01.022 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:00 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:01.022 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:00 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:01.022 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:00 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:01.022 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:00 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:01.022 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:00 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:01.022 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:00 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T14:00:01.022 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:00 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:01.022 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:00 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:01.022 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:00 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:01.022 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:00 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:01.022 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:00 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:01.023 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:00 smithi099 ceph-mon[29691]: pgmap v814: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:01.023 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:00 smithi099 ceph-mon[29691]: pgmap v815: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:01.023 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:00 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:01.023 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:00 smithi099 ceph-mon[29691]: pgmap v816: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:01.023 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:00 smithi099 ceph-mon[29691]: pgmap v817: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:01.023 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:00 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:01.023 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:00 smithi099 ceph-mon[29691]: pgmap v818: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:01.023 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:00 smithi099 ceph-mon[29691]: pgmap v819: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:01.023 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:00 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:01.023 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:00 smithi099 ceph-mon[29691]: pgmap v820: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:01.024 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:00 smithi099 ceph-mon[29691]: pgmap v821: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:01.024 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:00 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:01.024 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:00 smithi099 ceph-mon[29691]: pgmap v822: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:01.024 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:00 smithi099 ceph-mon[29691]: pgmap v823: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:01.024 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:00 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:01.024 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:00 smithi099 ceph-mon[29691]: pgmap v824: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:01.024 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:00 smithi099 ceph-mon[29691]: pgmap v825: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:01.024 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:00 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:01.024 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:00 smithi099 ceph-mon[29691]: pgmap v826: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:01.024 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:00 smithi099 ceph-mon[29691]: pgmap v827: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:01.024 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:00 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:01.024 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:00 smithi099 ceph-mon[29691]: pgmap v828: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:01.024 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:00 smithi099 ceph-mon[29691]: pgmap v829: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:01.024 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:00 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:01.025 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:00 smithi099 ceph-mon[29691]: pgmap v830: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:01.025 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:00 smithi099 ceph-mon[29691]: pgmap v831: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:01.025 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:00 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:01.025 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:00 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:01.025 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:00 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:01.025 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:00 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:01.025 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:00 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:01.025 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:00 smithi099 ceph-mon[29691]: pgmap v832: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:01.025 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:00 smithi099 ceph-mon[29691]: pgmap v833: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:01.025 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:00 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:01.025 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:00 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:01.025 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:00 smithi099 ceph-mon[29691]: overall HEALTH_WARN 1 failed cephadm daemon(s) 2024-03-30T14:00:01.025 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:00 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:01.025 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:00 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:01.025 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:00 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:01.026 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:00 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:01.026 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:00 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:01.026 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:00 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:01.026 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:00 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:01.026 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:00 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:01.026 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:00 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:01.026 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:00 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:01.026 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:00 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:01.026 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:00 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:01.026 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:00 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:01.026 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:00 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:01.026 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:00 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:01.026 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:00 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:01.027 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:00 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:01.027 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:00 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:01.027 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:00 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:01.027 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:00 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:01.027 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:00 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:01.027 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:00 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:01.027 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:00 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:01.027 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:00 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:01.027 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:00 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:01.027 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:00 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:01.027 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:00 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:01.027 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:00 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:01.027 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:00 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:01.027 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:00 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:01.028 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:00 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T14:00:01.028 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:00 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:01.028 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:00 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:01.028 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:00 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:01.028 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:00 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:01.028 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:00 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:01.193 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:00 smithi181 ceph-mon[25762]: pgmap v814: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:01.193 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:00 smithi181 ceph-mon[25762]: pgmap v815: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:01.193 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:00 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:01.193 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:00 smithi181 ceph-mon[25762]: pgmap v816: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:01.193 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:00 smithi181 ceph-mon[25762]: pgmap v817: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:01.194 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:00 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:01.194 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:00 smithi181 ceph-mon[25762]: pgmap v818: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:01.194 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:00 smithi181 ceph-mon[25762]: pgmap v819: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:01.194 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:00 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:01.194 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:00 smithi181 ceph-mon[25762]: pgmap v820: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:01.194 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:00 smithi181 ceph-mon[25762]: pgmap v821: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:01.194 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:00 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:01.194 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:00 smithi181 ceph-mon[25762]: pgmap v822: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:01.194 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:00 smithi181 ceph-mon[25762]: pgmap v823: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:01.194 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:00 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:01.194 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:00 smithi181 ceph-mon[25762]: pgmap v824: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:01.194 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:00 smithi181 ceph-mon[25762]: pgmap v825: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:01.194 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:00 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:01.194 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:00 smithi181 ceph-mon[25762]: pgmap v826: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:01.194 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:00 smithi181 ceph-mon[25762]: pgmap v827: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:01.194 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:00 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:01.195 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:00 smithi181 ceph-mon[25762]: pgmap v828: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:01.195 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:00 smithi181 ceph-mon[25762]: pgmap v829: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:01.195 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:00 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:01.195 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:00 smithi181 ceph-mon[25762]: pgmap v830: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:01.195 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:00 smithi181 ceph-mon[25762]: pgmap v831: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:01.195 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:00 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:01.195 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:00 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:01.195 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:00 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:01.195 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:00 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:01.195 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:00 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:01.195 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:00 smithi181 ceph-mon[25762]: pgmap v832: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:01.195 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:00 smithi181 ceph-mon[25762]: pgmap v833: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:01.195 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:00 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:01.195 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:00 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:01.195 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:00 smithi181 ceph-mon[25762]: overall HEALTH_WARN 1 failed cephadm daemon(s) 2024-03-30T14:00:01.196 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:00 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:01.196 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:00 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:01.196 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:00 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:01.196 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:00 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:01.196 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:00 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:01.196 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:00 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:01.196 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:00 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:01.196 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:00 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:01.196 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:00 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:01.196 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:00 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:01.196 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:00 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:01.196 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:00 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:01.196 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:00 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:01.196 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:00 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:01.196 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:00 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:01.196 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:00 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:01.197 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:00 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:01.197 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:00 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:01.197 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:00 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:01.197 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:00 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:01.197 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:00 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:01.197 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:00 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:01.197 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:00 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:01.197 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:00 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:01.197 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:00 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:01.197 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:00 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:01.197 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:00 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:01.197 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:00 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:01.197 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:00 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:01.197 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:00 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:01.197 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:00 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T14:00:01.198 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:00 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:01.198 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:00 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:01.198 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:00 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:01.198 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:00 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:01.198 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:00 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:02.081 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:01 smithi099 ceph-mon[24912]: pgmap v834: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:02.081 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:01 smithi099 ceph-mon[24912]: pgmap v835: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:02.081 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:01 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:02.081 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:01 smithi099 ceph-mon[24912]: pgmap v836: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:02.082 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:01 smithi099 ceph-mon[24912]: pgmap v837: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:02.082 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:01 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:02.082 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:01 smithi099 ceph-mon[24912]: pgmap v838: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:02.082 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:01 smithi099 ceph-mon[24912]: pgmap v839: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:02.082 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:01 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:02.082 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:01 smithi099 ceph-mon[24912]: pgmap v840: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:02.082 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:01 smithi099 ceph-mon[24912]: pgmap v841: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:02.082 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:01 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:02.082 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:01 smithi099 ceph-mon[24912]: pgmap v842: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:02.082 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:01 smithi099 ceph-mon[24912]: pgmap v843: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:02.082 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:01 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:02.082 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:01 smithi099 ceph-mon[24912]: pgmap v844: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:02.082 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:01 smithi099 ceph-mon[24912]: pgmap v845: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:02.083 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:01 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:02.083 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:01 smithi099 ceph-mon[24912]: pgmap v846: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:02.083 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:01 smithi099 ceph-mon[24912]: pgmap v847: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:02.083 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:01 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:02.083 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:01 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:02.083 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:01 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:02.083 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:01 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:02.083 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:01 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:02.083 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:01 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:02.083 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:01 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:02.083 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:01 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:02.083 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:01 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:02.083 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:01 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:02.084 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:01 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:02.084 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:01 smithi099 ceph-mon[29691]: pgmap v834: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:02.084 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:01 smithi099 ceph-mon[29691]: pgmap v835: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:02.084 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:01 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:02.084 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:01 smithi099 ceph-mon[29691]: pgmap v836: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:02.084 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:01 smithi099 ceph-mon[29691]: pgmap v837: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:02.084 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:01 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:02.084 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:01 smithi099 ceph-mon[29691]: pgmap v838: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:02.084 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:01 smithi099 ceph-mon[29691]: pgmap v839: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:02.085 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:01 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:02.085 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:01 smithi099 ceph-mon[29691]: pgmap v840: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:02.085 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:01 smithi099 ceph-mon[29691]: pgmap v841: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:02.085 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:01 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:02.085 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:01 smithi099 ceph-mon[29691]: pgmap v842: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:02.085 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:01 smithi099 ceph-mon[29691]: pgmap v843: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:02.085 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:01 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:02.085 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:01 smithi099 ceph-mon[29691]: pgmap v844: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:02.085 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:01 smithi099 ceph-mon[29691]: pgmap v845: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:02.085 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:01 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:02.085 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:01 smithi099 ceph-mon[29691]: pgmap v846: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:02.085 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:01 smithi099 ceph-mon[29691]: pgmap v847: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:02.085 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:01 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:02.085 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:01 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:02.086 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:01 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:02.086 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:01 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:02.086 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:01 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:02.086 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:01 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:02.086 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:01 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:02.086 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:01 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:02.086 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:01 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:02.086 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:01 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:02.086 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:01 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:02.086 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:01 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:02.087 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:01 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:02.087 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:01 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:02.087 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:01 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:02.087 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:01 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:02.087 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:01 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:02.087 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:01 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:02.087 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:01 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:02.087 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:01 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:02.087 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:01 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:02.087 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:01 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:02.087 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:01 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:02.087 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:01 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:02.087 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:01 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:02.088 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:01 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:02.088 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:01 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:02.088 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:01 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:02.088 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:01 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:02.088 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:01 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:02.088 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:01 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:02.088 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:01 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:02.088 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:01 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:02.088 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:01 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:02.088 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:01 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:02.088 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:01 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:02.088 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:01 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:02.089 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:01 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:02.089 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:01 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:02.089 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:01 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:02.089 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:01 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:02.089 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:01 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:02.089 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:01 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:02.089 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:01 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:02.089 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:01 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:02.089 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:01 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:02.089 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:01 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:02.089 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:01 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:02.089 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:01 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:02.089 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:01 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:02.089 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:01 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:02.089 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:01 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:02.090 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:01 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:02.090 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:01 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:02.090 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:01 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:02.090 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:01 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:02.090 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:01 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:02.090 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:01 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:02.090 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:01 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:02.090 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:01 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:02.090 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:01 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:02.173 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:01 smithi181 ceph-mon[25762]: pgmap v834: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:02.173 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:01 smithi181 ceph-mon[25762]: pgmap v835: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:02.173 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:01 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:02.173 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:01 smithi181 ceph-mon[25762]: pgmap v836: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:02.173 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:01 smithi181 ceph-mon[25762]: pgmap v837: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:02.173 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:01 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:02.174 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:01 smithi181 ceph-mon[25762]: pgmap v838: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:02.174 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:01 smithi181 ceph-mon[25762]: pgmap v839: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:02.174 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:01 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:02.174 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:01 smithi181 ceph-mon[25762]: pgmap v840: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:02.174 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:01 smithi181 ceph-mon[25762]: pgmap v841: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:02.174 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:01 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:02.174 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:01 smithi181 ceph-mon[25762]: pgmap v842: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:02.174 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:01 smithi181 ceph-mon[25762]: pgmap v843: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:02.174 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:01 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:02.174 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:01 smithi181 ceph-mon[25762]: pgmap v844: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:02.174 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:01 smithi181 ceph-mon[25762]: pgmap v845: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:02.174 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:01 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:02.174 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:01 smithi181 ceph-mon[25762]: pgmap v846: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:02.174 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:01 smithi181 ceph-mon[25762]: pgmap v847: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:02.174 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:01 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:02.175 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:01 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:02.175 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:01 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:02.175 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:01 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:02.175 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:01 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:02.175 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:01 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:02.175 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:01 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:02.175 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:01 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:02.175 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:01 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:02.175 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:01 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:02.175 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:01 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:02.176 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:01 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:02.176 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:01 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:02.176 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:01 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:02.176 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:01 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:02.176 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:01 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:02.176 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:01 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:02.176 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:01 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:02.176 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:01 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:02.176 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:01 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:02.176 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:01 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:02.176 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:01 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:02.176 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:01 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:02.176 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:01 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:02.177 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:01 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:02.177 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:01 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:02.177 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:01 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:02.177 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:01 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:02.177 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:01 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:02.177 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:01 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:02.177 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:01 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:02.177 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:01 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:02.177 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:01 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:02.177 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:01 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:02.177 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:01 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:02.177 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:01 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:03.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:02 smithi181 ceph-mon[25762]: pgmap v848: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:03.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:02 smithi181 ceph-mon[25762]: pgmap v849: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:03.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:02 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:03.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:02 smithi181 ceph-mon[25762]: pgmap v850: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:03.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:02 smithi181 ceph-mon[25762]: pgmap v851: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:03.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:02 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:03.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:02 smithi181 ceph-mon[25762]: pgmap v852: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:03.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:02 smithi181 ceph-mon[25762]: pgmap v853: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:03.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:02 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:03.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:02 smithi181 ceph-mon[25762]: pgmap v854: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:03.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:02 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:03.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:02 smithi181 ceph-mon[25762]: pgmap v855: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:03.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:02 smithi181 ceph-mon[25762]: pgmap v856: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:03.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:02 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:03.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:02 smithi181 ceph-mon[25762]: pgmap v857: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 8.1 KiB/s rd, 8 op/s 2024-03-30T14:00:03.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:02 smithi181 ceph-mon[25762]: pgmap v858: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 11 KiB/s rd, 10 op/s 2024-03-30T14:00:03.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:02 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:03.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:02 smithi181 ceph-mon[25762]: pgmap v859: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 8.7 KiB/s rd, 8 op/s 2024-03-30T14:00:03.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:02 smithi181 ceph-mon[25762]: pgmap v860: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 12 KiB/s rd, 11 op/s 2024-03-30T14:00:03.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:02 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:03.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:02 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:03.253 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:02 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:03.253 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:02 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:03.253 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:02 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:03.253 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:02 smithi181 ceph-mon[25762]: pgmap v861: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 14 KiB/s rd, 13 op/s 2024-03-30T14:00:03.253 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:02 smithi181 ceph-mon[25762]: pgmap v862: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 14 KiB/s rd, 13 op/s 2024-03-30T14:00:03.253 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:02 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:03.254 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:02 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:03.254 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:02 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:03.254 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:02 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:03.254 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:02 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:03.255 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:02 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:03.255 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:02 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:03.255 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:02 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:03.255 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:02 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:03.255 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:02 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:03.255 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:02 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:03.255 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:02 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:03.256 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:02 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:03.256 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:02 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:03.256 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:02 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:03.256 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:02 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:03.256 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:02 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:03.256 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:02 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:03.256 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:02 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:03.257 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:02 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:03.257 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:02 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:03.257 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:02 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:03.257 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:02 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:03.257 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:02 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:03.257 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:02 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:03.258 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:02 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:03.258 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:02 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:03.258 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:02 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:03.258 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:02 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:03.258 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:02 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:03.258 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:02 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:03.258 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:02 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:03.259 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:02 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:03.259 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:02 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:03.259 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:02 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:03.259 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:02 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:03.259 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:02 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:03.259 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:02 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:03.260 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:02 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:03.260 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:02 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:03.260 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:02 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:03.260 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:02 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:03.274 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:02 smithi099 ceph-mon[24912]: pgmap v848: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:03.274 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:02 smithi099 ceph-mon[24912]: pgmap v849: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:03.274 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:02 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:03.274 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:02 smithi099 ceph-mon[24912]: pgmap v850: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:03.275 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:02 smithi099 ceph-mon[24912]: pgmap v851: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:03.275 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:02 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:03.275 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:02 smithi099 ceph-mon[24912]: pgmap v852: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:03.275 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:02 smithi099 ceph-mon[24912]: pgmap v853: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:03.275 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:02 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:03.275 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:02 smithi099 ceph-mon[24912]: pgmap v854: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:03.275 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:02 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:03.276 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:02 smithi099 ceph-mon[24912]: pgmap v855: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:03.276 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:02 smithi099 ceph-mon[24912]: pgmap v856: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:03.276 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:02 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:03.276 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:02 smithi099 ceph-mon[24912]: pgmap v857: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 8.1 KiB/s rd, 8 op/s 2024-03-30T14:00:03.276 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:02 smithi099 ceph-mon[24912]: pgmap v858: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 11 KiB/s rd, 10 op/s 2024-03-30T14:00:03.276 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:02 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:03.276 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:02 smithi099 ceph-mon[24912]: pgmap v859: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 8.7 KiB/s rd, 8 op/s 2024-03-30T14:00:03.276 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:02 smithi099 ceph-mon[24912]: pgmap v860: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 12 KiB/s rd, 11 op/s 2024-03-30T14:00:03.277 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:02 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:03.277 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:02 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:03.277 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:02 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:03.277 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:02 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:03.277 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:02 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:03.277 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:02 smithi099 ceph-mon[24912]: pgmap v861: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 14 KiB/s rd, 13 op/s 2024-03-30T14:00:03.277 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:02 smithi099 ceph-mon[24912]: pgmap v862: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 14 KiB/s rd, 13 op/s 2024-03-30T14:00:03.277 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:02 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:03.277 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:02 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:03.277 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:02 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:03.278 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:02 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:03.279 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:02 smithi099 ceph-mon[29691]: pgmap v848: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:03.279 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:02 smithi099 ceph-mon[29691]: pgmap v849: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:03.279 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:02 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:03.279 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:02 smithi099 ceph-mon[29691]: pgmap v850: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:03.279 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:02 smithi099 ceph-mon[29691]: pgmap v851: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:03.279 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:02 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:03.280 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:02 smithi099 ceph-mon[29691]: pgmap v852: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:03.280 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:02 smithi099 ceph-mon[29691]: pgmap v853: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:03.280 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:02 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:03.280 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:02 smithi099 ceph-mon[29691]: pgmap v854: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:03.280 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:02 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:03.280 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:02 smithi099 ceph-mon[29691]: pgmap v855: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:03.280 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:02 smithi099 ceph-mon[29691]: pgmap v856: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:03.280 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:02 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:03.280 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:02 smithi099 ceph-mon[29691]: pgmap v857: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 8.1 KiB/s rd, 8 op/s 2024-03-30T14:00:03.280 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:02 smithi099 ceph-mon[29691]: pgmap v858: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 11 KiB/s rd, 10 op/s 2024-03-30T14:00:03.281 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:02 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:03.281 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:02 smithi099 ceph-mon[29691]: pgmap v859: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 8.7 KiB/s rd, 8 op/s 2024-03-30T14:00:03.281 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:02 smithi099 ceph-mon[29691]: pgmap v860: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 12 KiB/s rd, 11 op/s 2024-03-30T14:00:03.281 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:02 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:03.281 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:02 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:03.281 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:02 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:03.281 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:02 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:03.281 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:02 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:03.281 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:02 smithi099 ceph-mon[29691]: pgmap v861: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 14 KiB/s rd, 13 op/s 2024-03-30T14:00:03.281 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:02 smithi099 ceph-mon[29691]: pgmap v862: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 14 KiB/s rd, 13 op/s 2024-03-30T14:00:03.281 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:02 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:03.281 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:02 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:03.281 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:02 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:03.281 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:02 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:03.282 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:02 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:03.282 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:02 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:03.282 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:02 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:03.282 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:02 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:03.283 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:02 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:03.283 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:02 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:03.283 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:02 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:03.283 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:02 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:03.283 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:02 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:03.283 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:02 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:03.283 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:02 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:03.284 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:02 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:03.284 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:02 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:03.284 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:02 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:03.284 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:02 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:03.284 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:02 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:03.284 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:02 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:03.285 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:02 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:03.285 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:02 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:03.285 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:02 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:03.285 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:02 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:03.285 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:02 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:03.285 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:02 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:03.285 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:02 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:03.286 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:02 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:03.286 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:02 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:03.286 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:02 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:03.286 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:02 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:03.286 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:02 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:03.286 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:02 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:03.287 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:02 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:03.287 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:02 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:03.287 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:02 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:03.287 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:02 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:03.287 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:02 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:03.287 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:02 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:03.287 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:02 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:03.288 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:02 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:03.288 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:02 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:03.288 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:02 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:03.288 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:02 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:03.289 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:02 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:03.289 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:02 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:03.289 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:02 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:03.289 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:02 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:03.289 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:02 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:03.289 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:02 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:03.290 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:02 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:03.290 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:02 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:03.290 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:02 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:03.290 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:02 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:03.290 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:02 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:03.290 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:02 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:03.291 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:02 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:03.291 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:02 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:03.291 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:02 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:03.291 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:02 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:03.291 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:02 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:03.291 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:02 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:03.291 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:02 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:03.292 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:02 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:03.292 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:02 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:03.292 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:02 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:03.292 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:02 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:03.292 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:02 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:03.292 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:02 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:03.292 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:02 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:03.292 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:02 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:03.293 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:02 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:03.293 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:02 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:03.293 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:02 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:03.293 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:02 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:03.293 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:02 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:03.293 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:02 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:03.293 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:02 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:03.294 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:02 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:04.163 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:03 smithi099 ceph-mon[29691]: pgmap v863: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:04.163 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:03 smithi099 ceph-mon[29691]: pgmap v864: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:04.163 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:03 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:04.163 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:03 smithi099 ceph-mon[29691]: pgmap v865: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:04.163 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:03 smithi099 ceph-mon[29691]: pgmap v866: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:04.164 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:03 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:04.164 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:03 smithi099 ceph-mon[29691]: pgmap v867: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:04.164 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:03 smithi099 ceph-mon[29691]: pgmap v868: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:04.164 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:03 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:04.164 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:03 smithi099 ceph-mon[29691]: pgmap v869: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:04.164 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:03 smithi099 ceph-mon[29691]: pgmap v870: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:04.164 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:03 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:04.164 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:03 smithi099 ceph-mon[29691]: pgmap v871: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:04.164 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:03 smithi099 ceph-mon[29691]: pgmap v872: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:04.164 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:03 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:04.164 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:03 smithi099 ceph-mon[29691]: pgmap v873: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:04.164 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:03 smithi099 ceph-mon[29691]: pgmap v874: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:04.164 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:03 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:04.164 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:03 smithi099 ceph-mon[29691]: pgmap v875: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:04.165 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:03 smithi099 ceph-mon[29691]: pgmap v876: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:04.165 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:03 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:04.165 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:03 smithi099 ceph-mon[29691]: pgmap v877: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:04.165 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:03 smithi099 ceph-mon[29691]: pgmap v878: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:04.165 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:03 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:04.165 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:03 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:04.165 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:03 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:04.165 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:03 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:04.165 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:03 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:04.165 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:03 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:04.165 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:03 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:04.165 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:03 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:04.166 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:03 smithi099 ceph-mon[24912]: pgmap v863: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:04.166 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:03 smithi099 ceph-mon[24912]: pgmap v864: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:04.166 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:03 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:04.166 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:03 smithi099 ceph-mon[24912]: pgmap v865: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:04.166 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:03 smithi099 ceph-mon[24912]: pgmap v866: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:04.166 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:03 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:04.166 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:03 smithi099 ceph-mon[24912]: pgmap v867: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:04.166 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:03 smithi099 ceph-mon[24912]: pgmap v868: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:04.166 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:03 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:04.166 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:03 smithi099 ceph-mon[24912]: pgmap v869: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:04.166 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:03 smithi099 ceph-mon[24912]: pgmap v870: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:04.166 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:03 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:04.166 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:03 smithi099 ceph-mon[24912]: pgmap v871: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:04.167 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:03 smithi099 ceph-mon[24912]: pgmap v872: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:04.167 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:03 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:04.167 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:03 smithi099 ceph-mon[24912]: pgmap v873: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:04.167 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:03 smithi099 ceph-mon[24912]: pgmap v874: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:04.167 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:03 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:04.167 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:03 smithi099 ceph-mon[24912]: pgmap v875: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:04.167 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:03 smithi099 ceph-mon[24912]: pgmap v876: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:04.167 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:03 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:04.167 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:03 smithi099 ceph-mon[24912]: pgmap v877: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:04.167 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:03 smithi099 ceph-mon[24912]: pgmap v878: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:04.167 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:03 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:04.167 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:03 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:04.167 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:03 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:04.167 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:03 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:04.167 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:03 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:04.168 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:03 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:04.168 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:03 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:04.168 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:03 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:04.168 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:03 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:04.168 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:03 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:04.168 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:03 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:04.168 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:03 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:04.168 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:03 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:04.169 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:03 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:04.169 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:03 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:04.169 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:03 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:04.169 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:03 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:04.169 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:03 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:04.169 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:03 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:04.169 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:03 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:04.169 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:03 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:04.169 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:03 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:04.169 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:03 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:04.169 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:03 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:04.169 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:03 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:04.169 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:03 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:04.169 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:03 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:04.169 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:03 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:04.170 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:03 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:04.170 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:03 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:04.170 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:03 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:04.170 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:03 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:04.170 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:03 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:04.170 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:03 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:04.170 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:03 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:04.170 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:03 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:04.170 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:03 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:04.170 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:03 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:04.170 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:03 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:04.170 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:03 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:04.170 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:03 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:04.170 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:03 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:04.170 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:03 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:04.171 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:03 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:04.171 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:03 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:04.171 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:03 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:04.171 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:03 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:04.171 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:03 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:04.171 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:03 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:04.171 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:03 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:04.171 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:03 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:04.171 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:03 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:04.171 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:03 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:04.171 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:03 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:04.172 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:03 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:04.172 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:03 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:04.172 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:03 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:04.172 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:03 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:04.172 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:03 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:04.172 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:03 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:04.172 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:03 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:04.172 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:03 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:04.172 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:03 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:04.172 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:03 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:04.172 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:03 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:04.172 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:03 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:04.172 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:03 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:04.172 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:03 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:04.173 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:03 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:04.173 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:03 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:04.173 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:03 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:04.173 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:03 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:04.173 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:03 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:04.173 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:03 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:04.173 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:03 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:04.173 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:03 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:04.173 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:03 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:04.173 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:03 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:04.173 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:03 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:04.173 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:03 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:04.173 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:03 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:04.173 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:03 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:04.173 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:03 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:04.174 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:03 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:04.174 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:03 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:04.174 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:03 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:04.174 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:03 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:04.174 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:03 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:04.174 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:03 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:04.174 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:03 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:04.174 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:03 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:04.174 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:03 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:04.223 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:03 smithi181 ceph-mon[25762]: pgmap v863: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:04.223 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:03 smithi181 ceph-mon[25762]: pgmap v864: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:04.223 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:03 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:04.223 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:03 smithi181 ceph-mon[25762]: pgmap v865: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:04.223 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:03 smithi181 ceph-mon[25762]: pgmap v866: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:04.223 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:03 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:04.223 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:03 smithi181 ceph-mon[25762]: pgmap v867: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:04.223 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:03 smithi181 ceph-mon[25762]: pgmap v868: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:04.223 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:03 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:04.224 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:03 smithi181 ceph-mon[25762]: pgmap v869: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:04.224 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:03 smithi181 ceph-mon[25762]: pgmap v870: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:04.224 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:03 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:04.224 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:03 smithi181 ceph-mon[25762]: pgmap v871: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:04.224 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:03 smithi181 ceph-mon[25762]: pgmap v872: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:04.224 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:03 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:04.224 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:03 smithi181 ceph-mon[25762]: pgmap v873: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:04.224 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:03 smithi181 ceph-mon[25762]: pgmap v874: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:04.224 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:03 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:04.224 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:03 smithi181 ceph-mon[25762]: pgmap v875: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:04.224 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:03 smithi181 ceph-mon[25762]: pgmap v876: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:04.224 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:03 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:04.224 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:03 smithi181 ceph-mon[25762]: pgmap v877: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:04.224 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:03 smithi181 ceph-mon[25762]: pgmap v878: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:04.224 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:03 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:04.225 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:03 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:04.225 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:03 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:04.225 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:03 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:04.225 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:03 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:04.225 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:03 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:04.225 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:03 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:04.225 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:03 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:04.225 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:03 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:04.225 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:03 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:04.225 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:03 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:04.225 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:03 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:04.225 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:03 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:04.225 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:03 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:04.225 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:03 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:04.225 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:03 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:04.226 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:03 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:04.226 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:03 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:04.226 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:03 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:04.226 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:03 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:04.226 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:03 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:04.226 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:03 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:04.226 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:03 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:04.226 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:03 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:04.226 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:03 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:04.226 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:03 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:04.226 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:03 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:04.226 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:03 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:04.226 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:03 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:04.226 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:03 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:04.227 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:03 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:04.227 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:03 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:04.227 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:03 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:04.227 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:03 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:04.227 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:03 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:04.227 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:03 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:04.227 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:03 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:04.227 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:03 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:04.227 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:03 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:04.227 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:03 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:04.227 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:03 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:04.227 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:03 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:04.227 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:03 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:04.227 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:03 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:04.228 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:03 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:04.228 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:03 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:04.228 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:03 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:04.228 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:03 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:04.228 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:03 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:04.228 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:03 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:05.061 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 14:00:04 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[71049]: ::ffff:172.21.15.181 - - [30/Mar/2024:14:00:04] "GET /metrics HTTP/1.1" 200 37985 "" "Prometheus/2.33.4" 2024-03-30T14:00:05.061 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:04 smithi099 ceph-mon[24912]: pgmap v879: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:05.062 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:04 smithi099 ceph-mon[24912]: pgmap v880: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:05.062 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:04 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:05.062 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:04 smithi099 ceph-mon[24912]: pgmap v881: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:05.062 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:04 smithi099 ceph-mon[24912]: pgmap v882: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:05.062 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:04 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:05.062 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:04 smithi099 ceph-mon[24912]: pgmap v883: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:05.062 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:04 smithi099 ceph-mon[24912]: pgmap v884: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:05.062 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:04 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:05.062 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:04 smithi099 ceph-mon[24912]: pgmap v885: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:05.062 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:04 smithi099 ceph-mon[24912]: pgmap v886: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:05.062 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:04 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:05.063 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:04 smithi099 ceph-mon[24912]: from='client.25136 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T14:00:05.063 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:04 smithi099 ceph-mon[24912]: pgmap v887: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:05.063 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:04 smithi099 ceph-mon[24912]: pgmap v888: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:05.063 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:04 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:05.063 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:04 smithi099 ceph-mon[24912]: pgmap v889: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:05.063 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:04 smithi099 ceph-mon[24912]: pgmap v890: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:05.063 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:04 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:05.063 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:04 smithi099 ceph-mon[24912]: pgmap v891: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:05.063 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:04 smithi099 ceph-mon[24912]: pgmap v892: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:05.063 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:04 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:05.063 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:04 smithi099 ceph-mon[24912]: pgmap v893: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:05.063 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:04 smithi099 ceph-mon[24912]: pgmap v894: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:05.063 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:04 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:05.063 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:04 smithi099 ceph-mon[24912]: pgmap v895: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:05.064 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:04 smithi099 ceph-mon[24912]: pgmap v896: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:05.064 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:04 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:05.064 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:04 smithi099 ceph-mon[24912]: pgmap v897: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:05.064 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:04 smithi099 ceph-mon[24912]: pgmap v898: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:05.064 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:04 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:05.064 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:04 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:05.064 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:04 smithi099 ceph-mon[29691]: pgmap v879: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:05.064 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:04 smithi099 ceph-mon[29691]: pgmap v880: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:05.064 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:04 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:05.064 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:04 smithi099 ceph-mon[29691]: pgmap v881: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:05.064 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:04 smithi099 ceph-mon[29691]: pgmap v882: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:05.065 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:04 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:05.065 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:04 smithi099 ceph-mon[29691]: pgmap v883: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:05.065 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:04 smithi099 ceph-mon[29691]: pgmap v884: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:05.065 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:04 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:05.065 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:04 smithi099 ceph-mon[29691]: pgmap v885: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:05.065 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:04 smithi099 ceph-mon[29691]: pgmap v886: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:05.065 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:04 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:05.065 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:04 smithi099 ceph-mon[29691]: from='client.25136 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T14:00:05.065 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:04 smithi099 ceph-mon[29691]: pgmap v887: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:05.065 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:04 smithi099 ceph-mon[29691]: pgmap v888: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:05.065 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:04 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:05.065 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:04 smithi099 ceph-mon[29691]: pgmap v889: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:05.065 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:04 smithi099 ceph-mon[29691]: pgmap v890: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:05.066 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:04 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:05.066 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:04 smithi099 ceph-mon[29691]: pgmap v891: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:05.066 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:04 smithi099 ceph-mon[29691]: pgmap v892: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:05.066 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:04 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:05.066 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:04 smithi099 ceph-mon[29691]: pgmap v893: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:05.066 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:04 smithi099 ceph-mon[29691]: pgmap v894: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:05.066 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:04 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:05.066 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:04 smithi099 ceph-mon[29691]: pgmap v895: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:05.066 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:04 smithi099 ceph-mon[29691]: pgmap v896: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:05.066 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:04 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:05.066 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:04 smithi099 ceph-mon[29691]: pgmap v897: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:05.066 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:04 smithi099 ceph-mon[29691]: pgmap v898: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:05.066 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:04 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:05.067 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:04 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:05.067 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:04 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:05.067 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:04 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:05.067 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:04 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:05.067 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:04 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:05.067 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:04 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:05.067 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:04 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:05.068 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:04 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:05.068 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:04 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:05.068 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:04 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:05.068 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:04 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:05.068 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:04 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:05.068 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:04 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:05.068 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:04 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:05.068 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:04 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:05.068 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:04 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:05.068 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:04 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:05.068 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:04 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:05.068 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:04 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:05.068 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:04 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:05.068 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:04 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:05.069 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:04 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:05.069 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:04 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:05.069 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:04 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:05.069 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:04 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:05.069 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:04 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:05.069 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:04 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:05.069 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:04 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:05.069 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:04 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:05.069 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:04 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:05.069 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:04 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:05.069 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:04 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:05.069 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:04 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:05.070 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:04 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:05.070 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:04 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:05.070 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:04 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:05.070 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:04 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:05.070 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:04 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:05.070 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:04 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:05.070 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:04 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:05.070 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:04 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:05.070 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:04 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:05.070 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:04 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:05.070 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:04 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:05.070 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:04 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:05.070 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:04 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:05.070 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:04 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:05.071 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:04 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:05.071 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:04 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:05.071 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:04 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:05.071 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:04 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:05.071 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:04 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:05.071 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:04 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:05.071 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:04 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:05.071 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:04 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:05.071 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:04 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:05.071 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:04 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:05.071 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:04 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:05.071 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:04 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:05.071 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:04 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:05.071 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:04 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:05.072 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:04 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:05.072 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:04 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:05.072 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:04 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:05.072 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:04 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:05.072 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:04 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:05.072 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:04 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:05.072 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:04 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:05.072 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:04 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:05.073 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:04 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:05.073 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:04 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:05.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:04 smithi181 ceph-mon[25762]: pgmap v879: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:05.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:04 smithi181 ceph-mon[25762]: pgmap v880: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:05.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:04 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:05.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:04 smithi181 ceph-mon[25762]: pgmap v881: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:05.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:04 smithi181 ceph-mon[25762]: pgmap v882: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:05.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:04 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:05.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:04 smithi181 ceph-mon[25762]: pgmap v883: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:05.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:04 smithi181 ceph-mon[25762]: pgmap v884: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:05.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:04 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:05.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:04 smithi181 ceph-mon[25762]: pgmap v885: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:05.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:04 smithi181 ceph-mon[25762]: pgmap v886: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:05.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:04 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:05.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:04 smithi181 ceph-mon[25762]: from='client.25136 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T14:00:05.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:04 smithi181 ceph-mon[25762]: pgmap v887: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:05.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:04 smithi181 ceph-mon[25762]: pgmap v888: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:05.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:04 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:05.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:04 smithi181 ceph-mon[25762]: pgmap v889: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:05.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:04 smithi181 ceph-mon[25762]: pgmap v890: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:05.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:04 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:05.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:04 smithi181 ceph-mon[25762]: pgmap v891: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:05.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:04 smithi181 ceph-mon[25762]: pgmap v892: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:05.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:04 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:05.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:04 smithi181 ceph-mon[25762]: pgmap v893: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:05.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:04 smithi181 ceph-mon[25762]: pgmap v894: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:05.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:04 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:05.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:04 smithi181 ceph-mon[25762]: pgmap v895: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:05.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:04 smithi181 ceph-mon[25762]: pgmap v896: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:05.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:04 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:05.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:04 smithi181 ceph-mon[25762]: pgmap v897: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:05.253 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:04 smithi181 ceph-mon[25762]: pgmap v898: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:05.253 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:04 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:05.253 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:04 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:05.253 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:04 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:05.253 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:04 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:05.253 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:04 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:05.253 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:04 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:05.253 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:04 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:05.253 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:04 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:05.253 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:04 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:05.253 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:04 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:05.253 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:04 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:05.253 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:04 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:05.253 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:04 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:05.253 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:04 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:05.254 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:04 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:05.254 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:04 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:05.254 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:04 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:05.254 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:04 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:05.254 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:04 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:05.254 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:04 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:05.254 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:04 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:05.254 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:04 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:05.254 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:04 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:05.254 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:04 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:05.254 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:04 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:05.254 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:04 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:05.255 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:04 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:05.255 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:04 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:05.255 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:04 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:05.255 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:04 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:05.255 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:04 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:05.255 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:04 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:05.255 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:04 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:05.255 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:04 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:05.255 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:04 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:05.255 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:04 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:05.255 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:04 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:06.081 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:05 smithi099 ceph-mon[24912]: pgmap v899: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:06.081 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:05 smithi099 ceph-mon[24912]: pgmap v900: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:06.081 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:05 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:06.082 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:05 smithi099 ceph-mon[24912]: pgmap v901: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:06.082 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:05 smithi099 ceph-mon[24912]: pgmap v902: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:06.082 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:05 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:06.082 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:05 smithi099 ceph-mon[24912]: pgmap v903: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:06.082 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:05 smithi099 ceph-mon[24912]: pgmap v904: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:06.082 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:05 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:06.082 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:05 smithi099 ceph-mon[24912]: pgmap v905: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:06.082 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:05 smithi099 ceph-mon[24912]: pgmap v906: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:06.082 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:05 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:06.082 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:05 smithi099 ceph-mon[24912]: pgmap v907: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:06.082 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:05 smithi099 ceph-mon[24912]: pgmap v908: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:06.083 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:05 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:06.083 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:05 smithi099 ceph-mon[24912]: pgmap v909: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:06.083 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:05 smithi099 ceph-mon[24912]: pgmap v910: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:06.083 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:05 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:06.083 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:05 smithi099 ceph-mon[24912]: pgmap v911: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:06.083 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:05 smithi099 ceph-mon[24912]: pgmap v912: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:06.083 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:05 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:06.083 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:05 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:06.083 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:05 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:06.083 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:05 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:06.083 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:05 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:06.084 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:05 smithi099 ceph-mon[24912]: pgmap v913: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:06.084 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:05 smithi099 ceph-mon[24912]: pgmap v914: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:06.084 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:05 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:06.084 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:05 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:06.084 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:05 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:06.084 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:05 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:06.084 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:05 smithi099 ceph-mon[29691]: pgmap v899: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:06.084 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:05 smithi099 ceph-mon[29691]: pgmap v900: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:06.085 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:05 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:06.085 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:05 smithi099 ceph-mon[29691]: pgmap v901: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:06.085 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:05 smithi099 ceph-mon[29691]: pgmap v902: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:06.085 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:05 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:06.085 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:05 smithi099 ceph-mon[29691]: pgmap v903: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:06.085 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:05 smithi099 ceph-mon[29691]: pgmap v904: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:06.085 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:05 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:06.085 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:05 smithi099 ceph-mon[29691]: pgmap v905: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:06.085 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:05 smithi099 ceph-mon[29691]: pgmap v906: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:06.085 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:05 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:06.085 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:05 smithi099 ceph-mon[29691]: pgmap v907: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:06.086 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:05 smithi099 ceph-mon[29691]: pgmap v908: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:06.086 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:05 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:06.086 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:05 smithi099 ceph-mon[29691]: pgmap v909: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:06.086 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:05 smithi099 ceph-mon[29691]: pgmap v910: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:06.086 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:05 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:06.086 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:05 smithi099 ceph-mon[29691]: pgmap v911: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:06.086 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:05 smithi099 ceph-mon[29691]: pgmap v912: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:06.087 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:05 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:06.087 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:05 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:06.087 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:05 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:06.087 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:05 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:06.087 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:05 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:06.087 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:05 smithi099 ceph-mon[29691]: pgmap v913: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:06.087 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:05 smithi099 ceph-mon[29691]: pgmap v914: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:06.087 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:05 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:06.087 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:05 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:06.087 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:05 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:06.087 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:05 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:06.088 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:05 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:06.088 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:05 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:06.088 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:05 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:06.088 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:05 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:06.088 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:05 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:06.088 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:05 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:06.088 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:05 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:06.088 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:05 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:06.089 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:05 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:06.089 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:05 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:06.089 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:05 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:06.089 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:05 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:06.089 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:05 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:06.089 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:05 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:06.089 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:05 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:06.089 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:05 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:06.089 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:05 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:06.089 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:05 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:06.089 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:05 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:06.089 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:05 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:06.089 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:05 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:06.090 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:05 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:06.090 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:05 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:06.090 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:05 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:06.090 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:05 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:06.090 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:05 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:06.090 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:05 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:06.090 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:05 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:06.090 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:05 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:06.090 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:05 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:06.090 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:05 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:06.091 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:05 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:06.091 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:05 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:06.091 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:05 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:06.091 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:05 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:06.091 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:05 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:06.091 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:05 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:06.091 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:05 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:06.091 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:05 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:06.091 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:05 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:06.091 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:05 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:06.092 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:05 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:06.092 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:05 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:06.092 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:05 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:06.092 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:05 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:06.092 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:05 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:06.092 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:05 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:06.092 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:05 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:06.092 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:05 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:06.092 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:05 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:06.092 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:05 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:06.092 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:05 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:06.092 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:05 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:06.093 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:05 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:06.093 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:05 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:06.093 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:05 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:06.093 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:05 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:06.093 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:05 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:06.093 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:05 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:06.093 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:05 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:06.093 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:05 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:06.093 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:05 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:06.093 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:05 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:06.094 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:05 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:06.094 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:05 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:06.094 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:05 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:06.094 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:05 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:06.094 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:05 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:06.094 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:05 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:06.094 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:05 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:06.094 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:05 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:06.094 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:05 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:06.094 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:05 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:06.094 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:05 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:06.095 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:05 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:06.095 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:05 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:06.095 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:05 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:06.095 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:05 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:06.095 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:05 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:06.095 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:05 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:06.095 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:05 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:06.095 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:05 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:06.095 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:05 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:06.095 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:05 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:06.095 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:05 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:06.096 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:05 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:06.096 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:05 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:06.096 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:05 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:06.096 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:05 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:06.096 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:05 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:06.096 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:05 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:06.096 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:05 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:06.096 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:05 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:06.096 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:05 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:06.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:05 smithi181 ceph-mon[25762]: pgmap v899: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:06.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:05 smithi181 ceph-mon[25762]: pgmap v900: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:06.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:05 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:06.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:05 smithi181 ceph-mon[25762]: pgmap v901: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:06.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:05 smithi181 ceph-mon[25762]: pgmap v902: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:06.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:05 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:06.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:05 smithi181 ceph-mon[25762]: pgmap v903: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:06.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:05 smithi181 ceph-mon[25762]: pgmap v904: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:06.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:05 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:06.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:05 smithi181 ceph-mon[25762]: pgmap v905: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:06.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:05 smithi181 ceph-mon[25762]: pgmap v906: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:06.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:05 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:06.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:05 smithi181 ceph-mon[25762]: pgmap v907: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:06.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:05 smithi181 ceph-mon[25762]: pgmap v908: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:06.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:05 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:06.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:05 smithi181 ceph-mon[25762]: pgmap v909: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:06.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:05 smithi181 ceph-mon[25762]: pgmap v910: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:06.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:05 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:06.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:05 smithi181 ceph-mon[25762]: pgmap v911: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:06.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:05 smithi181 ceph-mon[25762]: pgmap v912: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:06.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:05 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:06.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:05 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:06.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:05 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:06.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:05 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:06.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:05 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:06.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:05 smithi181 ceph-mon[25762]: pgmap v913: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:06.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:05 smithi181 ceph-mon[25762]: pgmap v914: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:06.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:05 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:06.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:05 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:06.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:05 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:06.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:05 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:06.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:05 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:06.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:05 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:06.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:05 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:06.253 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:05 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:06.253 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:05 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:06.253 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:05 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:06.253 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:05 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:06.253 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:05 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:06.253 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:05 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:06.253 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:05 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:06.253 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:05 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:06.253 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:05 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:06.253 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:05 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:06.253 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:05 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:06.253 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:05 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:06.253 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:05 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:06.253 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:05 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:06.253 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:05 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:06.254 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:05 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:06.254 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:05 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:06.254 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:05 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:06.254 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:05 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:06.254 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:05 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:06.254 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:05 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:06.254 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:05 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:06.254 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:05 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:06.254 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:05 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:06.254 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:05 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:06.254 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:05 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:06.254 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:05 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:06.254 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:05 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:06.254 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:05 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:06.254 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:05 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:06.255 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:05 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:06.255 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:05 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:06.255 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:05 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:06.255 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:05 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:06.255 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:05 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:06.255 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:05 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:06.255 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:05 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:06.255 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:05 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:06.255 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:05 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:06.255 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:05 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:06.255 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:05 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:06.255 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:05 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:06.255 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:05 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:06.255 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:05 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:06.883 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:06 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:06.884 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:06 smithi181 ceph-mon[25762]: pgmap v915: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:06.884 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:06 smithi181 ceph-mon[25762]: pgmap v916: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:06.884 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:06 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:06.884 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:06 smithi181 ceph-mon[25762]: pgmap v917: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:06.884 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:06 smithi181 ceph-mon[25762]: pgmap v918: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:06.884 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:06 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:06.884 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:06 smithi181 ceph-mon[25762]: pgmap v919: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:07.178 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:06 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:07.178 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:06 smithi099 ceph-mon[24912]: pgmap v915: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:07.178 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:06 smithi099 ceph-mon[24912]: pgmap v916: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:07.178 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:06 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:07.178 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:06 smithi099 ceph-mon[24912]: pgmap v917: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:07.179 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:06 smithi099 ceph-mon[24912]: pgmap v918: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:07.179 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:06 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:07.179 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:06 smithi099 ceph-mon[24912]: pgmap v919: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:07.179 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:06 smithi099 ceph-mon[24912]: pgmap v920: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:07.179 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:06 smithi099 ceph-mon[24912]: pgmap v921: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:07.179 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:06 smithi099 ceph-mon[24912]: pgmap v922: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:07.179 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:06 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:07.179 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:06 smithi099 ceph-mon[24912]: pgmap v923: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:07.179 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:06 smithi099 ceph-mon[24912]: pgmap v924: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:07.179 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:06 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:07.179 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:06 smithi099 ceph-mon[24912]: pgmap v925: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:07.179 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:06 smithi099 ceph-mon[24912]: pgmap v926: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:07.179 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:06 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:07.179 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:06 smithi099 ceph-mon[24912]: pgmap v927: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:07.180 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:06 smithi099 ceph-mon[24912]: pgmap v928: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:07.180 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:06 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:07.180 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:06 smithi099 ceph-mon[24912]: pgmap v929: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:07.180 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:06 smithi099 ceph-mon[24912]: pgmap v930: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:07.180 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:06 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:07.180 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:06 smithi099 ceph-mon[24912]: pgmap v931: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:07.180 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:06 smithi099 ceph-mon[24912]: pgmap v932: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:07.180 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:06 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:07.180 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:06 smithi099 ceph-mon[29691]: pgmap v915: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:07.180 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:06 smithi099 ceph-mon[29691]: pgmap v916: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:07.180 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:06 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:07.180 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:06 smithi099 ceph-mon[29691]: pgmap v917: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:07.180 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:06 smithi099 ceph-mon[29691]: pgmap v918: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:07.181 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:06 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:07.181 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:06 smithi099 ceph-mon[29691]: pgmap v919: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:07.181 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:06 smithi099 ceph-mon[29691]: pgmap v920: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:07.181 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:06 smithi099 ceph-mon[29691]: pgmap v921: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:07.181 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:06 smithi099 ceph-mon[29691]: pgmap v922: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:07.181 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:06 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:07.181 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:06 smithi099 ceph-mon[29691]: pgmap v923: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:07.181 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:06 smithi099 ceph-mon[29691]: pgmap v924: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:07.181 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:06 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:07.181 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:06 smithi099 ceph-mon[29691]: pgmap v925: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:07.181 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:06 smithi099 ceph-mon[29691]: pgmap v926: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:07.181 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:06 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:07.181 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:06 smithi099 ceph-mon[29691]: pgmap v927: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:07.181 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:06 smithi099 ceph-mon[29691]: pgmap v928: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:07.181 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:06 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:07.182 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:06 smithi099 ceph-mon[29691]: pgmap v929: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:07.182 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:06 smithi099 ceph-mon[29691]: pgmap v930: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:07.182 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:06 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:07.182 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:06 smithi099 ceph-mon[29691]: pgmap v931: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:07.182 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:06 smithi099 ceph-mon[29691]: pgmap v932: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:07.193 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:06 smithi181 ceph-mon[25762]: pgmap v920: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:07.194 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:06 smithi181 ceph-mon[25762]: pgmap v921: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:07.194 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:06 smithi181 ceph-mon[25762]: pgmap v922: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:07.194 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:06 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:07.194 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:06 smithi181 ceph-mon[25762]: pgmap v923: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:07.194 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:06 smithi181 ceph-mon[25762]: pgmap v924: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:07.194 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:06 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:07.194 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:06 smithi181 ceph-mon[25762]: pgmap v925: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:07.194 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:06 smithi181 ceph-mon[25762]: pgmap v926: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:07.194 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:06 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:07.194 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:06 smithi181 ceph-mon[25762]: pgmap v927: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:07.194 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:06 smithi181 ceph-mon[25762]: pgmap v928: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:07.194 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:06 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:07.194 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:06 smithi181 ceph-mon[25762]: pgmap v929: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:07.194 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:06 smithi181 ceph-mon[25762]: pgmap v930: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:07.195 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:06 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:07.195 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:06 smithi181 ceph-mon[25762]: pgmap v931: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:07.195 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:06 smithi181 ceph-mon[25762]: pgmap v932: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:09.081 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:08 smithi099 ceph-mon[24912]: pgmap v933: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-03-30T14:00:09.081 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:08 smithi099 ceph-mon[29691]: pgmap v933: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-03-30T14:00:09.208 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:08 smithi181 ceph-mon[25762]: pgmap v933: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-03-30T14:00:10.649 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:10 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:10.650 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:10 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:10.650 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:10 smithi099 ceph-mon[24912]: pgmap v934: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-03-30T14:00:10.650 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:10 smithi099 ceph-mon[24912]: pgmap v935: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-03-30T14:00:10.650 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:10 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:10.650 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:10 smithi099 ceph-mon[24912]: Upgrade: Updating node-exporter.a (1/2) 2024-03-30T14:00:10.650 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:10 smithi099 ceph-mon[24912]: Deploying daemon node-exporter.a on smithi099 2024-03-30T14:00:10.650 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:10 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:10.650 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:10 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:10.650 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:10 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:10.650 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:10 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:10.651 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:10 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:10.651 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:10 smithi099 ceph-mon[29691]: pgmap v934: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-03-30T14:00:10.651 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:10 smithi099 ceph-mon[29691]: pgmap v935: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-03-30T14:00:10.651 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:10 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:10.651 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:10 smithi099 ceph-mon[29691]: Upgrade: Updating node-exporter.a (1/2) 2024-03-30T14:00:10.651 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:10 smithi099 ceph-mon[29691]: Deploying daemon node-exporter.a on smithi099 2024-03-30T14:00:10.651 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:10 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:10.651 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:10 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:10.651 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:10 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:10.827 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:10 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:10.827 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:10 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:10.827 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:10 smithi181 ceph-mon[25762]: pgmap v934: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-03-30T14:00:10.827 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:10 smithi181 ceph-mon[25762]: pgmap v935: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-03-30T14:00:10.827 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:10 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:10.827 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:10 smithi181 ceph-mon[25762]: Upgrade: Updating node-exporter.a (1/2) 2024-03-30T14:00:10.827 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:10 smithi181 ceph-mon[25762]: Deploying daemon node-exporter.a on smithi099 2024-03-30T14:00:10.827 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:10 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:10.827 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:10 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:10.827 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:10 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:11.081 INFO:journalctl@ceph.node-exporter.a.smithi099.stdout:Mar 30 14:00:10 smithi099 systemd[1]: Stopping Ceph node-exporter.a for 98ebaeb8-ee99-11ee-b647-cb9ed24678a4... 2024-03-30T14:00:11.663 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:11 smithi099 ceph-mon[24912]: pgmap v936: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T14:00:11.663 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:11 smithi099 ceph-mon[24912]: pgmap v937: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T14:00:11.663 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:11 smithi099 ceph-mon[29691]: pgmap v936: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T14:00:11.663 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:11 smithi099 ceph-mon[29691]: pgmap v937: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T14:00:11.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:11 smithi181 ceph-mon[25762]: pgmap v936: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T14:00:12.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:11 smithi181 ceph-mon[25762]: pgmap v937: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T14:00:12.330 INFO:journalctl@ceph.node-exporter.a.smithi099.stdout:Mar 30 14:00:12 smithi099 podman[106031]: 2024-03-30 14:00:12.058402112 +0000 UTC m=+0.130051896 container died a2d2ea3d25489c249abf5bfbe77f54ea1b78286d7850fa9d8eebc53883f53d31 (image=quay.io/prometheus/node-exporter:v1.5.0, name=ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-node-exporter-a, maintainer=The Prometheus Authors ) 2024-03-30T14:00:12.660 INFO:journalctl@ceph.node-exporter.a.smithi099.stdout:Mar 30 14:00:12 smithi099 podman[106031]: 2024-03-30 14:00:12.464775721 +0000 UTC m=+0.536425505 container cleanup a2d2ea3d25489c249abf5bfbe77f54ea1b78286d7850fa9d8eebc53883f53d31 (image=quay.io/prometheus/node-exporter:v1.5.0, name=ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-node-exporter-a, maintainer=The Prometheus Authors ) 2024-03-30T14:00:12.660 INFO:journalctl@ceph.node-exporter.a.smithi099.stdout:Mar 30 14:00:12 smithi099 bash[106031]: ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-node-exporter-a 2024-03-30T14:00:13.278 INFO:journalctl@ceph.node-exporter.a.smithi099.stdout:Mar 30 14:00:13 smithi099 podman[106060]: 2024-03-30 14:00:13.000938607 +0000 UTC m=+0.947165828 container remove a2d2ea3d25489c249abf5bfbe77f54ea1b78286d7850fa9d8eebc53883f53d31 (image=quay.io/prometheus/node-exporter:v1.5.0, name=ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-node-exporter-a, maintainer=The Prometheus Authors ) 2024-03-30T14:00:13.279 INFO:journalctl@ceph.node-exporter.a.smithi099.stdout:Mar 30 14:00:13 smithi099 systemd[1]: ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4@node-exporter.a.service: Main process exited, code=exited, status=143/n/a 2024-03-30T14:00:13.830 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:13 smithi099 ceph-mon[24912]: pgmap v938: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-03-30T14:00:13.831 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:13 smithi099 ceph-mon[29691]: pgmap v938: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-03-30T14:00:13.831 INFO:journalctl@ceph.node-exporter.a.smithi099.stdout:Mar 30 14:00:13 smithi099 systemd[1]: ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4@node-exporter.a.service: Failed with result 'exit-code'. 2024-03-30T14:00:13.831 INFO:journalctl@ceph.node-exporter.a.smithi099.stdout:Mar 30 14:00:13 smithi099 systemd[1]: Stopped Ceph node-exporter.a for 98ebaeb8-ee99-11ee-b647-cb9ed24678a4. 2024-03-30T14:00:13.831 INFO:journalctl@ceph.node-exporter.a.smithi099.stdout:Mar 30 14:00:13 smithi099 systemd[1]: ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4@node-exporter.a.service: Consumed 1.710s CPU time. 2024-03-30T14:00:13.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:13 smithi181 ceph-mon[25762]: pgmap v938: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-03-30T14:00:14.237 INFO:journalctl@ceph.node-exporter.a.smithi099.stdout:Mar 30 14:00:13 smithi099 systemd[1]: Starting Ceph node-exporter.a for 98ebaeb8-ee99-11ee-b647-cb9ed24678a4... 2024-03-30T14:00:14.237 INFO:journalctl@ceph.node-exporter.a.smithi099.stdout:Mar 30 14:00:14 smithi099 podman[106324]: 2024-03-30 14:00:14.024715008 +0000 UTC m=+0.022558355 image pull 0da6a335fe1356545476b749c68f022c897de3a2139e8f0054f6937349ee2b83 quay.io/prometheus/node-exporter:v1.5.0 2024-03-30T14:00:14.237 INFO:journalctl@ceph.node-exporter.a.smithi099.stdout:Mar 30 14:00:14 smithi099 podman[106324]: 2024-03-30 14:00:14.145936514 +0000 UTC m=+0.143779841 container create 4a3f1f6e7068e330460dfee02fb2791a8be551162e2674687cbe2be492d36880 (image=quay.io/prometheus/node-exporter:v1.5.0, name=ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-node-exporter-a, maintainer=The Prometheus Authors ) 2024-03-30T14:00:14.637 INFO:journalctl@ceph.node-exporter.a.smithi099.stdout:Mar 30 14:00:14 smithi099 podman[106324]: 2024-03-30 14:00:14.348667253 +0000 UTC m=+0.346510581 container init 4a3f1f6e7068e330460dfee02fb2791a8be551162e2674687cbe2be492d36880 (image=quay.io/prometheus/node-exporter:v1.5.0, name=ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-node-exporter-a, maintainer=The Prometheus Authors ) 2024-03-30T14:00:14.637 INFO:journalctl@ceph.node-exporter.a.smithi099.stdout:Mar 30 14:00:14 smithi099 podman[106324]: 2024-03-30 14:00:14.351420778 +0000 UTC m=+0.349264114 container start 4a3f1f6e7068e330460dfee02fb2791a8be551162e2674687cbe2be492d36880 (image=quay.io/prometheus/node-exporter:v1.5.0, name=ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-node-exporter-a, maintainer=The Prometheus Authors ) 2024-03-30T14:00:14.637 INFO:journalctl@ceph.node-exporter.a.smithi099.stdout:Mar 30 14:00:14 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-node-exporter-a[106368]: ts=2024-03-30T14:00:14.354Z caller=node_exporter.go:180 level=info msg="Starting node_exporter" version="(version=1.5.0, branch=HEAD, revision=1b48970ffcf5630534fb00bb0687d73c66d1c959)" 2024-03-30T14:00:14.637 INFO:journalctl@ceph.node-exporter.a.smithi099.stdout:Mar 30 14:00:14 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-node-exporter-a[106368]: ts=2024-03-30T14:00:14.354Z caller=node_exporter.go:181 level=info msg="Build context" build_context="(go=go1.19.3, user=root@6e7732a7b81b, date=20221129-18:59:09)" 2024-03-30T14:00:14.637 INFO:journalctl@ceph.node-exporter.a.smithi099.stdout:Mar 30 14:00:14 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-node-exporter-a[106368]: ts=2024-03-30T14:00:14.355Z caller=diskstats_common.go:111 level=info collector=diskstats msg="Parsed flag --collector.diskstats.device-exclude" flag=^(ram|loop|fd|(h|s|v|xv)d[a-z]|nvme\d+n\d+p)\d+$ 2024-03-30T14:00:14.637 INFO:journalctl@ceph.node-exporter.a.smithi099.stdout:Mar 30 14:00:14 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-node-exporter-a[106368]: ts=2024-03-30T14:00:14.355Z caller=diskstats_linux.go:264 level=error collector=diskstats msg="Failed to open directory, disabling udev device properties" path=/run/udev/data 2024-03-30T14:00:14.637 INFO:journalctl@ceph.node-exporter.a.smithi099.stdout:Mar 30 14:00:14 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-node-exporter-a[106368]: ts=2024-03-30T14:00:14.355Z caller=filesystem_common.go:111 level=info collector=filesystem msg="Parsed flag --collector.filesystem.mount-points-exclude" flag=^/(dev|proc|run/credentials/.+|sys|var/lib/docker/.+|var/lib/containers/storage/.+)($|/) 2024-03-30T14:00:14.637 INFO:journalctl@ceph.node-exporter.a.smithi099.stdout:Mar 30 14:00:14 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-node-exporter-a[106368]: ts=2024-03-30T14:00:14.355Z caller=filesystem_common.go:113 level=info collector=filesystem msg="Parsed flag --collector.filesystem.fs-types-exclude" flag=^(autofs|binfmt_misc|bpf|cgroup2?|configfs|debugfs|devpts|devtmpfs|fusectl|hugetlbfs|iso9660|mqueue|nsfs|overlay|proc|procfs|pstore|rpc_pipefs|securityfs|selinuxfs|squashfs|sysfs|tracefs)$ 2024-03-30T14:00:14.637 INFO:journalctl@ceph.node-exporter.a.smithi099.stdout:Mar 30 14:00:14 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-node-exporter-a[106368]: ts=2024-03-30T14:00:14.356Z caller=node_exporter.go:110 level=info msg="Enabled collectors" 2024-03-30T14:00:14.637 INFO:journalctl@ceph.node-exporter.a.smithi099.stdout:Mar 30 14:00:14 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-node-exporter-a[106368]: ts=2024-03-30T14:00:14.356Z caller=node_exporter.go:117 level=info collector=arp 2024-03-30T14:00:14.637 INFO:journalctl@ceph.node-exporter.a.smithi099.stdout:Mar 30 14:00:14 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-node-exporter-a[106368]: ts=2024-03-30T14:00:14.356Z caller=node_exporter.go:117 level=info collector=bcache 2024-03-30T14:00:14.638 INFO:journalctl@ceph.node-exporter.a.smithi099.stdout:Mar 30 14:00:14 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-node-exporter-a[106368]: ts=2024-03-30T14:00:14.356Z caller=node_exporter.go:117 level=info collector=bonding 2024-03-30T14:00:14.638 INFO:journalctl@ceph.node-exporter.a.smithi099.stdout:Mar 30 14:00:14 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-node-exporter-a[106368]: ts=2024-03-30T14:00:14.356Z caller=node_exporter.go:117 level=info collector=btrfs 2024-03-30T14:00:14.638 INFO:journalctl@ceph.node-exporter.a.smithi099.stdout:Mar 30 14:00:14 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-node-exporter-a[106368]: ts=2024-03-30T14:00:14.356Z caller=node_exporter.go:117 level=info collector=conntrack 2024-03-30T14:00:14.638 INFO:journalctl@ceph.node-exporter.a.smithi099.stdout:Mar 30 14:00:14 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-node-exporter-a[106368]: ts=2024-03-30T14:00:14.356Z caller=node_exporter.go:117 level=info collector=cpu 2024-03-30T14:00:14.638 INFO:journalctl@ceph.node-exporter.a.smithi099.stdout:Mar 30 14:00:14 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-node-exporter-a[106368]: ts=2024-03-30T14:00:14.356Z caller=node_exporter.go:117 level=info collector=cpufreq 2024-03-30T14:00:14.638 INFO:journalctl@ceph.node-exporter.a.smithi099.stdout:Mar 30 14:00:14 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-node-exporter-a[106368]: ts=2024-03-30T14:00:14.356Z caller=node_exporter.go:117 level=info collector=diskstats 2024-03-30T14:00:14.638 INFO:journalctl@ceph.node-exporter.a.smithi099.stdout:Mar 30 14:00:14 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-node-exporter-a[106368]: ts=2024-03-30T14:00:14.356Z caller=node_exporter.go:117 level=info collector=dmi 2024-03-30T14:00:14.638 INFO:journalctl@ceph.node-exporter.a.smithi099.stdout:Mar 30 14:00:14 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-node-exporter-a[106368]: ts=2024-03-30T14:00:14.356Z caller=node_exporter.go:117 level=info collector=edac 2024-03-30T14:00:14.639 INFO:journalctl@ceph.node-exporter.a.smithi099.stdout:Mar 30 14:00:14 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-node-exporter-a[106368]: ts=2024-03-30T14:00:14.356Z caller=node_exporter.go:117 level=info collector=entropy 2024-03-30T14:00:14.639 INFO:journalctl@ceph.node-exporter.a.smithi099.stdout:Mar 30 14:00:14 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-node-exporter-a[106368]: ts=2024-03-30T14:00:14.356Z caller=node_exporter.go:117 level=info collector=fibrechannel 2024-03-30T14:00:14.639 INFO:journalctl@ceph.node-exporter.a.smithi099.stdout:Mar 30 14:00:14 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-node-exporter-a[106368]: ts=2024-03-30T14:00:14.356Z caller=node_exporter.go:117 level=info collector=filefd 2024-03-30T14:00:14.639 INFO:journalctl@ceph.node-exporter.a.smithi099.stdout:Mar 30 14:00:14 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-node-exporter-a[106368]: ts=2024-03-30T14:00:14.356Z caller=node_exporter.go:117 level=info collector=filesystem 2024-03-30T14:00:14.639 INFO:journalctl@ceph.node-exporter.a.smithi099.stdout:Mar 30 14:00:14 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-node-exporter-a[106368]: ts=2024-03-30T14:00:14.356Z caller=node_exporter.go:117 level=info collector=hwmon 2024-03-30T14:00:14.639 INFO:journalctl@ceph.node-exporter.a.smithi099.stdout:Mar 30 14:00:14 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-node-exporter-a[106368]: ts=2024-03-30T14:00:14.356Z caller=node_exporter.go:117 level=info collector=infiniband 2024-03-30T14:00:14.639 INFO:journalctl@ceph.node-exporter.a.smithi099.stdout:Mar 30 14:00:14 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-node-exporter-a[106368]: ts=2024-03-30T14:00:14.356Z caller=node_exporter.go:117 level=info collector=ipvs 2024-03-30T14:00:14.639 INFO:journalctl@ceph.node-exporter.a.smithi099.stdout:Mar 30 14:00:14 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-node-exporter-a[106368]: ts=2024-03-30T14:00:14.356Z caller=node_exporter.go:117 level=info collector=loadavg 2024-03-30T14:00:14.639 INFO:journalctl@ceph.node-exporter.a.smithi099.stdout:Mar 30 14:00:14 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-node-exporter-a[106368]: ts=2024-03-30T14:00:14.356Z caller=node_exporter.go:117 level=info collector=mdadm 2024-03-30T14:00:14.639 INFO:journalctl@ceph.node-exporter.a.smithi099.stdout:Mar 30 14:00:14 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-node-exporter-a[106368]: ts=2024-03-30T14:00:14.356Z caller=node_exporter.go:117 level=info collector=meminfo 2024-03-30T14:00:14.639 INFO:journalctl@ceph.node-exporter.a.smithi099.stdout:Mar 30 14:00:14 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-node-exporter-a[106368]: ts=2024-03-30T14:00:14.356Z caller=node_exporter.go:117 level=info collector=netclass 2024-03-30T14:00:14.639 INFO:journalctl@ceph.node-exporter.a.smithi099.stdout:Mar 30 14:00:14 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-node-exporter-a[106368]: ts=2024-03-30T14:00:14.356Z caller=node_exporter.go:117 level=info collector=netdev 2024-03-30T14:00:14.639 INFO:journalctl@ceph.node-exporter.a.smithi099.stdout:Mar 30 14:00:14 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-node-exporter-a[106368]: ts=2024-03-30T14:00:14.356Z caller=node_exporter.go:117 level=info collector=netstat 2024-03-30T14:00:14.639 INFO:journalctl@ceph.node-exporter.a.smithi099.stdout:Mar 30 14:00:14 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-node-exporter-a[106368]: ts=2024-03-30T14:00:14.356Z caller=node_exporter.go:117 level=info collector=nfs 2024-03-30T14:00:14.640 INFO:journalctl@ceph.node-exporter.a.smithi099.stdout:Mar 30 14:00:14 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-node-exporter-a[106368]: ts=2024-03-30T14:00:14.356Z caller=node_exporter.go:117 level=info collector=nfsd 2024-03-30T14:00:14.640 INFO:journalctl@ceph.node-exporter.a.smithi099.stdout:Mar 30 14:00:14 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-node-exporter-a[106368]: ts=2024-03-30T14:00:14.356Z caller=node_exporter.go:117 level=info collector=nvme 2024-03-30T14:00:14.640 INFO:journalctl@ceph.node-exporter.a.smithi099.stdout:Mar 30 14:00:14 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-node-exporter-a[106368]: ts=2024-03-30T14:00:14.356Z caller=node_exporter.go:117 level=info collector=os 2024-03-30T14:00:14.640 INFO:journalctl@ceph.node-exporter.a.smithi099.stdout:Mar 30 14:00:14 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-node-exporter-a[106368]: ts=2024-03-30T14:00:14.356Z caller=node_exporter.go:117 level=info collector=powersupplyclass 2024-03-30T14:00:14.640 INFO:journalctl@ceph.node-exporter.a.smithi099.stdout:Mar 30 14:00:14 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-node-exporter-a[106368]: ts=2024-03-30T14:00:14.356Z caller=node_exporter.go:117 level=info collector=pressure 2024-03-30T14:00:14.640 INFO:journalctl@ceph.node-exporter.a.smithi099.stdout:Mar 30 14:00:14 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-node-exporter-a[106368]: ts=2024-03-30T14:00:14.356Z caller=node_exporter.go:117 level=info collector=rapl 2024-03-30T14:00:14.640 INFO:journalctl@ceph.node-exporter.a.smithi099.stdout:Mar 30 14:00:14 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-node-exporter-a[106368]: ts=2024-03-30T14:00:14.356Z caller=node_exporter.go:117 level=info collector=schedstat 2024-03-30T14:00:14.640 INFO:journalctl@ceph.node-exporter.a.smithi099.stdout:Mar 30 14:00:14 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-node-exporter-a[106368]: ts=2024-03-30T14:00:14.356Z caller=node_exporter.go:117 level=info collector=selinux 2024-03-30T14:00:14.640 INFO:journalctl@ceph.node-exporter.a.smithi099.stdout:Mar 30 14:00:14 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-node-exporter-a[106368]: ts=2024-03-30T14:00:14.356Z caller=node_exporter.go:117 level=info collector=sockstat 2024-03-30T14:00:14.640 INFO:journalctl@ceph.node-exporter.a.smithi099.stdout:Mar 30 14:00:14 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-node-exporter-a[106368]: ts=2024-03-30T14:00:14.356Z caller=node_exporter.go:117 level=info collector=softnet 2024-03-30T14:00:14.640 INFO:journalctl@ceph.node-exporter.a.smithi099.stdout:Mar 30 14:00:14 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-node-exporter-a[106368]: ts=2024-03-30T14:00:14.356Z caller=node_exporter.go:117 level=info collector=stat 2024-03-30T14:00:14.640 INFO:journalctl@ceph.node-exporter.a.smithi099.stdout:Mar 30 14:00:14 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-node-exporter-a[106368]: ts=2024-03-30T14:00:14.356Z caller=node_exporter.go:117 level=info collector=tapestats 2024-03-30T14:00:14.640 INFO:journalctl@ceph.node-exporter.a.smithi099.stdout:Mar 30 14:00:14 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-node-exporter-a[106368]: ts=2024-03-30T14:00:14.356Z caller=node_exporter.go:117 level=info collector=textfile 2024-03-30T14:00:14.640 INFO:journalctl@ceph.node-exporter.a.smithi099.stdout:Mar 30 14:00:14 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-node-exporter-a[106368]: ts=2024-03-30T14:00:14.356Z caller=node_exporter.go:117 level=info collector=thermal_zone 2024-03-30T14:00:14.640 INFO:journalctl@ceph.node-exporter.a.smithi099.stdout:Mar 30 14:00:14 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-node-exporter-a[106368]: ts=2024-03-30T14:00:14.356Z caller=node_exporter.go:117 level=info collector=time 2024-03-30T14:00:14.640 INFO:journalctl@ceph.node-exporter.a.smithi099.stdout:Mar 30 14:00:14 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-node-exporter-a[106368]: ts=2024-03-30T14:00:14.356Z caller=node_exporter.go:117 level=info collector=udp_queues 2024-03-30T14:00:14.641 INFO:journalctl@ceph.node-exporter.a.smithi099.stdout:Mar 30 14:00:14 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-node-exporter-a[106368]: ts=2024-03-30T14:00:14.356Z caller=node_exporter.go:117 level=info collector=uname 2024-03-30T14:00:14.641 INFO:journalctl@ceph.node-exporter.a.smithi099.stdout:Mar 30 14:00:14 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-node-exporter-a[106368]: ts=2024-03-30T14:00:14.356Z caller=node_exporter.go:117 level=info collector=vmstat 2024-03-30T14:00:14.641 INFO:journalctl@ceph.node-exporter.a.smithi099.stdout:Mar 30 14:00:14 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-node-exporter-a[106368]: ts=2024-03-30T14:00:14.356Z caller=node_exporter.go:117 level=info collector=xfs 2024-03-30T14:00:14.641 INFO:journalctl@ceph.node-exporter.a.smithi099.stdout:Mar 30 14:00:14 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-node-exporter-a[106368]: ts=2024-03-30T14:00:14.356Z caller=node_exporter.go:117 level=info collector=zfs 2024-03-30T14:00:14.641 INFO:journalctl@ceph.node-exporter.a.smithi099.stdout:Mar 30 14:00:14 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-node-exporter-a[106368]: ts=2024-03-30T14:00:14.356Z caller=tls_config.go:232 level=info msg="Listening on" address=[::]:9100 2024-03-30T14:00:14.641 INFO:journalctl@ceph.node-exporter.a.smithi099.stdout:Mar 30 14:00:14 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-node-exporter-a[106368]: ts=2024-03-30T14:00:14.356Z caller=tls_config.go:235 level=info msg="TLS is disabled." http2=false address=[::]:9100 2024-03-30T14:00:14.641 INFO:journalctl@ceph.node-exporter.a.smithi099.stdout:Mar 30 14:00:14 smithi099 bash[106324]: 4a3f1f6e7068e330460dfee02fb2791a8be551162e2674687cbe2be492d36880 2024-03-30T14:00:14.641 INFO:journalctl@ceph.node-exporter.a.smithi099.stdout:Mar 30 14:00:14 smithi099 systemd[1]: Started Ceph node-exporter.a for 98ebaeb8-ee99-11ee-b647-cb9ed24678a4. 2024-03-30T14:00:15.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:14 smithi181 ceph-mon[25762]: from='client.25136 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T14:00:15.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:14 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:15.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:14 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:15.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:14 smithi181 ceph-mon[25762]: pgmap v939: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 868 B/s rd, 0 op/s 2024-03-30T14:00:15.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:14 smithi181 ceph-mon[25762]: pgmap v940: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T14:00:15.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:14 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:15.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:14 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:15.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:14 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:15.081 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 14:00:14 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[71049]: ::ffff:172.21.15.181 - - [30/Mar/2024:14:00:14] "GET /metrics HTTP/1.1" 200 37985 "" "Prometheus/2.33.4" 2024-03-30T14:00:15.081 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:14 smithi099 ceph-mon[29691]: from='client.25136 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T14:00:15.081 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:14 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:15.081 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:14 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:15.081 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:14 smithi099 ceph-mon[29691]: pgmap v939: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 868 B/s rd, 0 op/s 2024-03-30T14:00:15.081 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:14 smithi099 ceph-mon[29691]: pgmap v940: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T14:00:15.081 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:14 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:15.081 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:14 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:15.082 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:14 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:15.082 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:14 smithi099 ceph-mon[24912]: from='client.25136 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T14:00:15.082 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:14 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:15.082 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:14 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:15.082 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:14 smithi099 ceph-mon[24912]: pgmap v939: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 868 B/s rd, 0 op/s 2024-03-30T14:00:15.082 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:14 smithi099 ceph-mon[24912]: pgmap v940: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T14:00:15.082 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:14 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:15.082 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:14 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:15.082 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:14 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:15.831 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:15 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T14:00:15.831 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:15 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T14:00:16.088 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:15 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T14:00:17.056 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:16 smithi181 ceph-mon[25762]: pgmap v941: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 839 B/s rd, 0 op/s 2024-03-30T14:00:17.080 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:16 smithi099 ceph-mon[24912]: pgmap v941: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 839 B/s rd, 0 op/s 2024-03-30T14:00:17.080 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:16 smithi099 ceph-mon[29691]: pgmap v941: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 839 B/s rd, 0 op/s 2024-03-30T14:00:17.331 INFO:journalctl@ceph.node-exporter.b.smithi181.stdout:Mar 30 14:00:17 smithi181 systemd[1]: Stopping Ceph node-exporter.b for 98ebaeb8-ee99-11ee-b647-cb9ed24678a4... 2024-03-30T14:00:17.606 INFO:journalctl@ceph.node-exporter.b.smithi181.stdout:Mar 30 14:00:17 smithi181 podman[95111]: 2024-03-30 14:00:17.337126789 +0000 UTC m=+0.136963825 container died e3b1f926703ff0812710d9ce9220a2c25d978ac33a178dd0174693ead4aab4b7 (image=quay.io/prometheus/node-exporter:v1.5.0, name=ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-node-exporter-b, maintainer=The Prometheus Authors ) 2024-03-30T14:00:17.830 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:17 smithi099 ceph-mon[24912]: Upgrade: Updating node-exporter.b (2/2) 2024-03-30T14:00:17.830 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:17 smithi099 ceph-mon[24912]: Deploying daemon node-exporter.b on smithi181 2024-03-30T14:00:17.831 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:17 smithi099 ceph-mon[29691]: Upgrade: Updating node-exporter.b (2/2) 2024-03-30T14:00:17.831 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:17 smithi099 ceph-mon[29691]: Deploying daemon node-exporter.b on smithi181 2024-03-30T14:00:17.972 INFO:journalctl@ceph.node-exporter.b.smithi181.stdout:Mar 30 14:00:17 smithi181 podman[95111]: 2024-03-30 14:00:17.710391612 +0000 UTC m=+0.510228660 container cleanup e3b1f926703ff0812710d9ce9220a2c25d978ac33a178dd0174693ead4aab4b7 (image=quay.io/prometheus/node-exporter:v1.5.0, name=ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-node-exporter-b, maintainer=The Prometheus Authors ) 2024-03-30T14:00:17.972 INFO:journalctl@ceph.node-exporter.b.smithi181.stdout:Mar 30 14:00:17 smithi181 bash[95111]: ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-node-exporter-b 2024-03-30T14:00:17.972 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:17 smithi181 ceph-mon[25762]: Upgrade: Updating node-exporter.b (2/2) 2024-03-30T14:00:17.973 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:17 smithi181 ceph-mon[25762]: Deploying daemon node-exporter.b on smithi181 2024-03-30T14:00:17.975 INFO:journalctl@ceph.node-exporter.b.smithi181.stdout:Mar 30 14:00:17 smithi181 podman[95125]: 2024-03-30 14:00:17.978109812 +0000 UTC m=+0.645045746 container remove e3b1f926703ff0812710d9ce9220a2c25d978ac33a178dd0174693ead4aab4b7 (image=quay.io/prometheus/node-exporter:v1.5.0, name=ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-node-exporter-b, maintainer=The Prometheus Authors ) 2024-03-30T14:00:17.975 INFO:journalctl@ceph.node-exporter.b.smithi181.stdout:Mar 30 14:00:17 smithi181 systemd[1]: ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4@node-exporter.b.service: Main process exited, code=exited, status=143/n/a 2024-03-30T14:00:18.249 INFO:journalctl@ceph.node-exporter.b.smithi181.stdout:Mar 30 14:00:18 smithi181 systemd[1]: ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4@node-exporter.b.service: Failed with result 'exit-code'. 2024-03-30T14:00:18.250 INFO:journalctl@ceph.node-exporter.b.smithi181.stdout:Mar 30 14:00:18 smithi181 systemd[1]: Stopped Ceph node-exporter.b for 98ebaeb8-ee99-11ee-b647-cb9ed24678a4. 2024-03-30T14:00:18.250 INFO:journalctl@ceph.node-exporter.b.smithi181.stdout:Mar 30 14:00:18 smithi181 systemd[1]: ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4@node-exporter.b.service: Consumed 1.710s CPU time. 2024-03-30T14:00:18.537 INFO:journalctl@ceph.node-exporter.b.smithi181.stdout:Mar 30 14:00:18 smithi181 systemd[1]: Starting Ceph node-exporter.b for 98ebaeb8-ee99-11ee-b647-cb9ed24678a4... 2024-03-30T14:00:18.834 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:18 smithi181 ceph-mon[25762]: pgmap v942: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-03-30T14:00:18.835 INFO:journalctl@ceph.node-exporter.b.smithi181.stdout:Mar 30 14:00:18 smithi181 podman[95256]: 2024-03-30 14:00:18.445553506 +0000 UTC m=+0.018004366 image pull 0da6a335fe1356545476b749c68f022c897de3a2139e8f0054f6937349ee2b83 quay.io/prometheus/node-exporter:v1.5.0 2024-03-30T14:00:18.835 INFO:journalctl@ceph.node-exporter.b.smithi181.stdout:Mar 30 14:00:18 smithi181 podman[95256]: 2024-03-30 14:00:18.545915987 +0000 UTC m=+0.118366827 container create acea317b5f5d87f24c33a73b4753355b7547428a29c5998b0cd57c93e6802e1f (image=quay.io/prometheus/node-exporter:v1.5.0, name=ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-node-exporter-b, maintainer=The Prometheus Authors ) 2024-03-30T14:00:18.835 INFO:journalctl@ceph.node-exporter.b.smithi181.stdout:Mar 30 14:00:18 smithi181 podman[95256]: 2024-03-30 14:00:18.748419329 +0000 UTC m=+0.320870180 container init acea317b5f5d87f24c33a73b4753355b7547428a29c5998b0cd57c93e6802e1f (image=quay.io/prometheus/node-exporter:v1.5.0, name=ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-node-exporter-b, maintainer=The Prometheus Authors ) 2024-03-30T14:00:18.835 INFO:journalctl@ceph.node-exporter.b.smithi181.stdout:Mar 30 14:00:18 smithi181 podman[95256]: 2024-03-30 14:00:18.751409035 +0000 UTC m=+0.323859885 container start acea317b5f5d87f24c33a73b4753355b7547428a29c5998b0cd57c93e6802e1f (image=quay.io/prometheus/node-exporter:v1.5.0, name=ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-node-exporter-b, maintainer=The Prometheus Authors ) 2024-03-30T14:00:18.835 INFO:journalctl@ceph.node-exporter.b.smithi181.stdout:Mar 30 14:00:18 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-node-exporter-b[95271]: ts=2024-03-30T14:00:18.755Z caller=node_exporter.go:180 level=info msg="Starting node_exporter" version="(version=1.5.0, branch=HEAD, revision=1b48970ffcf5630534fb00bb0687d73c66d1c959)" 2024-03-30T14:00:18.835 INFO:journalctl@ceph.node-exporter.b.smithi181.stdout:Mar 30 14:00:18 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-node-exporter-b[95271]: ts=2024-03-30T14:00:18.755Z caller=node_exporter.go:181 level=info msg="Build context" build_context="(go=go1.19.3, user=root@6e7732a7b81b, date=20221129-18:59:09)" 2024-03-30T14:00:18.835 INFO:journalctl@ceph.node-exporter.b.smithi181.stdout:Mar 30 14:00:18 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-node-exporter-b[95271]: ts=2024-03-30T14:00:18.755Z caller=diskstats_common.go:111 level=info collector=diskstats msg="Parsed flag --collector.diskstats.device-exclude" flag=^(ram|loop|fd|(h|s|v|xv)d[a-z]|nvme\d+n\d+p)\d+$ 2024-03-30T14:00:18.835 INFO:journalctl@ceph.node-exporter.b.smithi181.stdout:Mar 30 14:00:18 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-node-exporter-b[95271]: ts=2024-03-30T14:00:18.755Z caller=diskstats_linux.go:264 level=error collector=diskstats msg="Failed to open directory, disabling udev device properties" path=/run/udev/data 2024-03-30T14:00:18.836 INFO:journalctl@ceph.node-exporter.b.smithi181.stdout:Mar 30 14:00:18 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-node-exporter-b[95271]: ts=2024-03-30T14:00:18.756Z caller=filesystem_common.go:111 level=info collector=filesystem msg="Parsed flag --collector.filesystem.mount-points-exclude" flag=^/(dev|proc|run/credentials/.+|sys|var/lib/docker/.+|var/lib/containers/storage/.+)($|/) 2024-03-30T14:00:18.836 INFO:journalctl@ceph.node-exporter.b.smithi181.stdout:Mar 30 14:00:18 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-node-exporter-b[95271]: ts=2024-03-30T14:00:18.756Z caller=filesystem_common.go:113 level=info collector=filesystem msg="Parsed flag --collector.filesystem.fs-types-exclude" flag=^(autofs|binfmt_misc|bpf|cgroup2?|configfs|debugfs|devpts|devtmpfs|fusectl|hugetlbfs|iso9660|mqueue|nsfs|overlay|proc|procfs|pstore|rpc_pipefs|securityfs|selinuxfs|squashfs|sysfs|tracefs)$ 2024-03-30T14:00:18.836 INFO:journalctl@ceph.node-exporter.b.smithi181.stdout:Mar 30 14:00:18 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-node-exporter-b[95271]: ts=2024-03-30T14:00:18.756Z caller=node_exporter.go:110 level=info msg="Enabled collectors" 2024-03-30T14:00:18.836 INFO:journalctl@ceph.node-exporter.b.smithi181.stdout:Mar 30 14:00:18 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-node-exporter-b[95271]: ts=2024-03-30T14:00:18.756Z caller=node_exporter.go:117 level=info collector=arp 2024-03-30T14:00:18.836 INFO:journalctl@ceph.node-exporter.b.smithi181.stdout:Mar 30 14:00:18 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-node-exporter-b[95271]: ts=2024-03-30T14:00:18.756Z caller=node_exporter.go:117 level=info collector=bcache 2024-03-30T14:00:18.836 INFO:journalctl@ceph.node-exporter.b.smithi181.stdout:Mar 30 14:00:18 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-node-exporter-b[95271]: ts=2024-03-30T14:00:18.756Z caller=node_exporter.go:117 level=info collector=bonding 2024-03-30T14:00:18.836 INFO:journalctl@ceph.node-exporter.b.smithi181.stdout:Mar 30 14:00:18 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-node-exporter-b[95271]: ts=2024-03-30T14:00:18.756Z caller=node_exporter.go:117 level=info collector=btrfs 2024-03-30T14:00:18.836 INFO:journalctl@ceph.node-exporter.b.smithi181.stdout:Mar 30 14:00:18 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-node-exporter-b[95271]: ts=2024-03-30T14:00:18.756Z caller=node_exporter.go:117 level=info collector=conntrack 2024-03-30T14:00:18.836 INFO:journalctl@ceph.node-exporter.b.smithi181.stdout:Mar 30 14:00:18 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-node-exporter-b[95271]: ts=2024-03-30T14:00:18.756Z caller=node_exporter.go:117 level=info collector=cpu 2024-03-30T14:00:18.836 INFO:journalctl@ceph.node-exporter.b.smithi181.stdout:Mar 30 14:00:18 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-node-exporter-b[95271]: ts=2024-03-30T14:00:18.756Z caller=node_exporter.go:117 level=info collector=cpufreq 2024-03-30T14:00:18.836 INFO:journalctl@ceph.node-exporter.b.smithi181.stdout:Mar 30 14:00:18 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-node-exporter-b[95271]: ts=2024-03-30T14:00:18.756Z caller=node_exporter.go:117 level=info collector=diskstats 2024-03-30T14:00:18.836 INFO:journalctl@ceph.node-exporter.b.smithi181.stdout:Mar 30 14:00:18 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-node-exporter-b[95271]: ts=2024-03-30T14:00:18.756Z caller=node_exporter.go:117 level=info collector=dmi 2024-03-30T14:00:18.836 INFO:journalctl@ceph.node-exporter.b.smithi181.stdout:Mar 30 14:00:18 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-node-exporter-b[95271]: ts=2024-03-30T14:00:18.756Z caller=node_exporter.go:117 level=info collector=edac 2024-03-30T14:00:18.836 INFO:journalctl@ceph.node-exporter.b.smithi181.stdout:Mar 30 14:00:18 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-node-exporter-b[95271]: ts=2024-03-30T14:00:18.756Z caller=node_exporter.go:117 level=info collector=entropy 2024-03-30T14:00:18.836 INFO:journalctl@ceph.node-exporter.b.smithi181.stdout:Mar 30 14:00:18 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-node-exporter-b[95271]: ts=2024-03-30T14:00:18.756Z caller=node_exporter.go:117 level=info collector=fibrechannel 2024-03-30T14:00:18.837 INFO:journalctl@ceph.node-exporter.b.smithi181.stdout:Mar 30 14:00:18 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-node-exporter-b[95271]: ts=2024-03-30T14:00:18.756Z caller=node_exporter.go:117 level=info collector=filefd 2024-03-30T14:00:18.837 INFO:journalctl@ceph.node-exporter.b.smithi181.stdout:Mar 30 14:00:18 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-node-exporter-b[95271]: ts=2024-03-30T14:00:18.756Z caller=node_exporter.go:117 level=info collector=filesystem 2024-03-30T14:00:18.837 INFO:journalctl@ceph.node-exporter.b.smithi181.stdout:Mar 30 14:00:18 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-node-exporter-b[95271]: ts=2024-03-30T14:00:18.756Z caller=node_exporter.go:117 level=info collector=hwmon 2024-03-30T14:00:18.837 INFO:journalctl@ceph.node-exporter.b.smithi181.stdout:Mar 30 14:00:18 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-node-exporter-b[95271]: ts=2024-03-30T14:00:18.756Z caller=node_exporter.go:117 level=info collector=infiniband 2024-03-30T14:00:18.837 INFO:journalctl@ceph.node-exporter.b.smithi181.stdout:Mar 30 14:00:18 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-node-exporter-b[95271]: ts=2024-03-30T14:00:18.756Z caller=node_exporter.go:117 level=info collector=ipvs 2024-03-30T14:00:18.837 INFO:journalctl@ceph.node-exporter.b.smithi181.stdout:Mar 30 14:00:18 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-node-exporter-b[95271]: ts=2024-03-30T14:00:18.756Z caller=node_exporter.go:117 level=info collector=loadavg 2024-03-30T14:00:18.837 INFO:journalctl@ceph.node-exporter.b.smithi181.stdout:Mar 30 14:00:18 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-node-exporter-b[95271]: ts=2024-03-30T14:00:18.756Z caller=node_exporter.go:117 level=info collector=mdadm 2024-03-30T14:00:18.837 INFO:journalctl@ceph.node-exporter.b.smithi181.stdout:Mar 30 14:00:18 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-node-exporter-b[95271]: ts=2024-03-30T14:00:18.756Z caller=node_exporter.go:117 level=info collector=meminfo 2024-03-30T14:00:18.837 INFO:journalctl@ceph.node-exporter.b.smithi181.stdout:Mar 30 14:00:18 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-node-exporter-b[95271]: ts=2024-03-30T14:00:18.756Z caller=node_exporter.go:117 level=info collector=netclass 2024-03-30T14:00:18.837 INFO:journalctl@ceph.node-exporter.b.smithi181.stdout:Mar 30 14:00:18 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-node-exporter-b[95271]: ts=2024-03-30T14:00:18.756Z caller=node_exporter.go:117 level=info collector=netdev 2024-03-30T14:00:18.837 INFO:journalctl@ceph.node-exporter.b.smithi181.stdout:Mar 30 14:00:18 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-node-exporter-b[95271]: ts=2024-03-30T14:00:18.756Z caller=node_exporter.go:117 level=info collector=netstat 2024-03-30T14:00:18.837 INFO:journalctl@ceph.node-exporter.b.smithi181.stdout:Mar 30 14:00:18 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-node-exporter-b[95271]: ts=2024-03-30T14:00:18.756Z caller=node_exporter.go:117 level=info collector=nfs 2024-03-30T14:00:18.837 INFO:journalctl@ceph.node-exporter.b.smithi181.stdout:Mar 30 14:00:18 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-node-exporter-b[95271]: ts=2024-03-30T14:00:18.756Z caller=node_exporter.go:117 level=info collector=nfsd 2024-03-30T14:00:18.837 INFO:journalctl@ceph.node-exporter.b.smithi181.stdout:Mar 30 14:00:18 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-node-exporter-b[95271]: ts=2024-03-30T14:00:18.756Z caller=node_exporter.go:117 level=info collector=nvme 2024-03-30T14:00:18.837 INFO:journalctl@ceph.node-exporter.b.smithi181.stdout:Mar 30 14:00:18 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-node-exporter-b[95271]: ts=2024-03-30T14:00:18.756Z caller=node_exporter.go:117 level=info collector=os 2024-03-30T14:00:18.838 INFO:journalctl@ceph.node-exporter.b.smithi181.stdout:Mar 30 14:00:18 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-node-exporter-b[95271]: ts=2024-03-30T14:00:18.756Z caller=node_exporter.go:117 level=info collector=powersupplyclass 2024-03-30T14:00:18.838 INFO:journalctl@ceph.node-exporter.b.smithi181.stdout:Mar 30 14:00:18 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-node-exporter-b[95271]: ts=2024-03-30T14:00:18.756Z caller=node_exporter.go:117 level=info collector=pressure 2024-03-30T14:00:18.838 INFO:journalctl@ceph.node-exporter.b.smithi181.stdout:Mar 30 14:00:18 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-node-exporter-b[95271]: ts=2024-03-30T14:00:18.756Z caller=node_exporter.go:117 level=info collector=rapl 2024-03-30T14:00:18.838 INFO:journalctl@ceph.node-exporter.b.smithi181.stdout:Mar 30 14:00:18 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-node-exporter-b[95271]: ts=2024-03-30T14:00:18.756Z caller=node_exporter.go:117 level=info collector=schedstat 2024-03-30T14:00:18.838 INFO:journalctl@ceph.node-exporter.b.smithi181.stdout:Mar 30 14:00:18 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-node-exporter-b[95271]: ts=2024-03-30T14:00:18.756Z caller=node_exporter.go:117 level=info collector=selinux 2024-03-30T14:00:18.838 INFO:journalctl@ceph.node-exporter.b.smithi181.stdout:Mar 30 14:00:18 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-node-exporter-b[95271]: ts=2024-03-30T14:00:18.756Z caller=node_exporter.go:117 level=info collector=sockstat 2024-03-30T14:00:18.838 INFO:journalctl@ceph.node-exporter.b.smithi181.stdout:Mar 30 14:00:18 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-node-exporter-b[95271]: ts=2024-03-30T14:00:18.756Z caller=node_exporter.go:117 level=info collector=softnet 2024-03-30T14:00:18.838 INFO:journalctl@ceph.node-exporter.b.smithi181.stdout:Mar 30 14:00:18 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-node-exporter-b[95271]: ts=2024-03-30T14:00:18.756Z caller=node_exporter.go:117 level=info collector=stat 2024-03-30T14:00:18.838 INFO:journalctl@ceph.node-exporter.b.smithi181.stdout:Mar 30 14:00:18 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-node-exporter-b[95271]: ts=2024-03-30T14:00:18.756Z caller=node_exporter.go:117 level=info collector=tapestats 2024-03-30T14:00:18.839 INFO:journalctl@ceph.node-exporter.b.smithi181.stdout:Mar 30 14:00:18 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-node-exporter-b[95271]: ts=2024-03-30T14:00:18.756Z caller=node_exporter.go:117 level=info collector=textfile 2024-03-30T14:00:18.839 INFO:journalctl@ceph.node-exporter.b.smithi181.stdout:Mar 30 14:00:18 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-node-exporter-b[95271]: ts=2024-03-30T14:00:18.756Z caller=node_exporter.go:117 level=info collector=thermal_zone 2024-03-30T14:00:18.839 INFO:journalctl@ceph.node-exporter.b.smithi181.stdout:Mar 30 14:00:18 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-node-exporter-b[95271]: ts=2024-03-30T14:00:18.756Z caller=node_exporter.go:117 level=info collector=time 2024-03-30T14:00:18.839 INFO:journalctl@ceph.node-exporter.b.smithi181.stdout:Mar 30 14:00:18 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-node-exporter-b[95271]: ts=2024-03-30T14:00:18.756Z caller=node_exporter.go:117 level=info collector=udp_queues 2024-03-30T14:00:18.839 INFO:journalctl@ceph.node-exporter.b.smithi181.stdout:Mar 30 14:00:18 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-node-exporter-b[95271]: ts=2024-03-30T14:00:18.756Z caller=node_exporter.go:117 level=info collector=uname 2024-03-30T14:00:18.839 INFO:journalctl@ceph.node-exporter.b.smithi181.stdout:Mar 30 14:00:18 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-node-exporter-b[95271]: ts=2024-03-30T14:00:18.756Z caller=node_exporter.go:117 level=info collector=vmstat 2024-03-30T14:00:18.839 INFO:journalctl@ceph.node-exporter.b.smithi181.stdout:Mar 30 14:00:18 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-node-exporter-b[95271]: ts=2024-03-30T14:00:18.756Z caller=node_exporter.go:117 level=info collector=xfs 2024-03-30T14:00:18.839 INFO:journalctl@ceph.node-exporter.b.smithi181.stdout:Mar 30 14:00:18 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-node-exporter-b[95271]: ts=2024-03-30T14:00:18.756Z caller=node_exporter.go:117 level=info collector=zfs 2024-03-30T14:00:18.839 INFO:journalctl@ceph.node-exporter.b.smithi181.stdout:Mar 30 14:00:18 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-node-exporter-b[95271]: ts=2024-03-30T14:00:18.756Z caller=tls_config.go:232 level=info msg="Listening on" address=[::]:9100 2024-03-30T14:00:18.839 INFO:journalctl@ceph.node-exporter.b.smithi181.stdout:Mar 30 14:00:18 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-node-exporter-b[95271]: ts=2024-03-30T14:00:18.756Z caller=tls_config.go:235 level=info msg="TLS is disabled." http2=false address=[::]:9100 2024-03-30T14:00:18.839 INFO:journalctl@ceph.node-exporter.b.smithi181.stdout:Mar 30 14:00:18 smithi181 bash[95256]: acea317b5f5d87f24c33a73b4753355b7547428a29c5998b0cd57c93e6802e1f 2024-03-30T14:00:19.069 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:18 smithi099 ceph-mon[24912]: pgmap v942: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-03-30T14:00:19.069 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:18 smithi099 ceph-mon[29691]: pgmap v942: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-03-30T14:00:19.237 INFO:journalctl@ceph.node-exporter.b.smithi181.stdout:Mar 30 14:00:18 smithi181 systemd[1]: Started Ceph node-exporter.b for 98ebaeb8-ee99-11ee-b647-cb9ed24678a4. 2024-03-30T14:00:20.010 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:19 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:20.011 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:19 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:20.011 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:19 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:20.011 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:19 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:20.011 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:19 smithi099 ceph-mon[24912]: pgmap v943: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-03-30T14:00:20.011 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:19 smithi099 ceph-mon[24912]: pgmap v944: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 739 B/s rd, 0 op/s 2024-03-30T14:00:20.011 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:19 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:20.011 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:19 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:20.011 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:19 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:20.011 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:19 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:20.011 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:19 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:20.011 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:19 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:20.011 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:19 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:20.011 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:19 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:20.012 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:19 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:20.012 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:19 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:20.012 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:19 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:20.012 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:19 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:20.012 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:19 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:20.012 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:19 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:20.012 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:19 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:20.012 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:19 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:20.012 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:19 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:20.012 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:19 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:20.012 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:19 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:20.012 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:19 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:20.012 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:19 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:20.012 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:19 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:20.012 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:19 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:20.013 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:19 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:20.013 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:19 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:20.013 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:19 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:20.013 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:19 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:20.013 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:19 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:20.013 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:19 smithi099 ceph-mon[29691]: pgmap v943: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-03-30T14:00:20.013 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:19 smithi099 ceph-mon[29691]: pgmap v944: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 739 B/s rd, 0 op/s 2024-03-30T14:00:20.013 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:19 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:20.013 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:19 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:20.013 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:19 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:20.013 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:19 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:20.014 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:19 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:20.014 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:19 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:20.014 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:19 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:20.014 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:19 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:20.014 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:19 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:20.014 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:19 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:20.014 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:19 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:20.014 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:19 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:20.014 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:19 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:20.014 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:19 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:20.014 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:19 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:20.014 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:19 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:20.014 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:19 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:20.014 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:19 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:20.015 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:19 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:20.015 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:19 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:20.015 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:19 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:20.015 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:19 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:20.015 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:19 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:20.015 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:19 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:20.015 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:19 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:20.015 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:19 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:20.015 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:19 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:20.015 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:19 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:20.016 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:19 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:20.016 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:19 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:20.016 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:19 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:20.016 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:19 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:20.016 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:19 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:20.016 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:19 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:20.016 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:19 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:20.016 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:19 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:20.016 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:19 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:20.016 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:19 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:20.016 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:19 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:20.016 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:19 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:20.016 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:19 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:20.017 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:19 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:20.017 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:19 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:20.017 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:19 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:20.017 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:19 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:20.017 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:19 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:20.017 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:19 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:20.017 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:19 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:20.017 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:19 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:20.017 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:19 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:20.017 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:19 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:20.017 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:19 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:20.017 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:19 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:20.017 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:19 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:20.017 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:19 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:20.018 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:19 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:20.182 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:19 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:20.182 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:19 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:20.182 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:19 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:20.182 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:19 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:20.182 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:19 smithi181 ceph-mon[25762]: pgmap v943: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-03-30T14:00:20.182 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:19 smithi181 ceph-mon[25762]: pgmap v944: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 739 B/s rd, 0 op/s 2024-03-30T14:00:20.182 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:19 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:20.183 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:19 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:20.183 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:19 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:20.183 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:19 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:20.183 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:19 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:20.183 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:19 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:20.183 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:19 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:20.183 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:19 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:20.183 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:19 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:20.183 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:19 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:20.183 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:19 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:20.183 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:19 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:20.183 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:19 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:20.183 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:19 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:20.183 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:19 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:20.184 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:19 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:20.184 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:19 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:20.184 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:19 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:20.184 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:19 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:20.184 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:19 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:20.184 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:19 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:20.184 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:19 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:20.184 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:19 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:20.184 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:19 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:20.184 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:19 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:20.184 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:19 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:20.184 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:19 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:20.184 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:19 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:20.184 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:19 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:20.184 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:19 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:20.185 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:19 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:20.185 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:19 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:20.185 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:19 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:20.185 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:19 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:20.185 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:19 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:20.185 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:19 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:20.185 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:19 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:20.185 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:19 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:20.185 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:19 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:20.185 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:19 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:20.910 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:20 smithi099 ceph-mon[24912]: pgmap v945: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 942 B/s rd, 0 op/s 2024-03-30T14:00:20.911 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:20 smithi099 ceph-mon[24912]: pgmap v946: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 942 B/s rd, 0 op/s 2024-03-30T14:00:20.911 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:20 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:20.911 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:20 smithi099 ceph-mon[24912]: pgmap v947: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-03-30T14:00:20.911 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:20 smithi099 ceph-mon[24912]: pgmap v948: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:20.911 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:20 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:20.911 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:20 smithi099 ceph-mon[24912]: pgmap v949: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:20.911 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:20 smithi099 ceph-mon[24912]: pgmap v950: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:20.911 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:20 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:20.911 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:20 smithi099 ceph-mon[24912]: pgmap v951: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:20.911 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:20 smithi099 ceph-mon[24912]: pgmap v952: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:20.911 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:20 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:20.911 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:20 smithi099 ceph-mon[24912]: pgmap v953: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:20.912 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:20 smithi099 ceph-mon[24912]: pgmap v954: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:20.912 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:20 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:20.912 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:20 smithi099 ceph-mon[24912]: pgmap v955: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:20.912 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:20 smithi099 ceph-mon[24912]: pgmap v956: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:20.912 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:20 smithi099 ceph-mon[24912]: pgmap v957: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:20.912 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:20 smithi099 ceph-mon[24912]: pgmap v958: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:20.912 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:20 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:20.912 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:20 smithi099 ceph-mon[24912]: pgmap v959: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:20.912 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:20 smithi099 ceph-mon[24912]: pgmap v960: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:20.912 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:20 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:20.912 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:20 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:20.912 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:20 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:20.912 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:20 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:20.912 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:20 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:20.912 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:20 smithi099 ceph-mon[24912]: pgmap v961: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:20.913 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:20 smithi099 ceph-mon[24912]: pgmap v962: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:20.913 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:20 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:20.913 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:20 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:20.913 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:20 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:20.913 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:20 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:20.913 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:20 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:20.913 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:20 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:20.913 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:20 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:20.913 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:20 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:20.913 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:20 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:20.913 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:20 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:20.913 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:20 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:20.913 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:20 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:20.913 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:20 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:20.913 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:20 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:20.914 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:20 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:20.914 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:20 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:20.914 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:20 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:20.914 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:20 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:20.914 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:20 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:20.914 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:20 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:20.914 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:20 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:20.914 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:20 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:20.914 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:20 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:20.914 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:20 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:20.914 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:20 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:20.914 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:20 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:20.914 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:20 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:20.915 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:20 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:20.915 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:20 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:20.915 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:20 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:20.915 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:20 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:20.915 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:20 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:20.915 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:20 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:20.915 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:20 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:20.915 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:20 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:20.915 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:20 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:20.915 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:20 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:20.915 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:20 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:20.915 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:20 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:20.915 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:20 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:20.915 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:20 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:20.915 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:20 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:20.916 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:20 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:20.916 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:20 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:20.916 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:20 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:20.916 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:20 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:20.916 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:20 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:20.916 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:20 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:20.916 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:20 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:20.916 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:20 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:21.164 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:20 smithi181 ceph-mon[25762]: pgmap v945: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 942 B/s rd, 0 op/s 2024-03-30T14:00:21.164 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:20 smithi181 ceph-mon[25762]: pgmap v946: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 942 B/s rd, 0 op/s 2024-03-30T14:00:21.164 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:20 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:21.164 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:20 smithi181 ceph-mon[25762]: pgmap v947: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-03-30T14:00:21.164 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:20 smithi181 ceph-mon[25762]: pgmap v948: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:21.164 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:20 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:21.164 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:20 smithi181 ceph-mon[25762]: pgmap v949: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:21.165 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:20 smithi181 ceph-mon[25762]: pgmap v950: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:21.165 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:20 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:21.165 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:20 smithi181 ceph-mon[25762]: pgmap v951: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:21.165 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:20 smithi181 ceph-mon[25762]: pgmap v952: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:21.165 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:20 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:21.165 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:20 smithi181 ceph-mon[25762]: pgmap v953: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:21.165 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:20 smithi181 ceph-mon[25762]: pgmap v954: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:21.165 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:20 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:21.165 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:20 smithi181 ceph-mon[25762]: pgmap v955: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:21.165 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:20 smithi181 ceph-mon[25762]: pgmap v956: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:21.165 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:20 smithi181 ceph-mon[25762]: pgmap v957: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:21.165 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:20 smithi181 ceph-mon[25762]: pgmap v958: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:21.165 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:20 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:21.165 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:20 smithi181 ceph-mon[25762]: pgmap v959: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:21.165 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:20 smithi181 ceph-mon[25762]: pgmap v960: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:21.166 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:20 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:21.166 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:20 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:21.166 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:20 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:21.166 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:20 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:21.166 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:20 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:21.166 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:20 smithi181 ceph-mon[25762]: pgmap v961: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:21.166 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:20 smithi181 ceph-mon[25762]: pgmap v962: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:21.166 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:20 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:21.166 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:20 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:21.167 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:20 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:21.167 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:20 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:21.167 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:20 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:21.167 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:20 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:21.167 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:20 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:21.167 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:20 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:21.167 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:20 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:21.167 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:20 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:21.167 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:20 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:21.167 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:20 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:21.167 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:20 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:21.167 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:20 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:21.167 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:20 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:21.168 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:20 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:21.168 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:20 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:21.168 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:20 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:21.168 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:20 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:21.168 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:20 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:21.168 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:20 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:21.168 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:20 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:21.168 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:20 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:21.168 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:20 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:21.168 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:20 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:21.168 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:20 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:21.168 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:20 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:21.168 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:20 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:21.168 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:20 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:21.169 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:20 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:21.169 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:20 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:21.169 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:20 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:21.169 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:20 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:21.169 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:20 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:21.169 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:20 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:21.169 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:20 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:21.169 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:20 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:21.169 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:20 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:21.169 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:20 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:21.169 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:20 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:21.169 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:20 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:21.169 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:20 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:21.169 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:20 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:21.169 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:20 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:21.170 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:20 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:21.170 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:20 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:21.170 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:20 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:21.170 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:20 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:21.170 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:20 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:21.170 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:20 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:21.204 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:20 smithi099 ceph-mon[29691]: pgmap v945: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 942 B/s rd, 0 op/s 2024-03-30T14:00:21.204 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:20 smithi099 ceph-mon[29691]: pgmap v946: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 942 B/s rd, 0 op/s 2024-03-30T14:00:21.204 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:20 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:21.204 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:20 smithi099 ceph-mon[29691]: pgmap v947: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-03-30T14:00:21.204 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:20 smithi099 ceph-mon[29691]: pgmap v948: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:21.204 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:20 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:21.204 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:20 smithi099 ceph-mon[29691]: pgmap v949: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:21.204 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:20 smithi099 ceph-mon[29691]: pgmap v950: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:21.205 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:20 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:21.205 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:20 smithi099 ceph-mon[29691]: pgmap v951: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:21.205 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:20 smithi099 ceph-mon[29691]: pgmap v952: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:21.205 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:20 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:21.205 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:20 smithi099 ceph-mon[29691]: pgmap v953: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:21.205 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:20 smithi099 ceph-mon[29691]: pgmap v954: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:21.205 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:20 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:21.205 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:20 smithi099 ceph-mon[29691]: pgmap v955: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:21.205 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:20 smithi099 ceph-mon[29691]: pgmap v956: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:21.205 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:20 smithi099 ceph-mon[29691]: pgmap v957: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:21.205 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:20 smithi099 ceph-mon[29691]: pgmap v958: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:21.205 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:20 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:21.205 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:20 smithi099 ceph-mon[29691]: pgmap v959: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:21.205 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:20 smithi099 ceph-mon[29691]: pgmap v960: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:21.206 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:20 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:21.206 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:20 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:21.206 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:20 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:21.206 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:20 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:21.206 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:20 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:21.206 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:20 smithi099 ceph-mon[29691]: pgmap v961: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:21.206 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:20 smithi099 ceph-mon[29691]: pgmap v962: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:21.206 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:20 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:21.206 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:20 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:21.206 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:20 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:21.206 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:20 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:21.206 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:20 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:21.206 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:20 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:21.206 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:20 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:21.207 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:20 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:21.207 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:20 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:21.207 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:20 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:21.207 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:20 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:21.207 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:20 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:21.207 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:20 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:21.207 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:20 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:21.207 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:20 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:21.207 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:20 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:21.208 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:20 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:21.208 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:20 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:21.208 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:20 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:21.208 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:20 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:21.208 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:20 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:21.208 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:20 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:21.208 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:20 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:21.208 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:20 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:21.209 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:20 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:21.209 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:20 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:21.209 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:20 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:21.209 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:20 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:21.209 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:20 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:21.209 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:20 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:21.209 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:20 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:21.209 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:20 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:21.209 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:20 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:21.209 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:20 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:21.209 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:20 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:21.209 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:20 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:21.209 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:20 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:21.209 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:20 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:21.209 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:20 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:21.210 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:20 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:21.210 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:20 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:21.210 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:20 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:21.210 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:20 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:21.210 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:20 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:21.210 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:20 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:21.210 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:20 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:21.210 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:20 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:21.210 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:20 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:21.210 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:20 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:21.210 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:20 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:22.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:21 smithi181 ceph-mon[25762]: pgmap v963: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:22.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:21 smithi181 ceph-mon[25762]: pgmap v964: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:22.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:21 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:22.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:21 smithi181 ceph-mon[25762]: pgmap v965: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:22.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:21 smithi181 ceph-mon[25762]: pgmap v966: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:22.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:21 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:22.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:21 smithi181 ceph-mon[25762]: pgmap v967: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:22.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:21 smithi181 ceph-mon[25762]: pgmap v968: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:22.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:21 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:22.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:21 smithi181 ceph-mon[25762]: pgmap v969: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:22.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:21 smithi181 ceph-mon[25762]: pgmap v970: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:22.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:21 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:22.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:21 smithi181 ceph-mon[25762]: pgmap v971: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:22.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:21 smithi181 ceph-mon[25762]: pgmap v972: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:22.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:21 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:22.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:21 smithi181 ceph-mon[25762]: pgmap v973: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:22.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:21 smithi181 ceph-mon[25762]: pgmap v974: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:22.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:21 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:22.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:21 smithi181 ceph-mon[25762]: pgmap v975: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:22.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:21 smithi181 ceph-mon[25762]: pgmap v976: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:22.002 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:21 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:22.002 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:21 smithi181 ceph-mon[25762]: pgmap v977: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:22.002 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:21 smithi181 ceph-mon[25762]: pgmap v978: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:22.002 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:21 smithi181 ceph-mon[25762]: pgmap v979: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:22.002 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:21 smithi181 ceph-mon[25762]: pgmap v980: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:22.002 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:21 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:22.002 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:21 smithi181 ceph-mon[25762]: pgmap v981: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:22.002 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:21 smithi181 ceph-mon[25762]: pgmap v982: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:22.002 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:21 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:22.002 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:21 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:22.002 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:21 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:22.002 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:21 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:22.002 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:21 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:22.003 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:21 smithi181 ceph-mon[25762]: pgmap v983: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:22.003 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:21 smithi181 ceph-mon[25762]: pgmap v984: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:22.003 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:21 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:22.003 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:21 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:22.003 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:21 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:22.003 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:21 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:22.003 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:21 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:22.003 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:21 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:22.003 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:21 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:22.003 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:21 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:22.003 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:21 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:22.003 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:21 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:22.003 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:21 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:22.003 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:21 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:22.003 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:21 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:22.003 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:21 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:22.004 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:21 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:22.004 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:21 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:22.004 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:21 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:22.004 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:21 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:22.004 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:21 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:22.004 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:21 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:22.004 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:21 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:22.004 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:21 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:22.004 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:21 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:22.004 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:21 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:22.004 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:21 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:22.004 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:21 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:22.004 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:21 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:22.005 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:21 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:22.005 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:21 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:22.005 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:21 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:22.005 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:21 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:22.005 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:21 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:22.005 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:21 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:22.005 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:21 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:22.005 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:21 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:22.005 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:21 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:22.005 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:21 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:22.005 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:21 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:22.005 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:21 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:22.005 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:21 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:22.005 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:21 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:22.303 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:21 smithi099 ceph-mon[29691]: pgmap v963: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:22.304 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:21 smithi099 ceph-mon[29691]: pgmap v964: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:22.304 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:21 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:22.304 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:21 smithi099 ceph-mon[29691]: pgmap v965: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:22.304 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:21 smithi099 ceph-mon[29691]: pgmap v966: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:22.304 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:21 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:22.304 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:21 smithi099 ceph-mon[29691]: pgmap v967: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:22.304 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:21 smithi099 ceph-mon[29691]: pgmap v968: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:22.304 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:21 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:22.304 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:21 smithi099 ceph-mon[29691]: pgmap v969: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:22.304 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:21 smithi099 ceph-mon[29691]: pgmap v970: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:22.304 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:21 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:22.304 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:21 smithi099 ceph-mon[29691]: pgmap v971: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:22.305 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:21 smithi099 ceph-mon[29691]: pgmap v972: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:22.305 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:21 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:22.305 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:21 smithi099 ceph-mon[29691]: pgmap v973: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:22.305 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:21 smithi099 ceph-mon[29691]: pgmap v974: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:22.305 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:21 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:22.305 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:21 smithi099 ceph-mon[29691]: pgmap v975: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:22.305 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:21 smithi099 ceph-mon[29691]: pgmap v976: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:22.305 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:21 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:22.305 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:21 smithi099 ceph-mon[29691]: pgmap v977: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:22.305 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:21 smithi099 ceph-mon[29691]: pgmap v978: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:22.305 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:21 smithi099 ceph-mon[29691]: pgmap v979: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:22.305 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:21 smithi099 ceph-mon[29691]: pgmap v980: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:22.305 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:21 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:22.305 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:21 smithi099 ceph-mon[29691]: pgmap v981: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:22.305 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:21 smithi099 ceph-mon[29691]: pgmap v982: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:22.306 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:21 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:22.306 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:21 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:22.306 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:21 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:22.306 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:21 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:22.306 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:21 smithi099 ceph-mon[24912]: pgmap v963: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:22.306 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:21 smithi099 ceph-mon[24912]: pgmap v964: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:22.306 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:21 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:22.306 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:21 smithi099 ceph-mon[24912]: pgmap v965: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:22.306 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:21 smithi099 ceph-mon[24912]: pgmap v966: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:22.306 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:21 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:22.307 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:21 smithi099 ceph-mon[24912]: pgmap v967: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:22.307 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:21 smithi099 ceph-mon[24912]: pgmap v968: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:22.307 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:21 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:22.307 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:21 smithi099 ceph-mon[24912]: pgmap v969: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:22.307 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:21 smithi099 ceph-mon[24912]: pgmap v970: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:22.307 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:21 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:22.307 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:21 smithi099 ceph-mon[24912]: pgmap v971: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:22.307 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:21 smithi099 ceph-mon[24912]: pgmap v972: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:22.307 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:21 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:22.307 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:21 smithi099 ceph-mon[24912]: pgmap v973: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:22.307 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:21 smithi099 ceph-mon[24912]: pgmap v974: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:22.307 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:21 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:22.307 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:21 smithi099 ceph-mon[24912]: pgmap v975: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:22.307 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:21 smithi099 ceph-mon[24912]: pgmap v976: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:22.307 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:21 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:22.307 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:21 smithi099 ceph-mon[24912]: pgmap v977: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:22.308 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:21 smithi099 ceph-mon[24912]: pgmap v978: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:22.308 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:21 smithi099 ceph-mon[24912]: pgmap v979: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:22.308 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:21 smithi099 ceph-mon[24912]: pgmap v980: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:22.308 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:21 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:22.308 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:21 smithi099 ceph-mon[24912]: pgmap v981: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:22.308 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:21 smithi099 ceph-mon[24912]: pgmap v982: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:22.308 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:21 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:22.308 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:21 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:22.308 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:21 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:22.308 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:21 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:22.309 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:21 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:22.309 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:21 smithi099 ceph-mon[29691]: pgmap v983: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:22.309 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:21 smithi099 ceph-mon[29691]: pgmap v984: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:22.309 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:21 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:22.309 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:21 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:22.309 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:21 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:22.309 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:21 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:22.309 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:21 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:22.309 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:21 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:22.309 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:21 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:22.309 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:21 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:22.309 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:21 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:22.310 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:21 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:22.310 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:21 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:22.310 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:21 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:22.310 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:21 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:22.310 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:21 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:22.310 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:21 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:22.310 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:21 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:22.310 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:21 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:22.310 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:21 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:22.310 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:21 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:22.310 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:21 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:22.310 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:21 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:22.310 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:21 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:22.310 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:21 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:22.310 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:21 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:22.311 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:21 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:22.311 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:21 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:22.311 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:21 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:22.311 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:21 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:22.311 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:21 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:22.311 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:21 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:22.311 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:21 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:22.311 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:21 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:22.311 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:21 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:22.311 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:21 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:22.311 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:21 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:22.311 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:21 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:22.311 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:21 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:22.311 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:21 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:22.311 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:21 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:22.312 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:21 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:22.312 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:21 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:22.312 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:21 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:22.312 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:21 smithi099 ceph-mon[24912]: pgmap v983: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:22.312 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:21 smithi099 ceph-mon[24912]: pgmap v984: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:22.312 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:21 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:22.312 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:21 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:22.312 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:21 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:22.312 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:21 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:22.312 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:21 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:22.313 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:21 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:22.313 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:21 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:22.313 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:21 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:22.313 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:21 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:22.313 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:21 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:22.313 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:21 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:22.313 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:21 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:22.313 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:21 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:22.313 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:21 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:22.313 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:21 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:22.313 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:21 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:22.313 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:21 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:22.313 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:21 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:22.314 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:21 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:22.314 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:21 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:22.314 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:21 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:22.314 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:21 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:22.314 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:21 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:22.314 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:21 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:22.314 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:21 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:22.314 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:21 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:22.314 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:21 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:22.314 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:21 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:22.314 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:21 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:22.314 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:21 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:22.314 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:21 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:22.314 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:21 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:22.314 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:21 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:22.315 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:21 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:22.315 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:21 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:22.315 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:21 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:22.315 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:21 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:22.315 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:21 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:22.315 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:21 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:22.315 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:21 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:22.315 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:21 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:22.921 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:22 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:22.921 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:22 smithi099 ceph-mon[29691]: pgmap v985: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:22.921 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:22 smithi099 ceph-mon[29691]: pgmap v986: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:22.921 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:22 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:22.921 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:22 smithi099 ceph-mon[29691]: pgmap v987: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:22.921 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:22 smithi099 ceph-mon[29691]: pgmap v988: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:22.921 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:22 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:22.921 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:22 smithi099 ceph-mon[29691]: pgmap v989: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:22.921 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:22 smithi099 ceph-mon[29691]: pgmap v990: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:22.921 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:22 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:22.921 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:22 smithi099 ceph-mon[29691]: pgmap v991: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:22.921 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:22 smithi099 ceph-mon[29691]: pgmap v992: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:22.921 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:22 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:22.922 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:22 smithi099 ceph-mon[29691]: pgmap v993: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:22.922 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:22 smithi099 ceph-mon[29691]: pgmap v994: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:22.922 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:22 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:22.922 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:22 smithi099 ceph-mon[29691]: pgmap v995: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 13 KiB/s rd, 12 op/s 2024-03-30T14:00:22.922 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:22 smithi099 ceph-mon[29691]: pgmap v996: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 13 KiB/s rd, 12 op/s 2024-03-30T14:00:22.922 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:22 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:22.922 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:22 smithi099 ceph-mon[29691]: pgmap v997: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 15 KiB/s rd, 15 op/s 2024-03-30T14:00:22.922 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:22 smithi099 ceph-mon[29691]: pgmap v998: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 15 KiB/s rd, 15 op/s 2024-03-30T14:00:22.922 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:22 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:22.922 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:22 smithi099 ceph-mon[29691]: pgmap v999: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 15 KiB/s rd, 15 op/s 2024-03-30T14:00:22.922 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:22 smithi099 ceph-mon[29691]: pgmap v1000: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 15 KiB/s rd, 15 op/s 2024-03-30T14:00:22.922 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:22 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:22.922 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:22 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:22.922 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:22 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:22.923 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:22 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:22.923 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:22 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:22.923 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:22 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:22.923 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:22 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:22.923 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:22 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:22.923 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:22 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:22.923 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:22 smithi099 ceph-mon[24912]: pgmap v985: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:22.923 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:22 smithi099 ceph-mon[24912]: pgmap v986: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:22.923 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:22 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:22.924 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:22 smithi099 ceph-mon[24912]: pgmap v987: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:22.924 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:22 smithi099 ceph-mon[24912]: pgmap v988: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:22.924 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:22 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:22.924 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:22 smithi099 ceph-mon[24912]: pgmap v989: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:22.924 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:22 smithi099 ceph-mon[24912]: pgmap v990: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:22.924 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:22 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:22.924 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:22 smithi099 ceph-mon[24912]: pgmap v991: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:22.924 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:22 smithi099 ceph-mon[24912]: pgmap v992: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:22.924 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:22 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:22.924 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:22 smithi099 ceph-mon[24912]: pgmap v993: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:22.924 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:22 smithi099 ceph-mon[24912]: pgmap v994: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:22.924 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:22 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:22.924 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:22 smithi099 ceph-mon[24912]: pgmap v995: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 13 KiB/s rd, 12 op/s 2024-03-30T14:00:22.924 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:22 smithi099 ceph-mon[24912]: pgmap v996: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 13 KiB/s rd, 12 op/s 2024-03-30T14:00:22.924 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:22 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:22.925 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:22 smithi099 ceph-mon[24912]: pgmap v997: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 15 KiB/s rd, 15 op/s 2024-03-30T14:00:22.925 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:22 smithi099 ceph-mon[24912]: pgmap v998: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 15 KiB/s rd, 15 op/s 2024-03-30T14:00:22.925 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:22 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:22.925 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:22 smithi099 ceph-mon[24912]: pgmap v999: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 15 KiB/s rd, 15 op/s 2024-03-30T14:00:22.925 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:22 smithi099 ceph-mon[24912]: pgmap v1000: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 15 KiB/s rd, 15 op/s 2024-03-30T14:00:22.925 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:22 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:22.925 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:22 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:22.925 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:22 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:22.925 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:22 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:22.925 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:22 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:22.925 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:22 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:22.925 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:22 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:22.925 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:22 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:22.925 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:22 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:22.925 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:22 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:22.926 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:22 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:22.926 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:22 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:22.926 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:22 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:22.926 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:22 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:22.926 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:22 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:22.926 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:22 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:22.926 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:22 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:22.926 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:22 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:22.926 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:22 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:22.926 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:22 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:22.926 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:22 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:22.926 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:22 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:22.926 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:22 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:22.926 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:22 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:22.927 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:22 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:22.927 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:22 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:22.927 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:22 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:22.927 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:22 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:22.927 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:22 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:22.927 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:22 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:22.927 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:22 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:22.927 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:22 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:22.927 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:22 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:22.927 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:22 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:22.927 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:22 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:22.927 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:22 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:22.927 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:22 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:22.927 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:22 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:22.927 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:22 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:22.928 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:22 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:23.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:22 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:23.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:22 smithi181 ceph-mon[25762]: pgmap v985: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:23.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:22 smithi181 ceph-mon[25762]: pgmap v986: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:23.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:22 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:23.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:22 smithi181 ceph-mon[25762]: pgmap v987: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:23.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:22 smithi181 ceph-mon[25762]: pgmap v988: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:23.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:22 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:23.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:22 smithi181 ceph-mon[25762]: pgmap v989: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:23.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:22 smithi181 ceph-mon[25762]: pgmap v990: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:23.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:22 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:23.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:22 smithi181 ceph-mon[25762]: pgmap v991: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:23.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:22 smithi181 ceph-mon[25762]: pgmap v992: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:23.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:22 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:23.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:22 smithi181 ceph-mon[25762]: pgmap v993: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:23.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:22 smithi181 ceph-mon[25762]: pgmap v994: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:23.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:22 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:23.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:22 smithi181 ceph-mon[25762]: pgmap v995: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 13 KiB/s rd, 12 op/s 2024-03-30T14:00:23.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:22 smithi181 ceph-mon[25762]: pgmap v996: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 13 KiB/s rd, 12 op/s 2024-03-30T14:00:23.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:22 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:23.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:22 smithi181 ceph-mon[25762]: pgmap v997: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 15 KiB/s rd, 15 op/s 2024-03-30T14:00:23.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:22 smithi181 ceph-mon[25762]: pgmap v998: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 15 KiB/s rd, 15 op/s 2024-03-30T14:00:23.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:22 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:23.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:22 smithi181 ceph-mon[25762]: pgmap v999: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 15 KiB/s rd, 15 op/s 2024-03-30T14:00:23.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:22 smithi181 ceph-mon[25762]: pgmap v1000: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 15 KiB/s rd, 15 op/s 2024-03-30T14:00:23.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:22 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:23.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:22 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:23.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:22 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:23.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:22 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:23.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:22 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:23.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:22 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:23.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:22 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:23.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:22 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:23.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:22 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:23.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:22 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:23.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:22 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:23.253 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:22 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:23.253 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:22 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:23.253 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:22 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:23.253 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:22 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:23.253 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:22 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:23.253 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:22 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:23.253 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:22 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:23.253 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:22 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:23.253 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:22 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:23.253 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:22 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:23.253 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:22 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:23.253 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:22 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:23.253 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:22 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:23.253 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:22 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:23.253 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:22 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:23.254 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:22 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:23.254 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:22 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:23.254 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:22 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:23.254 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:22 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:23.254 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:22 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:23.254 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:22 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:23.254 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:22 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:23.254 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:22 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:23.254 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:22 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:23.254 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:22 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:23.254 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:22 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:23.255 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:22 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:23.255 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:22 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:23.255 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:22 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:23.255 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:22 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:23.255 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:22 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:23.255 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:22 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:23.255 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:22 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:23.255 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:22 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:23.255 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:22 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:23.255 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:22 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:23.255 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:22 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:23.255 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:22 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:23.255 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:22 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:23.255 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:22 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:23.256 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:22 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:23.256 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:22 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:23.256 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:22 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:23.256 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:22 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:23.256 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:22 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:23.288 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:22 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:23.289 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:22 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:23.289 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:22 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:23.289 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:22 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:23.289 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:22 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:23.289 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:22 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:23.289 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:22 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:23.289 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:22 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:23.289 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:22 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:23.289 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:22 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:23.289 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:22 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:23.289 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:22 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:23.289 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:22 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:23.289 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:22 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:23.289 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:22 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:23.289 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:22 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:23.290 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:22 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:23.290 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:22 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:23.290 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:22 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:23.290 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:22 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:23.290 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:22 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:23.290 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:22 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:23.291 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:22 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:23.291 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:22 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:23.291 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:22 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:23.291 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:22 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:23.291 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:22 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:23.291 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:22 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:23.291 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:22 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:23.291 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:22 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:23.291 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:22 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:23.291 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:22 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:23.291 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:22 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:23.291 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:22 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:23.291 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:22 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:23.291 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:22 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:23.292 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:22 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:23.292 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:22 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:23.292 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:22 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:23.292 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:22 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:23.292 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:22 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:23.292 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:22 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:23.292 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:22 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:23.292 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:22 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:23.292 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:22 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:23.292 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:22 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:23.292 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:22 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:23.292 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:22 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:23.292 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:22 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:23.292 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:22 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:23.293 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:22 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:23.293 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:22 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:23.293 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:22 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:23.293 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:22 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:23.293 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:22 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:23.293 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:22 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:23.293 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:22 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:23.293 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:22 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:23.293 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:22 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:23.293 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:22 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:23.293 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:22 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:23.293 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:22 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:23.293 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:22 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:23.293 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:22 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:23.964 INFO:teuthology.orchestra.run.smithi099.stdout:true 2024-03-30T14:00:24.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:23 smithi181 ceph-mon[25762]: pgmap v1001: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:24.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:23 smithi181 ceph-mon[25762]: pgmap v1002: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:24.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:23 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:24.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:23 smithi181 ceph-mon[25762]: pgmap v1003: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:24.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:23 smithi181 ceph-mon[25762]: pgmap v1004: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:24.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:23 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:24.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:23 smithi181 ceph-mon[25762]: pgmap v1005: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:24.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:23 smithi181 ceph-mon[25762]: pgmap v1006: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:24.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:23 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:24.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:23 smithi181 ceph-mon[25762]: pgmap v1007: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:24.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:23 smithi181 ceph-mon[25762]: pgmap v1008: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:24.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:23 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:24.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:23 smithi181 ceph-mon[25762]: pgmap v1009: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:24.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:23 smithi181 ceph-mon[25762]: pgmap v1010: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:24.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:23 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:24.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:23 smithi181 ceph-mon[25762]: pgmap v1011: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:24.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:23 smithi181 ceph-mon[25762]: pgmap v1012: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:24.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:23 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:24.002 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:23 smithi181 ceph-mon[25762]: pgmap v1013: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:24.002 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:23 smithi181 ceph-mon[25762]: pgmap v1014: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:24.002 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:23 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:24.002 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:23 smithi181 ceph-mon[25762]: pgmap v1015: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:24.002 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:23 smithi181 ceph-mon[25762]: pgmap v1016: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:24.002 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:23 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:24.002 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:23 smithi181 ceph-mon[25762]: pgmap v1017: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:24.002 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:23 smithi181 ceph-mon[25762]: pgmap v1018: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:24.002 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:23 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:24.002 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:23 smithi181 ceph-mon[25762]: pgmap v1019: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:24.002 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:23 smithi181 ceph-mon[25762]: pgmap v1020: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:24.002 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:23 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:24.002 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:23 smithi181 ceph-mon[25762]: pgmap v1021: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:24.002 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:23 smithi181 ceph-mon[25762]: pgmap v1022: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:24.003 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:23 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:24.003 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:23 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:24.003 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:23 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:24.003 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:23 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:24.003 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:23 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:24.003 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:23 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:24.003 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:23 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:24.003 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:23 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:24.003 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:23 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:24.003 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:23 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:24.003 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:23 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:24.003 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:23 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:24.003 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:23 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:24.004 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:23 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:24.004 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:23 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:24.004 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:23 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:24.004 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:23 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:24.004 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:23 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:24.004 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:23 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:24.004 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:23 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:24.004 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:23 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:24.004 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:23 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:24.004 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:23 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:24.004 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:23 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:24.004 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:23 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:24.004 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:23 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:24.004 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:23 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:24.005 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:23 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:24.005 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:23 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:24.005 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:23 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:24.005 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:23 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:24.005 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:23 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:24.005 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:23 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:24.005 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:23 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:24.005 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:23 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:24.005 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:23 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:24.005 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:23 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:24.005 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:23 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:24.005 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:23 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:24.005 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:23 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:24.005 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:23 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:24.005 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:23 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:24.006 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:23 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:24.006 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:23 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:24.006 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:23 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:24.006 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:23 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:24.006 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:23 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:24.006 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:23 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:24.006 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:23 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:24.006 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:23 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:24.006 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:23 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:24.006 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:23 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:24.006 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:23 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:24.006 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:23 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:24.006 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:23 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:24.007 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:23 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:24.282 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:23 smithi099 ceph-mon[29691]: pgmap v1001: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:24.282 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:23 smithi099 ceph-mon[29691]: pgmap v1002: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:24.283 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:23 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:24.283 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:23 smithi099 ceph-mon[29691]: pgmap v1003: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:24.283 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:23 smithi099 ceph-mon[29691]: pgmap v1004: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:24.283 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:23 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:24.283 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:23 smithi099 ceph-mon[29691]: pgmap v1005: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:24.283 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:23 smithi099 ceph-mon[29691]: pgmap v1006: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:24.283 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:23 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:24.283 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:23 smithi099 ceph-mon[29691]: pgmap v1007: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:24.283 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:23 smithi099 ceph-mon[29691]: pgmap v1008: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:24.283 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:23 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:24.283 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:23 smithi099 ceph-mon[29691]: pgmap v1009: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:24.283 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:23 smithi099 ceph-mon[29691]: pgmap v1010: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:24.283 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:23 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:24.283 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:23 smithi099 ceph-mon[29691]: pgmap v1011: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:24.284 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:23 smithi099 ceph-mon[29691]: pgmap v1012: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:24.284 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:23 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:24.284 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:23 smithi099 ceph-mon[29691]: pgmap v1013: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:24.284 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:23 smithi099 ceph-mon[29691]: pgmap v1014: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:24.284 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:23 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:24.284 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:23 smithi099 ceph-mon[29691]: pgmap v1015: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:24.284 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:23 smithi099 ceph-mon[29691]: pgmap v1016: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:24.284 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:23 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:24.284 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:23 smithi099 ceph-mon[29691]: pgmap v1017: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:24.284 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:23 smithi099 ceph-mon[29691]: pgmap v1018: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:24.284 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:23 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:24.284 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:23 smithi099 ceph-mon[29691]: pgmap v1019: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:24.284 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:23 smithi099 ceph-mon[29691]: pgmap v1020: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:24.285 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:23 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:24.285 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:23 smithi099 ceph-mon[29691]: pgmap v1021: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:24.285 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:23 smithi099 ceph-mon[29691]: pgmap v1022: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:24.285 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:23 smithi099 ceph-mon[24912]: pgmap v1001: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:24.285 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:23 smithi099 ceph-mon[24912]: pgmap v1002: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:24.285 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:23 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:24.285 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:23 smithi099 ceph-mon[24912]: pgmap v1003: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:24.285 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:23 smithi099 ceph-mon[24912]: pgmap v1004: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:24.285 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:23 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:24.285 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:23 smithi099 ceph-mon[24912]: pgmap v1005: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:24.285 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:23 smithi099 ceph-mon[24912]: pgmap v1006: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:24.286 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:23 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:24.286 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:23 smithi099 ceph-mon[24912]: pgmap v1007: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:24.286 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:23 smithi099 ceph-mon[24912]: pgmap v1008: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:24.286 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:23 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:24.286 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:23 smithi099 ceph-mon[24912]: pgmap v1009: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:24.286 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:23 smithi099 ceph-mon[24912]: pgmap v1010: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:24.286 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:23 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:24.286 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:23 smithi099 ceph-mon[24912]: pgmap v1011: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:24.286 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:23 smithi099 ceph-mon[24912]: pgmap v1012: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:24.286 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:23 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:24.286 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:23 smithi099 ceph-mon[24912]: pgmap v1013: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:24.286 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:23 smithi099 ceph-mon[24912]: pgmap v1014: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:24.286 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:23 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:24.286 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:23 smithi099 ceph-mon[24912]: pgmap v1015: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:24.287 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:23 smithi099 ceph-mon[24912]: pgmap v1016: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:24.287 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:23 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:24.287 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:23 smithi099 ceph-mon[24912]: pgmap v1017: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:24.287 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:23 smithi099 ceph-mon[24912]: pgmap v1018: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:24.287 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:23 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:24.287 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:23 smithi099 ceph-mon[24912]: pgmap v1019: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:24.287 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:23 smithi099 ceph-mon[24912]: pgmap v1020: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:24.287 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:23 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:24.287 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:23 smithi099 ceph-mon[24912]: pgmap v1021: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:24.287 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:23 smithi099 ceph-mon[24912]: pgmap v1022: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:24.288 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:23 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:24.288 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:23 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:24.288 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:23 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:24.288 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:23 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:24.288 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:23 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:24.288 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:23 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:24.288 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:23 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:24.288 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:23 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:24.288 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:23 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:24.288 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:23 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:24.289 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:23 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:24.289 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:23 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:24.289 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:23 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:24.289 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:23 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:24.289 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:23 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:24.289 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:23 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:24.289 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:23 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:24.289 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:23 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:24.289 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:23 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:24.289 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:23 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:24.290 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:23 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:24.290 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:23 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:24.290 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:23 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:24.290 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:23 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:24.290 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:23 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:24.290 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:23 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:24.290 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:23 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:24.290 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:23 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:24.290 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:23 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:24.290 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:23 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:24.290 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:23 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:24.290 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:23 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:24.290 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:23 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:24.290 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:23 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:24.291 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:23 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:24.291 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:23 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:24.291 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:23 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:24.291 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:23 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:24.291 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:23 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:24.291 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:23 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:24.291 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:23 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:24.291 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:23 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:24.291 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:23 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:24.291 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:23 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:24.291 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:23 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:24.291 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:23 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:24.291 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:23 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:24.291 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:23 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:24.292 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:23 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:24.292 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:23 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:24.292 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:23 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:24.292 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:23 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:24.292 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:23 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:24.292 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:23 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:24.292 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:23 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:24.292 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:23 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:24.292 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:23 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:24.292 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:23 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:24.293 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:23 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:24.293 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:23 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:24.293 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:23 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:24.293 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:23 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:24.293 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:23 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:24.293 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:23 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:24.293 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:23 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:24.293 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:23 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:24.293 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:23 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:24.293 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:23 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:24.293 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:23 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:24.293 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:23 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:24.293 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:23 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:24.293 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:23 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:24.293 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:23 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:24.294 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:23 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:24.294 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:23 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:24.294 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:23 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:24.294 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:23 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:24.294 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:23 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:24.294 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:23 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:24.294 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:23 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:24.294 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:23 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:24.294 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:23 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:24.294 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:23 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:24.294 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:23 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:24.294 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:23 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:24.294 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:23 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:24.294 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:23 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:24.294 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:23 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:24.295 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:23 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:24.295 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:23 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:24.295 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:23 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:24.295 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:23 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:24.295 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:23 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:24.295 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:23 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:24.295 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:23 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:24.295 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:23 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:24.295 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:23 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:24.295 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:23 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:24.295 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:23 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:24.295 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:23 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:24.295 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:23 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:24.295 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:23 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:24.295 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:23 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:24.296 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:23 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:24.296 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:23 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:24.296 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:23 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:24.296 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:23 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:24.296 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:23 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:24.296 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:23 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:24.296 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:23 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:24.296 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:23 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:24.296 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:23 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:24.690 INFO:teuthology.orchestra.run.smithi099.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-03-30T14:00:24.690 INFO:teuthology.orchestra.run.smithi099.stdout:agent.smithi099 smithi099 running 4s ago 28m - - 2024-03-30T14:00:24.690 INFO:teuthology.orchestra.run.smithi099.stdout:agent.smithi181 smithi181 running 14s ago 28m - - 2024-03-30T14:00:24.690 INFO:teuthology.orchestra.run.smithi099.stdout:alertmanager.a smithi099 *:9093,9094 running (15m) 4s ago 22m 23.6M - 0.23.0 ba2b418f427c 0f1be3801027 2024-03-30T14:00:24.690 INFO:teuthology.orchestra.run.smithi099.stdout:grafana.a smithi181 *:3000 error 14s ago 22m - - 2024-03-30T14:00:24.690 INFO:teuthology.orchestra.run.smithi099.stdout:iscsi.foo.smithi099.qyjuvr smithi099 running (102s) 4s ago 22m 46.7M - 3.5 e1d6a67b021e 2f859af6bc2a 2024-03-30T14:00:24.690 INFO:teuthology.orchestra.run.smithi099.stdout:mgr.x smithi181 *:8443,9283,8765 running (53s) 14s ago 27m 450M - 19.0.0-1967-g4e50bbcd b0c4478f1d83 f269106f7913 2024-03-30T14:00:24.690 INFO:teuthology.orchestra.run.smithi099.stdout:mgr.y smithi099 *:8443,9283,8765 running (11m) 4s ago 29m 516M - 19.0.0-1967-g4e50bbcd b0c4478f1d83 0d464b8c1d18 2024-03-30T14:00:24.690 INFO:teuthology.orchestra.run.smithi099.stdout:mon.a smithi099 running (29m) 4s ago 29m 118M 2048M 17.2.0 e1d6a67b021e af06ebb19fd8 2024-03-30T14:00:24.691 INFO:teuthology.orchestra.run.smithi099.stdout:mon.b smithi181 running (28m) 14s ago 28m 71.9M 2048M 17.2.0 e1d6a67b021e e678a2a25c90 2024-03-30T14:00:24.691 INFO:teuthology.orchestra.run.smithi099.stdout:mon.c smithi099 running (28m) 4s ago 28m 70.3M 2048M 17.2.0 e1d6a67b021e 0f1e98917718 2024-03-30T14:00:24.691 INFO:teuthology.orchestra.run.smithi099.stdout:node-exporter.a smithi099 *:9100 running (10s) 4s ago 23m 8112k - 1.5.0 0da6a335fe13 4a3f1f6e7068 2024-03-30T14:00:24.691 INFO:teuthology.orchestra.run.smithi099.stdout:node-exporter.b smithi181 *:9100 starting - - - - 2024-03-30T14:00:24.691 INFO:teuthology.orchestra.run.smithi099.stdout:osd.0 smithi099 running (27m) 4s ago 27m 54.6M 4096M 17.2.0 e1d6a67b021e 3158ee1b0c67 2024-03-30T14:00:24.691 INFO:teuthology.orchestra.run.smithi099.stdout:osd.1 smithi099 running (27m) 4s ago 27m 57.7M 4096M 17.2.0 e1d6a67b021e c4af0fd7071a 2024-03-30T14:00:24.691 INFO:teuthology.orchestra.run.smithi099.stdout:osd.2 smithi099 running (26m) 4s ago 26m 49.7M 4096M 17.2.0 e1d6a67b021e 8e4e805a7e20 2024-03-30T14:00:24.691 INFO:teuthology.orchestra.run.smithi099.stdout:osd.3 smithi099 running (26m) 4s ago 26m 53.7M 4096M 17.2.0 e1d6a67b021e 718812bcf065 2024-03-30T14:00:24.691 INFO:teuthology.orchestra.run.smithi099.stdout:osd.4 smithi181 running (26m) 14s ago 26m 55.3M 4096M 17.2.0 e1d6a67b021e 5e205434e973 2024-03-30T14:00:24.691 INFO:teuthology.orchestra.run.smithi099.stdout:osd.5 smithi181 running (25m) 14s ago 25m 52.9M 4096M 17.2.0 e1d6a67b021e e330c920f152 2024-03-30T14:00:24.691 INFO:teuthology.orchestra.run.smithi099.stdout:osd.6 smithi181 running (25m) 14s ago 25m 52.3M 4096M 17.2.0 e1d6a67b021e 81d889ea213d 2024-03-30T14:00:24.691 INFO:teuthology.orchestra.run.smithi099.stdout:osd.7 smithi181 running (24m) 14s ago 24m 53.0M 4096M 17.2.0 e1d6a67b021e c08b1839dd7e 2024-03-30T14:00:24.691 INFO:teuthology.orchestra.run.smithi099.stdout:prometheus.a smithi181 *:9095 running (115s) 14s ago 24m 60.5M - 2.33.4 514e6a882f6e 6b662de21f27 2024-03-30T14:00:24.691 INFO:teuthology.orchestra.run.smithi099.stdout:rgw.foo.smithi099.fxjbmp smithi099 *:8000 running (22m) 4s ago 22m 76.3M - 17.2.0 e1d6a67b021e 400b28b3f650 2024-03-30T14:00:24.692 INFO:teuthology.orchestra.run.smithi099.stdout:rgw.foo.smithi181.wfqwti smithi181 *:8000 running (22m) 14s ago 22m 76.0M - 17.2.0 e1d6a67b021e 97e1b130f9d4 2024-03-30T14:00:25.080 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 14:00:24 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[71049]: ::ffff:172.21.15.181 - - [30/Mar/2024:14:00:24] "GET /metrics HTTP/1.1" 200 37986 "" "Prometheus/2.33.4" 2024-03-30T14:00:25.081 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:24 smithi099 ceph-mon[24912]: pgmap v1023: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:25.081 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:24 smithi099 ceph-mon[24912]: pgmap v1024: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:25.081 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:24 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:25.081 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:24 smithi099 ceph-mon[24912]: pgmap v1025: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:25.081 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:24 smithi099 ceph-mon[24912]: pgmap v1026: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:25.081 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:24 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:25.082 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:24 smithi099 ceph-mon[24912]: pgmap v1027: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:25.082 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:24 smithi099 ceph-mon[24912]: pgmap v1028: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:25.082 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:24 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:25.082 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:24 smithi099 ceph-mon[24912]: pgmap v1029: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:25.082 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:24 smithi099 ceph-mon[24912]: pgmap v1030: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:25.082 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:24 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:25.082 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:24 smithi099 ceph-mon[24912]: from='client.25136 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T14:00:25.082 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:24 smithi099 ceph-mon[24912]: pgmap v1031: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:25.082 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:24 smithi099 ceph-mon[24912]: pgmap v1032: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:25.082 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:24 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:25.082 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:24 smithi099 ceph-mon[24912]: pgmap v1033: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:25.082 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:24 smithi099 ceph-mon[24912]: pgmap v1034: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:25.082 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:24 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:25.082 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:24 smithi099 ceph-mon[24912]: pgmap v1035: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:25.082 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:24 smithi099 ceph-mon[24912]: pgmap v1036: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:25.083 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:24 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:25.083 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:24 smithi099 ceph-mon[24912]: pgmap v1037: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:25.083 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:24 smithi099 ceph-mon[24912]: pgmap v1038: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:25.083 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:24 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:25.083 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:24 smithi099 ceph-mon[24912]: pgmap v1039: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:25.083 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:24 smithi099 ceph-mon[24912]: pgmap v1040: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:25.083 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:24 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:25.083 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:24 smithi099 ceph-mon[24912]: pgmap v1041: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:25.083 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:24 smithi099 ceph-mon[24912]: pgmap v1042: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:25.083 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:24 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:25.083 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:24 smithi099 ceph-mon[24912]: pgmap v1043: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:25.083 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:24 smithi099 ceph-mon[29691]: pgmap v1023: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:25.084 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:24 smithi099 ceph-mon[29691]: pgmap v1024: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:25.084 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:24 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:25.084 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:24 smithi099 ceph-mon[29691]: pgmap v1025: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:25.084 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:24 smithi099 ceph-mon[29691]: pgmap v1026: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:25.084 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:24 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:25.084 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:24 smithi099 ceph-mon[29691]: pgmap v1027: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:25.084 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:24 smithi099 ceph-mon[29691]: pgmap v1028: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:25.084 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:24 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:25.084 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:24 smithi099 ceph-mon[29691]: pgmap v1029: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:25.084 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:24 smithi099 ceph-mon[29691]: pgmap v1030: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:25.084 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:24 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:25.084 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:24 smithi099 ceph-mon[29691]: from='client.25136 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T14:00:25.084 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:24 smithi099 ceph-mon[29691]: pgmap v1031: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:25.085 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:24 smithi099 ceph-mon[29691]: pgmap v1032: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:25.085 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:24 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:25.085 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:24 smithi099 ceph-mon[29691]: pgmap v1033: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:25.085 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:24 smithi099 ceph-mon[29691]: pgmap v1034: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:25.085 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:24 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:25.085 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:24 smithi099 ceph-mon[29691]: pgmap v1035: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:25.085 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:24 smithi099 ceph-mon[29691]: pgmap v1036: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:25.085 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:24 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:25.085 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:24 smithi099 ceph-mon[29691]: pgmap v1037: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:25.085 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:24 smithi099 ceph-mon[29691]: pgmap v1038: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:25.085 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:24 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:25.085 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:24 smithi099 ceph-mon[29691]: pgmap v1039: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:25.085 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:24 smithi099 ceph-mon[29691]: pgmap v1040: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:25.085 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:24 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:25.085 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:24 smithi099 ceph-mon[29691]: pgmap v1041: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:25.086 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:24 smithi099 ceph-mon[29691]: pgmap v1042: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:25.086 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:24 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:25.086 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:24 smithi099 ceph-mon[29691]: pgmap v1043: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:25.086 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:24 smithi099 ceph-mon[24912]: pgmap v1044: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:25.086 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:24 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:25.086 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:24 smithi099 ceph-mon[24912]: from='client.25504 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T14:00:25.086 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:24 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:25.087 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:24 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:25.087 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:24 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:25.087 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:24 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:25.087 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:24 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:25.087 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:24 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:25.087 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:24 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:25.087 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:24 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:25.088 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:24 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:25.088 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:24 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:25.088 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:24 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:25.088 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:24 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:25.088 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:24 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:25.088 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:24 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:25.088 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:24 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:25.088 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:24 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:25.088 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:24 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:25.088 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:24 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:25.088 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:24 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:25.088 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:24 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:25.088 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:24 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:25.088 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:24 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:25.088 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:24 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:25.089 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:24 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:25.089 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:24 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:25.089 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:24 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:25.089 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:24 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:25.089 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:24 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:25.089 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:24 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:25.089 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:24 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:25.089 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:24 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:25.089 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:24 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:25.089 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:24 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:25.089 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:24 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:25.089 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:24 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:25.090 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:24 smithi099 ceph-mon[29691]: pgmap v1044: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:25.090 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:24 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:25.090 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:24 smithi099 ceph-mon[29691]: from='client.25504 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T14:00:25.090 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:24 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:25.090 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:24 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:25.090 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:24 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:25.090 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:24 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:25.090 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:24 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:25.090 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:24 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:25.090 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:24 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:25.090 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:24 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:25.090 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:24 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:25.090 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:24 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:25.091 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:24 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:25.091 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:24 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:25.091 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:24 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:25.091 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:24 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:25.091 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:24 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:25.091 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:24 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:25.091 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:24 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:25.091 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:24 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:25.091 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:24 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:25.091 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:24 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:25.091 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:24 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:25.091 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:24 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:25.091 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:24 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:25.091 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:24 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:25.091 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:24 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:25.092 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:24 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:25.092 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:24 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:25.092 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:24 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:25.092 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:24 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:25.092 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:24 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:25.092 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:24 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:25.092 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:24 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:25.092 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:24 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:25.092 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:24 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:25.092 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:24 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:25.113 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:24 smithi181 ceph-mon[25762]: pgmap v1023: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:25.113 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:24 smithi181 ceph-mon[25762]: pgmap v1024: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:25.113 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:24 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:25.113 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:24 smithi181 ceph-mon[25762]: pgmap v1025: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:25.113 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:24 smithi181 ceph-mon[25762]: pgmap v1026: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:25.114 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:24 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:25.114 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:24 smithi181 ceph-mon[25762]: pgmap v1027: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:25.114 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:24 smithi181 ceph-mon[25762]: pgmap v1028: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:25.114 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:24 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:25.114 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:24 smithi181 ceph-mon[25762]: pgmap v1029: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:25.114 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:24 smithi181 ceph-mon[25762]: pgmap v1030: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:25.114 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:24 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:25.114 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:24 smithi181 ceph-mon[25762]: from='client.25136 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T14:00:25.114 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:24 smithi181 ceph-mon[25762]: pgmap v1031: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:25.114 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:24 smithi181 ceph-mon[25762]: pgmap v1032: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:25.114 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:24 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:25.115 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:24 smithi181 ceph-mon[25762]: pgmap v1033: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:25.115 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:24 smithi181 ceph-mon[25762]: pgmap v1034: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:25.115 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:24 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:25.115 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:24 smithi181 ceph-mon[25762]: pgmap v1035: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:25.115 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:24 smithi181 ceph-mon[25762]: pgmap v1036: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:25.115 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:24 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:25.115 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:24 smithi181 ceph-mon[25762]: pgmap v1037: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:25.115 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:24 smithi181 ceph-mon[25762]: pgmap v1038: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:25.115 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:24 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:25.115 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:24 smithi181 ceph-mon[25762]: pgmap v1039: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:25.115 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:24 smithi181 ceph-mon[25762]: pgmap v1040: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:25.115 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:24 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:25.115 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:24 smithi181 ceph-mon[25762]: pgmap v1041: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:25.115 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:24 smithi181 ceph-mon[25762]: pgmap v1042: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:25.116 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:24 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:25.116 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:24 smithi181 ceph-mon[25762]: pgmap v1043: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:25.116 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:24 smithi181 ceph-mon[25762]: pgmap v1044: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:25.116 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:24 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:25.116 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:24 smithi181 ceph-mon[25762]: from='client.25504 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T14:00:25.116 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:24 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:25.116 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:24 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:25.116 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:24 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:25.117 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:24 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:25.117 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:24 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:25.117 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:24 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:25.117 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:24 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:25.118 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:24 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:25.118 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:24 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:25.118 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:24 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:25.118 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:24 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:25.118 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:24 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:25.118 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:24 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:25.118 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:24 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:25.118 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:24 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:25.118 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:24 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:25.118 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:24 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:25.118 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:24 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:25.119 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:24 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:25.119 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:24 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:25.119 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:24 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:25.119 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:24 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:25.119 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:24 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:25.119 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:24 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:25.119 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:24 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:25.119 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:24 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:25.119 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:24 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:25.119 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:24 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:25.119 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:24 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:25.119 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:24 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:25.119 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:24 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:25.119 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:24 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:25.119 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:24 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:25.120 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:24 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:25.120 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:24 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:25.139 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-03-30T14:00:25.139 INFO:teuthology.orchestra.run.smithi099.stdout: "mon": { 2024-03-30T14:00:25.139 INFO:teuthology.orchestra.run.smithi099.stdout: "ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)": 3 2024-03-30T14:00:25.139 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T14:00:25.139 INFO:teuthology.orchestra.run.smithi099.stdout: "mgr": { 2024-03-30T14:00:25.140 INFO:teuthology.orchestra.run.smithi099.stdout: "ceph version 19.0.0-1967-g4e50bbcd (4e50bbcdd1630c7760b708f3a5b4d38a121e66cb) squid (dev)": 2 2024-03-30T14:00:25.140 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T14:00:25.140 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": { 2024-03-30T14:00:25.140 INFO:teuthology.orchestra.run.smithi099.stdout: "ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)": 8 2024-03-30T14:00:25.140 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T14:00:25.140 INFO:teuthology.orchestra.run.smithi099.stdout: "mds": {}, 2024-03-30T14:00:25.140 INFO:teuthology.orchestra.run.smithi099.stdout: "rgw": { 2024-03-30T14:00:25.140 INFO:teuthology.orchestra.run.smithi099.stdout: "ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)": 2 2024-03-30T14:00:25.140 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T14:00:25.140 INFO:teuthology.orchestra.run.smithi099.stdout: "overall": { 2024-03-30T14:00:25.140 INFO:teuthology.orchestra.run.smithi099.stdout: "ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)": 13, 2024-03-30T14:00:25.140 INFO:teuthology.orchestra.run.smithi099.stdout: "ceph version 19.0.0-1967-g4e50bbcd (4e50bbcdd1630c7760b708f3a5b4d38a121e66cb) squid (dev)": 2 2024-03-30T14:00:25.140 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-03-30T14:00:25.141 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-03-30T14:00:25.511 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-03-30T14:00:25.512 INFO:teuthology.orchestra.run.smithi099.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph:4e50bbcdd1630c7760b708f3a5b4d38a121e66cb", 2024-03-30T14:00:25.512 INFO:teuthology.orchestra.run.smithi099.stdout: "in_progress": true, 2024-03-30T14:00:25.512 INFO:teuthology.orchestra.run.smithi099.stdout: "which": "Upgrading daemons of type(s) mgr", 2024-03-30T14:00:25.512 INFO:teuthology.orchestra.run.smithi099.stdout: "services_complete": [ 2024-03-30T14:00:25.512 INFO:teuthology.orchestra.run.smithi099.stdout: "mgr" 2024-03-30T14:00:25.512 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-03-30T14:00:25.512 INFO:teuthology.orchestra.run.smithi099.stdout: "progress": "2/2 daemons upgraded", 2024-03-30T14:00:25.512 INFO:teuthology.orchestra.run.smithi099.stdout: "message": "Currently upgrading node-exporter daemons", 2024-03-30T14:00:25.512 INFO:teuthology.orchestra.run.smithi099.stdout: "is_paused": false 2024-03-30T14:00:25.512 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-03-30T14:00:26.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:25 smithi181 ceph-mon[25762]: pgmap v1045: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:26.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:25 smithi181 ceph-mon[25762]: pgmap v1046: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:26.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:25 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:26.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:25 smithi181 ceph-mon[25762]: pgmap v1047: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:26.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:25 smithi181 ceph-mon[25762]: pgmap v1048: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:26.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:25 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:26.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:25 smithi181 ceph-mon[25762]: from='client.25510 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T14:00:26.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:25 smithi181 ceph-mon[25762]: pgmap v1049: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:26.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:25 smithi181 ceph-mon[25762]: pgmap v1050: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:26.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:25 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:26.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:25 smithi181 ceph-mon[25762]: pgmap v1051: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:26.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:25 smithi181 ceph-mon[25762]: pgmap v1052: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:26.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:25 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:26.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:25 smithi181 ceph-mon[25762]: pgmap v1053: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:26.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:25 smithi181 ceph-mon[25762]: pgmap v1054: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:26.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:25 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:26.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:25 smithi181 ceph-mon[25762]: from='client.25516 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T14:00:26.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:25 smithi181 ceph-mon[25762]: pgmap v1055: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:26.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:25 smithi181 ceph-mon[25762]: pgmap v1056: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:26.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:25 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:26.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:25 smithi181 ceph-mon[25762]: pgmap v1057: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:26.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:25 smithi181 ceph-mon[25762]: pgmap v1058: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:26.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:25 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:26.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:25 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:26.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:25 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:26.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:25 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:26.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:25 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:26.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:25 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:26.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:25 smithi181 ceph-mon[25762]: from='client.? 172.21.15.99:0/3730160819' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:26.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:25 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:26.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:25 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:26.253 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:25 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:26.253 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:25 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:26.253 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:25 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:26.253 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:25 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:26.253 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:25 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:26.253 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:25 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:26.253 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:25 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:26.253 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:25 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:26.253 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:25 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:26.253 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:25 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:26.253 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:25 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:26.253 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:25 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:26.253 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:25 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:26.253 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:25 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:26.254 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:25 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:26.254 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:25 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:26.254 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:25 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:26.254 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:25 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:26.254 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:25 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:26.254 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:25 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:26.254 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:25 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:26.254 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:25 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:26.254 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:25 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:26.254 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:25 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:26.254 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:25 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:26.254 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:25 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:26.254 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:25 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:26.254 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:25 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:26.254 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:25 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:26.255 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:25 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:26.255 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:25 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:26.255 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:25 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:26.255 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:25 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:26.331 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:25 smithi099 ceph-mon[29691]: pgmap v1045: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:26.331 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:25 smithi099 ceph-mon[29691]: pgmap v1046: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:26.331 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:25 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:26.331 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:25 smithi099 ceph-mon[29691]: pgmap v1047: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:26.332 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:25 smithi099 ceph-mon[29691]: pgmap v1048: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:26.332 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:25 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:26.332 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:25 smithi099 ceph-mon[29691]: from='client.25510 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T14:00:26.332 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:25 smithi099 ceph-mon[29691]: pgmap v1049: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:26.332 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:25 smithi099 ceph-mon[29691]: pgmap v1050: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:26.332 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:25 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:26.332 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:25 smithi099 ceph-mon[29691]: pgmap v1051: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:26.332 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:25 smithi099 ceph-mon[29691]: pgmap v1052: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:26.333 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:25 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:26.333 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:25 smithi099 ceph-mon[29691]: pgmap v1053: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:26.333 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:25 smithi099 ceph-mon[29691]: pgmap v1054: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:26.333 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:25 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:26.333 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:25 smithi099 ceph-mon[29691]: from='client.25516 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T14:00:26.333 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:25 smithi099 ceph-mon[29691]: pgmap v1055: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:26.333 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:25 smithi099 ceph-mon[29691]: pgmap v1056: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:26.333 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:25 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:26.333 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:25 smithi099 ceph-mon[29691]: pgmap v1057: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:26.334 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:25 smithi099 ceph-mon[29691]: pgmap v1058: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:26.334 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:25 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:26.334 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:25 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:26.334 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:25 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:26.334 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:25 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:26.334 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:25 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:26.334 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:25 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:26.334 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:25 smithi099 ceph-mon[29691]: from='client.? 172.21.15.99:0/3730160819' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:26.335 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:25 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:26.335 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:25 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:26.335 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:25 smithi099 ceph-mon[24912]: pgmap v1045: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:26.335 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:25 smithi099 ceph-mon[24912]: pgmap v1046: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:26.336 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:25 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:26.336 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:25 smithi099 ceph-mon[24912]: pgmap v1047: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:26.336 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:25 smithi099 ceph-mon[24912]: pgmap v1048: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:26.336 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:25 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:26.336 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:25 smithi099 ceph-mon[24912]: from='client.25510 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T14:00:26.336 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:25 smithi099 ceph-mon[24912]: pgmap v1049: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:26.336 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:25 smithi099 ceph-mon[24912]: pgmap v1050: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:26.337 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:25 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:26.337 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:25 smithi099 ceph-mon[24912]: pgmap v1051: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:26.337 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:25 smithi099 ceph-mon[24912]: pgmap v1052: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:26.337 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:25 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:26.337 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:25 smithi099 ceph-mon[24912]: pgmap v1053: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:26.337 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:25 smithi099 ceph-mon[24912]: pgmap v1054: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:26.338 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:25 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:26.338 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:25 smithi099 ceph-mon[24912]: from='client.25516 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T14:00:26.338 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:25 smithi099 ceph-mon[24912]: pgmap v1055: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:26.338 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:25 smithi099 ceph-mon[24912]: pgmap v1056: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:26.338 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:25 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:26.338 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:25 smithi099 ceph-mon[24912]: pgmap v1057: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:26.339 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:25 smithi099 ceph-mon[24912]: pgmap v1058: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:26.339 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:25 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:26.339 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:25 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:26.339 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:25 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:26.339 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:25 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:26.339 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:25 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:26.340 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:25 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:26.340 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:25 smithi099 ceph-mon[24912]: from='client.? 172.21.15.99:0/3730160819' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:26.340 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:25 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:26.340 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:25 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:26.340 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:25 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:26.340 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:25 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:26.341 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:25 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:26.341 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:25 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:26.341 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:25 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:26.341 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:25 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:26.341 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:25 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:26.341 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:25 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:26.341 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:25 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:26.341 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:25 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:26.341 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:25 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:26.341 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:25 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:26.341 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:25 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:26.341 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:25 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:26.341 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:25 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:26.341 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:25 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:26.342 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:25 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:26.342 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:25 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:26.342 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:25 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:26.342 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:25 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:26.342 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:25 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:26.342 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:25 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:26.342 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:25 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:26.342 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:25 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:26.342 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:25 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:26.342 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:25 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:26.342 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:25 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:26.342 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:25 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:26.342 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:25 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:26.343 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:25 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:26.343 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:25 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:26.343 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:25 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:26.343 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:25 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:26.343 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:25 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:26.343 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:25 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:26.343 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:25 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:26.343 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:25 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:26.343 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:25 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:26.343 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:25 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:26.344 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:25 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:26.344 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:25 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:26.344 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:25 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:26.344 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:25 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:26.344 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:25 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:26.344 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:25 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:26.344 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:25 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:26.344 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:25 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:26.344 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:25 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:26.344 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:25 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:26.345 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:25 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:26.345 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:25 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:26.345 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:25 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:26.345 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:25 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:26.345 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:25 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:26.345 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:25 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:26.345 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:25 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:26.345 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:25 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:26.345 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:25 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:26.345 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:25 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:26.345 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:25 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:26.345 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:25 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:26.345 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:25 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:26.345 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:25 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:26.346 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:25 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:26.346 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:25 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:26.346 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:25 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:27.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:26 smithi181 ceph-mon[25762]: pgmap v1059: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:27.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:26 smithi181 ceph-mon[25762]: pgmap v1060: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:27.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:26 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:27.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:26 smithi181 ceph-mon[25762]: pgmap v1061: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:27.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:26 smithi181 ceph-mon[25762]: pgmap v1062: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:27.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:26 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:27.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:26 smithi181 ceph-mon[25762]: pgmap v1063: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:27.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:26 smithi181 ceph-mon[25762]: pgmap v1064: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:27.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:26 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:27.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:26 smithi181 ceph-mon[25762]: pgmap v1065: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:27.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:26 smithi181 ceph-mon[25762]: pgmap v1066: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:27.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:26 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:27.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:26 smithi181 ceph-mon[25762]: from='client.25528 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T14:00:27.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:26 smithi181 ceph-mon[25762]: pgmap v1067: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:27.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:26 smithi181 ceph-mon[25762]: pgmap v1068: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:27.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:26 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:27.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:26 smithi181 ceph-mon[25762]: pgmap v1069: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:27.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:26 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:27.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:26 smithi181 ceph-mon[25762]: pgmap v1070: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:27.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:26 smithi181 ceph-mon[25762]: pgmap v1071: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:27.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:26 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:27.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:26 smithi181 ceph-mon[25762]: pgmap v1072: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:27.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:26 smithi181 ceph-mon[25762]: pgmap v1073: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:27.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:26 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:27.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:26 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:27.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:26 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:27.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:26 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:27.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:26 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:27.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:26 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:27.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:26 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:27.253 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:26 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:27.253 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:26 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:27.253 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:26 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:27.253 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:26 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:27.253 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:26 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:27.253 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:26 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:27.253 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:26 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:27.253 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:26 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:27.253 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:26 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:27.253 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:26 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:27.253 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:26 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:27.253 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:26 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:27.253 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:26 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:27.253 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:26 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:27.254 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:26 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:27.254 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:26 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:27.254 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:26 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:27.254 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:26 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:27.254 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:26 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:27.254 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:26 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:27.254 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:26 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:27.254 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:26 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:27.254 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:26 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:27.254 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:26 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:27.254 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:26 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:27.254 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:26 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:27.254 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:26 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:27.254 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:26 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:27.254 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:26 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:27.255 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:26 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:27.255 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:26 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:27.255 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:26 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:27.255 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:26 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:27.255 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:26 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:27.255 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:26 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:27.255 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:26 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:27.255 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:26 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:27.255 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:26 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:27.255 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:26 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:27.255 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:26 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:27.255 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:26 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:27.255 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:26 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:27.255 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:26 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:27.255 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:26 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:27.256 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:26 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:27.256 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:26 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:27.256 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:26 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:27.256 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:26 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:27.256 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:26 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:27.256 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:26 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:27.256 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:26 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:27.256 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:26 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:27.256 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:26 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:27.256 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:26 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:27.330 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:26 smithi099 ceph-mon[24912]: pgmap v1059: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:27.331 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:26 smithi099 ceph-mon[24912]: pgmap v1060: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:27.331 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:26 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:27.331 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:26 smithi099 ceph-mon[24912]: pgmap v1061: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:27.331 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:26 smithi099 ceph-mon[24912]: pgmap v1062: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:27.331 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:26 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:27.331 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:26 smithi099 ceph-mon[24912]: pgmap v1063: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:27.331 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:26 smithi099 ceph-mon[24912]: pgmap v1064: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:27.331 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:26 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:27.331 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:26 smithi099 ceph-mon[24912]: pgmap v1065: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:27.331 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:26 smithi099 ceph-mon[24912]: pgmap v1066: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:27.331 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:26 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:27.331 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:26 smithi099 ceph-mon[24912]: from='client.25528 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T14:00:27.331 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:26 smithi099 ceph-mon[24912]: pgmap v1067: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:27.332 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:26 smithi099 ceph-mon[24912]: pgmap v1068: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:27.332 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:26 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:27.332 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:26 smithi099 ceph-mon[24912]: pgmap v1069: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:27.332 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:26 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:27.332 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:26 smithi099 ceph-mon[24912]: pgmap v1070: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:27.332 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:26 smithi099 ceph-mon[24912]: pgmap v1071: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:27.332 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:26 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:27.332 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:26 smithi099 ceph-mon[24912]: pgmap v1072: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:27.332 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:26 smithi099 ceph-mon[24912]: pgmap v1073: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:27.332 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:26 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:27.332 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:26 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:27.332 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:26 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:27.332 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:26 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:27.332 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:26 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:27.332 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:26 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:27.333 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:26 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:27.333 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:26 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:27.333 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:26 smithi099 ceph-mon[29691]: pgmap v1059: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:27.333 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:26 smithi099 ceph-mon[29691]: pgmap v1060: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:27.333 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:26 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:27.333 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:26 smithi099 ceph-mon[29691]: pgmap v1061: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:27.333 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:26 smithi099 ceph-mon[29691]: pgmap v1062: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:27.333 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:26 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:27.333 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:26 smithi099 ceph-mon[29691]: pgmap v1063: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:27.333 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:26 smithi099 ceph-mon[29691]: pgmap v1064: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:27.333 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:26 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:27.334 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:26 smithi099 ceph-mon[29691]: pgmap v1065: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:27.334 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:26 smithi099 ceph-mon[29691]: pgmap v1066: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:27.334 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:26 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:27.334 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:26 smithi099 ceph-mon[29691]: from='client.25528 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T14:00:27.334 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:26 smithi099 ceph-mon[29691]: pgmap v1067: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:27.334 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:26 smithi099 ceph-mon[29691]: pgmap v1068: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:27.334 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:26 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:27.334 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:26 smithi099 ceph-mon[29691]: pgmap v1069: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:27.334 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:26 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:27.334 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:26 smithi099 ceph-mon[29691]: pgmap v1070: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:27.334 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:26 smithi099 ceph-mon[29691]: pgmap v1071: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:27.334 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:26 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:27.334 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:26 smithi099 ceph-mon[29691]: pgmap v1072: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:27.334 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:26 smithi099 ceph-mon[29691]: pgmap v1073: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:27.334 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:26 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:27.335 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:26 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:27.335 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:26 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:27.335 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:26 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:27.335 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:26 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:27.335 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:26 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:27.335 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:26 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:27.335 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:26 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:27.335 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:26 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:27.335 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:26 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:27.335 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:26 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:27.335 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:26 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:27.336 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:26 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:27.336 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:26 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:27.336 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:26 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:27.336 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:26 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:27.336 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:26 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:27.336 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:26 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:27.336 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:26 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:27.336 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:26 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:27.336 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:26 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:27.336 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:26 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:27.336 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:26 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:27.336 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:26 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:27.336 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:26 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:27.336 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:26 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:27.337 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:26 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:27.337 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:26 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:27.337 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:26 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:27.337 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:26 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:27.337 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:26 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:27.337 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:26 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:27.337 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:26 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:27.337 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:26 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:27.337 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:26 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:27.337 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:26 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:27.337 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:26 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:27.337 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:26 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:27.338 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:26 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:27.338 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:26 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:27.338 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:26 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:27.338 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:26 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:27.338 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:26 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:27.338 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:26 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:27.338 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:26 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:27.338 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:26 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:27.338 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:26 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:27.338 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:26 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:27.338 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:26 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:27.338 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:26 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:27.338 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:26 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:27.338 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:26 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:27.338 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:26 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:27.339 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:26 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:27.339 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:26 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:27.339 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:26 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:27.339 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:26 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:27.339 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:26 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:27.339 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:26 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:27.339 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:26 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:27.339 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:26 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:27.339 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:26 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:27.339 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:26 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:27.339 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:26 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:27.339 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:26 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:27.339 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:26 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:27.340 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:26 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:27.340 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:26 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:27.340 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:26 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:27.340 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:26 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:27.340 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:26 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:27.340 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:26 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:27.340 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:26 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:27.340 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:26 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:27.340 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:26 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:27.340 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:26 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:27.340 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:26 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:27.340 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:26 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:27.340 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:26 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:27.341 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:26 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:27.341 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:26 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:27.341 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:26 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:27.341 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:26 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:27.341 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:26 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:27.341 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:26 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:27.341 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:26 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:27.341 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:26 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:27.341 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:26 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:27.341 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:26 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:27.341 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:26 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:27.341 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:26 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:27.342 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:26 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:27.342 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:26 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:27.342 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:26 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:27.342 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:26 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:27.342 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:26 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:27.342 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:26 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:27.342 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:26 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:27.342 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:26 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:27.342 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:26 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:27.342 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:26 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:27.342 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:26 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:27.342 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:26 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:27.342 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:26 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:27.342 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:26 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:27.343 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:26 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:27.343 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:26 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:27.343 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:26 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:27.343 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:26 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:27.343 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:26 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:27.343 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:26 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:27.343 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:26 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:27.343 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:26 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:27.343 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:26 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:28.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:27 smithi181 ceph-mon[25762]: pgmap v1074: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:28.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:27 smithi181 ceph-mon[25762]: pgmap v1075: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:28.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:27 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:28.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:27 smithi181 ceph-mon[25762]: pgmap v1076: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:28.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:27 smithi181 ceph-mon[25762]: pgmap v1077: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:28.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:27 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:28.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:27 smithi181 ceph-mon[25762]: pgmap v1078: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:28.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:27 smithi181 ceph-mon[25762]: pgmap v1079: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:28.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:27 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:28.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:27 smithi181 ceph-mon[25762]: pgmap v1080: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:28.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:27 smithi181 ceph-mon[25762]: pgmap v1081: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:28.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:27 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:28.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:27 smithi181 ceph-mon[25762]: pgmap v1082: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:28.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:27 smithi181 ceph-mon[25762]: pgmap v1083: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:28.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:27 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:28.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:27 smithi181 ceph-mon[25762]: pgmap v1084: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:28.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:27 smithi181 ceph-mon[25762]: pgmap v1085: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:28.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:27 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:28.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:27 smithi181 ceph-mon[25762]: pgmap v1086: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:28.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:27 smithi181 ceph-mon[25762]: pgmap v1087: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:28.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:27 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:28.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:27 smithi181 ceph-mon[25762]: pgmap v1088: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:28.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:27 smithi181 ceph-mon[25762]: pgmap v1089: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:28.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:27 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:28.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:27 smithi181 ceph-mon[25762]: pgmap v1090: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 20 KiB/s rd, 20 op/s 2024-03-30T14:00:28.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:27 smithi181 ceph-mon[25762]: pgmap v1091: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 20 KiB/s rd, 20 op/s 2024-03-30T14:00:28.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:27 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:28.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:27 smithi181 ceph-mon[25762]: pgmap v1092: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 20 KiB/s rd, 20 op/s 2024-03-30T14:00:28.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:27 smithi181 ceph-mon[25762]: pgmap v1093: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 20 KiB/s rd, 20 op/s 2024-03-30T14:00:28.253 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:27 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:28.253 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:27 smithi181 ceph-mon[25762]: pgmap v1094: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 20 KiB/s rd, 20 op/s 2024-03-30T14:00:28.253 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:27 smithi181 ceph-mon[25762]: pgmap v1095: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 20 KiB/s rd, 20 op/s 2024-03-30T14:00:28.253 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:27 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:28.253 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:27 smithi181 ceph-mon[25762]: pgmap v1096: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:28.253 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:27 smithi181 ceph-mon[25762]: pgmap v1097: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:28.253 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:27 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:28.253 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:27 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:28.253 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:27 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:28.253 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:27 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:28.253 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:27 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:28.253 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:27 smithi181 ceph-mon[25762]: pgmap v1098: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:28.253 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:27 smithi181 ceph-mon[25762]: pgmap v1099: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:28.253 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:27 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:28.254 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:27 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:28.254 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:27 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:28.254 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:27 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:28.254 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:27 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:28.254 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:27 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:28.254 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:27 smithi181 ceph-mon[25762]: pgmap v1100: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:28.254 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:27 smithi181 ceph-mon[25762]: pgmap v1101: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:28.254 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:27 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:28.254 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:27 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:28.254 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:27 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:28.254 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:27 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:28.254 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:27 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:28.254 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:27 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:28.255 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:27 smithi181 ceph-mon[25762]: pgmap v1102: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:28.255 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:27 smithi181 ceph-mon[25762]: pgmap v1103: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:28.255 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:27 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:28.255 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:27 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:28.255 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:27 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:28.255 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:27 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:28.256 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:27 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:28.256 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:27 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:28.256 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:27 smithi181 ceph-mon[25762]: pgmap v1104: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:28.256 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:27 smithi181 ceph-mon[25762]: pgmap v1105: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:28.256 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:27 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:28.256 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:27 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:28.256 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:27 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:28.256 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:27 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:28.256 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:27 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:28.256 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:27 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:28.256 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:27 smithi181 ceph-mon[25762]: pgmap v1106: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:28.256 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:27 smithi181 ceph-mon[25762]: pgmap v1107: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:28.257 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:27 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:28.257 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:27 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:28.257 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:27 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:28.257 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:27 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:28.257 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:27 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:28.257 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:27 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:28.257 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:27 smithi181 ceph-mon[25762]: pgmap v1108: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:28.257 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:27 smithi181 ceph-mon[25762]: pgmap v1109: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:28.257 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:27 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:28.257 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:27 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:28.257 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:27 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:28.257 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:27 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:28.258 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:27 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:28.258 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:27 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:28.258 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:27 smithi181 ceph-mon[25762]: pgmap v1110: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:28.258 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:27 smithi181 ceph-mon[25762]: pgmap v1111: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:28.258 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:27 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:28.258 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:27 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:28.258 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:27 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:28.258 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:27 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:28.258 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:27 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:28.258 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:27 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:28.258 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:27 smithi181 ceph-mon[25762]: pgmap v1112: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:28.258 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:27 smithi181 ceph-mon[25762]: pgmap v1113: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:28.258 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:27 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:28.258 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:27 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:28.259 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:27 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:28.259 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:27 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:28.259 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:27 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:28.259 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:27 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:28.259 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:27 smithi181 ceph-mon[25762]: pgmap v1114: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:28.259 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:27 smithi181 ceph-mon[25762]: pgmap v1115: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:28.259 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:27 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:28.259 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:27 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:28.259 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:27 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:28.259 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:27 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:28.259 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:27 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:28.259 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:27 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:28.259 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:27 smithi181 ceph-mon[25762]: pgmap v1116: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:28.259 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:27 smithi181 ceph-mon[25762]: pgmap v1117: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:28.260 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:27 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:28.260 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:27 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:28.260 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:27 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:28.260 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:27 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:28.260 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:27 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:28.260 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:27 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:28.260 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:27 smithi181 ceph-mon[25762]: pgmap v1118: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:28.260 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:27 smithi181 ceph-mon[25762]: pgmap v1119: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:28.260 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:27 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:28.260 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:27 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:28.260 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:27 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:28.260 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:27 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:28.260 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:27 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:28.260 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:27 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:28.260 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:27 smithi181 ceph-mon[25762]: pgmap v1120: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:28.260 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:27 smithi181 ceph-mon[25762]: pgmap v1121: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:28.261 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:27 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:28.261 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:27 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:28.331 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:27 smithi099 ceph-mon[24912]: pgmap v1074: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:28.331 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:27 smithi099 ceph-mon[24912]: pgmap v1075: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:28.331 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:27 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:28.331 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:27 smithi099 ceph-mon[24912]: pgmap v1076: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:28.331 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:27 smithi099 ceph-mon[24912]: pgmap v1077: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:28.331 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:27 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:28.331 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:27 smithi099 ceph-mon[24912]: pgmap v1078: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:28.331 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:27 smithi099 ceph-mon[24912]: pgmap v1079: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:28.331 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:27 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:28.331 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:27 smithi099 ceph-mon[24912]: pgmap v1080: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:28.331 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:27 smithi099 ceph-mon[24912]: pgmap v1081: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:28.331 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:27 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:28.332 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:27 smithi099 ceph-mon[24912]: pgmap v1082: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:28.332 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:27 smithi099 ceph-mon[24912]: pgmap v1083: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:28.332 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:27 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:28.332 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:27 smithi099 ceph-mon[24912]: pgmap v1084: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:28.332 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:27 smithi099 ceph-mon[24912]: pgmap v1085: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:28.332 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:27 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:28.332 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:27 smithi099 ceph-mon[24912]: pgmap v1086: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:28.332 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:27 smithi099 ceph-mon[24912]: pgmap v1087: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:28.332 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:27 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:28.332 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:27 smithi099 ceph-mon[24912]: pgmap v1088: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:28.332 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:27 smithi099 ceph-mon[24912]: pgmap v1089: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:28.332 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:27 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:28.332 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:27 smithi099 ceph-mon[24912]: pgmap v1090: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 20 KiB/s rd, 20 op/s 2024-03-30T14:00:28.332 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:27 smithi099 ceph-mon[24912]: pgmap v1091: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 20 KiB/s rd, 20 op/s 2024-03-30T14:00:28.332 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:27 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:28.333 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:27 smithi099 ceph-mon[24912]: pgmap v1092: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 20 KiB/s rd, 20 op/s 2024-03-30T14:00:28.333 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:27 smithi099 ceph-mon[24912]: pgmap v1093: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 20 KiB/s rd, 20 op/s 2024-03-30T14:00:28.333 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:27 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:28.333 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:27 smithi099 ceph-mon[24912]: pgmap v1094: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 20 KiB/s rd, 20 op/s 2024-03-30T14:00:28.333 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:27 smithi099 ceph-mon[29691]: pgmap v1074: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:28.333 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:27 smithi099 ceph-mon[29691]: pgmap v1075: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:28.333 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:27 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:28.334 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:27 smithi099 ceph-mon[29691]: pgmap v1076: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:28.334 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:27 smithi099 ceph-mon[29691]: pgmap v1077: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:28.334 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:27 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:28.334 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:27 smithi099 ceph-mon[29691]: pgmap v1078: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:28.334 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:27 smithi099 ceph-mon[29691]: pgmap v1079: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:28.334 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:27 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:28.334 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:27 smithi099 ceph-mon[29691]: pgmap v1080: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:28.334 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:27 smithi099 ceph-mon[29691]: pgmap v1081: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:28.334 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:27 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:28.334 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:27 smithi099 ceph-mon[29691]: pgmap v1082: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:28.334 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:27 smithi099 ceph-mon[29691]: pgmap v1083: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:28.334 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:27 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:28.334 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:27 smithi099 ceph-mon[29691]: pgmap v1084: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:28.335 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:27 smithi099 ceph-mon[29691]: pgmap v1085: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:28.335 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:27 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:28.335 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:27 smithi099 ceph-mon[29691]: pgmap v1086: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:28.335 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:27 smithi099 ceph-mon[29691]: pgmap v1087: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:28.335 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:27 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:28.335 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:27 smithi099 ceph-mon[29691]: pgmap v1088: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:28.335 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:27 smithi099 ceph-mon[29691]: pgmap v1089: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:28.335 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:27 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:28.335 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:27 smithi099 ceph-mon[29691]: pgmap v1090: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 20 KiB/s rd, 20 op/s 2024-03-30T14:00:28.335 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:27 smithi099 ceph-mon[29691]: pgmap v1091: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 20 KiB/s rd, 20 op/s 2024-03-30T14:00:28.335 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:27 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:28.335 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:27 smithi099 ceph-mon[29691]: pgmap v1092: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 20 KiB/s rd, 20 op/s 2024-03-30T14:00:28.335 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:27 smithi099 ceph-mon[29691]: pgmap v1093: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 20 KiB/s rd, 20 op/s 2024-03-30T14:00:28.335 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:27 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:28.336 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:27 smithi099 ceph-mon[29691]: pgmap v1094: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 20 KiB/s rd, 20 op/s 2024-03-30T14:00:28.336 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:27 smithi099 ceph-mon[29691]: pgmap v1095: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 20 KiB/s rd, 20 op/s 2024-03-30T14:00:28.336 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:27 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:28.336 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:27 smithi099 ceph-mon[29691]: pgmap v1096: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:28.336 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:27 smithi099 ceph-mon[29691]: pgmap v1097: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:28.336 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:27 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:28.336 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:27 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:28.336 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:27 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:28.336 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:27 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:28.336 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:27 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:28.336 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:27 smithi099 ceph-mon[29691]: pgmap v1098: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:28.336 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:27 smithi099 ceph-mon[29691]: pgmap v1099: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:28.336 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:27 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:28.336 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:27 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:28.337 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:27 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:28.337 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:27 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:28.337 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:27 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:28.337 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:27 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:28.337 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:27 smithi099 ceph-mon[29691]: pgmap v1100: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:28.337 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:27 smithi099 ceph-mon[29691]: pgmap v1101: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:28.337 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:27 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:28.337 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:27 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:28.337 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:27 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:28.337 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:27 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:28.337 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:27 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:28.337 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:27 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:28.337 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:27 smithi099 ceph-mon[29691]: pgmap v1102: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:28.338 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:27 smithi099 ceph-mon[29691]: pgmap v1103: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:28.338 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:27 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:28.338 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:27 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:28.338 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:27 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:28.338 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:27 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:28.338 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:27 smithi099 ceph-mon[24912]: pgmap v1095: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 20 KiB/s rd, 20 op/s 2024-03-30T14:00:28.338 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:27 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:28.339 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:27 smithi099 ceph-mon[24912]: pgmap v1096: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:28.339 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:27 smithi099 ceph-mon[24912]: pgmap v1097: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:28.339 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:27 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:28.339 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:27 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:28.339 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:27 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:28.339 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:27 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:28.339 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:27 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:28.339 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:27 smithi099 ceph-mon[24912]: pgmap v1098: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:28.339 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:27 smithi099 ceph-mon[24912]: pgmap v1099: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:28.339 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:27 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:28.339 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:27 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:28.339 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:27 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:28.339 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:27 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:28.339 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:27 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:28.340 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:27 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:28.340 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:27 smithi099 ceph-mon[24912]: pgmap v1100: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:28.340 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:27 smithi099 ceph-mon[24912]: pgmap v1101: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:28.340 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:27 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:28.340 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:27 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:28.340 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:27 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:28.340 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:27 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:28.340 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:27 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:28.340 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:27 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:28.341 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:27 smithi099 ceph-mon[24912]: pgmap v1102: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:28.341 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:27 smithi099 ceph-mon[24912]: pgmap v1103: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:28.341 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:27 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:28.341 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:27 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:28.341 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:27 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:28.341 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:27 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:28.341 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:27 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:28.341 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:27 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:28.341 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:27 smithi099 ceph-mon[24912]: pgmap v1104: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:28.341 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:27 smithi099 ceph-mon[24912]: pgmap v1105: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:28.341 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:27 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:28.341 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:27 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:28.341 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:27 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:28.342 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:27 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:28.342 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:27 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:28.342 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:27 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:28.342 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:27 smithi099 ceph-mon[24912]: pgmap v1106: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:28.342 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:27 smithi099 ceph-mon[24912]: pgmap v1107: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:28.342 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:27 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:28.342 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:27 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:28.342 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:27 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:28.342 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:27 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:28.342 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:27 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:28.342 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:27 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:28.342 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:27 smithi099 ceph-mon[24912]: pgmap v1108: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:28.343 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:27 smithi099 ceph-mon[24912]: pgmap v1109: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:28.343 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:27 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:28.343 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:27 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:28.343 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:27 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:28.343 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:27 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:28.343 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:27 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:28.343 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:27 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:28.343 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:27 smithi099 ceph-mon[24912]: pgmap v1110: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:28.343 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:27 smithi099 ceph-mon[24912]: pgmap v1111: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:28.343 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:27 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:28.343 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:27 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:28.343 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:27 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:28.343 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:27 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:28.344 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:27 smithi099 ceph-mon[29691]: pgmap v1104: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:28.344 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:27 smithi099 ceph-mon[29691]: pgmap v1105: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:28.344 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:27 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:28.344 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:27 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:28.344 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:27 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:28.344 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:27 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:28.344 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:27 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:28.344 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:27 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:28.344 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:27 smithi099 ceph-mon[29691]: pgmap v1106: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:28.344 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:27 smithi099 ceph-mon[29691]: pgmap v1107: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:28.344 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:27 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:28.344 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:27 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:28.344 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:27 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:28.344 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:27 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:28.344 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:27 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:28.345 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:27 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:28.345 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:27 smithi099 ceph-mon[29691]: pgmap v1108: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:28.345 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:27 smithi099 ceph-mon[29691]: pgmap v1109: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:28.345 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:27 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:28.345 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:27 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:28.345 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:27 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:28.345 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:27 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:28.345 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:27 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:28.345 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:27 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:28.346 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:27 smithi099 ceph-mon[29691]: pgmap v1110: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:28.346 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:27 smithi099 ceph-mon[29691]: pgmap v1111: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:28.346 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:27 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:28.346 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:27 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:28.346 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:27 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:28.346 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:27 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:28.346 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:27 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:28.346 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:27 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:28.346 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:27 smithi099 ceph-mon[24912]: pgmap v1112: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:28.346 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:27 smithi099 ceph-mon[24912]: pgmap v1113: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:28.347 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:27 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:28.347 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:27 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:28.347 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:27 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:28.347 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:27 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:28.347 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:27 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:28.347 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:27 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:28.347 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:27 smithi099 ceph-mon[24912]: pgmap v1114: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:28.347 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:27 smithi099 ceph-mon[24912]: pgmap v1115: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:28.347 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:27 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:28.347 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:27 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:28.347 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:27 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:28.347 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:27 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:28.347 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:27 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:28.347 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:27 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:28.347 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:27 smithi099 ceph-mon[24912]: pgmap v1116: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:28.348 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:27 smithi099 ceph-mon[24912]: pgmap v1117: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:28.348 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:27 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:28.348 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:27 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:28.348 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:27 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:28.348 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:27 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:28.348 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:27 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:28.348 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:27 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:28.348 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:27 smithi099 ceph-mon[24912]: pgmap v1118: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:28.348 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:27 smithi099 ceph-mon[24912]: pgmap v1119: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:28.348 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:27 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:28.348 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:27 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:28.348 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:27 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:28.349 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:27 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:28.349 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:27 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:28.349 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:27 smithi099 ceph-mon[29691]: pgmap v1112: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:28.349 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:27 smithi099 ceph-mon[29691]: pgmap v1113: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:28.349 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:27 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:28.349 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:27 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:28.349 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:27 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:28.349 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:27 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:28.349 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:27 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:28.349 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:27 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:28.349 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:27 smithi099 ceph-mon[29691]: pgmap v1114: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:28.349 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:27 smithi099 ceph-mon[29691]: pgmap v1115: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:28.349 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:27 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:28.349 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:27 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:28.350 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:27 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:28.350 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:27 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:28.350 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:27 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:28.350 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:27 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:28.350 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:27 smithi099 ceph-mon[29691]: pgmap v1116: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:28.350 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:27 smithi099 ceph-mon[29691]: pgmap v1117: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:28.350 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:27 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:28.350 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:27 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:28.350 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:27 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:28.350 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:27 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:28.350 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:27 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:28.350 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:27 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:28.350 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:27 smithi099 ceph-mon[29691]: pgmap v1118: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:28.350 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:27 smithi099 ceph-mon[29691]: pgmap v1119: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:28.350 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:27 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:28.351 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:27 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:28.351 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:27 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:28.351 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:27 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:28.351 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:27 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:28.351 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:27 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:28.351 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:27 smithi099 ceph-mon[24912]: pgmap v1120: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:28.351 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:27 smithi099 ceph-mon[24912]: pgmap v1121: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:28.351 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:27 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:28.351 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:27 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:28.352 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:27 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:28.352 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:27 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:28.352 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:27 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:28.352 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:27 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:28.352 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:27 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:28.352 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:27 smithi099 ceph-mon[29691]: pgmap v1120: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:28.352 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:27 smithi099 ceph-mon[29691]: pgmap v1121: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:28.352 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:27 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:28.352 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:27 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:29.175 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:28 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:29.176 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:28 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:29.176 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:28 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:29.176 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:28 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:29.176 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:28 smithi181 ceph-mon[25762]: pgmap v1122: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:29.176 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:28 smithi181 ceph-mon[25762]: pgmap v1123: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:29.176 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:28 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:29.176 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:28 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:29.176 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:28 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:29.176 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:28 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:29.176 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:28 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:29.176 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:28 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:29.177 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:28 smithi181 ceph-mon[25762]: pgmap v1124: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:29.177 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:28 smithi181 ceph-mon[25762]: pgmap v1125: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:29.177 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:28 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:29.177 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:28 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:29.177 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:28 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:29.177 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:28 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:29.177 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:28 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:29.177 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:28 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:29.177 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:28 smithi181 ceph-mon[25762]: pgmap v1126: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:29.177 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:28 smithi181 ceph-mon[25762]: pgmap v1127: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:29.177 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:28 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:29.177 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:28 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:29.177 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:28 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:29.177 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:28 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:29.177 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:28 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:29.178 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:28 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:29.178 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:28 smithi181 ceph-mon[25762]: pgmap v1128: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:29.178 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:28 smithi181 ceph-mon[25762]: pgmap v1129: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:29.178 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:28 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:29.178 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:28 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:29.178 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:28 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:29.178 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:28 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:29.178 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:28 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:29.178 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:28 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:29.178 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:28 smithi181 ceph-mon[25762]: pgmap v1130: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:29.178 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:28 smithi181 ceph-mon[25762]: pgmap v1131: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:29.178 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:28 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:29.178 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:28 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:29.178 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:28 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:29.178 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:28 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:29.179 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:28 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:29.179 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:28 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:29.179 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:28 smithi181 ceph-mon[25762]: pgmap v1132: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:29.179 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:28 smithi181 ceph-mon[25762]: pgmap v1133: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:29.179 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:28 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:29.179 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:28 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:29.179 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:28 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:29.179 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:28 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:29.179 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:28 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:29.179 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:28 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:29.179 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:28 smithi181 ceph-mon[25762]: pgmap v1134: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:29.179 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:28 smithi181 ceph-mon[25762]: pgmap v1135: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:29.179 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:28 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:29.179 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:28 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:29.179 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:28 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:29.180 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:28 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:29.180 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:28 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:29.180 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:28 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:29.180 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:28 smithi181 ceph-mon[25762]: pgmap v1136: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:29.180 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:28 smithi181 ceph-mon[25762]: pgmap v1137: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:29.180 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:28 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:29.180 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:28 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:29.180 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:28 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:29.180 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:28 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:29.180 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:28 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:29.180 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:28 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:29.180 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:28 smithi181 ceph-mon[25762]: pgmap v1138: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:29.180 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:28 smithi181 ceph-mon[25762]: pgmap v1139: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:29.180 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:28 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:29.181 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:28 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:29.181 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:28 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:29.181 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:28 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:29.181 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:28 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:29.181 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:28 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:29.181 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:28 smithi181 ceph-mon[25762]: pgmap v1140: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:29.181 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:28 smithi181 ceph-mon[25762]: pgmap v1141: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:29.181 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:28 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:29.181 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:28 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:29.181 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:28 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:29.181 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:28 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:29.181 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:28 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:29.181 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:28 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:29.181 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:28 smithi181 ceph-mon[25762]: pgmap v1142: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:29.181 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:28 smithi181 ceph-mon[25762]: pgmap v1143: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:29.182 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:28 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:29.182 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:28 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:29.182 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:28 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:29.182 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:28 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:29.182 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:28 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:29.182 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:28 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:29.182 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:28 smithi181 ceph-mon[25762]: pgmap v1144: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:29.182 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:28 smithi181 ceph-mon[25762]: pgmap v1145: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:29.182 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:28 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:29.182 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:28 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:29.331 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:28 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:29.331 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:28 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:29.331 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:28 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:29.331 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:28 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:29.331 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:28 smithi099 ceph-mon[29691]: pgmap v1122: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:29.331 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:28 smithi099 ceph-mon[29691]: pgmap v1123: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:29.331 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:28 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:29.331 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:28 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:29.331 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:28 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:29.331 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:28 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:29.331 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:28 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:29.332 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:28 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:29.332 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:28 smithi099 ceph-mon[29691]: pgmap v1124: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:29.332 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:28 smithi099 ceph-mon[29691]: pgmap v1125: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:29.332 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:28 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:29.332 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:28 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:29.332 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:28 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:29.332 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:28 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:29.332 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:28 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:29.332 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:28 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:29.332 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:28 smithi099 ceph-mon[29691]: pgmap v1126: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:29.332 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:28 smithi099 ceph-mon[29691]: pgmap v1127: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:29.332 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:28 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:29.332 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:28 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:29.332 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:28 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:29.333 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:28 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:29.333 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:28 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:29.333 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:28 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:29.333 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:28 smithi099 ceph-mon[29691]: pgmap v1128: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:29.333 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:28 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:29.333 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:28 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:29.333 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:28 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:29.333 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:28 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:29.333 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:28 smithi099 ceph-mon[24912]: pgmap v1122: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:29.333 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:28 smithi099 ceph-mon[24912]: pgmap v1123: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:29.333 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:28 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:29.334 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:28 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:29.334 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:28 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:29.334 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:28 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:29.334 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:28 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:29.334 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:28 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:29.334 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:28 smithi099 ceph-mon[24912]: pgmap v1124: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:29.334 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:28 smithi099 ceph-mon[24912]: pgmap v1125: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:29.334 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:28 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:29.334 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:28 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:29.334 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:28 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:29.334 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:28 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:29.334 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:28 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:29.334 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:28 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:29.334 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:28 smithi099 ceph-mon[24912]: pgmap v1126: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:29.334 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:28 smithi099 ceph-mon[24912]: pgmap v1127: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:29.335 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:28 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:29.335 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:28 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:29.335 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:28 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:29.335 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:28 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:29.335 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:28 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:29.335 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:28 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:29.335 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:28 smithi099 ceph-mon[24912]: pgmap v1128: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:29.335 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:28 smithi099 ceph-mon[29691]: pgmap v1129: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:29.335 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:28 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:29.335 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:28 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:29.335 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:28 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:29.336 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:28 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:29.336 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:28 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:29.336 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:28 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:29.336 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:28 smithi099 ceph-mon[29691]: pgmap v1130: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:29.336 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:28 smithi099 ceph-mon[29691]: pgmap v1131: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:29.336 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:28 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:29.336 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:28 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:29.336 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:28 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:29.336 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:28 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:29.336 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:28 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:29.336 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:28 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:29.336 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:28 smithi099 ceph-mon[29691]: pgmap v1132: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:29.336 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:28 smithi099 ceph-mon[29691]: pgmap v1133: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:29.336 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:28 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:29.336 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:28 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:29.337 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:28 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:29.337 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:28 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:29.337 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:28 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:29.337 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:28 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:29.337 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:28 smithi099 ceph-mon[29691]: pgmap v1134: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:29.337 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:28 smithi099 ceph-mon[29691]: pgmap v1135: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:29.337 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:28 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:29.337 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:28 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:29.337 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:28 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:29.337 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:28 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:29.337 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:28 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:29.337 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:28 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:29.338 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:28 smithi099 ceph-mon[24912]: pgmap v1129: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:29.338 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:28 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:29.338 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:28 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:29.338 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:28 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:29.338 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:28 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:29.338 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:28 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:29.338 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:28 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:29.338 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:28 smithi099 ceph-mon[24912]: pgmap v1130: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:29.338 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:28 smithi099 ceph-mon[24912]: pgmap v1131: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:29.338 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:28 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:29.338 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:28 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:29.338 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:28 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:29.338 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:28 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:29.339 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:28 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:29.339 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:28 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:29.339 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:28 smithi099 ceph-mon[24912]: pgmap v1132: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:29.339 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:28 smithi099 ceph-mon[24912]: pgmap v1133: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:29.339 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:28 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:29.339 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:28 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:29.339 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:28 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:29.339 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:28 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:29.339 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:28 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:29.339 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:28 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:29.339 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:28 smithi099 ceph-mon[24912]: pgmap v1134: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:29.339 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:28 smithi099 ceph-mon[24912]: pgmap v1135: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:29.339 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:28 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:29.339 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:28 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:29.339 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:28 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:29.339 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:28 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:29.340 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:28 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:29.340 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:28 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:29.340 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:28 smithi099 ceph-mon[29691]: pgmap v1136: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:29.340 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:28 smithi099 ceph-mon[29691]: pgmap v1137: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:29.340 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:28 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:29.340 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:28 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:29.340 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:28 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:29.340 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:28 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:29.340 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:28 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:29.341 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:28 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:29.341 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:28 smithi099 ceph-mon[29691]: pgmap v1138: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:29.341 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:28 smithi099 ceph-mon[29691]: pgmap v1139: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:29.341 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:28 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:29.341 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:28 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:29.341 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:28 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:29.341 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:28 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:29.341 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:28 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:29.341 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:28 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:29.341 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:28 smithi099 ceph-mon[29691]: pgmap v1140: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:29.341 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:28 smithi099 ceph-mon[29691]: pgmap v1141: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:29.342 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:28 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:29.342 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:28 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:29.342 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:28 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:29.342 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:28 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:29.342 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:28 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:29.342 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:28 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:29.342 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:28 smithi099 ceph-mon[29691]: pgmap v1142: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:29.342 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:28 smithi099 ceph-mon[29691]: pgmap v1143: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:29.342 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:28 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:29.342 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:28 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:29.342 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:28 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:29.342 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:28 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:29.342 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:28 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:29.342 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:28 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:29.343 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:28 smithi099 ceph-mon[29691]: pgmap v1144: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:29.343 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:28 smithi099 ceph-mon[29691]: pgmap v1145: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:29.343 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:28 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:29.343 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:28 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:29.343 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:28 smithi099 ceph-mon[24912]: pgmap v1136: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:29.343 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:28 smithi099 ceph-mon[24912]: pgmap v1137: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:29.343 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:28 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:29.343 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:28 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:29.343 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:28 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:29.343 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:28 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:29.343 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:28 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:29.344 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:28 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:29.344 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:28 smithi099 ceph-mon[24912]: pgmap v1138: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:29.344 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:28 smithi099 ceph-mon[24912]: pgmap v1139: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:29.344 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:28 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:29.344 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:28 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:29.344 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:28 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:29.344 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:28 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:29.344 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:28 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:29.344 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:28 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:29.344 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:28 smithi099 ceph-mon[24912]: pgmap v1140: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:29.344 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:28 smithi099 ceph-mon[24912]: pgmap v1141: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:29.344 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:28 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:29.344 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:28 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:29.344 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:28 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:29.345 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:28 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:29.345 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:28 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:29.345 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:28 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:29.345 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:28 smithi099 ceph-mon[24912]: pgmap v1142: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:29.345 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:28 smithi099 ceph-mon[24912]: pgmap v1143: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:29.345 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:28 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:29.345 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:28 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:29.345 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:28 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:29.345 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:28 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:29.345 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:28 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:29.345 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:28 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:29.345 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:28 smithi099 ceph-mon[24912]: pgmap v1144: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:29.345 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:28 smithi099 ceph-mon[24912]: pgmap v1145: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:29.345 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:28 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:29.345 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:28 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:30.247 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:29 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:30.248 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:29 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:30.248 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:29 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:30.248 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:29 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:30.248 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:29 smithi181 ceph-mon[25762]: pgmap v1146: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:30.248 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:29 smithi181 ceph-mon[25762]: pgmap v1147: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:30.248 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:29 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:30.248 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:29 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:30.248 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:29 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:30.248 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:29 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:30.248 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:29 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:30.248 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:29 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:30.248 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:29 smithi181 ceph-mon[25762]: pgmap v1148: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:30.249 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:29 smithi181 ceph-mon[25762]: pgmap v1149: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:30.249 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:29 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:30.249 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:29 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:30.249 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:29 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:30.249 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:29 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:30.249 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:29 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:30.249 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:29 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:30.249 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:29 smithi181 ceph-mon[25762]: pgmap v1150: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:30.249 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:29 smithi181 ceph-mon[25762]: pgmap v1151: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:30.249 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:29 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:30.249 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:29 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:30.249 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:29 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:30.249 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:29 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:30.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:29 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:30.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:29 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:30.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:29 smithi181 ceph-mon[25762]: pgmap v1152: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:30.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:29 smithi181 ceph-mon[25762]: pgmap v1153: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:30.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:29 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:30.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:29 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:30.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:29 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:30.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:29 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:30.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:29 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:30.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:29 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:30.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:29 smithi181 ceph-mon[25762]: pgmap v1154: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:30.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:29 smithi181 ceph-mon[25762]: pgmap v1155: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:30.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:29 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:30.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:29 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:30.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:29 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:30.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:29 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:30.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:29 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:30.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:29 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:30.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:29 smithi181 ceph-mon[25762]: pgmap v1156: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:30.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:29 smithi181 ceph-mon[25762]: pgmap v1157: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:30.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:29 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:30.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:29 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:30.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:29 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:30.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:29 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:30.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:29 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:30.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:29 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:30.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:29 smithi181 ceph-mon[25762]: pgmap v1158: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:30.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:29 smithi181 ceph-mon[25762]: pgmap v1159: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:30.253 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:29 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:30.253 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:29 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:30.253 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:29 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:30.253 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:29 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:30.253 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:29 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:30.253 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:29 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:30.253 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:29 smithi181 ceph-mon[25762]: pgmap v1160: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:30.253 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:29 smithi181 ceph-mon[25762]: pgmap v1161: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:30.253 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:29 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:30.253 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:29 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:30.253 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:29 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:30.253 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:29 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:30.253 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:29 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:30.253 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:29 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:30.254 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:29 smithi181 ceph-mon[25762]: pgmap v1162: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:30.254 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:29 smithi181 ceph-mon[25762]: pgmap v1163: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:30.254 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:29 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:30.254 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:29 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:30.254 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:29 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:30.254 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:29 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:30.254 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:29 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:30.254 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:29 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:30.254 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:29 smithi181 ceph-mon[25762]: pgmap v1164: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:30.254 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:29 smithi181 ceph-mon[25762]: pgmap v1165: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:30.254 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:29 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:30.254 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:29 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:30.254 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:29 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:30.254 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:29 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:30.255 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:29 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:30.255 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:29 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:30.255 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:29 smithi181 ceph-mon[25762]: pgmap v1166: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:30.255 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:29 smithi181 ceph-mon[25762]: pgmap v1167: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:30.255 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:29 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:30.255 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:29 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:30.331 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:29 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:30.331 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:29 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:30.331 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:29 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:30.331 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:29 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:30.331 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:29 smithi099 ceph-mon[24912]: pgmap v1146: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:30.331 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:29 smithi099 ceph-mon[24912]: pgmap v1147: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:30.331 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:29 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:30.331 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:29 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:30.331 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:29 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:30.331 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:29 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:30.331 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:29 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:30.331 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:29 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:30.331 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:29 smithi099 ceph-mon[24912]: pgmap v1148: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:30.332 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:29 smithi099 ceph-mon[24912]: pgmap v1149: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:30.332 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:29 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:30.332 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:29 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:30.332 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:29 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:30.332 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:29 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:30.332 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:29 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:30.332 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:29 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:30.332 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:29 smithi099 ceph-mon[24912]: pgmap v1150: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:30.332 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:29 smithi099 ceph-mon[24912]: pgmap v1151: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:30.332 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:29 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:30.332 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:29 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:30.332 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:29 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:30.332 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:29 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:30.332 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:29 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:30.333 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:29 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:30.333 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:29 smithi099 ceph-mon[24912]: pgmap v1152: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:30.333 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:29 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:30.333 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:29 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:30.333 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:29 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:30.333 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:29 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:30.333 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:29 smithi099 ceph-mon[29691]: pgmap v1146: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:30.333 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:29 smithi099 ceph-mon[29691]: pgmap v1147: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:30.333 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:29 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:30.333 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:29 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:30.334 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:29 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:30.334 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:29 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:30.334 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:29 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:30.334 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:29 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:30.334 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:29 smithi099 ceph-mon[29691]: pgmap v1148: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:30.334 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:29 smithi099 ceph-mon[29691]: pgmap v1149: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:30.334 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:29 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:30.334 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:29 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:30.334 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:29 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:30.334 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:29 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:30.334 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:29 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:30.334 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:29 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:30.334 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:29 smithi099 ceph-mon[29691]: pgmap v1150: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:30.334 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:29 smithi099 ceph-mon[29691]: pgmap v1151: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:30.335 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:29 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:30.335 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:29 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:30.335 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:29 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:30.335 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:29 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:30.335 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:29 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:30.335 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:29 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:30.335 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:29 smithi099 ceph-mon[29691]: pgmap v1152: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:30.335 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:29 smithi099 ceph-mon[29691]: pgmap v1153: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:30.335 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:29 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:30.335 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:29 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:30.335 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:29 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:30.335 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:29 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:30.335 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:29 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:30.335 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:29 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:30.335 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:29 smithi099 ceph-mon[29691]: pgmap v1154: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:30.336 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:29 smithi099 ceph-mon[29691]: pgmap v1155: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:30.336 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:29 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:30.336 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:29 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:30.336 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:29 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:30.336 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:29 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:30.336 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:29 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:30.336 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:29 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:30.336 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:29 smithi099 ceph-mon[29691]: pgmap v1156: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:30.336 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:29 smithi099 ceph-mon[29691]: pgmap v1157: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:30.336 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:29 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:30.336 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:29 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:30.336 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:29 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:30.336 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:29 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:30.336 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:29 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:30.336 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:29 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:30.337 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:29 smithi099 ceph-mon[29691]: pgmap v1158: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:30.337 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:29 smithi099 ceph-mon[29691]: pgmap v1159: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:30.337 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:29 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:30.337 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:29 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:30.337 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:29 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:30.337 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:29 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:30.337 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:29 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:30.337 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:29 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:30.337 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:29 smithi099 ceph-mon[24912]: pgmap v1153: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:30.337 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:29 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:30.337 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:29 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:30.337 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:29 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:30.337 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:29 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:30.338 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:29 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:30.338 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:29 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:30.338 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:29 smithi099 ceph-mon[24912]: pgmap v1154: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:30.338 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:29 smithi099 ceph-mon[24912]: pgmap v1155: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:30.338 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:29 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:30.338 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:29 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:30.338 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:29 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:30.338 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:29 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:30.338 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:29 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:30.338 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:29 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:30.338 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:29 smithi099 ceph-mon[24912]: pgmap v1156: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:30.338 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:29 smithi099 ceph-mon[24912]: pgmap v1157: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:30.338 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:29 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:30.338 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:29 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:30.339 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:29 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:30.339 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:29 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:30.339 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:29 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:30.339 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:29 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:30.339 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:29 smithi099 ceph-mon[24912]: pgmap v1158: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:30.339 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:29 smithi099 ceph-mon[24912]: pgmap v1159: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:30.339 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:29 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:30.339 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:29 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:30.339 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:29 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:30.339 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:29 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:30.339 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:29 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:30.339 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:29 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:30.340 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:29 smithi099 ceph-mon[29691]: pgmap v1160: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:30.340 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:29 smithi099 ceph-mon[29691]: pgmap v1161: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:30.340 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:29 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:30.340 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:29 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:30.340 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:29 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:30.340 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:29 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:30.340 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:29 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:30.340 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:29 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:30.340 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:29 smithi099 ceph-mon[29691]: pgmap v1162: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:30.340 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:29 smithi099 ceph-mon[29691]: pgmap v1163: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:30.340 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:29 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:30.340 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:29 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:30.340 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:29 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:30.340 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:29 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:30.341 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:29 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:30.341 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:29 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:30.341 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:29 smithi099 ceph-mon[29691]: pgmap v1164: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:30.341 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:29 smithi099 ceph-mon[29691]: pgmap v1165: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:30.341 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:29 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:30.341 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:29 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:30.341 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:29 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:30.341 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:29 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:30.341 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:29 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:30.341 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:29 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:30.341 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:29 smithi099 ceph-mon[29691]: pgmap v1166: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:30.341 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:29 smithi099 ceph-mon[29691]: pgmap v1167: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:30.341 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:29 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:30.341 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:29 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:30.342 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:29 smithi099 ceph-mon[24912]: pgmap v1160: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:30.342 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:29 smithi099 ceph-mon[24912]: pgmap v1161: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:30.342 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:29 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:30.342 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:29 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:30.342 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:29 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:30.342 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:29 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:30.342 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:29 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:30.342 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:29 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:30.342 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:29 smithi099 ceph-mon[24912]: pgmap v1162: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:30.342 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:29 smithi099 ceph-mon[24912]: pgmap v1163: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:30.342 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:29 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:30.342 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:29 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:30.342 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:29 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:30.343 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:29 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:30.343 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:29 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:30.343 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:29 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:30.343 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:29 smithi099 ceph-mon[24912]: pgmap v1164: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:30.343 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:29 smithi099 ceph-mon[24912]: pgmap v1165: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:30.343 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:29 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:30.343 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:29 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:30.343 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:29 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:30.343 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:29 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:30.343 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:29 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:30.343 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:29 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:30.343 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:29 smithi099 ceph-mon[24912]: pgmap v1166: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:30.343 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:29 smithi099 ceph-mon[24912]: pgmap v1167: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:30.343 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:29 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:30.344 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:29 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:31.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:30 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:31.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:30 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:31.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:30 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:31.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:30 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:31.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:30 smithi181 ceph-mon[25762]: pgmap v1168: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:31.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:30 smithi181 ceph-mon[25762]: pgmap v1169: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:31.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:30 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:31.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:30 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:31.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:30 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:31.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:30 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:31.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:30 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:31.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:30 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:31.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:30 smithi181 ceph-mon[25762]: pgmap v1170: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:31.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:30 smithi181 ceph-mon[25762]: pgmap v1171: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:31.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:30 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:31.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:30 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:31.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:30 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:31.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:30 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:31.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:30 smithi181 ceph-mon[25762]: pgmap v1172: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:31.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:30 smithi181 ceph-mon[25762]: pgmap v1173: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:31.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:30 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:31.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:30 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:31.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:30 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:31.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:30 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:31.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:30 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:31.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:30 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:31.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:30 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:31.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:30 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:31.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:30 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:31.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:30 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:31.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:30 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:31.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:30 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T14:00:31.330 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:30 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:31.331 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:30 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:31.331 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:30 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:31.331 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:30 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:31.331 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:30 smithi099 ceph-mon[24912]: pgmap v1168: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:31.331 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:30 smithi099 ceph-mon[24912]: pgmap v1169: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:31.331 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:30 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:31.331 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:30 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:31.331 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:30 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:31.331 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:30 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:31.331 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:30 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:31.331 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:30 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:31.331 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:30 smithi099 ceph-mon[24912]: pgmap v1170: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:31.332 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:30 smithi099 ceph-mon[24912]: pgmap v1171: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:31.332 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:30 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:31.332 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:30 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:31.332 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:30 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:31.332 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:30 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:31.332 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:30 smithi099 ceph-mon[24912]: pgmap v1172: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:31.332 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:30 smithi099 ceph-mon[24912]: pgmap v1173: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:31.332 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:30 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:31.332 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:30 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:31.332 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:30 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:31.332 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:30 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:31.332 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:30 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:31.332 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:30 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:31.332 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:30 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:31.332 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:30 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:31.333 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:30 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:31.333 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:30 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:31.333 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:30 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:31.333 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:30 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T14:00:31.333 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:30 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:31.333 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:30 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:31.333 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:30 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:31.333 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:30 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:31.333 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:30 smithi099 ceph-mon[29691]: pgmap v1168: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:31.333 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:30 smithi099 ceph-mon[29691]: pgmap v1169: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:31.333 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:30 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:31.333 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:30 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:31.334 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:30 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:31.334 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:30 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:31.334 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:30 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:31.334 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:30 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:31.334 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:30 smithi099 ceph-mon[29691]: pgmap v1170: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:31.334 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:30 smithi099 ceph-mon[29691]: pgmap v1171: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:31.334 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:30 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:31.334 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:30 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:31.334 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:30 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:31.334 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:30 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:31.334 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:30 smithi099 ceph-mon[29691]: pgmap v1172: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:31.334 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:30 smithi099 ceph-mon[29691]: pgmap v1173: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:31.334 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:30 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:31.334 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:30 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:31.334 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:30 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:31.335 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:30 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:31.335 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:30 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:31.335 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:30 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:31.335 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:30 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:31.335 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:30 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:31.335 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:30 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:31.335 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:30 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:31.335 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:30 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:31.335 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:30 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T14:00:32.220 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:32 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:32.220 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:32 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:32.220 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:32 smithi181 ceph-mon[25762]: pgmap v1174: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:32.220 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:32 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:32.220 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:32 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:32.220 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:32 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:32.220 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:32 smithi181 ceph-mon[25762]: pgmap v1175: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:32.220 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:32 smithi181 ceph-mon[25762]: pgmap v1176: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:32.221 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:32 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:32.580 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:32 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:32.581 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:32 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:32.581 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:32 smithi099 ceph-mon[24912]: pgmap v1174: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:32.581 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:32 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:32.581 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:32 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:32.581 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:32 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:32.581 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:32 smithi099 ceph-mon[24912]: pgmap v1175: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:32.581 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:32 smithi099 ceph-mon[24912]: pgmap v1176: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:32.581 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:32 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:32.581 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:32 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:32.581 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:32 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:32.581 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:32 smithi099 ceph-mon[29691]: pgmap v1174: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:32.581 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:32 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:32.581 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:32 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:32.582 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:32 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:32.582 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:32 smithi099 ceph-mon[29691]: pgmap v1175: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:32.582 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:32 smithi099 ceph-mon[29691]: pgmap v1176: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:32.582 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:32 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:33.499 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:33 smithi181 ceph-mon[25762]: Upgrade: Updating prometheus.a 2024-03-30T14:00:33.499 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:33 smithi181 ceph-mon[25762]: Deploying daemon prometheus.a on smithi181 2024-03-30T14:00:33.580 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:33 smithi099 ceph-mon[24912]: Upgrade: Updating prometheus.a 2024-03-30T14:00:33.580 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:33 smithi099 ceph-mon[24912]: Deploying daemon prometheus.a on smithi181 2024-03-30T14:00:33.581 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:33 smithi099 ceph-mon[29691]: Upgrade: Updating prometheus.a 2024-03-30T14:00:33.581 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:33 smithi099 ceph-mon[29691]: Deploying daemon prometheus.a on smithi181 2024-03-30T14:00:35.080 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:34 smithi099 ceph-mon[24912]: from='client.25136 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T14:00:35.080 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:34 smithi099 ceph-mon[24912]: pgmap v1177: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-03-30T14:00:35.081 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 14:00:34 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[71049]: ::ffff:172.21.15.181 - - [30/Mar/2024:14:00:34] "GET /metrics HTTP/1.1" 200 37999 "" "Prometheus/2.33.4" 2024-03-30T14:00:35.081 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:34 smithi099 ceph-mon[29691]: from='client.25136 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T14:00:35.081 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:34 smithi099 ceph-mon[29691]: pgmap v1177: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-03-30T14:00:35.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:34 smithi181 ceph-mon[25762]: from='client.25136 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T14:00:35.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:34 smithi181 ceph-mon[25762]: pgmap v1177: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-03-30T14:00:37.020 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:36 smithi181 ceph-mon[25762]: pgmap v1178: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 989 B/s rd, 0 op/s 2024-03-30T14:00:37.330 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:36 smithi099 ceph-mon[24912]: pgmap v1178: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 989 B/s rd, 0 op/s 2024-03-30T14:00:37.330 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:36 smithi099 ceph-mon[29691]: pgmap v1178: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 989 B/s rd, 0 op/s 2024-03-30T14:00:37.617 INFO:journalctl@ceph.prometheus.a.smithi181.stdout:Mar 30 14:00:37 smithi181 systemd[1]: Stopping Ceph prometheus.a for 98ebaeb8-ee99-11ee-b647-cb9ed24678a4... 2024-03-30T14:00:37.909 INFO:journalctl@ceph.prometheus.a.smithi181.stdout:Mar 30 14:00:37 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-prometheus-a[72618]: ts=2024-03-30T14:00:37.622Z caller=main.go:775 level=warn msg="Received SIGTERM, exiting gracefully..." 2024-03-30T14:00:37.909 INFO:journalctl@ceph.prometheus.a.smithi181.stdout:Mar 30 14:00:37 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-prometheus-a[72618]: ts=2024-03-30T14:00:37.622Z caller=main.go:798 level=info msg="Stopping scrape discovery manager..." 2024-03-30T14:00:37.909 INFO:journalctl@ceph.prometheus.a.smithi181.stdout:Mar 30 14:00:37 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-prometheus-a[72618]: ts=2024-03-30T14:00:37.622Z caller=main.go:812 level=info msg="Stopping notify discovery manager..." 2024-03-30T14:00:37.909 INFO:journalctl@ceph.prometheus.a.smithi181.stdout:Mar 30 14:00:37 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-prometheus-a[72618]: ts=2024-03-30T14:00:37.622Z caller=main.go:834 level=info msg="Stopping scrape manager..." 2024-03-30T14:00:37.909 INFO:journalctl@ceph.prometheus.a.smithi181.stdout:Mar 30 14:00:37 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-prometheus-a[72618]: ts=2024-03-30T14:00:37.622Z caller=main.go:794 level=info msg="Scrape discovery manager stopped" 2024-03-30T14:00:37.909 INFO:journalctl@ceph.prometheus.a.smithi181.stdout:Mar 30 14:00:37 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-prometheus-a[72618]: ts=2024-03-30T14:00:37.622Z caller=main.go:808 level=info msg="Notify discovery manager stopped" 2024-03-30T14:00:37.910 INFO:journalctl@ceph.prometheus.a.smithi181.stdout:Mar 30 14:00:37 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-prometheus-a[72618]: ts=2024-03-30T14:00:37.622Z caller=manager.go:945 level=info component="rule manager" msg="Stopping rule manager..." 2024-03-30T14:00:37.910 INFO:journalctl@ceph.prometheus.a.smithi181.stdout:Mar 30 14:00:37 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-prometheus-a[72618]: ts=2024-03-30T14:00:37.622Z caller=manager.go:955 level=info component="rule manager" msg="Rule manager stopped" 2024-03-30T14:00:37.910 INFO:journalctl@ceph.prometheus.a.smithi181.stdout:Mar 30 14:00:37 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-prometheus-a[72618]: ts=2024-03-30T14:00:37.622Z caller=main.go:828 level=info msg="Scrape manager stopped" 2024-03-30T14:00:37.910 INFO:journalctl@ceph.prometheus.a.smithi181.stdout:Mar 30 14:00:37 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-prometheus-a[72618]: ts=2024-03-30T14:00:37.623Z caller=notifier.go:600 level=info component=notifier msg="Stopping notification manager..." 2024-03-30T14:00:37.910 INFO:journalctl@ceph.prometheus.a.smithi181.stdout:Mar 30 14:00:37 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-prometheus-a[72618]: ts=2024-03-30T14:00:37.623Z caller=main.go:1054 level=info msg="Notifier manager stopped" 2024-03-30T14:00:37.910 INFO:journalctl@ceph.prometheus.a.smithi181.stdout:Mar 30 14:00:37 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-prometheus-a[72618]: ts=2024-03-30T14:00:37.623Z caller=main.go:1066 level=info msg="See you next time!" 2024-03-30T14:00:37.910 INFO:journalctl@ceph.prometheus.a.smithi181.stdout:Mar 30 14:00:37 smithi181 podman[100379]: 2024-03-30 14:00:37.632215308 +0000 UTC m=+0.100809670 container died 6b662de21f27db22102abcccd995bc155eb52b3e58b1195c49737bd73b277519 (image=quay.io/prometheus/prometheus:v2.33.4, name=ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-prometheus-a, maintainer=The Prometheus Authors ) 2024-03-30T14:00:38.249 INFO:journalctl@ceph.prometheus.a.smithi181.stdout:Mar 30 14:00:38 smithi181 podman[100379]: 2024-03-30 14:00:38.005717931 +0000 UTC m=+0.474312285 container cleanup 6b662de21f27db22102abcccd995bc155eb52b3e58b1195c49737bd73b277519 (image=quay.io/prometheus/prometheus:v2.33.4, name=ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-prometheus-a, maintainer=The Prometheus Authors ) 2024-03-30T14:00:38.249 INFO:journalctl@ceph.prometheus.a.smithi181.stdout:Mar 30 14:00:38 smithi181 bash[100379]: ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-prometheus-a 2024-03-30T14:00:38.607 INFO:journalctl@ceph.prometheus.a.smithi181.stdout:Mar 30 14:00:38 smithi181 podman[100393]: 2024-03-30 14:00:38.273566992 +0000 UTC m=+0.638763148 container remove 6b662de21f27db22102abcccd995bc155eb52b3e58b1195c49737bd73b277519 (image=quay.io/prometheus/prometheus:v2.33.4, name=ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-prometheus-a, maintainer=The Prometheus Authors ) 2024-03-30T14:00:38.607 INFO:journalctl@ceph.prometheus.a.smithi181.stdout:Mar 30 14:00:38 smithi181 systemd[1]: ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4@prometheus.a.service: Deactivated successfully. 2024-03-30T14:00:38.607 INFO:journalctl@ceph.prometheus.a.smithi181.stdout:Mar 30 14:00:38 smithi181 systemd[1]: Stopped Ceph prometheus.a for 98ebaeb8-ee99-11ee-b647-cb9ed24678a4. 2024-03-30T14:00:38.607 INFO:journalctl@ceph.prometheus.a.smithi181.stdout:Mar 30 14:00:38 smithi181 systemd[1]: ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4@prometheus.a.service: Consumed 1.586s CPU time. 2024-03-30T14:00:38.875 INFO:journalctl@ceph.prometheus.a.smithi181.stdout:Mar 30 14:00:38 smithi181 systemd[1]: Starting Ceph prometheus.a for 98ebaeb8-ee99-11ee-b647-cb9ed24678a4... 2024-03-30T14:00:38.875 INFO:journalctl@ceph.prometheus.a.smithi181.stdout:Mar 30 14:00:38 smithi181 podman[100528]: 2024-03-30 14:00:38.728636218 +0000 UTC m=+0.018696554 image pull a07b618ecd1dce142bce4c52f0e80982eaf1f14265a2415c2d35978ccaa0a464 quay.io/prometheus/prometheus:v2.43.0 2024-03-30T14:00:38.875 INFO:journalctl@ceph.prometheus.a.smithi181.stdout:Mar 30 14:00:38 smithi181 podman[100528]: 2024-03-30 14:00:38.849643005 +0000 UTC m=+0.139703327 container create 004088bdf70e4654d32fd5585813a3078d1569b70bb8a062b5cc11f440a5fff4 (image=quay.io/prometheus/prometheus:v2.43.0, name=ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-prometheus-a, maintainer=The Prometheus Authors ) 2024-03-30T14:00:39.129 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:38 smithi181 ceph-mon[25762]: pgmap v1179: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-03-30T14:00:39.129 INFO:journalctl@ceph.prometheus.a.smithi181.stdout:Mar 30 14:00:39 smithi181 podman[100528]: 2024-03-30 14:00:39.102000788 +0000 UTC m=+0.392061109 container init 004088bdf70e4654d32fd5585813a3078d1569b70bb8a062b5cc11f440a5fff4 (image=quay.io/prometheus/prometheus:v2.43.0, name=ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-prometheus-a, maintainer=The Prometheus Authors ) 2024-03-30T14:00:39.130 INFO:journalctl@ceph.prometheus.a.smithi181.stdout:Mar 30 14:00:39 smithi181 podman[100528]: 2024-03-30 14:00:39.10451913 +0000 UTC m=+0.394579452 container start 004088bdf70e4654d32fd5585813a3078d1569b70bb8a062b5cc11f440a5fff4 (image=quay.io/prometheus/prometheus:v2.43.0, name=ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-prometheus-a, maintainer=The Prometheus Authors ) 2024-03-30T14:00:39.130 INFO:journalctl@ceph.prometheus.a.smithi181.stdout:Mar 30 14:00:39 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-prometheus-a[100542]: ts=2024-03-30T14:00:39.128Z caller=main.go:564 level=info msg="Starting Prometheus Server" mode=server version="(version=2.43.0, branch=HEAD, revision=edfc3bcd025dd6fe296c167a14a216cab1e552ee)" 2024-03-30T14:00:39.130 INFO:journalctl@ceph.prometheus.a.smithi181.stdout:Mar 30 14:00:39 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-prometheus-a[100542]: ts=2024-03-30T14:00:39.128Z caller=main.go:569 level=info build_context="(go=go1.19.7, platform=linux/amd64, user=root@8a0ee342e522, date=20230321-12:56:07, tags=netgo,builtinassets)" 2024-03-30T14:00:39.130 INFO:journalctl@ceph.prometheus.a.smithi181.stdout:Mar 30 14:00:39 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-prometheus-a[100542]: ts=2024-03-30T14:00:39.128Z caller=main.go:570 level=info host_details="(Linux 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 x86_64 smithi181 (none))" 2024-03-30T14:00:39.130 INFO:journalctl@ceph.prometheus.a.smithi181.stdout:Mar 30 14:00:39 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-prometheus-a[100542]: ts=2024-03-30T14:00:39.128Z caller=main.go:571 level=info fd_limits="(soft=1048576, hard=1048576)" 2024-03-30T14:00:39.130 INFO:journalctl@ceph.prometheus.a.smithi181.stdout:Mar 30 14:00:39 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-prometheus-a[100542]: ts=2024-03-30T14:00:39.128Z caller=main.go:572 level=info vm_limits="(soft=unlimited, hard=unlimited)" 2024-03-30T14:00:39.130 INFO:journalctl@ceph.prometheus.a.smithi181.stdout:Mar 30 14:00:39 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-prometheus-a[100542]: ts=2024-03-30T14:00:39.130Z caller=web.go:561 level=info component=web msg="Start listening for connections" address=:9095 2024-03-30T14:00:39.130 INFO:journalctl@ceph.prometheus.a.smithi181.stdout:Mar 30 14:00:39 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-prometheus-a[100542]: ts=2024-03-30T14:00:39.130Z caller=main.go:1005 level=info msg="Starting TSDB ..." 2024-03-30T14:00:39.130 INFO:journalctl@ceph.prometheus.a.smithi181.stdout:Mar 30 14:00:39 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-prometheus-a[100542]: ts=2024-03-30T14:00:39.131Z caller=tls_config.go:232 level=info component=web msg="Listening on" address=[::]:9095 2024-03-30T14:00:39.130 INFO:journalctl@ceph.prometheus.a.smithi181.stdout:Mar 30 14:00:39 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-prometheus-a[100542]: ts=2024-03-30T14:00:39.131Z caller=tls_config.go:235 level=info component=web msg="TLS is disabled." http2=false address=[::]:9095 2024-03-30T14:00:39.130 INFO:journalctl@ceph.prometheus.a.smithi181.stdout:Mar 30 14:00:39 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-prometheus-a[100542]: ts=2024-03-30T14:00:39.134Z caller=head.go:587 level=info component=tsdb msg="Replaying on-disk memory mappable chunks if any" 2024-03-30T14:00:39.330 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:38 smithi099 ceph-mon[24912]: pgmap v1179: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-03-30T14:00:39.331 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:38 smithi099 ceph-mon[29691]: pgmap v1179: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-03-30T14:00:39.500 INFO:journalctl@ceph.prometheus.a.smithi181.stdout:Mar 30 14:00:39 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-prometheus-a[100542]: ts=2024-03-30T14:00:39.134Z caller=head.go:658 level=info component=tsdb msg="On-disk memory mappable chunks replay completed" duration=897.336µs 2024-03-30T14:00:39.500 INFO:journalctl@ceph.prometheus.a.smithi181.stdout:Mar 30 14:00:39 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-prometheus-a[100542]: ts=2024-03-30T14:00:39.134Z caller=head.go:664 level=info component=tsdb msg="Replaying WAL, this may take a while" 2024-03-30T14:00:39.500 INFO:journalctl@ceph.prometheus.a.smithi181.stdout:Mar 30 14:00:39 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-prometheus-a[100542]: ts=2024-03-30T14:00:39.139Z caller=head.go:735 level=info component=tsdb msg="WAL segment loaded" segment=0 maxSegment=7 2024-03-30T14:00:39.500 INFO:journalctl@ceph.prometheus.a.smithi181.stdout:Mar 30 14:00:39 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-prometheus-a[100542]: ts=2024-03-30T14:00:39.146Z caller=head.go:735 level=info component=tsdb msg="WAL segment loaded" segment=1 maxSegment=7 2024-03-30T14:00:39.500 INFO:journalctl@ceph.prometheus.a.smithi181.stdout:Mar 30 14:00:39 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-prometheus-a[100542]: ts=2024-03-30T14:00:39.156Z caller=head.go:735 level=info component=tsdb msg="WAL segment loaded" segment=2 maxSegment=7 2024-03-30T14:00:39.500 INFO:journalctl@ceph.prometheus.a.smithi181.stdout:Mar 30 14:00:39 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-prometheus-a[100542]: ts=2024-03-30T14:00:39.163Z caller=head.go:735 level=info component=tsdb msg="WAL segment loaded" segment=3 maxSegment=7 2024-03-30T14:00:39.500 INFO:journalctl@ceph.prometheus.a.smithi181.stdout:Mar 30 14:00:39 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-prometheus-a[100542]: ts=2024-03-30T14:00:39.166Z caller=head.go:735 level=info component=tsdb msg="WAL segment loaded" segment=4 maxSegment=7 2024-03-30T14:00:39.500 INFO:journalctl@ceph.prometheus.a.smithi181.stdout:Mar 30 14:00:39 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-prometheus-a[100542]: ts=2024-03-30T14:00:39.167Z caller=head.go:735 level=info component=tsdb msg="WAL segment loaded" segment=5 maxSegment=7 2024-03-30T14:00:39.501 INFO:journalctl@ceph.prometheus.a.smithi181.stdout:Mar 30 14:00:39 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-prometheus-a[100542]: ts=2024-03-30T14:00:39.169Z caller=head.go:735 level=info component=tsdb msg="WAL segment loaded" segment=6 maxSegment=7 2024-03-30T14:00:39.501 INFO:journalctl@ceph.prometheus.a.smithi181.stdout:Mar 30 14:00:39 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-prometheus-a[100542]: ts=2024-03-30T14:00:39.170Z caller=head.go:735 level=info component=tsdb msg="WAL segment loaded" segment=7 maxSegment=7 2024-03-30T14:00:39.501 INFO:journalctl@ceph.prometheus.a.smithi181.stdout:Mar 30 14:00:39 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-prometheus-a[100542]: ts=2024-03-30T14:00:39.170Z caller=head.go:772 level=info component=tsdb msg="WAL replay completed" checkpoint_replay_duration=35.089µs wal_replay_duration=35.243205ms wbl_replay_duration=557ns total_replay_duration=36.202888ms 2024-03-30T14:00:39.501 INFO:journalctl@ceph.prometheus.a.smithi181.stdout:Mar 30 14:00:39 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-prometheus-a[100542]: ts=2024-03-30T14:00:39.173Z caller=main.go:1026 level=info fs_type=XFS_SUPER_MAGIC 2024-03-30T14:00:39.501 INFO:journalctl@ceph.prometheus.a.smithi181.stdout:Mar 30 14:00:39 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-prometheus-a[100542]: ts=2024-03-30T14:00:39.173Z caller=main.go:1029 level=info msg="TSDB started" 2024-03-30T14:00:39.501 INFO:journalctl@ceph.prometheus.a.smithi181.stdout:Mar 30 14:00:39 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-prometheus-a[100542]: ts=2024-03-30T14:00:39.173Z caller=main.go:1209 level=info msg="Loading configuration file" filename=/etc/prometheus/prometheus.yml 2024-03-30T14:00:39.501 INFO:journalctl@ceph.prometheus.a.smithi181.stdout:Mar 30 14:00:39 smithi181 bash[100528]: 004088bdf70e4654d32fd5585813a3078d1569b70bb8a062b5cc11f440a5fff4 2024-03-30T14:00:39.501 INFO:journalctl@ceph.prometheus.a.smithi181.stdout:Mar 30 14:00:39 smithi181 systemd[1]: Started Ceph prometheus.a for 98ebaeb8-ee99-11ee-b647-cb9ed24678a4. 2024-03-30T14:00:39.501 INFO:journalctl@ceph.prometheus.a.smithi181.stdout:Mar 30 14:00:39 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-prometheus-a[100542]: ts=2024-03-30T14:00:39.191Z caller=main.go:1246 level=info msg="Completed loading of configuration file" filename=/etc/prometheus/prometheus.yml totalDuration=18.49991ms db_storage=1.143µs remote_storage=1.149µs web_handler=401ns query_engine=635ns scrape=480.606µs scrape_sd=101.873µs notify=9.884µs notify_sd=12.634µs rules=17.646895ms tracing=6.74µs 2024-03-30T14:00:39.501 INFO:journalctl@ceph.prometheus.a.smithi181.stdout:Mar 30 14:00:39 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-prometheus-a[100542]: ts=2024-03-30T14:00:39.191Z caller=main.go:990 level=info msg="Server is ready to receive web requests." 2024-03-30T14:00:39.501 INFO:journalctl@ceph.prometheus.a.smithi181.stdout:Mar 30 14:00:39 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-prometheus-a[100542]: ts=2024-03-30T14:00:39.191Z caller=manager.go:974 level=info component="rule manager" msg="Starting rule manager..." 2024-03-30T14:00:40.500 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:40 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:40.500 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:40 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:40.500 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:40 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:40.500 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:40 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:40.500 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:40 smithi181 ceph-mon[25762]: pgmap v1180: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T14:00:40.501 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:40 smithi181 ceph-mon[25762]: pgmap v1181: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-03-30T14:00:40.501 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:40 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:40.501 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:40 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:40.501 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:40 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-03-30T14:00:40.501 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:40 smithi181 ceph-mon[25762]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-03-30T14:00:40.501 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:40 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:40.501 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:40 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:40.501 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:40 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:40.501 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:40 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:40.501 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:40 smithi181 ceph-mon[25762]: pgmap v1182: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T14:00:40.501 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:40 smithi181 ceph-mon[25762]: pgmap v1183: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 848 B/s rd, 0 op/s 2024-03-30T14:00:40.501 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:40 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:40.501 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:40 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:40.501 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:40 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:40.502 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:40 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:40.502 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:40 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:40.502 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:40 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:40.502 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:40 smithi181 ceph-mon[25762]: pgmap v1184: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T14:00:40.502 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:40 smithi181 ceph-mon[25762]: pgmap v1185: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:40.502 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:40 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:40.502 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:40 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:40.502 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:40 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:40.502 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:40 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:40.502 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:40 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:40.502 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:40 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:40.502 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:40 smithi181 ceph-mon[25762]: pgmap v1186: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:40.502 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:40 smithi181 ceph-mon[25762]: pgmap v1187: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:40.502 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:40 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:40.503 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:40 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:40.503 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:40 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:40.503 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:40 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:40.503 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:40 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:40.503 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:40 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:40.503 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:40 smithi181 ceph-mon[25762]: pgmap v1188: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:40.503 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:40 smithi181 ceph-mon[25762]: pgmap v1189: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:40.503 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:40 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:40.503 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:40 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:40.503 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:40 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:40.503 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:40 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:40.503 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:40 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:40.503 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:40 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:40.504 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:40 smithi181 ceph-mon[25762]: pgmap v1190: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:40.504 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:40 smithi181 ceph-mon[25762]: pgmap v1191: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:40.504 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:40 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:40.504 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:40 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:40.504 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:40 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:40.504 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:40 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:40.504 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:40 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:40.504 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:40 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:40.504 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:40 smithi181 ceph-mon[25762]: pgmap v1192: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:40.504 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:40 smithi181 ceph-mon[25762]: pgmap v1193: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:40.504 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:40 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:40.504 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:40 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:40.504 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:40 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:40.504 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:40 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:40.505 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:40 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:40.505 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:40 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:40.505 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:40 smithi181 ceph-mon[25762]: pgmap v1194: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:40.505 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:40 smithi181 ceph-mon[25762]: pgmap v1195: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:40.505 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:40 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:40.505 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:40 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:40.505 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:40 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:40.505 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:40 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:40.505 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:40 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:40.505 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:40 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:40.505 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:40 smithi181 ceph-mon[25762]: pgmap v1196: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:40.505 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:40 smithi181 ceph-mon[25762]: pgmap v1197: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:40.505 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:40 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:40.505 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:40 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:40.506 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:40 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:40.506 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:40 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:40.506 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:40 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:40.506 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:40 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:40.506 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:40 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:40.506 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:40 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:40.506 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:40 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:40.506 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:40 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:40.506 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:40 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:40.506 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:40 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:40.506 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:40 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:40.506 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:40 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:40.506 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:40 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:40.506 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:40 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:40.581 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:40 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:40.581 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:40 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:40.581 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:40 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:40.581 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:40 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:40.581 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:40 smithi099 ceph-mon[24912]: pgmap v1180: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T14:00:40.581 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:40 smithi099 ceph-mon[24912]: pgmap v1181: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-03-30T14:00:40.581 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:40 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:40.581 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:40 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:40.581 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:40 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-03-30T14:00:40.582 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:40 smithi099 ceph-mon[24912]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-03-30T14:00:40.582 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:40 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:40.582 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:40 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:40.582 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:40 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:40.582 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:40 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:40.582 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:40 smithi099 ceph-mon[24912]: pgmap v1182: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T14:00:40.582 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:40 smithi099 ceph-mon[24912]: pgmap v1183: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 848 B/s rd, 0 op/s 2024-03-30T14:00:40.582 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:40 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:40.582 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:40 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:40.582 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:40 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:40.582 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:40 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:40.582 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:40 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:40.582 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:40 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:40.582 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:40 smithi099 ceph-mon[24912]: pgmap v1184: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T14:00:40.583 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:40 smithi099 ceph-mon[24912]: pgmap v1185: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:40.583 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:40 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:40.583 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:40 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:40.583 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:40 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:40.583 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:40 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:40.583 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:40 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:40.583 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:40 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:40.583 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:40 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:40.583 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:40 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:40.584 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:40 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:40.584 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:40 smithi099 ceph-mon[29691]: pgmap v1180: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T14:00:40.584 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:40 smithi099 ceph-mon[29691]: pgmap v1181: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-03-30T14:00:40.584 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:40 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:40.584 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:40 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:40.584 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:40 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-03-30T14:00:40.584 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:40 smithi099 ceph-mon[29691]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-03-30T14:00:40.584 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:40 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:40.584 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:40 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:40.584 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:40 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:40.584 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:40 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:40.584 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:40 smithi099 ceph-mon[29691]: pgmap v1182: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T14:00:40.584 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:40 smithi099 ceph-mon[29691]: pgmap v1183: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 848 B/s rd, 0 op/s 2024-03-30T14:00:40.584 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:40 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:40.584 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:40 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:40.585 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:40 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:40.585 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:40 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:40.585 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:40 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:40.585 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:40 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:40.585 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:40 smithi099 ceph-mon[29691]: pgmap v1184: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T14:00:40.585 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:40 smithi099 ceph-mon[29691]: pgmap v1185: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:40.585 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:40 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:40.585 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:40 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:40.585 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:40 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:40.585 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:40 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:40.585 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:40 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:40.586 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:40 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:40.586 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:40 smithi099 ceph-mon[24912]: pgmap v1186: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:40.586 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:40 smithi099 ceph-mon[24912]: pgmap v1187: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:40.586 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:40 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:40.586 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:40 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:40.586 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:40 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:40.586 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:40 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:40.586 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:40 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:40.586 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:40 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:40.586 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:40 smithi099 ceph-mon[24912]: pgmap v1188: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:40.586 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:40 smithi099 ceph-mon[24912]: pgmap v1189: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:40.586 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:40 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:40.586 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:40 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:40.587 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:40 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:40.587 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:40 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:40.587 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:40 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:40.587 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:40 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:40.587 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:40 smithi099 ceph-mon[24912]: pgmap v1190: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:40.587 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:40 smithi099 ceph-mon[24912]: pgmap v1191: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:40.587 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:40 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:40.587 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:40 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:40.587 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:40 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:40.587 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:40 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:40.587 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:40 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:40.587 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:40 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:40.587 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:40 smithi099 ceph-mon[24912]: pgmap v1192: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:40.587 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:40 smithi099 ceph-mon[24912]: pgmap v1193: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:40.587 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:40 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:40.588 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:40 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:40.588 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:40 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:40.588 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:40 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:40.588 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:40 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:40.588 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:40 smithi099 ceph-mon[29691]: pgmap v1186: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:40.588 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:40 smithi099 ceph-mon[29691]: pgmap v1187: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:40.588 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:40 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:40.588 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:40 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:40.588 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:40 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:40.588 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:40 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:40.588 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:40 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:40.588 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:40 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:40.589 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:40 smithi099 ceph-mon[29691]: pgmap v1188: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:40.589 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:40 smithi099 ceph-mon[29691]: pgmap v1189: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:40.589 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:40 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:40.589 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:40 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:40.589 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:40 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:40.589 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:40 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:40.589 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:40 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:40.589 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:40 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:40.589 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:40 smithi099 ceph-mon[29691]: pgmap v1190: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:40.589 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:40 smithi099 ceph-mon[29691]: pgmap v1191: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:40.589 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:40 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:40.589 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:40 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:40.589 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:40 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:40.589 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:40 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:40.589 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:40 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:40.590 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:40 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:40.590 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:40 smithi099 ceph-mon[29691]: pgmap v1192: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:40.590 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:40 smithi099 ceph-mon[29691]: pgmap v1193: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:40.590 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:40 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:40.590 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:40 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:40.590 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:40 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:40.590 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:40 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:40.590 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:40 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:40.590 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:40 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:40.590 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:40 smithi099 ceph-mon[24912]: pgmap v1194: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:40.590 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:40 smithi099 ceph-mon[24912]: pgmap v1195: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:40.591 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:40 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:40.591 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:40 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:40.591 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:40 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:40.591 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:40 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:40.591 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:40 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:40.591 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:40 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:40.591 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:40 smithi099 ceph-mon[24912]: pgmap v1196: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:40.591 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:40 smithi099 ceph-mon[24912]: pgmap v1197: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:40.591 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:40 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:40.591 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:40 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:40.591 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:40 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:40.591 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:40 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:40.591 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:40 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:40.591 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:40 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:40.592 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:40 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:40.592 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:40 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:40.592 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:40 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:40.592 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:40 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:40.592 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:40 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:40.592 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:40 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:40.592 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:40 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:40.592 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:40 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:40.592 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:40 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:40.592 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:40 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:40.592 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:40 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:40.592 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:40 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:40.593 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:40 smithi099 ceph-mon[29691]: pgmap v1194: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:40.593 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:40 smithi099 ceph-mon[29691]: pgmap v1195: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:40.593 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:40 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:40.593 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:40 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:40.593 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:40 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:40.593 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:40 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:40.593 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:40 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:40.593 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:40 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:40.593 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:40 smithi099 ceph-mon[29691]: pgmap v1196: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:40.593 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:40 smithi099 ceph-mon[29691]: pgmap v1197: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:40.593 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:40 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:40.593 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:40 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:40.593 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:40 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:40.593 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:40 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:40.593 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:40 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:40.594 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:40 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:40.594 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:40 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:40.594 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:40 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:40.594 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:40 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:40.594 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:40 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:40.594 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:40 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:40.594 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:40 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:40.594 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:40 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:40.594 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:40 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:40.594 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:40 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:40.594 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:40 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:41.351 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:41 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:41.351 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:41 smithi099 ceph-mon[29691]: pgmap v1198: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:41.351 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:41 smithi099 ceph-mon[29691]: pgmap v1199: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:41.351 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:41 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:41.351 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:41 smithi099 ceph-mon[29691]: pgmap v1200: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:41.351 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:41 smithi099 ceph-mon[29691]: pgmap v1201: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:41.351 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:41 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:41.351 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:41 smithi099 ceph-mon[29691]: pgmap v1202: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:41.351 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:41 smithi099 ceph-mon[29691]: pgmap v1203: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:41.351 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:41 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:41.352 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:41 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:41.352 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:41 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:41.352 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:41 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:41.352 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:41 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:41.352 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:41 smithi099 ceph-mon[29691]: pgmap v1204: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:41.352 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:41 smithi099 ceph-mon[29691]: pgmap v1205: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:41.352 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:41 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:41.352 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:41 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:41.352 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:41 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:41.352 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:41 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:41.352 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:41 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:41.352 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:41 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:41.352 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:41 smithi099 ceph-mon[29691]: pgmap v1206: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:41.352 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:41 smithi099 ceph-mon[29691]: pgmap v1207: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:41.352 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:41 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:41.353 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:41 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:41.353 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:41 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:41.353 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:41 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:41.353 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:41 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:41.353 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:41 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:41.353 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:41 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:41.353 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:41 smithi099 ceph-mon[24912]: pgmap v1198: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:41.353 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:41 smithi099 ceph-mon[24912]: pgmap v1199: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:41.353 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:41 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:41.353 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:41 smithi099 ceph-mon[24912]: pgmap v1200: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:41.354 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:41 smithi099 ceph-mon[24912]: pgmap v1201: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:41.354 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:41 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:41.354 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:41 smithi099 ceph-mon[24912]: pgmap v1202: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:41.354 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:41 smithi099 ceph-mon[24912]: pgmap v1203: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:41.354 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:41 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:41.354 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:41 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:41.354 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:41 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:41.354 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:41 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:41.354 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:41 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:41.354 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:41 smithi099 ceph-mon[24912]: pgmap v1204: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:41.354 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:41 smithi099 ceph-mon[24912]: pgmap v1205: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:41.354 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:41 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:41.354 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:41 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:41.354 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:41 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:41.355 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:41 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:41.355 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:41 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:41.355 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:41 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:41.355 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:41 smithi099 ceph-mon[24912]: pgmap v1206: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:41.355 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:41 smithi099 ceph-mon[24912]: pgmap v1207: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:41.355 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:41 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:41.355 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:41 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:41.355 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:41 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:41.355 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:41 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:41.355 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:41 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:41.355 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:41 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:41.356 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:41 smithi099 ceph-mon[29691]: pgmap v1208: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:41.356 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:41 smithi099 ceph-mon[29691]: pgmap v1209: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:41.356 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:41 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:41.356 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:41 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:41.356 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:41 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:41.356 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:41 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:41.356 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:41 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:41.356 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:41 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:41.356 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:41 smithi099 ceph-mon[29691]: pgmap v1210: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:41.356 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:41 smithi099 ceph-mon[29691]: pgmap v1211: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:41.356 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:41 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:41.356 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:41 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:41.356 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:41 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:41.356 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:41 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:41.357 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:41 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:41.357 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:41 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:41.357 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:41 smithi099 ceph-mon[29691]: pgmap v1212: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:41.357 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:41 smithi099 ceph-mon[29691]: pgmap v1213: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:41.357 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:41 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:41.357 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:41 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:41.357 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:41 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:41.357 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:41 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:41.357 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:41 smithi099 ceph-mon[29691]: pgmap v1214: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:41.358 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:41 smithi099 ceph-mon[29691]: pgmap v1215: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:41.358 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:41 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:41.358 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:41 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:41.358 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:41 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:41.358 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:41 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:41.358 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:41 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:41.358 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:41 smithi099 ceph-mon[29691]: pgmap v1216: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:41.358 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:41 smithi099 ceph-mon[29691]: pgmap v1217: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:41.358 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:41 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:41.358 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:41 smithi099 ceph-mon[24912]: pgmap v1208: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:41.358 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:41 smithi099 ceph-mon[24912]: pgmap v1209: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:41.359 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:41 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:41.359 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:41 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:41.359 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:41 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:41.359 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:41 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:41.359 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:41 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:41.359 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:41 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:41.359 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:41 smithi099 ceph-mon[24912]: pgmap v1210: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:41.359 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:41 smithi099 ceph-mon[24912]: pgmap v1211: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:41.359 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:41 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:41.359 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:41 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:41.359 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:41 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:41.359 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:41 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:41.359 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:41 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:41.359 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:41 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:41.360 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:41 smithi099 ceph-mon[24912]: pgmap v1212: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:41.360 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:41 smithi099 ceph-mon[24912]: pgmap v1213: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:41.360 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:41 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:41.360 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:41 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:41.360 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:41 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:41.360 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:41 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:41.360 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:41 smithi099 ceph-mon[24912]: pgmap v1214: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:41.360 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:41 smithi099 ceph-mon[24912]: pgmap v1215: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:41.360 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:41 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:41.360 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:41 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:41.360 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:41 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:41.360 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:41 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:41.360 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:41 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:41.360 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:41 smithi099 ceph-mon[24912]: pgmap v1216: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:41.360 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:41 smithi099 ceph-mon[24912]: pgmap v1217: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:41.361 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:41 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:41.361 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:41 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:41.361 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:41 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:41.361 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:41 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:41.361 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:41 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:41.361 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:41 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:41.361 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:41 smithi099 ceph-mon[29691]: pgmap v1218: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:41.361 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:41 smithi099 ceph-mon[29691]: pgmap v1219: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:41.361 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:41 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:41.361 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:41 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:41.361 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:41 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:41.362 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:41 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:41.362 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:41 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:41.362 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:41 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:41.362 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:41 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:41.362 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:41 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:41.362 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:41 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:41.362 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:41 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:41.362 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:41 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:41.362 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:41 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:41.362 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:41 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:41.362 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:41 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:41.362 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:41 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:41.363 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:41 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:41.363 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:41 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:41.363 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:41 smithi099 ceph-mon[24912]: pgmap v1218: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:41.363 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:41 smithi099 ceph-mon[24912]: pgmap v1219: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:41.363 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:41 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:41.363 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:41 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:41.363 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:41 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:41.363 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:41 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:41.363 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:41 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:41.363 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:41 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:41.363 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:41 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:41.363 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:41 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:41.363 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:41 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:41.363 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:41 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:41.363 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:41 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:41.364 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:41 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:41.500 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:41 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:41.500 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:41 smithi181 ceph-mon[25762]: pgmap v1198: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:41.500 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:41 smithi181 ceph-mon[25762]: pgmap v1199: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:41.500 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:41 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:41.500 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:41 smithi181 ceph-mon[25762]: pgmap v1200: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:41.501 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:41 smithi181 ceph-mon[25762]: pgmap v1201: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:41.501 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:41 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:41.501 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:41 smithi181 ceph-mon[25762]: pgmap v1202: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:41.501 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:41 smithi181 ceph-mon[25762]: pgmap v1203: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:41.501 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:41 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:41.501 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:41 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:41.501 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:41 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:41.501 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:41 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:41.501 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:41 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:41.501 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:41 smithi181 ceph-mon[25762]: pgmap v1204: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:41.501 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:41 smithi181 ceph-mon[25762]: pgmap v1205: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:41.501 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:41 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:41.501 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:41 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:41.501 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:41 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:41.501 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:41 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:41.501 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:41 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:41.501 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:41 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:41.502 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:41 smithi181 ceph-mon[25762]: pgmap v1206: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:41.502 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:41 smithi181 ceph-mon[25762]: pgmap v1207: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:41.502 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:41 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:41.502 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:41 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:41.502 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:41 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:41.502 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:41 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:41.502 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:41 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:41.502 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:41 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:41.502 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:41 smithi181 ceph-mon[25762]: pgmap v1208: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:41.502 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:41 smithi181 ceph-mon[25762]: pgmap v1209: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:41.502 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:41 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:41.502 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:41 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:41.502 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:41 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:41.502 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:41 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:41.503 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:41 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:41.503 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:41 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:41.503 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:41 smithi181 ceph-mon[25762]: pgmap v1210: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:41.503 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:41 smithi181 ceph-mon[25762]: pgmap v1211: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:41.503 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:41 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:41.503 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:41 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:41.503 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:41 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:41.503 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:41 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:41.503 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:41 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:41.503 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:41 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:41.503 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:41 smithi181 ceph-mon[25762]: pgmap v1212: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:41.503 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:41 smithi181 ceph-mon[25762]: pgmap v1213: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:41.503 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:41 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:41.503 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:41 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:41.503 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:41 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:41.504 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:41 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:41.504 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:41 smithi181 ceph-mon[25762]: pgmap v1214: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:41.504 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:41 smithi181 ceph-mon[25762]: pgmap v1215: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:41.504 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:41 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:41.504 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:41 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:41.504 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:41 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:41.504 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:41 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:41.504 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:41 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:41.504 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:41 smithi181 ceph-mon[25762]: pgmap v1216: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:41.504 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:41 smithi181 ceph-mon[25762]: pgmap v1217: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:41.504 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:41 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:41.504 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:41 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:41.504 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:41 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:41.504 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:41 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:41.504 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:41 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:41.504 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:41 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:41.505 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:41 smithi181 ceph-mon[25762]: pgmap v1218: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:41.505 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:41 smithi181 ceph-mon[25762]: pgmap v1219: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:41.505 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:41 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:41.505 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:41 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:41.505 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:41 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:41.505 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:41 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:41.505 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:41 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:41.505 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:41 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:41.505 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:41 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:41.505 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:41 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:41.505 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:41 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:41.505 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:41 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:41.505 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:41 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:41.505 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:41 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:42.299 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:42 smithi099 ceph-mon[24912]: pgmap v1220: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:42.299 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:42 smithi099 ceph-mon[24912]: pgmap v1221: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:42.299 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:42 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:42.299 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:42 smithi099 ceph-mon[24912]: pgmap v1222: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:42.299 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:42 smithi099 ceph-mon[24912]: pgmap v1223: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:42.300 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:42 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:42.300 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:42 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:42.300 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:42 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:42.300 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:42 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:42.300 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:42 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:42.300 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:42 smithi099 ceph-mon[24912]: pgmap v1224: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:42.300 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:42 smithi099 ceph-mon[24912]: pgmap v1225: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:42.300 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:42 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:42.300 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:42 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:42.300 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:42 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:42.300 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:42 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:42.300 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:42 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:42.300 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:42 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:42.300 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:42 smithi099 ceph-mon[24912]: pgmap v1226: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:42.300 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:42 smithi099 ceph-mon[24912]: pgmap v1227: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:42.301 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:42 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:42.301 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:42 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:42.301 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:42 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:42.301 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:42 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:42.301 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:42 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:42.301 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:42 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:42.301 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:42 smithi099 ceph-mon[24912]: pgmap v1228: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:42.301 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:42 smithi099 ceph-mon[24912]: pgmap v1229: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:42.301 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:42 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:42.301 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:42 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:42.301 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:42 smithi099 ceph-mon[29691]: pgmap v1220: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:42.302 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:42 smithi099 ceph-mon[29691]: pgmap v1221: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:42.302 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:42 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:42.302 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:42 smithi099 ceph-mon[29691]: pgmap v1222: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:42.302 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:42 smithi099 ceph-mon[29691]: pgmap v1223: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:42.302 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:42 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:42.302 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:42 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:42.302 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:42 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:42.302 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:42 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:42.302 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:42 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:42.302 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:42 smithi099 ceph-mon[29691]: pgmap v1224: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:42.302 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:42 smithi099 ceph-mon[29691]: pgmap v1225: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:42.302 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:42 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:42.302 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:42 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:42.302 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:42 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:42.302 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:42 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:42.303 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:42 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:42.303 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:42 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:42.303 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:42 smithi099 ceph-mon[29691]: pgmap v1226: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:42.303 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:42 smithi099 ceph-mon[29691]: pgmap v1227: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:42.303 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:42 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:42.303 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:42 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:42.303 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:42 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:42.303 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:42 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:42.303 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:42 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:42.303 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:42 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:42.303 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:42 smithi099 ceph-mon[29691]: pgmap v1228: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:42.303 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:42 smithi099 ceph-mon[29691]: pgmap v1229: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:42.303 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:42 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:42.303 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:42 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:42.304 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:42 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:42.304 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:42 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:42.304 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:42 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:42.304 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:42 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:42.304 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:42 smithi099 ceph-mon[24912]: pgmap v1230: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 12 KiB/s rd, 11 op/s 2024-03-30T14:00:42.304 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:42 smithi099 ceph-mon[24912]: pgmap v1231: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 12 KiB/s rd, 11 op/s 2024-03-30T14:00:42.304 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:42 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:42.304 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:42 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:42.304 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:42 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:42.304 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:42 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:42.304 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:42 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:42.304 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:42 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:42.305 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:42 smithi099 ceph-mon[24912]: pgmap v1232: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 13 KiB/s rd, 13 op/s 2024-03-30T14:00:42.305 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:42 smithi099 ceph-mon[24912]: pgmap v1233: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 13 KiB/s rd, 13 op/s 2024-03-30T14:00:42.305 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:42 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:42.305 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:42 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:42.305 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:42 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:42.305 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:42 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:42.305 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:42 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:42.305 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:42 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:42.305 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:42 smithi099 ceph-mon[24912]: pgmap v1234: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 13 KiB/s rd, 13 op/s 2024-03-30T14:00:42.305 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:42 smithi099 ceph-mon[24912]: pgmap v1235: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 13 KiB/s rd, 13 op/s 2024-03-30T14:00:42.305 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:42 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:42.305 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:42 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:42.305 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:42 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:42.305 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:42 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:42.305 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:42 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:42.305 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:42 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:42.306 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:42 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:42.306 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:42 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:42.306 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:42 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:42.306 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:42 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:42.306 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:42 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:42.306 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:42 smithi099 ceph-mon[29691]: pgmap v1230: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 12 KiB/s rd, 11 op/s 2024-03-30T14:00:42.306 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:42 smithi099 ceph-mon[29691]: pgmap v1231: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 12 KiB/s rd, 11 op/s 2024-03-30T14:00:42.306 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:42 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:42.306 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:42 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:42.306 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:42 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:42.306 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:42 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:42.307 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:42 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:42.307 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:42 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:42.307 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:42 smithi099 ceph-mon[29691]: pgmap v1232: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 13 KiB/s rd, 13 op/s 2024-03-30T14:00:42.307 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:42 smithi099 ceph-mon[29691]: pgmap v1233: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 13 KiB/s rd, 13 op/s 2024-03-30T14:00:42.307 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:42 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:42.307 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:42 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:42.307 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:42 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:42.307 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:42 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:42.307 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:42 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:42.307 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:42 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:42.307 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:42 smithi099 ceph-mon[29691]: pgmap v1234: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 13 KiB/s rd, 13 op/s 2024-03-30T14:00:42.307 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:42 smithi099 ceph-mon[29691]: pgmap v1235: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 13 KiB/s rd, 13 op/s 2024-03-30T14:00:42.307 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:42 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:42.307 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:42 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:42.307 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:42 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:42.308 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:42 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:42.308 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:42 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:42.308 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:42 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:42.308 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:42 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:42.308 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:42 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:42.308 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:42 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:42.308 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:42 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:42.308 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:42 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:42.308 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:42 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:42.308 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:42 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:42.308 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:42 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:42.308 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:42 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:42.716 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:42 smithi181 ceph-mon[25762]: pgmap v1220: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:42.717 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:42 smithi181 ceph-mon[25762]: pgmap v1221: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:42.717 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:42 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:42.717 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:42 smithi181 ceph-mon[25762]: pgmap v1222: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:42.717 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:42 smithi181 ceph-mon[25762]: pgmap v1223: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:42.717 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:42 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:42.717 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:42 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:42.717 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:42 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:42.717 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:42 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:42.717 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:42 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:42.717 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:42 smithi181 ceph-mon[25762]: pgmap v1224: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:42.717 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:42 smithi181 ceph-mon[25762]: pgmap v1225: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:42.717 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:42 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:42.718 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:42 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:42.718 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:42 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:42.718 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:42 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:42.718 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:42 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:42.718 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:42 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:42.718 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:42 smithi181 ceph-mon[25762]: pgmap v1226: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:42.718 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:42 smithi181 ceph-mon[25762]: pgmap v1227: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:42.718 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:42 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:42.718 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:42 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:42.718 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:42 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:42.718 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:42 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:42.718 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:42 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:42.718 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:42 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:42.719 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:42 smithi181 ceph-mon[25762]: pgmap v1228: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:42.719 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:42 smithi181 ceph-mon[25762]: pgmap v1229: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:42.719 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:42 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:42.719 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:42 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:42.719 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:42 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:42.719 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:42 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:42.719 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:42 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:42.720 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:42 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:42.720 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:42 smithi181 ceph-mon[25762]: pgmap v1230: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 12 KiB/s rd, 11 op/s 2024-03-30T14:00:42.720 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:42 smithi181 ceph-mon[25762]: pgmap v1231: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 12 KiB/s rd, 11 op/s 2024-03-30T14:00:42.720 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:42 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:42.721 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:42 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:42.721 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:42 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:42.721 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:42 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:42.721 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:42 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:42.721 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:42 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:42.721 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:42 smithi181 ceph-mon[25762]: pgmap v1232: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 13 KiB/s rd, 13 op/s 2024-03-30T14:00:42.721 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:42 smithi181 ceph-mon[25762]: pgmap v1233: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 13 KiB/s rd, 13 op/s 2024-03-30T14:00:42.721 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:42 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:42.722 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:42 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:42.722 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:42 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:42.722 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:42 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:42.722 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:42 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:42.722 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:42 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:42.722 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:42 smithi181 ceph-mon[25762]: pgmap v1234: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 13 KiB/s rd, 13 op/s 2024-03-30T14:00:42.722 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:42 smithi181 ceph-mon[25762]: pgmap v1235: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 13 KiB/s rd, 13 op/s 2024-03-30T14:00:42.722 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:42 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:42.722 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:42 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:42.722 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:42 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:42.722 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:42 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:42.722 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:42 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:42.722 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:42 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:42.722 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:42 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:42.723 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:42 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:42.723 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:42 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:42.723 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:42 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:42.723 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:42 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:43.330 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:43 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:43.331 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:43 smithi099 ceph-mon[29691]: pgmap v1236: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:43.331 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:43 smithi099 ceph-mon[29691]: pgmap v1237: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:43.331 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:43 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:43.331 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:43 smithi099 ceph-mon[29691]: pgmap v1238: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:43.331 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:43 smithi099 ceph-mon[29691]: pgmap v1239: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:43.331 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:43 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:43.331 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:43 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:43.331 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:43 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:43.331 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:43 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:43.331 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:43 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:43.331 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:43 smithi099 ceph-mon[29691]: pgmap v1240: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:43.332 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:43 smithi099 ceph-mon[29691]: pgmap v1241: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:43.332 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:43 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:43.332 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:43 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:43.332 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:43 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:43.332 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:43 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:43.332 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:43 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:43.332 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:43 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:43.332 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:43 smithi099 ceph-mon[29691]: pgmap v1242: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:43.332 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:43 smithi099 ceph-mon[29691]: pgmap v1243: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:43.332 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:43 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:43.332 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:43 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:43.332 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:43 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:43.333 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:43 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:43.333 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:43 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:43.333 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:43 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:43.333 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:43 smithi099 ceph-mon[29691]: pgmap v1244: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:43.333 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:43 smithi099 ceph-mon[29691]: pgmap v1245: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:43.333 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:43 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:43.333 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:43 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:43.333 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:43 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:43.333 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:43 smithi099 ceph-mon[24912]: pgmap v1236: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:43.334 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:43 smithi099 ceph-mon[24912]: pgmap v1237: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:43.334 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:43 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:43.334 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:43 smithi099 ceph-mon[24912]: pgmap v1238: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:43.334 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:43 smithi099 ceph-mon[24912]: pgmap v1239: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:43.334 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:43 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:43.334 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:43 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:43.334 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:43 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:43.334 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:43 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:43.334 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:43 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:43.334 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:43 smithi099 ceph-mon[24912]: pgmap v1240: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:43.334 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:43 smithi099 ceph-mon[24912]: pgmap v1241: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:43.334 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:43 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:43.335 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:43 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:43.335 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:43 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:43.335 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:43 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:43.335 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:43 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:43.335 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:43 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:43.335 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:43 smithi099 ceph-mon[24912]: pgmap v1242: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:43.335 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:43 smithi099 ceph-mon[24912]: pgmap v1243: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:43.335 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:43 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:43.335 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:43 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:43.335 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:43 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:43.335 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:43 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:43.335 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:43 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:43.335 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:43 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:43.336 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:43 smithi099 ceph-mon[24912]: pgmap v1244: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:43.336 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:43 smithi099 ceph-mon[24912]: pgmap v1245: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:43.336 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:43 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:43.336 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:43 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:43.336 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:43 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:43.336 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:43 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:43.336 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:43 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:43.337 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:43 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:43.337 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:43 smithi099 ceph-mon[29691]: pgmap v1246: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:43.337 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:43 smithi099 ceph-mon[29691]: pgmap v1247: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:43.337 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:43 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:43.337 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:43 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:43.337 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:43 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:43.337 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:43 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:43.337 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:43 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:43.337 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:43 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:43.337 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:43 smithi099 ceph-mon[29691]: pgmap v1248: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:43.337 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:43 smithi099 ceph-mon[29691]: pgmap v1249: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:43.337 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:43 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:43.338 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:43 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:43.338 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:43 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:43.338 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:43 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:43.338 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:43 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:43.338 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:43 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:43.338 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:43 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:43.338 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:43 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:43.338 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:43 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:43.338 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:43 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:43.338 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:43 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:43.338 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:43 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:43.338 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:43 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:43.338 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:43 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:43.339 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:43 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:43.339 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:43 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:43.339 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:43 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:43.339 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:43 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:43.339 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:43 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:43.339 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:43 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:43.339 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:43 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:43.339 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:43 smithi099 ceph-mon[24912]: pgmap v1246: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:43.339 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:43 smithi099 ceph-mon[24912]: pgmap v1247: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:43.340 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:43 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:43.340 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:43 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:43.340 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:43 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:43.340 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:43 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:43.340 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:43 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:43.340 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:43 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:43.340 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:43 smithi099 ceph-mon[24912]: pgmap v1248: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:43.340 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:43 smithi099 ceph-mon[24912]: pgmap v1249: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:43.340 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:43 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:43.340 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:43 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:43.340 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:43 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:43.340 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:43 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:43.340 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:43 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:43.341 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:43 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:43.341 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:43 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:43.341 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:43 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:43.341 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:43 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:43.341 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:43 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:43.341 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:43 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:43.341 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:43 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:43.341 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:43 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:43.341 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:43 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:43.341 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:43 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:43.341 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:43 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:43.341 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:43 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:43.522 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:43 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:43.522 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:43 smithi181 ceph-mon[25762]: pgmap v1236: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:43.522 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:43 smithi181 ceph-mon[25762]: pgmap v1237: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:43.522 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:43 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:43.522 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:43 smithi181 ceph-mon[25762]: pgmap v1238: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:43.522 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:43 smithi181 ceph-mon[25762]: pgmap v1239: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:43.523 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:43 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:43.523 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:43 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:43.523 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:43 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:43.523 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:43 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:43.523 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:43 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:43.523 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:43 smithi181 ceph-mon[25762]: pgmap v1240: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:43.523 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:43 smithi181 ceph-mon[25762]: pgmap v1241: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:43.523 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:43 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:43.523 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:43 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:43.523 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:43 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:43.523 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:43 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:43.523 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:43 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:43.523 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:43 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:43.523 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:43 smithi181 ceph-mon[25762]: pgmap v1242: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:43.524 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:43 smithi181 ceph-mon[25762]: pgmap v1243: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:43.524 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:43 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:43.524 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:43 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:43.524 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:43 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:43.524 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:43 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:43.524 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:43 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:43.524 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:43 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:43.524 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:43 smithi181 ceph-mon[25762]: pgmap v1244: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:43.524 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:43 smithi181 ceph-mon[25762]: pgmap v1245: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:43.524 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:43 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:43.524 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:43 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:43.524 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:43 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:43.524 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:43 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:43.524 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:43 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:43.525 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:43 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:43.525 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:43 smithi181 ceph-mon[25762]: pgmap v1246: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:43.525 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:43 smithi181 ceph-mon[25762]: pgmap v1247: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:43.525 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:43 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:43.525 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:43 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:43.525 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:43 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:43.525 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:43 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:43.525 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:43 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:43.525 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:43 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:43.525 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:43 smithi181 ceph-mon[25762]: pgmap v1248: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:43.525 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:43 smithi181 ceph-mon[25762]: pgmap v1249: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:43.525 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:43 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:43.525 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:43 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:43.526 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:43 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:43.526 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:43 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:43.526 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:43 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:43.526 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:43 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:43.526 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:43 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:43.526 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:43 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:43.526 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:43 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:43.526 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:43 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:43.526 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:43 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:43.526 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:43 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:43.526 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:43 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:43.526 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:43 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:43.526 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:43 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:43.526 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:43 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:43.527 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:43 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:44.411 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:44 smithi181 ceph-mon[25762]: pgmap v1250: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:44.411 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:44 smithi181 ceph-mon[25762]: pgmap v1251: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:44.411 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:44 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:44.411 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:44 smithi181 ceph-mon[25762]: pgmap v1252: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:44.411 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:44 smithi181 ceph-mon[25762]: pgmap v1253: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:44.411 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:44 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:44.412 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:44 smithi181 ceph-mon[25762]: pgmap v1254: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:44.412 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:44 smithi181 ceph-mon[25762]: pgmap v1255: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:44.412 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:44 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:44.412 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:44 smithi181 ceph-mon[25762]: from='client.25136 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T14:00:44.412 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:44 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:44.412 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:44 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:44.412 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:44 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:44.412 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:44 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:44.412 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:44 smithi181 ceph-mon[25762]: pgmap v1256: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:44.412 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:44 smithi181 ceph-mon[25762]: pgmap v1257: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:44.412 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:44 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:44.412 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:44 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:44.412 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:44 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:44.412 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:44 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:44.413 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:44 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:44.413 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:44 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:44.413 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:44 smithi181 ceph-mon[25762]: pgmap v1258: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:44.413 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:44 smithi181 ceph-mon[25762]: pgmap v1259: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:44.413 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:44 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:44.413 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:44 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:44.413 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:44 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:44.413 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:44 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:44.413 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:44 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:44.413 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:44 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:44.413 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:44 smithi181 ceph-mon[25762]: pgmap v1260: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:44.413 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:44 smithi181 ceph-mon[25762]: pgmap v1261: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:44.413 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:44 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:44.414 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:44 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:44.414 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:44 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:44.414 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:44 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:44.414 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:44 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:44.414 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:44 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:44.414 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:44 smithi181 ceph-mon[25762]: pgmap v1262: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:44.414 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:44 smithi181 ceph-mon[25762]: pgmap v1263: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:44.414 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:44 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:44.414 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:44 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:44.414 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:44 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:44.414 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:44 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:44.414 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:44 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:44.414 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:44 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:44.414 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:44 smithi181 ceph-mon[25762]: pgmap v1264: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:44.415 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:44 smithi181 ceph-mon[25762]: pgmap v1265: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:44.415 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:44 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:44.415 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:44 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:44.415 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:44 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:44.415 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:44 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:44.415 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:44 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:44.415 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:44 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:44.415 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:44 smithi181 ceph-mon[25762]: pgmap v1266: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:44.415 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:44 smithi181 ceph-mon[25762]: pgmap v1267: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:44.415 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:44 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:44.415 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:44 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:44.415 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:44 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:44.415 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:44 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:44.415 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:44 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:44.416 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:44 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:44.416 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:44 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:44.416 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:44 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:44.416 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:44 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:44.416 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:44 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:44.416 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:44 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:44.416 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:44 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:44.416 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:44 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:44.416 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:44 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:44.416 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:44 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:44.416 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:44 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:44.416 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:44 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:44.416 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:44 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:44.581 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:44 smithi099 ceph-mon[24912]: pgmap v1250: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:44.581 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:44 smithi099 ceph-mon[24912]: pgmap v1251: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:44.581 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:44 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:44.581 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:44 smithi099 ceph-mon[24912]: pgmap v1252: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:44.581 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:44 smithi099 ceph-mon[24912]: pgmap v1253: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:44.581 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:44 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:44.581 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:44 smithi099 ceph-mon[24912]: pgmap v1254: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:44.581 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:44 smithi099 ceph-mon[24912]: pgmap v1255: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:44.581 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:44 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:44.581 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:44 smithi099 ceph-mon[24912]: from='client.25136 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T14:00:44.582 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:44 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:44.582 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:44 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:44.582 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:44 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:44.582 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:44 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:44.582 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:44 smithi099 ceph-mon[24912]: pgmap v1256: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:44.582 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:44 smithi099 ceph-mon[24912]: pgmap v1257: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:44.582 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:44 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:44.582 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:44 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:44.582 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:44 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:44.582 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:44 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:44.582 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:44 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:44.582 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:44 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:44.582 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:44 smithi099 ceph-mon[24912]: pgmap v1258: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:44.583 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:44 smithi099 ceph-mon[24912]: pgmap v1259: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:44.583 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:44 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:44.583 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:44 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:44.583 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:44 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:44.583 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:44 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:44.583 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:44 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:44.583 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:44 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:44.583 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:44 smithi099 ceph-mon[29691]: pgmap v1250: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:44.583 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:44 smithi099 ceph-mon[29691]: pgmap v1251: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:44.583 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:44 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:44.583 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:44 smithi099 ceph-mon[29691]: pgmap v1252: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:44.583 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:44 smithi099 ceph-mon[29691]: pgmap v1253: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:44.583 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:44 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:44.584 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:44 smithi099 ceph-mon[29691]: pgmap v1254: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:44.584 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:44 smithi099 ceph-mon[29691]: pgmap v1255: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:44.584 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:44 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:44.584 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:44 smithi099 ceph-mon[29691]: from='client.25136 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T14:00:44.584 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:44 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:44.584 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:44 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:44.584 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:44 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:44.584 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:44 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:44.584 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:44 smithi099 ceph-mon[29691]: pgmap v1256: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:44.584 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:44 smithi099 ceph-mon[29691]: pgmap v1257: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:44.584 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:44 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:44.584 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:44 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:44.584 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:44 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:44.584 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:44 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:44.584 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:44 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:44.584 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:44 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:44.585 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:44 smithi099 ceph-mon[29691]: pgmap v1258: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:44.585 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:44 smithi099 ceph-mon[29691]: pgmap v1259: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:44.585 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:44 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:44.585 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:44 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:44.585 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:44 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:44.585 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:44 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:44.585 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:44 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:44.585 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:44 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:44.585 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:44 smithi099 ceph-mon[24912]: pgmap v1260: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:44.585 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:44 smithi099 ceph-mon[24912]: pgmap v1261: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:44.586 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:44 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:44.586 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:44 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:44.586 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:44 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:44.586 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:44 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:44.586 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:44 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:44.586 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:44 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:44.586 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:44 smithi099 ceph-mon[24912]: pgmap v1262: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:44.586 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:44 smithi099 ceph-mon[24912]: pgmap v1263: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:44.586 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:44 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:44.586 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:44 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:44.586 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:44 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:44.586 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:44 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:44.586 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:44 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:44.587 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:44 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:44.587 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:44 smithi099 ceph-mon[24912]: pgmap v1264: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:44.587 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:44 smithi099 ceph-mon[24912]: pgmap v1265: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:44.587 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:44 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:44.587 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:44 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:44.587 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:44 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:44.587 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:44 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:44.587 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:44 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:44.587 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:44 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:44.587 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:44 smithi099 ceph-mon[24912]: pgmap v1266: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:44.587 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:44 smithi099 ceph-mon[24912]: pgmap v1267: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:44.587 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:44 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:44.587 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:44 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:44.587 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:44 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:44.587 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:44 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:44.587 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:44 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:44.587 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:44 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:44.588 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:44 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:44.588 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:44 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:44.588 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:44 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:44.588 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:44 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:44.588 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:44 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:44.588 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:44 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:44.588 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:44 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:44.588 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:44 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:44.588 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:44 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:44.588 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:44 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:44.588 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:44 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:44.588 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:44 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:44.589 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:44 smithi099 ceph-mon[29691]: pgmap v1260: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:44.589 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:44 smithi099 ceph-mon[29691]: pgmap v1261: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:44.589 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:44 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:44.589 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:44 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:44.589 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:44 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:44.589 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:44 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:44.589 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:44 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:44.589 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:44 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:44.589 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:44 smithi099 ceph-mon[29691]: pgmap v1262: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:44.589 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:44 smithi099 ceph-mon[29691]: pgmap v1263: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:44.589 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:44 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:44.590 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:44 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:44.590 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:44 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:44.590 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:44 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:44.590 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:44 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:44.590 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:44 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:44.590 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:44 smithi099 ceph-mon[29691]: pgmap v1264: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:44.590 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:44 smithi099 ceph-mon[29691]: pgmap v1265: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:44.590 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:44 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:44.590 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:44 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:44.590 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:44 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:44.590 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:44 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:44.590 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:44 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:44.590 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:44 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:44.591 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:44 smithi099 ceph-mon[29691]: pgmap v1266: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:44.591 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:44 smithi099 ceph-mon[29691]: pgmap v1267: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:44.591 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:44 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:44.591 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:44 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:44.591 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:44 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:44.591 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:44 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:44.591 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:44 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:44.591 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:44 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:44.591 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:44 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:44.591 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:44 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:44.591 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:44 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:44.591 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:44 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:44.591 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:44 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:44.591 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:44 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:44.592 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:44 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:44.592 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:44 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:44.592 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:44 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:44.592 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:44 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:44.592 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:44 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:44.592 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:44 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:45.080 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 14:00:44 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[71049]: ::ffff:172.21.15.181 - - [30/Mar/2024:14:00:44] "GET /metrics HTTP/1.1" 200 37999 "" "Prometheus/2.43.0" 2024-03-30T14:00:45.330 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:45 smithi181 ceph-mon[25762]: pgmap v1268: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:45.331 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:45 smithi181 ceph-mon[25762]: pgmap v1269: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:45.331 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:45 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:45.331 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:45 smithi181 ceph-mon[25762]: pgmap v1270: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:45.331 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:45 smithi181 ceph-mon[25762]: pgmap v1271: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:45.331 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:45 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:45.331 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:45 smithi181 ceph-mon[25762]: pgmap v1272: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:45.331 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:45 smithi181 ceph-mon[25762]: pgmap v1273: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:45.331 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:45 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:45.331 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:45 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:45.331 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:45 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:45.331 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:45 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:45.331 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:45 smithi181 ceph-mon[25762]: pgmap v1274: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:45.331 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:45 smithi181 ceph-mon[25762]: pgmap v1275: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:45.331 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:45 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:45.332 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:45 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:45.332 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:45 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:45.332 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:45 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:45.332 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:45 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:45.332 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:45 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:45.332 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:45 smithi181 ceph-mon[25762]: pgmap v1276: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:45.332 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:45 smithi181 ceph-mon[25762]: pgmap v1277: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:45.332 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:45 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:45.332 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:45 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:45.332 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:45 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:45.332 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:45 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:45.332 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:45 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:45.332 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:45 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:45.332 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:45 smithi181 ceph-mon[25762]: pgmap v1278: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:45.332 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:45 smithi181 ceph-mon[25762]: pgmap v1279: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:45.332 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:45 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:45.333 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:45 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:45.333 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:45 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:45.333 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:45 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:45.333 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:45 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:45.333 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:45 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:45.333 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:45 smithi181 ceph-mon[25762]: pgmap v1280: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:45.333 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:45 smithi181 ceph-mon[25762]: pgmap v1281: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:45.333 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:45 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:45.333 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:45 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:45.333 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:45 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:45.334 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:45 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:45.334 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:45 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:45.334 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:45 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:45.334 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:45 smithi181 ceph-mon[25762]: pgmap v1282: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:45.334 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:45 smithi181 ceph-mon[25762]: pgmap v1283: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:45.334 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:45 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:45.334 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:45 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:45.334 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:45 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:45.334 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:45 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:45.334 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:45 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:45.334 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:45 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:45.334 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:45 smithi181 ceph-mon[25762]: pgmap v1284: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:45.334 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:45 smithi181 ceph-mon[25762]: pgmap v1285: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:45.335 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:45 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:45.335 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:45 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:45.335 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:45 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:45.335 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:45 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:45.335 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:45 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:45.335 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:45 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:45.335 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:45 smithi181 ceph-mon[25762]: pgmap v1286: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:45.335 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:45 smithi181 ceph-mon[25762]: pgmap v1287: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:45.335 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:45 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:45.335 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:45 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:45.335 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:45 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:45.336 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:45 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:45.336 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:45 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:45.336 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:45 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:45.336 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:45 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:45.336 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:45 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:45.336 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:45 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:45.336 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:45 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:45.336 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:45 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:45.336 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:45 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:45.336 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:45 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:45.336 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:45 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:45.337 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:45 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:45.337 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:45 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:45.337 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:45 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:45.337 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:45 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:45.337 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:45 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:45.337 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:45 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:45.337 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:45 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:45.337 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:45 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:45.581 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:45 smithi099 ceph-mon[24912]: pgmap v1268: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:45.581 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:45 smithi099 ceph-mon[24912]: pgmap v1269: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:45.581 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:45 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:45.581 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:45 smithi099 ceph-mon[24912]: pgmap v1270: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:45.581 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:45 smithi099 ceph-mon[24912]: pgmap v1271: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:45.581 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:45 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:45.581 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:45 smithi099 ceph-mon[24912]: pgmap v1272: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:45.581 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:45 smithi099 ceph-mon[24912]: pgmap v1273: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:45.582 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:45 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:45.582 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:45 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:45.582 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:45 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:45.582 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:45 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:45.582 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:45 smithi099 ceph-mon[24912]: pgmap v1274: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:45.582 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:45 smithi099 ceph-mon[24912]: pgmap v1275: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:45.582 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:45 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:45.582 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:45 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:45.582 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:45 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:45.582 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:45 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:45.583 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:45 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:45.583 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:45 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:45.583 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:45 smithi099 ceph-mon[24912]: pgmap v1276: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:45.583 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:45 smithi099 ceph-mon[24912]: pgmap v1277: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:45.583 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:45 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:45.583 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:45 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:45.583 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:45 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:45.583 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:45 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:45.583 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:45 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:45.583 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:45 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:45.583 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:45 smithi099 ceph-mon[24912]: pgmap v1278: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:45.583 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:45 smithi099 ceph-mon[24912]: pgmap v1279: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:45.583 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:45 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:45.584 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:45 smithi099 ceph-mon[29691]: pgmap v1268: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:45.584 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:45 smithi099 ceph-mon[29691]: pgmap v1269: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:45.584 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:45 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:45.584 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:45 smithi099 ceph-mon[29691]: pgmap v1270: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:45.584 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:45 smithi099 ceph-mon[29691]: pgmap v1271: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:45.584 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:45 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:45.584 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:45 smithi099 ceph-mon[29691]: pgmap v1272: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:45.584 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:45 smithi099 ceph-mon[29691]: pgmap v1273: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:45.584 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:45 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:45.584 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:45 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:45.584 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:45 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:45.585 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:45 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:45.585 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:45 smithi099 ceph-mon[29691]: pgmap v1274: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:45.585 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:45 smithi099 ceph-mon[29691]: pgmap v1275: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:45.585 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:45 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:45.585 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:45 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:45.585 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:45 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:45.585 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:45 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:45.585 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:45 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:45.585 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:45 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:45.585 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:45 smithi099 ceph-mon[29691]: pgmap v1276: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:45.585 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:45 smithi099 ceph-mon[29691]: pgmap v1277: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:45.585 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:45 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:45.585 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:45 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:45.585 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:45 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:45.585 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:45 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:45.586 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:45 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:45.586 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:45 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:45.586 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:45 smithi099 ceph-mon[29691]: pgmap v1278: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:45.586 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:45 smithi099 ceph-mon[29691]: pgmap v1279: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:45.586 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:45 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:45.586 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:45 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:45.586 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:45 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:45.586 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:45 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:45.586 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:45 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:45.586 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:45 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:45.587 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:45 smithi099 ceph-mon[24912]: pgmap v1280: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:45.587 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:45 smithi099 ceph-mon[24912]: pgmap v1281: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:45.587 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:45 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:45.587 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:45 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:45.587 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:45 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:45.587 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:45 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:45.587 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:45 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:45.587 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:45 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:45.587 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:45 smithi099 ceph-mon[24912]: pgmap v1282: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:45.587 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:45 smithi099 ceph-mon[24912]: pgmap v1283: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:45.587 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:45 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:45.587 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:45 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:45.587 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:45 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:45.587 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:45 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:45.587 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:45 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:45.588 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:45 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:45.588 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:45 smithi099 ceph-mon[24912]: pgmap v1284: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:45.588 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:45 smithi099 ceph-mon[24912]: pgmap v1285: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:45.588 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:45 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:45.588 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:45 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:45.588 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:45 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:45.588 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:45 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:45.588 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:45 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:45.588 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:45 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:45.588 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:45 smithi099 ceph-mon[24912]: pgmap v1286: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:45.588 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:45 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:45.589 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:45 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:45.589 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:45 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:45.589 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:45 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:45.589 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:45 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:45.589 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:45 smithi099 ceph-mon[29691]: pgmap v1280: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:45.589 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:45 smithi099 ceph-mon[29691]: pgmap v1281: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:45.589 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:45 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:45.589 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:45 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:45.589 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:45 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:45.589 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:45 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:45.589 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:45 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:45.589 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:45 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:45.589 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:45 smithi099 ceph-mon[29691]: pgmap v1282: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:45.589 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:45 smithi099 ceph-mon[29691]: pgmap v1283: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:45.590 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:45 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:45.590 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:45 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:45.590 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:45 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:45.590 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:45 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:45.590 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:45 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:45.590 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:45 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:45.590 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:45 smithi099 ceph-mon[29691]: pgmap v1284: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:45.590 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:45 smithi099 ceph-mon[29691]: pgmap v1285: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:45.590 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:45 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:45.590 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:45 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:45.590 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:45 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:45.590 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:45 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:45.590 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:45 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:45.590 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:45 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:45.590 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:45 smithi099 ceph-mon[29691]: pgmap v1286: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:45.591 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:45 smithi099 ceph-mon[24912]: pgmap v1287: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:45.591 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:45 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:45.591 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:45 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:45.591 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:45 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:45.591 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:45 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:45.591 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:45 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:45.591 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:45 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:45.591 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:45 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:45.591 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:45 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:45.591 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:45 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:45.592 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:45 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:45.592 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:45 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:45.592 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:45 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:45.592 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:45 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:45.592 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:45 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:45.592 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:45 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:45.592 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:45 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:45.592 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:45 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:45.592 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:45 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:45.592 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:45 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:45.592 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:45 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:45.592 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:45 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:45.592 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:45 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:45.592 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:45 smithi099 ceph-mon[29691]: pgmap v1287: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:45.593 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:45 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:45.593 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:45 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:45.593 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:45 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:45.593 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:45 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:45.593 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:45 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:45.593 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:45 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:45.593 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:45 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:45.593 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:45 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:45.593 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:45 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:45.593 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:45 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:45.593 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:45 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:45.593 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:45 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:45.593 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:45 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:45.593 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:45 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:45.594 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:45 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:45.594 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:45 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:45.594 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:45 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:45.594 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:45 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:45.594 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:45 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:45.594 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:45 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:45.594 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:45 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:45.594 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:45 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:46.580 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:46 smithi099 ceph-mon[29691]: pgmap v1288: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:46.581 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:46 smithi099 ceph-mon[29691]: pgmap v1289: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:46.581 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:46 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:46.581 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:46 smithi099 ceph-mon[29691]: pgmap v1290: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:46.581 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:46 smithi099 ceph-mon[29691]: pgmap v1291: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:46.581 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:46 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:46.581 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:46 smithi099 ceph-mon[29691]: pgmap v1292: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:46.581 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:46 smithi099 ceph-mon[29691]: pgmap v1293: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:46.581 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:46 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:46.581 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:46 smithi099 ceph-mon[29691]: pgmap v1294: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:46.581 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:46 smithi099 ceph-mon[29691]: pgmap v1295: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:46.581 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:46 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:46.581 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:46 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:46.582 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:46 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:46.582 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:46 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:46.582 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:46 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:46.582 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:46 smithi099 ceph-mon[29691]: pgmap v1296: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:46.582 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:46 smithi099 ceph-mon[29691]: pgmap v1297: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:46.582 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:46 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:46.582 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:46 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:46.582 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:46 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:46.582 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:46 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:46.582 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:46 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:46.582 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:46 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:46.582 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:46 smithi099 ceph-mon[29691]: pgmap v1298: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:46.583 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:46 smithi099 ceph-mon[29691]: pgmap v1299: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:46.583 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:46 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:46.583 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:46 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:46.583 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:46 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:46.583 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:46 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:46.583 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:46 smithi099 ceph-mon[24912]: pgmap v1288: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:46.583 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:46 smithi099 ceph-mon[24912]: pgmap v1289: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:46.583 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:46 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:46.584 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:46 smithi099 ceph-mon[24912]: pgmap v1290: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:46.584 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:46 smithi099 ceph-mon[24912]: pgmap v1291: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:46.584 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:46 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:46.584 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:46 smithi099 ceph-mon[24912]: pgmap v1292: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:46.584 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:46 smithi099 ceph-mon[24912]: pgmap v1293: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:46.584 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:46 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:46.584 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:46 smithi099 ceph-mon[24912]: pgmap v1294: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:46.584 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:46 smithi099 ceph-mon[24912]: pgmap v1295: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:46.584 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:46 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:46.584 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:46 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:46.584 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:46 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:46.584 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:46 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:46.584 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:46 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:46.585 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:46 smithi099 ceph-mon[24912]: pgmap v1296: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:46.585 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:46 smithi099 ceph-mon[24912]: pgmap v1297: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:46.585 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:46 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:46.585 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:46 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:46.585 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:46 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:46.585 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:46 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:46.585 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:46 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:46.585 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:46 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:46.585 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:46 smithi099 ceph-mon[24912]: pgmap v1298: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:46.585 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:46 smithi099 ceph-mon[24912]: pgmap v1299: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:46.585 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:46 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:46.585 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:46 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:46.585 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:46 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:46.585 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:46 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:46.586 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:46 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:46.586 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:46 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:46.586 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:46 smithi099 ceph-mon[29691]: pgmap v1300: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:46.586 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:46 smithi099 ceph-mon[29691]: pgmap v1301: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:46.586 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:46 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:46.586 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:46 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:46.586 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:46 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:46.586 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:46 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:46.587 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:46 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:46.587 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:46 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:46.587 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:46 smithi099 ceph-mon[29691]: pgmap v1302: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:46.587 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:46 smithi099 ceph-mon[29691]: pgmap v1303: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:46.587 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:46 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:46.587 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:46 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:46.587 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:46 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T14:00:46.587 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:46 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:46.587 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:46 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:46.587 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:46 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:46.587 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:46 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:46.587 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:46 smithi099 ceph-mon[29691]: pgmap v1304: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:46.587 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:46 smithi099 ceph-mon[29691]: pgmap v1305: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:46.587 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:46 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:46.588 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:46 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:46.588 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:46 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:46.588 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:46 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:46.588 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:46 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:46.588 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:46 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:46.588 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:46 smithi099 ceph-mon[29691]: pgmap v1306: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:46.588 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:46 smithi099 ceph-mon[29691]: pgmap v1307: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:46.588 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:46 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:46.588 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:46 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:46.588 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:46 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:46.588 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:46 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:46.588 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:46 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:46.588 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:46 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:46.588 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:46 smithi099 ceph-mon[29691]: pgmap v1308: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:46.588 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:46 smithi099 ceph-mon[29691]: pgmap v1309: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:46.589 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:46 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:46.589 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:46 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:46.589 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:46 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:46.589 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:46 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:46.589 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:46 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:46.589 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:46 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:46.589 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:46 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:46.589 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:46 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:46.589 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:46 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:46.589 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:46 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:46.589 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:46 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:46.589 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:46 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:46.589 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:46 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:46.589 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:46 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:46.590 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:46 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:46.590 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:46 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:46.590 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:46 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:46.590 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:46 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:46.590 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:46 smithi099 ceph-mon[24912]: pgmap v1300: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:46.590 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:46 smithi099 ceph-mon[24912]: pgmap v1301: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:46.590 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:46 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:46.590 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:46 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:46.590 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:46 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:46.590 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:46 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:46.591 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:46 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:46.591 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:46 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:46.591 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:46 smithi099 ceph-mon[24912]: pgmap v1302: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:46.591 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:46 smithi099 ceph-mon[24912]: pgmap v1303: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:46.591 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:46 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:46.591 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:46 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:46.591 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:46 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T14:00:46.591 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:46 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:46.591 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:46 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:46.591 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:46 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:46.591 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:46 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:46.591 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:46 smithi099 ceph-mon[24912]: pgmap v1304: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:46.591 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:46 smithi099 ceph-mon[24912]: pgmap v1305: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:46.592 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:46 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:46.592 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:46 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:46.592 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:46 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:46.592 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:46 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:46.592 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:46 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:46.592 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:46 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:46.592 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:46 smithi099 ceph-mon[24912]: pgmap v1306: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:46.592 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:46 smithi099 ceph-mon[24912]: pgmap v1307: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:46.592 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:46 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:46.592 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:46 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:46.592 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:46 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:46.592 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:46 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:46.592 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:46 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:46.592 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:46 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:46.592 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:46 smithi099 ceph-mon[24912]: pgmap v1308: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:46.593 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:46 smithi099 ceph-mon[24912]: pgmap v1309: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:46.593 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:46 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:46.593 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:46 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:46.593 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:46 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:46.593 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:46 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:46.593 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:46 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:46.593 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:46 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:46.593 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:46 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:46.593 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:46 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:46.593 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:46 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:46.593 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:46 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:46.593 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:46 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:46.593 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:46 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:46.593 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:46 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:46.593 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:46 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:46.594 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:46 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:46.594 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:46 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:46.750 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:46 smithi181 ceph-mon[25762]: pgmap v1288: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:46.750 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:46 smithi181 ceph-mon[25762]: pgmap v1289: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:46.750 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:46 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:46.750 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:46 smithi181 ceph-mon[25762]: pgmap v1290: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:46.750 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:46 smithi181 ceph-mon[25762]: pgmap v1291: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:46.750 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:46 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:46.750 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:46 smithi181 ceph-mon[25762]: pgmap v1292: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:46.750 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:46 smithi181 ceph-mon[25762]: pgmap v1293: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:46.750 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:46 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:46.751 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:46 smithi181 ceph-mon[25762]: pgmap v1294: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:46.751 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:46 smithi181 ceph-mon[25762]: pgmap v1295: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:46.751 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:46 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:46.751 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:46 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:46.751 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:46 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:46.751 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:46 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:46.751 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:46 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:46.751 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:46 smithi181 ceph-mon[25762]: pgmap v1296: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:46.751 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:46 smithi181 ceph-mon[25762]: pgmap v1297: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:46.751 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:46 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:46.751 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:46 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:46.751 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:46 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:46.751 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:46 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:46.751 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:46 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:46.751 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:46 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:46.752 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:46 smithi181 ceph-mon[25762]: pgmap v1298: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:46.752 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:46 smithi181 ceph-mon[25762]: pgmap v1299: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:46.752 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:46 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:46.752 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:46 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:46.752 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:46 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:46.752 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:46 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:46.752 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:46 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:46.752 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:46 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:46.752 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:46 smithi181 ceph-mon[25762]: pgmap v1300: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:46.752 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:46 smithi181 ceph-mon[25762]: pgmap v1301: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:46.752 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:46 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:46.752 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:46 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:46.752 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:46 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:46.752 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:46 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:46.753 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:46 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:46.753 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:46 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:46.753 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:46 smithi181 ceph-mon[25762]: pgmap v1302: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:46.753 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:46 smithi181 ceph-mon[25762]: pgmap v1303: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:46.753 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:46 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:46.753 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:46 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:46.753 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:46 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T14:00:46.753 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:46 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:46.753 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:46 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:46.753 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:46 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:46.753 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:46 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:46.753 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:46 smithi181 ceph-mon[25762]: pgmap v1304: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:46.753 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:46 smithi181 ceph-mon[25762]: pgmap v1305: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:46.753 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:46 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:46.753 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:46 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:46.753 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:46 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:46.754 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:46 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:46.754 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:46 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:46.754 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:46 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:46.754 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:46 smithi181 ceph-mon[25762]: pgmap v1306: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:46.754 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:46 smithi181 ceph-mon[25762]: pgmap v1307: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:46.754 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:46 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:46.754 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:46 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:46.754 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:46 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:46.754 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:46 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:46.754 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:46 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:46.754 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:46 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:46.754 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:46 smithi181 ceph-mon[25762]: pgmap v1308: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:46.754 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:46 smithi181 ceph-mon[25762]: pgmap v1309: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:46.755 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:46 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:46.755 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:46 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:46.755 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:46 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:46.755 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:46 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:46.755 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:46 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:46.755 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:46 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:46.755 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:46 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:46.755 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:46 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:46.755 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:46 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:46.755 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:46 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:46.755 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:46 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:46.756 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:46 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:46.756 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:46 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:46.756 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:46 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:46.756 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:46 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:46.756 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:46 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:47.408 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:47 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:47.408 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:47 smithi181 ceph-mon[25762]: pgmap v1310: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:47.408 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:47 smithi181 ceph-mon[25762]: pgmap v1311: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:47.408 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:47 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:47.408 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:47 smithi181 ceph-mon[25762]: pgmap v1312: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:47.408 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:47 smithi181 ceph-mon[25762]: pgmap v1313: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:47.408 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:47 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:47.409 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:47 smithi181 ceph-mon[25762]: pgmap v1314: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:47.409 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:47 smithi181 ceph-mon[25762]: pgmap v1315: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:47.409 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:47 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:47.409 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:47 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:47.409 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:47 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:47.409 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:47 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:47.409 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:47 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:47.409 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:47 smithi181 ceph-mon[25762]: pgmap v1316: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:47.409 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:47 smithi181 ceph-mon[25762]: pgmap v1317: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:47.409 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:47 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:47.409 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:47 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:47.409 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:47 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:47.409 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:47 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:47.409 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:47 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:47.410 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:47 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:47.410 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:47 smithi181 ceph-mon[25762]: pgmap v1318: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:47.410 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:47 smithi181 ceph-mon[25762]: pgmap v1319: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:47.410 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:47 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:47.410 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:47 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:47.410 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:47 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:47.410 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:47 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:47.410 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:47 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:47.410 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:47 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:47.410 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:47 smithi181 ceph-mon[25762]: pgmap v1320: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:47.410 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:47 smithi181 ceph-mon[25762]: pgmap v1321: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:47.410 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:47 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:47.410 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:47 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:47.410 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:47 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:47.411 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:47 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:47.411 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:47 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:47.411 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:47 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:47.411 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:47 smithi181 ceph-mon[25762]: pgmap v1322: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:47.411 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:47 smithi181 ceph-mon[25762]: pgmap v1323: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:47.411 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:47 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:47.411 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:47 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:47.411 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:47 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:47.411 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:47 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:47.411 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:47 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:47.411 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:47 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:47.411 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:47 smithi181 ceph-mon[25762]: pgmap v1324: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 18 KiB/s rd, 18 op/s 2024-03-30T14:00:47.411 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:47 smithi181 ceph-mon[25762]: pgmap v1325: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 18 KiB/s rd, 18 op/s 2024-03-30T14:00:47.411 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:47 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:47.411 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:47 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:47.412 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:47 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:47.412 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:47 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:47.412 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:47 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:47.412 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:47 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:47.412 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:47 smithi181 ceph-mon[25762]: pgmap v1326: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 21 KiB/s rd, 20 op/s 2024-03-30T14:00:47.412 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:47 smithi181 ceph-mon[25762]: pgmap v1327: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 21 KiB/s rd, 20 op/s 2024-03-30T14:00:47.412 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:47 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:47.412 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:47 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:47.412 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:47 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:47.412 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:47 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:47.413 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:47 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:47.413 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:47 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:47.413 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:47 smithi181 ceph-mon[25762]: pgmap v1328: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 21 KiB/s rd, 20 op/s 2024-03-30T14:00:47.413 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:47 smithi181 ceph-mon[25762]: pgmap v1329: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 21 KiB/s rd, 20 op/s 2024-03-30T14:00:47.413 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:47 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:47.413 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:47 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:47.413 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:47 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:47.413 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:47 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:47.413 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:47 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:47.413 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:47 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:47.413 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:47 smithi181 ceph-mon[25762]: pgmap v1330: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:47.413 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:47 smithi181 ceph-mon[25762]: pgmap v1331: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:47.414 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:47 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:47.414 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:47 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:47.414 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:47 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:47.414 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:47 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:47.414 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:47 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:47.414 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:47 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:47.414 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:47 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:47.414 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:47 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:47.414 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:47 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:47.414 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:47 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:47.414 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:47 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:47.414 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:47 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:47.414 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:47 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:47.414 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:47 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:47.414 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:47 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:47.415 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:47 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:47.415 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:47 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:47.415 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:47 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:47.415 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:47 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:47.415 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:47 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:47.415 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:47 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:47.415 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:47 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:47.580 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:47 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:47.581 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:47 smithi099 ceph-mon[24912]: pgmap v1310: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:47.581 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:47 smithi099 ceph-mon[24912]: pgmap v1311: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:47.581 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:47 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:47.581 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:47 smithi099 ceph-mon[24912]: pgmap v1312: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:47.581 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:47 smithi099 ceph-mon[24912]: pgmap v1313: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:47.581 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:47 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:47.581 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:47 smithi099 ceph-mon[24912]: pgmap v1314: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:47.581 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:47 smithi099 ceph-mon[24912]: pgmap v1315: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:47.581 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:47 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:47.581 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:47 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:47.581 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:47 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:47.581 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:47 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:47.581 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:47 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:47.581 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:47 smithi099 ceph-mon[24912]: pgmap v1316: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:47.581 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:47 smithi099 ceph-mon[24912]: pgmap v1317: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:47.582 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:47 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:47.582 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:47 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:47.582 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:47 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:47.582 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:47 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:47.582 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:47 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:47.582 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:47 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:47.582 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:47 smithi099 ceph-mon[24912]: pgmap v1318: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:47.582 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:47 smithi099 ceph-mon[24912]: pgmap v1319: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:47.582 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:47 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:47.582 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:47 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:47.582 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:47 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:47.582 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:47 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:47.582 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:47 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:47.582 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:47 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:47.583 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:47 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:47.583 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:47 smithi099 ceph-mon[29691]: pgmap v1310: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:47.583 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:47 smithi099 ceph-mon[29691]: pgmap v1311: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:47.583 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:47 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:47.583 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:47 smithi099 ceph-mon[29691]: pgmap v1312: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:47.583 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:47 smithi099 ceph-mon[29691]: pgmap v1313: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:47.583 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:47 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:47.583 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:47 smithi099 ceph-mon[29691]: pgmap v1314: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:47.583 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:47 smithi099 ceph-mon[29691]: pgmap v1315: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:47.583 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:47 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:47.584 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:47 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:47.584 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:47 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:47.584 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:47 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:47.584 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:47 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:47.584 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:47 smithi099 ceph-mon[29691]: pgmap v1316: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:47.584 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:47 smithi099 ceph-mon[29691]: pgmap v1317: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:47.584 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:47 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:47.584 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:47 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:47.584 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:47 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:47.584 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:47 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:47.584 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:47 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:47.584 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:47 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:47.584 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:47 smithi099 ceph-mon[29691]: pgmap v1318: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:47.585 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:47 smithi099 ceph-mon[29691]: pgmap v1319: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:47.585 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:47 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:47.585 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:47 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:47.585 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:47 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:47.585 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:47 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:47.585 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:47 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:47.585 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:47 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:47.585 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:47 smithi099 ceph-mon[24912]: pgmap v1320: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:47.586 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:47 smithi099 ceph-mon[24912]: pgmap v1321: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:47.586 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:47 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:47.586 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:47 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:47.586 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:47 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:47.586 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:47 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:47.586 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:47 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:47.586 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:47 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:47.586 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:47 smithi099 ceph-mon[24912]: pgmap v1322: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:47.586 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:47 smithi099 ceph-mon[24912]: pgmap v1323: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:47.586 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:47 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:47.586 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:47 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:47.586 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:47 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:47.586 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:47 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:47.586 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:47 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:47.587 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:47 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:47.587 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:47 smithi099 ceph-mon[24912]: pgmap v1324: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 18 KiB/s rd, 18 op/s 2024-03-30T14:00:47.587 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:47 smithi099 ceph-mon[24912]: pgmap v1325: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 18 KiB/s rd, 18 op/s 2024-03-30T14:00:47.587 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:47 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:47.587 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:47 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:47.587 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:47 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:47.587 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:47 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:47.587 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:47 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:47.587 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:47 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:47.587 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:47 smithi099 ceph-mon[24912]: pgmap v1326: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 21 KiB/s rd, 20 op/s 2024-03-30T14:00:47.587 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:47 smithi099 ceph-mon[24912]: pgmap v1327: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 21 KiB/s rd, 20 op/s 2024-03-30T14:00:47.587 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:47 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:47.587 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:47 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:47.587 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:47 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:47.588 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:47 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:47.588 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:47 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:47.588 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:47 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:47.588 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:47 smithi099 ceph-mon[24912]: pgmap v1328: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 21 KiB/s rd, 20 op/s 2024-03-30T14:00:47.588 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:47 smithi099 ceph-mon[24912]: pgmap v1329: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 21 KiB/s rd, 20 op/s 2024-03-30T14:00:47.588 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:47 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:47.588 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:47 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:47.588 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:47 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:47.588 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:47 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:47.588 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:47 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:47.588 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:47 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:47.588 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:47 smithi099 ceph-mon[24912]: pgmap v1330: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:47.588 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:47 smithi099 ceph-mon[24912]: pgmap v1331: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:47.588 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:47 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:47.589 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:47 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:47.589 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:47 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:47.589 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:47 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:47.589 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:47 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:47.589 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:47 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:47.589 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:47 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:47.589 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:47 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:47.589 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:47 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:47.589 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:47 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:47.589 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:47 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:47.589 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:47 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:47.589 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:47 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:47.589 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:47 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:47.589 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:47 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:47.589 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:47 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:47.590 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:47 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:47.590 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:47 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:47.590 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:47 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:47.590 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:47 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:47.590 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:47 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:47.590 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:47 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:47.590 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:47 smithi099 ceph-mon[29691]: pgmap v1320: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:47.591 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:47 smithi099 ceph-mon[29691]: pgmap v1321: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:47.591 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:47 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:47.591 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:47 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:47.591 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:47 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:47.591 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:47 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:47.591 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:47 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:47.591 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:47 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:47.591 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:47 smithi099 ceph-mon[29691]: pgmap v1322: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:47.591 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:47 smithi099 ceph-mon[29691]: pgmap v1323: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:47.591 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:47 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:47.591 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:47 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:47.591 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:47 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:47.591 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:47 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:47.591 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:47 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:47.592 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:47 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:47.592 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:47 smithi099 ceph-mon[29691]: pgmap v1324: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 18 KiB/s rd, 18 op/s 2024-03-30T14:00:47.592 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:47 smithi099 ceph-mon[29691]: pgmap v1325: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 18 KiB/s rd, 18 op/s 2024-03-30T14:00:47.592 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:47 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:47.592 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:47 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:47.592 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:47 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:47.592 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:47 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:47.592 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:47 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:47.592 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:47 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:47.592 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:47 smithi099 ceph-mon[29691]: pgmap v1326: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 21 KiB/s rd, 20 op/s 2024-03-30T14:00:47.592 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:47 smithi099 ceph-mon[29691]: pgmap v1327: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 21 KiB/s rd, 20 op/s 2024-03-30T14:00:47.592 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:47 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:47.592 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:47 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:47.592 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:47 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:47.592 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:47 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:47.593 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:47 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:47.593 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:47 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:47.593 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:47 smithi099 ceph-mon[29691]: pgmap v1328: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 21 KiB/s rd, 20 op/s 2024-03-30T14:00:47.593 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:47 smithi099 ceph-mon[29691]: pgmap v1329: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 21 KiB/s rd, 20 op/s 2024-03-30T14:00:47.593 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:47 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:47.593 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:47 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:47.593 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:47 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:47.593 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:47 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:47.593 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:47 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:47.593 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:47 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:47.593 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:47 smithi099 ceph-mon[29691]: pgmap v1330: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:47.593 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:47 smithi099 ceph-mon[29691]: pgmap v1331: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:47.593 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:47 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:47.594 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:47 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:47.594 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:47 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:47.594 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:47 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:47.594 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:47 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:47.594 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:47 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:47.594 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:47 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:47.594 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:47 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:47.594 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:47 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:47.594 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:47 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:47.594 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:47 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:47.594 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:47 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:47.594 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:47 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:47.594 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:47 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:47.595 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:47 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:47.595 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:47 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:47.595 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:47 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:47.595 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:47 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:47.595 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:47 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:47.595 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:47 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:47.595 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:47 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:47.595 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:47 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:48.581 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:48 smithi099 ceph-mon[24912]: pgmap v1332: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:48.581 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:48 smithi099 ceph-mon[24912]: pgmap v1333: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:48.581 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:48 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:48.581 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:48 smithi099 ceph-mon[24912]: pgmap v1334: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:48.581 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:48 smithi099 ceph-mon[24912]: pgmap v1335: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:48.581 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:48 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:48.581 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:48 smithi099 ceph-mon[24912]: pgmap v1336: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:48.582 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:48 smithi099 ceph-mon[24912]: pgmap v1337: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:48.582 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:48 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:48.582 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:48 smithi099 ceph-mon[24912]: pgmap v1338: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:48.582 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:48 smithi099 ceph-mon[24912]: pgmap v1339: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:48.582 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:48 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:48.582 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:48 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:48.582 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:48 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:48.582 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:48 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:48.582 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:48 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:48.582 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:48 smithi099 ceph-mon[24912]: pgmap v1340: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:48.582 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:48 smithi099 ceph-mon[24912]: pgmap v1341: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:48.582 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:48 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:48.583 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:48 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:48.583 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:48 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:48.583 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:48 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:48.583 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:48 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:48.583 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:48 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:48.583 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:48 smithi099 ceph-mon[24912]: pgmap v1342: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:48.583 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:48 smithi099 ceph-mon[24912]: pgmap v1343: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:48.583 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:48 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:48.583 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:48 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:48.583 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:48 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:48.583 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:48 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:48.584 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:48 smithi099 ceph-mon[29691]: pgmap v1332: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:48.584 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:48 smithi099 ceph-mon[29691]: pgmap v1333: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:48.584 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:48 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:48.584 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:48 smithi099 ceph-mon[29691]: pgmap v1334: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:48.584 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:48 smithi099 ceph-mon[29691]: pgmap v1335: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:48.584 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:48 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:48.584 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:48 smithi099 ceph-mon[29691]: pgmap v1336: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:48.584 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:48 smithi099 ceph-mon[29691]: pgmap v1337: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:48.584 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:48 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:48.585 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:48 smithi099 ceph-mon[29691]: pgmap v1338: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:48.585 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:48 smithi099 ceph-mon[29691]: pgmap v1339: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:48.585 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:48 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:48.585 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:48 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:48.585 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:48 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:48.585 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:48 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:48.585 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:48 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:48.585 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:48 smithi099 ceph-mon[29691]: pgmap v1340: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:48.585 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:48 smithi099 ceph-mon[29691]: pgmap v1341: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:48.585 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:48 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:48.585 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:48 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:48.585 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:48 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:48.585 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:48 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:48.585 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:48 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:48.586 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:48 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:48.586 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:48 smithi099 ceph-mon[29691]: pgmap v1342: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:48.586 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:48 smithi099 ceph-mon[29691]: pgmap v1343: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:48.586 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:48 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:48.586 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:48 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:48.586 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:48 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:48.586 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:48 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:48.586 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:48 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:48.586 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:48 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:48.587 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:48 smithi099 ceph-mon[29691]: pgmap v1344: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:48.587 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:48 smithi099 ceph-mon[29691]: pgmap v1345: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:48.587 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:48 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:48.587 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:48 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:48.587 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:48 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:48.587 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:48 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:48.587 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:48 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:48.588 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:48 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:48.588 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:48 smithi099 ceph-mon[29691]: pgmap v1346: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:48.588 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:48 smithi099 ceph-mon[29691]: pgmap v1347: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:48.588 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:48 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:48.588 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:48 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:48.588 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:48 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:48.588 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:48 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:48.588 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:48 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:48.588 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:48 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:48.588 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:48 smithi099 ceph-mon[29691]: pgmap v1348: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:48.588 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:48 smithi099 ceph-mon[29691]: pgmap v1349: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:48.589 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:48 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:48.589 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:48 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:48.589 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:48 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:48.589 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:48 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:48.589 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:48 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:48.589 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:48 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:48.589 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:48 smithi099 ceph-mon[29691]: pgmap v1350: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:48.589 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:48 smithi099 ceph-mon[29691]: pgmap v1351: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:48.589 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:48 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:48.589 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:48 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:48.589 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:48 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:48.590 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:48 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:48.590 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:48 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:48.590 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:48 smithi099 ceph-mon[24912]: pgmap v1344: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:48.590 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:48 smithi099 ceph-mon[24912]: pgmap v1345: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:48.590 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:48 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:48.590 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:48 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:48.591 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:48 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:48.591 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:48 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:48.591 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:48 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:48.591 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:48 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:48.591 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:48 smithi099 ceph-mon[24912]: pgmap v1346: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:48.591 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:48 smithi099 ceph-mon[24912]: pgmap v1347: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:48.591 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:48 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:48.591 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:48 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:48.591 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:48 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:48.591 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:48 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:48.591 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:48 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:48.591 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:48 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:48.591 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:48 smithi099 ceph-mon[24912]: pgmap v1348: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:48.591 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:48 smithi099 ceph-mon[24912]: pgmap v1349: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:48.591 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:48 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:48.592 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:48 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:48.592 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:48 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:48.592 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:48 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:48.592 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:48 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:48.592 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:48 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:48.592 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:48 smithi099 ceph-mon[24912]: pgmap v1350: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:48.592 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:48 smithi099 ceph-mon[24912]: pgmap v1351: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:48.592 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:48 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:48.592 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:48 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:48.592 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:48 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:48.592 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:48 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:48.592 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:48 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:48.593 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:48 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:48.593 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:48 smithi099 ceph-mon[29691]: pgmap v1352: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:48.593 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:48 smithi099 ceph-mon[29691]: pgmap v1353: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:48.593 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:48 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:48.593 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:48 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:48.593 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:48 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:48.593 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:48 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:48.593 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:48 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:48.594 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:48 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:48.594 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:48 smithi099 ceph-mon[29691]: pgmap v1354: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:48.594 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:48 smithi099 ceph-mon[29691]: pgmap v1355: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:48.594 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:48 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:48.594 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:48 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:48.594 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:48 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:48.595 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:48 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:48.595 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:48 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:48.595 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:48 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:48.595 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:48 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:48.595 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:48 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:48.595 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:48 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:48.595 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:48 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:48.595 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:48 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:48.595 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:48 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:48.595 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:48 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:48.595 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:48 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:48.595 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:48 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:48.595 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:48 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:48.595 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:48 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:48.596 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:48 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:48.596 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:48 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:48.596 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:48 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:48.596 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:48 smithi099 ceph-mon[24912]: pgmap v1352: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:48.596 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:48 smithi099 ceph-mon[24912]: pgmap v1353: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:48.596 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:48 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:48.596 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:48 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:48.596 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:48 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:48.596 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:48 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:48.596 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:48 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:48.596 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:48 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:48.597 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:48 smithi099 ceph-mon[24912]: pgmap v1354: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:48.597 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:48 smithi099 ceph-mon[24912]: pgmap v1355: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:48.597 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:48 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:48.597 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:48 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:48.597 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:48 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:48.597 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:48 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:48.597 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:48 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:48.597 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:48 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:48.597 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:48 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:48.597 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:48 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:48.597 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:48 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:48.597 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:48 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:48.598 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:48 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:48.598 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:48 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:48.598 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:48 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:48.598 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:48 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:48.598 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:48 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:48.598 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:48 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:48.598 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:48 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:48.598 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:48 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:48.598 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:48 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:48.598 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:48 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:48.598 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:48 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:48.599 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:48 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:48.599 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:48 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:48.599 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:48 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:48.599 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:48 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:48.599 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:48 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:48.599 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:48 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:48.670 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:48 smithi181 ceph-mon[25762]: pgmap v1332: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:48.670 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:48 smithi181 ceph-mon[25762]: pgmap v1333: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:48.670 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:48 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:48.671 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:48 smithi181 ceph-mon[25762]: pgmap v1334: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:48.671 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:48 smithi181 ceph-mon[25762]: pgmap v1335: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:48.671 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:48 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:48.671 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:48 smithi181 ceph-mon[25762]: pgmap v1336: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:48.671 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:48 smithi181 ceph-mon[25762]: pgmap v1337: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:48.671 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:48 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:48.671 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:48 smithi181 ceph-mon[25762]: pgmap v1338: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:48.671 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:48 smithi181 ceph-mon[25762]: pgmap v1339: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:48.671 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:48 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:48.671 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:48 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:48.671 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:48 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:48.671 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:48 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:48.671 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:48 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:48.671 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:48 smithi181 ceph-mon[25762]: pgmap v1340: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:48.672 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:48 smithi181 ceph-mon[25762]: pgmap v1341: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:48.672 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:48 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:48.672 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:48 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:48.672 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:48 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:48.672 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:48 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:48.672 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:48 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:48.672 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:48 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:48.672 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:48 smithi181 ceph-mon[25762]: pgmap v1342: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:48.672 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:48 smithi181 ceph-mon[25762]: pgmap v1343: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:48.672 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:48 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:48.672 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:48 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:48.672 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:48 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:48.672 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:48 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:48.672 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:48 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:48.672 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:48 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:48.672 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:48 smithi181 ceph-mon[25762]: pgmap v1344: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:48.673 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:48 smithi181 ceph-mon[25762]: pgmap v1345: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:48.673 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:48 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:48.673 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:48 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:48.673 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:48 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:48.673 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:48 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:48.673 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:48 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:48.673 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:48 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:48.673 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:48 smithi181 ceph-mon[25762]: pgmap v1346: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:48.673 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:48 smithi181 ceph-mon[25762]: pgmap v1347: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:48.673 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:48 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:48.673 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:48 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:48.673 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:48 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:48.673 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:48 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:48.673 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:48 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:48.673 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:48 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:48.673 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:48 smithi181 ceph-mon[25762]: pgmap v1348: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:48.674 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:48 smithi181 ceph-mon[25762]: pgmap v1349: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:48.674 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:48 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:48.674 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:48 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:48.674 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:48 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:48.674 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:48 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:48.674 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:48 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:48.674 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:48 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:48.674 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:48 smithi181 ceph-mon[25762]: pgmap v1350: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:48.674 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:48 smithi181 ceph-mon[25762]: pgmap v1351: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:48.674 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:48 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:48.674 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:48 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:48.674 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:48 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:48.675 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:48 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:48.675 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:48 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:48.675 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:48 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:48.675 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:48 smithi181 ceph-mon[25762]: pgmap v1352: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:48.675 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:48 smithi181 ceph-mon[25762]: pgmap v1353: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:48.675 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:48 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:48.675 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:48 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:48.675 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:48 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:48.675 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:48 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:48.675 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:48 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:48.675 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:48 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:48.676 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:48 smithi181 ceph-mon[25762]: pgmap v1354: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:48.676 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:48 smithi181 ceph-mon[25762]: pgmap v1355: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:48.676 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:48 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:48.676 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:48 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:48.676 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:48 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:48.676 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:48 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:48.676 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:48 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:48.676 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:48 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:48.676 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:48 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:48.676 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:48 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:48.676 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:48 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:48.677 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:48 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:48.677 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:48 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:48.677 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:48 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:48.677 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:48 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:48.677 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:48 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:48.677 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:48 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:48.677 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:48 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:48.677 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:48 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:48.677 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:48 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:48.677 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:48 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:48.677 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:48 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:48.677 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:48 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:48.677 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:48 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:49.581 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:49 smithi099 ceph-mon[24912]: pgmap v1356: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:49.581 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:49 smithi099 ceph-mon[24912]: pgmap v1357: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:49.581 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:49 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:49.581 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:49 smithi099 ceph-mon[24912]: pgmap v1358: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:49.581 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:49 smithi099 ceph-mon[24912]: pgmap v1359: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:49.581 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:49 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:49.582 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:49 smithi099 ceph-mon[24912]: pgmap v1360: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:49.582 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:49 smithi099 ceph-mon[24912]: pgmap v1361: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:49.582 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:49 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:49.582 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:49 smithi099 ceph-mon[24912]: pgmap v1362: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:49.582 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:49 smithi099 ceph-mon[24912]: pgmap v1363: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:49.582 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:49 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:49.582 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:49 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:49.582 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:49 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:49.582 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:49 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:49.582 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:49 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:49.582 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:49 smithi099 ceph-mon[24912]: pgmap v1364: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:49.582 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:49 smithi099 ceph-mon[24912]: pgmap v1365: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:49.583 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:49 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:49.583 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:49 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:49.583 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:49 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:49.583 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:49 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:49.583 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:49 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:49.583 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:49 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:49.583 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:49 smithi099 ceph-mon[24912]: pgmap v1366: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:49.583 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:49 smithi099 ceph-mon[24912]: pgmap v1367: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:49.583 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:49 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:49.583 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:49 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:49.583 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:49 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:49.583 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:49 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:49.584 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:49 smithi099 ceph-mon[29691]: pgmap v1356: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:49.584 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:49 smithi099 ceph-mon[29691]: pgmap v1357: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:49.584 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:49 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:49.584 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:49 smithi099 ceph-mon[29691]: pgmap v1358: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:49.584 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:49 smithi099 ceph-mon[29691]: pgmap v1359: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:49.584 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:49 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:49.584 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:49 smithi099 ceph-mon[29691]: pgmap v1360: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:49.584 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:49 smithi099 ceph-mon[29691]: pgmap v1361: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:49.584 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:49 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:49.584 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:49 smithi099 ceph-mon[29691]: pgmap v1362: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:49.584 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:49 smithi099 ceph-mon[29691]: pgmap v1363: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:49.584 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:49 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:49.585 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:49 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:49.585 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:49 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:49.585 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:49 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:49.585 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:49 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:49.585 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:49 smithi099 ceph-mon[29691]: pgmap v1364: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:49.585 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:49 smithi099 ceph-mon[29691]: pgmap v1365: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:49.585 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:49 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:49.585 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:49 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:49.585 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:49 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:49.585 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:49 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:49.585 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:49 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:49.585 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:49 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:49.585 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:49 smithi099 ceph-mon[29691]: pgmap v1366: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:49.585 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:49 smithi099 ceph-mon[29691]: pgmap v1367: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:49.585 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:49 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:49.585 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:49 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:49.586 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:49 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:49.586 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:49 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:49.586 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:49 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:49.586 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:49 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:49.586 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:49 smithi099 ceph-mon[29691]: pgmap v1368: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:49.586 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:49 smithi099 ceph-mon[29691]: pgmap v1369: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:49.586 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:49 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:49.586 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:49 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:49.586 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:49 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:49.586 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:49 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:49.587 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:49 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:49.587 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:49 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:49.587 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:49 smithi099 ceph-mon[29691]: pgmap v1370: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:49.587 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:49 smithi099 ceph-mon[29691]: pgmap v1371: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:49.587 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:49 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:49.587 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:49 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:49.588 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:49 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:49.588 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:49 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:49.589 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:49 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:49.589 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:49 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:49.589 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:49 smithi099 ceph-mon[29691]: pgmap v1372: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:49.589 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:49 smithi099 ceph-mon[29691]: pgmap v1373: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:49.589 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:49 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:49.589 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:49 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:49.590 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:49 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:49.590 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:49 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:49.590 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:49 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:49.590 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:49 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:49.590 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:49 smithi099 ceph-mon[29691]: pgmap v1374: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:49.590 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:49 smithi099 ceph-mon[29691]: pgmap v1375: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:49.591 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:49 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:49.591 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:49 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:49.593 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:49 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:49.594 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:49 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:49.594 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:49 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:49.595 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:49 smithi099 ceph-mon[24912]: pgmap v1368: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:49.595 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:49 smithi099 ceph-mon[24912]: pgmap v1369: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:49.595 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:49 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:49.595 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:49 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:49.595 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:49 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:49.595 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:49 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:49.596 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:49 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:49.596 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:49 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:49.596 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:49 smithi099 ceph-mon[24912]: pgmap v1370: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:49.596 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:49 smithi099 ceph-mon[24912]: pgmap v1371: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:49.596 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:49 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:49.596 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:49 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:49.596 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:49 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:49.597 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:49 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:49.597 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:49 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:49.597 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:49 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:49.597 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:49 smithi099 ceph-mon[24912]: pgmap v1372: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:49.597 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:49 smithi099 ceph-mon[24912]: pgmap v1373: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:49.597 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:49 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:49.598 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:49 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:49.599 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:49 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:49.599 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:49 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:49.599 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:49 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:49.599 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:49 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:49.599 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:49 smithi099 ceph-mon[24912]: pgmap v1374: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:49.599 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:49 smithi099 ceph-mon[24912]: pgmap v1375: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:49.599 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:49 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:49.599 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:49 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:49.599 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:49 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:49.599 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:49 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:49.600 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:49 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:49.600 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:49 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:49.600 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:49 smithi099 ceph-mon[24912]: pgmap v1376: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:49.600 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:49 smithi099 ceph-mon[24912]: pgmap v1377: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:49.600 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:49 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:49.600 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:49 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:49.600 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:49 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:49.600 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:49 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:49.600 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:49 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:49.600 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:49 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:49.600 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:49 smithi099 ceph-mon[24912]: pgmap v1378: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:49.600 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:49 smithi099 ceph-mon[24912]: pgmap v1379: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:49.600 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:49 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:49.600 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:49 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:49.600 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:49 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:49.601 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:49 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:49.601 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:49 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:49.601 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:49 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:49.601 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:49 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:49.601 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:49 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:49.601 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:49 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:49.601 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:49 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:49.601 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:49 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:49.601 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:49 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:49.601 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:49 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:49.601 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:49 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:49.601 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:49 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:49.601 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:49 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:49.601 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:49 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:49.602 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:49 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:49.602 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:49 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:49.602 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:49 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:49.602 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:49 smithi099 ceph-mon[29691]: pgmap v1376: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:49.602 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:49 smithi099 ceph-mon[29691]: pgmap v1377: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:49.602 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:49 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:49.603 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:49 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:49.603 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:49 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:49.603 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:49 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:49.603 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:49 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:49.603 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:49 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:49.603 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:49 smithi099 ceph-mon[29691]: pgmap v1378: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:49.603 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:49 smithi099 ceph-mon[29691]: pgmap v1379: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:49.603 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:49 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:49.603 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:49 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:49.603 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:49 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:49.603 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:49 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:49.603 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:49 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:49.603 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:49 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:49.603 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:49 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:49.603 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:49 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:49.604 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:49 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:49.604 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:49 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:49.604 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:49 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:49.604 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:49 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:49.604 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:49 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:49.604 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:49 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:49.604 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:49 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:49.604 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:49 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:49.604 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:49 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:49.604 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:49 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:49.604 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:49 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:49.604 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:49 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:49.604 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:49 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:49.604 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:49 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:49.605 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:49 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:49.605 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:49 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:49.605 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:49 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:49.605 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:49 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:49.605 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:49 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:49.680 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:49 smithi181 ceph-mon[25762]: pgmap v1356: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:49.680 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:49 smithi181 ceph-mon[25762]: pgmap v1357: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:49.680 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:49 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:49.680 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:49 smithi181 ceph-mon[25762]: pgmap v1358: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:49.680 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:49 smithi181 ceph-mon[25762]: pgmap v1359: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:49.680 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:49 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:49.680 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:49 smithi181 ceph-mon[25762]: pgmap v1360: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:49.680 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:49 smithi181 ceph-mon[25762]: pgmap v1361: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:49.680 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:49 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:49.680 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:49 smithi181 ceph-mon[25762]: pgmap v1362: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:49.681 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:49 smithi181 ceph-mon[25762]: pgmap v1363: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:49.681 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:49 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:49.681 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:49 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:49.681 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:49 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:49.681 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:49 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:49.681 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:49 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:49.681 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:49 smithi181 ceph-mon[25762]: pgmap v1364: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:49.681 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:49 smithi181 ceph-mon[25762]: pgmap v1365: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:49.681 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:49 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:49.681 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:49 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:49.681 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:49 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:49.681 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:49 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:49.682 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:49 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:49.682 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:49 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:49.682 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:49 smithi181 ceph-mon[25762]: pgmap v1366: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:49.682 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:49 smithi181 ceph-mon[25762]: pgmap v1367: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:49.682 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:49 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:49.682 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:49 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:49.682 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:49 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:49.682 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:49 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:49.682 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:49 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:49.682 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:49 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:49.682 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:49 smithi181 ceph-mon[25762]: pgmap v1368: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:49.682 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:49 smithi181 ceph-mon[25762]: pgmap v1369: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:49.682 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:49 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:49.682 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:49 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:49.683 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:49 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:49.683 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:49 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:49.683 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:49 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:49.683 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:49 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:49.683 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:49 smithi181 ceph-mon[25762]: pgmap v1370: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:49.683 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:49 smithi181 ceph-mon[25762]: pgmap v1371: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:49.683 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:49 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:49.683 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:49 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:49.683 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:49 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:49.683 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:49 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:49.683 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:49 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:49.683 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:49 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:49.683 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:49 smithi181 ceph-mon[25762]: pgmap v1372: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:49.684 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:49 smithi181 ceph-mon[25762]: pgmap v1373: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:49.684 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:49 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:49.684 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:49 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:49.684 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:49 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:49.684 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:49 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:49.684 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:49 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:49.684 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:49 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:49.684 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:49 smithi181 ceph-mon[25762]: pgmap v1374: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:49.684 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:49 smithi181 ceph-mon[25762]: pgmap v1375: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:49.684 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:49 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:49.684 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:49 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:49.684 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:49 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:49.685 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:49 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:49.685 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:49 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:49.685 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:49 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:49.685 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:49 smithi181 ceph-mon[25762]: pgmap v1376: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:49.685 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:49 smithi181 ceph-mon[25762]: pgmap v1377: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:49.685 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:49 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:49.685 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:49 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:49.685 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:49 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:49.686 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:49 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:49.686 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:49 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:49.686 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:49 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:49.686 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:49 smithi181 ceph-mon[25762]: pgmap v1378: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:49.686 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:49 smithi181 ceph-mon[25762]: pgmap v1379: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:49.686 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:49 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:49.686 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:49 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:49.686 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:49 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:49.686 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:49 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:49.686 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:49 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:49.686 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:49 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:49.686 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:49 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:49.686 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:49 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:49.687 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:49 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:49.687 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:49 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:49.687 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:49 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:49.687 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:49 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:49.687 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:49 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:49.687 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:49 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:49.687 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:49 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:49.687 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:49 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:49.687 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:49 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:49.687 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:49 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:49.687 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:49 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:49.687 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:49 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:49.687 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:49 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:49.687 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:49 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:50.581 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:50 smithi099 ceph-mon[24912]: pgmap v1380: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:50.581 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:50 smithi099 ceph-mon[24912]: pgmap v1381: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:50.581 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:50 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:50.581 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:50 smithi099 ceph-mon[24912]: pgmap v1382: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:50.581 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:50 smithi099 ceph-mon[24912]: pgmap v1383: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:50.581 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:50 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:50.582 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:50 smithi099 ceph-mon[24912]: pgmap v1384: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:50.582 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:50 smithi099 ceph-mon[24912]: pgmap v1385: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:50.582 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:50 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:50.582 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:50 smithi099 ceph-mon[24912]: pgmap v1386: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:50.582 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:50 smithi099 ceph-mon[24912]: pgmap v1387: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:50.582 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:50 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:50.582 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:50 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:50.582 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:50 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:50.582 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:50 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:50.582 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:50 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:50.582 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:50 smithi099 ceph-mon[24912]: pgmap v1388: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:50.582 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:50 smithi099 ceph-mon[24912]: pgmap v1389: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:50.582 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:50 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:50.582 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:50 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:50.582 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:50 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:50.583 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:50 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:50.583 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:50 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:50.583 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:50 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:50.583 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:50 smithi099 ceph-mon[24912]: pgmap v1390: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:50.583 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:50 smithi099 ceph-mon[24912]: pgmap v1391: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:50.583 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:50 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:50.583 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:50 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:50.583 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:50 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:50.583 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:50 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:50.583 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:50 smithi099 ceph-mon[29691]: pgmap v1380: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:50.584 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:50 smithi099 ceph-mon[29691]: pgmap v1381: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:50.584 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:50 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:50.584 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:50 smithi099 ceph-mon[29691]: pgmap v1382: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:50.584 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:50 smithi099 ceph-mon[29691]: pgmap v1383: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:50.584 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:50 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:50.584 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:50 smithi099 ceph-mon[29691]: pgmap v1384: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:50.584 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:50 smithi099 ceph-mon[29691]: pgmap v1385: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:50.584 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:50 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:50.584 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:50 smithi099 ceph-mon[29691]: pgmap v1386: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:50.584 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:50 smithi099 ceph-mon[29691]: pgmap v1387: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:50.584 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:50 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:50.584 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:50 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:50.584 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:50 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:50.585 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:50 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:50.585 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:50 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:50.585 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:50 smithi099 ceph-mon[29691]: pgmap v1388: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:50.585 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:50 smithi099 ceph-mon[29691]: pgmap v1389: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:50.585 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:50 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:50.585 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:50 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:50.585 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:50 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:50.585 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:50 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:50.585 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:50 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:50.585 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:50 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:50.585 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:50 smithi099 ceph-mon[29691]: pgmap v1390: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:50.585 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:50 smithi099 ceph-mon[29691]: pgmap v1391: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:50.585 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:50 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:50.585 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:50 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:50.585 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:50 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:50.585 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:50 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:50.586 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:50 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:50.586 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:50 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:50.586 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:50 smithi099 ceph-mon[24912]: pgmap v1392: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:50.586 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:50 smithi099 ceph-mon[24912]: pgmap v1393: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:50.586 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:50 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:50.586 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:50 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:50.587 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:50 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:50.587 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:50 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:50.587 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:50 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:50.587 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:50 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:50.587 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:50 smithi099 ceph-mon[24912]: pgmap v1394: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:50.587 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:50 smithi099 ceph-mon[24912]: pgmap v1395: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:50.588 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:50 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:50.588 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:50 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:50.588 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:50 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:50.588 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:50 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:50.588 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:50 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:50.588 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:50 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:50.588 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:50 smithi099 ceph-mon[24912]: pgmap v1396: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:50.588 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:50 smithi099 ceph-mon[24912]: pgmap v1397: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:50.588 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:50 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:50.588 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:50 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:50.588 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:50 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:50.588 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:50 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:50.588 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:50 smithi099 ceph-mon[24912]: pgmap v1398: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:50.588 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:50 smithi099 ceph-mon[24912]: pgmap v1399: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:50.588 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:50 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:50.589 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:50 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:50.589 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:50 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:50.589 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:50 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:50.589 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:50 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:50.589 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:50 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:50.589 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:50 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:50.589 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:50 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:50.589 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:50 smithi099 ceph-mon[29691]: pgmap v1392: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:50.589 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:50 smithi099 ceph-mon[29691]: pgmap v1393: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:50.590 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:50 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:50.590 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:50 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:50.590 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:50 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:50.590 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:50 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:50.590 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:50 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:50.590 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:50 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:50.590 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:50 smithi099 ceph-mon[29691]: pgmap v1394: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:50.590 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:50 smithi099 ceph-mon[29691]: pgmap v1395: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:50.590 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:50 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:50.590 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:50 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:50.590 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:50 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:50.590 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:50 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:50.590 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:50 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:50.591 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:50 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:50.591 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:50 smithi099 ceph-mon[29691]: pgmap v1396: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:50.591 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:50 smithi099 ceph-mon[29691]: pgmap v1397: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:50.591 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:50 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:50.591 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:50 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:50.591 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:50 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:50.591 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:50 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:50.591 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:50 smithi099 ceph-mon[29691]: pgmap v1398: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:50.591 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:50 smithi099 ceph-mon[29691]: pgmap v1399: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:50.591 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:50 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:50.591 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:50 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:50.591 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:50 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:50.591 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:50 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:50.591 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:50 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:50.591 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:50 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:50.592 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:50 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:50.592 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:50 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:50.592 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:50 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:50.592 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:50 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:50.592 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:50 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:50.592 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:50 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:50.592 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:50 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:50.592 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:50 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:50.592 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:50 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:50.593 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:50 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:50.593 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:50 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:50.593 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:50 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:50.593 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:50 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:50.593 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:50 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:50.593 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:50 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:50.593 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:50 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:50.593 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:50 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:50.593 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:50 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:50.738 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:50 smithi181 ceph-mon[25762]: pgmap v1380: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:50.738 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:50 smithi181 ceph-mon[25762]: pgmap v1381: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:50.738 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:50 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:50.738 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:50 smithi181 ceph-mon[25762]: pgmap v1382: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:50.738 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:50 smithi181 ceph-mon[25762]: pgmap v1383: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:50.739 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:50 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:50.739 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:50 smithi181 ceph-mon[25762]: pgmap v1384: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:50.739 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:50 smithi181 ceph-mon[25762]: pgmap v1385: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:50.739 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:50 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:50.739 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:50 smithi181 ceph-mon[25762]: pgmap v1386: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:50.739 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:50 smithi181 ceph-mon[25762]: pgmap v1387: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:50.739 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:50 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:50.739 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:50 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:50.739 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:50 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:50.739 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:50 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:50.739 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:50 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:50.739 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:50 smithi181 ceph-mon[25762]: pgmap v1388: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:50.739 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:50 smithi181 ceph-mon[25762]: pgmap v1389: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:50.739 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:50 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:50.739 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:50 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:50.740 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:50 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:50.740 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:50 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:50.740 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:50 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:50.740 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:50 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:50.740 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:50 smithi181 ceph-mon[25762]: pgmap v1390: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:50.740 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:50 smithi181 ceph-mon[25762]: pgmap v1391: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:50.740 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:50 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:50.740 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:50 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:50.740 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:50 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:50.740 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:50 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:50.741 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:50 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:50.741 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:50 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:50.741 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:50 smithi181 ceph-mon[25762]: pgmap v1392: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:50.741 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:50 smithi181 ceph-mon[25762]: pgmap v1393: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:50.741 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:50 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:50.741 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:50 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:50.741 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:50 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:50.741 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:50 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:50.741 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:50 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:50.741 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:50 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:50.741 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:50 smithi181 ceph-mon[25762]: pgmap v1394: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:50.741 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:50 smithi181 ceph-mon[25762]: pgmap v1395: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:50.741 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:50 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:50.741 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:50 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:50.742 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:50 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:50.742 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:50 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:50.742 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:50 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:50.742 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:50 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:50.742 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:50 smithi181 ceph-mon[25762]: pgmap v1396: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:50.742 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:50 smithi181 ceph-mon[25762]: pgmap v1397: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:50.742 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:50 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:50.742 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:50 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:50.742 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:50 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:50.742 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:50 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:50.742 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:50 smithi181 ceph-mon[25762]: pgmap v1398: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:50.742 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:50 smithi181 ceph-mon[25762]: pgmap v1399: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:50.742 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:50 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:50.742 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:50 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:50.743 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:50 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:50.743 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:50 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:50.743 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:50 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:50.743 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:50 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:50.743 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:50 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:50.743 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:50 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:50.743 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:50 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:50.743 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:50 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:50.743 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:50 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:50.743 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:50 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:50.743 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:50 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:50.743 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:50 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:50.743 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:50 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:51.404 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:51 smithi181 ceph-mon[25762]: pgmap v1400: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:51.404 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:51 smithi181 ceph-mon[25762]: pgmap v1401: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:51.580 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:51 smithi099 ceph-mon[24912]: pgmap v1400: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:51.580 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:51 smithi099 ceph-mon[24912]: pgmap v1401: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:51.580 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:51 smithi099 ceph-mon[29691]: pgmap v1400: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:51.580 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:51 smithi099 ceph-mon[29691]: pgmap v1401: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:52.386 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:52 smithi099 ceph-mon[29691]: Upgrade: Updating alertmanager.a 2024-03-30T14:00:52.386 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:52 smithi099 ceph-mon[29691]: Deploying daemon alertmanager.a on smithi099 2024-03-30T14:00:52.386 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:52 smithi099 ceph-mon[24912]: Upgrade: Updating alertmanager.a 2024-03-30T14:00:52.386 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:52 smithi099 ceph-mon[24912]: Deploying daemon alertmanager.a on smithi099 2024-03-30T14:00:52.499 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:52 smithi181 ceph-mon[25762]: Upgrade: Updating alertmanager.a 2024-03-30T14:00:52.499 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:52 smithi181 ceph-mon[25762]: Deploying daemon alertmanager.a on smithi099 2024-03-30T14:00:53.499 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:53 smithi181 ceph-mon[25762]: pgmap v1402: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 2.2 KiB/s rd, 2 op/s 2024-03-30T14:00:53.580 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:53 smithi099 ceph-mon[24912]: pgmap v1402: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 2.2 KiB/s rd, 2 op/s 2024-03-30T14:00:53.581 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:53 smithi099 ceph-mon[29691]: pgmap v1402: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 2.2 KiB/s rd, 2 op/s 2024-03-30T14:00:55.031 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:54 smithi099 ceph-mon[24912]: from='client.25136 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T14:00:55.031 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:54 smithi099 ceph-mon[29691]: from='client.25136 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T14:00:55.031 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 14:00:54 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[71049]: ::ffff:172.21.15.181 - - [30/Mar/2024:14:00:54] "GET /metrics HTTP/1.1" 200 37996 "" "Prometheus/2.43.0" 2024-03-30T14:00:55.249 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:54 smithi181 ceph-mon[25762]: from='client.25136 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T14:00:55.334 INFO:journalctl@ceph.alertmanager.a.smithi099.stdout:Mar 30 14:00:55 smithi099 systemd[1]: Stopping Ceph alertmanager.a for 98ebaeb8-ee99-11ee-b647-cb9ed24678a4... 2024-03-30T14:00:55.706 INFO:journalctl@ceph.alertmanager.a.smithi099.stdout:Mar 30 14:00:55 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-alertmanager-a[64884]: level=info ts=2024-03-30T14:00:55.400Z caller=main.go:557 msg="Received SIGTERM, exiting gracefully..." 2024-03-30T14:00:55.706 INFO:journalctl@ceph.alertmanager.a.smithi099.stdout:Mar 30 14:00:55 smithi099 podman[115117]: 2024-03-30 14:00:55.441665071 +0000 UTC m=+0.152939843 container died 0f1be38010273360865e2c9876a2c2bb85c27dd134d31fb3b7f242c57b8da619 (image=quay.io/prometheus/alertmanager:v0.23.0, name=ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-alertmanager-a, maintainer=The Prometheus Authors ) 2024-03-30T14:00:55.864 INFO:teuthology.orchestra.run.smithi099.stdout:true 2024-03-30T14:00:56.080 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:55 smithi099 ceph-mon[24912]: pgmap v1403: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T14:00:56.080 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:55 smithi099 ceph-mon[29691]: pgmap v1403: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T14:00:56.080 INFO:journalctl@ceph.alertmanager.a.smithi099.stdout:Mar 30 14:00:55 smithi099 podman[115117]: 2024-03-30 14:00:55.809611846 +0000 UTC m=+0.520886615 container cleanup 0f1be38010273360865e2c9876a2c2bb85c27dd134d31fb3b7f242c57b8da619 (image=quay.io/prometheus/alertmanager:v0.23.0, name=ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-alertmanager-a, maintainer=The Prometheus Authors ) 2024-03-30T14:00:56.081 INFO:journalctl@ceph.alertmanager.a.smithi099.stdout:Mar 30 14:00:55 smithi099 bash[115117]: ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-alertmanager-a 2024-03-30T14:00:56.249 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:55 smithi181 ceph-mon[25762]: pgmap v1403: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T14:00:56.371 INFO:journalctl@ceph.alertmanager.a.smithi099.stdout:Mar 30 14:00:56 smithi099 podman[115131]: 2024-03-30 14:00:56.094313026 +0000 UTC m=+0.652681581 container remove 0f1be38010273360865e2c9876a2c2bb85c27dd134d31fb3b7f242c57b8da619 (image=quay.io/prometheus/alertmanager:v0.23.0, name=ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-alertmanager-a, maintainer=The Prometheus Authors ) 2024-03-30T14:00:56.372 INFO:journalctl@ceph.alertmanager.a.smithi099.stdout:Mar 30 14:00:56 smithi099 podman[115131]: 2024-03-30 14:00:56.186705295 +0000 UTC m=+0.745073848 volume remove a69ea3e29dff3bf62093177be1e23c2a2898dd76fb4aea4f72c8a0eb571c5831 2024-03-30T14:00:56.539 INFO:teuthology.orchestra.run.smithi099.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-03-30T14:00:56.539 INFO:teuthology.orchestra.run.smithi099.stdout:agent.smithi099 smithi099 running 15s ago 29m - - 2024-03-30T14:00:56.539 INFO:teuthology.orchestra.run.smithi099.stdout:agent.smithi181 smithi181 running 6s ago 29m - - 2024-03-30T14:00:56.539 INFO:teuthology.orchestra.run.smithi099.stdout:alertmanager.a smithi099 *:9093,9094 running (15m) 15s ago 23m 23.6M - 0.23.0 ba2b418f427c 0f1be3801027 2024-03-30T14:00:56.539 INFO:teuthology.orchestra.run.smithi099.stdout:grafana.a smithi181 *:3000 error 6s ago 23m - - 2024-03-30T14:00:56.539 INFO:teuthology.orchestra.run.smithi099.stdout:iscsi.foo.smithi099.qyjuvr smithi099 running (2m) 15s ago 22m 46.8M - 3.5 e1d6a67b021e 2f859af6bc2a 2024-03-30T14:00:56.539 INFO:teuthology.orchestra.run.smithi099.stdout:mgr.x smithi181 *:8443,9283,8765 running (85s) 6s ago 28m 450M - 19.0.0-1967-g4e50bbcd b0c4478f1d83 f269106f7913 2024-03-30T14:00:56.540 INFO:teuthology.orchestra.run.smithi099.stdout:mgr.y smithi099 *:8443,9283,8765 running (12m) 15s ago 30m 519M - 19.0.0-1967-g4e50bbcd b0c4478f1d83 0d464b8c1d18 2024-03-30T14:00:56.540 INFO:teuthology.orchestra.run.smithi099.stdout:mon.a smithi099 running (30m) 15s ago 30m 123M 2048M 17.2.0 e1d6a67b021e af06ebb19fd8 2024-03-30T14:00:56.540 INFO:teuthology.orchestra.run.smithi099.stdout:mon.b smithi181 running (28m) 6s ago 28m 73.6M 2048M 17.2.0 e1d6a67b021e e678a2a25c90 2024-03-30T14:00:56.540 INFO:teuthology.orchestra.run.smithi099.stdout:mon.c smithi099 running (28m) 15s ago 28m 71.9M 2048M 17.2.0 e1d6a67b021e 0f1e98917718 2024-03-30T14:00:56.540 INFO:teuthology.orchestra.run.smithi099.stdout:node-exporter.a smithi099 *:9100 running (42s) 15s ago 24m 8270k - 1.5.0 0da6a335fe13 4a3f1f6e7068 2024-03-30T14:00:56.540 INFO:teuthology.orchestra.run.smithi099.stdout:node-exporter.b smithi181 *:9100 running (38s) 6s ago 24m 15.4M - 1.5.0 0da6a335fe13 acea317b5f5d 2024-03-30T14:00:56.540 INFO:teuthology.orchestra.run.smithi099.stdout:osd.0 smithi099 running (28m) 15s ago 28m 54.6M 4096M 17.2.0 e1d6a67b021e 3158ee1b0c67 2024-03-30T14:00:56.540 INFO:teuthology.orchestra.run.smithi099.stdout:osd.1 smithi099 running (27m) 15s ago 27m 57.7M 4096M 17.2.0 e1d6a67b021e c4af0fd7071a 2024-03-30T14:00:56.540 INFO:teuthology.orchestra.run.smithi099.stdout:osd.2 smithi099 running (27m) 15s ago 27m 49.7M 4096M 17.2.0 e1d6a67b021e 8e4e805a7e20 2024-03-30T14:00:56.540 INFO:teuthology.orchestra.run.smithi099.stdout:osd.3 smithi099 running (26m) 15s ago 26m 53.7M 4096M 17.2.0 e1d6a67b021e 718812bcf065 2024-03-30T14:00:56.540 INFO:teuthology.orchestra.run.smithi099.stdout:osd.4 smithi181 running (26m) 6s ago 26m 55.3M 4096M 17.2.0 e1d6a67b021e 5e205434e973 2024-03-30T14:00:56.540 INFO:teuthology.orchestra.run.smithi099.stdout:osd.5 smithi181 running (26m) 6s ago 26m 52.9M 4096M 17.2.0 e1d6a67b021e e330c920f152 2024-03-30T14:00:56.540 INFO:teuthology.orchestra.run.smithi099.stdout:osd.6 smithi181 running (25m) 6s ago 25m 52.3M 4096M 17.2.0 e1d6a67b021e 81d889ea213d 2024-03-30T14:00:56.540 INFO:teuthology.orchestra.run.smithi099.stdout:osd.7 smithi181 running (25m) 6s ago 25m 53.0M 4096M 17.2.0 e1d6a67b021e c08b1839dd7e 2024-03-30T14:00:56.540 INFO:teuthology.orchestra.run.smithi099.stdout:prometheus.a smithi181 *:9095 running (17s) 6s ago 24m 44.5M - 2.43.0 a07b618ecd1d 004088bdf70e 2024-03-30T14:00:56.541 INFO:teuthology.orchestra.run.smithi099.stdout:rgw.foo.smithi099.fxjbmp smithi099 *:8000 running (22m) 15s ago 22m 76.4M - 17.2.0 e1d6a67b021e 400b28b3f650 2024-03-30T14:00:56.541 INFO:teuthology.orchestra.run.smithi099.stdout:rgw.foo.smithi181.wfqwti smithi181 *:8000 running (22m) 6s ago 22m 76.1M - 17.2.0 e1d6a67b021e 97e1b130f9d4 2024-03-30T14:00:56.823 INFO:journalctl@ceph.alertmanager.a.smithi099.stdout:Mar 30 14:00:56 smithi099 systemd[1]: ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4@alertmanager.a.service: Deactivated successfully. 2024-03-30T14:00:56.824 INFO:journalctl@ceph.alertmanager.a.smithi099.stdout:Mar 30 14:00:56 smithi099 systemd[1]: Stopped Ceph alertmanager.a for 98ebaeb8-ee99-11ee-b647-cb9ed24678a4. 2024-03-30T14:00:56.824 INFO:journalctl@ceph.alertmanager.a.smithi099.stdout:Mar 30 14:00:56 smithi099 systemd[1]: ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4@alertmanager.a.service: Consumed 1.597s CPU time. 2024-03-30T14:00:56.824 INFO:journalctl@ceph.alertmanager.a.smithi099.stdout:Mar 30 14:00:56 smithi099 systemd[1]: Starting Ceph alertmanager.a for 98ebaeb8-ee99-11ee-b647-cb9ed24678a4... 2024-03-30T14:00:56.959 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-03-30T14:00:56.959 INFO:teuthology.orchestra.run.smithi099.stdout: "mon": { 2024-03-30T14:00:56.959 INFO:teuthology.orchestra.run.smithi099.stdout: "ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)": 3 2024-03-30T14:00:56.959 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T14:00:56.960 INFO:teuthology.orchestra.run.smithi099.stdout: "mgr": { 2024-03-30T14:00:56.960 INFO:teuthology.orchestra.run.smithi099.stdout: "ceph version 19.0.0-1967-g4e50bbcd (4e50bbcdd1630c7760b708f3a5b4d38a121e66cb) squid (dev)": 2 2024-03-30T14:00:56.960 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T14:00:56.960 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": { 2024-03-30T14:00:56.960 INFO:teuthology.orchestra.run.smithi099.stdout: "ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)": 8 2024-03-30T14:00:56.960 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T14:00:56.960 INFO:teuthology.orchestra.run.smithi099.stdout: "mds": {}, 2024-03-30T14:00:56.960 INFO:teuthology.orchestra.run.smithi099.stdout: "rgw": { 2024-03-30T14:00:56.960 INFO:teuthology.orchestra.run.smithi099.stdout: "ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)": 2 2024-03-30T14:00:56.960 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T14:00:56.960 INFO:teuthology.orchestra.run.smithi099.stdout: "overall": { 2024-03-30T14:00:56.960 INFO:teuthology.orchestra.run.smithi099.stdout: "ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)": 13, 2024-03-30T14:00:56.960 INFO:teuthology.orchestra.run.smithi099.stdout: "ceph version 19.0.0-1967-g4e50bbcd (4e50bbcdd1630c7760b708f3a5b4d38a121e66cb) squid (dev)": 2 2024-03-30T14:00:56.960 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-03-30T14:00:56.960 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-03-30T14:00:57.080 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:56 smithi099 ceph-mon[24912]: from='client.15642 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T14:00:57.081 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:56 smithi099 ceph-mon[29691]: from='client.15642 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T14:00:57.081 INFO:journalctl@ceph.alertmanager.a.smithi099.stdout:Mar 30 14:00:56 smithi099 podman[115354]: 2024-03-30 14:00:56.829286032 +0000 UTC m=+0.116960156 volume create c2ec592fc5f444d0e38e6e9c6835fc8d38cf7c9b1d63dce049518a4ec00c51b3 2024-03-30T14:00:57.081 INFO:journalctl@ceph.alertmanager.a.smithi099.stdout:Mar 30 14:00:56 smithi099 podman[115354]: 2024-03-30 14:00:56.73749878 +0000 UTC m=+0.025172916 image pull c8568f914cd25b2062c44e9f79f9c18da6e3b85fe0c47a12a2191c61426c2b19 quay.io/prometheus/alertmanager:v0.25.0 2024-03-30T14:00:57.082 INFO:journalctl@ceph.alertmanager.a.smithi099.stdout:Mar 30 14:00:56 smithi099 podman[115354]: 2024-03-30 14:00:56.946621386 +0000 UTC m=+0.234295508 container create 0dfa689eb2c323c12d762f09779cc0eaa2649802d3bcf3b243603fa68aaee315 (image=quay.io/prometheus/alertmanager:v0.25.0, name=ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-alertmanager-a, maintainer=The Prometheus Authors ) 2024-03-30T14:00:57.249 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:56 smithi181 ceph-mon[25762]: from='client.15642 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T14:00:57.297 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-03-30T14:00:57.297 INFO:teuthology.orchestra.run.smithi099.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph:4e50bbcdd1630c7760b708f3a5b4d38a121e66cb", 2024-03-30T14:00:57.297 INFO:teuthology.orchestra.run.smithi099.stdout: "in_progress": true, 2024-03-30T14:00:57.297 INFO:teuthology.orchestra.run.smithi099.stdout: "which": "Upgrading daemons of type(s) mgr", 2024-03-30T14:00:57.297 INFO:teuthology.orchestra.run.smithi099.stdout: "services_complete": [ 2024-03-30T14:00:57.298 INFO:teuthology.orchestra.run.smithi099.stdout: "mgr" 2024-03-30T14:00:57.298 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-03-30T14:00:57.298 INFO:teuthology.orchestra.run.smithi099.stdout: "progress": "2/2 daemons upgraded", 2024-03-30T14:00:57.298 INFO:teuthology.orchestra.run.smithi099.stdout: "message": "Currently upgrading alertmanager daemons", 2024-03-30T14:00:57.298 INFO:teuthology.orchestra.run.smithi099.stdout: "is_paused": false 2024-03-30T14:00:57.298 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-03-30T14:00:57.582 INFO:journalctl@ceph.alertmanager.a.smithi099.stdout:Mar 30 14:00:57 smithi099 podman[115354]: 2024-03-30 14:00:57.266946201 +0000 UTC m=+0.554620338 container init 0dfa689eb2c323c12d762f09779cc0eaa2649802d3bcf3b243603fa68aaee315 (image=quay.io/prometheus/alertmanager:v0.25.0, name=ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-alertmanager-a, maintainer=The Prometheus Authors ) 2024-03-30T14:00:57.582 INFO:journalctl@ceph.alertmanager.a.smithi099.stdout:Mar 30 14:00:57 smithi099 podman[115354]: 2024-03-30 14:00:57.270564344 +0000 UTC m=+0.558238477 container start 0dfa689eb2c323c12d762f09779cc0eaa2649802d3bcf3b243603fa68aaee315 (image=quay.io/prometheus/alertmanager:v0.25.0, name=ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-alertmanager-a, maintainer=The Prometheus Authors ) 2024-03-30T14:00:57.582 INFO:journalctl@ceph.alertmanager.a.smithi099.stdout:Mar 30 14:00:57 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-alertmanager-a[115391]: ts=2024-03-30T14:00:57.282Z caller=main.go:240 level=info msg="Starting Alertmanager" version="(version=0.25.0, branch=HEAD, revision=258fab7cdd551f2cf251ed0348f0ad7289aee789)" 2024-03-30T14:00:57.582 INFO:journalctl@ceph.alertmanager.a.smithi099.stdout:Mar 30 14:00:57 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-alertmanager-a[115391]: ts=2024-03-30T14:00:57.282Z caller=main.go:241 level=info build_context="(go=go1.19.4, user=root@abe866dd5717, date=20221222-14:51:36)" 2024-03-30T14:00:57.583 INFO:journalctl@ceph.alertmanager.a.smithi099.stdout:Mar 30 14:00:57 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-alertmanager-a[115391]: ts=2024-03-30T14:00:57.283Z caller=cluster.go:185 level=info component=cluster msg="setting advertise address explicitly" addr=172.21.15.99 port=9094 2024-03-30T14:00:57.583 INFO:journalctl@ceph.alertmanager.a.smithi099.stdout:Mar 30 14:00:57 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-alertmanager-a[115391]: ts=2024-03-30T14:00:57.285Z caller=cluster.go:681 level=info component=cluster msg="Waiting for gossip to settle..." interval=2s 2024-03-30T14:00:57.583 INFO:journalctl@ceph.alertmanager.a.smithi099.stdout:Mar 30 14:00:57 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-alertmanager-a[115391]: ts=2024-03-30T14:00:57.309Z caller=coordinator.go:113 level=info component=configuration msg="Loading configuration file" file=/etc/alertmanager/alertmanager.yml 2024-03-30T14:00:57.583 INFO:journalctl@ceph.alertmanager.a.smithi099.stdout:Mar 30 14:00:57 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-alertmanager-a[115391]: ts=2024-03-30T14:00:57.309Z caller=coordinator.go:126 level=info component=configuration msg="Completed loading of configuration file" file=/etc/alertmanager/alertmanager.yml 2024-03-30T14:00:57.583 INFO:journalctl@ceph.alertmanager.a.smithi099.stdout:Mar 30 14:00:57 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-alertmanager-a[115391]: ts=2024-03-30T14:00:57.312Z caller=tls_config.go:232 level=info msg="Listening on" address=[::]:9093 2024-03-30T14:00:57.583 INFO:journalctl@ceph.alertmanager.a.smithi099.stdout:Mar 30 14:00:57 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-alertmanager-a[115391]: ts=2024-03-30T14:00:57.312Z caller=tls_config.go:235 level=info msg="TLS is disabled." http2=false address=[::]:9093 2024-03-30T14:00:57.583 INFO:journalctl@ceph.alertmanager.a.smithi099.stdout:Mar 30 14:00:57 smithi099 bash[115354]: 0dfa689eb2c323c12d762f09779cc0eaa2649802d3bcf3b243603fa68aaee315 2024-03-30T14:00:57.583 INFO:journalctl@ceph.alertmanager.a.smithi099.stdout:Mar 30 14:00:57 smithi099 systemd[1]: Started Ceph alertmanager.a for 98ebaeb8-ee99-11ee-b647-cb9ed24678a4. 2024-03-30T14:00:58.141 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:57 smithi099 ceph-mon[24912]: pgmap v1404: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 823 B/s rd, 0 op/s 2024-03-30T14:00:58.141 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:57 smithi099 ceph-mon[24912]: from='client.25540 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T14:00:58.141 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:57 smithi099 ceph-mon[24912]: from='client.15654 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T14:00:58.141 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:57 smithi099 ceph-mon[24912]: from='client.? 172.21.15.99:0/1939605127' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:58.141 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:57 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:58.141 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:57 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:58.142 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:57 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:58.142 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:57 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:58.142 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:57 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:58.142 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:57 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-03-30T14:00:58.142 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:57 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:58.142 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:57 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:58.142 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:57 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:58.142 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:57 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:58.142 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:57 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:58.142 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:57 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:58.142 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:57 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:58.142 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:57 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:58.142 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:57 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:58.142 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:57 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:58.143 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:57 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:58.143 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:57 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:58.143 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:57 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:58.143 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:57 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:58.143 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:57 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:58.143 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:57 smithi099 ceph-mon[29691]: pgmap v1404: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 823 B/s rd, 0 op/s 2024-03-30T14:00:58.143 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:57 smithi099 ceph-mon[29691]: from='client.25540 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T14:00:58.143 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:57 smithi099 ceph-mon[29691]: from='client.15654 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T14:00:58.143 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:57 smithi099 ceph-mon[29691]: from='client.? 172.21.15.99:0/1939605127' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:58.143 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:57 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:58.143 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:57 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:58.143 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:57 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:58.143 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:57 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:58.144 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:57 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:58.144 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:57 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-03-30T14:00:58.144 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:57 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:58.144 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:57 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:58.144 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:57 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:58.144 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:57 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:58.144 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:57 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:58.144 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:57 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:58.144 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:57 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:58.144 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:57 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:58.144 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:57 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:58.144 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:57 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:58.144 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:57 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:58.144 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:57 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:58.144 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:57 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:58.145 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:57 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:58.145 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:57 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:58.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:57 smithi181 ceph-mon[25762]: pgmap v1404: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 823 B/s rd, 0 op/s 2024-03-30T14:00:58.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:57 smithi181 ceph-mon[25762]: from='client.25540 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T14:00:58.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:57 smithi181 ceph-mon[25762]: from='client.15654 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T14:00:58.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:57 smithi181 ceph-mon[25762]: from='client.? 172.21.15.99:0/1939605127' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:58.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:57 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:58.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:57 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:58.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:57 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:58.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:57 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:58.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:57 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:58.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:57 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-03-30T14:00:58.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:57 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:58.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:57 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:58.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:57 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:58.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:57 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:58.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:57 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:58.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:57 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:58.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:57 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:58.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:57 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:58.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:57 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:58.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:57 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:58.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:57 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:58.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:57 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:58.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:57 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:58.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:57 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:58.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:57 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:59.214 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:58 smithi099 ceph-mon[29691]: from='client.15666 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T14:00:59.214 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:58 smithi099 ceph-mon[29691]: pgmap v1405: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-03-30T14:00:59.214 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:58 smithi099 ceph-mon[29691]: pgmap v1406: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-03-30T14:00:59.214 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:58 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:59.214 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:58 smithi099 ceph-mon[29691]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-03-30T14:00:59.214 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:58 smithi099 ceph-mon[29691]: pgmap v1407: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-03-30T14:00:59.214 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:58 smithi099 ceph-mon[29691]: pgmap v1408: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 908 B/s rd, 0 op/s 2024-03-30T14:00:59.214 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:58 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:59.215 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:58 smithi099 ceph-mon[29691]: pgmap v1409: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-03-30T14:00:59.215 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:58 smithi099 ceph-mon[29691]: pgmap v1410: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 2.9 KiB/s rd, 2 op/s 2024-03-30T14:00:59.215 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:58 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:59.215 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:58 smithi099 ceph-mon[29691]: pgmap v1411: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:59.215 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:58 smithi099 ceph-mon[29691]: pgmap v1412: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:59.215 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:58 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:59.215 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:58 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:59.215 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:58 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:59.215 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:58 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:59.215 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:58 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:59.215 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:58 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:59.215 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:58 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:59.215 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:58 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:59.215 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:58 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:59.216 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:58 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:59.216 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:58 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:59.216 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:58 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:59.216 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:58 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:59.216 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:58 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:59.216 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:58 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:59.216 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:58 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:59.216 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:58 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:59.216 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:58 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:59.216 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:58 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:59.216 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:58 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:59.216 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:58 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:59.216 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:58 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:59.216 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:58 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:59.216 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:58 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:59.217 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:58 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:59.217 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:58 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:59.217 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:58 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:59.217 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:58 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:59.217 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:58 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:59.217 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:58 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:59.217 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:58 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:59.217 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:58 smithi099 ceph-mon[24912]: from='client.15666 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T14:00:59.217 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:58 smithi099 ceph-mon[24912]: pgmap v1405: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-03-30T14:00:59.218 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:58 smithi099 ceph-mon[24912]: pgmap v1406: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-03-30T14:00:59.218 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:58 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:59.218 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:58 smithi099 ceph-mon[24912]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-03-30T14:00:59.218 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:58 smithi099 ceph-mon[24912]: pgmap v1407: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-03-30T14:00:59.218 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:58 smithi099 ceph-mon[24912]: pgmap v1408: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 908 B/s rd, 0 op/s 2024-03-30T14:00:59.218 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:58 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:59.218 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:58 smithi099 ceph-mon[24912]: pgmap v1409: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-03-30T14:00:59.218 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:58 smithi099 ceph-mon[24912]: pgmap v1410: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 2.9 KiB/s rd, 2 op/s 2024-03-30T14:00:59.218 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:58 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:59.218 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:58 smithi099 ceph-mon[24912]: pgmap v1411: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:59.218 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:58 smithi099 ceph-mon[24912]: pgmap v1412: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:59.218 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:58 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:59.218 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:58 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:59.218 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:58 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:59.219 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:58 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:59.219 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:58 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:59.219 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:58 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:59.219 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:58 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:59.219 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:58 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:59.219 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:58 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:59.219 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:58 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:59.219 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:58 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:59.219 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:58 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:59.219 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:58 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:59.219 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:58 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:59.219 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:58 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:59.219 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:58 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:59.219 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:58 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:59.219 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:58 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:59.220 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:58 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:59.220 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:58 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:59.220 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:58 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:59.220 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:58 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:59.220 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:58 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:59.220 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:58 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:59.220 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:58 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:59.220 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:58 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:59.220 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:58 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:59.220 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:58 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:59.220 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:58 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:59.220 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:58 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:59.220 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:58 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:59.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:58 smithi181 ceph-mon[25762]: from='client.15666 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T14:00:59.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:58 smithi181 ceph-mon[25762]: pgmap v1405: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-03-30T14:00:59.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:58 smithi181 ceph-mon[25762]: pgmap v1406: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-03-30T14:00:59.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:58 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:59.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:58 smithi181 ceph-mon[25762]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-03-30T14:00:59.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:58 smithi181 ceph-mon[25762]: pgmap v1407: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-03-30T14:00:59.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:58 smithi181 ceph-mon[25762]: pgmap v1408: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 908 B/s rd, 0 op/s 2024-03-30T14:00:59.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:58 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:59.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:58 smithi181 ceph-mon[25762]: pgmap v1409: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-03-30T14:00:59.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:58 smithi181 ceph-mon[25762]: pgmap v1410: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 2.9 KiB/s rd, 2 op/s 2024-03-30T14:00:59.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:58 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:59.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:58 smithi181 ceph-mon[25762]: pgmap v1411: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:59.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:58 smithi181 ceph-mon[25762]: pgmap v1412: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:00:59.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:58 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:00:59.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:58 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:59.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:58 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:59.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:58 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:59.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:58 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:59.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:58 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:59.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:58 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:59.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:58 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:59.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:58 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:59.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:58 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:59.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:58 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:59.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:58 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:59.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:58 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:59.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:58 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:59.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:58 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:59.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:58 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:59.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:58 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:59.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:58 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:59.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:58 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:59.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:58 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:59.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:58 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:59.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:58 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:59.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:58 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:59.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:58 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:59.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:58 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:59.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:58 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:59.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:58 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:00:59.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:58 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:00:59.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:58 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:00:59.253 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:58 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:00:59.253 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:58 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:00:59.485 INFO:journalctl@ceph.alertmanager.a.smithi099.stdout:Mar 30 14:00:59 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-alertmanager-a[115391]: ts=2024-03-30T14:00:59.286Z caller=cluster.go:706 level=info component=cluster msg="gossip not settled" polls=0 before=0 now=1 elapsed=2.000786125s 2024-03-30T14:01:00.169 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:59 smithi099 ceph-mon[29691]: pgmap v1413: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:00.169 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:59 smithi099 ceph-mon[29691]: pgmap v1414: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:00.169 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:59 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:01:00.169 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:59 smithi099 ceph-mon[29691]: pgmap v1415: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:00.169 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:59 smithi099 ceph-mon[29691]: pgmap v1416: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:00.169 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:59 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:01:00.169 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:59 smithi099 ceph-mon[29691]: pgmap v1417: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:00.170 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:59 smithi099 ceph-mon[29691]: pgmap v1418: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:00.170 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:59 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:01:00.170 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:59 smithi099 ceph-mon[29691]: pgmap v1419: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:00.170 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:59 smithi099 ceph-mon[29691]: pgmap v1420: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:00.170 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:59 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:01:00.170 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:59 smithi099 ceph-mon[29691]: pgmap v1421: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:00.170 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:59 smithi099 ceph-mon[29691]: pgmap v1422: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:00.170 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:59 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:01:00.170 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:59 smithi099 ceph-mon[29691]: pgmap v1423: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:00.170 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:59 smithi099 ceph-mon[29691]: pgmap v1424: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:00.170 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:59 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:01:00.170 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:59 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:01:00.170 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:59 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:00.170 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:59 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:01:00.171 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:59 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:01:00.171 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:59 smithi099 ceph-mon[29691]: pgmap v1425: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:00.171 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:59 smithi099 ceph-mon[29691]: pgmap v1426: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:00.171 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:59 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:00.171 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:59 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:01:00.171 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:59 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:01:00.171 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:59 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:00.171 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:59 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:01:00.171 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:59 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:01:00.171 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:59 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:00.171 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:59 smithi099 ceph-mon[24912]: pgmap v1413: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:00.172 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:59 smithi099 ceph-mon[24912]: pgmap v1414: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:00.172 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:59 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:01:00.172 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:59 smithi099 ceph-mon[24912]: pgmap v1415: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:00.172 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:59 smithi099 ceph-mon[24912]: pgmap v1416: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:00.172 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:59 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:01:00.172 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:59 smithi099 ceph-mon[24912]: pgmap v1417: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:00.172 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:59 smithi099 ceph-mon[24912]: pgmap v1418: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:00.172 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:59 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:01:00.172 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:59 smithi099 ceph-mon[24912]: pgmap v1419: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:00.172 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:59 smithi099 ceph-mon[24912]: pgmap v1420: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:00.172 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:59 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:01:00.172 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:59 smithi099 ceph-mon[24912]: pgmap v1421: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:00.172 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:59 smithi099 ceph-mon[24912]: pgmap v1422: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:00.173 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:59 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:01:00.173 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:59 smithi099 ceph-mon[24912]: pgmap v1423: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:00.173 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:59 smithi099 ceph-mon[24912]: pgmap v1424: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:00.173 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:59 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:01:00.173 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:59 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:01:00.173 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:59 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:00.173 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:59 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:01:00.173 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:59 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:01:00.173 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:59 smithi099 ceph-mon[24912]: pgmap v1425: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:00.173 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:59 smithi099 ceph-mon[24912]: pgmap v1426: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:00.173 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:59 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:00.173 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:59 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:01:00.173 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:59 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:01:00.173 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:59 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:00.173 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:59 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:01:00.174 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:59 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:01:00.174 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:59 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:00.174 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:59 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:01:00.174 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:59 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:00.174 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:59 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:01:00.174 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:59 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:01:00.174 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:59 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:00.174 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:59 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:01:00.175 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:59 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:00.175 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:59 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:01:00.175 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:59 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:01:00.175 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:59 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:00.175 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:59 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:01:00.175 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:59 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:00.175 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:59 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:01:00.175 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:59 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:01:00.175 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:59 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:00.175 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:59 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:01:00.175 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:59 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:00.175 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:59 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:01:00.175 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:59 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:01:00.175 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:59 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:00.175 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:59 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:01:00.175 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:59 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:00.176 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:59 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:01:00.176 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:59 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:01:00.176 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:59 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:00.176 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:59 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:01:00.176 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:59 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:00.176 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:59 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:01:00.176 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:59 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:01:00.176 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:59 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:00.176 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:59 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:01:00.176 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:59 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:00.176 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:59 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:01:00.176 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:59 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:01:00.176 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:59 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:00.176 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:59 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:01:00.176 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:59 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:00.177 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:59 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:01:00.177 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:59 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:01:00.177 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:59 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:00.177 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:59 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:01:00.177 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:59 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:00.177 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:59 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:01:00.177 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:59 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:01:00.177 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:00:59 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:00.177 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:59 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:01:00.177 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:59 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:00.178 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:59 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:01:00.178 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:59 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:01:00.178 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:59 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:00.178 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:59 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:01:00.178 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:59 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:00.178 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:59 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:01:00.178 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:59 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:01:00.178 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:59 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:00.178 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:59 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:01:00.178 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:59 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:00.178 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:59 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:01:00.178 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:59 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:01:00.178 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:59 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:00.178 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:59 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:01:00.179 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:59 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:00.179 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:59 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:01:00.179 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:59 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:01:00.179 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:59 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:00.179 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:59 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:01:00.179 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:59 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:00.179 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:59 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:01:00.179 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:59 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:01:00.179 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:59 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:00.179 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:59 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:01:00.179 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:59 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:00.179 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:59 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:01:00.179 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:59 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:01:00.179 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:59 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:00.179 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:59 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:01:00.179 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:59 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:00.180 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:59 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:01:00.180 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:59 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:01:00.180 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:59 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:00.180 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:59 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:01:00.180 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:59 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:00.180 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:59 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:01:00.180 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:59 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:01:00.180 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:59 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:00.180 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:59 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:01:00.180 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:59 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:00.180 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:59 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:01:00.180 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:59 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:01:00.181 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:00:59 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:00.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:59 smithi181 ceph-mon[25762]: pgmap v1413: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:00.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:59 smithi181 ceph-mon[25762]: pgmap v1414: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:00.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:59 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:01:00.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:59 smithi181 ceph-mon[25762]: pgmap v1415: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:00.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:59 smithi181 ceph-mon[25762]: pgmap v1416: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:00.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:59 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:01:00.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:59 smithi181 ceph-mon[25762]: pgmap v1417: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:00.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:59 smithi181 ceph-mon[25762]: pgmap v1418: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:00.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:59 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:01:00.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:59 smithi181 ceph-mon[25762]: pgmap v1419: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:00.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:59 smithi181 ceph-mon[25762]: pgmap v1420: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:00.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:59 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:01:00.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:59 smithi181 ceph-mon[25762]: pgmap v1421: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:00.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:59 smithi181 ceph-mon[25762]: pgmap v1422: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:00.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:59 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:01:00.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:59 smithi181 ceph-mon[25762]: pgmap v1423: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:00.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:59 smithi181 ceph-mon[25762]: pgmap v1424: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:00.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:59 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:01:00.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:59 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:01:00.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:59 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:00.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:59 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:01:00.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:59 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:01:00.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:59 smithi181 ceph-mon[25762]: pgmap v1425: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:00.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:59 smithi181 ceph-mon[25762]: pgmap v1426: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:00.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:59 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:00.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:59 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:01:00.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:59 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:01:00.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:59 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:00.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:59 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:01:00.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:59 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:01:00.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:59 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:00.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:59 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:01:00.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:59 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:00.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:59 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:01:00.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:59 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:01:00.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:59 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:00.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:59 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:01:00.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:59 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:00.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:59 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:01:00.253 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:59 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:01:00.253 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:59 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:00.253 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:59 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:01:00.253 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:59 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:00.253 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:59 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:01:00.253 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:59 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:01:00.253 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:59 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:00.253 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:59 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:01:00.253 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:59 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:00.253 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:59 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:01:00.253 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:59 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:01:00.253 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:59 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:00.253 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:59 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:01:00.253 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:59 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:00.253 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:59 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:01:00.254 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:59 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:01:00.254 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:59 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:00.254 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:59 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:01:00.254 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:59 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:00.254 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:59 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:01:00.254 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:59 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:01:00.254 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:59 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:00.254 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:59 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:01:00.254 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:59 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:00.254 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:59 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:01:00.254 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:59 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:01:00.254 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:59 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:00.254 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:59 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:01:00.254 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:59 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:00.255 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:59 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:01:00.255 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:59 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:01:00.255 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:59 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:00.255 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:59 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:01:00.255 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:59 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:00.255 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:59 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:01:00.255 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:59 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:01:00.255 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:00:59 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:01.002 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:00 smithi181 ceph-mon[25762]: pgmap v1427: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:01.002 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:00 smithi181 ceph-mon[25762]: pgmap v1428: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:01.003 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:00 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:01:01.003 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:00 smithi181 ceph-mon[25762]: pgmap v1429: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:01.003 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:00 smithi181 ceph-mon[25762]: pgmap v1430: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:01.003 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:00 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:01:01.003 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:00 smithi181 ceph-mon[25762]: pgmap v1431: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:01.003 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:00 smithi181 ceph-mon[25762]: pgmap v1432: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:01.003 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:00 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:01:01.003 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:00 smithi181 ceph-mon[25762]: pgmap v1433: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:01.003 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:00 smithi181 ceph-mon[25762]: pgmap v1434: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:01.003 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:00 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:01:01.003 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:00 smithi181 ceph-mon[25762]: pgmap v1435: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:01.003 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:00 smithi181 ceph-mon[25762]: pgmap v1436: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:01.003 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:00 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:01:01.003 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:00 smithi181 ceph-mon[25762]: pgmap v1437: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:01.004 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:00 smithi181 ceph-mon[25762]: pgmap v1438: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:01.004 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:00 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:01:01.004 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:00 smithi181 ceph-mon[25762]: pgmap v1439: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:01.004 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:00 smithi181 ceph-mon[25762]: pgmap v1440: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:01.004 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:00 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:01:01.004 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:00 smithi181 ceph-mon[25762]: pgmap v1441: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:01.004 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:00 smithi181 ceph-mon[25762]: pgmap v1442: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:01.004 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:00 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:01:01.004 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:00 smithi181 ceph-mon[25762]: pgmap v1443: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:01.004 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:00 smithi181 ceph-mon[25762]: pgmap v1444: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:01.004 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:00 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:01:01.004 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:00 smithi181 ceph-mon[25762]: pgmap v1445: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:01.004 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:00 smithi181 ceph-mon[25762]: pgmap v1446: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:01.004 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:00 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:01:01.004 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:00 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:01:01.005 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:00 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:01.005 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:00 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:01:01.005 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:00 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:01:01.005 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:00 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:01.005 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:00 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:01:01.005 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:00 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:01.005 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:00 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:01:01.006 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:00 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:01:01.006 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:00 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:01.006 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:00 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:01:01.006 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:00 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:01.006 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:00 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:01:01.006 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:00 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:01:01.006 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:00 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:01.006 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:00 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:01:01.006 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:00 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:01.006 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:00 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:01:01.006 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:00 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:01:01.006 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:00 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:01.006 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:00 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:01:01.006 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:00 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:01.006 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:00 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:01:01.007 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:00 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:01:01.007 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:00 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:01.007 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:00 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:01:01.007 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:00 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:01.007 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:00 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:01:01.007 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:00 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:01:01.008 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:00 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:01.008 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:00 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:01:01.008 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:00 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:01.008 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:00 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:01:01.008 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:00 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:01:01.008 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:00 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:01.008 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:00 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:01:01.009 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:00 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:01.009 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:00 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:01:01.009 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:00 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:01:01.009 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:00 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:01.009 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:00 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T14:01:01.009 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:00 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:01:01.009 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:00 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:01.009 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:00 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:01:01.009 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:00 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:01:01.009 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:00 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:01.009 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:00 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:01.009 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:00 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:01.009 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:00 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:01.241 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:00 smithi099 ceph-mon[24912]: pgmap v1427: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:01.241 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:00 smithi099 ceph-mon[24912]: pgmap v1428: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:01.241 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:00 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:01:01.241 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:00 smithi099 ceph-mon[24912]: pgmap v1429: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:01.241 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:00 smithi099 ceph-mon[24912]: pgmap v1430: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:01.242 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:00 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:01:01.242 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:00 smithi099 ceph-mon[24912]: pgmap v1431: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:01.242 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:00 smithi099 ceph-mon[24912]: pgmap v1432: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:01.242 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:00 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:01:01.242 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:00 smithi099 ceph-mon[24912]: pgmap v1433: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:01.242 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:00 smithi099 ceph-mon[24912]: pgmap v1434: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:01.242 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:00 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:01:01.242 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:00 smithi099 ceph-mon[24912]: pgmap v1435: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:01.242 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:00 smithi099 ceph-mon[24912]: pgmap v1436: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:01.242 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:00 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:01:01.242 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:00 smithi099 ceph-mon[24912]: pgmap v1437: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:01.242 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:00 smithi099 ceph-mon[24912]: pgmap v1438: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:01.242 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:00 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:01:01.242 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:00 smithi099 ceph-mon[24912]: pgmap v1439: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:01.243 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:00 smithi099 ceph-mon[24912]: pgmap v1440: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:01.243 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:00 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:01:01.243 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:00 smithi099 ceph-mon[24912]: pgmap v1441: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:01.243 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:00 smithi099 ceph-mon[24912]: pgmap v1442: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:01.243 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:00 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:01:01.243 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:00 smithi099 ceph-mon[24912]: pgmap v1443: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:01.243 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:00 smithi099 ceph-mon[24912]: pgmap v1444: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:01.243 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:00 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:01:01.243 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:00 smithi099 ceph-mon[24912]: pgmap v1445: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:01.243 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:00 smithi099 ceph-mon[24912]: pgmap v1446: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:01.243 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:00 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:01:01.243 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:00 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:01:01.243 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:00 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:01.244 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:00 smithi099 ceph-mon[29691]: pgmap v1427: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:01.244 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:00 smithi099 ceph-mon[29691]: pgmap v1428: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:01.244 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:00 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:01:01.244 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:00 smithi099 ceph-mon[29691]: pgmap v1429: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:01.244 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:00 smithi099 ceph-mon[29691]: pgmap v1430: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:01.244 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:00 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:01:01.244 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:00 smithi099 ceph-mon[29691]: pgmap v1431: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:01.244 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:00 smithi099 ceph-mon[29691]: pgmap v1432: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:01.244 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:00 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:01:01.244 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:00 smithi099 ceph-mon[29691]: pgmap v1433: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:01.244 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:00 smithi099 ceph-mon[29691]: pgmap v1434: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:01.245 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:00 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:01:01.245 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:00 smithi099 ceph-mon[29691]: pgmap v1435: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:01.245 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:00 smithi099 ceph-mon[29691]: pgmap v1436: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:01.245 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:00 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:01:01.245 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:00 smithi099 ceph-mon[29691]: pgmap v1437: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:01.245 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:00 smithi099 ceph-mon[29691]: pgmap v1438: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:01.245 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:00 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:01:01.245 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:00 smithi099 ceph-mon[29691]: pgmap v1439: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:01.245 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:00 smithi099 ceph-mon[29691]: pgmap v1440: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:01.245 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:00 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:01:01.245 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:00 smithi099 ceph-mon[29691]: pgmap v1441: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:01.245 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:00 smithi099 ceph-mon[29691]: pgmap v1442: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:01.245 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:00 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:01:01.245 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:00 smithi099 ceph-mon[29691]: pgmap v1443: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:01.245 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:00 smithi099 ceph-mon[29691]: pgmap v1444: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:01.246 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:00 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:01:01.246 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:00 smithi099 ceph-mon[29691]: pgmap v1445: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:01.246 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:00 smithi099 ceph-mon[29691]: pgmap v1446: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:01.246 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:00 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:01:01.246 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:00 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:01:01.246 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:00 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:01.246 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:00 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:01:01.246 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:00 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:01:01.246 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:00 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:01.246 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:00 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:01:01.247 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:00 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:01.247 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:00 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:01:01.247 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:00 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:01:01.247 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:00 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:01.247 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:00 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:01:01.247 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:00 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:01.247 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:00 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:01:01.247 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:00 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:01:01.247 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:00 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:01.247 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:00 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:01:01.247 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:00 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:01.247 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:00 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:01:01.247 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:00 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:01:01.247 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:00 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:01.247 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:00 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:01:01.248 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:00 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:01.248 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:00 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:01:01.248 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:00 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:01:01.248 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:00 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:01.248 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:00 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:01:01.248 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:00 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:01.248 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:00 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:01:01.248 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:00 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:01:01.248 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:00 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:01.249 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:00 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:01:01.249 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:00 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:01:01.249 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:00 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:01:01.249 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:00 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:01.249 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:00 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:01:01.250 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:00 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:01.250 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:00 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:01:01.250 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:00 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:01:01.250 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:00 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:01.250 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:00 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:01:01.250 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:00 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:01.250 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:00 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:01:01.250 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:00 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:01:01.250 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:00 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:01.250 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:00 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:01:01.250 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:00 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:01.250 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:00 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:01:01.250 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:00 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:01:01.251 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:00 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:01.251 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:00 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:01:01.251 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:00 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:01.251 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:00 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:01:01.251 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:00 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:01:01.251 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:00 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:01.251 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:00 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:01:01.251 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:00 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:01.251 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:00 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:01:01.251 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:00 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:01:01.251 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:00 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:01.251 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:00 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:01:01.252 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:00 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:01.252 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:00 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:01:01.252 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:00 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:01:01.252 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:00 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:01.252 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:00 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:01:01.252 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:00 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:01.252 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:00 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:01:01.252 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:00 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:01:01.252 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:00 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:01.252 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:00 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T14:01:01.252 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:00 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:01:01.252 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:00 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:01.252 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:00 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:01:01.253 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:00 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:01:01.253 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:00 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:01.253 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:00 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:01.253 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:00 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:01.253 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:00 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:01.253 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:00 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:01.253 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:00 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:01:01.253 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:00 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:01:01.253 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:00 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:01.253 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:00 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:01:01.253 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:00 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:01.253 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:00 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:01:01.253 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:00 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:01:01.254 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:00 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:01.254 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:00 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T14:01:01.254 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:00 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:01:01.254 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:00 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:01.254 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:00 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:01:01.254 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:00 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:01:01.254 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:00 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:01.254 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:00 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:01.254 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:00 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:01.254 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:00 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:02.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:01 smithi181 ceph-mon[25762]: pgmap v1447: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:02.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:01 smithi181 ceph-mon[25762]: pgmap v1448: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:02.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:01 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:01:02.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:01 smithi181 ceph-mon[25762]: pgmap v1449: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:02.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:01 smithi181 ceph-mon[25762]: pgmap v1450: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:02.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:01 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:01:02.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:01 smithi181 ceph-mon[25762]: pgmap v1451: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:02.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:01 smithi181 ceph-mon[25762]: pgmap v1452: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:02.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:01 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:01:02.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:01 smithi181 ceph-mon[25762]: pgmap v1453: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:02.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:01 smithi181 ceph-mon[25762]: pgmap v1454: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:02.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:01 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:01:02.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:01 smithi181 ceph-mon[25762]: pgmap v1455: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:02.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:01 smithi181 ceph-mon[25762]: pgmap v1456: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:02.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:01 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:01:02.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:01 smithi181 ceph-mon[25762]: pgmap v1457: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:02.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:01 smithi181 ceph-mon[25762]: pgmap v1458: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:02.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:01 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:01:02.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:01 smithi181 ceph-mon[25762]: pgmap v1459: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:02.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:01 smithi181 ceph-mon[25762]: pgmap v1460: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:02.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:01 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:01:02.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:01 smithi181 ceph-mon[25762]: pgmap v1461: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:02.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:01 smithi181 ceph-mon[25762]: pgmap v1462: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:02.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:01 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:01:02.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:01 smithi181 ceph-mon[25762]: pgmap v1463: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:02.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:01 smithi181 ceph-mon[25762]: pgmap v1464: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:02.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:01 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:01:02.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:01 smithi181 ceph-mon[25762]: pgmap v1465: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:02.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:01 smithi181 ceph-mon[25762]: pgmap v1466: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:02.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:01 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:01:02.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:01 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:02.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:01 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:02.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:01 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:02.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:01 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:02.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:01 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:02.253 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:01 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:02.253 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:01 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:02.253 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:01 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:02.253 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:01 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:02.253 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:01 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:02.331 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:01 smithi099 ceph-mon[29691]: pgmap v1447: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:02.331 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:01 smithi099 ceph-mon[29691]: pgmap v1448: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:02.331 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:01 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:01:02.331 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:01 smithi099 ceph-mon[29691]: pgmap v1449: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:02.331 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:01 smithi099 ceph-mon[29691]: pgmap v1450: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:02.331 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:01 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:01:02.331 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:01 smithi099 ceph-mon[29691]: pgmap v1451: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:02.331 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:01 smithi099 ceph-mon[29691]: pgmap v1452: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:02.331 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:01 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:01:02.331 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:01 smithi099 ceph-mon[29691]: pgmap v1453: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:02.331 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:01 smithi099 ceph-mon[29691]: pgmap v1454: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:02.332 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:01 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:01:02.332 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:01 smithi099 ceph-mon[29691]: pgmap v1455: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:02.332 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:01 smithi099 ceph-mon[29691]: pgmap v1456: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:02.332 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:01 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:01:02.332 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:01 smithi099 ceph-mon[29691]: pgmap v1457: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:02.332 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:01 smithi099 ceph-mon[29691]: pgmap v1458: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:02.332 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:01 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:01:02.332 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:01 smithi099 ceph-mon[29691]: pgmap v1459: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:02.332 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:01 smithi099 ceph-mon[29691]: pgmap v1460: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:02.332 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:01 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:01:02.332 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:01 smithi099 ceph-mon[29691]: pgmap v1461: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:02.332 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:01 smithi099 ceph-mon[29691]: pgmap v1462: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:02.332 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:01 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:01:02.332 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:01 smithi099 ceph-mon[29691]: pgmap v1463: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:02.332 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:01 smithi099 ceph-mon[29691]: pgmap v1464: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:02.332 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:01 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:01:02.333 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:01 smithi099 ceph-mon[29691]: pgmap v1465: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:02.333 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:01 smithi099 ceph-mon[29691]: pgmap v1466: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:02.333 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:01 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:01:02.333 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:01 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:02.333 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:01 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:02.333 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:01 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:02.333 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:01 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:02.333 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:01 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:02.333 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:01 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:02.333 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:01 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:02.333 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:01 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:02.333 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:01 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:02.333 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:01 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:02.334 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:01 smithi099 ceph-mon[24912]: pgmap v1447: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:02.334 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:01 smithi099 ceph-mon[24912]: pgmap v1448: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:02.334 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:01 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:01:02.334 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:01 smithi099 ceph-mon[24912]: pgmap v1449: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:02.334 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:01 smithi099 ceph-mon[24912]: pgmap v1450: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:02.334 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:01 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:01:02.334 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:01 smithi099 ceph-mon[24912]: pgmap v1451: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:02.334 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:01 smithi099 ceph-mon[24912]: pgmap v1452: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:02.334 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:01 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:01:02.334 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:01 smithi099 ceph-mon[24912]: pgmap v1453: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:02.334 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:01 smithi099 ceph-mon[24912]: pgmap v1454: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:02.335 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:01 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:01:02.335 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:01 smithi099 ceph-mon[24912]: pgmap v1455: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:02.335 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:01 smithi099 ceph-mon[24912]: pgmap v1456: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:02.335 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:01 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:01:02.335 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:01 smithi099 ceph-mon[24912]: pgmap v1457: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:02.335 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:01 smithi099 ceph-mon[24912]: pgmap v1458: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:02.335 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:01 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:01:02.335 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:01 smithi099 ceph-mon[24912]: pgmap v1459: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:02.335 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:01 smithi099 ceph-mon[24912]: pgmap v1460: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:02.335 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:01 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:01:02.335 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:01 smithi099 ceph-mon[24912]: pgmap v1461: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:02.335 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:01 smithi099 ceph-mon[24912]: pgmap v1462: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:02.335 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:01 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:01:02.335 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:01 smithi099 ceph-mon[24912]: pgmap v1463: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:02.335 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:01 smithi099 ceph-mon[24912]: pgmap v1464: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:02.336 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:01 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:01:02.336 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:01 smithi099 ceph-mon[24912]: pgmap v1465: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:02.336 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:01 smithi099 ceph-mon[24912]: pgmap v1466: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:02.336 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:01 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:01:02.336 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:01 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:02.336 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:01 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:02.336 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:01 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:02.336 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:01 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:02.336 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:01 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:02.336 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:01 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:02.336 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:01 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:02.336 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:01 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:02.336 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:01 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:02.336 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:01 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:03.922 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:03 smithi099 ceph-mon[24912]: pgmap v1467: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 2.2 KiB/s rd, 2 op/s 2024-03-30T14:01:03.922 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:03 smithi099 ceph-mon[29691]: pgmap v1467: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 2.2 KiB/s rd, 2 op/s 2024-03-30T14:01:04.249 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:03 smithi181 ceph-mon[25762]: pgmap v1467: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 2.2 KiB/s rd, 2 op/s 2024-03-30T14:01:05.059 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:04 smithi099 ceph-mon[24912]: from='client.25136 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T14:01:05.059 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:04 smithi099 ceph-mon[29691]: from='client.25136 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T14:01:05.060 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 14:01:04 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[71049]: ::ffff:172.21.15.181 - - [30/Mar/2024:14:01:04] "GET /metrics HTTP/1.1" 200 37993 "" "Prometheus/2.43.0" 2024-03-30T14:01:05.249 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:04 smithi181 ceph-mon[25762]: from='client.25136 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T14:01:06.249 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:05 smithi181 ceph-mon[25762]: Upgrade: Updating alertmanager.a 2024-03-30T14:01:06.249 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:05 smithi181 ceph-mon[25762]: Deploying daemon alertmanager.a on smithi099 2024-03-30T14:01:06.249 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:05 smithi181 ceph-mon[25762]: pgmap v1468: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T14:01:06.330 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:05 smithi099 ceph-mon[24912]: Upgrade: Updating alertmanager.a 2024-03-30T14:01:06.330 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:05 smithi099 ceph-mon[24912]: Deploying daemon alertmanager.a on smithi099 2024-03-30T14:01:06.330 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:05 smithi099 ceph-mon[24912]: pgmap v1468: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T14:01:06.331 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:05 smithi099 ceph-mon[29691]: Upgrade: Updating alertmanager.a 2024-03-30T14:01:06.331 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:05 smithi099 ceph-mon[29691]: Deploying daemon alertmanager.a on smithi099 2024-03-30T14:01:06.331 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:05 smithi099 ceph-mon[29691]: pgmap v1468: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T14:01:07.580 INFO:journalctl@ceph.alertmanager.a.smithi099.stdout:Mar 30 14:01:07 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-alertmanager-a[115391]: ts=2024-03-30T14:01:07.288Z caller=cluster.go:698 level=info component=cluster msg="gossip settled; proceeding" elapsed=10.003604992s 2024-03-30T14:01:08.223 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:07 smithi099 ceph-mon[24912]: pgmap v1469: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-03-30T14:01:08.223 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:07 smithi099 ceph-mon[29691]: pgmap v1469: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-03-30T14:01:08.249 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:07 smithi181 ceph-mon[25762]: pgmap v1469: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-03-30T14:01:08.580 INFO:journalctl@ceph.alertmanager.a.smithi099.stdout:Mar 30 14:01:08 smithi099 systemd[1]: Stopping Ceph alertmanager.a for 98ebaeb8-ee99-11ee-b647-cb9ed24678a4... 2024-03-30T14:01:09.580 INFO:journalctl@ceph.alertmanager.a.smithi099.stdout:Mar 30 14:01:09 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-alertmanager-a[115391]: ts=2024-03-30T14:01:09.320Z caller=main.go:583 level=info msg="Received SIGTERM, exiting gracefully..." 2024-03-30T14:01:09.580 INFO:journalctl@ceph.alertmanager.a.smithi099.stdout:Mar 30 14:01:09 smithi099 podman[117478]: 2024-03-30 14:01:09.341387969 +0000 UTC m=+0.362691050 container died 0dfa689eb2c323c12d762f09779cc0eaa2649802d3bcf3b243603fa68aaee315 (image=quay.io/prometheus/alertmanager:v0.25.0, name=ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-alertmanager-a, maintainer=The Prometheus Authors ) 2024-03-30T14:01:09.879 INFO:journalctl@ceph.alertmanager.a.smithi099.stdout:Mar 30 14:01:09 smithi099 podman[117478]: 2024-03-30 14:01:09.7043755 +0000 UTC m=+0.725678595 container cleanup 0dfa689eb2c323c12d762f09779cc0eaa2649802d3bcf3b243603fa68aaee315 (image=quay.io/prometheus/alertmanager:v0.25.0, name=ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-alertmanager-a, maintainer=The Prometheus Authors ) 2024-03-30T14:01:09.879 INFO:journalctl@ceph.alertmanager.a.smithi099.stdout:Mar 30 14:01:09 smithi099 bash[117478]: ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-alertmanager-a 2024-03-30T14:01:10.249 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:09 smithi181 ceph-mon[25762]: pgmap v1470: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T14:01:10.294 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:09 smithi099 ceph-mon[24912]: pgmap v1470: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T14:01:10.294 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:09 smithi099 ceph-mon[29691]: pgmap v1470: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T14:01:10.294 INFO:journalctl@ceph.alertmanager.a.smithi099.stdout:Mar 30 14:01:09 smithi099 podman[117528]: 2024-03-30 14:01:09.997389573 +0000 UTC m=+0.655863192 container remove 0dfa689eb2c323c12d762f09779cc0eaa2649802d3bcf3b243603fa68aaee315 (image=quay.io/prometheus/alertmanager:v0.25.0, name=ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-alertmanager-a, maintainer=The Prometheus Authors ) 2024-03-30T14:01:10.294 INFO:journalctl@ceph.alertmanager.a.smithi099.stdout:Mar 30 14:01:10 smithi099 podman[117528]: 2024-03-30 14:01:10.073115965 +0000 UTC m=+0.731589584 volume remove c2ec592fc5f444d0e38e6e9c6835fc8d38cf7c9b1d63dce049518a4ec00c51b3 2024-03-30T14:01:11.080 INFO:journalctl@ceph.alertmanager.a.smithi099.stdout:Mar 30 14:01:10 smithi099 systemd[1]: ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4@alertmanager.a.service: Deactivated successfully. 2024-03-30T14:01:11.080 INFO:journalctl@ceph.alertmanager.a.smithi099.stdout:Mar 30 14:01:10 smithi099 systemd[1]: Stopped Ceph alertmanager.a for 98ebaeb8-ee99-11ee-b647-cb9ed24678a4. 2024-03-30T14:01:11.249 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:11 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:11.249 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:11 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:11.249 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:11 smithi181 ceph-mon[25762]: pgmap v1471: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-03-30T14:01:11.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:11 smithi181 ceph-mon[25762]: pgmap v1472: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-03-30T14:01:11.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:11 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:11.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:11 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:11.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:11 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:11.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:11 smithi181 ceph-mon[25762]: pgmap v1473: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 642 B/s rd, 0 op/s 2024-03-30T14:01:11.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:11 smithi181 ceph-mon[25762]: pgmap v1474: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 858 B/s rd, 0 op/s 2024-03-30T14:01:11.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:11 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:11.448 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:11 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:11.448 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:11 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:11.448 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:11 smithi099 ceph-mon[24912]: pgmap v1471: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-03-30T14:01:11.448 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:11 smithi099 ceph-mon[24912]: pgmap v1472: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-03-30T14:01:11.448 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:11 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:11.448 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:11 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:11.448 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:11 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:11.448 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:11 smithi099 ceph-mon[24912]: pgmap v1473: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 642 B/s rd, 0 op/s 2024-03-30T14:01:11.448 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:11 smithi099 ceph-mon[24912]: pgmap v1474: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 858 B/s rd, 0 op/s 2024-03-30T14:01:11.448 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:11 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:11.449 INFO:journalctl@ceph.alertmanager.a.smithi099.stdout:Mar 30 14:01:11 smithi099 systemd[1]: Starting Ceph alertmanager.a for 98ebaeb8-ee99-11ee-b647-cb9ed24678a4... 2024-03-30T14:01:11.449 INFO:journalctl@ceph.alertmanager.a.smithi099.stdout:Mar 30 14:01:11 smithi099 podman[117806]: 2024-03-30 14:01:11.229040754 +0000 UTC m=+0.020246678 image pull c8568f914cd25b2062c44e9f79f9c18da6e3b85fe0c47a12a2191c61426c2b19 quay.io/prometheus/alertmanager:v0.25.0 2024-03-30T14:01:11.449 INFO:journalctl@ceph.alertmanager.a.smithi099.stdout:Mar 30 14:01:11 smithi099 podman[117806]: 2024-03-30 14:01:11.328317518 +0000 UTC m=+0.119523441 volume create 87ec3bce5a02f3338eec00111b2129e153c99a6928f17f509ba0c94f68e963c5 2024-03-30T14:01:11.449 INFO:journalctl@ceph.alertmanager.a.smithi099.stdout:Mar 30 14:01:11 smithi099 podman[117806]: 2024-03-30 14:01:11.453953441 +0000 UTC m=+0.245159364 container create 08735152b67d8c179c8f934bdfc04f3c8e756f4a5ecbd48b8119498096b56537 (image=quay.io/prometheus/alertmanager:v0.25.0, name=ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-alertmanager-a, maintainer=The Prometheus Authors ) 2024-03-30T14:01:11.449 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:11 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:11.449 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:11 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:11.449 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:11 smithi099 ceph-mon[29691]: pgmap v1471: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-03-30T14:01:11.449 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:11 smithi099 ceph-mon[29691]: pgmap v1472: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-03-30T14:01:11.450 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:11 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:11.450 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:11 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:11.450 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:11 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:11.450 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:11 smithi099 ceph-mon[29691]: pgmap v1473: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 642 B/s rd, 0 op/s 2024-03-30T14:01:11.450 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:11 smithi099 ceph-mon[29691]: pgmap v1474: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 858 B/s rd, 0 op/s 2024-03-30T14:01:11.450 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:11 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:12.080 INFO:journalctl@ceph.alertmanager.a.smithi099.stdout:Mar 30 14:01:11 smithi099 podman[117806]: 2024-03-30 14:01:11.757318537 +0000 UTC m=+0.548524461 container init 08735152b67d8c179c8f934bdfc04f3c8e756f4a5ecbd48b8119498096b56537 (image=quay.io/prometheus/alertmanager:v0.25.0, name=ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-alertmanager-a, maintainer=The Prometheus Authors ) 2024-03-30T14:01:12.080 INFO:journalctl@ceph.alertmanager.a.smithi099.stdout:Mar 30 14:01:11 smithi099 podman[117806]: 2024-03-30 14:01:11.759983726 +0000 UTC m=+0.551189649 container start 08735152b67d8c179c8f934bdfc04f3c8e756f4a5ecbd48b8119498096b56537 (image=quay.io/prometheus/alertmanager:v0.25.0, name=ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-alertmanager-a, maintainer=The Prometheus Authors ) 2024-03-30T14:01:12.081 INFO:journalctl@ceph.alertmanager.a.smithi099.stdout:Mar 30 14:01:11 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-alertmanager-a[117844]: ts=2024-03-30T14:01:11.771Z caller=main.go:240 level=info msg="Starting Alertmanager" version="(version=0.25.0, branch=HEAD, revision=258fab7cdd551f2cf251ed0348f0ad7289aee789)" 2024-03-30T14:01:12.081 INFO:journalctl@ceph.alertmanager.a.smithi099.stdout:Mar 30 14:01:11 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-alertmanager-a[117844]: ts=2024-03-30T14:01:11.772Z caller=main.go:241 level=info build_context="(go=go1.19.4, user=root@abe866dd5717, date=20221222-14:51:36)" 2024-03-30T14:01:12.081 INFO:journalctl@ceph.alertmanager.a.smithi099.stdout:Mar 30 14:01:11 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-alertmanager-a[117844]: ts=2024-03-30T14:01:11.773Z caller=cluster.go:185 level=info component=cluster msg="setting advertise address explicitly" addr=172.21.15.99 port=9094 2024-03-30T14:01:12.081 INFO:journalctl@ceph.alertmanager.a.smithi099.stdout:Mar 30 14:01:11 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-alertmanager-a[117844]: ts=2024-03-30T14:01:11.775Z caller=cluster.go:681 level=info component=cluster msg="Waiting for gossip to settle..." interval=2s 2024-03-30T14:01:12.081 INFO:journalctl@ceph.alertmanager.a.smithi099.stdout:Mar 30 14:01:11 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-alertmanager-a[117844]: ts=2024-03-30T14:01:11.797Z caller=coordinator.go:113 level=info component=configuration msg="Loading configuration file" file=/etc/alertmanager/alertmanager.yml 2024-03-30T14:01:12.081 INFO:journalctl@ceph.alertmanager.a.smithi099.stdout:Mar 30 14:01:11 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-alertmanager-a[117844]: ts=2024-03-30T14:01:11.798Z caller=coordinator.go:126 level=info component=configuration msg="Completed loading of configuration file" file=/etc/alertmanager/alertmanager.yml 2024-03-30T14:01:12.081 INFO:journalctl@ceph.alertmanager.a.smithi099.stdout:Mar 30 14:01:11 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-alertmanager-a[117844]: ts=2024-03-30T14:01:11.801Z caller=tls_config.go:232 level=info msg="Listening on" address=[::]:9093 2024-03-30T14:01:12.081 INFO:journalctl@ceph.alertmanager.a.smithi099.stdout:Mar 30 14:01:11 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-alertmanager-a[117844]: ts=2024-03-30T14:01:11.801Z caller=tls_config.go:235 level=info msg="TLS is disabled." http2=false address=[::]:9093 2024-03-30T14:01:12.081 INFO:journalctl@ceph.alertmanager.a.smithi099.stdout:Mar 30 14:01:11 smithi099 bash[117806]: 08735152b67d8c179c8f934bdfc04f3c8e756f4a5ecbd48b8119498096b56537 2024-03-30T14:01:12.081 INFO:journalctl@ceph.alertmanager.a.smithi099.stdout:Mar 30 14:01:11 smithi099 systemd[1]: Started Ceph alertmanager.a for 98ebaeb8-ee99-11ee-b647-cb9ed24678a4. 2024-03-30T14:01:12.499 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:12 smithi181 ceph-mon[25762]: Health check update: 2 failed cephadm daemon(s) (CEPHADM_FAILED_DAEMON) 2024-03-30T14:01:12.499 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:12 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:12.499 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:12 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:12.499 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:12 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:01:12.500 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:12 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:01:12.500 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:12 smithi181 ceph-mon[25762]: pgmap v1475: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 1013 B/s rd, 0 op/s 2024-03-30T14:01:12.500 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:12 smithi181 ceph-mon[25762]: pgmap v1476: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-03-30T14:01:12.500 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:12 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:12.500 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:12 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:01:12.500 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:12 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-03-30T14:01:12.500 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:12 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:01:12.500 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:12 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:12.500 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:12 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:01:12.500 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:12 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:01:12.580 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:12 smithi099 ceph-mon[29691]: Health check update: 2 failed cephadm daemon(s) (CEPHADM_FAILED_DAEMON) 2024-03-30T14:01:12.580 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:12 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:12.580 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:12 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:12.580 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:12 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:01:12.580 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:12 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:01:12.581 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:12 smithi099 ceph-mon[29691]: pgmap v1475: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 1013 B/s rd, 0 op/s 2024-03-30T14:01:12.581 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:12 smithi099 ceph-mon[29691]: pgmap v1476: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-03-30T14:01:12.581 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:12 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:12.581 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:12 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:01:12.581 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:12 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-03-30T14:01:12.581 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:12 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:01:12.581 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:12 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:12.581 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:12 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:01:12.581 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:12 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:01:12.581 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:12 smithi099 ceph-mon[24912]: Health check update: 2 failed cephadm daemon(s) (CEPHADM_FAILED_DAEMON) 2024-03-30T14:01:12.581 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:12 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:12.581 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:12 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:12.582 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:12 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:01:12.582 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:12 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:01:12.582 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:12 smithi099 ceph-mon[24912]: pgmap v1475: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 1013 B/s rd, 0 op/s 2024-03-30T14:01:12.582 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:12 smithi099 ceph-mon[24912]: pgmap v1476: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-03-30T14:01:12.582 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:12 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:12.582 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:12 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:01:12.582 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:12 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-03-30T14:01:12.582 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:12 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:01:12.582 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:12 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:12.582 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:12 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:01:12.582 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:12 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:01:13.240 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:13 smithi181 ceph-mon[25762]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-03-30T14:01:13.240 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:13 smithi181 ceph-mon[25762]: pgmap v1477: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-03-30T14:01:13.240 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:13 smithi181 ceph-mon[25762]: pgmap v1478: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-03-30T14:01:13.240 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:13 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:13.240 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:13 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:01:13.240 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:13 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:01:13.241 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:13 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:13.241 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:13 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:01:13.241 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:13 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:01:13.241 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:13 smithi181 ceph-mon[25762]: pgmap v1479: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 3.7 KiB/s rd, 3 op/s 2024-03-30T14:01:13.241 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:13 smithi181 ceph-mon[25762]: pgmap v1480: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 3.7 KiB/s rd, 3 op/s 2024-03-30T14:01:13.241 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:13 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:13.241 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:13 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:01:13.241 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:13 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:01:13.241 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:13 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:13.241 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:13 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:01:13.241 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:13 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:01:13.241 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:13 smithi181 ceph-mon[25762]: pgmap v1481: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:13.241 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:13 smithi181 ceph-mon[25762]: pgmap v1482: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:13.242 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:13 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:13.242 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:13 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:01:13.242 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:13 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:01:13.242 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:13 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:13.242 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:13 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:01:13.242 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:13 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:01:13.242 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:13 smithi181 ceph-mon[25762]: pgmap v1483: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:13.242 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:13 smithi181 ceph-mon[25762]: pgmap v1484: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:13.242 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:13 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:13.242 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:13 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:01:13.242 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:13 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:01:13.242 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:13 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:13.242 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:13 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:01:13.242 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:13 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:01:13.243 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:13 smithi181 ceph-mon[25762]: pgmap v1485: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:13.243 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:13 smithi181 ceph-mon[25762]: pgmap v1486: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:13.243 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:13 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:13.243 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:13 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:01:13.243 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:13 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:01:13.243 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:13 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:13.243 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:13 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:01:13.243 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:13 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:01:13.243 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:13 smithi181 ceph-mon[25762]: pgmap v1487: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:13.243 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:13 smithi181 ceph-mon[25762]: pgmap v1488: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:13.243 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:13 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:13.243 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:13 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:01:13.243 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:13 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:01:13.244 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:13 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:13.244 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:13 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:01:13.244 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:13 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:01:13.244 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:13 smithi181 ceph-mon[25762]: pgmap v1489: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:13.244 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:13 smithi181 ceph-mon[25762]: pgmap v1490: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:13.244 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:13 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:13.244 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:13 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:01:13.244 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:13 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:01:13.244 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:13 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:13.244 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:13 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:01:13.244 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:13 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:01:13.244 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:13 smithi181 ceph-mon[25762]: pgmap v1491: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:13.244 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:13 smithi181 ceph-mon[25762]: pgmap v1492: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:13.244 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:13 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:13.244 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:13 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:01:13.245 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:13 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:01:13.245 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:13 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:13.245 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:13 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:01:13.245 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:13 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:01:13.245 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:13 smithi181 ceph-mon[25762]: pgmap v1493: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:13.245 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:13 smithi181 ceph-mon[25762]: pgmap v1494: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:13.245 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:13 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:13.245 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:13 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:01:13.245 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:13 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:01:13.245 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:13 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:13.245 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:13 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:01:13.245 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:13 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:01:13.245 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:13 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:13.330 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:13 smithi099 ceph-mon[24912]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-03-30T14:01:13.330 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:13 smithi099 ceph-mon[24912]: pgmap v1477: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-03-30T14:01:13.331 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:13 smithi099 ceph-mon[24912]: pgmap v1478: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-03-30T14:01:13.331 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:13 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:13.331 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:13 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:01:13.331 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:13 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:01:13.331 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:13 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:13.331 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:13 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:01:13.331 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:13 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:01:13.331 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:13 smithi099 ceph-mon[24912]: pgmap v1479: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 3.7 KiB/s rd, 3 op/s 2024-03-30T14:01:13.331 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:13 smithi099 ceph-mon[24912]: pgmap v1480: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 3.7 KiB/s rd, 3 op/s 2024-03-30T14:01:13.331 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:13 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:13.331 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:13 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:01:13.331 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:13 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:01:13.331 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:13 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:13.331 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:13 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:01:13.332 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:13 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:01:13.332 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:13 smithi099 ceph-mon[24912]: pgmap v1481: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:13.332 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:13 smithi099 ceph-mon[24912]: pgmap v1482: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:13.332 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:13 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:13.332 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:13 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:01:13.332 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:13 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:01:13.332 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:13 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:13.332 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:13 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:01:13.332 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:13 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:01:13.332 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:13 smithi099 ceph-mon[24912]: pgmap v1483: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:13.332 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:13 smithi099 ceph-mon[24912]: pgmap v1484: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:13.332 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:13 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:13.332 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:13 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:01:13.332 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:13 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:01:13.333 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:13 smithi099 ceph-mon[29691]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-03-30T14:01:13.333 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:13 smithi099 ceph-mon[29691]: pgmap v1477: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-03-30T14:01:13.333 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:13 smithi099 ceph-mon[29691]: pgmap v1478: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-03-30T14:01:13.333 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:13 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:13.333 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:13 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:01:13.333 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:13 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:01:13.333 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:13 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:13.333 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:13 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:01:13.333 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:13 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:01:13.333 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:13 smithi099 ceph-mon[29691]: pgmap v1479: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 3.7 KiB/s rd, 3 op/s 2024-03-30T14:01:13.334 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:13 smithi099 ceph-mon[29691]: pgmap v1480: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 3.7 KiB/s rd, 3 op/s 2024-03-30T14:01:13.334 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:13 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:13.334 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:13 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:01:13.334 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:13 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:01:13.334 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:13 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:13.334 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:13 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:01:13.334 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:13 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:01:13.334 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:13 smithi099 ceph-mon[29691]: pgmap v1481: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:13.334 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:13 smithi099 ceph-mon[29691]: pgmap v1482: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:13.334 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:13 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:13.334 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:13 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:01:13.334 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:13 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:01:13.334 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:13 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:13.334 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:13 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:01:13.335 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:13 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:01:13.335 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:13 smithi099 ceph-mon[29691]: pgmap v1483: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:13.335 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:13 smithi099 ceph-mon[29691]: pgmap v1484: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:13.335 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:13 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:13.335 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:13 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:01:13.335 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:13 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:01:13.335 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:13 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:13.335 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:13 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:01:13.335 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:13 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:01:13.336 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:13 smithi099 ceph-mon[24912]: pgmap v1485: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:13.336 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:13 smithi099 ceph-mon[24912]: pgmap v1486: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:13.336 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:13 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:13.336 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:13 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:01:13.336 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:13 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:01:13.336 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:13 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:13.336 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:13 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:01:13.336 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:13 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:01:13.336 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:13 smithi099 ceph-mon[24912]: pgmap v1487: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:13.336 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:13 smithi099 ceph-mon[24912]: pgmap v1488: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:13.336 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:13 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:13.336 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:13 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:01:13.336 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:13 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:01:13.336 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:13 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:13.337 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:13 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:01:13.337 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:13 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:01:13.337 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:13 smithi099 ceph-mon[24912]: pgmap v1489: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:13.337 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:13 smithi099 ceph-mon[24912]: pgmap v1490: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:13.337 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:13 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:13.337 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:13 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:01:13.337 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:13 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:01:13.337 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:13 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:13.337 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:13 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:01:13.337 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:13 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:01:13.337 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:13 smithi099 ceph-mon[24912]: pgmap v1491: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:13.337 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:13 smithi099 ceph-mon[24912]: pgmap v1492: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:13.337 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:13 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:13.337 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:13 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:01:13.338 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:13 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:01:13.338 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:13 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:13.338 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:13 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:01:13.338 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:13 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:01:13.338 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:13 smithi099 ceph-mon[24912]: pgmap v1493: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:13.338 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:13 smithi099 ceph-mon[24912]: pgmap v1494: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:13.338 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:13 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:13.338 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:13 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:01:13.338 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:13 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:01:13.338 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:13 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:13.339 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:13 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:01:13.339 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:13 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:01:13.339 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:13 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:13.339 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:13 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:13.339 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:13 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:01:13.339 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:13 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:01:13.339 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:13 smithi099 ceph-mon[29691]: pgmap v1485: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:13.339 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:13 smithi099 ceph-mon[29691]: pgmap v1486: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:13.339 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:13 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:13.339 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:13 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:01:13.340 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:13 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:01:13.340 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:13 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:13.340 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:13 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:01:13.340 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:13 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:01:13.340 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:13 smithi099 ceph-mon[29691]: pgmap v1487: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:13.340 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:13 smithi099 ceph-mon[29691]: pgmap v1488: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:13.340 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:13 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:13.340 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:13 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:01:13.340 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:13 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:01:13.340 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:13 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:13.340 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:13 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:01:13.340 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:13 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:01:13.340 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:13 smithi099 ceph-mon[29691]: pgmap v1489: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:13.340 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:13 smithi099 ceph-mon[29691]: pgmap v1490: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:13.340 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:13 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:13.341 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:13 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:01:13.341 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:13 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:01:13.341 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:13 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:13.341 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:13 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:01:13.341 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:13 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:01:13.341 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:13 smithi099 ceph-mon[29691]: pgmap v1491: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:13.341 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:13 smithi099 ceph-mon[29691]: pgmap v1492: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:13.341 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:13 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:13.341 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:13 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:01:13.341 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:13 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:01:13.341 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:13 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:13.341 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:13 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:01:13.341 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:13 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:01:13.341 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:13 smithi099 ceph-mon[29691]: pgmap v1493: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:13.342 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:13 smithi099 ceph-mon[29691]: pgmap v1494: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:13.342 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:13 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:13.342 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:13 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:01:13.342 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:13 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:01:13.342 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:13 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:13.342 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:13 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:01:13.342 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:13 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:01:13.342 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:13 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:14.053 INFO:journalctl@ceph.alertmanager.a.smithi099.stdout:Mar 30 14:01:13 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-alertmanager-a[117844]: ts=2024-03-30T14:01:13.775Z caller=cluster.go:706 level=info component=cluster msg="gossip not settled" polls=0 before=0 now=1 elapsed=2.00081021s 2024-03-30T14:01:14.330 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:14 smithi099 ceph-mon[29691]: pgmap v1495: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:14.331 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:14 smithi099 ceph-mon[29691]: pgmap v1496: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:14.331 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:14 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:01:14.331 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:14 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:01:14.331 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:14 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:14.331 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:14 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:01:14.331 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:14 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:01:14.331 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:14 smithi099 ceph-mon[29691]: pgmap v1497: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:14.331 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:14 smithi099 ceph-mon[29691]: pgmap v1498: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:14.331 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:14 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:14.331 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:14 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:01:14.331 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:14 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:01:14.331 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:14 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:14.331 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:14 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:01:14.332 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:14 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:01:14.332 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:14 smithi099 ceph-mon[29691]: pgmap v1499: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:14.332 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:14 smithi099 ceph-mon[29691]: pgmap v1500: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:14.332 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:14 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:14.332 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:14 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:01:14.332 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:14 smithi099 ceph-mon[29691]: from='client.25136 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T14:01:14.332 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:14 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:01:14.332 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:14 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:14.332 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:14 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:01:14.332 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:14 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:01:14.332 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:14 smithi099 ceph-mon[29691]: pgmap v1501: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:14.332 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:14 smithi099 ceph-mon[29691]: pgmap v1502: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:14.332 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:14 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:14.332 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:14 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:01:14.332 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:14 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:01:14.333 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:14 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:14.333 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:14 smithi099 ceph-mon[24912]: pgmap v1495: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:14.333 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:14 smithi099 ceph-mon[24912]: pgmap v1496: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:14.333 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:14 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:01:14.333 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:14 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:01:14.333 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:14 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:14.333 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:14 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:01:14.333 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:14 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:01:14.333 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:14 smithi099 ceph-mon[24912]: pgmap v1497: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:14.333 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:14 smithi099 ceph-mon[24912]: pgmap v1498: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:14.333 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:14 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:14.334 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:14 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:01:14.334 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:14 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:01:14.334 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:14 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:14.334 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:14 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:01:14.334 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:14 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:01:14.334 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:14 smithi099 ceph-mon[24912]: pgmap v1499: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:14.334 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:14 smithi099 ceph-mon[24912]: pgmap v1500: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:14.334 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:14 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:14.334 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:14 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:01:14.334 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:14 smithi099 ceph-mon[24912]: from='client.25136 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T14:01:14.334 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:14 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:01:14.334 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:14 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:14.334 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:14 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:01:14.334 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:14 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:01:14.335 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:14 smithi099 ceph-mon[24912]: pgmap v1501: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:14.335 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:14 smithi099 ceph-mon[24912]: pgmap v1502: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:14.335 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:14 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:14.335 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:14 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:01:14.335 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:14 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:01:14.335 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:14 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:14.335 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:14 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:01:14.335 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:14 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:01:14.335 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:14 smithi099 ceph-mon[29691]: pgmap v1503: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:14.336 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:14 smithi099 ceph-mon[29691]: pgmap v1504: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:14.336 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:14 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:14.336 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:14 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:01:14.336 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:14 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:01:14.336 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:14 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:14.336 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:14 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:01:14.336 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:14 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:01:14.336 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:14 smithi099 ceph-mon[29691]: pgmap v1505: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:14.336 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:14 smithi099 ceph-mon[29691]: pgmap v1506: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:14.336 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:14 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:14.336 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:14 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:01:14.336 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:14 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:01:14.337 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:14 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:14.337 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:14 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:01:14.337 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:14 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:01:14.337 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:14 smithi099 ceph-mon[29691]: pgmap v1507: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:14.337 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:14 smithi099 ceph-mon[29691]: pgmap v1508: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:14.337 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:14 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:14.337 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:14 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:01:14.337 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:14 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:01:14.337 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:14 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:14.337 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:14 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:01:14.337 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:14 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:01:14.337 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:14 smithi099 ceph-mon[29691]: pgmap v1509: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:14.337 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:14 smithi099 ceph-mon[29691]: pgmap v1510: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:14.337 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:14 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:14.338 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:14 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:01:14.338 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:14 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:01:14.338 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:14 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:14.338 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:14 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:01:14.338 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:14 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:01:14.338 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:14 smithi099 ceph-mon[29691]: pgmap v1511: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:14.338 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:14 smithi099 ceph-mon[29691]: pgmap v1512: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:14.338 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:14 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:14.338 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:14 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:01:14.338 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:14 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:01:14.338 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:14 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:14.338 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:14 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:01:14.338 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:14 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:01:14.339 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:14 smithi099 ceph-mon[29691]: pgmap v1513: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:14.339 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:14 smithi099 ceph-mon[29691]: pgmap v1514: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:14.339 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:14 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:14.339 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:14 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:01:14.339 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:14 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:01:14.339 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:14 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:01:14.339 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:14 smithi099 ceph-mon[24912]: pgmap v1503: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:14.339 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:14 smithi099 ceph-mon[24912]: pgmap v1504: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:14.339 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:14 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:14.340 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:14 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:01:14.340 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:14 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:01:14.340 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:14 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:14.340 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:14 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:01:14.340 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:14 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:01:14.340 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:14 smithi099 ceph-mon[24912]: pgmap v1505: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:14.340 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:14 smithi099 ceph-mon[24912]: pgmap v1506: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:14.340 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:14 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:14.340 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:14 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:01:14.340 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:14 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:01:14.340 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:14 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:14.340 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:14 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:01:14.340 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:14 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:01:14.340 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:14 smithi099 ceph-mon[24912]: pgmap v1507: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:14.341 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:14 smithi099 ceph-mon[24912]: pgmap v1508: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:14.341 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:14 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:14.341 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:14 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:01:14.341 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:14 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:01:14.341 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:14 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:14.341 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:14 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:01:14.341 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:14 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:01:14.341 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:14 smithi099 ceph-mon[24912]: pgmap v1509: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:14.341 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:14 smithi099 ceph-mon[24912]: pgmap v1510: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:14.341 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:14 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:14.341 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:14 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:01:14.341 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:14 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:01:14.341 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:14 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:14.341 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:14 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:01:14.341 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:14 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:01:14.342 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:14 smithi099 ceph-mon[24912]: pgmap v1511: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:14.342 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:14 smithi099 ceph-mon[24912]: pgmap v1512: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:14.342 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:14 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:14.342 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:14 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:01:14.342 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:14 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:01:14.342 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:14 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:14.342 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:14 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:01:14.342 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:14 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:01:14.342 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:14 smithi099 ceph-mon[24912]: pgmap v1513: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:14.342 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:14 smithi099 ceph-mon[24912]: pgmap v1514: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:14.342 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:14 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:14.342 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:14 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:01:14.500 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:14 smithi181 ceph-mon[25762]: pgmap v1495: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:14.500 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:14 smithi181 ceph-mon[25762]: pgmap v1496: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:14.500 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:14 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:01:14.500 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:14 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:01:14.500 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:14 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:14.500 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:14 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:01:14.500 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:14 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:01:14.500 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:14 smithi181 ceph-mon[25762]: pgmap v1497: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:14.500 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:14 smithi181 ceph-mon[25762]: pgmap v1498: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:14.500 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:14 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:14.500 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:14 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:01:14.501 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:14 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:01:14.501 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:14 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:14.501 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:14 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:01:14.501 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:14 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:01:14.501 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:14 smithi181 ceph-mon[25762]: pgmap v1499: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:14.501 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:14 smithi181 ceph-mon[25762]: pgmap v1500: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:14.501 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:14 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:14.501 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:14 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:01:14.501 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:14 smithi181 ceph-mon[25762]: from='client.25136 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T14:01:14.501 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:14 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:01:14.501 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:14 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:14.501 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:14 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:01:14.501 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:14 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:01:14.501 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:14 smithi181 ceph-mon[25762]: pgmap v1501: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:14.501 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:14 smithi181 ceph-mon[25762]: pgmap v1502: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:14.502 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:14 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:14.502 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:14 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:01:14.502 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:14 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:01:14.502 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:14 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:14.502 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:14 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:01:14.502 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:14 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:01:14.502 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:14 smithi181 ceph-mon[25762]: pgmap v1503: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:14.502 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:14 smithi181 ceph-mon[25762]: pgmap v1504: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:14.503 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:14 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:14.503 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:14 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:01:14.503 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:14 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:01:14.503 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:14 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:14.503 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:14 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:01:14.503 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:14 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:01:14.503 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:14 smithi181 ceph-mon[25762]: pgmap v1505: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:14.503 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:14 smithi181 ceph-mon[25762]: pgmap v1506: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:14.503 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:14 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:14.503 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:14 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:01:14.503 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:14 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:01:14.503 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:14 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:14.503 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:14 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:01:14.503 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:14 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:01:14.503 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:14 smithi181 ceph-mon[25762]: pgmap v1507: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:14.504 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:14 smithi181 ceph-mon[25762]: pgmap v1508: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:14.504 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:14 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:14.504 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:14 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:01:14.504 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:14 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:01:14.504 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:14 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:14.504 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:14 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:01:14.504 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:14 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:01:14.504 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:14 smithi181 ceph-mon[25762]: pgmap v1509: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:14.504 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:14 smithi181 ceph-mon[25762]: pgmap v1510: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:14.504 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:14 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:14.504 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:14 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:01:14.504 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:14 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:01:14.504 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:14 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:14.504 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:14 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:01:14.504 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:14 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:01:14.505 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:14 smithi181 ceph-mon[25762]: pgmap v1511: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:14.505 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:14 smithi181 ceph-mon[25762]: pgmap v1512: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:14.505 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:14 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:14.505 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:14 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:01:14.505 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:14 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:01:14.505 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:14 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:14.505 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:14 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:01:14.505 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:14 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:01:14.505 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:14 smithi181 ceph-mon[25762]: pgmap v1513: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:14.505 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:14 smithi181 ceph-mon[25762]: pgmap v1514: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:14.505 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:14 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:14.505 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:14 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:01:15.019 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 14:01:14 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[71049]: ::ffff:172.21.15.181 - - [30/Mar/2024:14:01:14] "GET /metrics HTTP/1.1" 200 37993 "" "Prometheus/2.43.0" 2024-03-30T14:01:15.331 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:15 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:01:15.331 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:15 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:15.331 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:15 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:01:15.331 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:15 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:01:15.331 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:15 smithi099 ceph-mon[24912]: pgmap v1515: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:15.331 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:15 smithi099 ceph-mon[24912]: pgmap v1516: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:15.332 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:15 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:15.332 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:15 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:01:15.332 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:15 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:01:15.332 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:15 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:15.332 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:15 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:01:15.332 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:15 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:01:15.332 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:15 smithi099 ceph-mon[24912]: pgmap v1517: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:15.332 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:15 smithi099 ceph-mon[24912]: pgmap v1518: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:15.332 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:15 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:15.332 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:15 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:01:15.332 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:15 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:01:15.332 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:15 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:15.333 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:15 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:01:15.333 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:15 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:01:15.333 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:15 smithi099 ceph-mon[24912]: pgmap v1519: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:15.333 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:15 smithi099 ceph-mon[24912]: pgmap v1520: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:15.333 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:15 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:15.333 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:15 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:01:15.333 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:15 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:01:15.333 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:15 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:15.333 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:15 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:01:15.333 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:15 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:01:15.333 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:15 smithi099 ceph-mon[24912]: pgmap v1521: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:15.334 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:15 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:01:15.334 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:15 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:15.334 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:15 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:01:15.334 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:15 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:01:15.334 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:15 smithi099 ceph-mon[29691]: pgmap v1515: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:15.334 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:15 smithi099 ceph-mon[29691]: pgmap v1516: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:15.334 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:15 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:15.334 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:15 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:01:15.335 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:15 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:01:15.335 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:15 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:15.335 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:15 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:01:15.335 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:15 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:01:15.335 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:15 smithi099 ceph-mon[29691]: pgmap v1517: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:15.335 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:15 smithi099 ceph-mon[29691]: pgmap v1518: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:15.335 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:15 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:15.335 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:15 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:01:15.335 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:15 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:01:15.335 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:15 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:15.335 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:15 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:01:15.335 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:15 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:01:15.335 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:15 smithi099 ceph-mon[29691]: pgmap v1519: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:15.336 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:15 smithi099 ceph-mon[29691]: pgmap v1520: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:15.336 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:15 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:15.336 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:15 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:01:15.336 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:15 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:01:15.336 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:15 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:15.336 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:15 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:01:15.336 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:15 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:01:15.336 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:15 smithi099 ceph-mon[29691]: pgmap v1521: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:15.336 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:15 smithi099 ceph-mon[29691]: pgmap v1522: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:15.336 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:15 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:15.336 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:15 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:01:15.336 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:15 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:01:15.336 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:15 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:15.337 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:15 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:01:15.337 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:15 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:01:15.337 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:15 smithi099 ceph-mon[29691]: pgmap v1523: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:15.337 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:15 smithi099 ceph-mon[29691]: pgmap v1524: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:15.337 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:15 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:15.337 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:15 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:01:15.337 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:15 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:01:15.337 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:15 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:15.337 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:15 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:01:15.337 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:15 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:01:15.337 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:15 smithi099 ceph-mon[29691]: pgmap v1525: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:15.338 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:15 smithi099 ceph-mon[29691]: pgmap v1526: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:15.338 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:15 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:15.338 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:15 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:01:15.338 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:15 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:01:15.338 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:15 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:15.338 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:15 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:01:15.338 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:15 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:01:15.338 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:15 smithi099 ceph-mon[29691]: pgmap v1527: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:15.338 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:15 smithi099 ceph-mon[29691]: pgmap v1528: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:15.338 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:15 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:15.338 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:15 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:01:15.338 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:15 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:01:15.338 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:15 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:15.339 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:15 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:01:15.339 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:15 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:01:15.339 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:15 smithi099 ceph-mon[24912]: pgmap v1522: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:15.339 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:15 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:15.339 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:15 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:01:15.339 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:15 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:01:15.339 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:15 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:15.340 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:15 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:01:15.340 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:15 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:01:15.340 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:15 smithi099 ceph-mon[24912]: pgmap v1523: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:15.340 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:15 smithi099 ceph-mon[24912]: pgmap v1524: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:15.340 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:15 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:15.340 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:15 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:01:15.340 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:15 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:01:15.340 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:15 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:15.340 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:15 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:01:15.340 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:15 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:01:15.340 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:15 smithi099 ceph-mon[24912]: pgmap v1525: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:15.340 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:15 smithi099 ceph-mon[24912]: pgmap v1526: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:15.341 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:15 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:15.341 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:15 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:01:15.341 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:15 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:01:15.341 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:15 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:15.341 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:15 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:01:15.341 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:15 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:01:15.341 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:15 smithi099 ceph-mon[24912]: pgmap v1527: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:15.341 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:15 smithi099 ceph-mon[24912]: pgmap v1528: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:15.341 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:15 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:15.341 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:15 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:01:15.341 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:15 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:01:15.341 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:15 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:15.341 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:15 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:01:15.342 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:15 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:01:15.342 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:15 smithi099 ceph-mon[29691]: pgmap v1529: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:15.342 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:15 smithi099 ceph-mon[29691]: pgmap v1530: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:15.342 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:15 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:15.342 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:15 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:01:15.342 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:15 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:01:15.342 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:15 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:15.342 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:15 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:01:15.342 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:15 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:01:15.343 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:15 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:15.343 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:15 smithi099 ceph-mon[24912]: pgmap v1529: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:15.343 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:15 smithi099 ceph-mon[24912]: pgmap v1530: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:15.343 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:15 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:15.343 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:15 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:01:15.343 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:15 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:01:15.343 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:15 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:15.343 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:15 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:01:15.343 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:15 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:01:15.343 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:15 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:15.500 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:15 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:01:15.500 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:15 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:15.500 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:15 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:01:15.500 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:15 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:01:15.500 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:15 smithi181 ceph-mon[25762]: pgmap v1515: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:15.501 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:15 smithi181 ceph-mon[25762]: pgmap v1516: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:15.501 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:15 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:15.501 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:15 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:01:15.501 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:15 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:01:15.501 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:15 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:15.501 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:15 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:01:15.501 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:15 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:01:15.501 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:15 smithi181 ceph-mon[25762]: pgmap v1517: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:15.502 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:15 smithi181 ceph-mon[25762]: pgmap v1518: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:15.502 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:15 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:15.502 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:15 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:01:15.502 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:15 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:01:15.502 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:15 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:15.502 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:15 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:01:15.502 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:15 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:01:15.502 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:15 smithi181 ceph-mon[25762]: pgmap v1519: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:15.502 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:15 smithi181 ceph-mon[25762]: pgmap v1520: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:15.503 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:15 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:15.503 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:15 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:01:15.503 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:15 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:01:15.503 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:15 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:15.503 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:15 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:01:15.503 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:15 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:01:15.503 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:15 smithi181 ceph-mon[25762]: pgmap v1521: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:15.503 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:15 smithi181 ceph-mon[25762]: pgmap v1522: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:15.503 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:15 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:15.503 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:15 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:01:15.503 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:15 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:01:15.504 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:15 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:15.504 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:15 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:01:15.504 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:15 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:01:15.504 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:15 smithi181 ceph-mon[25762]: pgmap v1523: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:15.504 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:15 smithi181 ceph-mon[25762]: pgmap v1524: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:15.504 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:15 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:15.504 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:15 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:01:15.504 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:15 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:01:15.505 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:15 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:15.505 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:15 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:01:15.505 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:15 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:01:15.505 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:15 smithi181 ceph-mon[25762]: pgmap v1525: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:15.505 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:15 smithi181 ceph-mon[25762]: pgmap v1526: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:15.505 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:15 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:15.505 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:15 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:01:15.505 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:15 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:01:15.505 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:15 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:15.505 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:15 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:01:15.506 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:15 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:01:15.506 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:15 smithi181 ceph-mon[25762]: pgmap v1527: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:15.506 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:15 smithi181 ceph-mon[25762]: pgmap v1528: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:15.506 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:15 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:15.506 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:15 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:01:15.506 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:15 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:01:15.506 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:15 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:15.506 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:15 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:01:15.506 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:15 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:01:15.507 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:15 smithi181 ceph-mon[25762]: pgmap v1529: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:15.507 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:15 smithi181 ceph-mon[25762]: pgmap v1530: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:15.507 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:15 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:15.507 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:15 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:01:15.507 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:15 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:01:15.507 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:15 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:15.507 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:15 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:01:15.507 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:15 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:01:15.507 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:15 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:16.500 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:16 smithi181 ceph-mon[25762]: pgmap v1531: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:16.500 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:16 smithi181 ceph-mon[25762]: pgmap v1532: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:16.500 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:16 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:01:16.500 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:16 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:01:16.500 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:16 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:16.500 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:16 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:01:16.500 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:16 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:01:16.500 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:16 smithi181 ceph-mon[25762]: pgmap v1533: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:16.500 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:16 smithi181 ceph-mon[25762]: pgmap v1534: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:16.501 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:16 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:16.501 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:16 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:01:16.501 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:16 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:01:16.501 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:16 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:16.501 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:16 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:01:16.501 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:16 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:01:16.501 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:16 smithi181 ceph-mon[25762]: pgmap v1535: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:16.501 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:16 smithi181 ceph-mon[25762]: pgmap v1536: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:16.501 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:16 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:16.501 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:16 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:01:16.501 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:16 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:01:16.501 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:16 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:16.501 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:16 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:01:16.501 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:16 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:01:16.502 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:16 smithi181 ceph-mon[25762]: pgmap v1537: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:16.502 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:16 smithi181 ceph-mon[25762]: pgmap v1538: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:16.502 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:16 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:16.502 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:16 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:01:16.502 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:16 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:01:16.502 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:16 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:16.502 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:16 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:01:16.502 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:16 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:01:16.502 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:16 smithi181 ceph-mon[25762]: pgmap v1539: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:16.502 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:16 smithi181 ceph-mon[25762]: pgmap v1540: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:16.502 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:16 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:16.502 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:16 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:01:16.502 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:16 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:01:16.502 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:16 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:16.502 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:16 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:01:16.503 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:16 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:01:16.503 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:16 smithi181 ceph-mon[25762]: pgmap v1541: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:16.503 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:16 smithi181 ceph-mon[25762]: pgmap v1542: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:16.503 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:16 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:16.503 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:16 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:01:16.503 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:16 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T14:01:16.503 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:16 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:01:16.503 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:16 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:16.503 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:16 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:01:16.503 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:16 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:01:16.503 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:16 smithi181 ceph-mon[25762]: pgmap v1543: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:16.503 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:16 smithi181 ceph-mon[25762]: pgmap v1544: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:16.503 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:16 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:16.503 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:16 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:01:16.503 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:16 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:01:16.504 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:16 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:16.504 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:16 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:01:16.504 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:16 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:01:16.504 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:16 smithi181 ceph-mon[25762]: pgmap v1545: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:16.504 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:16 smithi181 ceph-mon[25762]: pgmap v1546: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:16.504 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:16 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:16.504 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:16 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:01:16.504 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:16 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:01:16.504 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:16 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:16.504 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:16 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:01:16.504 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:16 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:01:16.504 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:16 smithi181 ceph-mon[25762]: pgmap v1547: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:16.504 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:16 smithi181 ceph-mon[25762]: pgmap v1548: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:16.504 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:16 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:16.505 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:16 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:01:16.505 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:16 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:01:16.505 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:16 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:16.505 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:16 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:01:16.505 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:16 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:01:16.505 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:16 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:16.580 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:16 smithi099 ceph-mon[24912]: pgmap v1531: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:16.580 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:16 smithi099 ceph-mon[24912]: pgmap v1532: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:16.580 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:16 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:01:16.581 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:16 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:01:16.581 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:16 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:16.581 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:16 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:01:16.581 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:16 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:01:16.581 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:16 smithi099 ceph-mon[24912]: pgmap v1533: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:16.581 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:16 smithi099 ceph-mon[24912]: pgmap v1534: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:16.581 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:16 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:16.581 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:16 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:01:16.581 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:16 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:01:16.581 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:16 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:16.581 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:16 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:01:16.581 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:16 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:01:16.581 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:16 smithi099 ceph-mon[24912]: pgmap v1535: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:16.581 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:16 smithi099 ceph-mon[24912]: pgmap v1536: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:16.582 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:16 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:16.582 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:16 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:01:16.582 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:16 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:01:16.582 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:16 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:16.582 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:16 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:01:16.582 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:16 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:01:16.582 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:16 smithi099 ceph-mon[24912]: pgmap v1537: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:16.582 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:16 smithi099 ceph-mon[24912]: pgmap v1538: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:16.582 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:16 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:16.582 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:16 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:01:16.582 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:16 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:01:16.582 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:16 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:16.582 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:16 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:01:16.583 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:16 smithi099 ceph-mon[29691]: pgmap v1531: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:16.583 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:16 smithi099 ceph-mon[29691]: pgmap v1532: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:16.583 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:16 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:01:16.583 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:16 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:01:16.583 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:16 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:16.583 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:16 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:01:16.583 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:16 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:01:16.583 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:16 smithi099 ceph-mon[29691]: pgmap v1533: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:16.583 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:16 smithi099 ceph-mon[29691]: pgmap v1534: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:16.583 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:16 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:16.583 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:16 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:01:16.584 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:16 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:01:16.584 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:16 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:16.584 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:16 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:01:16.584 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:16 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:01:16.584 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:16 smithi099 ceph-mon[29691]: pgmap v1535: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:16.584 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:16 smithi099 ceph-mon[29691]: pgmap v1536: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:16.584 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:16 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:16.584 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:16 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:01:16.584 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:16 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:01:16.584 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:16 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:16.584 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:16 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:01:16.584 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:16 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:01:16.584 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:16 smithi099 ceph-mon[29691]: pgmap v1537: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:16.584 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:16 smithi099 ceph-mon[29691]: pgmap v1538: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:16.584 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:16 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:16.585 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:16 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:01:16.585 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:16 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:01:16.585 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:16 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:16.585 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:16 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:01:16.585 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:16 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:01:16.585 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:16 smithi099 ceph-mon[24912]: pgmap v1539: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:16.585 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:16 smithi099 ceph-mon[24912]: pgmap v1540: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:16.585 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:16 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:16.585 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:16 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:01:16.585 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:16 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:01:16.585 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:16 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:16.585 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:16 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:01:16.586 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:16 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:01:16.586 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:16 smithi099 ceph-mon[24912]: pgmap v1541: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:16.586 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:16 smithi099 ceph-mon[24912]: pgmap v1542: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:16.586 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:16 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:16.586 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:16 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:01:16.586 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:16 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T14:01:16.586 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:16 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:01:16.586 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:16 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:16.587 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:16 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:01:16.587 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:16 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:01:16.587 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:16 smithi099 ceph-mon[24912]: pgmap v1543: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:16.587 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:16 smithi099 ceph-mon[24912]: pgmap v1544: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:16.587 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:16 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:16.587 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:16 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:01:16.587 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:16 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:01:16.587 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:16 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:16.587 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:16 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:01:16.587 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:16 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:01:16.587 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:16 smithi099 ceph-mon[24912]: pgmap v1545: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:16.587 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:16 smithi099 ceph-mon[24912]: pgmap v1546: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:16.587 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:16 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:16.587 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:16 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:01:16.588 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:16 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:01:16.588 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:16 smithi099 ceph-mon[29691]: pgmap v1539: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:16.588 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:16 smithi099 ceph-mon[29691]: pgmap v1540: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:16.588 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:16 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:16.588 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:16 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:01:16.588 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:16 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:01:16.588 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:16 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:16.588 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:16 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:01:16.588 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:16 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:01:16.588 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:16 smithi099 ceph-mon[29691]: pgmap v1541: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:16.588 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:16 smithi099 ceph-mon[29691]: pgmap v1542: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:16.589 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:16 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:16.589 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:16 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:01:16.589 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:16 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T14:01:16.589 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:16 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:01:16.589 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:16 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:16.589 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:16 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:01:16.589 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:16 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:01:16.589 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:16 smithi099 ceph-mon[29691]: pgmap v1543: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:16.589 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:16 smithi099 ceph-mon[29691]: pgmap v1544: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:16.589 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:16 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:16.589 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:16 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:01:16.589 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:16 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:01:16.589 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:16 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:16.589 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:16 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:01:16.589 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:16 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:01:16.590 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:16 smithi099 ceph-mon[29691]: pgmap v1545: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:16.590 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:16 smithi099 ceph-mon[29691]: pgmap v1546: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:16.590 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:16 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:16.590 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:16 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:01:16.590 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:16 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:01:16.590 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:16 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:16.590 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:16 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:01:16.590 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:16 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:01:16.590 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:16 smithi099 ceph-mon[24912]: pgmap v1547: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:16.590 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:16 smithi099 ceph-mon[24912]: pgmap v1548: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:16.591 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:16 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:16.591 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:16 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:01:16.591 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:16 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:01:16.591 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:16 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:16.591 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:16 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:01:16.591 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:16 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:01:16.591 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:16 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:16.591 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:16 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:01:16.591 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:16 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:16.591 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:16 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:01:16.591 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:16 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:01:16.591 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:16 smithi099 ceph-mon[29691]: pgmap v1547: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:16.591 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:16 smithi099 ceph-mon[29691]: pgmap v1548: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:16.592 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:16 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:16.592 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:16 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:01:16.592 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:16 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:01:16.592 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:16 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:16.592 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:16 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:01:16.592 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:16 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:01:16.592 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:16 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:17.221 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:17 smithi099 ceph-mon[24912]: pgmap v1549: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:17.222 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:17 smithi099 ceph-mon[24912]: pgmap v1550: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:17.222 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:17 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:01:17.222 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:17 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:01:17.222 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:17 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:17.222 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:17 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:01:17.222 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:17 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:01:17.222 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:17 smithi099 ceph-mon[24912]: pgmap v1551: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:17.222 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:17 smithi099 ceph-mon[24912]: pgmap v1552: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:17.222 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:17 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:17.222 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:17 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:01:17.222 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:17 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:01:17.222 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:17 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:17.222 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:17 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:01:17.223 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:17 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:01:17.223 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:17 smithi099 ceph-mon[24912]: pgmap v1553: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:17.223 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:17 smithi099 ceph-mon[24912]: pgmap v1554: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:17.223 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:17 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:17.223 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:17 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:01:17.223 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:17 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:01:17.223 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:17 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:17.223 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:17 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:01:17.223 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:17 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:01:17.223 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:17 smithi099 ceph-mon[24912]: pgmap v1555: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:17.223 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:17 smithi099 ceph-mon[24912]: pgmap v1556: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:17.223 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:17 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:17.223 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:17 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:01:17.223 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:17 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:01:17.223 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:17 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:17.223 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:17 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:01:17.223 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:17 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:01:17.224 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:17 smithi099 ceph-mon[24912]: pgmap v1557: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:17.224 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:17 smithi099 ceph-mon[24912]: pgmap v1558: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:17.224 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:17 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:17.224 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:17 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:01:17.224 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:17 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:01:17.224 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:17 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:17.224 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:17 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:01:17.224 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:17 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:01:17.224 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:17 smithi099 ceph-mon[24912]: pgmap v1559: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:17.224 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:17 smithi099 ceph-mon[24912]: pgmap v1560: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:17.224 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:17 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:17.224 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:17 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:01:17.224 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:17 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:01:17.224 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:17 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:17.224 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:17 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:01:17.224 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:17 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:01:17.225 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:17 smithi099 ceph-mon[24912]: pgmap v1561: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:17.225 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:17 smithi099 ceph-mon[24912]: pgmap v1562: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:17.225 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:17 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:17.225 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:17 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:01:17.225 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:17 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:01:17.225 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:17 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:17.225 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:17 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:01:17.225 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:17 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:01:17.225 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:17 smithi099 ceph-mon[24912]: pgmap v1563: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 18 KiB/s rd, 18 op/s 2024-03-30T14:01:17.225 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:17 smithi099 ceph-mon[24912]: pgmap v1564: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 18 KiB/s rd, 17 op/s 2024-03-30T14:01:17.225 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:17 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:17.225 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:17 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:01:17.225 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:17 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:01:17.226 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:17 smithi099 ceph-mon[29691]: pgmap v1549: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:17.226 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:17 smithi099 ceph-mon[29691]: pgmap v1550: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:17.226 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:17 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:01:17.226 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:17 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:01:17.226 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:17 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:17.226 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:17 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:01:17.226 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:17 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:01:17.226 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:17 smithi099 ceph-mon[29691]: pgmap v1551: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:17.226 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:17 smithi099 ceph-mon[29691]: pgmap v1552: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:17.226 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:17 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:17.226 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:17 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:01:17.227 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:17 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:01:17.227 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:17 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:17.227 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:17 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:01:17.227 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:17 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:01:17.227 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:17 smithi099 ceph-mon[29691]: pgmap v1553: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:17.227 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:17 smithi099 ceph-mon[29691]: pgmap v1554: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:17.227 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:17 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:17.227 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:17 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:01:17.227 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:17 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:01:17.227 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:17 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:17.227 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:17 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:01:17.227 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:17 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:01:17.227 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:17 smithi099 ceph-mon[29691]: pgmap v1555: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:17.227 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:17 smithi099 ceph-mon[29691]: pgmap v1556: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:17.227 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:17 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:17.228 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:17 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:01:17.228 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:17 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:01:17.228 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:17 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:17.228 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:17 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:01:17.228 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:17 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:01:17.228 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:17 smithi099 ceph-mon[29691]: pgmap v1557: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:17.228 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:17 smithi099 ceph-mon[29691]: pgmap v1558: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:17.228 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:17 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:17.228 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:17 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:01:17.228 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:17 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:01:17.228 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:17 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:17.228 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:17 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:01:17.228 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:17 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:01:17.228 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:17 smithi099 ceph-mon[29691]: pgmap v1559: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:17.228 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:17 smithi099 ceph-mon[29691]: pgmap v1560: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:17.229 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:17 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:17.229 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:17 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:01:17.229 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:17 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:01:17.229 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:17 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:17.229 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:17 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:01:17.229 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:17 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:01:17.229 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:17 smithi099 ceph-mon[29691]: pgmap v1561: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:17.229 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:17 smithi099 ceph-mon[29691]: pgmap v1562: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:17.229 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:17 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:17.229 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:17 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:01:17.229 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:17 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:01:17.229 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:17 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:17.229 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:17 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:01:17.229 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:17 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:01:17.229 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:17 smithi099 ceph-mon[29691]: pgmap v1563: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 18 KiB/s rd, 18 op/s 2024-03-30T14:01:17.230 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:17 smithi099 ceph-mon[29691]: pgmap v1564: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 18 KiB/s rd, 17 op/s 2024-03-30T14:01:17.230 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:17 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:17.230 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:17 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:01:17.230 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:17 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:01:17.230 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:17 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:17.230 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:17 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:01:17.230 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:17 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:01:17.230 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:17 smithi099 ceph-mon[24912]: pgmap v1565: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 18 KiB/s rd, 17 op/s 2024-03-30T14:01:17.230 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:17 smithi099 ceph-mon[24912]: pgmap v1566: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 18 KiB/s rd, 17 op/s 2024-03-30T14:01:17.230 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:17 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:17.230 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:17 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:01:17.231 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:17 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:01:17.231 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:17 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:17.231 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:17 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:01:17.231 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:17 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:01:17.231 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:17 smithi099 ceph-mon[24912]: pgmap v1567: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 20 KiB/s rd, 20 op/s 2024-03-30T14:01:17.231 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:17 smithi099 ceph-mon[24912]: pgmap v1568: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 20 KiB/s rd, 20 op/s 2024-03-30T14:01:17.231 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:17 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:17.231 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:17 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:01:17.231 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:17 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:01:17.231 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:17 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:17.231 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:17 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:01:17.231 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:17 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:01:17.231 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:17 smithi099 ceph-mon[24912]: pgmap v1569: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:17.231 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:17 smithi099 ceph-mon[24912]: pgmap v1570: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:17.231 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:17 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:17.231 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:17 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:01:17.231 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:17 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:01:17.232 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:17 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:17.232 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:17 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:01:17.232 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:17 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:01:17.232 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:17 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:17.232 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:17 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:17.232 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:17 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:01:17.232 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:17 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:01:17.232 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:17 smithi099 ceph-mon[29691]: pgmap v1565: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 18 KiB/s rd, 17 op/s 2024-03-30T14:01:17.232 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:17 smithi099 ceph-mon[29691]: pgmap v1566: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 18 KiB/s rd, 17 op/s 2024-03-30T14:01:17.232 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:17 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:17.232 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:17 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:01:17.232 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:17 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:01:17.232 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:17 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:17.232 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:17 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:01:17.232 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:17 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:01:17.233 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:17 smithi099 ceph-mon[29691]: pgmap v1567: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 20 KiB/s rd, 20 op/s 2024-03-30T14:01:17.233 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:17 smithi099 ceph-mon[29691]: pgmap v1568: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 20 KiB/s rd, 20 op/s 2024-03-30T14:01:17.233 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:17 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:17.233 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:17 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:01:17.233 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:17 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:01:17.233 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:17 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:17.233 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:17 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:01:17.233 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:17 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:01:17.233 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:17 smithi099 ceph-mon[29691]: pgmap v1569: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:17.233 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:17 smithi099 ceph-mon[29691]: pgmap v1570: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:17.233 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:17 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:17.233 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:17 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:01:17.233 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:17 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:01:17.233 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:17 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:17.233 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:17 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:01:17.234 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:17 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:01:17.234 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:17 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:17.499 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:17 smithi181 ceph-mon[25762]: pgmap v1549: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:17.500 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:17 smithi181 ceph-mon[25762]: pgmap v1550: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:17.500 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:17 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:01:17.500 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:17 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:01:17.500 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:17 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:17.500 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:17 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:01:17.500 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:17 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:01:17.500 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:17 smithi181 ceph-mon[25762]: pgmap v1551: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:17.500 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:17 smithi181 ceph-mon[25762]: pgmap v1552: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:17.500 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:17 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:17.500 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:17 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:01:17.500 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:17 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:01:17.500 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:17 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:17.501 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:17 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:01:17.501 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:17 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:01:17.501 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:17 smithi181 ceph-mon[25762]: pgmap v1553: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:17.501 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:17 smithi181 ceph-mon[25762]: pgmap v1554: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:17.501 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:17 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:17.501 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:17 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:01:17.501 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:17 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:01:17.501 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:17 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:17.501 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:17 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:01:17.501 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:17 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:01:17.501 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:17 smithi181 ceph-mon[25762]: pgmap v1555: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:17.501 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:17 smithi181 ceph-mon[25762]: pgmap v1556: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:17.501 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:17 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:17.501 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:17 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:01:17.501 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:17 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:01:17.501 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:17 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:17.502 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:17 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:01:17.502 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:17 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:01:17.502 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:17 smithi181 ceph-mon[25762]: pgmap v1557: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:17.502 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:17 smithi181 ceph-mon[25762]: pgmap v1558: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:17.502 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:17 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:17.502 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:17 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:01:17.502 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:17 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:01:17.502 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:17 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:17.502 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:17 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:01:17.502 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:17 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:01:17.502 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:17 smithi181 ceph-mon[25762]: pgmap v1559: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:17.502 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:17 smithi181 ceph-mon[25762]: pgmap v1560: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:17.502 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:17 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:17.502 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:17 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:01:17.503 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:17 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:01:17.503 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:17 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:17.503 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:17 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:01:17.503 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:17 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:01:17.503 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:17 smithi181 ceph-mon[25762]: pgmap v1561: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:17.503 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:17 smithi181 ceph-mon[25762]: pgmap v1562: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:17.503 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:17 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:17.503 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:17 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:01:17.503 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:17 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:01:17.503 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:17 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:17.503 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:17 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:01:17.503 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:17 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:01:17.503 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:17 smithi181 ceph-mon[25762]: pgmap v1563: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 18 KiB/s rd, 18 op/s 2024-03-30T14:01:17.503 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:17 smithi181 ceph-mon[25762]: pgmap v1564: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 18 KiB/s rd, 17 op/s 2024-03-30T14:01:17.503 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:17 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:17.503 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:17 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:01:17.504 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:17 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:01:17.504 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:17 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:17.504 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:17 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:01:17.504 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:17 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:01:17.504 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:17 smithi181 ceph-mon[25762]: pgmap v1565: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 18 KiB/s rd, 17 op/s 2024-03-30T14:01:17.504 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:17 smithi181 ceph-mon[25762]: pgmap v1566: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 18 KiB/s rd, 17 op/s 2024-03-30T14:01:17.504 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:17 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:17.504 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:17 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:01:17.504 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:17 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:01:17.504 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:17 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:17.504 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:17 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:01:17.504 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:17 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:01:17.504 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:17 smithi181 ceph-mon[25762]: pgmap v1567: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 20 KiB/s rd, 20 op/s 2024-03-30T14:01:17.504 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:17 smithi181 ceph-mon[25762]: pgmap v1568: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 20 KiB/s rd, 20 op/s 2024-03-30T14:01:17.504 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:17 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:17.505 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:17 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:01:17.505 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:17 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:01:17.505 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:17 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:17.505 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:17 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:01:17.505 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:17 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:01:17.505 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:17 smithi181 ceph-mon[25762]: pgmap v1569: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:17.505 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:17 smithi181 ceph-mon[25762]: pgmap v1570: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:17.505 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:17 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:17.505 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:17 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:01:17.505 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:17 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:01:17.505 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:17 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:17.505 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:17 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:01:17.505 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:17 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:01:17.506 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:17 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:18.400 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:18 smithi181 ceph-mon[25762]: pgmap v1571: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:18.401 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:18 smithi181 ceph-mon[25762]: pgmap v1572: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:18.401 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:18 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:01:18.401 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:18 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:01:18.401 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:18 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:18.401 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:18 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:01:18.401 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:18 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:01:18.401 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:18 smithi181 ceph-mon[25762]: pgmap v1573: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:18.401 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:18 smithi181 ceph-mon[25762]: pgmap v1574: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:18.401 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:18 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:18.401 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:18 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:01:18.402 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:18 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:01:18.402 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:18 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:18.402 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:18 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:01:18.402 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:18 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:01:18.402 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:18 smithi181 ceph-mon[25762]: pgmap v1575: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:18.402 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:18 smithi181 ceph-mon[25762]: pgmap v1576: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:18.402 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:18 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:18.402 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:18 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:01:18.402 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:18 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:01:18.402 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:18 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:18.402 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:18 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:01:18.402 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:18 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:01:18.402 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:18 smithi181 ceph-mon[25762]: pgmap v1577: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:18.403 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:18 smithi181 ceph-mon[25762]: pgmap v1578: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:18.403 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:18 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:18.403 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:18 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:01:18.403 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:18 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:01:18.403 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:18 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:18.403 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:18 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:01:18.403 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:18 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:01:18.403 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:18 smithi181 ceph-mon[25762]: pgmap v1579: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:18.403 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:18 smithi181 ceph-mon[25762]: pgmap v1580: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:18.403 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:18 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:18.403 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:18 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:01:18.403 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:18 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:01:18.403 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:18 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:18.404 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:18 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:01:18.404 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:18 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:01:18.404 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:18 smithi181 ceph-mon[25762]: pgmap v1581: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:18.404 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:18 smithi181 ceph-mon[25762]: pgmap v1582: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:18.404 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:18 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:18.404 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:18 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:01:18.404 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:18 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:01:18.404 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:18 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:18.404 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:18 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:01:18.404 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:18 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:01:18.404 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:18 smithi181 ceph-mon[25762]: pgmap v1583: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:18.404 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:18 smithi181 ceph-mon[25762]: pgmap v1584: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:18.404 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:18 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:18.404 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:18 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:01:18.405 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:18 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:01:18.405 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:18 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:18.405 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:18 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:01:18.405 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:18 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:01:18.405 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:18 smithi181 ceph-mon[25762]: pgmap v1585: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:18.405 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:18 smithi181 ceph-mon[25762]: pgmap v1586: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:18.405 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:18 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:18.405 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:18 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:01:18.405 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:18 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:01:18.406 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:18 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:18.406 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:18 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:01:18.406 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:18 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:01:18.406 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:18 smithi181 ceph-mon[25762]: pgmap v1587: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:18.406 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:18 smithi181 ceph-mon[25762]: pgmap v1588: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:18.406 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:18 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:18.406 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:18 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:01:18.406 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:18 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:01:18.406 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:18 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:18.406 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:18 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:01:18.406 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:18 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:01:18.406 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:18 smithi181 ceph-mon[25762]: pgmap v1589: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:18.406 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:18 smithi181 ceph-mon[25762]: pgmap v1590: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:18.407 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:18 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:18.407 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:18 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:01:18.407 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:18 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:01:18.407 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:18 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:18.407 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:18 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:01:18.407 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:18 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:01:18.407 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:18 smithi181 ceph-mon[25762]: pgmap v1591: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:18.407 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:18 smithi181 ceph-mon[25762]: pgmap v1592: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:18.407 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:18 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:18.407 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:18 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:01:18.407 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:18 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:01:18.407 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:18 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:18.407 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:18 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:01:18.407 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:18 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:01:18.407 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:18 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:18.407 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:18 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:01:18.408 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:18 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:18.408 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:18 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:01:18.408 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:18 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:01:18.408 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:18 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:18.475 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:18 smithi099 ceph-mon[24912]: pgmap v1571: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:18.476 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:18 smithi099 ceph-mon[24912]: pgmap v1572: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:18.476 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:18 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:01:18.476 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:18 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:01:18.476 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:18 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:18.476 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:18 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:01:18.476 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:18 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:01:18.476 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:18 smithi099 ceph-mon[24912]: pgmap v1573: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:18.476 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:18 smithi099 ceph-mon[24912]: pgmap v1574: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:18.476 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:18 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:18.476 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:18 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:01:18.476 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:18 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:01:18.476 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:18 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:18.477 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:18 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:01:18.477 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:18 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:01:18.477 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:18 smithi099 ceph-mon[24912]: pgmap v1575: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:18.477 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:18 smithi099 ceph-mon[24912]: pgmap v1576: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:18.477 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:18 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:18.477 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:18 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:01:18.477 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:18 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:01:18.477 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:18 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:18.477 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:18 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:01:18.477 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:18 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:01:18.477 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:18 smithi099 ceph-mon[24912]: pgmap v1577: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:18.477 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:18 smithi099 ceph-mon[24912]: pgmap v1578: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:18.477 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:18 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:18.477 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:18 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:01:18.478 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:18 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:01:18.478 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:18 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:18.478 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:18 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:01:18.478 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:18 smithi099 ceph-mon[29691]: pgmap v1571: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:18.478 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:18 smithi099 ceph-mon[29691]: pgmap v1572: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:18.478 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:18 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:01:18.478 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:18 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:01:18.479 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:18 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:18.479 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:18 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:01:18.479 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:18 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:01:18.479 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:18 smithi099 ceph-mon[29691]: pgmap v1573: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:18.479 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:18 smithi099 ceph-mon[29691]: pgmap v1574: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:18.479 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:18 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:18.479 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:18 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:01:18.479 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:18 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:01:18.479 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:18 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:18.479 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:18 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:01:18.479 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:18 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:01:18.479 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:18 smithi099 ceph-mon[29691]: pgmap v1575: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:18.480 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:18 smithi099 ceph-mon[29691]: pgmap v1576: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:18.480 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:18 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:18.480 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:18 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:01:18.480 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:18 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:01:18.480 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:18 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:18.480 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:18 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:01:18.480 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:18 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:01:18.480 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:18 smithi099 ceph-mon[29691]: pgmap v1577: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:18.480 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:18 smithi099 ceph-mon[29691]: pgmap v1578: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:18.480 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:18 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:18.480 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:18 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:01:18.480 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:18 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:01:18.480 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:18 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:18.480 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:18 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:01:18.481 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:18 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:01:18.481 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:18 smithi099 ceph-mon[29691]: pgmap v1579: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:18.481 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:18 smithi099 ceph-mon[29691]: pgmap v1580: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:18.481 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:18 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:18.481 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:18 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:01:18.481 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:18 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:01:18.481 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:18 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:18.481 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:18 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:01:18.481 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:18 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:01:18.481 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:18 smithi099 ceph-mon[29691]: pgmap v1581: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:18.481 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:18 smithi099 ceph-mon[29691]: pgmap v1582: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:18.481 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:18 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:18.481 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:18 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:01:18.481 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:18 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:01:18.481 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:18 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:18.482 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:18 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:01:18.482 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:18 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:01:18.482 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:18 smithi099 ceph-mon[29691]: pgmap v1583: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:18.482 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:18 smithi099 ceph-mon[29691]: pgmap v1584: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:18.482 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:18 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:18.482 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:18 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:01:18.482 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:18 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:01:18.482 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:18 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:18.482 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:18 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:01:18.482 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:18 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:01:18.482 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:18 smithi099 ceph-mon[29691]: pgmap v1585: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:18.482 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:18 smithi099 ceph-mon[29691]: pgmap v1586: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:18.482 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:18 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:18.482 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:18 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:01:18.483 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:18 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:01:18.483 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:18 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:01:18.483 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:18 smithi099 ceph-mon[24912]: pgmap v1579: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:18.483 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:18 smithi099 ceph-mon[24912]: pgmap v1580: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:18.483 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:18 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:18.483 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:18 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:01:18.483 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:18 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:01:18.483 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:18 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:18.483 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:18 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:01:18.483 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:18 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:01:18.483 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:18 smithi099 ceph-mon[24912]: pgmap v1581: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:18.483 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:18 smithi099 ceph-mon[24912]: pgmap v1582: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:18.484 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:18 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:18.484 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:18 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:01:18.484 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:18 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:01:18.484 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:18 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:18.484 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:18 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:01:18.484 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:18 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:01:18.484 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:18 smithi099 ceph-mon[24912]: pgmap v1583: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:18.484 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:18 smithi099 ceph-mon[24912]: pgmap v1584: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:18.484 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:18 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:18.484 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:18 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:01:18.484 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:18 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:01:18.484 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:18 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:18.484 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:18 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:01:18.484 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:18 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:01:18.484 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:18 smithi099 ceph-mon[24912]: pgmap v1585: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:18.484 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:18 smithi099 ceph-mon[24912]: pgmap v1586: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:18.485 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:18 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:18.485 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:18 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:01:18.485 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:18 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:01:18.485 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:18 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:18.485 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:18 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:01:18.485 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:18 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:01:18.485 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:18 smithi099 ceph-mon[29691]: pgmap v1587: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:18.485 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:18 smithi099 ceph-mon[29691]: pgmap v1588: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:18.485 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:18 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:18.486 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:18 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:01:18.486 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:18 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:01:18.486 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:18 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:18.486 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:18 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:01:18.486 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:18 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:01:18.486 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:18 smithi099 ceph-mon[29691]: pgmap v1589: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:18.486 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:18 smithi099 ceph-mon[29691]: pgmap v1590: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:18.486 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:18 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:18.486 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:18 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:01:18.486 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:18 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:01:18.486 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:18 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:18.486 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:18 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:01:18.486 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:18 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:01:18.487 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:18 smithi099 ceph-mon[29691]: pgmap v1591: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:18.487 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:18 smithi099 ceph-mon[29691]: pgmap v1592: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:18.487 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:18 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:18.487 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:18 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:01:18.487 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:18 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:01:18.487 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:18 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:18.487 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:18 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:01:18.487 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:18 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:01:18.487 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:18 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:18.487 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:18 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:01:18.487 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:18 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:18.487 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:18 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:01:18.487 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:18 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:01:18.487 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:18 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:18.488 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:18 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:18.488 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:18 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:01:18.488 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:18 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:01:18.488 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:18 smithi099 ceph-mon[24912]: pgmap v1587: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:18.488 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:18 smithi099 ceph-mon[24912]: pgmap v1588: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:18.488 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:18 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:18.488 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:18 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:01:18.488 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:18 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:01:18.488 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:18 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:18.488 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:18 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:01:18.488 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:18 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:01:18.488 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:18 smithi099 ceph-mon[24912]: pgmap v1589: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:18.489 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:18 smithi099 ceph-mon[24912]: pgmap v1590: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:18.489 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:18 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:18.489 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:18 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:01:18.489 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:18 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:01:18.489 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:18 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:18.489 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:18 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:01:18.489 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:18 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:01:18.489 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:18 smithi099 ceph-mon[24912]: pgmap v1591: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:18.489 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:18 smithi099 ceph-mon[24912]: pgmap v1592: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:18.489 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:18 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:18.489 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:18 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:01:18.489 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:18 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:01:18.489 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:18 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:18.489 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:18 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:01:18.489 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:18 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:01:18.490 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:18 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:18.490 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:18 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:01:18.490 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:18 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:18.490 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:18 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:01:18.490 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:18 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:01:18.490 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:18 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:19.210 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:19 smithi099 ceph-mon[29691]: pgmap v1593: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:19.211 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:19 smithi099 ceph-mon[29691]: pgmap v1594: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:19.211 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:19 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:01:19.211 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:19 smithi099 ceph-mon[29691]: pgmap v1595: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:19.211 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:19 smithi099 ceph-mon[29691]: pgmap v1596: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:19.211 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:19 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:01:19.211 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:19 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:01:19.211 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:19 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:19.211 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:19 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:01:19.211 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:19 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:01:19.211 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:19 smithi099 ceph-mon[29691]: pgmap v1597: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:19.211 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:19 smithi099 ceph-mon[29691]: pgmap v1598: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:19.211 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:19 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:19.212 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:19 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:01:19.212 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:19 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:01:19.212 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:19 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:19.212 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:19 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:01:19.212 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:19 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:01:19.212 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:19 smithi099 ceph-mon[29691]: pgmap v1599: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:19.212 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:19 smithi099 ceph-mon[29691]: pgmap v1600: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:19.212 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:19 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:19.212 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:19 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:01:19.212 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:19 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:01:19.212 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:19 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:19.212 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:19 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:01:19.212 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:19 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:01:19.212 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:19 smithi099 ceph-mon[29691]: pgmap v1601: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:19.212 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:19 smithi099 ceph-mon[29691]: pgmap v1602: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:19.213 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:19 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:19.213 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:19 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:01:19.213 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:19 smithi099 ceph-mon[24912]: pgmap v1593: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:19.213 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:19 smithi099 ceph-mon[24912]: pgmap v1594: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:19.213 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:19 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:01:19.213 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:19 smithi099 ceph-mon[24912]: pgmap v1595: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:19.213 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:19 smithi099 ceph-mon[24912]: pgmap v1596: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:19.213 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:19 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:01:19.213 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:19 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:01:19.213 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:19 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:19.214 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:19 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:01:19.214 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:19 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:01:19.214 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:19 smithi099 ceph-mon[24912]: pgmap v1597: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:19.214 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:19 smithi099 ceph-mon[24912]: pgmap v1598: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:19.214 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:19 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:19.214 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:19 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:01:19.214 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:19 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:01:19.214 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:19 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:19.214 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:19 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:01:19.214 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:19 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:01:19.214 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:19 smithi099 ceph-mon[24912]: pgmap v1599: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:19.214 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:19 smithi099 ceph-mon[24912]: pgmap v1600: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:19.214 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:19 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:19.215 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:19 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:01:19.215 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:19 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:01:19.215 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:19 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:19.215 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:19 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:01:19.215 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:19 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:01:19.215 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:19 smithi099 ceph-mon[24912]: pgmap v1601: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:19.215 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:19 smithi099 ceph-mon[24912]: pgmap v1602: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:19.215 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:19 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:19.215 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:19 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:01:19.216 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:19 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:01:19.216 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:19 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:19.216 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:19 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:01:19.216 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:19 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:01:19.216 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:19 smithi099 ceph-mon[29691]: pgmap v1603: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:19.217 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:19 smithi099 ceph-mon[29691]: pgmap v1604: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:19.217 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:19 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:19.217 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:19 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:01:19.217 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:19 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:01:19.217 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:19 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:19.217 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:19 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:01:19.217 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:19 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:01:19.217 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:19 smithi099 ceph-mon[29691]: pgmap v1605: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:19.217 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:19 smithi099 ceph-mon[29691]: pgmap v1606: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:19.217 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:19 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:19.217 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:19 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:01:19.217 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:19 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:01:19.217 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:19 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:19.217 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:19 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:01:19.218 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:19 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:01:19.218 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:19 smithi099 ceph-mon[29691]: pgmap v1607: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:19.218 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:19 smithi099 ceph-mon[29691]: pgmap v1608: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:19.218 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:19 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:19.218 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:19 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:01:19.218 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:19 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:01:19.218 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:19 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:19.218 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:19 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:01:19.218 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:19 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:01:19.218 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:19 smithi099 ceph-mon[29691]: pgmap v1609: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:19.218 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:19 smithi099 ceph-mon[29691]: pgmap v1610: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:19.218 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:19 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:19.218 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:19 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:01:19.218 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:19 smithi099 ceph-mon[29691]: Health check update: 1 failed cephadm daemon(s) (CEPHADM_FAILED_DAEMON) 2024-03-30T14:01:19.219 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:19 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:01:19.219 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:19 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:19.219 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:19 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:01:19.219 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:19 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:01:19.219 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:19 smithi099 ceph-mon[29691]: pgmap v1611: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:19.219 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:19 smithi099 ceph-mon[29691]: pgmap v1612: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:19.219 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:19 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:19.219 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:19 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:01:19.219 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:19 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:01:19.219 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:19 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:19.219 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:19 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:01:19.219 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:19 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:01:19.219 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:19 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:19.220 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:19 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:01:19.220 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:19 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:19.220 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:19 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:01:19.220 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:19 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:01:19.220 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:19 smithi099 ceph-mon[24912]: pgmap v1603: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:19.220 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:19 smithi099 ceph-mon[24912]: pgmap v1604: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:19.220 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:19 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:19.220 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:19 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:01:19.220 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:19 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:01:19.220 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:19 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:19.220 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:19 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:01:19.220 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:19 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:01:19.220 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:19 smithi099 ceph-mon[24912]: pgmap v1605: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:19.221 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:19 smithi099 ceph-mon[24912]: pgmap v1606: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:19.221 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:19 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:19.221 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:19 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:01:19.221 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:19 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:01:19.221 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:19 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:19.222 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:19 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:01:19.222 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:19 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:01:19.222 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:19 smithi099 ceph-mon[24912]: pgmap v1607: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:19.222 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:19 smithi099 ceph-mon[24912]: pgmap v1608: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:19.222 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:19 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:19.222 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:19 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:01:19.222 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:19 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:01:19.223 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:19 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:19.223 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:19 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:01:19.223 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:19 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:01:19.223 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:19 smithi099 ceph-mon[24912]: pgmap v1609: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:19.223 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:19 smithi099 ceph-mon[24912]: pgmap v1610: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:19.223 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:19 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:19.223 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:19 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:01:19.223 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:19 smithi099 ceph-mon[24912]: Health check update: 1 failed cephadm daemon(s) (CEPHADM_FAILED_DAEMON) 2024-03-30T14:01:19.224 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:19 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:01:19.224 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:19 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:19.224 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:19 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:01:19.224 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:19 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:01:19.224 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:19 smithi099 ceph-mon[24912]: pgmap v1611: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:19.224 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:19 smithi099 ceph-mon[24912]: pgmap v1612: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:19.224 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:19 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:19.225 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:19 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:01:19.225 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:19 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:01:19.225 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:19 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:19.225 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:19 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:01:19.225 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:19 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:01:19.226 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:19 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:19.500 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:19 smithi181 ceph-mon[25762]: pgmap v1593: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:19.500 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:19 smithi181 ceph-mon[25762]: pgmap v1594: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:19.500 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:19 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:01:19.500 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:19 smithi181 ceph-mon[25762]: pgmap v1595: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:19.500 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:19 smithi181 ceph-mon[25762]: pgmap v1596: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:19.500 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:19 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:01:19.500 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:19 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:01:19.500 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:19 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:19.501 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:19 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:01:19.501 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:19 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:01:19.501 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:19 smithi181 ceph-mon[25762]: pgmap v1597: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:19.501 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:19 smithi181 ceph-mon[25762]: pgmap v1598: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:19.501 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:19 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:19.501 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:19 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:01:19.501 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:19 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:01:19.501 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:19 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:19.501 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:19 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:01:19.501 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:19 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:01:19.501 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:19 smithi181 ceph-mon[25762]: pgmap v1599: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:19.501 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:19 smithi181 ceph-mon[25762]: pgmap v1600: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:19.501 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:19 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:19.501 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:19 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:01:19.501 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:19 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:01:19.502 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:19 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:19.502 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:19 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:01:19.502 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:19 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:01:19.502 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:19 smithi181 ceph-mon[25762]: pgmap v1601: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:19.502 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:19 smithi181 ceph-mon[25762]: pgmap v1602: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:19.502 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:19 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:19.502 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:19 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:01:19.502 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:19 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:01:19.502 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:19 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:19.502 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:19 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:01:19.502 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:19 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:01:19.502 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:19 smithi181 ceph-mon[25762]: pgmap v1603: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:19.502 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:19 smithi181 ceph-mon[25762]: pgmap v1604: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:19.502 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:19 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:19.503 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:19 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:01:19.503 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:19 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:01:19.503 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:19 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:19.503 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:19 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:01:19.503 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:19 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:01:19.503 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:19 smithi181 ceph-mon[25762]: pgmap v1605: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:19.503 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:19 smithi181 ceph-mon[25762]: pgmap v1606: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:19.503 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:19 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:19.503 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:19 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:01:19.503 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:19 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:01:19.503 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:19 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:19.503 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:19 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:01:19.503 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:19 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:01:19.503 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:19 smithi181 ceph-mon[25762]: pgmap v1607: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:19.504 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:19 smithi181 ceph-mon[25762]: pgmap v1608: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:19.504 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:19 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:19.504 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:19 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:01:19.504 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:19 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:01:19.504 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:19 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:19.504 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:19 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:01:19.504 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:19 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:01:19.504 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:19 smithi181 ceph-mon[25762]: pgmap v1609: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:19.504 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:19 smithi181 ceph-mon[25762]: pgmap v1610: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:19.504 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:19 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:19.504 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:19 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:01:19.504 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:19 smithi181 ceph-mon[25762]: Health check update: 1 failed cephadm daemon(s) (CEPHADM_FAILED_DAEMON) 2024-03-30T14:01:19.504 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:19 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:01:19.504 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:19 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:19.505 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:19 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:01:19.505 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:19 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:01:19.505 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:19 smithi181 ceph-mon[25762]: pgmap v1611: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:19.505 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:19 smithi181 ceph-mon[25762]: pgmap v1612: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:19.505 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:19 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:19.505 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:19 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:01:19.505 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:19 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:01:19.505 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:19 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:19.505 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:19 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:01:19.505 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:19 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:01:19.505 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:19 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:20.318 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:20 smithi099 ceph-mon[29691]: pgmap v1613: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:20.318 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:20 smithi099 ceph-mon[29691]: pgmap v1614: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:20.319 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:20 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:01:20.319 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:20 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:01:20.319 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:20 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:20.319 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:20 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:01:20.319 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:20 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:01:20.319 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:20 smithi099 ceph-mon[29691]: pgmap v1615: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:20.319 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:20 smithi099 ceph-mon[29691]: pgmap v1616: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:20.319 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:20 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:20.319 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:20 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:01:20.319 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:20 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:01:20.319 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:20 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:20.320 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:20 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:01:20.320 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:20 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:01:20.320 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:20 smithi099 ceph-mon[29691]: pgmap v1617: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:20.320 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:20 smithi099 ceph-mon[29691]: pgmap v1618: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:20.320 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:20 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:20.320 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:20 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:01:20.320 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:20 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:01:20.320 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:20 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:20.320 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:20 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:01:20.320 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:20 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:01:20.320 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:20 smithi099 ceph-mon[29691]: pgmap v1619: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:20.320 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:20 smithi099 ceph-mon[29691]: pgmap v1620: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:20.320 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:20 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:20.321 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:20 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:01:20.321 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:20 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:01:20.321 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:20 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:20.321 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:20 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:01:20.321 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:20 smithi099 ceph-mon[24912]: pgmap v1613: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:20.321 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:20 smithi099 ceph-mon[24912]: pgmap v1614: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:20.321 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:20 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:01:20.321 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:20 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:01:20.321 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:20 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:20.321 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:20 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:01:20.321 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:20 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:01:20.322 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:20 smithi099 ceph-mon[24912]: pgmap v1615: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:20.322 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:20 smithi099 ceph-mon[24912]: pgmap v1616: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:20.322 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:20 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:20.322 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:20 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:01:20.322 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:20 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:01:20.322 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:20 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:20.322 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:20 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:01:20.322 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:20 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:01:20.325 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:20 smithi099 ceph-mon[24912]: pgmap v1617: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:20.325 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:20 smithi099 ceph-mon[24912]: pgmap v1618: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:20.325 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:20 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:20.325 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:20 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:01:20.326 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:20 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:01:20.326 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:20 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:20.326 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:20 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:01:20.326 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:20 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:01:20.326 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:20 smithi099 ceph-mon[24912]: pgmap v1619: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:20.326 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:20 smithi099 ceph-mon[24912]: pgmap v1620: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:20.326 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:20 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:20.326 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:20 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:01:20.326 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:20 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:01:20.326 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:20 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:20.326 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:20 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:01:20.327 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:20 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:01:20.327 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:20 smithi099 ceph-mon[29691]: pgmap v1621: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:20.327 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:20 smithi099 ceph-mon[29691]: pgmap v1622: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:20.327 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:20 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:20.327 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:20 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:01:20.327 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:20 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:01:20.327 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:20 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:20.327 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:20 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:01:20.327 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:20 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:01:20.328 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:20 smithi099 ceph-mon[29691]: pgmap v1623: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:20.328 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:20 smithi099 ceph-mon[29691]: pgmap v1624: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:20.328 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:20 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:20.328 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:20 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:01:20.328 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:20 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:01:20.328 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:20 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:20.328 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:20 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:01:20.328 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:20 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:01:20.328 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:20 smithi099 ceph-mon[29691]: pgmap v1625: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:20.328 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:20 smithi099 ceph-mon[29691]: pgmap v1626: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:20.328 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:20 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:20.328 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:20 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:01:20.328 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:20 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:01:20.329 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:20 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:20.329 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:20 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:01:20.329 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:20 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:01:20.329 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:20 smithi099 ceph-mon[29691]: pgmap v1627: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:20.329 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:20 smithi099 ceph-mon[29691]: pgmap v1628: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:20.329 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:20 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:20.329 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:20 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:01:20.329 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:20 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:01:20.329 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:20 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:20.329 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:20 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:01:20.329 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:20 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:01:20.329 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:20 smithi099 ceph-mon[29691]: pgmap v1629: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:20.330 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:20 smithi099 ceph-mon[29691]: pgmap v1630: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:20.330 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:20 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:20.330 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:20 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:01:20.330 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:20 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:01:20.330 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:20 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:20.330 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:20 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:01:20.330 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:20 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:01:20.330 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:20 smithi099 ceph-mon[29691]: pgmap v1631: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:20.330 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:20 smithi099 ceph-mon[29691]: pgmap v1632: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:20.330 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:20 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:20.330 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:20 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:01:20.330 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:20 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:01:20.330 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:20 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:20.331 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:20 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:01:20.331 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:20 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:01:20.331 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:20 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:20.331 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:20 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:01:20.331 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:20 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:20.331 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:20 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:01:20.331 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:20 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:01:20.331 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:20 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:20.332 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:20 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:01:20.332 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:20 smithi099 ceph-mon[24912]: pgmap v1621: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:20.332 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:20 smithi099 ceph-mon[24912]: pgmap v1622: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:20.332 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:20 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:20.332 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:20 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:01:20.332 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:20 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:01:20.332 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:20 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:20.332 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:20 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:01:20.332 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:20 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:01:20.332 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:20 smithi099 ceph-mon[24912]: pgmap v1623: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:20.332 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:20 smithi099 ceph-mon[24912]: pgmap v1624: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:20.332 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:20 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:20.333 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:20 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:01:20.333 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:20 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:01:20.333 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:20 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:20.333 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:20 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:01:20.333 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:20 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:01:20.333 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:20 smithi099 ceph-mon[24912]: pgmap v1625: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:20.333 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:20 smithi099 ceph-mon[24912]: pgmap v1626: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:20.333 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:20 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:20.333 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:20 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:01:20.333 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:20 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:01:20.333 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:20 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:20.334 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:20 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:01:20.334 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:20 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:01:20.334 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:20 smithi099 ceph-mon[24912]: pgmap v1627: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:20.334 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:20 smithi099 ceph-mon[24912]: pgmap v1628: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:20.334 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:20 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:20.334 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:20 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:01:20.334 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:20 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:01:20.334 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:20 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:20.334 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:20 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:01:20.334 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:20 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:01:20.334 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:20 smithi099 ceph-mon[24912]: pgmap v1629: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:20.334 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:20 smithi099 ceph-mon[24912]: pgmap v1630: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:20.335 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:20 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:20.335 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:20 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:01:20.335 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:20 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:01:20.335 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:20 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:20.335 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:20 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:01:20.335 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:20 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:01:20.335 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:20 smithi099 ceph-mon[24912]: pgmap v1631: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:20.335 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:20 smithi099 ceph-mon[24912]: pgmap v1632: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:20.335 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:20 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:20.335 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:20 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:01:20.335 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:20 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:01:20.335 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:20 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:20.335 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:20 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:01:20.335 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:20 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:01:20.336 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:20 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:20.336 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:20 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:01:20.336 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:20 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:20.336 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:20 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:01:20.336 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:20 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:01:20.336 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:20 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:20.500 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:20 smithi181 ceph-mon[25762]: pgmap v1613: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:20.500 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:20 smithi181 ceph-mon[25762]: pgmap v1614: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:20.500 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:20 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:01:20.500 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:20 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:01:20.500 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:20 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:20.500 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:20 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:01:20.500 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:20 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:01:20.500 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:20 smithi181 ceph-mon[25762]: pgmap v1615: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:20.500 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:20 smithi181 ceph-mon[25762]: pgmap v1616: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:20.500 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:20 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:20.500 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:20 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:01:20.500 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:20 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:01:20.501 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:20 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:20.501 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:20 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:01:20.501 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:20 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:01:20.501 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:20 smithi181 ceph-mon[25762]: pgmap v1617: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:20.501 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:20 smithi181 ceph-mon[25762]: pgmap v1618: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:20.501 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:20 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:20.501 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:20 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:01:20.501 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:20 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:01:20.501 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:20 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:20.501 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:20 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:01:20.501 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:20 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:01:20.501 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:20 smithi181 ceph-mon[25762]: pgmap v1619: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:20.501 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:20 smithi181 ceph-mon[25762]: pgmap v1620: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:20.501 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:20 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:20.502 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:20 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:01:20.502 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:20 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:01:20.502 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:20 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:20.502 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:20 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:01:20.502 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:20 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:01:20.502 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:20 smithi181 ceph-mon[25762]: pgmap v1621: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:20.502 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:20 smithi181 ceph-mon[25762]: pgmap v1622: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:20.502 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:20 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:20.502 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:20 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:01:20.502 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:20 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:01:20.502 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:20 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:20.502 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:20 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:01:20.502 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:20 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:01:20.503 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:20 smithi181 ceph-mon[25762]: pgmap v1623: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:20.503 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:20 smithi181 ceph-mon[25762]: pgmap v1624: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:20.503 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:20 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:20.503 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:20 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:01:20.503 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:20 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:01:20.503 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:20 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:20.503 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:20 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:01:20.503 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:20 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:01:20.503 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:20 smithi181 ceph-mon[25762]: pgmap v1625: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:20.503 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:20 smithi181 ceph-mon[25762]: pgmap v1626: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:20.503 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:20 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:20.503 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:20 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:01:20.503 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:20 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:01:20.503 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:20 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:20.503 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:20 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:01:20.504 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:20 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:01:20.504 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:20 smithi181 ceph-mon[25762]: pgmap v1627: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:20.504 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:20 smithi181 ceph-mon[25762]: pgmap v1628: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:20.504 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:20 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:20.504 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:20 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:01:20.504 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:20 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:01:20.504 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:20 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:20.504 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:20 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:01:20.504 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:20 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:01:20.504 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:20 smithi181 ceph-mon[25762]: pgmap v1629: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:20.504 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:20 smithi181 ceph-mon[25762]: pgmap v1630: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:20.504 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:20 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:20.504 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:20 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:01:20.504 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:20 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:01:20.504 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:20 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:20.505 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:20 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:01:20.505 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:20 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:01:20.505 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:20 smithi181 ceph-mon[25762]: pgmap v1631: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:20.505 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:20 smithi181 ceph-mon[25762]: pgmap v1632: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:20.505 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:20 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:20.505 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:20 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:01:20.505 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:20 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:01:20.505 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:20 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:20.505 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:20 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:01:20.505 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:20 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:01:20.505 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:20 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:20.505 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:20 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:01:20.505 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:20 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:20.505 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:20 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:01:20.505 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:20 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:01:20.506 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:20 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:21.457 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:21 smithi099 ceph-mon[24912]: pgmap v1633: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:21.458 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:21 smithi099 ceph-mon[24912]: pgmap v1634: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:21.458 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:21 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:01:21.458 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:21 smithi099 ceph-mon[24912]: pgmap v1635: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:21.458 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:21 smithi099 ceph-mon[24912]: pgmap v1636: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:21.458 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:21 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:01:21.458 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:21 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:01:21.458 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:21 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:21.458 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:21 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:01:21.458 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:21 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:01:21.459 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:21 smithi099 ceph-mon[24912]: pgmap v1637: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:21.459 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:21 smithi099 ceph-mon[24912]: pgmap v1638: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:21.459 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:21 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:21.459 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:21 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:01:21.459 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:21 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:01:21.459 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:21 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:21.459 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:21 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:01:21.459 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:21 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:01:21.459 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:21 smithi099 ceph-mon[24912]: pgmap v1639: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:21.459 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:21 smithi099 ceph-mon[24912]: pgmap v1640: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:21.459 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:21 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:21.459 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:21 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:01:21.459 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:21 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:01:21.460 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:21 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:21.460 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:21 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:01:21.460 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:21 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:01:21.460 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:21 smithi099 ceph-mon[24912]: pgmap v1641: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:21.460 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:21 smithi099 ceph-mon[24912]: pgmap v1642: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:21.460 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:21 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:21.460 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:21 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:01:21.460 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:21 smithi099 ceph-mon[29691]: pgmap v1633: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:21.461 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:21 smithi099 ceph-mon[29691]: pgmap v1634: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:21.461 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:21 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:01:21.461 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:21 smithi099 ceph-mon[29691]: pgmap v1635: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:21.461 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:21 smithi099 ceph-mon[29691]: pgmap v1636: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:21.461 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:21 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:01:21.461 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:21 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:01:21.461 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:21 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:21.461 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:21 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:01:21.461 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:21 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:01:21.461 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:21 smithi099 ceph-mon[29691]: pgmap v1637: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:21.461 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:21 smithi099 ceph-mon[29691]: pgmap v1638: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:21.461 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:21 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:21.462 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:21 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:01:21.462 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:21 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:01:21.462 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:21 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:21.462 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:21 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:01:21.462 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:21 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:01:21.462 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:21 smithi099 ceph-mon[29691]: pgmap v1639: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:21.462 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:21 smithi099 ceph-mon[29691]: pgmap v1640: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:21.462 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:21 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:21.462 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:21 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:01:21.462 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:21 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:01:21.462 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:21 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:21.463 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:21 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:01:21.463 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:21 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:01:21.463 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:21 smithi099 ceph-mon[29691]: pgmap v1641: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:21.463 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:21 smithi099 ceph-mon[29691]: pgmap v1642: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:21.463 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:21 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:21.463 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:21 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:01:21.463 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:21 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:01:21.463 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:21 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:21.463 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:21 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:01:21.463 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:21 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:01:21.464 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:21 smithi099 ceph-mon[24912]: pgmap v1643: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:21.464 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:21 smithi099 ceph-mon[24912]: pgmap v1644: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:21.464 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:21 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:21.464 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:21 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:01:21.464 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:21 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:01:21.464 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:21 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:21.464 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:21 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:01:21.464 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:21 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:01:21.464 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:21 smithi099 ceph-mon[24912]: pgmap v1645: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:21.464 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:21 smithi099 ceph-mon[24912]: pgmap v1646: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:21.464 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:21 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:21.464 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:21 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:01:21.464 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:21 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:01:21.465 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:21 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:21.465 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:21 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:01:21.465 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:21 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:01:21.465 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:21 smithi099 ceph-mon[24912]: pgmap v1647: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:21.465 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:21 smithi099 ceph-mon[24912]: pgmap v1648: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:21.465 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:21 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:21.465 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:21 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:01:21.465 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:21 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:01:21.465 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:21 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:21.465 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:21 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:01:21.465 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:21 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:01:21.465 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:21 smithi099 ceph-mon[24912]: pgmap v1649: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:21.465 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:21 smithi099 ceph-mon[24912]: pgmap v1650: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:21.466 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:21 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:21.466 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:21 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:01:21.466 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:21 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:21.466 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:21 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:01:21.466 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:21 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:01:21.466 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:21 smithi099 ceph-mon[29691]: pgmap v1643: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:21.466 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:21 smithi099 ceph-mon[29691]: pgmap v1644: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:21.466 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:21 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:21.467 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:21 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:01:21.467 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:21 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:01:21.467 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:21 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:21.467 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:21 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:01:21.467 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:21 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:01:21.467 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:21 smithi099 ceph-mon[29691]: pgmap v1645: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:21.467 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:21 smithi099 ceph-mon[29691]: pgmap v1646: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:21.467 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:21 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:21.467 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:21 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:01:21.467 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:21 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:01:21.467 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:21 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:21.467 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:21 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:01:21.467 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:21 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:01:21.468 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:21 smithi099 ceph-mon[29691]: pgmap v1647: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:21.468 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:21 smithi099 ceph-mon[29691]: pgmap v1648: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:21.468 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:21 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:21.468 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:21 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:01:21.468 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:21 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:01:21.468 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:21 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:21.468 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:21 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:01:21.468 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:21 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:01:21.468 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:21 smithi099 ceph-mon[29691]: pgmap v1649: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:21.468 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:21 smithi099 ceph-mon[29691]: pgmap v1650: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:21.468 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:21 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:21.469 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:21 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:01:21.469 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:21 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:01:21.469 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:21 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:21.469 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:21 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:01:21.469 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:21 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:01:21.469 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:21 smithi099 ceph-mon[24912]: pgmap v1651: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:21.469 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:21 smithi099 ceph-mon[24912]: pgmap v1652: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:21.469 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:21 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:21.469 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:21 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:01:21.469 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:21 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:01:21.470 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:21 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:21.470 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:21 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:01:21.470 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:21 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:01:21.470 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:21 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:21.470 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:21 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:01:21.470 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:21 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:01:21.470 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:21 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:21.470 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:21 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:01:21.470 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:21 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:01:21.470 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:21 smithi099 ceph-mon[29691]: pgmap v1651: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:21.470 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:21 smithi099 ceph-mon[29691]: pgmap v1652: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:21.471 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:21 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:21.471 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:21 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:01:21.471 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:21 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:01:21.471 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:21 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:21.471 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:21 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:01:21.471 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:21 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:01:21.471 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:21 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:21.500 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:21 smithi181 ceph-mon[25762]: pgmap v1633: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:21.500 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:21 smithi181 ceph-mon[25762]: pgmap v1634: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:21.500 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:21 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:01:21.500 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:21 smithi181 ceph-mon[25762]: pgmap v1635: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:21.500 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:21 smithi181 ceph-mon[25762]: pgmap v1636: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:21.500 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:21 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:01:21.500 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:21 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:01:21.500 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:21 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:21.500 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:21 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:01:21.500 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:21 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:01:21.500 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:21 smithi181 ceph-mon[25762]: pgmap v1637: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:21.501 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:21 smithi181 ceph-mon[25762]: pgmap v1638: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:21.501 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:21 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:21.501 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:21 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:01:21.501 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:21 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:01:21.501 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:21 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:21.501 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:21 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:01:21.501 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:21 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:01:21.501 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:21 smithi181 ceph-mon[25762]: pgmap v1639: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:21.501 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:21 smithi181 ceph-mon[25762]: pgmap v1640: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:21.501 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:21 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:21.501 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:21 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:01:21.501 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:21 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:01:21.501 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:21 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:21.502 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:21 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:01:21.502 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:21 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:01:21.502 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:21 smithi181 ceph-mon[25762]: pgmap v1641: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:21.502 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:21 smithi181 ceph-mon[25762]: pgmap v1642: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:21.502 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:21 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:21.502 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:21 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:01:21.502 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:21 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:01:21.502 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:21 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:21.503 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:21 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:01:21.503 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:21 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:01:21.503 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:21 smithi181 ceph-mon[25762]: pgmap v1643: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:21.503 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:21 smithi181 ceph-mon[25762]: pgmap v1644: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:21.503 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:21 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:21.503 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:21 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:01:21.503 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:21 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:01:21.503 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:21 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:21.504 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:21 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:01:21.504 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:21 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:01:21.504 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:21 smithi181 ceph-mon[25762]: pgmap v1645: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:21.504 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:21 smithi181 ceph-mon[25762]: pgmap v1646: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:21.504 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:21 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:21.504 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:21 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:01:21.504 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:21 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:01:21.504 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:21 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:21.504 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:21 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:01:21.505 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:21 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:01:21.505 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:21 smithi181 ceph-mon[25762]: pgmap v1647: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:21.505 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:21 smithi181 ceph-mon[25762]: pgmap v1648: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:21.505 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:21 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:21.505 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:21 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:01:21.505 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:21 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:01:21.505 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:21 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:21.505 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:21 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:01:21.505 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:21 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:01:21.506 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:21 smithi181 ceph-mon[25762]: pgmap v1649: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:21.506 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:21 smithi181 ceph-mon[25762]: pgmap v1650: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:21.506 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:21 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:21.506 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:21 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:01:21.506 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:21 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:01:21.506 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:21 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:21.506 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:21 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:01:21.506 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:21 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:01:21.507 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:21 smithi181 ceph-mon[25762]: pgmap v1651: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:21.507 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:21 smithi181 ceph-mon[25762]: pgmap v1652: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:21.507 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:21 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:21.507 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:21 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:01:21.507 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:21 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:01:21.507 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:21 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:21.507 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:21 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:01:21.507 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:21 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:01:21.507 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:21 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:22.080 INFO:journalctl@ceph.alertmanager.a.smithi099.stdout:Mar 30 14:01:21 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-alertmanager-a[117844]: ts=2024-03-30T14:01:21.779Z caller=cluster.go:698 level=info component=cluster msg="gossip settled; proceeding" elapsed=10.003930441s 2024-03-30T14:01:22.435 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:22 smithi099 ceph-mon[24912]: pgmap v1653: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:22.435 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:22 smithi099 ceph-mon[24912]: pgmap v1654: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:22.435 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:22 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:01:22.435 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:22 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:01:22.435 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:22 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:22.435 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:22 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:01:22.435 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:22 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:01:22.435 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:22 smithi099 ceph-mon[24912]: pgmap v1655: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:22.435 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:22 smithi099 ceph-mon[24912]: pgmap v1656: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:22.435 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:22 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:22.435 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:22 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:01:22.436 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:22 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:01:22.436 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:22 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:22.436 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:22 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:01:22.436 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:22 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:01:22.436 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:22 smithi099 ceph-mon[24912]: pgmap v1657: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:22.436 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:22 smithi099 ceph-mon[24912]: pgmap v1658: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:22.436 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:22 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:22.436 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:22 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:01:22.436 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:22 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:01:22.436 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:22 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:22.436 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:22 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:01:22.436 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:22 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:01:22.436 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:22 smithi099 ceph-mon[24912]: pgmap v1659: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:22.436 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:22 smithi099 ceph-mon[24912]: pgmap v1660: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:22.437 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:22 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:22.437 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:22 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:01:22.437 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:22 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:01:22.437 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:22 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:22.437 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:22 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:01:22.437 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:22 smithi099 ceph-mon[29691]: pgmap v1653: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:22.437 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:22 smithi099 ceph-mon[29691]: pgmap v1654: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:22.437 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:22 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:01:22.437 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:22 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:01:22.438 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:22 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:22.438 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:22 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:01:22.438 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:22 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:01:22.438 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:22 smithi099 ceph-mon[29691]: pgmap v1655: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:22.438 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:22 smithi099 ceph-mon[29691]: pgmap v1656: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:22.438 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:22 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:22.438 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:22 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:01:22.438 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:22 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:01:22.438 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:22 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:22.438 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:22 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:01:22.438 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:22 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:01:22.439 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:22 smithi099 ceph-mon[29691]: pgmap v1657: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:22.439 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:22 smithi099 ceph-mon[29691]: pgmap v1658: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:22.439 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:22 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:22.439 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:22 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:01:22.439 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:22 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:01:22.439 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:22 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:22.439 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:22 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:01:22.439 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:22 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:01:22.439 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:22 smithi099 ceph-mon[29691]: pgmap v1659: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:22.439 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:22 smithi099 ceph-mon[29691]: pgmap v1660: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:22.440 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:22 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:22.440 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:22 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:01:22.440 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:22 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:01:22.440 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:22 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:22.440 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:22 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:01:22.440 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:22 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:01:22.440 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:22 smithi099 ceph-mon[24912]: pgmap v1661: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:22.440 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:22 smithi099 ceph-mon[24912]: pgmap v1662: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:22.440 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:22 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:22.440 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:22 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:01:22.440 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:22 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:01:22.441 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:22 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:22.441 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:22 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:01:22.441 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:22 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:01:22.441 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:22 smithi099 ceph-mon[24912]: pgmap v1663: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:22.441 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:22 smithi099 ceph-mon[24912]: pgmap v1664: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:22.441 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:22 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:22.441 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:22 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:01:22.441 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:22 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:01:22.441 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:22 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:22.441 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:22 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:01:22.441 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:22 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:01:22.441 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:22 smithi099 ceph-mon[24912]: pgmap v1665: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:22.441 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:22 smithi099 ceph-mon[24912]: pgmap v1666: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:22.442 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:22 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:22.442 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:22 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:01:22.442 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:22 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:01:22.442 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:22 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:22.442 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:22 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:01:22.442 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:22 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:01:22.442 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:22 smithi099 ceph-mon[24912]: pgmap v1667: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 18 KiB/s rd, 17 op/s 2024-03-30T14:01:22.442 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:22 smithi099 ceph-mon[24912]: pgmap v1668: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 18 KiB/s rd, 17 op/s 2024-03-30T14:01:22.442 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:22 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:22.442 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:22 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:01:22.442 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:22 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:01:22.443 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:22 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:01:22.443 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:22 smithi099 ceph-mon[29691]: pgmap v1661: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:22.443 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:22 smithi099 ceph-mon[29691]: pgmap v1662: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:22.443 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:22 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:22.443 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:22 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:01:22.443 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:22 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:01:22.443 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:22 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:22.443 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:22 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:01:22.443 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:22 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:01:22.443 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:22 smithi099 ceph-mon[29691]: pgmap v1663: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:22.443 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:22 smithi099 ceph-mon[29691]: pgmap v1664: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:22.444 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:22 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:22.444 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:22 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:01:22.444 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:22 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:01:22.444 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:22 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:22.444 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:22 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:01:22.444 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:22 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:01:22.444 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:22 smithi099 ceph-mon[29691]: pgmap v1665: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:22.444 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:22 smithi099 ceph-mon[29691]: pgmap v1666: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:22.444 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:22 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:22.444 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:22 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:01:22.444 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:22 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:01:22.444 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:22 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:22.444 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:22 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:01:22.444 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:22 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:01:22.445 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:22 smithi099 ceph-mon[29691]: pgmap v1667: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 18 KiB/s rd, 17 op/s 2024-03-30T14:01:22.445 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:22 smithi099 ceph-mon[29691]: pgmap v1668: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 18 KiB/s rd, 17 op/s 2024-03-30T14:01:22.445 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:22 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:22.445 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:22 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:01:22.445 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:22 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:01:22.445 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:22 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:22.445 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:22 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:01:22.445 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:22 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:01:22.445 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:22 smithi099 ceph-mon[29691]: pgmap v1669: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 20 KiB/s rd, 20 op/s 2024-03-30T14:01:22.445 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:22 smithi099 ceph-mon[29691]: pgmap v1670: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 20 KiB/s rd, 20 op/s 2024-03-30T14:01:22.445 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:22 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:22.445 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:22 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:01:22.445 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:22 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:01:22.445 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:22 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:22.446 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:22 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:01:22.446 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:22 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:01:22.446 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:22 smithi099 ceph-mon[29691]: pgmap v1671: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 18 KiB/s rd, 17 op/s 2024-03-30T14:01:22.446 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:22 smithi099 ceph-mon[29691]: pgmap v1672: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 18 KiB/s rd, 17 op/s 2024-03-30T14:01:22.446 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:22 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:22.446 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:22 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:01:22.446 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:22 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:22.446 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:22 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:22.446 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:22 smithi099 ceph-mon[29691]: pgmap v1673: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:22.446 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:22 smithi099 ceph-mon[29691]: pgmap v1674: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:22.446 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:22 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:22.447 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:22 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:01:22.447 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:22 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:22.447 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:22 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:22.447 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:22 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:22.447 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:22 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:22.447 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:22 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:22.447 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:22 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:22.447 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:22 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:22.447 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:22 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:22.447 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:22 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:22.447 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:22 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:22.447 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:22 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:22.448 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:22 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:22.448 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:22 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:01:22.448 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:22 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:01:22.448 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:22 smithi099 ceph-mon[24912]: pgmap v1669: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 20 KiB/s rd, 20 op/s 2024-03-30T14:01:22.448 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:22 smithi099 ceph-mon[24912]: pgmap v1670: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 20 KiB/s rd, 20 op/s 2024-03-30T14:01:22.448 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:22 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:22.448 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:22 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:01:22.448 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:22 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:01:22.448 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:22 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:22.448 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:22 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:01:22.448 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:22 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:01:22.449 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:22 smithi099 ceph-mon[24912]: pgmap v1671: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 18 KiB/s rd, 17 op/s 2024-03-30T14:01:22.449 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:22 smithi099 ceph-mon[24912]: pgmap v1672: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 18 KiB/s rd, 17 op/s 2024-03-30T14:01:22.449 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:22 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:22.449 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:22 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:01:22.449 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:22 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:22.449 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:22 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:22.449 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:22 smithi099 ceph-mon[24912]: pgmap v1673: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:22.449 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:22 smithi099 ceph-mon[24912]: pgmap v1674: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:22.449 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:22 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:22.449 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:22 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:01:22.449 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:22 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:22.449 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:22 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:22.449 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:22 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:22.449 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:22 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:22.449 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:22 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:22.450 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:22 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:22.450 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:22 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:22.450 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:22 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:22.450 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:22 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:22.450 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:22 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:22.450 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:22 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:22.500 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:22 smithi181 ceph-mon[25762]: pgmap v1653: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:22.500 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:22 smithi181 ceph-mon[25762]: pgmap v1654: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:22.500 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:22 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:01:22.500 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:22 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:01:22.500 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:22 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:22.500 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:22 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:01:22.500 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:22 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:01:22.501 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:22 smithi181 ceph-mon[25762]: pgmap v1655: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:22.501 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:22 smithi181 ceph-mon[25762]: pgmap v1656: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:22.501 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:22 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:22.501 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:22 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:01:22.501 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:22 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:01:22.501 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:22 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:22.501 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:22 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:01:22.502 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:22 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:01:22.502 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:22 smithi181 ceph-mon[25762]: pgmap v1657: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:22.502 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:22 smithi181 ceph-mon[25762]: pgmap v1658: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:22.502 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:22 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:22.502 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:22 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:01:22.502 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:22 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:01:22.502 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:22 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:22.502 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:22 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:01:22.502 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:22 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:01:22.502 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:22 smithi181 ceph-mon[25762]: pgmap v1659: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:22.502 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:22 smithi181 ceph-mon[25762]: pgmap v1660: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:22.502 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:22 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:22.503 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:22 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:01:22.503 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:22 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:01:22.503 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:22 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:22.503 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:22 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:01:22.503 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:22 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:01:22.503 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:22 smithi181 ceph-mon[25762]: pgmap v1661: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:22.503 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:22 smithi181 ceph-mon[25762]: pgmap v1662: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:22.503 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:22 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:22.503 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:22 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:01:22.503 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:22 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:01:22.503 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:22 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:22.503 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:22 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:01:22.503 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:22 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:01:22.503 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:22 smithi181 ceph-mon[25762]: pgmap v1663: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:22.503 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:22 smithi181 ceph-mon[25762]: pgmap v1664: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:22.503 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:22 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:22.503 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:22 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:01:22.504 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:22 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:01:22.504 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:22 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:22.504 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:22 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:01:22.504 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:22 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:01:22.504 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:22 smithi181 ceph-mon[25762]: pgmap v1665: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:22.504 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:22 smithi181 ceph-mon[25762]: pgmap v1666: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:22.504 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:22 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:22.504 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:22 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:01:22.504 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:22 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:01:22.504 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:22 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:22.504 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:22 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:01:22.504 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:22 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:01:22.504 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:22 smithi181 ceph-mon[25762]: pgmap v1667: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 18 KiB/s rd, 17 op/s 2024-03-30T14:01:22.504 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:22 smithi181 ceph-mon[25762]: pgmap v1668: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 18 KiB/s rd, 17 op/s 2024-03-30T14:01:22.504 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:22 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:22.504 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:22 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:01:22.504 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:22 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:01:22.505 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:22 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:22.505 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:22 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:01:22.505 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:22 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:01:22.505 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:22 smithi181 ceph-mon[25762]: pgmap v1669: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 20 KiB/s rd, 20 op/s 2024-03-30T14:01:22.505 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:22 smithi181 ceph-mon[25762]: pgmap v1670: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 20 KiB/s rd, 20 op/s 2024-03-30T14:01:22.505 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:22 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:22.505 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:22 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:01:22.505 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:22 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:01:22.505 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:22 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:22.505 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:22 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:01:22.505 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:22 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:01:22.505 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:22 smithi181 ceph-mon[25762]: pgmap v1671: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 18 KiB/s rd, 17 op/s 2024-03-30T14:01:22.505 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:22 smithi181 ceph-mon[25762]: pgmap v1672: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 18 KiB/s rd, 17 op/s 2024-03-30T14:01:22.505 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:22 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:22.505 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:22 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:01:22.505 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:22 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:22.506 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:22 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:22.506 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:22 smithi181 ceph-mon[25762]: pgmap v1673: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:22.506 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:22 smithi181 ceph-mon[25762]: pgmap v1674: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:22.506 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:22 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:22.506 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:22 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:01:22.506 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:22 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:22.506 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:22 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:22.506 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:22 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:22.506 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:22 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:22.506 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:22 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:22.506 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:22 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:22.506 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:22 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:22.506 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:22 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:22.507 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:22 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:22.507 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:22 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:22.507 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:22 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:23.758 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:23 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:23.758 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:23 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:23.758 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:23 smithi099 ceph-mon[24912]: pgmap v1675: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:23.758 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:23 smithi099 ceph-mon[24912]: pgmap v1676: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:23.758 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:23 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:23.759 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:23 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:23.759 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:23 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:23.759 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:23 smithi099 ceph-mon[29691]: pgmap v1675: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:23.759 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:23 smithi099 ceph-mon[29691]: pgmap v1676: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:23.759 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:23 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:23.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:23 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:23.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:23 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:23.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:23 smithi181 ceph-mon[25762]: pgmap v1675: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:23.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:23 smithi181 ceph-mon[25762]: pgmap v1676: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:23.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:23 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:25.072 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:24 smithi099 ceph-mon[24912]: from='client.25136 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T14:01:25.072 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:24 smithi099 ceph-mon[24912]: Upgrade: Updating grafana.a 2024-03-30T14:01:25.072 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:24 smithi099 ceph-mon[24912]: Deploying daemon grafana.a on smithi181 2024-03-30T14:01:25.072 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:24 smithi099 ceph-mon[29691]: from='client.25136 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T14:01:25.072 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:24 smithi099 ceph-mon[29691]: Upgrade: Updating grafana.a 2024-03-30T14:01:25.072 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:24 smithi099 ceph-mon[29691]: Deploying daemon grafana.a on smithi181 2024-03-30T14:01:25.072 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 14:01:24 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[71049]: ::ffff:172.21.15.181 - - [30/Mar/2024:14:01:24] "GET /metrics HTTP/1.1" 200 37996 "" "Prometheus/2.43.0" 2024-03-30T14:01:25.249 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:24 smithi181 ceph-mon[25762]: from='client.25136 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T14:01:25.249 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:24 smithi181 ceph-mon[25762]: Upgrade: Updating grafana.a 2024-03-30T14:01:25.249 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:24 smithi181 ceph-mon[25762]: Deploying daemon grafana.a on smithi181 2024-03-30T14:01:26.080 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:25 smithi099 ceph-mon[29691]: pgmap v1677: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:26.080 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:25 smithi099 ceph-mon[24912]: pgmap v1677: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:26.200 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:25 smithi181 ceph-mon[25762]: pgmap v1677: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:27.204 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 14:01:26 smithi181 systemd[1]: Starting Ceph grafana.a for 98ebaeb8-ee99-11ee-b647-cb9ed24678a4... 2024-03-30T14:01:27.499 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 14:01:27 smithi181 podman[109991]: 2024-03-30 14:01:27.113314509 +0000 UTC m=+0.018748933 image pull 2bacad6d85d802cd176c146528adcc0e47a8a83e94bc4a8b7ba1a9b9ef2c65e7 quay.io/ceph/grafana:9.4.12 2024-03-30T14:01:27.499 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 14:01:27 smithi181 podman[109991]: 2024-03-30 14:01:27.232843284 +0000 UTC m=+0.138277695 container create 3d006a088644da7ee8ec3c4ab96532390e378d9aef143447123f20f071e65fef (image=quay.io/ceph/grafana:9.4.12, name=ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a, maintainer=Grafana Labs ) 2024-03-30T14:01:27.649 INFO:teuthology.orchestra.run.smithi099.stdout:true 2024-03-30T14:01:27.751 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 14:01:27 smithi181 podman[109991]: 2024-03-30 14:01:27.56053282 +0000 UTC m=+0.465967231 container init 3d006a088644da7ee8ec3c4ab96532390e378d9aef143447123f20f071e65fef (image=quay.io/ceph/grafana:9.4.12, name=ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a, maintainer=Grafana Labs ) 2024-03-30T14:01:27.751 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 14:01:27 smithi181 podman[109991]: 2024-03-30 14:01:27.563231698 +0000 UTC m=+0.468666119 container start 3d006a088644da7ee8ec3c4ab96532390e378d9aef143447123f20f071e65fef (image=quay.io/ceph/grafana:9.4.12, name=ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a, maintainer=Grafana Labs ) 2024-03-30T14:01:27.752 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 14:01:27 smithi181 bash[109991]: 3d006a088644da7ee8ec3c4ab96532390e378d9aef143447123f20f071e65fef 2024-03-30T14:01:27.752 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 14:01:27 smithi181 systemd[1]: Started Ceph grafana.a for 98ebaeb8-ee99-11ee-b647-cb9ed24678a4. 2024-03-30T14:01:27.752 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 14:01:27 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a[110006]: logger=settings t=2024-03-30T14:01:27.710612341Z level=info msg="Starting Grafana" version=9.4.12 commit=37ee25ba46 branch=HEAD compiled=2023-05-22T15:58:05Z 2024-03-30T14:01:27.752 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 14:01:27 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a[110006]: logger=settings t=2024-03-30T14:01:27.710775061Z level=warn msg="\"sentry\" frontend logging provider is deprecated and will be removed in the next major version. Use \"grafana\" provider instead." 2024-03-30T14:01:27.752 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 14:01:27 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a[110006]: logger=settings t=2024-03-30T14:01:27.710784665Z level=info msg="Config loaded from" file=/usr/share/grafana/conf/defaults.ini 2024-03-30T14:01:27.752 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 14:01:27 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a[110006]: logger=settings t=2024-03-30T14:01:27.710787781Z level=info msg="Config loaded from" file=/etc/grafana/grafana.ini 2024-03-30T14:01:27.752 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 14:01:27 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a[110006]: logger=settings t=2024-03-30T14:01:27.710790772Z level=info msg="Config overridden from command line" arg="default.paths.data=/var/lib/grafana" 2024-03-30T14:01:27.752 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 14:01:27 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a[110006]: logger=settings t=2024-03-30T14:01:27.710795586Z level=info msg="Config overridden from command line" arg="default.paths.logs=/var/log/grafana" 2024-03-30T14:01:27.752 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 14:01:27 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a[110006]: logger=settings t=2024-03-30T14:01:27.710799607Z level=info msg="Config overridden from command line" arg="default.paths.plugins=/var/lib/grafana/plugins" 2024-03-30T14:01:27.752 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 14:01:27 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a[110006]: logger=settings t=2024-03-30T14:01:27.710803287Z level=info msg="Config overridden from command line" arg="default.paths.provisioning=/etc/grafana/provisioning" 2024-03-30T14:01:27.752 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 14:01:27 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a[110006]: logger=settings t=2024-03-30T14:01:27.71080661Z level=info msg="Config overridden from command line" arg="default.log.mode=console" 2024-03-30T14:01:27.752 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 14:01:27 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a[110006]: logger=settings t=2024-03-30T14:01:27.71081064Z level=info msg="Config overridden from Environment variable" var="GF_PATHS_DATA=/var/lib/grafana" 2024-03-30T14:01:27.753 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 14:01:27 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a[110006]: logger=settings t=2024-03-30T14:01:27.710814352Z level=info msg="Config overridden from Environment variable" var="GF_PATHS_LOGS=/var/log/grafana" 2024-03-30T14:01:27.753 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 14:01:27 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a[110006]: logger=settings t=2024-03-30T14:01:27.71083923Z level=info msg="Config overridden from Environment variable" var="GF_PATHS_PLUGINS=/var/lib/grafana/plugins" 2024-03-30T14:01:27.753 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 14:01:27 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a[110006]: logger=settings t=2024-03-30T14:01:27.710844086Z level=info msg="Config overridden from Environment variable" var="GF_PATHS_PROVISIONING=/etc/grafana/provisioning" 2024-03-30T14:01:27.753 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 14:01:27 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a[110006]: logger=settings t=2024-03-30T14:01:27.710850295Z level=info msg="Path Home" path=/usr/share/grafana 2024-03-30T14:01:27.753 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 14:01:27 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a[110006]: logger=settings t=2024-03-30T14:01:27.710854009Z level=info msg="Path Data" path=/var/lib/grafana 2024-03-30T14:01:27.753 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 14:01:27 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a[110006]: logger=settings t=2024-03-30T14:01:27.710857531Z level=info msg="Path Logs" path=/var/log/grafana 2024-03-30T14:01:27.753 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 14:01:27 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a[110006]: logger=settings t=2024-03-30T14:01:27.710860831Z level=info msg="Path Plugins" path=/var/lib/grafana/plugins 2024-03-30T14:01:27.753 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 14:01:27 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a[110006]: logger=settings t=2024-03-30T14:01:27.710864401Z level=info msg="Path Provisioning" path=/etc/grafana/provisioning 2024-03-30T14:01:27.753 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 14:01:27 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a[110006]: logger=settings t=2024-03-30T14:01:27.710868865Z level=info msg="App mode production" 2024-03-30T14:01:27.753 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 14:01:27 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a[110006]: logger=sqlstore t=2024-03-30T14:01:27.710921015Z level=info msg="Connecting to DB" dbtype=sqlite3 2024-03-30T14:01:27.753 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 14:01:27 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a[110006]: logger=sqlstore t=2024-03-30T14:01:27.710936404Z level=warn msg="SQLite database file has broader permissions than it should" path=/var/lib/grafana/grafana.db mode=-rw-r--r-- expected=-rw-r----- 2024-03-30T14:01:27.753 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 14:01:27 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a[110006]: logger=migrator t=2024-03-30T14:01:27.722695705Z level=info msg="Starting DB migrations" 2024-03-30T14:01:27.753 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 14:01:27 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a[110006]: logger=migrator t=2024-03-30T14:01:27.725914102Z level=info msg="Executing migration" id="Update is_service_account column to nullable" 2024-03-30T14:01:27.753 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 14:01:27 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a[110006]: logger=migrator t=2024-03-30T14:01:27.7373039Z level=info msg="Executing migration" id="Add isPublic for dashboard" 2024-03-30T14:01:27.754 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 14:01:27 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a[110006]: logger=migrator t=2024-03-30T14:01:27.738483097Z level=info msg="Executing migration" id="set service account foreign key to nil if 0" 2024-03-30T14:01:27.754 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 14:01:27 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a[110006]: logger=migrator t=2024-03-30T14:01:27.741137218Z level=info msg="Executing migration" id="Add last_used_at to api_key table" 2024-03-30T14:01:27.754 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 14:01:27 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a[110006]: logger=migrator t=2024-03-30T14:01:27.74381512Z level=info msg="Executing migration" id="Add is_revoked column to api_key table" 2024-03-30T14:01:27.754 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 14:01:27 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a[110006]: logger=migrator t=2024-03-30T14:01:27.74639206Z level=info msg="Executing migration" id="Add column preferences.json_data" 2024-03-30T14:01:27.754 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 14:01:27 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a[110006]: logger=migrator t=2024-03-30T14:01:27.74914007Z level=info msg="Executing migration" id="alter preferences.json_data to mediumtext v1" 2024-03-30T14:01:27.754 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 14:01:27 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a[110006]: logger=migrator t=2024-03-30T14:01:27.751859008Z level=info msg="Executing migration" id="Add preferences index org_id" 2024-03-30T14:01:27.754 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 14:01:27 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a[110006]: logger=migrator t=2024-03-30T14:01:27.75236976Z level=info msg="Executing migration" id="Add preferences index user_id" 2024-03-30T14:01:27.754 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 14:01:27 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a[110006]: logger=migrator t=2024-03-30T14:01:27.75463274Z level=info msg="Executing migration" id="Increase tags column to length 4096" 2024-03-30T14:01:27.754 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 14:01:27 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a[110006]: logger=migrator t=2024-03-30T14:01:27.757304537Z level=info msg="Executing migration" id="Add OAuth ID token to user_auth" 2024-03-30T14:01:27.899 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:27 smithi099 ceph-mon[24912]: pgmap v1678: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:27.899 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:27 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:27.900 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:27 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:27.900 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:27 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:01:27.900 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:27 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:01:27.900 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:27 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:27.900 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:27 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-03-30T14:01:27.900 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:27 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:01:27.900 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:27 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:27.900 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:27 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:01:27.900 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:27 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:01:27.900 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:27 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:28.014 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:27 smithi181 ceph-mon[25762]: pgmap v1678: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:28.014 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:27 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:28.014 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:27 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:28.014 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:27 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:01:28.014 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:27 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:01:28.014 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:27 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:28.014 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:27 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-03-30T14:01:28.015 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:27 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:01:28.015 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:27 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:28.015 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:27 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:01:28.015 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:27 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:01:28.015 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:27 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:28.015 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 14:01:27 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a[110006]: logger=migrator t=2024-03-30T14:01:27.760022569Z level=info msg="Executing migration" id="alter table short_url alter column created_by type to bigint" 2024-03-30T14:01:28.015 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 14:01:27 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a[110006]: logger=migrator t=2024-03-30T14:01:27.760369329Z level=info msg="Executing migration" id="add current_reason column related to current_state" 2024-03-30T14:01:28.016 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 14:01:27 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a[110006]: logger=migrator t=2024-03-30T14:01:27.763092411Z level=info msg="Executing migration" id="add rule_group_idx column to alert_rule" 2024-03-30T14:01:28.016 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 14:01:27 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a[110006]: logger=migrator t=2024-03-30T14:01:27.765728156Z level=info msg="Executing migration" id="add is_paused column to alert_rule table" 2024-03-30T14:01:28.016 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 14:01:27 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a[110006]: logger=migrator t=2024-03-30T14:01:27.768424347Z level=info msg="Executing migration" id="fix is_paused column for alert_rule table" 2024-03-30T14:01:28.016 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 14:01:27 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a[110006]: logger=migrator t=2024-03-30T14:01:27.768782698Z level=info msg="Executing migration" id="add rule_group_idx column to alert_rule_version" 2024-03-30T14:01:28.016 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 14:01:27 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a[110006]: logger=migrator t=2024-03-30T14:01:27.771534528Z level=info msg="Executing migration" id="add is_paused column to alert_rule_versions table" 2024-03-30T14:01:28.016 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 14:01:27 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a[110006]: logger=migrator t=2024-03-30T14:01:27.772716396Z level=info msg="Executing migration" id="fix is_paused column for alert_rule_version table" 2024-03-30T14:01:28.016 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 14:01:27 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a[110006]: logger=migrator t=2024-03-30T14:01:27.773584884Z level=info msg="Executing migration" id="add configuration_hash column to alert_configuration" 2024-03-30T14:01:28.016 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 14:01:27 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a[110006]: logger=migrator t=2024-03-30T14:01:27.774782772Z level=info msg="Executing migration" id="add column send_alerts_to in ngalert_configuration" 2024-03-30T14:01:28.016 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 14:01:27 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a[110006]: logger=migrator t=2024-03-30T14:01:27.775881124Z level=info msg="Executing migration" id="create provenance_type table" 2024-03-30T14:01:28.017 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 14:01:27 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a[110006]: logger=migrator t=2024-03-30T14:01:27.776795351Z level=info msg="Executing migration" id="add index to uniquify (record_key, record_type, org_id) columns" 2024-03-30T14:01:28.017 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 14:01:27 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a[110006]: logger=migrator t=2024-03-30T14:01:27.777452198Z level=info msg="Executing migration" id="create alert_image table" 2024-03-30T14:01:28.017 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 14:01:27 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a[110006]: logger=migrator t=2024-03-30T14:01:27.777905818Z level=info msg="Executing migration" id="add unique index on token to alert_image table" 2024-03-30T14:01:28.017 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 14:01:27 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a[110006]: logger=migrator t=2024-03-30T14:01:27.778892291Z level=info msg="Executing migration" id="support longer URLs in alert_image table" 2024-03-30T14:01:28.017 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 14:01:27 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a[110006]: logger=migrator t=2024-03-30T14:01:27.779579277Z level=info msg="Executing migration" id=create_alert_configuration_history_table 2024-03-30T14:01:28.017 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 14:01:27 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a[110006]: logger=migrator t=2024-03-30T14:01:27.78041585Z level=info msg="Executing migration" id="drop non-unique orgID index on alert_configuration" 2024-03-30T14:01:28.017 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 14:01:27 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a[110006]: logger=migrator t=2024-03-30T14:01:27.780917711Z level=info msg="Executing migration" id="drop unique orgID index on alert_configuration if exists" 2024-03-30T14:01:28.017 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 14:01:27 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a[110006]: logger=migrator t=2024-03-30T14:01:27.781020839Z level=warn msg="Skipping migration: Already executed, but not recorded in migration log" id="drop unique orgID index on alert_configuration if exists" 2024-03-30T14:01:28.017 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 14:01:27 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a[110006]: logger=migrator t=2024-03-30T14:01:27.781754468Z level=info msg="Executing migration" id="extract alertmanager configuration history to separate table" 2024-03-30T14:01:28.017 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 14:01:27 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a[110006]: logger=migrator t=2024-03-30T14:01:27.782713153Z level=info msg="Executing migration" id="add unique index on orgID to alert_configuration" 2024-03-30T14:01:28.017 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 14:01:27 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a[110006]: logger=migrator t=2024-03-30T14:01:27.783456215Z level=info msg="Executing migration" id="increase max description length to 2048" 2024-03-30T14:01:28.018 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 14:01:27 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a[110006]: logger=migrator t=2024-03-30T14:01:27.783747141Z level=info msg="Executing migration" id="create secrets table" 2024-03-30T14:01:28.018 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 14:01:27 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a[110006]: logger=migrator t=2024-03-30T14:01:27.78421149Z level=info msg="Executing migration" id="rename data_keys name column to id" 2024-03-30T14:01:28.018 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 14:01:27 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a[110006]: logger=migrator t=2024-03-30T14:01:27.790364964Z level=info msg="Executing migration" id="add name column into data_keys" 2024-03-30T14:01:28.018 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 14:01:27 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a[110006]: logger=migrator t=2024-03-30T14:01:27.791548865Z level=info msg="Executing migration" id="copy data_keys id column values into name" 2024-03-30T14:01:28.018 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 14:01:27 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a[110006]: logger=migrator t=2024-03-30T14:01:27.791878974Z level=info msg="Executing migration" id="rename data_keys name column to label" 2024-03-30T14:01:28.018 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 14:01:27 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a[110006]: logger=migrator t=2024-03-30T14:01:27.798132091Z level=info msg="Executing migration" id="rename data_keys id column back to name" 2024-03-30T14:01:28.018 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 14:01:27 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a[110006]: logger=migrator t=2024-03-30T14:01:27.804450642Z level=info msg="Executing migration" id="add column hidden to role table" 2024-03-30T14:01:28.018 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 14:01:27 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a[110006]: logger=migrator t=2024-03-30T14:01:27.805651336Z level=info msg="Executing migration" id="create query_history table v1" 2024-03-30T14:01:28.018 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 14:01:27 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a[110006]: logger=migrator t=2024-03-30T14:01:27.806094123Z level=info msg="Executing migration" id="add index query_history.org_id-created_by-datasource_uid" 2024-03-30T14:01:28.018 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 14:01:27 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a[110006]: logger=migrator t=2024-03-30T14:01:27.806584279Z level=info msg="Executing migration" id="alter table query_history alter column created_by type to bigint" 2024-03-30T14:01:28.018 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 14:01:27 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a[110006]: logger=migrator t=2024-03-30T14:01:27.806875947Z level=info msg="Executing migration" id="teams permissions migration" 2024-03-30T14:01:28.019 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 14:01:27 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a[110006]: logger=migrator t=2024-03-30T14:01:27.807377004Z level=info msg="Executing migration" id="dashboard permissions" 2024-03-30T14:01:28.019 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 14:01:27 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a[110006]: logger=migrator t=2024-03-30T14:01:27.808619675Z level=info msg="Executing migration" id="dashboard permissions uid scopes" 2024-03-30T14:01:28.019 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 14:01:27 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a[110006]: logger=migrator t=2024-03-30T14:01:27.809335523Z level=info msg="Executing migration" id="drop managed folder create actions" 2024-03-30T14:01:28.019 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 14:01:27 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a[110006]: logger=migrator t=2024-03-30T14:01:27.809635811Z level=info msg="Executing migration" id="alerting notification permissions" 2024-03-30T14:01:28.020 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 14:01:27 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a[110006]: logger=migrator t=2024-03-30T14:01:27.810015435Z level=info msg="Executing migration" id="create query_history_star table v1" 2024-03-30T14:01:28.020 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 14:01:27 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a[110006]: logger=migrator t=2024-03-30T14:01:27.81042455Z level=info msg="Executing migration" id="add index query_history.user_id-query_uid" 2024-03-30T14:01:28.020 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 14:01:27 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a[110006]: logger=migrator t=2024-03-30T14:01:27.810929057Z level=info msg="Executing migration" id="add column org_id in query_history_star" 2024-03-30T14:01:28.020 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 14:01:27 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a[110006]: logger=migrator t=2024-03-30T14:01:27.812154095Z level=info msg="Executing migration" id="alter table query_history_star_mig column user_id type to bigint" 2024-03-30T14:01:28.020 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 14:01:27 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a[110006]: logger=migrator t=2024-03-30T14:01:27.81244577Z level=info msg="Executing migration" id="create correlation table v1" 2024-03-30T14:01:28.020 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 14:01:27 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a[110006]: logger=migrator t=2024-03-30T14:01:27.812911876Z level=info msg="Executing migration" id="add index correlations.uid" 2024-03-30T14:01:28.020 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 14:01:27 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a[110006]: logger=migrator t=2024-03-30T14:01:27.813721466Z level=info msg="Executing migration" id="add index correlations.source_uid" 2024-03-30T14:01:28.020 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 14:01:27 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a[110006]: logger=migrator t=2024-03-30T14:01:27.81457154Z level=info msg="Executing migration" id="add correlation config column" 2024-03-30T14:01:28.020 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 14:01:27 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a[110006]: logger=migrator t=2024-03-30T14:01:27.815743762Z level=info msg="Executing migration" id="create entity_events table" 2024-03-30T14:01:28.020 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 14:01:27 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a[110006]: logger=migrator t=2024-03-30T14:01:27.816627034Z level=info msg="Executing migration" id="create dashboard public config v1" 2024-03-30T14:01:28.020 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 14:01:27 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a[110006]: logger=migrator t=2024-03-30T14:01:27.817472515Z level=info msg="Executing migration" id="drop index UQE_dashboard_public_config_uid - v1" 2024-03-30T14:01:28.020 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 14:01:27 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a[110006]: logger=migrator t=2024-03-30T14:01:27.817562355Z level=warn msg="Skipping migration: Already executed, but not recorded in migration log" id="drop index UQE_dashboard_public_config_uid - v1" 2024-03-30T14:01:28.020 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 14:01:27 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a[110006]: logger=migrator t=2024-03-30T14:01:27.817845359Z level=info msg="Executing migration" id="drop index IDX_dashboard_public_config_org_id_dashboard_uid - v1" 2024-03-30T14:01:28.020 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 14:01:27 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a[110006]: logger=migrator t=2024-03-30T14:01:27.817930941Z level=warn msg="Skipping migration: Already executed, but not recorded in migration log" id="drop index IDX_dashboard_public_config_org_id_dashboard_uid - v1" 2024-03-30T14:01:28.021 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 14:01:27 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a[110006]: logger=migrator t=2024-03-30T14:01:27.818242429Z level=info msg="Executing migration" id="Drop old dashboard public config table" 2024-03-30T14:01:28.021 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 14:01:27 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a[110006]: logger=migrator t=2024-03-30T14:01:27.818677636Z level=info msg="Executing migration" id="recreate dashboard public config v1" 2024-03-30T14:01:28.021 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 14:01:27 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a[110006]: logger=migrator t=2024-03-30T14:01:27.819127956Z level=info msg="Executing migration" id="create index UQE_dashboard_public_config_uid - v1" 2024-03-30T14:01:28.021 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 14:01:27 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a[110006]: logger=migrator t=2024-03-30T14:01:27.819626865Z level=info msg="Executing migration" id="create index IDX_dashboard_public_config_org_id_dashboard_uid - v1" 2024-03-30T14:01:28.021 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 14:01:27 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a[110006]: logger=migrator t=2024-03-30T14:01:27.820468637Z level=info msg="Executing migration" id="drop index UQE_dashboard_public_config_uid - v2" 2024-03-30T14:01:28.021 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 14:01:27 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a[110006]: logger=migrator t=2024-03-30T14:01:27.820929104Z level=info msg="Executing migration" id="drop index IDX_dashboard_public_config_org_id_dashboard_uid - v2" 2024-03-30T14:01:28.021 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 14:01:27 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a[110006]: logger=migrator t=2024-03-30T14:01:27.821782113Z level=info msg="Executing migration" id="Drop public config table" 2024-03-30T14:01:28.021 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 14:01:27 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a[110006]: logger=migrator t=2024-03-30T14:01:27.822646908Z level=info msg="Executing migration" id="Recreate dashboard public config v2" 2024-03-30T14:01:28.021 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 14:01:27 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a[110006]: logger=migrator t=2024-03-30T14:01:27.823482904Z level=info msg="Executing migration" id="create index UQE_dashboard_public_config_uid - v2" 2024-03-30T14:01:28.021 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 14:01:27 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a[110006]: logger=migrator t=2024-03-30T14:01:27.823953029Z level=info msg="Executing migration" id="create index IDX_dashboard_public_config_org_id_dashboard_uid - v2" 2024-03-30T14:01:28.021 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 14:01:27 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a[110006]: logger=migrator t=2024-03-30T14:01:27.826604315Z level=info msg="Executing migration" id="create index UQE_dashboard_public_config_access_token - v2" 2024-03-30T14:01:28.021 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 14:01:27 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a[110006]: logger=migrator t=2024-03-30T14:01:27.8295146Z level=info msg="Executing migration" id="Rename table dashboard_public_config to dashboard_public - v2" 2024-03-30T14:01:28.021 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 14:01:27 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a[110006]: logger=migrator t=2024-03-30T14:01:27.83340176Z level=info msg="Executing migration" id="add annotations_enabled column" 2024-03-30T14:01:28.021 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 14:01:27 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a[110006]: logger=migrator t=2024-03-30T14:01:27.834579827Z level=info msg="Executing migration" id="add time_selection_enabled column" 2024-03-30T14:01:28.021 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 14:01:27 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a[110006]: logger=migrator t=2024-03-30T14:01:27.837252149Z level=info msg="Executing migration" id="delete orphaned public dashboards" 2024-03-30T14:01:28.022 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 14:01:27 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a[110006]: logger=migrator t=2024-03-30T14:01:27.839994285Z level=info msg="Executing migration" id="add share column" 2024-03-30T14:01:28.022 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 14:01:27 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a[110006]: logger=migrator t=2024-03-30T14:01:27.841213873Z level=info msg="Executing migration" id="create default alerting folders" 2024-03-30T14:01:28.022 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 14:01:27 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a[110006]: logger=migrator t=2024-03-30T14:01:27.84172665Z level=info msg="Executing migration" id="create file table" 2024-03-30T14:01:28.022 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 14:01:27 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a[110006]: logger=migrator t=2024-03-30T14:01:27.842149847Z level=info msg="Executing migration" id="file table idx: path natural pk" 2024-03-30T14:01:28.022 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 14:01:27 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a[110006]: logger=migrator t=2024-03-30T14:01:27.842596782Z level=info msg="Executing migration" id="file table idx: parent_folder_path_hash fast folder retrieval" 2024-03-30T14:01:28.022 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 14:01:27 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a[110006]: logger=migrator t=2024-03-30T14:01:27.843067609Z level=info msg="Executing migration" id="create file_meta table" 2024-03-30T14:01:28.022 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 14:01:27 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a[110006]: logger=migrator t=2024-03-30T14:01:27.843497298Z level=info msg="Executing migration" id="file table idx: path key" 2024-03-30T14:01:28.022 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 14:01:27 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a[110006]: logger=migrator t=2024-03-30T14:01:27.843950688Z level=info msg="Executing migration" id="set path collation in file table" 2024-03-30T14:01:28.022 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 14:01:27 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a[110006]: logger=migrator t=2024-03-30T14:01:27.844244817Z level=info msg="Executing migration" id="managed permissions migration" 2024-03-30T14:01:28.022 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 14:01:27 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a[110006]: logger=migrator t=2024-03-30T14:01:27.84541945Z level=info msg="Executing migration" id="managed folder permissions alert actions migration" 2024-03-30T14:01:28.022 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 14:01:27 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a[110006]: logger=migrator t=2024-03-30T14:01:27.846027587Z level=info msg="Executing migration" id="RBAC action name migrator" 2024-03-30T14:01:28.022 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 14:01:27 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a[110006]: logger=migrator t=2024-03-30T14:01:27.846517653Z level=info msg="Executing migration" id="Add UID column to playlist" 2024-03-30T14:01:28.022 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 14:01:27 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a[110006]: logger=migrator t=2024-03-30T14:01:27.84770753Z level=info msg="Executing migration" id="Update uid column values in playlist" 2024-03-30T14:01:28.023 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 14:01:27 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a[110006]: logger=migrator t=2024-03-30T14:01:27.848043166Z level=info msg="Executing migration" id="Add index for uid in playlist" 2024-03-30T14:01:28.023 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 14:01:27 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a[110006]: logger=migrator t=2024-03-30T14:01:27.848496864Z level=info msg="Executing migration" id="update group index for alert rules" 2024-03-30T14:01:28.023 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 14:01:27 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a[110006]: logger=migrator t=2024-03-30T14:01:27.848870324Z level=info msg="Executing migration" id="managed folder permissions alert actions repeated migration" 2024-03-30T14:01:28.023 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 14:01:27 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a[110006]: logger=migrator t=2024-03-30T14:01:27.849368074Z level=info msg="Executing migration" id="admin only folder/dashboard permission" 2024-03-30T14:01:28.023 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 14:01:27 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a[110006]: logger=migrator t=2024-03-30T14:01:27.849724344Z level=info msg="Executing migration" id="add action column to seed_assignment" 2024-03-30T14:01:28.023 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 14:01:27 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a[110006]: logger=migrator t=2024-03-30T14:01:27.850903532Z level=info msg="Executing migration" id="add scope column to seed_assignment" 2024-03-30T14:01:28.023 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 14:01:27 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a[110006]: logger=migrator t=2024-03-30T14:01:27.852087857Z level=info msg="Executing migration" id="remove unique index builtin_role_role_name before nullable update" 2024-03-30T14:01:28.023 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 14:01:27 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a[110006]: logger=migrator t=2024-03-30T14:01:27.852511011Z level=info msg="Executing migration" id="update seed_assignment role_name column to nullable" 2024-03-30T14:01:28.023 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 14:01:27 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a[110006]: logger=migrator t=2024-03-30T14:01:27.865787639Z level=info msg="Executing migration" id="add unique index builtin_role_name back" 2024-03-30T14:01:28.023 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 14:01:27 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a[110006]: logger=migrator t=2024-03-30T14:01:27.868554309Z level=info msg="Executing migration" id="add unique index builtin_role_action_scope" 2024-03-30T14:01:28.023 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 14:01:27 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a[110006]: logger=migrator t=2024-03-30T14:01:27.869018411Z level=info msg="Executing migration" id="add primary key to seed_assigment" 2024-03-30T14:01:28.023 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 14:01:27 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a[110006]: logger=migrator t=2024-03-30T14:01:27.87338787Z level=info msg="Executing migration" id="managed folder permissions alert actions repeated fixed migration" 2024-03-30T14:01:28.023 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 14:01:27 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a[110006]: logger=migrator t=2024-03-30T14:01:27.873900551Z level=info msg="Executing migration" id="migrate external alertmanagers to datsourcse" 2024-03-30T14:01:28.023 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 14:01:27 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a[110006]: logger=migrator t=2024-03-30T14:01:27.874244518Z level=info msg="Executing migration" id="create folder table" 2024-03-30T14:01:28.023 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 14:01:27 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a[110006]: logger=migrator t=2024-03-30T14:01:27.874620014Z level=info msg="Executing migration" id="Add index for parent_uid" 2024-03-30T14:01:28.024 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 14:01:27 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a[110006]: logger=migrator t=2024-03-30T14:01:27.875081053Z level=info msg="Executing migration" id="Add unique index for folder.uid and folder.org_id" 2024-03-30T14:01:28.024 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 14:01:27 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a[110006]: logger=migrator t=2024-03-30T14:01:27.87554698Z level=info msg="Executing migration" id="Update folder title length" 2024-03-30T14:01:28.024 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 14:01:27 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a[110006]: logger=migrator t=2024-03-30T14:01:27.875805038Z level=info msg="Executing migration" id="Add unique index for folder.title and folder.parent_uid" 2024-03-30T14:01:28.024 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 14:01:27 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a[110006]: logger=migrator t=2024-03-30T14:01:27.876292272Z level=info msg="migrations completed" performed=105 skipped=376 duration=150.412895ms 2024-03-30T14:01:28.024 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 14:01:27 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a[110006]: logger=sqlstore t=2024-03-30T14:01:27.876591354Z level=info msg="Created default organization" 2024-03-30T14:01:28.024 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 14:01:27 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a[110006]: logger=plugin.finder t=2024-03-30T14:01:27.910570817Z level=warn msg="Skipping finding plugins as directory does not exist" path=/usr/share/grafana/plugins-bundled 2024-03-30T14:01:28.024 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 14:01:27 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a[110006]: logger=secrets t=2024-03-30T14:01:27.910664909Z level=info msg="Envelope encryption state" enabled=true currentprovider=secretKey.v1 2024-03-30T14:01:28.024 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 14:01:27 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a[110006]: logger=query_data t=2024-03-30T14:01:27.912786595Z level=info msg="Query Service initialization" 2024-03-30T14:01:28.024 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 14:01:27 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a[110006]: logger=live.push_http t=2024-03-30T14:01:27.915381885Z level=info msg="Live Push Gateway initialization" 2024-03-30T14:01:28.330 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:27 smithi099 ceph-mon[29691]: pgmap v1678: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:01:28.330 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:27 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:28.330 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:27 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:28.330 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:27 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:01:28.330 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:27 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:01:28.330 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:27 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:28.330 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:27 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-03-30T14:01:28.330 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:27 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:01:28.331 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:27 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:28.331 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:27 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:01:28.331 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:27 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:01:28.331 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:27 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:28.346 INFO:teuthology.orchestra.run.smithi099.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-03-30T14:01:28.346 INFO:teuthology.orchestra.run.smithi099.stdout:agent.smithi099 smithi099 running 5s ago 29m - - 2024-03-30T14:01:28.347 INFO:teuthology.orchestra.run.smithi099.stdout:agent.smithi181 smithi181 running 18s ago 29m - - 2024-03-30T14:01:28.347 INFO:teuthology.orchestra.run.smithi099.stdout:alertmanager.a smithi099 *:9093,9094 running (17s) 5s ago 24m 18.6M - 0.25.0 c8568f914cd2 08735152b67d 2024-03-30T14:01:28.347 INFO:teuthology.orchestra.run.smithi099.stdout:grafana.a smithi181 *:3000 starting - - - - 2024-03-30T14:01:28.347 INFO:teuthology.orchestra.run.smithi099.stdout:iscsi.foo.smithi099.qyjuvr smithi099 running (2m) 5s ago 23m 49.3M - 3.5 e1d6a67b021e 2f859af6bc2a 2024-03-30T14:01:28.347 INFO:teuthology.orchestra.run.smithi099.stdout:mgr.x smithi181 *:8443,9283,8765 running (116s) 18s ago 28m 450M - 19.0.0-1967-g4e50bbcd b0c4478f1d83 f269106f7913 2024-03-30T14:01:28.347 INFO:teuthology.orchestra.run.smithi099.stdout:mgr.y smithi099 *:8443,9283,8765 running (12m) 5s ago 30m 522M - 19.0.0-1967-g4e50bbcd b0c4478f1d83 0d464b8c1d18 2024-03-30T14:01:28.347 INFO:teuthology.orchestra.run.smithi099.stdout:mon.a smithi099 running (30m) 5s ago 30m 135M 2048M 17.2.0 e1d6a67b021e af06ebb19fd8 2024-03-30T14:01:28.347 INFO:teuthology.orchestra.run.smithi099.stdout:mon.b smithi181 running (29m) 18s ago 29m 75.3M 2048M 17.2.0 e1d6a67b021e e678a2a25c90 2024-03-30T14:01:28.347 INFO:teuthology.orchestra.run.smithi099.stdout:mon.c smithi099 running (29m) 5s ago 29m 74.4M 2048M 17.2.0 e1d6a67b021e 0f1e98917718 2024-03-30T14:01:28.347 INFO:teuthology.orchestra.run.smithi099.stdout:node-exporter.a smithi099 *:9100 running (74s) 5s ago 25m 8480k - 1.5.0 0da6a335fe13 4a3f1f6e7068 2024-03-30T14:01:28.347 INFO:teuthology.orchestra.run.smithi099.stdout:node-exporter.b smithi181 *:9100 running (69s) 18s ago 24m 15.7M - 1.5.0 0da6a335fe13 acea317b5f5d 2024-03-30T14:01:28.347 INFO:teuthology.orchestra.run.smithi099.stdout:osd.0 smithi099 running (28m) 5s ago 28m 54.6M 4096M 17.2.0 e1d6a67b021e 3158ee1b0c67 2024-03-30T14:01:28.347 INFO:teuthology.orchestra.run.smithi099.stdout:osd.1 smithi099 running (28m) 5s ago 28m 57.7M 4096M 17.2.0 e1d6a67b021e c4af0fd7071a 2024-03-30T14:01:28.347 INFO:teuthology.orchestra.run.smithi099.stdout:osd.2 smithi099 running (27m) 5s ago 27m 49.7M 4096M 17.2.0 e1d6a67b021e 8e4e805a7e20 2024-03-30T14:01:28.348 INFO:teuthology.orchestra.run.smithi099.stdout:osd.3 smithi099 running (27m) 5s ago 27m 53.7M 4096M 17.2.0 e1d6a67b021e 718812bcf065 2024-03-30T14:01:28.348 INFO:teuthology.orchestra.run.smithi099.stdout:osd.4 smithi181 running (27m) 18s ago 27m 55.3M 4096M 17.2.0 e1d6a67b021e 5e205434e973 2024-03-30T14:01:28.348 INFO:teuthology.orchestra.run.smithi099.stdout:osd.5 smithi181 running (26m) 18s ago 26m 52.9M 4096M 17.2.0 e1d6a67b021e e330c920f152 2024-03-30T14:01:28.348 INFO:teuthology.orchestra.run.smithi099.stdout:osd.6 smithi181 running (26m) 18s ago 26m 52.3M 4096M 17.2.0 e1d6a67b021e 81d889ea213d 2024-03-30T14:01:28.348 INFO:teuthology.orchestra.run.smithi099.stdout:osd.7 smithi181 running (25m) 18s ago 25m 53.0M 4096M 17.2.0 e1d6a67b021e c08b1839dd7e 2024-03-30T14:01:28.348 INFO:teuthology.orchestra.run.smithi099.stdout:prometheus.a smithi181 *:9095 running (49s) 18s ago 25m 55.6M - 2.43.0 a07b618ecd1d 004088bdf70e 2024-03-30T14:01:28.348 INFO:teuthology.orchestra.run.smithi099.stdout:rgw.foo.smithi099.fxjbmp smithi099 *:8000 running (23m) 5s ago 23m 76.5M - 17.2.0 e1d6a67b021e 400b28b3f650 2024-03-30T14:01:28.348 INFO:teuthology.orchestra.run.smithi099.stdout:rgw.foo.smithi181.wfqwti smithi181 *:8000 running (23m) 18s ago 23m 76.2M - 17.2.0 e1d6a67b021e 97e1b130f9d4 2024-03-30T14:01:28.749 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 14:01:28 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a[110006]: logger=infra.usagestats.collector t=2024-03-30T14:01:28.547622179Z level=info msg="registering usage stat providers" usageStatsProvidersLen=2 2024-03-30T14:01:28.749 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 14:01:28 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a[110006]: logger=provisioning.datasources t=2024-03-30T14:01:28.549333808Z level=info msg="deleted correlations based on configuration" ds_name=Dashboard1 2024-03-30T14:01:28.750 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 14:01:28 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a[110006]: logger=provisioning.datasources t=2024-03-30T14:01:28.549342075Z level=info msg="deleted datasource based on configuration" name=Dashboard1 2024-03-30T14:01:28.750 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 14:01:28 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a[110006]: logger=provisioning.datasources t=2024-03-30T14:01:28.549438183Z level=info msg="inserting datasource from configuration " name=Dashboard1 uid=P43CA22E17D0F9596 2024-03-30T14:01:28.750 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 14:01:28 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a[110006]: logger=provisioning.datasources t=2024-03-30T14:01:28.562765397Z level=info msg="inserting datasource from configuration " name=Loki uid=P8E80F9AEF21F6940 2024-03-30T14:01:28.750 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 14:01:28 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a[110006]: logger=provisioning.alerting t=2024-03-30T14:01:28.573357356Z level=info msg="starting to provision alerting" 2024-03-30T14:01:28.750 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 14:01:28 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a[110006]: logger=provisioning.alerting t=2024-03-30T14:01:28.573367586Z level=info msg="finished to provision alerting" 2024-03-30T14:01:28.750 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 14:01:28 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a[110006]: logger=grafanaStorageLogger t=2024-03-30T14:01:28.573470789Z level=info msg="storage starting" 2024-03-30T14:01:28.750 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 14:01:28 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a[110006]: logger=ngalert.state.manager t=2024-03-30T14:01:28.573576137Z level=info msg="Warming state cache for startup" 2024-03-30T14:01:28.750 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 14:01:28 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a[110006]: logger=http.server t=2024-03-30T14:01:28.575469935Z level=info msg="HTTP Server Listen" address=[::]:3000 protocol=https subUrl= socket= 2024-03-30T14:01:28.750 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 14:01:28 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a[110006]: logger=ngalert.state.manager t=2024-03-30T14:01:28.582015274Z level=info msg="State cache has been initialized" states=0 duration=8.438362ms 2024-03-30T14:01:28.750 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 14:01:28 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a[110006]: logger=ticker t=2024-03-30T14:01:28.582062038Z level=info msg=starting first_tick=2024-03-30T14:01:30Z 2024-03-30T14:01:28.750 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 14:01:28 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a[110006]: logger=ngalert.multiorg.alertmanager t=2024-03-30T14:01:28.582072907Z level=info msg="starting MultiOrg Alertmanager" 2024-03-30T14:01:28.750 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 14:01:28 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a[110006]: logger=sqlstore.transactions t=2024-03-30T14:01:28.595608756Z level=info msg="Database locked, sleeping then retrying" error="database is locked" retry=0 code="database is locked" 2024-03-30T14:01:28.750 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 14:01:28 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a[110006]: logger=sqlstore.transactions t=2024-03-30T14:01:28.608065495Z level=info msg="Database locked, sleeping then retrying" error="database is locked" retry=1 code="database is locked" 2024-03-30T14:01:28.751 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 14:01:28 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a[110006]: logger=sqlstore.transactions t=2024-03-30T14:01:28.619831169Z level=info msg="Database locked, sleeping then retrying" error="database is locked" retry=2 code="database is locked" 2024-03-30T14:01:28.768 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-03-30T14:01:28.768 INFO:teuthology.orchestra.run.smithi099.stdout: "mon": { 2024-03-30T14:01:28.768 INFO:teuthology.orchestra.run.smithi099.stdout: "ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)": 3 2024-03-30T14:01:28.768 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T14:01:28.769 INFO:teuthology.orchestra.run.smithi099.stdout: "mgr": { 2024-03-30T14:01:28.769 INFO:teuthology.orchestra.run.smithi099.stdout: "ceph version 19.0.0-1967-g4e50bbcd (4e50bbcdd1630c7760b708f3a5b4d38a121e66cb) squid (dev)": 2 2024-03-30T14:01:28.769 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T14:01:28.769 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": { 2024-03-30T14:01:28.769 INFO:teuthology.orchestra.run.smithi099.stdout: "ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)": 8 2024-03-30T14:01:28.769 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T14:01:28.769 INFO:teuthology.orchestra.run.smithi099.stdout: "mds": {}, 2024-03-30T14:01:28.769 INFO:teuthology.orchestra.run.smithi099.stdout: "rgw": { 2024-03-30T14:01:28.769 INFO:teuthology.orchestra.run.smithi099.stdout: "ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)": 2 2024-03-30T14:01:28.769 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T14:01:28.769 INFO:teuthology.orchestra.run.smithi099.stdout: "overall": { 2024-03-30T14:01:28.769 INFO:teuthology.orchestra.run.smithi099.stdout: "ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)": 13, 2024-03-30T14:01:28.769 INFO:teuthology.orchestra.run.smithi099.stdout: "ceph version 19.0.0-1967-g4e50bbcd (4e50bbcdd1630c7760b708f3a5b4d38a121e66cb) squid (dev)": 2 2024-03-30T14:01:28.769 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-03-30T14:01:28.769 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-03-30T14:01:29.080 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:28 smithi099 ceph-mon[29691]: from='client.15672 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T14:01:29.080 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:28 smithi099 ceph-mon[29691]: pgmap v1679: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 881 B/s rd, 0 op/s 2024-03-30T14:01:29.081 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:28 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:01:29.081 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:28 smithi099 ceph-mon[29691]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-03-30T14:01:29.081 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:28 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:01:29.081 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:28 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:01:29.081 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:28 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:29.081 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:28 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:01:29.081 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:28 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:01:29.081 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:28 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:29.081 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:28 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:01:29.081 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:28 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:01:29.081 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:28 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:29.081 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:28 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:01:29.081 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:28 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:01:29.081 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:28 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:29.082 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:28 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:01:29.082 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:28 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:29.082 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:28 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:01:29.082 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:28 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:01:29.082 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:28 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:29.082 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:28 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:01:29.082 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:28 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:29.082 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:28 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:01:29.082 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:28 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:01:29.082 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:28 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:29.082 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:28 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:01:29.082 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:28 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:29.082 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:28 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:01:29.083 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:28 smithi099 ceph-mon[24912]: from='client.15672 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T14:01:29.083 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:28 smithi099 ceph-mon[24912]: pgmap v1679: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 881 B/s rd, 0 op/s 2024-03-30T14:01:29.083 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:28 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:01:29.083 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:28 smithi099 ceph-mon[24912]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-03-30T14:01:29.083 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:28 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:01:29.083 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:28 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:01:29.083 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:28 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:29.083 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:28 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:01:29.083 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:28 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:01:29.084 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:28 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:29.084 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:28 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:01:29.084 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:28 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:01:29.084 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:28 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:29.084 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:28 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:01:29.084 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:28 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:01:29.084 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:28 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:29.084 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:28 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:01:29.084 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:28 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:29.084 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:28 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:01:29.084 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:28 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:01:29.084 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:28 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:29.084 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:28 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:01:29.084 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:28 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:29.085 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:28 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:01:29.085 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:28 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:01:29.085 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:28 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:29.085 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:28 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:01:29.085 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:28 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:29.085 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:28 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:01:29.085 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:28 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:01:29.085 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:28 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:29.085 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:28 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:01:29.085 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:28 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:29.085 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:28 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:01:29.086 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:28 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:01:29.086 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:28 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:29.086 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:28 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:01:29.086 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:28 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:29.086 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:28 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:01:29.086 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:28 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:01:29.086 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:28 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:29.086 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:28 smithi099 ceph-mon[29691]: Health check cleared: CEPHADM_FAILED_DAEMON (was: 1 failed cephadm daemon(s)) 2024-03-30T14:01:29.086 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:28 smithi099 ceph-mon[29691]: Cluster is now healthy 2024-03-30T14:01:29.086 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:28 smithi099 ceph-mon[29691]: from='client.? 172.21.15.99:0/3715387675' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:29.086 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:28 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:01:29.086 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:28 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:29.086 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:28 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:01:29.086 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:28 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:01:29.087 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:28 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:29.087 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:28 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:01:29.087 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:28 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:29.087 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:28 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:01:29.087 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:28 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:29.087 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:28 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:01:29.087 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:28 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:01:29.087 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:28 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:29.087 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:28 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:01:29.087 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:28 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:29.087 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:28 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:01:29.087 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:28 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:01:29.087 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:28 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:29.088 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:28 smithi099 ceph-mon[24912]: Health check cleared: CEPHADM_FAILED_DAEMON (was: 1 failed cephadm daemon(s)) 2024-03-30T14:01:29.088 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:28 smithi099 ceph-mon[24912]: Cluster is now healthy 2024-03-30T14:01:29.088 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:28 smithi099 ceph-mon[24912]: from='client.? 172.21.15.99:0/3715387675' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:29.088 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:28 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:01:29.088 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:28 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:29.088 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:28 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:01:29.088 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:28 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:01:29.088 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:28 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:29.097 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:28 smithi181 ceph-mon[25762]: from='client.15672 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T14:01:29.097 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:28 smithi181 ceph-mon[25762]: pgmap v1679: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 881 B/s rd, 0 op/s 2024-03-30T14:01:29.097 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:28 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:01:29.097 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:28 smithi181 ceph-mon[25762]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-03-30T14:01:29.097 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:28 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:01:29.097 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:28 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:01:29.097 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:28 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:29.097 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:28 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:01:29.097 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:28 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:01:29.097 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:28 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:29.097 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:28 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:01:29.098 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:28 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:01:29.098 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:28 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:29.098 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:28 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:01:29.098 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:28 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:01:29.098 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:28 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:29.098 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:28 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:01:29.098 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:28 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:29.098 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:28 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:01:29.098 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:28 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:01:29.098 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:28 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:29.098 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:28 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:01:29.098 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:28 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:29.098 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:28 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:01:29.099 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:28 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:01:29.099 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:28 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:29.099 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:28 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:01:29.099 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:28 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:29.099 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:28 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:01:29.099 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:28 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:01:29.099 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:28 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:29.099 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:28 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:01:29.099 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:28 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:29.099 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:28 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:01:29.099 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:28 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:01:29.099 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:28 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:29.099 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:28 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:01:29.099 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:28 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:29.099 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:28 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:01:29.100 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:28 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:01:29.100 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:28 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:29.100 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:28 smithi181 ceph-mon[25762]: Health check cleared: CEPHADM_FAILED_DAEMON (was: 1 failed cephadm daemon(s)) 2024-03-30T14:01:29.100 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:28 smithi181 ceph-mon[25762]: Cluster is now healthy 2024-03-30T14:01:29.100 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:28 smithi181 ceph-mon[25762]: from='client.? 172.21.15.99:0/3715387675' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:29.100 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:28 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:01:29.100 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:28 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:29.100 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:28 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:01:29.100 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:28 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:01:29.100 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:28 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:29.133 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-03-30T14:01:29.134 INFO:teuthology.orchestra.run.smithi099.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph:4e50bbcdd1630c7760b708f3a5b4d38a121e66cb", 2024-03-30T14:01:29.134 INFO:teuthology.orchestra.run.smithi099.stdout: "in_progress": true, 2024-03-30T14:01:29.134 INFO:teuthology.orchestra.run.smithi099.stdout: "which": "Upgrading daemons of type(s) mgr", 2024-03-30T14:01:29.134 INFO:teuthology.orchestra.run.smithi099.stdout: "services_complete": [ 2024-03-30T14:01:29.134 INFO:teuthology.orchestra.run.smithi099.stdout: "mgr" 2024-03-30T14:01:29.134 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-03-30T14:01:29.134 INFO:teuthology.orchestra.run.smithi099.stdout: "progress": "2/2 daemons upgraded", 2024-03-30T14:01:29.134 INFO:teuthology.orchestra.run.smithi099.stdout: "message": "Currently upgrading grafana daemons", 2024-03-30T14:01:29.134 INFO:teuthology.orchestra.run.smithi099.stdout: "is_paused": false 2024-03-30T14:01:29.134 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-03-30T14:01:30.183 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:29 smithi181 ceph-mon[25762]: from='client.15678 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T14:01:30.183 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:29 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:01:30.183 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:29 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:01:30.183 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:29 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:01:30.183 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:29 smithi181 ceph-mon[25762]: from='client.25576 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T14:01:30.183 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:29 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:01:30.183 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:29 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:01:30.183 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:29 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:01:30.183 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:29 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:01:30.183 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:29 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:01:30.183 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:29 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:30.183 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:29 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:01:30.184 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:29 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:01:30.184 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:29 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:30.184 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:29 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:01:30.184 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:29 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:01:30.184 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:29 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:30.184 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:29 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:01:30.184 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:29 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:01:30.184 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:29 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:30.184 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:29 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:01:30.184 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:29 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:30.184 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:29 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:01:30.184 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:29 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:01:30.184 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:29 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:30.184 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:29 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:01:30.184 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:29 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:30.185 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:29 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:01:30.185 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:29 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:01:30.185 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:29 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:30.185 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:29 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:01:30.185 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:29 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:30.185 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:29 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:01:30.185 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:29 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:01:30.185 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:29 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:30.185 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:29 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:01:30.185 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:29 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:30.185 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:29 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:01:30.185 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:29 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:01:30.185 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:29 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:30.185 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:29 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:01:30.186 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:29 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:30.186 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:29 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:01:30.186 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:29 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:01:30.186 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:29 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:30.186 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:29 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:01:30.186 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:29 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:30.186 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:29 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:01:30.186 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:29 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:01:30.186 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:29 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:30.186 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:29 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:01:30.186 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:29 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:30.186 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:29 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:01:30.187 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:29 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:01:30.187 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:29 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:30.187 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:29 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:01:30.187 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:29 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:30.187 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:29 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:01:30.187 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:29 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:01:30.187 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:29 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:30.187 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:29 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:01:30.187 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:29 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:30.187 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:29 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:01:30.187 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:29 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:01:30.187 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:29 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:30.330 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:29 smithi099 ceph-mon[24912]: from='client.15678 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T14:01:30.331 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:29 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:01:30.331 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:29 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:01:30.331 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:29 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:01:30.331 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:29 smithi099 ceph-mon[24912]: from='client.25576 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T14:01:30.331 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:29 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:01:30.332 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:29 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:01:30.332 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:29 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:01:30.332 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:29 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:01:30.332 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:29 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:01:30.332 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:29 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:30.332 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:29 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:01:30.332 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:29 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:01:30.333 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:29 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:30.333 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:29 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:01:30.333 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:29 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:01:30.333 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:29 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:30.333 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:29 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:01:30.334 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:29 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:01:30.334 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:29 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:30.334 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:29 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:01:30.334 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:29 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:30.334 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:29 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:01:30.334 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:29 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:01:30.334 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:29 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:30.335 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:29 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:01:30.335 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:29 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:30.335 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:29 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:01:30.335 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:29 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:01:30.335 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:29 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:30.336 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:29 smithi099 ceph-mon[29691]: from='client.15678 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T14:01:30.336 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:29 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:01:30.336 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:29 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:01:30.337 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:29 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:01:30.337 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:29 smithi099 ceph-mon[29691]: from='client.25576 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T14:01:30.337 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:29 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:01:30.337 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:29 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:01:30.337 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:29 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:01:30.337 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:29 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:01:30.337 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:29 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:01:30.338 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:29 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:30.338 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:29 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:01:30.338 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:29 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:01:30.338 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:29 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:30.338 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:29 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:01:30.338 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:29 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:01:30.338 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:29 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:30.338 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:29 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:01:30.338 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:29 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:01:30.339 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:29 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:30.339 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:29 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:01:30.339 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:29 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:30.339 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:29 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:01:30.339 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:29 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:01:30.339 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:29 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:30.339 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:29 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:01:30.339 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:29 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:30.339 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:29 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:01:30.340 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:29 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:01:30.340 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:29 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:30.340 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:29 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:01:30.340 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:29 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:30.340 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:29 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:01:30.340 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:29 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:01:30.340 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:29 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:30.340 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:29 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:01:30.340 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:29 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:30.341 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:29 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:01:30.341 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:29 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:01:30.341 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:29 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:30.341 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:29 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:01:30.341 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:29 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:30.341 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:29 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:01:30.341 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:29 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:01:30.341 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:29 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:30.342 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:29 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:01:30.342 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:29 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:30.342 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:29 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:01:30.342 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:29 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:01:30.342 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:29 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:30.342 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:29 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:01:30.342 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:29 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:30.342 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:29 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:01:30.342 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:29 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:01:30.342 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:29 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:30.342 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:29 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:01:30.342 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:29 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:30.342 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:29 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:01:30.343 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:29 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:01:30.343 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:29 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:01:30.343 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:29 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:30.343 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:29 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:01:30.343 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:29 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:01:30.343 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:29 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:30.343 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:29 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:01:30.343 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:29 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:30.343 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:29 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:01:30.343 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:29 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:01:30.343 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:29 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:30.344 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:29 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:01:30.344 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:29 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:30.344 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:29 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:01:30.344 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:29 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:01:30.344 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:29 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:30.344 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:29 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:01:30.344 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:29 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:30.344 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:29 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:01:30.344 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:29 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:01:30.344 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:29 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:30.344 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:29 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:01:30.344 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:29 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:30.344 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:29 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:01:30.344 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:29 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:01:30.344 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:29 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:30.345 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:29 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:01:30.345 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:29 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:30.345 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:29 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:01:30.345 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:29 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:01:30.345 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:29 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:30.345 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:29 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:01:30.345 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:29 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:30.345 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:29 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:01:30.345 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:29 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:01:30.345 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:29 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:30.346 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:29 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:30.346 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:29 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:01:30.346 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:29 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:30.346 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:29 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:01:30.346 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:29 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:01:30.346 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:29 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:30.991 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:30 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:01:30.991 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:30 smithi181 ceph-mon[25762]: from='client.15696 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T14:01:30.991 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:30 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:01:30.991 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:30 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:01:30.991 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:30 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:01:30.991 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:30 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:01:30.992 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:30 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:01:30.992 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:30 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:01:30.992 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:30 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:01:30.992 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:30 smithi181 ceph-mon[25762]: pgmap v1680: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 655 B/s rd, 0 op/s 2024-03-30T14:01:30.992 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:30 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:01:30.992 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:30 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:01:30.992 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:30 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:01:30.992 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:30 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:30.992 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:30 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:01:30.992 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:30 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:01:30.992 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:30 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:30.992 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:30 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:01:30.992 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:30 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:01:30.993 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:30 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:30.993 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:30 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:01:30.993 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:30 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:01:30.993 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:30 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:30.993 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:30 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:01:30.993 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:30 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:30.993 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:30 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:01:30.993 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:30 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:01:30.993 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:30 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:30.993 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:30 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:01:30.993 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:30 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:30.993 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:30 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:01:30.993 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:30 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:01:30.993 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:30 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:30.993 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:30 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:30.994 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:30 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:30.994 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:30 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:30.994 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:30 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:01:30.994 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:30 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:30.994 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:30 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:30.994 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:30 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:30.994 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:30 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:30.994 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:30 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:30.994 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:30 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:30.994 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:30 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:30.994 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:30 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:30.994 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:30 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:30.994 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:30 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:30.995 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:30 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:30.995 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:30 smithi181 ceph-mon[25762]: Health check failed: 1 failed cephadm daemon(s) (CEPHADM_FAILED_DAEMON) 2024-03-30T14:01:30.995 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:30 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T14:01:31.330 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:30 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:01:31.331 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:30 smithi099 ceph-mon[24912]: from='client.15696 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T14:01:31.331 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:30 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:01:31.331 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:30 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:01:31.331 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:30 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:01:31.331 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:30 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:01:31.331 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:30 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:01:31.331 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:30 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:01:31.331 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:30 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:01:31.331 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:30 smithi099 ceph-mon[24912]: pgmap v1680: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 655 B/s rd, 0 op/s 2024-03-30T14:01:31.331 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:30 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:01:31.331 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:30 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:01:31.331 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:30 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:01:31.331 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:30 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:31.331 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:30 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:01:31.331 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:30 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:01:31.331 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:30 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:31.332 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:30 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:01:31.332 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:30 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:01:31.332 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:30 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:31.332 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:30 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:01:31.332 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:30 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:01:31.332 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:30 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:31.332 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:30 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:01:31.332 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:30 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:31.332 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:30 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:01:31.332 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:30 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:01:31.332 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:30 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:31.332 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:30 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:01:31.332 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:30 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:31.332 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:30 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:01:31.333 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:30 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:01:31.333 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:30 smithi099 ceph-mon[29691]: from='client.15696 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T14:01:31.333 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:30 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:01:31.333 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:30 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:01:31.333 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:30 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:01:31.333 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:30 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:01:31.333 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:30 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:01:31.333 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:30 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:01:31.333 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:30 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:01:31.333 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:30 smithi099 ceph-mon[29691]: pgmap v1680: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 655 B/s rd, 0 op/s 2024-03-30T14:01:31.333 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:30 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:01:31.334 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:30 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:01:31.334 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:30 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:01:31.334 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:30 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:31.334 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:30 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:01:31.334 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:30 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:01:31.334 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:30 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:31.334 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:30 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:01:31.334 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:30 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:01:31.334 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:30 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:31.334 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:30 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:01:31.334 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:30 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:01:31.334 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:30 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:31.334 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:30 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:01:31.334 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:30 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:31.334 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:30 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:01:31.335 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:30 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:01:31.335 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:30 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:31.335 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:30 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:01:31.335 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:30 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:31.335 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:30 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:01:31.335 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:30 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:01:31.335 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:30 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:31.335 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:30 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:31.335 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:30 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:31.335 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:30 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:31.335 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:30 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:01:31.335 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:30 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:31.335 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:30 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:31.336 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:30 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:31.336 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:30 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:31.336 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:30 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:31.336 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:30 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:31.336 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:30 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:31.336 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:30 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:31.336 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:30 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:31.336 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:30 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:31.336 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:30 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:31.336 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:30 smithi099 ceph-mon[29691]: Health check failed: 1 failed cephadm daemon(s) (CEPHADM_FAILED_DAEMON) 2024-03-30T14:01:31.336 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:30 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T14:01:31.336 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:30 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:01:31.337 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:30 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:31.337 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:30 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:31.337 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:30 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:31.337 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:30 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:31.337 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:30 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:01:31.337 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:30 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:31.337 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:30 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:31.337 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:30 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:31.337 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:30 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:31.337 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:30 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:31.337 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:30 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:31.337 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:30 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:31.338 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:30 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:31.338 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:30 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:31.338 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:30 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:31.338 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:30 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:31.338 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:30 smithi099 ceph-mon[24912]: Health check failed: 1 failed cephadm daemon(s) (CEPHADM_FAILED_DAEMON) 2024-03-30T14:01:31.338 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:30 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T14:01:32.164 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:31 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:01:32.164 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:31 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:01:32.164 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:31 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:01:32.164 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:31 smithi181 ceph-mon[25762]: pgmap v1681: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 670 B/s rd, 0 op/s 2024-03-30T14:01:32.330 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:31 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:01:32.330 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:31 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:01:32.330 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:31 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:01:32.330 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:31 smithi099 ceph-mon[24912]: pgmap v1681: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 670 B/s rd, 0 op/s 2024-03-30T14:01:32.330 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:31 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:01:32.330 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:31 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:01:32.330 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:31 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:01:32.331 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:31 smithi099 ceph-mon[29691]: pgmap v1681: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 670 B/s rd, 0 op/s 2024-03-30T14:01:34.192 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:33 smithi181 ceph-mon[25762]: pgmap v1682: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 1.0 KiB/s rd, 1 op/s 2024-03-30T14:01:34.330 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:33 smithi099 ceph-mon[24912]: pgmap v1682: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 1.0 KiB/s rd, 1 op/s 2024-03-30T14:01:34.330 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:33 smithi099 ceph-mon[29691]: pgmap v1682: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 1.0 KiB/s rd, 1 op/s 2024-03-30T14:01:35.080 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:34 smithi099 ceph-mon[24912]: from='client.25136 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T14:01:35.080 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:34 smithi099 ceph-mon[29691]: from='client.25136 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T14:01:35.081 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 14:01:34 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[71049]: ::ffff:172.21.15.181 - - [30/Mar/2024:14:01:34] "GET /metrics HTTP/1.1" 200 37994 "" "Prometheus/2.43.0" 2024-03-30T14:01:35.194 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:34 smithi181 ceph-mon[25762]: from='client.25136 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T14:01:35.943 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:35 smithi181 ceph-mon[25762]: pgmap v1683: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 1.0 KiB/s rd, 1 op/s 2024-03-30T14:01:36.330 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:35 smithi099 ceph-mon[24912]: pgmap v1683: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 1.0 KiB/s rd, 1 op/s 2024-03-30T14:01:36.330 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:35 smithi099 ceph-mon[29691]: pgmap v1683: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 1.0 KiB/s rd, 1 op/s 2024-03-30T14:01:37.249 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:36 smithi181 ceph-mon[25762]: Upgrade: Updating grafana.a 2024-03-30T14:01:37.249 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:36 smithi181 ceph-mon[25762]: Deploying daemon grafana.a on smithi181 2024-03-30T14:01:37.330 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:36 smithi099 ceph-mon[29691]: Upgrade: Updating grafana.a 2024-03-30T14:01:37.330 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:36 smithi099 ceph-mon[29691]: Deploying daemon grafana.a on smithi181 2024-03-30T14:01:37.330 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:36 smithi099 ceph-mon[24912]: Upgrade: Updating grafana.a 2024-03-30T14:01:37.330 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:36 smithi099 ceph-mon[24912]: Deploying daemon grafana.a on smithi181 2024-03-30T14:01:37.974 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:37 smithi181 ceph-mon[25762]: pgmap v1684: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 1.0 KiB/s rd, 1 op/s 2024-03-30T14:01:38.330 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:37 smithi099 ceph-mon[24912]: pgmap v1684: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 1.0 KiB/s rd, 1 op/s 2024-03-30T14:01:38.330 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:37 smithi099 ceph-mon[29691]: pgmap v1684: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 1.0 KiB/s rd, 1 op/s 2024-03-30T14:01:39.313 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 14:01:39 smithi181 systemd[1]: Stopping Ceph grafana.a for 98ebaeb8-ee99-11ee-b647-cb9ed24678a4... 2024-03-30T14:01:40.249 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:39 smithi181 ceph-mon[25762]: pgmap v1685: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 973 B/s rd, 0 op/s 2024-03-30T14:01:40.330 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:39 smithi099 ceph-mon[24912]: pgmap v1685: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 973 B/s rd, 0 op/s 2024-03-30T14:01:40.330 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:39 smithi099 ceph-mon[29691]: pgmap v1685: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 973 B/s rd, 0 op/s 2024-03-30T14:01:40.641 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 14:01:40 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a[110006]: logger=server t=2024-03-30T14:01:40.354530254Z level=info msg="Shutdown started" reason="System signal: terminated" 2024-03-30T14:01:40.641 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 14:01:40 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a[110006]: logger=ticker t=2024-03-30T14:01:40.354582152Z level=info msg=stopped last_tick=2024-03-30T14:01:40Z 2024-03-30T14:01:40.641 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 14:01:40 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a[110006]: logger=tracing t=2024-03-30T14:01:40.35462979Z level=info msg="Closing tracing" 2024-03-30T14:01:40.917 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 14:01:40 smithi181 podman[111940]: 2024-03-30 14:01:40.737672016 +0000 UTC m=+1.122073368 container cleanup 3d006a088644da7ee8ec3c4ab96532390e378d9aef143447123f20f071e65fef (image=quay.io/ceph/grafana:9.4.12, name=ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a, maintainer=Grafana Labs ) 2024-03-30T14:01:40.917 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 14:01:40 smithi181 bash[111940]: ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a 2024-03-30T14:01:41.170 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 14:01:41 smithi181 podman[112041]: 2024-03-30 14:01:41.039382091 +0000 UTC m=+0.674734995 container remove 3d006a088644da7ee8ec3c4ab96532390e378d9aef143447123f20f071e65fef (image=quay.io/ceph/grafana:9.4.12, name=ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a, maintainer=Grafana Labs ) 2024-03-30T14:01:41.499 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:41 smithi181 ceph-mon[25762]: pgmap v1686: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 973 B/s rd, 0 op/s 2024-03-30T14:01:41.499 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:41 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:41.499 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:41 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:41.500 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:41 smithi181 ceph-mon[25762]: pgmap v1687: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 1010 B/s rd, 0 op/s 2024-03-30T14:01:41.500 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:41 smithi181 ceph-mon[25762]: pgmap v1688: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 629 B/s rd, 0 op/s 2024-03-30T14:01:41.500 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:41 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:41.500 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 14:01:41 smithi181 systemd[1]: ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4@grafana.a.service: Deactivated successfully. 2024-03-30T14:01:41.500 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 14:01:41 smithi181 systemd[1]: Stopped Ceph grafana.a for 98ebaeb8-ee99-11ee-b647-cb9ed24678a4. 2024-03-30T14:01:41.500 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 14:01:41 smithi181 systemd[1]: ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4@grafana.a.service: Consumed 2.528s CPU time. 2024-03-30T14:01:41.500 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 14:01:41 smithi181 systemd[1]: Starting Ceph grafana.a for 98ebaeb8-ee99-11ee-b647-cb9ed24678a4... 2024-03-30T14:01:41.831 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:41 smithi099 ceph-mon[24912]: pgmap v1686: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 973 B/s rd, 0 op/s 2024-03-30T14:01:41.831 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:41 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:41.831 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:41 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:41.831 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:41 smithi099 ceph-mon[24912]: pgmap v1687: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 1010 B/s rd, 0 op/s 2024-03-30T14:01:41.831 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:41 smithi099 ceph-mon[24912]: pgmap v1688: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 629 B/s rd, 0 op/s 2024-03-30T14:01:41.831 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:41 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:41.831 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:41 smithi099 ceph-mon[29691]: pgmap v1686: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 973 B/s rd, 0 op/s 2024-03-30T14:01:41.831 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:41 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:41.831 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:41 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:41.832 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:41 smithi099 ceph-mon[29691]: pgmap v1687: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 1010 B/s rd, 0 op/s 2024-03-30T14:01:41.832 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:41 smithi099 ceph-mon[29691]: pgmap v1688: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 629 B/s rd, 0 op/s 2024-03-30T14:01:41.832 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:41 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:42.625 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 14:01:42 smithi181 podman[112377]: 2024-03-30 14:01:42.170497237 +0000 UTC m=+0.024124036 image pull 2bacad6d85d802cd176c146528adcc0e47a8a83e94bc4a8b7ba1a9b9ef2c65e7 quay.io/ceph/grafana:9.4.12 2024-03-30T14:01:42.626 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 14:01:42 smithi181 podman[112377]: 2024-03-30 14:01:42.32758109 +0000 UTC m=+0.181207869 container create d599aa7730d6227db19936ee8df095983f72f801c1ba54984dfd4bf6c82f3037 (image=quay.io/ceph/grafana:9.4.12, name=ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a, maintainer=Grafana Labs ) 2024-03-30T14:01:43.727 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 14:01:43 smithi181 podman[112377]: 2024-03-30 14:01:43.317348001 +0000 UTC m=+1.170974787 container init d599aa7730d6227db19936ee8df095983f72f801c1ba54984dfd4bf6c82f3037 (image=quay.io/ceph/grafana:9.4.12, name=ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a, maintainer=Grafana Labs ) 2024-03-30T14:01:43.728 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 14:01:43 smithi181 podman[112377]: 2024-03-30 14:01:43.319995196 +0000 UTC m=+1.173621978 container start d599aa7730d6227db19936ee8df095983f72f801c1ba54984dfd4bf6c82f3037 (image=quay.io/ceph/grafana:9.4.12, name=ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a, maintainer=Grafana Labs ) 2024-03-30T14:01:43.728 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 14:01:43 smithi181 bash[112377]: d599aa7730d6227db19936ee8df095983f72f801c1ba54984dfd4bf6c82f3037 2024-03-30T14:01:43.728 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 14:01:43 smithi181 systemd[1]: Started Ceph grafana.a for 98ebaeb8-ee99-11ee-b647-cb9ed24678a4. 2024-03-30T14:01:43.728 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 14:01:43 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a[112419]: logger=settings t=2024-03-30T14:01:43.471191163Z level=info msg="Starting Grafana" version=9.4.12 commit=37ee25ba46 branch=HEAD compiled=2023-05-22T15:58:05Z 2024-03-30T14:01:43.728 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 14:01:43 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a[112419]: logger=settings t=2024-03-30T14:01:43.471374309Z level=warn msg="\"sentry\" frontend logging provider is deprecated and will be removed in the next major version. Use \"grafana\" provider instead." 2024-03-30T14:01:43.728 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 14:01:43 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a[112419]: logger=settings t=2024-03-30T14:01:43.471384789Z level=info msg="Config loaded from" file=/usr/share/grafana/conf/defaults.ini 2024-03-30T14:01:43.728 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 14:01:43 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a[112419]: logger=settings t=2024-03-30T14:01:43.471388054Z level=info msg="Config loaded from" file=/etc/grafana/grafana.ini 2024-03-30T14:01:43.729 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 14:01:43 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a[112419]: logger=settings t=2024-03-30T14:01:43.471390755Z level=info msg="Config overridden from command line" arg="default.paths.data=/var/lib/grafana" 2024-03-30T14:01:43.729 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 14:01:43 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a[112419]: logger=settings t=2024-03-30T14:01:43.47139343Z level=info msg="Config overridden from command line" arg="default.paths.logs=/var/log/grafana" 2024-03-30T14:01:43.729 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 14:01:43 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a[112419]: logger=settings t=2024-03-30T14:01:43.471396018Z level=info msg="Config overridden from command line" arg="default.paths.plugins=/var/lib/grafana/plugins" 2024-03-30T14:01:43.729 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 14:01:43 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a[112419]: logger=settings t=2024-03-30T14:01:43.47139859Z level=info msg="Config overridden from command line" arg="default.paths.provisioning=/etc/grafana/provisioning" 2024-03-30T14:01:43.729 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 14:01:43 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a[112419]: logger=settings t=2024-03-30T14:01:43.471401364Z level=info msg="Config overridden from command line" arg="default.log.mode=console" 2024-03-30T14:01:43.729 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 14:01:43 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a[112419]: logger=settings t=2024-03-30T14:01:43.471404868Z level=info msg="Config overridden from Environment variable" var="GF_PATHS_DATA=/var/lib/grafana" 2024-03-30T14:01:43.729 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 14:01:43 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a[112419]: logger=settings t=2024-03-30T14:01:43.471407542Z level=info msg="Config overridden from Environment variable" var="GF_PATHS_LOGS=/var/log/grafana" 2024-03-30T14:01:43.729 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 14:01:43 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a[112419]: logger=settings t=2024-03-30T14:01:43.471410164Z level=info msg="Config overridden from Environment variable" var="GF_PATHS_PLUGINS=/var/lib/grafana/plugins" 2024-03-30T14:01:43.730 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 14:01:43 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a[112419]: logger=settings t=2024-03-30T14:01:43.471412703Z level=info msg="Config overridden from Environment variable" var="GF_PATHS_PROVISIONING=/etc/grafana/provisioning" 2024-03-30T14:01:43.730 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 14:01:43 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a[112419]: logger=settings t=2024-03-30T14:01:43.471415978Z level=info msg="Path Home" path=/usr/share/grafana 2024-03-30T14:01:43.730 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 14:01:43 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a[112419]: logger=settings t=2024-03-30T14:01:43.47141941Z level=info msg="Path Data" path=/var/lib/grafana 2024-03-30T14:01:43.730 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 14:01:43 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a[112419]: logger=settings t=2024-03-30T14:01:43.471422238Z level=info msg="Path Logs" path=/var/log/grafana 2024-03-30T14:01:43.730 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 14:01:43 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a[112419]: logger=settings t=2024-03-30T14:01:43.471424608Z level=info msg="Path Plugins" path=/var/lib/grafana/plugins 2024-03-30T14:01:43.730 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 14:01:43 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a[112419]: logger=settings t=2024-03-30T14:01:43.471427174Z level=info msg="Path Provisioning" path=/etc/grafana/provisioning 2024-03-30T14:01:43.730 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 14:01:43 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a[112419]: logger=settings t=2024-03-30T14:01:43.471429734Z level=info msg="App mode production" 2024-03-30T14:01:43.731 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 14:01:43 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a[112419]: logger=sqlstore t=2024-03-30T14:01:43.471472177Z level=info msg="Connecting to DB" dbtype=sqlite3 2024-03-30T14:01:43.731 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 14:01:43 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a[112419]: logger=sqlstore t=2024-03-30T14:01:43.471483391Z level=warn msg="SQLite database file has broader permissions than it should" path=/var/lib/grafana/grafana.db mode=-rw-r--r-- expected=-rw-r----- 2024-03-30T14:01:43.731 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 14:01:43 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a[112419]: logger=migrator t=2024-03-30T14:01:43.489614958Z level=info msg="Starting DB migrations" 2024-03-30T14:01:43.731 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 14:01:43 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a[112419]: logger=migrator t=2024-03-30T14:01:43.494758665Z level=info msg="migrations completed" performed=0 skipped=481 duration=667.208µs 2024-03-30T14:01:43.731 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 14:01:43 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a[112419]: logger=sqlstore t=2024-03-30T14:01:43.495201222Z level=info msg="Created default organization" 2024-03-30T14:01:43.731 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 14:01:43 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a[112419]: logger=plugin.finder t=2024-03-30T14:01:43.533600351Z level=warn msg="Skipping finding plugins as directory does not exist" path=/usr/share/grafana/plugins-bundled 2024-03-30T14:01:43.731 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 14:01:43 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a[112419]: logger=secrets t=2024-03-30T14:01:43.533701249Z level=info msg="Envelope encryption state" enabled=true currentprovider=secretKey.v1 2024-03-30T14:01:43.732 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 14:01:43 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a[112419]: logger=query_data t=2024-03-30T14:01:43.53580258Z level=info msg="Query Service initialization" 2024-03-30T14:01:43.732 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 14:01:43 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a[112419]: logger=live.push_http t=2024-03-30T14:01:43.538533908Z level=info msg="Live Push Gateway initialization" 2024-03-30T14:01:43.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:43 smithi181 ceph-mon[25762]: pgmap v1689: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T14:01:43.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:43 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:43.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:43 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:43.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:43 smithi181 ceph-mon[25762]: pgmap v1690: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 1 op/s 2024-03-30T14:01:44.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:43 smithi181 ceph-mon[25762]: pgmap v1691: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-03-30T14:01:44.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:43 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:44.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:43 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:44.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:43 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:44.003 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:43 smithi099 ceph-mon[24912]: pgmap v1689: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T14:01:44.003 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:43 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:44.003 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:43 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:44.003 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:43 smithi099 ceph-mon[24912]: pgmap v1690: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 1 op/s 2024-03-30T14:01:44.003 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:43 smithi099 ceph-mon[24912]: pgmap v1691: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-03-30T14:01:44.003 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:43 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:44.003 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:43 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:44.003 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:43 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:44.004 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:43 smithi099 ceph-mon[29691]: pgmap v1689: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T14:01:44.004 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:43 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:44.004 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:43 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:44.004 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:43 smithi099 ceph-mon[29691]: pgmap v1690: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 1 op/s 2024-03-30T14:01:44.004 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:43 smithi099 ceph-mon[29691]: pgmap v1691: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-03-30T14:01:44.004 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:43 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:44.004 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:43 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:44.004 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:43 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:44.499 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 14:01:44 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a[112419]: logger=infra.usagestats.collector t=2024-03-30T14:01:44.183332395Z level=info msg="registering usage stat providers" usageStatsProvidersLen=2 2024-03-30T14:01:44.499 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 14:01:44 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a[112419]: logger=provisioning.datasources t=2024-03-30T14:01:44.18524489Z level=info msg="deleted correlations based on configuration" ds_name=Dashboard1 2024-03-30T14:01:44.499 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 14:01:44 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a[112419]: logger=provisioning.datasources t=2024-03-30T14:01:44.185253619Z level=info msg="deleted datasource based on configuration" name=Dashboard1 2024-03-30T14:01:44.499 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 14:01:44 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a[112419]: logger=provisioning.datasources t=2024-03-30T14:01:44.185351153Z level=info msg="inserting datasource from configuration " name=Dashboard1 uid=P43CA22E17D0F9596 2024-03-30T14:01:44.500 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 14:01:44 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a[112419]: logger=provisioning.alerting t=2024-03-30T14:01:44.212456912Z level=info msg="starting to provision alerting" 2024-03-30T14:01:44.500 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 14:01:44 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a[112419]: logger=provisioning.alerting t=2024-03-30T14:01:44.21246799Z level=info msg="finished to provision alerting" 2024-03-30T14:01:44.500 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 14:01:44 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a[112419]: logger=grafanaStorageLogger t=2024-03-30T14:01:44.212597351Z level=info msg="storage starting" 2024-03-30T14:01:44.500 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 14:01:44 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a[112419]: logger=ngalert.state.manager t=2024-03-30T14:01:44.21267302Z level=info msg="Warming state cache for startup" 2024-03-30T14:01:44.500 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 14:01:44 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a[112419]: logger=http.server t=2024-03-30T14:01:44.214997422Z level=info msg="HTTP Server Listen" address=[::]:3000 protocol=https subUrl= socket= 2024-03-30T14:01:44.500 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 14:01:44 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a[112419]: logger=ngalert.state.manager t=2024-03-30T14:01:44.22304556Z level=info msg="State cache has been initialized" states=0 duration=10.370861ms 2024-03-30T14:01:44.500 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 14:01:44 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a[112419]: logger=ngalert.multiorg.alertmanager t=2024-03-30T14:01:44.2231006Z level=info msg="starting MultiOrg Alertmanager" 2024-03-30T14:01:44.500 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 14:01:44 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a[112419]: logger=ticker t=2024-03-30T14:01:44.223113415Z level=info msg=starting first_tick=2024-03-30T14:01:50Z 2024-03-30T14:01:44.890 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 14:01:44 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[71049]: ::ffff:172.21.15.181 - - [30/Mar/2024:14:01:44] "GET /metrics HTTP/1.1" 200 37994 "" "Prometheus/2.43.0" 2024-03-30T14:01:45.207 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:44 smithi181 ceph-mon[25762]: from='client.25136 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T14:01:45.207 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:44 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:45.207 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:44 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:45.207 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:44 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:01:45.207 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:44 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:01:45.207 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:44 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:45.207 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:44 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-03-30T14:01:45.207 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:44 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:01:45.207 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:44 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:45.207 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:44 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:01:45.207 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:44 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:01:45.207 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:44 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:45.208 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:44 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:01:45.208 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:44 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:45.208 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:44 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:01:45.208 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:44 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:01:45.208 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:44 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:45.208 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:44 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:01:45.208 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:44 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:45.208 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:44 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:01:45.208 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:44 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:01:45.208 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:44 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:45.208 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:44 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:01:45.208 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:44 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:45.208 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:44 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:01:45.208 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:44 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:01:45.208 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:44 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:45.209 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:44 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:01:45.209 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:44 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:45.209 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:44 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:01:45.209 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:44 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:01:45.209 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:44 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:45.209 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:44 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:01:45.209 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:44 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:45.209 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:44 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:01:45.209 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:44 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:01:45.209 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:44 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:45.209 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:44 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:01:45.209 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:44 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:45.209 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:44 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:01:45.209 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:44 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:01:45.210 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:44 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:45.210 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:44 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:01:45.210 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:44 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:45.210 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:44 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:01:45.210 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:44 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:01:45.210 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:44 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:45.210 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:44 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:01:45.210 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:44 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:45.210 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:44 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:01:45.210 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:44 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:01:45.299 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:44 smithi099 ceph-mon[24912]: from='client.25136 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T14:01:45.299 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:44 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:45.299 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:44 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:45.299 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:44 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:01:45.299 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:44 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:01:45.299 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:44 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:45.299 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:44 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-03-30T14:01:45.299 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:44 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:01:45.299 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:44 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:45.299 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:44 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:01:45.299 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:44 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:01:45.299 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:44 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:45.300 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:44 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:01:45.300 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:44 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:45.300 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:44 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:01:45.300 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:44 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:01:45.300 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:44 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:45.300 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:44 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:01:45.300 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:44 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:45.300 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:44 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:01:45.300 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:44 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:01:45.300 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:44 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:45.300 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:44 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:01:45.300 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:44 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:45.300 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:44 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:01:45.300 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:44 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:01:45.300 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:44 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:45.301 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:44 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:01:45.301 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:44 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:45.301 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:44 smithi099 ceph-mon[29691]: from='client.25136 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T14:01:45.301 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:44 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:45.301 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:44 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:45.301 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:44 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:01:45.301 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:44 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:01:45.301 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:44 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:45.301 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:44 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-03-30T14:01:45.301 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:44 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:01:45.301 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:44 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:45.302 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:44 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:01:45.302 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:44 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:01:45.302 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:44 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:45.302 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:44 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:01:45.302 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:44 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:45.302 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:44 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:01:45.302 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:44 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:01:45.302 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:44 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:45.303 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:44 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:01:45.303 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:44 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:45.303 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:44 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:01:45.303 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:44 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:01:45.303 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:44 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:45.303 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:44 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:01:45.303 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:44 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:45.303 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:44 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:01:45.303 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:44 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:01:45.303 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:44 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:45.303 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:44 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:01:45.303 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:44 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:45.304 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:44 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:01:45.304 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:44 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:01:45.304 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:44 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:45.304 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:44 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:01:45.304 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:44 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:45.304 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:44 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:01:45.304 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:44 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:01:45.304 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:44 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:45.304 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:44 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:01:45.304 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:44 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:45.304 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:44 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:01:45.304 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:44 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:01:45.304 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:44 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:45.304 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:44 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:01:45.304 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:44 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:45.305 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:44 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:01:45.305 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:44 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:01:45.305 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:44 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:45.305 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:44 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:01:45.305 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:44 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:45.305 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:44 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:01:45.305 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:44 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:01:45.305 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:44 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:01:45.305 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:44 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:01:45.305 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:44 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:45.305 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:44 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:01:45.305 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:44 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:45.306 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:44 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:01:45.306 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:44 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:01:45.306 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:44 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:45.306 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:44 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:01:45.306 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:44 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:45.306 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:44 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:01:45.306 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:44 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:01:45.306 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:44 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:45.306 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:44 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:01:45.306 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:44 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:45.306 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:44 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:01:45.306 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:44 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:01:45.306 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:44 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:45.306 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:44 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:01:45.307 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:44 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:45.307 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:44 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:01:45.307 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:44 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:01:46.151 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:45 smithi099 ceph-mon[24912]: pgmap v1692: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-03-30T14:01:46.151 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:45 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:01:46.151 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:45 smithi099 ceph-mon[24912]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-03-30T14:01:46.151 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:45 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:01:46.152 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:45 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:01:46.152 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:45 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:01:46.152 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:45 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:01:46.152 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:45 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:01:46.152 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:45 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:01:46.152 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:45 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:01:46.152 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:45 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:01:46.152 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:45 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:46.152 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:45 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:01:46.152 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:45 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:01:46.152 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:45 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:46.152 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:45 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:01:46.152 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:45 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:01:46.152 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:45 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:46.152 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:45 smithi099 ceph-mon[24912]: Health check cleared: CEPHADM_FAILED_DAEMON (was: 1 failed cephadm daemon(s)) 2024-03-30T14:01:46.153 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:45 smithi099 ceph-mon[24912]: Cluster is now healthy 2024-03-30T14:01:46.153 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:45 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:01:46.153 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:45 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:46.153 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:45 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:01:46.153 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:45 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:01:46.153 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:45 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:46.153 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:45 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:01:46.153 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:45 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:46.153 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:45 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:01:46.153 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:45 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:01:46.153 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:45 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:46.153 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:45 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:01:46.153 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:45 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:46.154 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:45 smithi099 ceph-mon[29691]: pgmap v1692: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-03-30T14:01:46.154 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:45 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:01:46.154 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:45 smithi099 ceph-mon[29691]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-03-30T14:01:46.154 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:45 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:01:46.154 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:45 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:01:46.154 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:45 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:01:46.154 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:45 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:01:46.154 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:45 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:01:46.154 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:45 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:01:46.154 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:45 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:01:46.154 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:45 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:01:46.154 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:45 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:46.154 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:45 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:01:46.154 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:45 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:01:46.155 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:45 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:46.155 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:45 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:01:46.155 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:45 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:01:46.155 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:45 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:46.155 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:45 smithi099 ceph-mon[29691]: Health check cleared: CEPHADM_FAILED_DAEMON (was: 1 failed cephadm daemon(s)) 2024-03-30T14:01:46.155 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:45 smithi099 ceph-mon[29691]: Cluster is now healthy 2024-03-30T14:01:46.155 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:45 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:01:46.155 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:45 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:46.155 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:45 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:01:46.155 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:45 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:01:46.155 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:45 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:46.155 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:45 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:01:46.155 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:45 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:46.156 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:45 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:01:46.156 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:45 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:01:46.156 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:45 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:46.156 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:45 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:01:46.156 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:45 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:46.156 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:45 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:01:46.156 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:45 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:01:46.157 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:45 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:46.157 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:45 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:01:46.157 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:45 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:46.157 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:45 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:01:46.157 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:45 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:01:46.157 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:45 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:46.157 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:45 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:01:46.157 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:45 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:46.157 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:45 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:01:46.157 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:45 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:01:46.157 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:45 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:46.157 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:45 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:01:46.157 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:45 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:46.157 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:45 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:01:46.158 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:45 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:01:46.158 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:45 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:46.158 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:45 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:01:46.158 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:45 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:46.158 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:45 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:01:46.158 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:45 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:01:46.158 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:45 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:46.158 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:45 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:46.158 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:45 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T14:01:46.158 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:45 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:01:46.158 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:45 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:46.158 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:45 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:01:46.158 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:45 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:01:46.158 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:45 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:46.159 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:45 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:01:46.159 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:45 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:46.159 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:45 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:01:46.159 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:45 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:01:46.159 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:45 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:46.159 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:45 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:01:46.159 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:45 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:01:46.159 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:45 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:46.159 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:45 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:01:46.159 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:45 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:46.159 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:45 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:01:46.160 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:45 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:01:46.160 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:45 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:46.160 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:45 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:01:46.160 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:45 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:46.160 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:45 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:01:46.160 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:45 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:01:46.160 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:45 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:46.160 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:45 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:01:46.160 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:45 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:46.160 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:45 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:01:46.160 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:45 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:01:46.160 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:45 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:46.160 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:45 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:01:46.161 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:45 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:46.161 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:45 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:01:46.161 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:45 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:01:46.161 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:45 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:46.161 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:45 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:46.161 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:45 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T14:01:46.161 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:45 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:01:46.161 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:45 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:46.161 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:45 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:01:46.161 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:45 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:01:46.161 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:45 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:46.161 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:45 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:01:46.161 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:45 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:46.161 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:45 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:01:46.162 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:45 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:01:46.162 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:45 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:46.249 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:45 smithi181 ceph-mon[25762]: pgmap v1692: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-03-30T14:01:46.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:45 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:01:46.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:45 smithi181 ceph-mon[25762]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-03-30T14:01:46.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:45 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:01:46.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:45 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:01:46.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:45 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:01:46.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:45 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:01:46.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:45 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:01:46.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:45 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:01:46.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:45 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:01:46.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:45 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:01:46.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:45 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:46.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:45 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:01:46.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:45 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:01:46.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:45 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:46.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:45 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:01:46.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:45 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:01:46.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:45 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:46.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:45 smithi181 ceph-mon[25762]: Health check cleared: CEPHADM_FAILED_DAEMON (was: 1 failed cephadm daemon(s)) 2024-03-30T14:01:46.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:45 smithi181 ceph-mon[25762]: Cluster is now healthy 2024-03-30T14:01:46.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:45 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:01:46.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:45 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:46.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:45 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:01:46.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:45 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:01:46.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:45 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:46.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:45 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:01:46.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:45 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:46.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:45 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:01:46.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:45 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:01:46.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:45 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:46.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:45 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:01:46.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:45 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:46.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:45 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:01:46.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:45 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:01:46.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:45 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:46.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:45 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:01:46.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:45 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:46.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:45 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:01:46.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:45 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:01:46.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:45 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:46.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:45 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:01:46.253 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:45 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:46.253 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:45 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:01:46.253 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:45 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:01:46.253 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:45 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:46.253 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:45 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:01:46.253 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:45 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:46.253 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:45 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:01:46.253 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:45 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:01:46.253 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:45 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:46.253 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:45 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:01:46.253 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:45 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:46.253 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:45 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:01:46.253 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:45 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:01:46.253 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:45 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:46.253 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:45 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:46.254 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:45 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T14:01:46.254 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:45 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:01:46.254 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:45 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:46.254 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:45 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:01:46.254 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:45 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:01:46.254 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:45 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:46.254 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:45 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:01:46.254 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:45 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:46.254 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:45 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:01:46.254 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:45 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:01:46.254 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:45 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:47.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:46 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:01:47.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:46 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:01:47.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:46 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:01:47.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:46 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:01:47.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:46 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:01:47.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:46 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:01:47.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:46 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:01:47.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:46 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:01:47.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:46 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:01:47.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:46 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:01:47.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:46 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:01:47.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:46 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:47.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:46 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:01:47.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:46 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:01:47.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:46 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:47.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:46 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:01:47.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:46 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:01:47.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:46 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:47.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:46 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:01:47.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:46 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:01:47.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:46 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:47.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:46 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:01:47.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:46 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:47.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:46 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:01:47.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:46 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:01:47.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:46 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:47.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:46 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:01:47.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:46 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:47.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:46 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:01:47.002 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:46 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:01:47.002 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:46 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:47.002 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:46 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:01:47.002 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:46 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:47.002 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:46 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:01:47.002 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:46 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:01:47.002 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:46 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:47.002 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:46 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:01:47.002 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:46 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:47.002 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:46 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:01:47.002 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:46 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:01:47.002 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:46 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:47.002 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:46 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:01:47.002 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:46 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:47.003 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:46 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:01:47.003 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:46 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:01:47.003 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:46 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:47.003 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:46 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:01:47.003 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:46 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:47.003 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:46 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:01:47.003 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:46 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:01:47.003 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:46 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:47.003 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:46 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:01:47.003 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:46 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:47.003 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:46 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:01:47.003 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:46 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:01:47.003 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:46 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:47.003 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:46 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:01:47.003 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:46 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:47.003 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:46 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:01:47.004 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:46 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:01:47.056 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:46 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:01:47.056 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:46 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:01:47.056 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:46 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:01:47.057 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:46 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:01:47.057 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:46 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:01:47.057 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:46 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:01:47.057 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:46 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:01:47.057 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:46 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:01:47.057 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:46 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:01:47.057 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:46 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:01:47.057 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:46 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:01:47.057 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:46 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:47.057 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:46 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:01:47.057 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:46 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:01:47.057 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:46 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:47.057 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:46 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:01:47.057 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:46 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:01:47.058 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:46 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:47.058 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:46 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:01:47.058 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:46 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:01:47.058 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:46 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:47.058 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:46 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:01:47.058 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:46 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:47.058 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:46 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:01:47.058 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:46 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:01:47.058 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:46 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:47.058 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:46 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:01:47.058 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:46 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:47.058 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:46 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:01:47.058 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:46 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:01:47.059 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:46 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:47.059 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:46 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:01:47.059 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:46 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:01:47.059 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:46 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:01:47.059 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:46 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:01:47.059 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:46 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:01:47.059 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:46 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:01:47.059 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:46 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:01:47.059 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:46 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:01:47.059 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:46 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:01:47.060 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:46 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:01:47.060 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:46 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:01:47.060 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:46 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:47.060 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:46 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:01:47.060 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:46 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:01:47.060 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:46 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:47.060 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:46 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:01:47.060 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:46 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:01:47.060 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:46 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:47.060 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:46 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:01:47.060 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:46 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:01:47.060 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:46 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:47.060 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:46 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:01:47.060 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:46 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:47.060 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:46 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:01:47.061 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:46 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:01:47.061 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:46 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:47.061 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:46 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:01:47.061 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:46 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:47.061 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:46 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:01:47.061 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:46 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:01:47.061 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:46 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:47.061 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:46 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:01:47.061 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:46 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:47.061 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:46 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:01:47.062 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:46 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:01:47.062 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:46 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:47.062 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:46 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:01:47.062 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:46 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:47.062 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:46 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:01:47.062 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:46 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:01:47.062 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:46 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:47.062 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:46 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:01:47.062 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:46 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:47.062 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:46 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:01:47.062 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:46 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:01:47.062 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:46 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:47.062 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:46 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:01:47.062 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:46 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:47.062 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:46 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:01:47.063 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:46 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:01:47.063 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:46 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:47.063 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:46 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:01:47.063 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:46 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:47.063 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:46 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:01:47.063 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:46 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:01:47.063 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:46 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:47.063 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:46 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:01:47.063 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:46 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:47.063 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:46 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:01:47.063 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:46 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:01:47.063 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:46 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:01:47.064 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:46 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:47.064 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:46 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:01:47.064 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:46 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:01:47.064 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:46 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:47.064 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:46 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:01:47.064 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:46 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:47.064 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:46 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:01:47.064 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:46 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:01:47.064 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:46 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:47.064 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:46 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:01:47.064 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:46 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:47.064 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:46 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:01:47.064 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:46 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:01:47.064 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:46 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:47.064 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:46 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:01:47.065 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:46 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:47.065 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:46 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:01:47.065 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:46 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:01:47.065 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:46 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:47.065 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:46 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:01:47.065 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:46 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:47.065 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:46 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:01:47.065 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:46 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:01:47.065 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:46 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:47.065 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:46 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:01:47.065 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:46 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:47.065 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:46 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:01:47.065 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:46 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:01:48.170 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:47 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:01:48.170 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:47 smithi181 ceph-mon[25762]: pgmap v1693: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 901 B/s rd, 0 op/s 2024-03-30T14:01:48.170 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:47 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:01:48.170 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:47 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:01:48.170 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:47 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:01:48.170 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:47 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:01:48.170 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:47 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:01:48.170 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:47 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:01:48.170 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:47 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:01:48.170 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:47 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:48.171 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:47 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:01:48.171 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:47 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:01:48.171 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:47 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:48.171 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:47 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:01:48.171 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:47 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:01:48.171 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:47 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:48.171 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:47 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:01:48.171 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:47 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:48.171 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:47 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:01:48.171 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:47 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:01:48.171 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:47 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:48.171 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:47 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:01:48.171 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:47 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:48.171 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:47 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:01:48.171 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:47 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:01:48.171 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:47 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:48.172 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:47 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:01:48.172 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:47 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:48.172 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:47 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:01:48.172 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:47 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:01:48.172 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:47 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:48.173 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:47 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:01:48.173 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:47 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:48.173 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:47 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:01:48.173 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:47 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:01:48.173 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:47 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:48.173 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:47 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:01:48.173 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:47 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:48.173 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:47 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:01:48.173 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:47 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:01:48.173 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:47 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:48.173 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:47 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:48.173 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:47 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:48.173 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:47 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:48.173 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:47 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:01:48.173 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:47 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:48.174 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:47 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:48.174 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:47 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:48.174 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:47 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:48.174 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:47 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:48.174 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:47 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:48.174 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:47 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:48.174 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:47 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:48.174 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:47 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:48.174 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:47 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:48.174 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:47 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:48.174 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:47 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:48.174 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:47 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:48.174 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:47 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:48.174 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:47 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:48.175 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:47 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]: dispatch 2024-03-30T14:01:48.175 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:47 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]: dispatch 2024-03-30T14:01:48.175 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:47 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]': finished 2024-03-30T14:01:48.175 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:47 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-03-30T14:01:48.175 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:47 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-03-30T14:01:48.175 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:47 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon"}]': finished 2024-03-30T14:01:48.175 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:47 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]: dispatch 2024-03-30T14:01:48.175 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:47 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]: dispatch 2024-03-30T14:01:48.175 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:47 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]': finished 2024-03-30T14:01:48.175 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:47 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd"}]: dispatch 2024-03-30T14:01:48.175 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:47 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd"}]: dispatch 2024-03-30T14:01:48.175 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:47 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds"}]: dispatch 2024-03-30T14:01:48.175 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:47 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds"}]: dispatch 2024-03-30T14:01:48.175 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:47 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds"}]': finished 2024-03-30T14:01:48.175 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:47 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]: dispatch 2024-03-30T14:01:48.175 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:47 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]: dispatch 2024-03-30T14:01:48.176 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:47 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]: dispatch 2024-03-30T14:01:48.176 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:47 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]: dispatch 2024-03-30T14:01:48.176 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:47 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]': finished 2024-03-30T14:01:48.176 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:47 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-03-30T14:01:48.176 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:47 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-03-30T14:01:48.176 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:47 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"}]: dispatch 2024-03-30T14:01:48.176 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:47 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"}]: dispatch 2024-03-30T14:01:48.176 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:47 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"}]': finished 2024-03-30T14:01:48.176 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:47 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]: dispatch 2024-03-30T14:01:48.176 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:47 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]: dispatch 2024-03-30T14:01:48.176 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:47 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]: dispatch 2024-03-30T14:01:48.176 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:47 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]: dispatch 2024-03-30T14:01:48.176 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:47 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]': finished 2024-03-30T14:01:48.176 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:47 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]: dispatch 2024-03-30T14:01:48.176 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:47 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]: dispatch 2024-03-30T14:01:48.177 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:47 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]': finished 2024-03-30T14:01:48.177 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:47 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-03-30T14:01:48.177 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:47 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-03-30T14:01:48.177 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:47 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-03-30T14:01:48.177 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:47 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-03-30T14:01:48.177 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:47 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-03-30T14:01:48.177 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:47 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-03-30T14:01:48.177 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:47 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-03-30T14:01:48.177 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:47 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-03-30T14:01:48.177 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:47 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-03-30T14:01:48.177 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:47 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-03-30T14:01:48.177 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:47 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-03-30T14:01:48.177 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:47 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-03-30T14:01:48.177 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:47 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]: dispatch 2024-03-30T14:01:48.177 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:47 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' cmd=[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]: dispatch 2024-03-30T14:01:48.178 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:47 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' cmd='[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]': finished 2024-03-30T14:01:48.178 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:47 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:01:48.178 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:47 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:01:48.178 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:47 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:48.178 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:47 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:01:48.178 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:47 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:01:48.178 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:47 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:48.330 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:47 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:01:48.330 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:47 smithi099 ceph-mon[24912]: pgmap v1693: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 901 B/s rd, 0 op/s 2024-03-30T14:01:48.331 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:47 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:01:48.331 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:47 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:01:48.331 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:47 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:01:48.331 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:47 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:01:48.331 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:47 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:01:48.331 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:47 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:01:48.331 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:47 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:01:48.331 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:47 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:48.331 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:47 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:01:48.331 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:47 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:01:48.331 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:47 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:48.331 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:47 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:01:48.331 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:47 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:01:48.331 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:47 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:48.332 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:47 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:01:48.332 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:47 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:48.332 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:47 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:01:48.332 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:47 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:01:48.332 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:47 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:48.332 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:47 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:01:48.332 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:47 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:48.332 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:47 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:01:48.332 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:47 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:01:48.332 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:47 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:48.332 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:47 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:01:48.332 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:47 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:48.332 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:47 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:01:48.333 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:47 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:01:48.333 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:47 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:48.333 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:47 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:01:48.333 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:47 smithi099 ceph-mon[29691]: pgmap v1693: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 901 B/s rd, 0 op/s 2024-03-30T14:01:48.333 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:47 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:01:48.333 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:47 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:01:48.333 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:47 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:01:48.333 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:47 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:01:48.333 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:47 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:01:48.333 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:47 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:01:48.333 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:47 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:01:48.334 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:47 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:48.334 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:47 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:01:48.334 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:47 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:01:48.334 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:47 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:48.334 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:47 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:01:48.334 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:47 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:01:48.334 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:47 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:48.334 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:47 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:01:48.334 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:47 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:48.334 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:47 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:01:48.334 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:47 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:01:48.334 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:47 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:48.334 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:47 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:01:48.335 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:47 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:48.335 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:47 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:01:48.335 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:47 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:01:48.335 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:47 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:48.335 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:47 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:01:48.335 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:47 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:48.335 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:47 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:01:48.335 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:47 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:01:48.335 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:47 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:48.335 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:47 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:01:48.335 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:47 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:48.336 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:47 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:01:48.336 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:47 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:01:48.336 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:47 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:48.336 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:47 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:01:48.336 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:47 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:48.336 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:47 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:01:48.336 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:47 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:01:48.336 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:47 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:48.336 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:47 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:48.336 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:47 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:48.336 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:47 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:48.336 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:47 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:01:48.336 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:47 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:48.336 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:47 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:48.337 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:47 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:48.337 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:47 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:48.337 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:47 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:48.337 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:47 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:48.337 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:47 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:48.337 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:47 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:48.337 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:47 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:48.337 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:47 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:48.337 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:47 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:48.337 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:47 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:48.337 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:47 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:48.337 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:47 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:48.337 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:47 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:48.337 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:47 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]: dispatch 2024-03-30T14:01:48.337 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:47 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]: dispatch 2024-03-30T14:01:48.338 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:47 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:01:48.338 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:47 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:48.338 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:47 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:01:48.338 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:47 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:01:48.338 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:47 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:48.338 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:47 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:01:48.338 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:47 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:48.338 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:47 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:01:48.338 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:47 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:01:48.338 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:47 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:48.338 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:47 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:48.339 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:47 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:48.339 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:47 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:48.339 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:47 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:01:48.339 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:47 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:48.339 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:47 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:48.339 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:47 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:48.339 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:47 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:48.339 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:47 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:48.339 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:47 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:48.339 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:47 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:48.339 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:47 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:48.339 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:47 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:48.339 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:47 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:48.339 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:47 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:48.339 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:47 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:48.340 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:47 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:48.340 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:47 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:01:48.340 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:47 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:48.340 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:47 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]: dispatch 2024-03-30T14:01:48.340 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:47 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]: dispatch 2024-03-30T14:01:48.340 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:47 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]': finished 2024-03-30T14:01:48.340 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:47 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-03-30T14:01:48.340 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:47 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-03-30T14:01:48.340 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:47 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon"}]': finished 2024-03-30T14:01:48.340 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:47 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]: dispatch 2024-03-30T14:01:48.340 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:47 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]: dispatch 2024-03-30T14:01:48.341 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:47 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]': finished 2024-03-30T14:01:48.341 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:47 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd"}]: dispatch 2024-03-30T14:01:48.341 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:47 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd"}]: dispatch 2024-03-30T14:01:48.341 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:47 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds"}]: dispatch 2024-03-30T14:01:48.341 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:47 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds"}]: dispatch 2024-03-30T14:01:48.341 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:47 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds"}]': finished 2024-03-30T14:01:48.341 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:47 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]: dispatch 2024-03-30T14:01:48.341 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:47 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]: dispatch 2024-03-30T14:01:48.341 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:47 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]: dispatch 2024-03-30T14:01:48.341 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:47 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]: dispatch 2024-03-30T14:01:48.341 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:47 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]': finished 2024-03-30T14:01:48.341 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:47 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-03-30T14:01:48.341 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:47 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-03-30T14:01:48.341 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:47 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"}]: dispatch 2024-03-30T14:01:48.341 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:47 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"}]: dispatch 2024-03-30T14:01:48.342 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:47 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"}]': finished 2024-03-30T14:01:48.342 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:47 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]: dispatch 2024-03-30T14:01:48.342 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:47 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]': finished 2024-03-30T14:01:48.342 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:47 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-03-30T14:01:48.342 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:47 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-03-30T14:01:48.342 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:47 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon"}]': finished 2024-03-30T14:01:48.342 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:47 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]: dispatch 2024-03-30T14:01:48.342 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:47 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]: dispatch 2024-03-30T14:01:48.342 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:47 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]': finished 2024-03-30T14:01:48.342 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:47 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd"}]: dispatch 2024-03-30T14:01:48.342 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:47 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd"}]: dispatch 2024-03-30T14:01:48.343 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:47 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds"}]: dispatch 2024-03-30T14:01:48.343 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:47 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds"}]: dispatch 2024-03-30T14:01:48.343 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:47 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds"}]': finished 2024-03-30T14:01:48.343 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:47 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]: dispatch 2024-03-30T14:01:48.343 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:47 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]: dispatch 2024-03-30T14:01:48.343 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:47 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]: dispatch 2024-03-30T14:01:48.343 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:47 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]: dispatch 2024-03-30T14:01:48.343 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:47 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]': finished 2024-03-30T14:01:48.343 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:47 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-03-30T14:01:48.343 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:47 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-03-30T14:01:48.343 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:47 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"}]: dispatch 2024-03-30T14:01:48.343 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:47 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"}]: dispatch 2024-03-30T14:01:48.343 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:47 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"}]': finished 2024-03-30T14:01:48.343 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:47 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]: dispatch 2024-03-30T14:01:48.344 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:47 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]: dispatch 2024-03-30T14:01:48.344 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:47 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]: dispatch 2024-03-30T14:01:48.344 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:47 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]: dispatch 2024-03-30T14:01:48.344 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:47 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]': finished 2024-03-30T14:01:48.344 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:47 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]: dispatch 2024-03-30T14:01:48.344 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:47 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]: dispatch 2024-03-30T14:01:48.344 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:47 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]': finished 2024-03-30T14:01:48.344 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:47 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-03-30T14:01:48.344 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:47 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-03-30T14:01:48.345 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:47 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-03-30T14:01:48.345 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:47 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-03-30T14:01:48.345 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:47 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-03-30T14:01:48.345 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:47 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-03-30T14:01:48.345 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:47 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-03-30T14:01:48.345 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:47 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-03-30T14:01:48.345 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:47 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-03-30T14:01:48.345 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:47 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-03-30T14:01:48.345 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:47 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-03-30T14:01:48.345 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:47 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-03-30T14:01:48.345 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:47 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]: dispatch 2024-03-30T14:01:48.345 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:47 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' cmd=[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]: dispatch 2024-03-30T14:01:48.345 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:47 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' cmd='[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]': finished 2024-03-30T14:01:48.345 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:47 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:01:48.346 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:47 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:01:48.346 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:47 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:48.346 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:47 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:01:48.346 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:47 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:01:48.346 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:47 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:48.346 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:47 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]: dispatch 2024-03-30T14:01:48.346 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:47 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]: dispatch 2024-03-30T14:01:48.346 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:47 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]: dispatch 2024-03-30T14:01:48.346 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:47 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]': finished 2024-03-30T14:01:48.347 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:47 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]: dispatch 2024-03-30T14:01:48.347 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:47 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]: dispatch 2024-03-30T14:01:48.347 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:47 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]': finished 2024-03-30T14:01:48.347 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:47 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-03-30T14:01:48.347 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:47 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-03-30T14:01:48.347 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:47 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-03-30T14:01:48.347 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:47 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-03-30T14:01:48.347 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:47 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-03-30T14:01:48.347 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:47 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-03-30T14:01:48.347 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:47 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-03-30T14:01:48.347 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:47 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-03-30T14:01:48.347 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:47 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-03-30T14:01:48.347 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:47 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-03-30T14:01:48.347 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:47 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-03-30T14:01:48.348 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:47 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-03-30T14:01:48.348 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:47 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]: dispatch 2024-03-30T14:01:48.348 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:47 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' cmd=[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]: dispatch 2024-03-30T14:01:48.348 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:47 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' cmd='[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]': finished 2024-03-30T14:01:48.348 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:47 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:01:48.348 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:47 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:01:48.348 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:47 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:48.348 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:47 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:01:48.348 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:47 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:01:48.348 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:47 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:49.206 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:48 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:01:49.206 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:48 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:01:49.206 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:48 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:01:49.206 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:48 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:01:49.206 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:48 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:01:49.206 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:48 smithi181 ceph-mon[25762]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:01:49.206 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:48 smithi181 ceph-mon[25762]: Upgrade: Finalizing container_image settings 2024-03-30T14:01:49.207 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:48 smithi181 ceph-mon[25762]: Upgrade: Complete! 2024-03-30T14:01:49.207 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:48 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:49.207 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:48 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:49.207 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:48 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:49.330 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:48 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:01:49.330 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:48 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:01:49.330 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:48 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:01:49.330 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:48 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:01:49.330 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:48 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:01:49.331 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:48 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:01:49.331 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:48 smithi099 ceph-mon[24912]: Upgrade: Finalizing container_image settings 2024-03-30T14:01:49.331 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:48 smithi099 ceph-mon[24912]: Upgrade: Complete! 2024-03-30T14:01:49.331 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:48 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:49.331 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:48 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:49.331 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:48 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:49.331 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:48 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:01:49.331 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:48 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:01:49.331 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:48 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:01:49.331 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:48 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:01:49.331 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:48 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:01:49.331 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:48 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:01:49.332 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:48 smithi099 ceph-mon[29691]: Upgrade: Finalizing container_image settings 2024-03-30T14:01:49.332 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:48 smithi099 ceph-mon[29691]: Upgrade: Complete! 2024-03-30T14:01:49.332 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:48 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:49.332 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:48 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:49.332 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:48 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:50.092 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:49 smithi181 ceph-mon[25762]: pgmap v1694: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-03-30T14:01:50.330 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:49 smithi099 ceph-mon[24912]: pgmap v1694: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-03-30T14:01:50.331 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:49 smithi099 ceph-mon[29691]: pgmap v1694: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-03-30T14:01:51.749 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:51 smithi181 ceph-mon[25762]: pgmap v1695: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 666 B/s rd, 0 op/s 2024-03-30T14:01:51.749 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:51 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:52.080 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:51 smithi099 ceph-mon[24912]: pgmap v1695: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 666 B/s rd, 0 op/s 2024-03-30T14:01:52.080 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:51 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:52.080 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:51 smithi099 ceph-mon[29691]: pgmap v1695: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 666 B/s rd, 0 op/s 2024-03-30T14:01:52.081 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:51 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:01:53.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:53 smithi181 ceph-mon[25762]: pgmap v1696: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-03-30T14:01:54.080 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:53 smithi099 ceph-mon[29691]: pgmap v1696: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-03-30T14:01:54.080 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:53 smithi099 ceph-mon[24912]: pgmap v1696: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-03-30T14:01:55.080 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:54 smithi099 ceph-mon[24912]: from='client.25136 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T14:01:55.080 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:54 smithi099 ceph-mon[29691]: from='client.25136 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T14:01:55.080 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 14:01:54 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[71049]: ::ffff:172.21.15.181 - - [30/Mar/2024:14:01:54] "GET /metrics HTTP/1.1" 200 37995 "" "Prometheus/2.43.0" 2024-03-30T14:01:55.249 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:54 smithi181 ceph-mon[25762]: from='client.25136 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T14:01:56.249 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:55 smithi181 ceph-mon[25762]: pgmap v1697: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 904 B/s rd, 0 op/s 2024-03-30T14:01:56.310 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:55 smithi099 ceph-mon[24912]: pgmap v1697: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 904 B/s rd, 0 op/s 2024-03-30T14:01:56.311 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:55 smithi099 ceph-mon[29691]: pgmap v1697: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 904 B/s rd, 0 op/s 2024-03-30T14:01:58.249 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:57 smithi181 ceph-mon[25762]: pgmap v1698: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T14:01:58.330 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:57 smithi099 ceph-mon[24912]: pgmap v1698: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T14:01:58.330 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:57 smithi099 ceph-mon[29691]: pgmap v1698: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T14:02:00.152 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:01:59 smithi099 ceph-mon[24912]: pgmap v1699: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T14:02:00.153 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:01:59 smithi099 ceph-mon[29691]: pgmap v1699: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T14:02:00.179 DEBUG:teuthology.orchestra.run.smithi099:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 98ebaeb8-ee99-11ee-b647-cb9ed24678a4 -e sha1=4e50bbcdd1630c7760b708f3a5b4d38a121e66cb -- bash -c 'ceph versions | jq -e '"'"'.mgr | length == 1'"'"'' 2024-03-30T14:02:00.249 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:01:59 smithi181 ceph-mon[25762]: pgmap v1699: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T14:02:01.080 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:00 smithi099 ceph-mon[29691]: from='client.25594 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T14:02:01.080 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:00 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T14:02:01.080 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:00 smithi099 ceph-mon[24912]: from='client.25594 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T14:02:01.080 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:00 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T14:02:01.249 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:00 smithi181 ceph-mon[25762]: from='client.25594 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T14:02:01.249 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:00 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T14:02:01.915 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:01 smithi099 ceph-mon[24912]: pgmap v1700: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T14:02:02.198 INFO:teuthology.orchestra.run.smithi099.stdout:true 2024-03-30T14:02:02.198 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:01 smithi099 ceph-mon[29691]: pgmap v1700: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T14:02:02.249 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:01 smithi181 ceph-mon[25762]: pgmap v1700: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T14:02:02.803 DEBUG:teuthology.orchestra.run.smithi099:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 98ebaeb8-ee99-11ee-b647-cb9ed24678a4 -e sha1=4e50bbcdd1630c7760b708f3a5b4d38a121e66cb -- bash -c 'ceph versions | jq -e '"'"'.mgr | keys'"'"' | grep $sha1' 2024-03-30T14:02:03.082 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:02 smithi099 ceph-mon[29691]: from='client.? 172.21.15.99:0/3900744864' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:02:03.082 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:02 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:02:03.082 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:02 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:02:03.082 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:02 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:02:03.082 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:02 smithi099 ceph-mon[24912]: from='client.? 172.21.15.99:0/3900744864' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:02:03.082 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:02 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:02:03.083 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:02 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:02:03.083 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:02 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:02:03.249 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:02 smithi181 ceph-mon[25762]: from='client.? 172.21.15.99:0/3900744864' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:02:03.249 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:02 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:02:03.249 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:02 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:02:03.249 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:02 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:02:04.249 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:03 smithi181 ceph-mon[25762]: pgmap v1701: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T14:02:04.282 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:03 smithi099 ceph-mon[24912]: pgmap v1701: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T14:02:04.282 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:03 smithi099 ceph-mon[29691]: pgmap v1701: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T14:02:04.830 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 14:02:04 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[71049]: ::ffff:172.21.15.181 - - [30/Mar/2024:14:02:04] "GET /metrics HTTP/1.1" 200 37992 "" "Prometheus/2.43.0" 2024-03-30T14:02:05.249 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:04 smithi181 ceph-mon[25762]: from='client.25136 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T14:02:05.277 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:04 smithi099 ceph-mon[24912]: from='client.25136 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T14:02:05.277 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:04 smithi099 ceph-mon[29691]: from='client.25136 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T14:02:05.681 INFO:teuthology.orchestra.run.smithi099.stdout: "ceph version 19.0.0-1967-g4e50bbcd (4e50bbcdd1630c7760b708f3a5b4d38a121e66cb) squid (dev)" 2024-03-30T14:02:06.249 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:05 smithi181 ceph-mon[25762]: pgmap v1702: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T14:02:06.249 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:05 smithi181 ceph-mon[25762]: from='client.? 172.21.15.99:0/1640115448' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:02:06.305 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:05 smithi099 ceph-mon[24912]: pgmap v1702: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T14:02:06.306 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:05 smithi099 ceph-mon[24912]: from='client.? 172.21.15.99:0/1640115448' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:02:06.306 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:05 smithi099 ceph-mon[29691]: pgmap v1702: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T14:02:06.306 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:05 smithi099 ceph-mon[29691]: from='client.? 172.21.15.99:0/1640115448' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:02:07.022 DEBUG:teuthology.orchestra.run.smithi099:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 98ebaeb8-ee99-11ee-b647-cb9ed24678a4 -e sha1=4e50bbcdd1630c7760b708f3a5b4d38a121e66cb -- bash -c 'ceph versions | jq -e '"'"'.overall | length == 2'"'"'' 2024-03-30T14:02:08.249 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:07 smithi181 ceph-mon[25762]: pgmap v1703: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T14:02:08.328 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:07 smithi099 ceph-mon[24912]: pgmap v1703: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T14:02:08.328 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:07 smithi099 ceph-mon[29691]: pgmap v1703: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T14:02:09.168 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:09 smithi181 ceph-mon[25762]: pgmap v1704: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T14:02:09.168 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:09 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:02:09.168 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:09 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:02:09.168 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:09 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:02:09.330 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:09 smithi099 ceph-mon[29691]: pgmap v1704: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T14:02:09.330 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:09 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:02:09.330 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:09 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:02:09.330 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:09 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:02:09.330 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:09 smithi099 ceph-mon[24912]: pgmap v1704: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T14:02:09.330 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:09 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:02:09.331 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:09 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:02:09.331 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:09 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:02:09.544 INFO:teuthology.orchestra.run.smithi099.stdout:true 2024-03-30T14:02:10.109 DEBUG:teuthology.orchestra.run.smithi099:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 98ebaeb8-ee99-11ee-b647-cb9ed24678a4 -e sha1=4e50bbcdd1630c7760b708f3a5b4d38a121e66cb -- bash -c 'ceph orch upgrade check quay.ceph.io/ceph-ci/ceph:$sha1 | jq -e '"'"'.up_to_date | length == 2'"'"'' 2024-03-30T14:02:10.319 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:10 smithi181 ceph-mon[25762]: from='client.? 172.21.15.99:0/4007137928' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:02:10.414 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:10 smithi099 ceph-mon[24912]: from='client.? 172.21.15.99:0/4007137928' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:02:10.415 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:10 smithi099 ceph-mon[29691]: from='client.? 172.21.15.99:0/4007137928' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:02:11.359 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:11 smithi181 ceph-mon[25762]: pgmap v1705: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T14:02:11.383 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:11 smithi099 ceph-mon[24912]: pgmap v1705: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T14:02:11.384 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:11 smithi099 ceph-mon[29691]: pgmap v1705: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T14:02:13.387 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:13 smithi099 ceph-mon[24912]: pgmap v1706: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T14:02:13.387 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:13 smithi099 ceph-mon[24912]: from='client.15726 -' entity='client.admin' cmd=[{"prefix": "orch upgrade check", "image": "quay.ceph.io/ceph-ci/ceph:4e50bbcdd1630c7760b708f3a5b4d38a121e66cb", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T14:02:13.388 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:13 smithi099 ceph-mon[29691]: pgmap v1706: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T14:02:13.388 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:13 smithi099 ceph-mon[29691]: from='client.15726 -' entity='client.admin' cmd=[{"prefix": "orch upgrade check", "image": "quay.ceph.io/ceph-ci/ceph:4e50bbcdd1630c7760b708f3a5b4d38a121e66cb", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T14:02:13.499 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:13 smithi181 ceph-mon[25762]: pgmap v1706: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T14:02:13.499 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:13 smithi181 ceph-mon[25762]: from='client.15726 -' entity='client.admin' cmd=[{"prefix": "orch upgrade check", "image": "quay.ceph.io/ceph-ci/ceph:4e50bbcdd1630c7760b708f3a5b4d38a121e66cb", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T14:02:13.600 INFO:teuthology.orchestra.run.smithi099.stdout:true 2024-03-30T14:02:14.233 DEBUG:teuthology.orchestra.run.smithi099:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 98ebaeb8-ee99-11ee-b647-cb9ed24678a4 -e sha1=4e50bbcdd1630c7760b708f3a5b4d38a121e66cb -- bash -c 'ceph orch upgrade status' 2024-03-30T14:02:14.830 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 14:02:14 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[71049]: ::ffff:172.21.15.181 - - [30/Mar/2024:14:02:14] "GET /metrics HTTP/1.1" 200 37992 "" "Prometheus/2.43.0" 2024-03-30T14:02:15.222 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:14 smithi099 ceph-mon[24912]: from='client.25136 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T14:02:15.223 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:14 smithi099 ceph-mon[29691]: from='client.25136 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T14:02:15.249 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:14 smithi181 ceph-mon[25762]: from='client.25136 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T14:02:16.080 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:15 smithi099 ceph-mon[29691]: pgmap v1707: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T14:02:16.080 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:15 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T14:02:16.080 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:15 smithi099 ceph-mon[24912]: pgmap v1707: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T14:02:16.080 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:15 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T14:02:16.185 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-03-30T14:02:16.185 INFO:teuthology.orchestra.run.smithi099.stdout: "target_image": null, 2024-03-30T14:02:16.185 INFO:teuthology.orchestra.run.smithi099.stdout: "in_progress": false, 2024-03-30T14:02:16.185 INFO:teuthology.orchestra.run.smithi099.stdout: "which": "", 2024-03-30T14:02:16.185 INFO:teuthology.orchestra.run.smithi099.stdout: "services_complete": [], 2024-03-30T14:02:16.185 INFO:teuthology.orchestra.run.smithi099.stdout: "progress": null, 2024-03-30T14:02:16.185 INFO:teuthology.orchestra.run.smithi099.stdout: "message": "", 2024-03-30T14:02:16.185 INFO:teuthology.orchestra.run.smithi099.stdout: "is_paused": false 2024-03-30T14:02:16.185 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-03-30T14:02:16.249 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:15 smithi181 ceph-mon[25762]: pgmap v1707: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T14:02:16.249 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:15 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T14:02:16.831 DEBUG:teuthology.orchestra.run.smithi099:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 98ebaeb8-ee99-11ee-b647-cb9ed24678a4 -e sha1=4e50bbcdd1630c7760b708f3a5b4d38a121e66cb -- bash -c 'ceph health detail' 2024-03-30T14:02:18.177 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:17 smithi099 ceph-mon[24912]: pgmap v1708: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T14:02:18.177 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:17 smithi099 ceph-mon[24912]: from='client.25624 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T14:02:18.178 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:17 smithi099 ceph-mon[29691]: pgmap v1708: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T14:02:18.178 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:17 smithi099 ceph-mon[29691]: from='client.25624 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T14:02:18.249 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:17 smithi181 ceph-mon[25762]: pgmap v1708: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T14:02:18.249 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:17 smithi181 ceph-mon[25762]: from='client.25624 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T14:02:18.895 INFO:teuthology.orchestra.run.smithi099.stdout:HEALTH_OK 2024-03-30T14:02:19.521 DEBUG:teuthology.orchestra.run.smithi099:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 98ebaeb8-ee99-11ee-b647-cb9ed24678a4 -e sha1=4e50bbcdd1630c7760b708f3a5b4d38a121e66cb -- bash -c 'ceph orch upgrade start --image quay.ceph.io/ceph-ci/ceph:$sha1 --daemon-types mon --hosts $(ceph orch ps | grep mgr.x | awk '"'"'{print $2}'"'"')' 2024-03-30T14:02:20.093 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:19 smithi099 ceph-mon[24912]: pgmap v1709: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T14:02:20.093 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:19 smithi099 ceph-mon[24912]: from='client.? 172.21.15.99:0/1636962975' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-03-30T14:02:20.093 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:19 smithi099 ceph-mon[29691]: pgmap v1709: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T14:02:20.093 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:19 smithi099 ceph-mon[29691]: from='client.? 172.21.15.99:0/1636962975' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-03-30T14:02:20.249 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:19 smithi181 ceph-mon[25762]: pgmap v1709: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T14:02:20.249 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:19 smithi181 ceph-mon[25762]: from='client.? 172.21.15.99:0/1636962975' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-03-30T14:02:22.249 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:21 smithi181 ceph-mon[25762]: pgmap v1710: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T14:02:22.329 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:21 smithi099 ceph-mon[24912]: pgmap v1710: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T14:02:22.330 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:21 smithi099 ceph-mon[29691]: pgmap v1710: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T14:02:23.249 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:22 smithi181 ceph-mon[25762]: from='client.15744 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T14:02:23.249 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:22 smithi181 ceph-mon[25762]: from='client.25642 -' entity='client.admin' cmd=[{"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:4e50bbcdd1630c7760b708f3a5b4d38a121e66cb", "daemon_types": "mon", "hosts": "smithi181", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T14:02:23.330 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:22 smithi099 ceph-mon[24912]: from='client.15744 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T14:02:23.330 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:22 smithi099 ceph-mon[24912]: from='client.25642 -' entity='client.admin' cmd=[{"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:4e50bbcdd1630c7760b708f3a5b4d38a121e66cb", "daemon_types": "mon", "hosts": "smithi181", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T14:02:23.330 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:22 smithi099 ceph-mon[29691]: from='client.15744 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T14:02:23.330 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:22 smithi099 ceph-mon[29691]: from='client.25642 -' entity='client.admin' cmd=[{"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:4e50bbcdd1630c7760b708f3a5b4d38a121e66cb", "daemon_types": "mon", "hosts": "smithi181", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T14:02:23.533 INFO:teuthology.orchestra.run.smithi099.stdout:Initiating upgrade to quay.ceph.io/ceph-ci/ceph:4e50bbcdd1630c7760b708f3a5b4d38a121e66cb 2024-03-30T14:02:24.171 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:23 smithi099 ceph-mon[24912]: pgmap v1711: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T14:02:24.171 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:23 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:02:24.171 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:23 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:02:24.171 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:23 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:02:24.171 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:23 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:02:24.171 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:23 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:02:24.171 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:23 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:02:24.171 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:23 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:02:24.172 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:23 smithi099 ceph-mon[29691]: pgmap v1711: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T14:02:24.172 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:23 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:02:24.172 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:23 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:02:24.172 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:23 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:02:24.172 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:23 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:02:24.172 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:23 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:02:24.172 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:23 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:02:24.172 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:23 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:02:24.195 DEBUG:teuthology.orchestra.run.smithi099:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 98ebaeb8-ee99-11ee-b647-cb9ed24678a4 -e sha1=4e50bbcdd1630c7760b708f3a5b4d38a121e66cb -- bash -c 'while ceph orch upgrade status | jq '"'"'.in_progress'"'"' | grep true && ! ceph orch upgrade status | jq '"'"'.message'"'"' | grep Error ; do ceph orch ps ; ceph versions ; ceph orch upgrade status ; sleep 30 ; done' 2024-03-30T14:02:24.249 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:23 smithi181 ceph-mon[25762]: pgmap v1711: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T14:02:24.249 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:23 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:02:24.249 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:23 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:02:24.249 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:23 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:02:24.249 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:23 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:02:24.249 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:23 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:02:24.249 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:23 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:02:24.249 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:23 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:02:25.080 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 14:02:24 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[71049]: ::ffff:172.21.15.181 - - [30/Mar/2024:14:02:24] "GET /metrics HTTP/1.1" 200 37995 "" "Prometheus/2.43.0" 2024-03-30T14:02:25.080 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:24 smithi099 ceph-mon[24912]: from='client.25136 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T14:02:25.080 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:24 smithi099 ceph-mon[24912]: Upgrade: Started with target quay.ceph.io/ceph-ci/ceph:4e50bbcdd1630c7760b708f3a5b4d38a121e66cb 2024-03-30T14:02:25.080 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:24 smithi099 ceph-mon[24912]: Upgrade: First pull of quay.ceph.io/ceph-ci/ceph:4e50bbcdd1630c7760b708f3a5b4d38a121e66cb 2024-03-30T14:02:25.080 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:24 smithi099 ceph-mon[29691]: from='client.25136 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T14:02:25.080 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:24 smithi099 ceph-mon[29691]: Upgrade: Started with target quay.ceph.io/ceph-ci/ceph:4e50bbcdd1630c7760b708f3a5b4d38a121e66cb 2024-03-30T14:02:25.081 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:24 smithi099 ceph-mon[29691]: Upgrade: First pull of quay.ceph.io/ceph-ci/ceph:4e50bbcdd1630c7760b708f3a5b4d38a121e66cb 2024-03-30T14:02:25.249 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:24 smithi181 ceph-mon[25762]: from='client.25136 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T14:02:25.249 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:24 smithi181 ceph-mon[25762]: Upgrade: Started with target quay.ceph.io/ceph-ci/ceph:4e50bbcdd1630c7760b708f3a5b4d38a121e66cb 2024-03-30T14:02:25.249 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:24 smithi181 ceph-mon[25762]: Upgrade: First pull of quay.ceph.io/ceph-ci/ceph:4e50bbcdd1630c7760b708f3a5b4d38a121e66cb 2024-03-30T14:02:26.080 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:25 smithi099 ceph-mon[24912]: pgmap v1712: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T14:02:26.080 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:25 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:02:26.080 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:25 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:02:26.080 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:25 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:02:26.080 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:25 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:02:26.080 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:25 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "quorum_status"}]: dispatch 2024-03-30T14:02:26.080 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:25 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "mon ok-to-stop", "ids": ["b"]}]: dispatch 2024-03-30T14:02:26.081 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:25 smithi099 ceph-mon[29691]: pgmap v1712: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T14:02:26.081 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:25 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:02:26.081 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:25 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:02:26.081 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:25 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:02:26.081 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:25 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:02:26.081 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:25 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "quorum_status"}]: dispatch 2024-03-30T14:02:26.081 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:25 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "mon ok-to-stop", "ids": ["b"]}]: dispatch 2024-03-30T14:02:26.170 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:25 smithi181 ceph-mon[25762]: pgmap v1712: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T14:02:26.171 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:25 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:02:26.171 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:25 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:02:26.171 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:25 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:02:26.171 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:25 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:02:26.171 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:25 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "quorum_status"}]: dispatch 2024-03-30T14:02:26.171 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:25 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "mon ok-to-stop", "ids": ["b"]}]: dispatch 2024-03-30T14:02:27.249 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:26 smithi181 ceph-mon[25762]: Upgrade: Target is version 19.0.0-1967-g4e50bbcd (squid) 2024-03-30T14:02:27.249 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:26 smithi181 ceph-mon[25762]: Upgrade: Target container is quay.ceph.io/ceph-ci/ceph:4e50bbcdd1630c7760b708f3a5b4d38a121e66cb, digests ['quay.ceph.io/ceph-ci/ceph@sha256:8f3809717761e681477c3ef1d8d2c03114aee2c597cd7380b93b8c10f47fcb5d'] 2024-03-30T14:02:27.249 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:26 smithi181 ceph-mon[25762]: Upgrade: Setting container_image for all mgr 2024-03-30T14:02:27.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:26 smithi181 ceph-mon[25762]: Upgrade: It appears safe to stop mon.b 2024-03-30T14:02:27.330 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:26 smithi099 ceph-mon[24912]: Upgrade: Target is version 19.0.0-1967-g4e50bbcd (squid) 2024-03-30T14:02:27.330 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:26 smithi099 ceph-mon[24912]: Upgrade: Target container is quay.ceph.io/ceph-ci/ceph:4e50bbcdd1630c7760b708f3a5b4d38a121e66cb, digests ['quay.ceph.io/ceph-ci/ceph@sha256:8f3809717761e681477c3ef1d8d2c03114aee2c597cd7380b93b8c10f47fcb5d'] 2024-03-30T14:02:27.330 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:26 smithi099 ceph-mon[24912]: Upgrade: Setting container_image for all mgr 2024-03-30T14:02:27.330 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:26 smithi099 ceph-mon[24912]: Upgrade: It appears safe to stop mon.b 2024-03-30T14:02:27.330 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:26 smithi099 ceph-mon[29691]: Upgrade: Target is version 19.0.0-1967-g4e50bbcd (squid) 2024-03-30T14:02:27.330 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:26 smithi099 ceph-mon[29691]: Upgrade: Target container is quay.ceph.io/ceph-ci/ceph:4e50bbcdd1630c7760b708f3a5b4d38a121e66cb, digests ['quay.ceph.io/ceph-ci/ceph@sha256:8f3809717761e681477c3ef1d8d2c03114aee2c597cd7380b93b8c10f47fcb5d'] 2024-03-30T14:02:27.331 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:26 smithi099 ceph-mon[29691]: Upgrade: Setting container_image for all mgr 2024-03-30T14:02:27.331 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:26 smithi099 ceph-mon[29691]: Upgrade: It appears safe to stop mon.b 2024-03-30T14:02:27.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:27 smithi181 ceph-mon[25762]: pgmap v1713: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T14:02:27.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:27 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:02:27.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:27 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-03-30T14:02:27.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:27 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-03-30T14:02:27.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:27 smithi181 ceph-mon[25762]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:02:28.191 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:27 smithi099 ceph-mon[29691]: pgmap v1713: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T14:02:28.191 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:27 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:02:28.191 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:27 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-03-30T14:02:28.191 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:27 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-03-30T14:02:28.192 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:27 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:02:28.192 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:27 smithi099 ceph-mon[24912]: pgmap v1713: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T14:02:28.192 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:27 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:02:28.192 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:27 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-03-30T14:02:28.192 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:27 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-03-30T14:02:28.192 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:27 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:02:28.761 INFO:teuthology.orchestra.run.smithi099.stdout:true 2024-03-30T14:02:29.080 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:28 smithi099 ceph-mon[24912]: Upgrade: Updating mon.b 2024-03-30T14:02:29.080 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:28 smithi099 ceph-mon[24912]: Deploying daemon mon.b on smithi181 2024-03-30T14:02:29.080 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:28 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:02:29.080 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:28 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:02:29.080 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:28 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:02:29.080 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:28 smithi099 ceph-mon[29691]: Upgrade: Updating mon.b 2024-03-30T14:02:29.080 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:28 smithi099 ceph-mon[29691]: Deploying daemon mon.b on smithi181 2024-03-30T14:02:29.080 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:28 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:02:29.080 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:28 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:02:29.081 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:28 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:02:29.189 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:28 smithi181 ceph-mon[25762]: Upgrade: Updating mon.b 2024-03-30T14:02:29.189 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:28 smithi181 ceph-mon[25762]: Deploying daemon mon.b on smithi181 2024-03-30T14:02:29.190 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:28 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:02:29.190 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:28 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:02:29.190 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:28 smithi181 ceph-mon[25762]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:02:29.432 INFO:teuthology.orchestra.run.smithi099.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-03-30T14:02:29.432 INFO:teuthology.orchestra.run.smithi099.stdout:agent.smithi099 smithi099 running 6s ago 30m - - 2024-03-30T14:02:29.432 INFO:teuthology.orchestra.run.smithi099.stdout:agent.smithi181 smithi181 running 1s ago 30m - - 2024-03-30T14:02:29.432 INFO:teuthology.orchestra.run.smithi099.stdout:alertmanager.a smithi099 *:9093,9094 running (78s) 6s ago 25m 18.7M - 0.25.0 c8568f914cd2 08735152b67d 2024-03-30T14:02:29.432 INFO:teuthology.orchestra.run.smithi099.stdout:grafana.a smithi181 *:3000 running (47s) 1s ago 24m 74.3M - 9.4.12 2bacad6d85d8 d599aa7730d6 2024-03-30T14:02:29.432 INFO:teuthology.orchestra.run.smithi099.stdout:iscsi.foo.smithi099.qyjuvr smithi099 running (3m) 6s ago 24m 53.7M - 3.5 e1d6a67b021e 2f859af6bc2a 2024-03-30T14:02:29.432 INFO:teuthology.orchestra.run.smithi099.stdout:mgr.x smithi181 *:8443,9283,8765 running (2m) 1s ago 30m 451M - 19.0.0-1967-g4e50bbcd b0c4478f1d83 f269106f7913 2024-03-30T14:02:29.433 INFO:teuthology.orchestra.run.smithi099.stdout:mgr.y smithi099 *:8443,9283,8765 running (13m) 6s ago 31m 531M - 19.0.0-1967-g4e50bbcd b0c4478f1d83 0d464b8c1d18 2024-03-30T14:02:29.433 INFO:teuthology.orchestra.run.smithi099.stdout:mon.a smithi099 running (31m) 6s ago 31m 138M 2048M 17.2.0 e1d6a67b021e af06ebb19fd8 2024-03-30T14:02:29.433 INFO:teuthology.orchestra.run.smithi099.stdout:mon.b smithi181 running (30m) 1s ago 30m 78.2M 2048M 17.2.0 e1d6a67b021e e678a2a25c90 2024-03-30T14:02:29.433 INFO:teuthology.orchestra.run.smithi099.stdout:mon.c smithi099 running (30m) 6s ago 30m 77.6M 2048M 17.2.0 e1d6a67b021e 0f1e98917718 2024-03-30T14:02:29.433 INFO:teuthology.orchestra.run.smithi099.stdout:node-exporter.a smithi099 *:9100 running (2m) 6s ago 26m 8372k - 1.5.0 0da6a335fe13 4a3f1f6e7068 2024-03-30T14:02:29.433 INFO:teuthology.orchestra.run.smithi099.stdout:node-exporter.b smithi181 *:9100 running (2m) 1s ago 25m 15.2M - 1.5.0 0da6a335fe13 acea317b5f5d 2024-03-30T14:02:29.433 INFO:teuthology.orchestra.run.smithi099.stdout:osd.0 smithi099 running (29m) 6s ago 29m 54.6M 4096M 17.2.0 e1d6a67b021e 3158ee1b0c67 2024-03-30T14:02:29.433 INFO:teuthology.orchestra.run.smithi099.stdout:osd.1 smithi099 running (29m) 6s ago 29m 57.7M 4096M 17.2.0 e1d6a67b021e c4af0fd7071a 2024-03-30T14:02:29.433 INFO:teuthology.orchestra.run.smithi099.stdout:osd.2 smithi099 running (28m) 6s ago 28m 49.8M 4096M 17.2.0 e1d6a67b021e 8e4e805a7e20 2024-03-30T14:02:29.433 INFO:teuthology.orchestra.run.smithi099.stdout:osd.3 smithi099 running (28m) 6s ago 28m 53.7M 4096M 17.2.0 e1d6a67b021e 718812bcf065 2024-03-30T14:02:29.433 INFO:teuthology.orchestra.run.smithi099.stdout:osd.4 smithi181 running (28m) 1s ago 28m 55.3M 4096M 17.2.0 e1d6a67b021e 5e205434e973 2024-03-30T14:02:29.433 INFO:teuthology.orchestra.run.smithi099.stdout:osd.5 smithi181 running (27m) 1s ago 27m 52.9M 4096M 17.2.0 e1d6a67b021e e330c920f152 2024-03-30T14:02:29.433 INFO:teuthology.orchestra.run.smithi099.stdout:osd.6 smithi181 running (27m) 1s ago 27m 52.3M 4096M 17.2.0 e1d6a67b021e 81d889ea213d 2024-03-30T14:02:29.434 INFO:teuthology.orchestra.run.smithi099.stdout:osd.7 smithi181 running (26m) 1s ago 26m 53.0M 4096M 17.2.0 e1d6a67b021e c08b1839dd7e 2024-03-30T14:02:29.434 INFO:teuthology.orchestra.run.smithi099.stdout:prometheus.a smithi181 *:9095 running (110s) 1s ago 26m 61.5M - 2.43.0 a07b618ecd1d 004088bdf70e 2024-03-30T14:02:29.434 INFO:teuthology.orchestra.run.smithi099.stdout:rgw.foo.smithi099.fxjbmp smithi099 *:8000 running (24m) 6s ago 24m 76.7M - 17.2.0 e1d6a67b021e 400b28b3f650 2024-03-30T14:02:29.434 INFO:teuthology.orchestra.run.smithi099.stdout:rgw.foo.smithi181.wfqwti smithi181 *:8000 running (24m) 1s ago 24m 76.5M - 17.2.0 e1d6a67b021e 97e1b130f9d4 2024-03-30T14:02:29.498 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:29 smithi181 systemd[1]: Stopping Ceph mon.b for 98ebaeb8-ee99-11ee-b647-cb9ed24678a4... 2024-03-30T14:02:29.831 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-03-30T14:02:29.831 INFO:teuthology.orchestra.run.smithi099.stdout: "mon": { 2024-03-30T14:02:29.831 INFO:teuthology.orchestra.run.smithi099.stdout: "ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)": 3 2024-03-30T14:02:29.831 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T14:02:29.831 INFO:teuthology.orchestra.run.smithi099.stdout: "mgr": { 2024-03-30T14:02:29.831 INFO:teuthology.orchestra.run.smithi099.stdout: "ceph version 19.0.0-1967-g4e50bbcd (4e50bbcdd1630c7760b708f3a5b4d38a121e66cb) squid (dev)": 2 2024-03-30T14:02:29.831 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T14:02:29.831 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": { 2024-03-30T14:02:29.831 INFO:teuthology.orchestra.run.smithi099.stdout: "ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)": 8 2024-03-30T14:02:29.831 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T14:02:29.831 INFO:teuthology.orchestra.run.smithi099.stdout: "mds": {}, 2024-03-30T14:02:29.831 INFO:teuthology.orchestra.run.smithi099.stdout: "rgw": { 2024-03-30T14:02:29.831 INFO:teuthology.orchestra.run.smithi099.stdout: "ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)": 2 2024-03-30T14:02:29.832 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T14:02:29.832 INFO:teuthology.orchestra.run.smithi099.stdout: "overall": { 2024-03-30T14:02:29.832 INFO:teuthology.orchestra.run.smithi099.stdout: "ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)": 13, 2024-03-30T14:02:29.832 INFO:teuthology.orchestra.run.smithi099.stdout: "ceph version 19.0.0-1967-g4e50bbcd (4e50bbcdd1630c7760b708f3a5b4d38a121e66cb) squid (dev)": 2 2024-03-30T14:02:29.832 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-03-30T14:02:29.832 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-03-30T14:02:29.997 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:29 smithi181 ceph-mon[25762]: pgmap v1714: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T14:02:29.997 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:29 smithi181 ceph-mon[25762]: from='client.25648 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T14:02:29.997 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:29 smithi181 ceph-mon[25762]: from='client.? 172.21.15.99:0/1437592839' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:02:30.162 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-03-30T14:02:30.162 INFO:teuthology.orchestra.run.smithi099.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph:4e50bbcdd1630c7760b708f3a5b4d38a121e66cb", 2024-03-30T14:02:30.162 INFO:teuthology.orchestra.run.smithi099.stdout: "in_progress": true, 2024-03-30T14:02:30.162 INFO:teuthology.orchestra.run.smithi099.stdout: "which": "Upgrading daemons of type(s) mon on host(s) smithi181", 2024-03-30T14:02:30.162 INFO:teuthology.orchestra.run.smithi099.stdout: "services_complete": [], 2024-03-30T14:02:30.163 INFO:teuthology.orchestra.run.smithi099.stdout: "progress": "0/1 daemons upgraded", 2024-03-30T14:02:30.163 INFO:teuthology.orchestra.run.smithi099.stdout: "message": "Currently upgrading mon daemons", 2024-03-30T14:02:30.163 INFO:teuthology.orchestra.run.smithi099.stdout: "is_paused": false 2024-03-30T14:02:30.163 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-03-30T14:02:30.249 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:30 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mon-b[25756]: 2024-03-30T14:02:30.156+0000 7fd848ebb700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.b -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-03-30T14:02:30.249 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:30 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mon-b[25756]: 2024-03-30T14:02:30.156+0000 7fd848ebb700 -1 mon.b@2(peon) e3 *** Got Signal Terminated *** 2024-03-30T14:02:30.330 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:29 smithi099 ceph-mon[24912]: pgmap v1714: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T14:02:30.330 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:29 smithi099 ceph-mon[24912]: from='client.25648 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T14:02:30.330 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:29 smithi099 ceph-mon[24912]: from='client.? 172.21.15.99:0/1437592839' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:02:30.330 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:29 smithi099 ceph-mon[29691]: pgmap v1714: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T14:02:30.330 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:29 smithi099 ceph-mon[29691]: from='client.25648 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T14:02:30.330 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:29 smithi099 ceph-mon[29691]: from='client.? 172.21.15.99:0/1437592839' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:02:30.660 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:30 smithi181 podman[115112]: 2024-03-30 14:02:30.361103525 +0000 UTC m=+0.309414801 container died e678a2a25c90c7b3e7081be401dd2b98c91678d6a0f1cb5cc0bcc6c809c921fb (image=quay.io/ceph/ceph@sha256:12a0a4f43413fd97a14a3d47a3451b2d2df50020835bb93db666209f3f77617a, name=ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mon-b, io.buildah.version=1.19.8, release=754, build-date=2022-05-03T08:36:31.336870, vcs-ref=f1ee6e37554363ec55e0035aba1a693d3627fdeb, GIT_BRANCH=HEAD, distribution-scope=public, name=centos-stream, io.k8s.description=The Universal Base Image is designed and engineered to be the base layer for all of your containerized applications, middleware and utilities. This base image is freely redistributable, but Red Hat only supports Red Hat technologies through subscriptions for Red Hat products. This image is maintained by Red Hat and updated regularly., io.k8s.display-name=CentOS Stream 8, io.openshift.tags=base centos centos-stream, version=8, maintainer=Guillaume Abrioux , com.redhat.component=centos-stream-container, com.redhat.license_terms=https://centos.org/legal/licensing-policy/, GIT_CLEAN=True, com.redhat.build-host=cpt-1002.osbs.prod.upshift.rdu2.redhat.com, GIT_COMMIT=b613db0f44179c0940781c1c7fe04e1acb7093ac, architecture=x86_64, RELEASE=HEAD, vcs-type=git, vendor=Red Hat, Inc., GIT_REPO=https://github.com/ceph/ceph-container.git, summary=Provides a CentOS Stream container based on the Red Hat Universal Base Image, ceph=True, io.openshift.expose-services=, CEPH_POINT_RELEASE=-17.2.0, url=https://access.redhat.com/containers/#/registry.access.redhat.com/ubi8/images/8.6-754, description=CentOS Stream is a continuously delivered distro that tracks just ahead of Red Hat Enterprise Linux development. This image takes the Red Hat UBI and layers on content from CentOS Stream) 2024-03-30T14:02:30.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:30 smithi181 podman[115112]: 2024-03-30 14:02:30.739961318 +0000 UTC m=+0.688272598 container cleanup e678a2a25c90c7b3e7081be401dd2b98c91678d6a0f1cb5cc0bcc6c809c921fb (image=quay.io/ceph/ceph@sha256:12a0a4f43413fd97a14a3d47a3451b2d2df50020835bb93db666209f3f77617a, name=ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mon-b, io.k8s.display-name=CentOS Stream 8, GIT_BRANCH=HEAD, io.openshift.expose-services=, distribution-scope=public, build-date=2022-05-03T08:36:31.336870, name=centos-stream, com.redhat.build-host=cpt-1002.osbs.prod.upshift.rdu2.redhat.com, io.k8s.description=The Universal Base Image is designed and engineered to be the base layer for all of your containerized applications, middleware and utilities. This base image is freely redistributable, but Red Hat only supports Red Hat technologies through subscriptions for Red Hat products. This image is maintained by Red Hat and updated regularly., RELEASE=HEAD, vcs-ref=f1ee6e37554363ec55e0035aba1a693d3627fdeb, com.redhat.component=centos-stream-container, ceph=True, vendor=Red Hat, Inc., architecture=x86_64, io.buildah.version=1.19.8, vcs-type=git, com.redhat.license_terms=https://centos.org/legal/licensing-policy/, GIT_COMMIT=b613db0f44179c0940781c1c7fe04e1acb7093ac, description=CentOS Stream is a continuously delivered distro that tracks just ahead of Red Hat Enterprise Linux development. This image takes the Red Hat UBI and layers on content from CentOS Stream, version=8, GIT_REPO=https://github.com/ceph/ceph-container.git, GIT_CLEAN=True, io.openshift.tags=base centos centos-stream, release=754, maintainer=Guillaume Abrioux , url=https://access.redhat.com/containers/#/registry.access.redhat.com/ubi8/images/8.6-754, summary=Provides a CentOS Stream container based on the Red Hat Universal Base Image, CEPH_POINT_RELEASE=-17.2.0) 2024-03-30T14:02:30.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:30 smithi181 bash[115112]: ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mon-b 2024-03-30T14:02:31.421 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:31 smithi181 podman[115126]: 2024-03-30 14:02:31.116011012 +0000 UTC m=+0.752026033 container remove e678a2a25c90c7b3e7081be401dd2b98c91678d6a0f1cb5cc0bcc6c809c921fb (image=quay.io/ceph/ceph@sha256:12a0a4f43413fd97a14a3d47a3451b2d2df50020835bb93db666209f3f77617a, name=ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mon-b, vcs-ref=f1ee6e37554363ec55e0035aba1a693d3627fdeb, version=8, GIT_BRANCH=HEAD, GIT_REPO=https://github.com/ceph/ceph-container.git, url=https://access.redhat.com/containers/#/registry.access.redhat.com/ubi8/images/8.6-754, vcs-type=git, maintainer=Guillaume Abrioux , GIT_COMMIT=b613db0f44179c0940781c1c7fe04e1acb7093ac, description=CentOS Stream is a continuously delivered distro that tracks just ahead of Red Hat Enterprise Linux development. This image takes the Red Hat UBI and layers on content from CentOS Stream, com.redhat.build-host=cpt-1002.osbs.prod.upshift.rdu2.redhat.com, ceph=True, com.redhat.license_terms=https://centos.org/legal/licensing-policy/, vendor=Red Hat, Inc., release=754, io.k8s.description=The Universal Base Image is designed and engineered to be the base layer for all of your containerized applications, middleware and utilities. This base image is freely redistributable, but Red Hat only supports Red Hat technologies through subscriptions for Red Hat products. This image is maintained by Red Hat and updated regularly., summary=Provides a CentOS Stream container based on the Red Hat Universal Base Image, RELEASE=HEAD, io.buildah.version=1.19.8, build-date=2022-05-03T08:36:31.336870, io.openshift.tags=base centos centos-stream, GIT_CLEAN=True, io.k8s.display-name=CentOS Stream 8, io.openshift.expose-services=, architecture=x86_64, distribution-scope=public, name=centos-stream, com.redhat.component=centos-stream-container, CEPH_POINT_RELEASE=-17.2.0) 2024-03-30T14:02:31.422 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:31 smithi181 systemd[1]: ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4@mon.b.service: Deactivated successfully. 2024-03-30T14:02:31.422 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:31 smithi181 systemd[1]: Stopped Ceph mon.b for 98ebaeb8-ee99-11ee-b647-cb9ed24678a4. 2024-03-30T14:02:31.422 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:31 smithi181 systemd[1]: ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4@mon.b.service: Consumed 23.595s CPU time. 2024-03-30T14:02:31.422 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:31 smithi181 systemd[1]: Starting Ceph mon.b for 98ebaeb8-ee99-11ee-b647-cb9ed24678a4... 2024-03-30T14:02:31.749 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:31 smithi181 podman[115257]: 2024-03-30 14:02:31.546442478 +0000 UTC m=+0.018522094 image pull b0c4478f1d83795df4d538bf108aee5fac57194348fb16dcdbb3115f3e2fe95e quay.ceph.io/ceph-ci/ceph:4e50bbcdd1630c7760b708f3a5b4d38a121e66cb 2024-03-30T14:02:31.749 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:31 smithi181 podman[115257]: 2024-03-30 14:02:31.675498477 +0000 UTC m=+0.147578081 container create 0468ed087cdd924e714de865c81d64cccd9fd88310697053bba1f6bd75544474 (image=quay.ceph.io/ceph-ci/ceph:4e50bbcdd1630c7760b708f3a5b4d38a121e66cb, name=ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mon-b, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, RELEASE=squid-4e50bbc, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240326, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, ceph=True, io.buildah.version=1.33.5, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-03-30T14:02:32.171 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:31 smithi181 podman[115257]: 2024-03-30 14:02:31.895126262 +0000 UTC m=+0.367205867 container init 0468ed087cdd924e714de865c81d64cccd9fd88310697053bba1f6bd75544474 (image=quay.ceph.io/ceph-ci/ceph:4e50bbcdd1630c7760b708f3a5b4d38a121e66cb, name=ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mon-b, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_CLEAN=True, ceph=True, GIT_BRANCH=HEAD, org.label-schema.build-date=20240326, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=squid-4e50bbc, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux ) 2024-03-30T14:02:32.171 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:31 smithi181 podman[115257]: 2024-03-30 14:02:31.898286087 +0000 UTC m=+0.370365693 container start 0468ed087cdd924e714de865c81d64cccd9fd88310697053bba1f6bd75544474 (image=quay.ceph.io/ceph-ci/ceph:4e50bbcdd1630c7760b708f3a5b4d38a121e66cb, name=ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mon-b, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , RELEASE=squid-4e50bbc, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.vendor=CentOS, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, org.label-schema.build-date=20240326) 2024-03-30T14:02:32.171 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:31 smithi181 ceph-mon[115276]: set uid:gid to 167:167 (ceph:ceph) 2024-03-30T14:02:32.171 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:31 smithi181 ceph-mon[115276]: ceph version 19.0.0-1967-g4e50bbcd (4e50bbcdd1630c7760b708f3a5b4d38a121e66cb) squid (dev), process ceph-mon, pid 2 2024-03-30T14:02:32.171 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:31 smithi181 ceph-mon[115276]: pidfile_write: ignore empty --pid-file 2024-03-30T14:02:32.171 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:31 smithi181 ceph-mon[115276]: load: jerasure load: lrc 2024-03-30T14:02:32.171 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:31 smithi181 ceph-mon[115276]: rocksdb: RocksDB version: 7.9.2 2024-03-30T14:02:32.171 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:31 smithi181 ceph-mon[115276]: rocksdb: Git sha 0 2024-03-30T14:02:32.171 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:31 smithi181 ceph-mon[115276]: rocksdb: Compile date 2024-03-29 15:06:16 2024-03-30T14:02:32.171 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:31 smithi181 ceph-mon[115276]: rocksdb: DB SUMMARY 2024-03-30T14:02:32.171 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:31 smithi181 ceph-mon[115276]: rocksdb: DB Session ID: E18EDKMVA8BJ81SEO6P5 2024-03-30T14:02:32.172 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:31 smithi181 ceph-mon[115276]: rocksdb: CURRENT file: CURRENT 2024-03-30T14:02:32.172 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:31 smithi181 ceph-mon[115276]: rocksdb: IDENTITY file: IDENTITY 2024-03-30T14:02:32.172 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:31 smithi181 ceph-mon[115276]: rocksdb: MANIFEST file: MANIFEST-000009 size: 5195 Bytes 2024-03-30T14:02:32.172 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:31 smithi181 ceph-mon[115276]: rocksdb: SST files in /var/lib/ceph/mon/ceph-b/store.db dir, Total Num: 1, files: 000090.sst 2024-03-30T14:02:32.172 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:31 smithi181 ceph-mon[115276]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-b/store.db: 000088.log size: 2446040 ; 2024-03-30T14:02:32.172 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:31 smithi181 ceph-mon[115276]: rocksdb: Options.error_if_exists: 0 2024-03-30T14:02:32.172 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:31 smithi181 ceph-mon[115276]: rocksdb: Options.create_if_missing: 0 2024-03-30T14:02:32.172 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:31 smithi181 ceph-mon[115276]: rocksdb: Options.paranoid_checks: 1 2024-03-30T14:02:32.172 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:31 smithi181 ceph-mon[115276]: rocksdb: Options.flush_verify_memtable_count: 1 2024-03-30T14:02:32.172 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:31 smithi181 ceph-mon[115276]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-03-30T14:02:32.172 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:31 smithi181 ceph-mon[115276]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-03-30T14:02:32.172 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:31 smithi181 ceph-mon[115276]: rocksdb: Options.env: 0x558ca4357c60 2024-03-30T14:02:32.172 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:31 smithi181 ceph-mon[115276]: rocksdb: Options.fs: PosixFileSystem 2024-03-30T14:02:32.172 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:31 smithi181 ceph-mon[115276]: rocksdb: Options.info_log: 0x558ca4ef9ae0 2024-03-30T14:02:32.172 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:31 smithi181 ceph-mon[115276]: rocksdb: Options.max_file_opening_threads: 16 2024-03-30T14:02:32.173 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:31 smithi181 ceph-mon[115276]: rocksdb: Options.statistics: (nil) 2024-03-30T14:02:32.174 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:31 smithi181 ceph-mon[115276]: rocksdb: Options.use_fsync: 0 2024-03-30T14:02:32.174 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:31 smithi181 ceph-mon[115276]: rocksdb: Options.max_log_file_size: 0 2024-03-30T14:02:32.174 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:31 smithi181 ceph-mon[115276]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-03-30T14:02:32.174 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:31 smithi181 ceph-mon[115276]: rocksdb: Options.log_file_time_to_roll: 0 2024-03-30T14:02:32.174 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:31 smithi181 ceph-mon[115276]: rocksdb: Options.keep_log_file_num: 1000 2024-03-30T14:02:32.174 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:31 smithi181 ceph-mon[115276]: rocksdb: Options.recycle_log_file_num: 0 2024-03-30T14:02:32.174 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:31 smithi181 ceph-mon[115276]: rocksdb: Options.allow_fallocate: 1 2024-03-30T14:02:32.174 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:31 smithi181 ceph-mon[115276]: rocksdb: Options.allow_mmap_reads: 0 2024-03-30T14:02:32.174 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:31 smithi181 ceph-mon[115276]: rocksdb: Options.allow_mmap_writes: 0 2024-03-30T14:02:32.174 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:31 smithi181 ceph-mon[115276]: rocksdb: Options.use_direct_reads: 0 2024-03-30T14:02:32.175 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:31 smithi181 ceph-mon[115276]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-03-30T14:02:32.175 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:31 smithi181 ceph-mon[115276]: rocksdb: Options.create_missing_column_families: 0 2024-03-30T14:02:32.175 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:31 smithi181 ceph-mon[115276]: rocksdb: Options.db_log_dir: 2024-03-30T14:02:32.175 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:31 smithi181 ceph-mon[115276]: rocksdb: Options.wal_dir: 2024-03-30T14:02:32.175 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:31 smithi181 ceph-mon[115276]: rocksdb: Options.table_cache_numshardbits: 6 2024-03-30T14:02:32.175 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:31 smithi181 ceph-mon[115276]: rocksdb: Options.WAL_ttl_seconds: 0 2024-03-30T14:02:32.175 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:31 smithi181 ceph-mon[115276]: rocksdb: Options.WAL_size_limit_MB: 0 2024-03-30T14:02:32.175 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:31 smithi181 ceph-mon[115276]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-03-30T14:02:32.175 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:31 smithi181 ceph-mon[115276]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-03-30T14:02:32.175 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:31 smithi181 ceph-mon[115276]: rocksdb: Options.is_fd_close_on_exec: 1 2024-03-30T14:02:32.175 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:31 smithi181 ceph-mon[115276]: rocksdb: Options.advise_random_on_open: 1 2024-03-30T14:02:32.175 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:31 smithi181 ceph-mon[115276]: rocksdb: Options.db_write_buffer_size: 0 2024-03-30T14:02:32.175 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:31 smithi181 ceph-mon[115276]: rocksdb: Options.write_buffer_manager: 0x558ca4ecc820 2024-03-30T14:02:32.175 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:31 smithi181 ceph-mon[115276]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-03-30T14:02:32.175 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:31 smithi181 ceph-mon[115276]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-03-30T14:02:32.176 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:31 smithi181 ceph-mon[115276]: rocksdb: Options.use_adaptive_mutex: 0 2024-03-30T14:02:32.176 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:31 smithi181 ceph-mon[115276]: rocksdb: Options.rate_limiter: (nil) 2024-03-30T14:02:32.176 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:31 smithi181 ceph-mon[115276]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-03-30T14:02:32.176 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:31 smithi181 ceph-mon[115276]: rocksdb: Options.wal_recovery_mode: 2 2024-03-30T14:02:32.176 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:31 smithi181 ceph-mon[115276]: rocksdb: Options.enable_thread_tracking: 0 2024-03-30T14:02:32.176 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:31 smithi181 ceph-mon[115276]: rocksdb: Options.enable_pipelined_write: 0 2024-03-30T14:02:32.176 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:31 smithi181 ceph-mon[115276]: rocksdb: Options.unordered_write: 0 2024-03-30T14:02:32.176 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:31 smithi181 ceph-mon[115276]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-03-30T14:02:32.176 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:31 smithi181 ceph-mon[115276]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-03-30T14:02:32.176 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:31 smithi181 ceph-mon[115276]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-03-30T14:02:32.176 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:31 smithi181 ceph-mon[115276]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-03-30T14:02:32.176 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:31 smithi181 ceph-mon[115276]: rocksdb: Options.row_cache: None 2024-03-30T14:02:32.176 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:31 smithi181 ceph-mon[115276]: rocksdb: Options.wal_filter: None 2024-03-30T14:02:32.176 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:31 smithi181 ceph-mon[115276]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-03-30T14:02:32.176 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:31 smithi181 ceph-mon[115276]: rocksdb: Options.allow_ingest_behind: 0 2024-03-30T14:02:32.177 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:31 smithi181 ceph-mon[115276]: rocksdb: Options.two_write_queues: 0 2024-03-30T14:02:32.177 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:31 smithi181 ceph-mon[115276]: rocksdb: Options.manual_wal_flush: 0 2024-03-30T14:02:32.177 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:31 smithi181 ceph-mon[115276]: rocksdb: Options.wal_compression: 0 2024-03-30T14:02:32.177 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:31 smithi181 ceph-mon[115276]: rocksdb: Options.atomic_flush: 0 2024-03-30T14:02:32.177 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:31 smithi181 ceph-mon[115276]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-03-30T14:02:32.177 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:31 smithi181 ceph-mon[115276]: rocksdb: Options.persist_stats_to_disk: 0 2024-03-30T14:02:32.177 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:31 smithi181 ceph-mon[115276]: rocksdb: Options.write_dbid_to_manifest: 0 2024-03-30T14:02:32.177 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:31 smithi181 ceph-mon[115276]: rocksdb: Options.log_readahead_size: 0 2024-03-30T14:02:32.177 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:31 smithi181 ceph-mon[115276]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-03-30T14:02:32.177 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:31 smithi181 ceph-mon[115276]: rocksdb: Options.best_efforts_recovery: 0 2024-03-30T14:02:32.177 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:31 smithi181 ceph-mon[115276]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-03-30T14:02:32.177 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:31 smithi181 ceph-mon[115276]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-03-30T14:02:32.177 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:31 smithi181 ceph-mon[115276]: rocksdb: Options.allow_data_in_errors: 0 2024-03-30T14:02:32.177 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:31 smithi181 ceph-mon[115276]: rocksdb: Options.db_host_id: __hostname__ 2024-03-30T14:02:32.177 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:31 smithi181 ceph-mon[115276]: rocksdb: Options.enforce_single_del_contracts: true 2024-03-30T14:02:32.177 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:31 smithi181 ceph-mon[115276]: rocksdb: Options.max_background_jobs: 2 2024-03-30T14:02:32.178 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:31 smithi181 ceph-mon[115276]: rocksdb: Options.max_background_compactions: -1 2024-03-30T14:02:32.178 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:31 smithi181 ceph-mon[115276]: rocksdb: Options.max_subcompactions: 1 2024-03-30T14:02:32.178 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:31 smithi181 ceph-mon[115276]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-03-30T14:02:32.178 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:31 smithi181 ceph-mon[115276]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-03-30T14:02:32.178 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:31 smithi181 ceph-mon[115276]: rocksdb: Options.delayed_write_rate : 16777216 2024-03-30T14:02:32.178 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:31 smithi181 ceph-mon[115276]: rocksdb: Options.max_total_wal_size: 0 2024-03-30T14:02:32.178 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:31 smithi181 ceph-mon[115276]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-03-30T14:02:32.178 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:31 smithi181 ceph-mon[115276]: rocksdb: Options.stats_dump_period_sec: 600 2024-03-30T14:02:32.178 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:31 smithi181 ceph-mon[115276]: rocksdb: Options.stats_persist_period_sec: 600 2024-03-30T14:02:32.178 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:31 smithi181 ceph-mon[115276]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-03-30T14:02:32.178 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:31 smithi181 ceph-mon[115276]: rocksdb: Options.max_open_files: -1 2024-03-30T14:02:32.178 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:31 smithi181 ceph-mon[115276]: rocksdb: Options.bytes_per_sync: 0 2024-03-30T14:02:32.178 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:31 smithi181 ceph-mon[115276]: rocksdb: Options.wal_bytes_per_sync: 0 2024-03-30T14:02:32.178 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:31 smithi181 ceph-mon[115276]: rocksdb: Options.strict_bytes_per_sync: 0 2024-03-30T14:02:32.179 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:31 smithi181 ceph-mon[115276]: rocksdb: Options.compaction_readahead_size: 0 2024-03-30T14:02:32.179 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:31 smithi181 ceph-mon[115276]: rocksdb: Options.max_background_flushes: -1 2024-03-30T14:02:32.179 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:31 smithi181 ceph-mon[115276]: rocksdb: Compression algorithms supported: 2024-03-30T14:02:32.179 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:31 smithi181 ceph-mon[115276]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-03-30T14:02:32.179 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:31 smithi181 ceph-mon[115276]: rocksdb: kZSTD supported: 0 2024-03-30T14:02:32.179 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:31 smithi181 ceph-mon[115276]: rocksdb: kXpressCompression supported: 0 2024-03-30T14:02:32.179 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:31 smithi181 ceph-mon[115276]: rocksdb: kLZ4HCCompression supported: 1 2024-03-30T14:02:32.179 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:31 smithi181 ceph-mon[115276]: rocksdb: kZlibCompression supported: 1 2024-03-30T14:02:32.179 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:31 smithi181 ceph-mon[115276]: rocksdb: kSnappyCompression supported: 1 2024-03-30T14:02:32.179 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:31 smithi181 ceph-mon[115276]: rocksdb: kLZ4Compression supported: 1 2024-03-30T14:02:32.179 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:31 smithi181 ceph-mon[115276]: rocksdb: kBZip2Compression supported: 0 2024-03-30T14:02:32.179 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:31 smithi181 ceph-mon[115276]: rocksdb: Fast CRC32 supported: Supported on x86 2024-03-30T14:02:32.179 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:31 smithi181 ceph-mon[115276]: rocksdb: DMutex implementation: pthread_mutex_t 2024-03-30T14:02:32.179 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:31 smithi181 ceph-mon[115276]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-b/store.db/MANIFEST-000009 2024-03-30T14:02:32.180 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:31 smithi181 ceph-mon[115276]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-03-30T14:02:32.180 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:31 smithi181 ceph-mon[115276]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-03-30T14:02:32.180 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:31 smithi181 ceph-mon[115276]: rocksdb: Options.merge_operator: 2024-03-30T14:02:32.180 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:31 smithi181 ceph-mon[115276]: rocksdb: Options.compaction_filter: None 2024-03-30T14:02:32.180 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:31 smithi181 ceph-mon[115276]: rocksdb: Options.compaction_filter_factory: None 2024-03-30T14:02:32.180 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:31 smithi181 ceph-mon[115276]: rocksdb: Options.sst_partitioner_factory: None 2024-03-30T14:02:32.180 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:31 smithi181 ceph-mon[115276]: rocksdb: Options.memtable_factory: SkipListFactory 2024-03-30T14:02:32.180 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:31 smithi181 ceph-mon[115276]: rocksdb: Options.table_factory: BlockBasedTable 2024-03-30T14:02:32.180 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:31 smithi181 ceph-mon[115276]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x558ca4ef9be0) 2024-03-30T14:02:32.180 INFO:journalctl@ceph.mon.b.smithi181.stdout: cache_index_and_filter_blocks: 1 2024-03-30T14:02:32.180 INFO:journalctl@ceph.mon.b.smithi181.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-03-30T14:02:32.180 INFO:journalctl@ceph.mon.b.smithi181.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-03-30T14:02:32.180 INFO:journalctl@ceph.mon.b.smithi181.stdout: pin_top_level_index_and_filter: 1 2024-03-30T14:02:32.180 INFO:journalctl@ceph.mon.b.smithi181.stdout: index_type: 0 2024-03-30T14:02:32.181 INFO:journalctl@ceph.mon.b.smithi181.stdout: data_block_index_type: 0 2024-03-30T14:02:32.181 INFO:journalctl@ceph.mon.b.smithi181.stdout: index_shortening: 1 2024-03-30T14:02:32.181 INFO:journalctl@ceph.mon.b.smithi181.stdout: data_block_hash_table_util_ratio: 0.750000 2024-03-30T14:02:32.181 INFO:journalctl@ceph.mon.b.smithi181.stdout: checksum: 4 2024-03-30T14:02:32.181 INFO:journalctl@ceph.mon.b.smithi181.stdout: no_block_cache: 0 2024-03-30T14:02:32.181 INFO:journalctl@ceph.mon.b.smithi181.stdout: block_cache: 0x558ca4efd090 2024-03-30T14:02:32.181 INFO:journalctl@ceph.mon.b.smithi181.stdout: block_cache_name: BinnedLRUCache 2024-03-30T14:02:32.181 INFO:journalctl@ceph.mon.b.smithi181.stdout: block_cache_options: 2024-03-30T14:02:32.181 INFO:journalctl@ceph.mon.b.smithi181.stdout: capacity : 536870912 2024-03-30T14:02:32.181 INFO:journalctl@ceph.mon.b.smithi181.stdout: num_shard_bits : 4 2024-03-30T14:02:32.181 INFO:journalctl@ceph.mon.b.smithi181.stdout: strict_capacity_limit : 0 2024-03-30T14:02:32.181 INFO:journalctl@ceph.mon.b.smithi181.stdout: high_pri_pool_ratio: 0.000 2024-03-30T14:02:32.181 INFO:journalctl@ceph.mon.b.smithi181.stdout: block_cache_compressed: (nil) 2024-03-30T14:02:32.181 INFO:journalctl@ceph.mon.b.smithi181.stdout: persistent_cache: (nil) 2024-03-30T14:02:32.181 INFO:journalctl@ceph.mon.b.smithi181.stdout: block_size: 4096 2024-03-30T14:02:32.182 INFO:journalctl@ceph.mon.b.smithi181.stdout: block_size_deviation: 10 2024-03-30T14:02:32.182 INFO:journalctl@ceph.mon.b.smithi181.stdout: block_restart_interval: 16 2024-03-30T14:02:32.182 INFO:journalctl@ceph.mon.b.smithi181.stdout: index_block_restart_interval: 1 2024-03-30T14:02:32.182 INFO:journalctl@ceph.mon.b.smithi181.stdout: metadata_block_size: 4096 2024-03-30T14:02:32.182 INFO:journalctl@ceph.mon.b.smithi181.stdout: partition_filters: 0 2024-03-30T14:02:32.182 INFO:journalctl@ceph.mon.b.smithi181.stdout: use_delta_encoding: 1 2024-03-30T14:02:32.182 INFO:journalctl@ceph.mon.b.smithi181.stdout: filter_policy: bloomfilter 2024-03-30T14:02:32.182 INFO:journalctl@ceph.mon.b.smithi181.stdout: whole_key_filtering: 1 2024-03-30T14:02:32.182 INFO:journalctl@ceph.mon.b.smithi181.stdout: verify_compression: 0 2024-03-30T14:02:32.182 INFO:journalctl@ceph.mon.b.smithi181.stdout: read_amp_bytes_per_bit: 0 2024-03-30T14:02:32.182 INFO:journalctl@ceph.mon.b.smithi181.stdout: format_version: 5 2024-03-30T14:02:32.182 INFO:journalctl@ceph.mon.b.smithi181.stdout: enable_index_compression: 1 2024-03-30T14:02:32.182 INFO:journalctl@ceph.mon.b.smithi181.stdout: block_align: 0 2024-03-30T14:02:32.182 INFO:journalctl@ceph.mon.b.smithi181.stdout: max_auto_readahead_size: 262144 2024-03-30T14:02:32.182 INFO:journalctl@ceph.mon.b.smithi181.stdout: prepopulate_block_cache: 0 2024-03-30T14:02:32.183 INFO:journalctl@ceph.mon.b.smithi181.stdout: initial_auto_readahead_size: 8192 2024-03-30T14:02:32.183 INFO:journalctl@ceph.mon.b.smithi181.stdout: num_file_reads_for_auto_readahead: 2 2024-03-30T14:02:32.183 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:31 smithi181 ceph-mon[115276]: rocksdb: Options.write_buffer_size: 33554432 2024-03-30T14:02:32.183 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:31 smithi181 ceph-mon[115276]: rocksdb: Options.max_write_buffer_number: 2 2024-03-30T14:02:32.183 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:31 smithi181 ceph-mon[115276]: rocksdb: Options.compression: NoCompression 2024-03-30T14:02:32.183 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:31 smithi181 ceph-mon[115276]: rocksdb: Options.bottommost_compression: Disabled 2024-03-30T14:02:32.183 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:31 smithi181 ceph-mon[115276]: rocksdb: Options.prefix_extractor: nullptr 2024-03-30T14:02:32.183 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:31 smithi181 ceph-mon[115276]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-03-30T14:02:32.183 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:31 smithi181 ceph-mon[115276]: rocksdb: Options.num_levels: 7 2024-03-30T14:02:32.183 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:31 smithi181 ceph-mon[115276]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-03-30T14:02:32.183 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:31 smithi181 ceph-mon[115276]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-03-30T14:02:32.183 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:31 smithi181 ceph-mon[115276]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-03-30T14:02:32.183 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:31 smithi181 ceph-mon[115276]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-03-30T14:02:32.183 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:31 smithi181 ceph-mon[115276]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-03-30T14:02:32.185 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:31 smithi181 ceph-mon[115276]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-03-30T14:02:32.185 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:31 smithi181 ceph-mon[115276]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-03-30T14:02:32.185 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:31 smithi181 ceph-mon[115276]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-03-30T14:02:32.185 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:31 smithi181 ceph-mon[115276]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-03-30T14:02:32.185 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:31 smithi181 ceph-mon[115276]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-03-30T14:02:32.185 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:31 smithi181 ceph-mon[115276]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-03-30T14:02:32.185 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:31 smithi181 ceph-mon[115276]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-03-30T14:02:32.185 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:31 smithi181 ceph-mon[115276]: rocksdb: Options.compression_opts.window_bits: -14 2024-03-30T14:02:32.185 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:31 smithi181 ceph-mon[115276]: rocksdb: Options.compression_opts.level: 32767 2024-03-30T14:02:32.186 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:31 smithi181 ceph-mon[115276]: rocksdb: Options.compression_opts.strategy: 0 2024-03-30T14:02:32.186 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:31 smithi181 ceph-mon[115276]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-03-30T14:02:32.186 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:31 smithi181 ceph-mon[115276]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-03-30T14:02:32.186 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:31 smithi181 ceph-mon[115276]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-03-30T14:02:32.186 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:31 smithi181 ceph-mon[115276]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-03-30T14:02:32.186 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:31 smithi181 ceph-mon[115276]: rocksdb: Options.compression_opts.enabled: false 2024-03-30T14:02:32.186 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:31 smithi181 ceph-mon[115276]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-03-30T14:02:32.186 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:31 smithi181 ceph-mon[115276]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-03-30T14:02:32.186 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:31 smithi181 ceph-mon[115276]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-03-30T14:02:32.186 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:31 smithi181 ceph-mon[115276]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-03-30T14:02:32.186 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:31 smithi181 ceph-mon[115276]: rocksdb: Options.target_file_size_base: 67108864 2024-03-30T14:02:32.186 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:31 smithi181 ceph-mon[115276]: rocksdb: Options.target_file_size_multiplier: 1 2024-03-30T14:02:32.186 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:31 smithi181 ceph-mon[115276]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-03-30T14:02:32.186 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:31 smithi181 ceph-mon[115276]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-03-30T14:02:32.186 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:31 smithi181 ceph-mon[115276]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-03-30T14:02:32.187 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:31 smithi181 ceph-mon[115276]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-03-30T14:02:32.187 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:31 smithi181 ceph-mon[115276]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-03-30T14:02:32.187 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:31 smithi181 ceph-mon[115276]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-03-30T14:02:32.187 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:31 smithi181 ceph-mon[115276]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-03-30T14:02:32.187 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:31 smithi181 ceph-mon[115276]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-03-30T14:02:32.187 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:31 smithi181 ceph-mon[115276]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-03-30T14:02:32.187 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:31 smithi181 ceph-mon[115276]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-03-30T14:02:32.187 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:31 smithi181 ceph-mon[115276]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-03-30T14:02:32.187 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:31 smithi181 ceph-mon[115276]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-03-30T14:02:32.187 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:31 smithi181 ceph-mon[115276]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-03-30T14:02:32.187 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:31 smithi181 ceph-mon[115276]: rocksdb: Options.arena_block_size: 1048576 2024-03-30T14:02:32.187 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:31 smithi181 ceph-mon[115276]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-03-30T14:02:32.187 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:31 smithi181 ceph-mon[115276]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-03-30T14:02:32.188 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:31 smithi181 ceph-mon[115276]: rocksdb: Options.disable_auto_compactions: 0 2024-03-30T14:02:32.188 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:31 smithi181 ceph-mon[115276]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-03-30T14:02:32.188 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:31 smithi181 ceph-mon[115276]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-03-30T14:02:32.188 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:31 smithi181 ceph-mon[115276]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-03-30T14:02:32.188 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:31 smithi181 ceph-mon[115276]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-03-30T14:02:32.188 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:31 smithi181 ceph-mon[115276]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-03-30T14:02:32.188 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:31 smithi181 ceph-mon[115276]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-03-30T14:02:32.188 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:31 smithi181 ceph-mon[115276]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-03-30T14:02:32.188 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:31 smithi181 ceph-mon[115276]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-03-30T14:02:32.188 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:31 smithi181 ceph-mon[115276]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-03-30T14:02:32.188 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:31 smithi181 ceph-mon[115276]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-03-30T14:02:32.188 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:31 smithi181 ceph-mon[115276]: rocksdb: Options.table_properties_collectors: 2024-03-30T14:02:32.188 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:31 smithi181 ceph-mon[115276]: rocksdb: Options.inplace_update_support: 0 2024-03-30T14:02:32.188 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:31 smithi181 ceph-mon[115276]: rocksdb: Options.inplace_update_num_locks: 10000 2024-03-30T14:02:32.188 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:31 smithi181 ceph-mon[115276]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-03-30T14:02:32.189 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:31 smithi181 ceph-mon[115276]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-03-30T14:02:32.189 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:31 smithi181 ceph-mon[115276]: rocksdb: Options.memtable_huge_page_size: 0 2024-03-30T14:02:32.189 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:31 smithi181 ceph-mon[115276]: rocksdb: Options.bloom_locality: 0 2024-03-30T14:02:32.189 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:31 smithi181 ceph-mon[115276]: rocksdb: Options.max_successive_merges: 0 2024-03-30T14:02:32.189 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:31 smithi181 ceph-mon[115276]: rocksdb: Options.optimize_filters_for_hits: 0 2024-03-30T14:02:32.189 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:31 smithi181 ceph-mon[115276]: rocksdb: Options.paranoid_file_checks: 0 2024-03-30T14:02:32.189 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:31 smithi181 ceph-mon[115276]: rocksdb: Options.force_consistency_checks: 1 2024-03-30T14:02:32.189 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:31 smithi181 ceph-mon[115276]: rocksdb: Options.report_bg_io_stats: 0 2024-03-30T14:02:32.189 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:31 smithi181 ceph-mon[115276]: rocksdb: Options.ttl: 2592000 2024-03-30T14:02:32.189 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:31 smithi181 ceph-mon[115276]: rocksdb: Options.periodic_compaction_seconds: 0 2024-03-30T14:02:32.189 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:31 smithi181 ceph-mon[115276]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-03-30T14:02:32.189 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:31 smithi181 ceph-mon[115276]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-03-30T14:02:32.189 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:31 smithi181 ceph-mon[115276]: rocksdb: Options.enable_blob_files: false 2024-03-30T14:02:32.190 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:31 smithi181 ceph-mon[115276]: rocksdb: Options.min_blob_size: 0 2024-03-30T14:02:32.190 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:31 smithi181 ceph-mon[115276]: rocksdb: Options.blob_file_size: 268435456 2024-03-30T14:02:32.190 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:31 smithi181 ceph-mon[115276]: rocksdb: Options.blob_compression_type: NoCompression 2024-03-30T14:02:32.190 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:31 smithi181 ceph-mon[115276]: rocksdb: Options.enable_blob_garbage_collection: false 2024-03-30T14:02:32.190 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:31 smithi181 ceph-mon[115276]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-03-30T14:02:32.190 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:31 smithi181 ceph-mon[115276]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-03-30T14:02:32.190 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:31 smithi181 ceph-mon[115276]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-03-30T14:02:32.190 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:31 smithi181 ceph-mon[115276]: rocksdb: Options.blob_file_starting_level: 0 2024-03-30T14:02:32.190 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:31 smithi181 ceph-mon[115276]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-03-30T14:02:32.190 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:31 smithi181 ceph-mon[115276]: rocksdb: [table/block_based/block_based_table_reader.cc:721] At least one SST file opened without unique ID to verify: 90.sst 2024-03-30T14:02:32.190 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:31 smithi181 ceph-mon[115276]: rocksdb: [db/version_set.cc:4390] More existing levels in DB than needed. max_bytes_for_level_multiplier may not be guaranteed. 2024-03-30T14:02:32.190 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:31 smithi181 ceph-mon[115276]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-b/store.db/MANIFEST-000009 succeeded,manifest_file_number is 9, next_file_number is 92, last_sequence is 53736, log_number is 88,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2024-03-30T14:02:32.190 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:31 smithi181 ceph-mon[115276]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 88 2024-03-30T14:02:32.191 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:31 smithi181 ceph-mon[115276]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: 09382dc8-592d-4a95-86e6-0dbff9290808 2024-03-30T14:02:32.191 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:31 smithi181 ceph-mon[115276]: rocksdb: EVENT_LOG_v1 {"time_micros": 1711807351928503, "job": 1, "event": "recovery_started", "wal_files": [88]} 2024-03-30T14:02:32.191 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:31 smithi181 ceph-mon[115276]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #88 mode 2 2024-03-30T14:02:32.191 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:31 smithi181 ceph-mon[115276]: rocksdb: EVENT_LOG_v1 {"time_micros": 1711807351935359, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 93, "file_size": 1479348, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 53741, "largest_seqno": 55461, "table_properties": {"data_size": 1472989, "index_size": 3423, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 1925, "raw_key_size": 18894, "raw_average_key_size": 24, "raw_value_size": 1458194, "raw_average_value_size": 1901, "num_data_blocks": 149, "num_entries": 767, "num_filter_entries": 767, "num_deletions": 7, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1711807351, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "09382dc8-592d-4a95-86e6-0dbff9290808", "db_session_id": "E18EDKMVA8BJ81SEO6P5", "orig_file_number": 93, "seqno_to_time_mapping": "N/A"}} 2024-03-30T14:02:32.191 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:31 smithi181 ceph-mon[115276]: rocksdb: EVENT_LOG_v1 {"time_micros": 1711807351935445, "job": 1, "event": "recovery_finished"} 2024-03-30T14:02:32.191 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:31 smithi181 ceph-mon[115276]: rocksdb: [db/version_set.cc:5047] Creating manifest 95 2024-03-30T14:02:32.191 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:31 smithi181 ceph-mon[115276]: rocksdb: [db/version_set.cc:4390] More existing levels in DB than needed. max_bytes_for_level_multiplier may not be guaranteed. 2024-03-30T14:02:32.191 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:31 smithi181 ceph-mon[115276]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-b/store.db/000088.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-03-30T14:02:32.191 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:31 smithi181 ceph-mon[115276]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x558ca4fee000 2024-03-30T14:02:32.191 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:31 smithi181 ceph-mon[115276]: rocksdb: DB pointer 0x558ca4fd8000 2024-03-30T14:02:32.191 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:31 smithi181 ceph-mon[115276]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-03-30T14:02:32.191 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:31 smithi181 ceph-mon[115276]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-03-30T14:02:32.191 INFO:journalctl@ceph.mon.b.smithi181.stdout: ** DB Stats ** 2024-03-30T14:02:32.191 INFO:journalctl@ceph.mon.b.smithi181.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-03-30T14:02:32.191 INFO:journalctl@ceph.mon.b.smithi181.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-03-30T14:02:32.192 INFO:journalctl@ceph.mon.b.smithi181.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-03-30T14:02:32.192 INFO:journalctl@ceph.mon.b.smithi181.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-03-30T14:02:32.192 INFO:journalctl@ceph.mon.b.smithi181.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-03-30T14:02:32.192 INFO:journalctl@ceph.mon.b.smithi181.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-03-30T14:02:32.192 INFO:journalctl@ceph.mon.b.smithi181.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-03-30T14:02:32.192 INFO:journalctl@ceph.mon.b.smithi181.stdout: 2024-03-30T14:02:32.192 INFO:journalctl@ceph.mon.b.smithi181.stdout: ** Compaction Stats [default] ** 2024-03-30T14:02:32.192 INFO:journalctl@ceph.mon.b.smithi181.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-03-30T14:02:32.192 INFO:journalctl@ceph.mon.b.smithi181.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-03-30T14:02:32.192 INFO:journalctl@ceph.mon.b.smithi181.stdout: L0 1/0 1.41 MB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 478.9 0.00 0.00 1 0.003 0 0 0.0 0.0 2024-03-30T14:02:32.192 INFO:journalctl@ceph.mon.b.smithi181.stdout: L6 1/0 11.69 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 2024-03-30T14:02:32.192 INFO:journalctl@ceph.mon.b.smithi181.stdout: Sum 2/0 13.10 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 478.9 0.00 0.00 1 0.003 0 0 0.0 0.0 2024-03-30T14:02:32.192 INFO:journalctl@ceph.mon.b.smithi181.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 478.9 0.00 0.00 1 0.003 0 0 0.0 0.0 2024-03-30T14:02:32.192 INFO:journalctl@ceph.mon.b.smithi181.stdout: 2024-03-30T14:02:32.192 INFO:journalctl@ceph.mon.b.smithi181.stdout: ** Compaction Stats [default] ** 2024-03-30T14:02:32.193 INFO:journalctl@ceph.mon.b.smithi181.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-03-30T14:02:32.193 INFO:journalctl@ceph.mon.b.smithi181.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-03-30T14:02:32.193 INFO:journalctl@ceph.mon.b.smithi181.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 478.9 0.00 0.00 1 0.003 0 0 0.0 0.0 2024-03-30T14:02:32.193 INFO:journalctl@ceph.mon.b.smithi181.stdout: 2024-03-30T14:02:32.193 INFO:journalctl@ceph.mon.b.smithi181.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-03-30T14:02:32.193 INFO:journalctl@ceph.mon.b.smithi181.stdout: 2024-03-30T14:02:32.193 INFO:journalctl@ceph.mon.b.smithi181.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-03-30T14:02:32.193 INFO:journalctl@ceph.mon.b.smithi181.stdout: Flush(GB): cumulative 0.001, interval 0.001 2024-03-30T14:02:32.193 INFO:journalctl@ceph.mon.b.smithi181.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-03-30T14:02:32.193 INFO:journalctl@ceph.mon.b.smithi181.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-03-30T14:02:32.193 INFO:journalctl@ceph.mon.b.smithi181.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-03-30T14:02:32.193 INFO:journalctl@ceph.mon.b.smithi181.stdout: AddFile(Keys): cumulative 0, interval 0 2024-03-30T14:02:32.193 INFO:journalctl@ceph.mon.b.smithi181.stdout: Cumulative compaction: 0.00 GB write, 115.18 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-03-30T14:02:32.193 INFO:journalctl@ceph.mon.b.smithi181.stdout: Interval compaction: 0.00 GB write, 115.18 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-03-30T14:02:32.194 INFO:journalctl@ceph.mon.b.smithi181.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-03-30T14:02:32.194 INFO:journalctl@ceph.mon.b.smithi181.stdout: Block cache BinnedLRUCache@0x558ca4efd090#2 capacity: 512.00 MB usage: 6.11 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 1.1e-05 secs_since: 0 2024-03-30T14:02:32.194 INFO:journalctl@ceph.mon.b.smithi181.stdout: Block cache entry stats(count,size,portion): FilterBlock(1,2.03 KB,0.00038743%) IndexBlock(1,4.08 KB,0.000777841%) Misc(1,0.00 KB,0%) 2024-03-30T14:02:32.194 INFO:journalctl@ceph.mon.b.smithi181.stdout: 2024-03-30T14:02:32.194 INFO:journalctl@ceph.mon.b.smithi181.stdout: ** File Read Latency Histogram By Level [default] ** 2024-03-30T14:02:32.194 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:31 smithi181 ceph-mon[115276]: starting mon.b rank 2 at public addrs [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] at bind addrs [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon_data /var/lib/ceph/mon/ceph-b fsid 98ebaeb8-ee99-11ee-b647-cb9ed24678a4 2024-03-30T14:02:32.194 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:31 smithi181 ceph-mon[115276]: mon.b@-1(???) e3 preinit fsid 98ebaeb8-ee99-11ee-b647-cb9ed24678a4 2024-03-30T14:02:32.194 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:31 smithi181 ceph-mon[115276]: mon.b@-1(???).mds e1 new map 2024-03-30T14:02:32.194 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:31 smithi181 ceph-mon[115276]: mon.b@-1(???).mds e1 print_map 2024-03-30T14:02:32.194 INFO:journalctl@ceph.mon.b.smithi181.stdout: e1 2024-03-30T14:02:32.194 INFO:journalctl@ceph.mon.b.smithi181.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-03-30T14:02:32.194 INFO:journalctl@ceph.mon.b.smithi181.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-03-30T14:02:32.194 INFO:journalctl@ceph.mon.b.smithi181.stdout: legacy client fscid: -1 2024-03-30T14:02:32.194 INFO:journalctl@ceph.mon.b.smithi181.stdout: 2024-03-30T14:02:32.195 INFO:journalctl@ceph.mon.b.smithi181.stdout: No filesystems configured 2024-03-30T14:02:32.195 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:31 smithi181 ceph-mon[115276]: mon.b@-1(???).osd e112 crush map has features 3314933000854323200, adjusting msgr requires 2024-03-30T14:02:32.195 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:31 smithi181 ceph-mon[115276]: mon.b@-1(???).osd e112 crush map has features 432629239337189376, adjusting msgr requires 2024-03-30T14:02:32.195 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:31 smithi181 ceph-mon[115276]: mon.b@-1(???).osd e112 crush map has features 432629239337189376, adjusting msgr requires 2024-03-30T14:02:32.195 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:31 smithi181 ceph-mon[115276]: mon.b@-1(???).osd e112 crush map has features 432629239337189376, adjusting msgr requires 2024-03-30T14:02:32.195 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:31 smithi181 ceph-mon[115276]: mon.b@-1(???).paxosservice(auth 1..27) refresh upgraded, format 0 -> 3 2024-03-30T14:02:32.195 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:31 smithi181 bash[115257]: 0468ed087cdd924e714de865c81d64cccd9fd88310697053bba1f6bd75544474 2024-03-30T14:02:32.195 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:31 smithi181 systemd[1]: Started Ceph mon.b for 98ebaeb8-ee99-11ee-b647-cb9ed24678a4. 2024-03-30T14:02:33.499 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:33 smithi181 ceph-mon[115276]: pgmap v1715: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T14:02:33.499 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:33 smithi181 ceph-mon[115276]: from='client.15780 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T14:02:33.499 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:33 smithi181 ceph-mon[115276]: pgmap v1716: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T14:02:33.500 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:33 smithi181 ceph-mon[115276]: mon.b calling monitor election 2024-03-30T14:02:33.500 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:33 smithi181 ceph-mon[115276]: mon.c calling monitor election 2024-03-30T14:02:33.500 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:33 smithi181 ceph-mon[115276]: mon.a calling monitor election 2024-03-30T14:02:33.500 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:33 smithi181 ceph-mon[115276]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-03-30T14:02:33.500 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:33 smithi181 ceph-mon[115276]: monmap e3: 3 mons at {a=[v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0],b=[v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0],c=[v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0]} 2024-03-30T14:02:33.500 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:33 smithi181 ceph-mon[115276]: fsmap 2024-03-30T14:02:33.500 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:33 smithi181 ceph-mon[115276]: osdmap e112: 8 total, 8 up, 8 in 2024-03-30T14:02:33.500 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:33 smithi181 ceph-mon[115276]: mgrmap e44: y(active, since 4m), standbys: x 2024-03-30T14:02:33.500 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:33 smithi181 ceph-mon[115276]: overall HEALTH_OK 2024-03-30T14:02:33.500 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:33 smithi181 ceph-mon[115276]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:02:33.500 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:33 smithi181 ceph-mon[115276]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:02:33.500 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:33 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:02:33.500 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:33 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:02:33.500 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:33 smithi181 ceph-mon[115276]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:02:33.501 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:33 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:02:33.501 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:33 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:02:33.501 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:33 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:02:33.501 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:33 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:02:33.501 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:33 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:02:33.501 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:33 smithi181 ceph-mon[115276]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:02:33.501 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:33 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:02:33.501 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:33 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:02:33.501 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:33 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:02:33.501 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:33 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:02:33.501 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:33 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:02:33.501 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:33 smithi181 ceph-mon[115276]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:02:33.501 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:33 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:02:33.501 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:33 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:02:33.502 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:33 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:02:33.502 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:33 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:02:33.502 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:33 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:02:33.502 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:33 smithi181 ceph-mon[115276]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:02:33.502 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:33 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:02:33.502 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:33 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:02:33.502 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:33 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:02:33.503 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:33 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:02:33.503 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:33 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:02:33.503 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:33 smithi181 ceph-mon[115276]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:02:33.503 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:33 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:02:33.503 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:33 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:02:33.503 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:33 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:02:33.503 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:33 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:02:33.503 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:33 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:02:33.503 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:33 smithi181 ceph-mon[115276]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:02:33.503 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:33 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:02:33.503 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:33 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:02:33.503 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:33 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:02:33.503 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:33 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:02:33.503 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:33 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:02:33.504 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:33 smithi181 ceph-mon[115276]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:02:33.504 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:33 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:02:33.504 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:33 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:02:33.504 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:33 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:02:33.504 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:33 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:02:33.504 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:33 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:02:33.504 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:33 smithi181 ceph-mon[115276]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:02:33.504 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:33 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:02:33.504 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:33 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:02:33.504 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:33 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:02:33.504 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:33 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:02:33.504 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:33 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:02:33.504 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:33 smithi181 ceph-mon[115276]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:02:33.504 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:33 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:02:33.505 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:33 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:02:33.505 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:33 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:02:33.505 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:33 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:02:33.505 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:33 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:02:33.505 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:33 smithi181 ceph-mon[115276]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:02:33.505 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:33 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:02:33.505 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:33 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:02:33.505 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:33 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:02:33.505 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:33 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:02:33.505 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:33 smithi181 ceph-mon[115276]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:02:33.580 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:33 smithi099 ceph-mon[29691]: pgmap v1715: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T14:02:33.580 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:33 smithi099 ceph-mon[29691]: from='client.15780 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T14:02:33.580 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:33 smithi099 ceph-mon[29691]: pgmap v1716: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T14:02:33.580 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:33 smithi099 ceph-mon[29691]: mon.b calling monitor election 2024-03-30T14:02:33.580 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:33 smithi099 ceph-mon[29691]: mon.c calling monitor election 2024-03-30T14:02:33.580 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:33 smithi099 ceph-mon[29691]: mon.a calling monitor election 2024-03-30T14:02:33.580 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:33 smithi099 ceph-mon[29691]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-03-30T14:02:33.580 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:33 smithi099 ceph-mon[29691]: monmap e3: 3 mons at {a=[v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0],b=[v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0],c=[v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0]} 2024-03-30T14:02:33.581 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:33 smithi099 ceph-mon[29691]: fsmap 2024-03-30T14:02:33.581 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:33 smithi099 ceph-mon[29691]: osdmap e112: 8 total, 8 up, 8 in 2024-03-30T14:02:33.581 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:33 smithi099 ceph-mon[29691]: mgrmap e44: y(active, since 4m), standbys: x 2024-03-30T14:02:33.581 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:33 smithi099 ceph-mon[29691]: overall HEALTH_OK 2024-03-30T14:02:33.581 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:33 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:02:33.581 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:33 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:02:33.581 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:33 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:02:33.581 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:33 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:02:33.581 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:33 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:02:33.581 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:33 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:02:33.581 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:33 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:02:33.581 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:33 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:02:33.581 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:33 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:02:33.581 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:33 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:02:33.581 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:33 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:02:33.582 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:33 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:02:33.582 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:33 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:02:33.582 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:33 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:02:33.582 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:33 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:02:33.582 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:33 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:02:33.582 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:33 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:02:33.582 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:33 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:02:33.582 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:33 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:02:33.582 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:33 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:02:33.582 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:33 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:02:33.583 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:33 smithi099 ceph-mon[24912]: pgmap v1715: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T14:02:33.583 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:33 smithi099 ceph-mon[24912]: from='client.15780 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T14:02:33.583 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:33 smithi099 ceph-mon[24912]: pgmap v1716: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T14:02:33.583 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:33 smithi099 ceph-mon[24912]: mon.b calling monitor election 2024-03-30T14:02:33.583 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:33 smithi099 ceph-mon[24912]: mon.c calling monitor election 2024-03-30T14:02:33.583 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:33 smithi099 ceph-mon[24912]: mon.a calling monitor election 2024-03-30T14:02:33.583 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:33 smithi099 ceph-mon[24912]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-03-30T14:02:33.583 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:33 smithi099 ceph-mon[24912]: monmap e3: 3 mons at {a=[v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0],b=[v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0],c=[v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0]} 2024-03-30T14:02:33.583 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:33 smithi099 ceph-mon[24912]: fsmap 2024-03-30T14:02:33.583 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:33 smithi099 ceph-mon[24912]: osdmap e112: 8 total, 8 up, 8 in 2024-03-30T14:02:33.583 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:33 smithi099 ceph-mon[24912]: mgrmap e44: y(active, since 4m), standbys: x 2024-03-30T14:02:33.583 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:33 smithi099 ceph-mon[24912]: overall HEALTH_OK 2024-03-30T14:02:33.584 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:33 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:02:33.584 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:33 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:02:33.584 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:33 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:02:33.584 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:33 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:02:33.584 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:33 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:02:33.584 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:33 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:02:33.584 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:33 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:02:33.584 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:33 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:02:33.584 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:33 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:02:33.584 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:33 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:02:33.584 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:33 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:02:33.584 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:33 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:02:33.584 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:33 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:02:33.584 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:33 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:02:33.585 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:33 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:02:33.585 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:33 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:02:33.585 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:33 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:02:33.585 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:33 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:02:33.585 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:33 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:02:33.585 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:33 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:02:33.585 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:33 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:02:33.585 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:33 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:02:33.585 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:33 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:02:33.585 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:33 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:02:33.586 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:33 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:02:33.586 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:33 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:02:33.586 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:33 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:02:33.586 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:33 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:02:33.586 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:33 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:02:33.586 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:33 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:02:33.586 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:33 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:02:33.586 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:33 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:02:33.586 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:33 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:02:33.586 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:33 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:02:33.586 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:33 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:02:33.586 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:33 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:02:33.586 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:33 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:02:33.586 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:33 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:02:33.587 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:33 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:02:33.587 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:33 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:02:33.587 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:33 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:02:33.587 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:33 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:02:33.587 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:33 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:02:33.587 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:33 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:02:33.587 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:33 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:02:33.587 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:33 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:02:33.587 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:33 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:02:33.587 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:33 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:02:33.587 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:33 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:02:33.587 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:33 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:02:33.587 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:33 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:02:33.588 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:33 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:02:33.588 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:33 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:02:33.588 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:33 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:02:33.588 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:33 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:02:33.588 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:33 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:02:33.588 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:33 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:02:33.588 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:33 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:02:33.588 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:33 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:02:33.588 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:33 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:02:33.588 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:33 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:02:33.588 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:33 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:02:33.588 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:33 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:02:33.589 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:33 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:02:33.589 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:33 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:02:33.589 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:33 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:02:33.589 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:33 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:02:33.589 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:33 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:02:33.589 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:33 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:02:33.589 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:33 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:02:33.589 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:33 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:02:33.589 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:33 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:02:33.589 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:33 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:02:33.589 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:33 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:02:33.589 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:33 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:02:33.589 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:33 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:02:33.589 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:33 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:02:33.589 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:33 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:02:33.590 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:33 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:02:33.590 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:33 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:02:33.590 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:33 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:02:33.590 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:33 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:02:33.590 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:33 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:02:33.590 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:33 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:02:33.590 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:33 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:02:33.590 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:33 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:02:33.590 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:33 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:02:33.591 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:33 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:02:33.591 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:33 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:02:33.591 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:33 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:02:33.591 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:33 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:02:33.591 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:33 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:02:33.591 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:33 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:02:33.591 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:33 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:02:33.591 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:33 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:02:33.591 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:33 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:02:33.591 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:33 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:02:33.591 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:33 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:02:33.591 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:33 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:02:33.591 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:33 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:02:33.592 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:33 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:02:33.592 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:33 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:02:33.592 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:33 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:02:33.592 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:33 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:02:33.592 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:33 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:02:33.592 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:33 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:02:33.592 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:33 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:02:34.195 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:34 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:02:34.195 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:34 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:02:34.195 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:34 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:02:34.195 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:34 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:02:34.195 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:34 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:02:34.196 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:34 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:02:34.196 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:34 smithi181 ceph-mon[115276]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:02:34.196 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:34 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:02:34.196 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:34 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:02:34.196 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:34 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:02:34.196 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:34 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:02:34.196 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:34 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:02:34.196 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:34 smithi181 ceph-mon[115276]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:02:34.196 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:34 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:02:34.196 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:34 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:02:34.196 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:34 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:02:34.196 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:34 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:02:34.196 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:34 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:02:34.196 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:34 smithi181 ceph-mon[115276]: from='client.25136 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T14:02:34.196 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:34 smithi181 ceph-mon[115276]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:02:34.197 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:34 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:02:34.197 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:34 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:02:34.197 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:34 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:02:34.197 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:34 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:02:34.197 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:34 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:02:34.197 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:34 smithi181 ceph-mon[115276]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:02:34.197 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:34 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:02:34.197 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:34 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:02:34.197 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:34 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:02:34.197 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:34 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:02:34.197 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:34 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:02:34.197 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:34 smithi181 ceph-mon[115276]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:02:34.197 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:34 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:02:34.197 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:34 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:02:34.198 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:34 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:02:34.198 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:34 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:02:34.198 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:34 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:02:34.198 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:34 smithi181 ceph-mon[115276]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:02:34.198 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:34 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:02:34.198 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:34 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:02:34.198 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:34 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:02:34.198 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:34 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:02:34.198 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:34 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:02:34.198 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:34 smithi181 ceph-mon[115276]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:02:34.198 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:34 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:02:34.198 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:34 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:02:34.198 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:34 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:02:34.199 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:34 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:02:34.199 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:34 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:02:34.199 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:34 smithi181 ceph-mon[115276]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:02:34.199 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:34 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:02:34.199 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:34 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:02:34.199 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:34 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:02:34.199 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:34 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:02:34.199 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:34 smithi181 ceph-mon[115276]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:02:34.199 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:34 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:02:34.199 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:34 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:02:34.199 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:34 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:02:34.199 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:34 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:02:34.199 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:34 smithi181 ceph-mon[115276]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:02:34.580 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:34 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:02:34.580 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:34 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:02:34.580 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:34 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:02:34.580 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:34 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:02:34.580 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:34 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:02:34.580 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:34 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:02:34.581 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:34 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:02:34.581 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:34 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:02:34.581 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:34 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:02:34.581 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:34 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:02:34.581 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:34 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:02:34.581 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:34 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:02:34.581 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:34 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:02:34.581 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:34 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:02:34.581 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:34 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:02:34.581 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:34 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:02:34.581 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:34 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:02:34.581 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:34 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:02:34.581 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:34 smithi099 ceph-mon[24912]: from='client.25136 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T14:02:34.581 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:34 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:02:34.581 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:34 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:02:34.582 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:34 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:02:34.582 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:34 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:02:34.582 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:34 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:02:34.582 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:34 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:02:34.582 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:34 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:02:34.582 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:34 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:02:34.582 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:34 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:02:34.582 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:34 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:02:34.582 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:34 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:02:34.582 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:34 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:02:34.583 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:34 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:02:34.583 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:34 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:02:34.583 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:34 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:02:34.583 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:34 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:02:34.583 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:34 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:02:34.583 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:34 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:02:34.583 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:34 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:02:34.583 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:34 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:02:34.583 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:34 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:02:34.583 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:34 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:02:34.583 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:34 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:02:34.583 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:34 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:02:34.583 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:34 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:02:34.583 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:34 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:02:34.583 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:34 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:02:34.584 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:34 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:02:34.584 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:34 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:02:34.584 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:34 smithi099 ceph-mon[29691]: from='client.25136 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T14:02:34.584 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:34 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:02:34.584 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:34 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:02:34.584 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:34 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:02:34.584 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:34 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:02:34.584 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:34 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:02:34.584 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:34 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:02:34.584 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:34 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:02:34.584 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:34 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:02:34.585 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:34 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:02:34.585 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:34 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:02:34.585 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:34 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:02:34.585 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:34 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:02:34.585 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:34 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:02:34.585 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:34 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:02:34.585 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:34 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:02:34.585 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:34 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:02:34.585 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:34 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:02:34.585 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:34 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:02:34.586 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:34 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:02:34.586 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:34 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:02:34.586 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:34 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:02:34.586 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:34 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:02:34.586 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:34 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:02:34.586 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:34 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:02:34.586 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:34 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:02:34.586 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:34 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:02:34.586 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:34 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:02:34.586 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:34 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:02:34.586 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:34 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:02:34.586 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:34 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:02:34.586 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:34 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:02:34.586 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:34 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:02:34.586 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:34 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:02:34.587 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:34 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:02:34.587 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:34 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:02:34.587 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:34 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:02:34.587 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:34 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:02:34.587 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:34 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:02:34.587 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:34 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:02:34.587 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:34 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:02:34.587 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:34 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:02:34.587 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:34 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:02:34.587 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:34 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:02:34.587 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:34 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:02:34.587 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:34 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:02:34.587 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:34 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:02:34.588 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:34 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:02:34.588 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:34 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:02:34.588 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:34 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:02:34.588 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:34 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:02:34.588 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:34 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:02:34.588 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:34 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:02:34.588 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:34 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:02:34.588 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:34 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:02:34.588 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:34 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:02:34.588 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:34 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:02:34.588 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:34 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:02:34.588 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:34 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:02:34.588 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:34 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:02:34.588 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:34 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:02:34.589 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:34 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:02:34.589 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:34 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:02:34.589 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:34 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:02:34.589 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:34 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:02:34.589 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:34 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:02:34.589 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:34 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:02:34.589 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:34 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:02:34.589 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:34 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:02:34.589 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:34 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:02:34.589 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:34 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:02:34.589 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:34 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:02:35.080 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 14:02:34 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[71049]: ::ffff:172.21.15.181 - - [30/Mar/2024:14:02:34] "GET /metrics HTTP/1.1" 200 37993 "" "Prometheus/2.43.0" 2024-03-30T14:02:35.422 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:35 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:02:35.422 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:35 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:02:35.422 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:35 smithi181 ceph-mon[115276]: pgmap v1717: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T14:02:35.423 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:35 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:02:35.423 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:35 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:02:35.423 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:35 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:02:35.423 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:35 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:02:35.423 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:35 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:02:35.423 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:35 smithi181 ceph-mon[115276]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:02:35.423 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:35 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:02:35.423 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:35 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:02:35.423 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:35 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:02:35.423 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:35 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:02:35.423 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:35 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:02:35.423 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:35 smithi181 ceph-mon[115276]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:02:35.423 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:35 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:02:35.423 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:35 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:02:35.424 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:35 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:02:35.424 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:35 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:02:35.424 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:35 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:02:35.424 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:35 smithi181 ceph-mon[115276]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:02:35.424 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:35 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:02:35.424 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:35 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:02:35.424 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:35 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:02:35.424 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:35 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:02:35.424 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:35 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:02:35.424 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:35 smithi181 ceph-mon[115276]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:02:35.424 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:35 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:02:35.424 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:35 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:02:35.424 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:35 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:02:35.424 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:35 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:02:35.424 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:35 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:02:35.425 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:35 smithi181 ceph-mon[115276]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:02:35.425 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:35 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:02:35.425 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:35 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:02:35.425 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:35 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:02:35.425 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:35 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:02:35.425 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:35 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:02:35.425 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:35 smithi181 ceph-mon[115276]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:02:35.425 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:35 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:02:35.425 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:35 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:02:35.425 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:35 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:02:35.425 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:35 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:02:35.426 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:35 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:02:35.426 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:35 smithi181 ceph-mon[115276]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:02:35.426 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:35 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:02:35.426 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:35 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:02:35.426 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:35 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:02:35.426 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:35 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:02:35.426 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:35 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:02:35.426 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:35 smithi181 ceph-mon[115276]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:02:35.426 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:35 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:02:35.426 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:35 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:02:35.426 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:35 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:02:35.426 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:35 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:02:35.426 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:35 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:02:35.427 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:35 smithi181 ceph-mon[115276]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:02:35.427 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:35 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:02:35.427 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:35 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:02:35.427 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:35 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:02:35.427 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:35 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:02:35.427 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:35 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:02:35.427 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:35 smithi181 ceph-mon[115276]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:02:35.427 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:35 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:02:35.427 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:35 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:02:35.427 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:35 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:02:35.427 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:35 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:02:35.427 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:35 smithi181 ceph-mon[115276]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:02:35.427 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:35 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:02:35.428 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:35 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:02:35.428 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:35 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:02:35.428 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:35 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:02:35.428 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:35 smithi181 ceph-mon[115276]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:02:35.580 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:35 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:02:35.580 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:35 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:02:35.580 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:35 smithi099 ceph-mon[29691]: pgmap v1717: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T14:02:35.580 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:35 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:02:35.580 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:35 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:02:35.580 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:35 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:02:35.581 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:35 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:02:35.581 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:35 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:02:35.581 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:35 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:02:35.581 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:35 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:02:35.581 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:35 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:02:35.581 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:35 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:02:35.581 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:35 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:02:35.581 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:35 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:02:35.581 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:35 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:02:35.581 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:35 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:02:35.581 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:35 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:02:35.581 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:35 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:02:35.581 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:35 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:02:35.581 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:35 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:02:35.582 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:35 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:02:35.582 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:35 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:02:35.582 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:35 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:02:35.582 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:35 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:02:35.582 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:35 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:02:35.582 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:35 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:02:35.582 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:35 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:02:35.582 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:35 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:02:35.582 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:35 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:02:35.582 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:35 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:02:35.583 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:35 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:02:35.583 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:35 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:02:35.583 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:35 smithi099 ceph-mon[24912]: pgmap v1717: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T14:02:35.583 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:35 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:02:35.583 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:35 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:02:35.583 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:35 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:02:35.583 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:35 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:02:35.583 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:35 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:02:35.583 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:35 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:02:35.583 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:35 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:02:35.583 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:35 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:02:35.583 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:35 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:02:35.583 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:35 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:02:35.584 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:35 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:02:35.584 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:35 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:02:35.584 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:35 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:02:35.584 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:35 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:02:35.584 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:35 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:02:35.584 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:35 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:02:35.584 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:35 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:02:35.584 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:35 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:02:35.584 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:35 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:02:35.584 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:35 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:02:35.584 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:35 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:02:35.584 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:35 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:02:35.585 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:35 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:02:35.585 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:35 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:02:35.585 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:35 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:02:35.585 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:35 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:02:35.585 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:35 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:02:35.585 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:35 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:02:35.585 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:35 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:02:35.586 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:35 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:02:35.586 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:35 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:02:35.586 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:35 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:02:35.586 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:35 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:02:35.586 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:35 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:02:35.586 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:35 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:02:35.586 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:35 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:02:35.586 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:35 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:02:35.586 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:35 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:02:35.586 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:35 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:02:35.586 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:35 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:02:35.586 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:35 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:02:35.586 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:35 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:02:35.587 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:35 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:02:35.587 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:35 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:02:35.587 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:35 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:02:35.587 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:35 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:02:35.587 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:35 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:02:35.587 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:35 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:02:35.587 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:35 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:02:35.587 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:35 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:02:35.587 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:35 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:02:35.587 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:35 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:02:35.587 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:35 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:02:35.587 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:35 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:02:35.587 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:35 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:02:35.587 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:35 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:02:35.587 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:35 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:02:35.587 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:35 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:02:35.588 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:35 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:02:35.588 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:35 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:02:35.588 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:35 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:02:35.588 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:35 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:02:35.588 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:35 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:02:35.588 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:35 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:02:35.588 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:35 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:02:35.588 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:35 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:02:35.588 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:35 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:02:35.588 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:35 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:02:35.588 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:35 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:02:35.588 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:35 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:02:35.589 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:35 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:02:35.589 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:35 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:02:35.589 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:35 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:02:35.589 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:35 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:02:35.589 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:35 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:02:35.589 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:35 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:02:35.589 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:35 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:02:35.589 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:35 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:02:35.589 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:35 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:02:35.590 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:35 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:02:35.590 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:35 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:02:35.590 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:35 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:02:35.590 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:35 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:02:35.590 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:35 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:02:35.590 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:35 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:02:35.590 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:35 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:02:35.590 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:35 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:02:35.590 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:35 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:02:35.590 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:35 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:02:35.590 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:35 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:02:35.590 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:35 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:02:35.590 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:35 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:02:35.591 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:35 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:02:35.591 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:35 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:02:35.591 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:35 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:02:35.591 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:35 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:02:35.591 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:35 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:02:35.591 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:35 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:02:35.591 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:35 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:02:35.591 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:35 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:02:35.591 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:35 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:02:35.591 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:35 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:02:35.591 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:35 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:02:35.591 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:35 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:02:35.591 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:35 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:02:35.591 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:35 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:02:35.591 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:35 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:02:35.591 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:35 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:02:35.592 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:35 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:02:35.592 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:35 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:02:35.592 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:35 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:02:35.592 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:35 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:02:35.592 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:35 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:02:36.418 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:36 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:02:36.419 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:36 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:02:36.419 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:36 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:02:36.419 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:36 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:02:36.419 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:36 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:02:36.419 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:36 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:02:36.419 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:36 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:02:36.419 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:36 smithi181 ceph-mon[115276]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:02:36.419 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:36 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:02:36.419 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:36 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:02:36.419 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:36 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:02:36.419 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:36 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:02:36.419 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:36 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:02:36.420 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:36 smithi181 ceph-mon[115276]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:02:36.420 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:36 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:02:36.420 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:36 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:02:36.420 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:36 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:02:36.420 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:36 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:02:36.420 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:36 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:02:36.420 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:36 smithi181 ceph-mon[115276]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:02:36.420 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:36 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:02:36.420 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:36 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:02:36.420 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:36 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:02:36.420 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:36 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:02:36.420 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:36 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:02:36.420 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:36 smithi181 ceph-mon[115276]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:02:36.420 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:36 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:02:36.420 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:36 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:02:36.421 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:36 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:02:36.421 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:36 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:02:36.421 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:36 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:02:36.421 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:36 smithi181 ceph-mon[115276]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:02:36.421 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:36 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:02:36.421 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:36 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:02:36.421 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:36 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:02:36.421 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:36 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:02:36.421 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:36 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:02:36.421 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:36 smithi181 ceph-mon[115276]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:02:36.421 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:36 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:02:36.421 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:36 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:02:36.421 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:36 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:02:36.421 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:36 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:02:36.422 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:36 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:02:36.422 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:36 smithi181 ceph-mon[115276]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:02:36.422 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:36 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:02:36.422 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:36 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:02:36.422 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:36 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:02:36.422 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:36 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:02:36.422 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:36 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:02:36.422 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:36 smithi181 ceph-mon[115276]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:02:36.422 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:36 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:02:36.422 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:36 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:02:36.422 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:36 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:02:36.422 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:36 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:02:36.423 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:36 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:02:36.423 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:36 smithi181 ceph-mon[115276]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:02:36.423 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:36 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:02:36.423 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:36 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:02:36.423 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:36 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:02:36.423 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:36 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:02:36.423 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:36 smithi181 ceph-mon[115276]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:02:36.580 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:36 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:02:36.580 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:36 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:02:36.580 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:36 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:02:36.580 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:36 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:02:36.581 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:36 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:02:36.581 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:36 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:02:36.581 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:36 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:02:36.581 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:36 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:02:36.581 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:36 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:02:36.581 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:36 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:02:36.581 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:36 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:02:36.581 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:36 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:02:36.581 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:36 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:02:36.582 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:36 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:02:36.582 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:36 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:02:36.582 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:36 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:02:36.582 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:36 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:02:36.582 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:36 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:02:36.582 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:36 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:02:36.582 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:36 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:02:36.582 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:36 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:02:36.582 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:36 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:02:36.582 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:36 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:02:36.582 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:36 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:02:36.582 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:36 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:02:36.582 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:36 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:02:36.582 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:36 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:02:36.583 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:36 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:02:36.583 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:36 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:02:36.583 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:36 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:02:36.583 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:36 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:02:36.583 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:36 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:02:36.583 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:36 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:02:36.583 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:36 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:02:36.583 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:36 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:02:36.583 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:36 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:02:36.583 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:36 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:02:36.583 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:36 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:02:36.584 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:36 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:02:36.584 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:36 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:02:36.584 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:36 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:02:36.584 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:36 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:02:36.584 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:36 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:02:36.584 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:36 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:02:36.584 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:36 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:02:36.584 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:36 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:02:36.584 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:36 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:02:36.584 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:36 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:02:36.584 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:36 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:02:36.584 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:36 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:02:36.585 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:36 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:02:36.585 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:36 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:02:36.585 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:36 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:02:36.585 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:36 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:02:36.585 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:36 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:02:36.585 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:36 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:02:36.585 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:36 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:02:36.585 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:36 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:02:36.585 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:36 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:02:36.585 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:36 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:02:36.586 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:36 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:02:36.586 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:36 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:02:36.586 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:36 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:02:36.586 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:36 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:02:36.586 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:36 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:02:36.586 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:36 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:02:36.586 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:36 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:02:36.586 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:36 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:02:36.587 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:36 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:02:36.587 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:36 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:02:36.587 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:36 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:02:36.587 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:36 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:02:36.587 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:36 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:02:36.587 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:36 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:02:36.587 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:36 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:02:36.587 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:36 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:02:36.587 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:36 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:02:36.587 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:36 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:02:36.587 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:36 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:02:36.587 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:36 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:02:36.588 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:36 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:02:36.588 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:36 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:02:36.588 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:36 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:02:36.588 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:36 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:02:36.588 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:36 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:02:36.588 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:36 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:02:36.588 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:36 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:02:36.588 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:36 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:02:36.588 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:36 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:02:36.588 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:36 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:02:36.588 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:36 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:02:36.589 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:36 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:02:36.589 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:36 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:02:36.589 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:36 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:02:36.589 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:36 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:02:36.589 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:36 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:02:36.589 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:36 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:02:36.589 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:36 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:02:36.589 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:36 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:02:36.589 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:36 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:02:36.589 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:36 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:02:36.589 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:36 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:02:36.589 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:36 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:02:36.589 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:36 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:02:36.590 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:36 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:02:36.590 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:36 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:02:36.590 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:36 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:02:36.590 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:36 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:02:36.590 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:36 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:02:36.590 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:36 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:02:36.590 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:36 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:02:36.590 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:36 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:02:36.591 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:36 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:02:36.591 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:36 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:02:36.591 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:36 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:02:36.591 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:36 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:02:36.591 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:36 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:02:36.591 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:36 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:02:36.591 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:36 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:02:36.591 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:36 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:02:36.591 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:36 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:02:36.591 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:36 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:02:37.329 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 14:02:36 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[71049]: 2024-03-30T14:02:36.946+0000 7f5f811dd700 -1 mgr.server handle_report got status from non-daemon mon.b 2024-03-30T14:02:37.330 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:37 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:02:37.330 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:37 smithi099 ceph-mon[24912]: pgmap v1718: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T14:02:37.330 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:37 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:02:37.330 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:37 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:02:37.330 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:37 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:02:37.330 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:37 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:02:37.330 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:37 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:02:37.331 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:37 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:02:37.331 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:37 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:02:37.331 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:37 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:02:37.331 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:37 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:02:37.331 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:37 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:02:37.331 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:37 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:02:37.331 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:37 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:02:37.331 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:37 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:02:37.331 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:37 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:02:37.331 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:37 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:02:37.331 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:37 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:02:37.331 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:37 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:02:37.331 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:37 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:02:37.331 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:37 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:02:37.331 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:37 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:02:37.332 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:37 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:02:37.332 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:37 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:02:37.332 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:37 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:02:37.332 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:37 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:02:37.332 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:37 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:02:37.332 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:37 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:02:37.332 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:37 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:02:37.332 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:37 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:02:37.332 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:37 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:02:37.332 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:37 smithi099 ceph-mon[29691]: pgmap v1718: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T14:02:37.333 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:37 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:02:37.333 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:37 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:02:37.333 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:37 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:02:37.333 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:37 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:02:37.333 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:37 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:02:37.333 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:37 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:02:37.333 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:37 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:02:37.333 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:37 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:02:37.333 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:37 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:02:37.333 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:37 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:02:37.333 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:37 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:02:37.333 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:37 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:02:37.333 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:37 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:02:37.333 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:37 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:02:37.333 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:37 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:02:37.334 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:37 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:02:37.334 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:37 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:02:37.334 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:37 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:02:37.334 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:37 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:02:37.334 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:37 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:02:37.334 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:37 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:02:37.334 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:37 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:02:37.334 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:37 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:02:37.334 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:37 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:02:37.334 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:37 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:02:37.334 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:37 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:02:37.335 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:37 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:02:37.335 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:37 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:02:37.335 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:37 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:02:37.335 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:37 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:02:37.335 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:37 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:02:37.335 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:37 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:02:37.335 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:37 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:02:37.335 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:37 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:02:37.336 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:37 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:02:37.336 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:37 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:02:37.336 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:37 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:02:37.336 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:37 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:02:37.336 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:37 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:02:37.336 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:37 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:02:37.336 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:37 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:02:37.336 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:37 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:02:37.336 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:37 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:02:37.336 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:37 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:02:37.337 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:37 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:02:37.337 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:37 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:02:37.337 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:37 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:02:37.337 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:37 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:02:37.337 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:37 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:02:37.337 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:37 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:02:37.337 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:37 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:02:37.337 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:37 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:02:37.337 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:37 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:02:37.337 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:37 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:02:37.337 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:37 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:02:37.337 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:37 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:02:37.337 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:37 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:02:37.337 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:37 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:02:37.337 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:37 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:02:37.338 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:37 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:02:37.338 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:37 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:02:37.338 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:37 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:02:37.338 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:37 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:02:37.338 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:37 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:02:37.338 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:37 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:02:37.338 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:37 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:02:37.338 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:37 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:02:37.338 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:37 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:02:37.338 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:37 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:02:37.338 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:37 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:02:37.338 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:37 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:02:37.339 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:37 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:02:37.339 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:37 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:02:37.339 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:37 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:02:37.339 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:37 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:02:37.339 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:37 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:02:37.340 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:37 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:02:37.340 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:37 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:02:37.340 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:37 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:02:37.340 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:37 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:02:37.340 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:37 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:02:37.340 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:37 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:02:37.340 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:37 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:02:37.340 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:37 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:02:37.340 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:37 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:02:37.340 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:37 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:02:37.340 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:37 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:02:37.340 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:37 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:02:37.340 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:37 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:02:37.340 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:37 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:02:37.340 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:37 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:02:37.341 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:37 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:02:37.341 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:37 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:02:37.341 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:37 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:02:37.341 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:37 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:02:37.341 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:37 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:02:37.341 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:37 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:02:37.341 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:37 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:02:37.341 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:37 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:02:37.341 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:37 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:02:37.341 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:37 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:02:37.341 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:37 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:02:37.341 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:37 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:02:37.341 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:37 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:02:37.341 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:37 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:02:37.342 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:37 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:02:37.342 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:37 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:02:37.342 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:37 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:02:37.342 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:37 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:02:37.342 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:37 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:02:37.342 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:37 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:02:37.342 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:37 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:02:37.342 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:37 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:02:37.342 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:37 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:02:37.499 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:37 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:02:37.500 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:37 smithi181 ceph-mon[115276]: pgmap v1718: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T14:02:37.500 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:37 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:02:37.500 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:37 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:02:37.500 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:37 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:02:37.500 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:37 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:02:37.500 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:37 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:02:37.500 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:37 smithi181 ceph-mon[115276]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:02:37.500 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:37 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:02:37.500 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:37 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:02:37.500 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:37 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:02:37.500 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:37 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:02:37.500 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:37 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:02:37.501 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:37 smithi181 ceph-mon[115276]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:02:37.501 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:37 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:02:37.501 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:37 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:02:37.501 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:37 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:02:37.501 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:37 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:02:37.501 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:37 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:02:37.501 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:37 smithi181 ceph-mon[115276]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:02:37.501 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:37 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:02:37.501 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:37 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:02:37.501 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:37 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:02:37.501 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:37 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:02:37.501 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:37 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:02:37.501 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:37 smithi181 ceph-mon[115276]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:02:37.501 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:37 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:02:37.501 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:37 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:02:37.501 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:37 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:02:37.502 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:37 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:02:37.502 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:37 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:02:37.502 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:37 smithi181 ceph-mon[115276]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:02:37.502 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:37 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:02:37.502 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:37 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:02:37.502 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:37 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:02:37.502 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:37 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:02:37.502 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:37 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:02:37.502 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:37 smithi181 ceph-mon[115276]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:02:37.502 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:37 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:02:37.502 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:37 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:02:37.502 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:37 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:02:37.502 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:37 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:02:37.502 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:37 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:02:37.503 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:37 smithi181 ceph-mon[115276]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:02:37.503 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:37 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:02:37.503 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:37 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:02:37.503 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:37 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:02:37.503 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:37 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:02:37.503 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:37 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:02:37.503 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:37 smithi181 ceph-mon[115276]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:02:37.503 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:37 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:02:37.503 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:37 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:02:37.503 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:37 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:02:37.503 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:37 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:02:37.503 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:37 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:02:37.503 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:37 smithi181 ceph-mon[115276]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:02:37.503 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:37 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:02:37.503 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:37 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:02:37.504 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:37 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:02:37.504 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:37 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:02:37.504 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:37 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:02:37.504 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:37 smithi181 ceph-mon[115276]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:02:37.504 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:37 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:02:37.504 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:37 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:02:37.504 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:37 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:02:37.504 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:37 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:02:37.504 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:37 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:02:37.504 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:37 smithi181 ceph-mon[115276]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:02:37.504 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:37 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:02:37.504 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:37 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:02:37.504 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:37 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:02:37.504 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:37 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:02:37.505 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:37 smithi181 ceph-mon[115276]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:02:38.499 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:38 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:02:38.500 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:38 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:02:38.500 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:38 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:02:38.500 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:38 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:02:38.500 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:38 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:02:38.500 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:38 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:02:38.500 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:38 smithi181 ceph-mon[115276]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:02:38.500 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:38 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:02:38.500 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:38 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:02:38.500 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:38 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:02:38.500 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:38 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:02:38.500 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:38 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:02:38.500 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:38 smithi181 ceph-mon[115276]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:02:38.500 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:38 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:02:38.500 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:38 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:02:38.501 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:38 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:02:38.501 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:38 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:02:38.501 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:38 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:02:38.501 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:38 smithi181 ceph-mon[115276]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:02:38.501 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:38 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:02:38.501 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:38 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:02:38.501 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:38 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:02:38.501 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:38 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:02:38.501 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:38 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:02:38.501 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:38 smithi181 ceph-mon[115276]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:02:38.501 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:38 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:02:38.501 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:38 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:02:38.501 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:38 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:02:38.501 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:38 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:02:38.501 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:38 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:02:38.502 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:38 smithi181 ceph-mon[115276]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:02:38.502 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:38 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:02:38.502 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:38 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:02:38.502 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:38 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:02:38.502 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:38 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:02:38.502 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:38 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:02:38.502 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:38 smithi181 ceph-mon[115276]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:02:38.502 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:38 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:02:38.502 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:38 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:02:38.502 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:38 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:02:38.502 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:38 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:02:38.502 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:38 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:02:38.502 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:38 smithi181 ceph-mon[115276]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:02:38.503 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:38 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:02:38.503 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:38 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:02:38.503 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:38 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:02:38.503 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:38 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:02:38.503 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:38 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:02:38.503 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:38 smithi181 ceph-mon[115276]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:02:38.503 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:38 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:02:38.503 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:38 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:02:38.503 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:38 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:02:38.503 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:38 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:02:38.503 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:38 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:02:38.503 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:38 smithi181 ceph-mon[115276]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:02:38.503 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:38 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:02:38.503 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:38 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:02:38.503 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:38 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:02:38.503 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:38 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:02:38.504 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:38 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:02:38.504 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:38 smithi181 ceph-mon[115276]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:02:38.504 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:38 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:02:38.504 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:38 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:02:38.504 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:38 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:02:38.504 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:38 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:02:38.504 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:38 smithi181 ceph-mon[115276]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:02:38.504 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:38 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:02:38.504 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:38 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:02:38.504 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:38 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:02:38.504 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:38 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:02:38.504 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:38 smithi181 ceph-mon[115276]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:02:38.580 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:38 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:02:38.580 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:38 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:02:38.580 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:38 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:02:38.580 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:38 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:02:38.581 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:38 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:02:38.581 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:38 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:02:38.581 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:38 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:02:38.581 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:38 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:02:38.581 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:38 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:02:38.581 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:38 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:02:38.581 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:38 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:02:38.581 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:38 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:02:38.581 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:38 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:02:38.581 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:38 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:02:38.581 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:38 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:02:38.581 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:38 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:02:38.581 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:38 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:02:38.581 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:38 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:02:38.581 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:38 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:02:38.582 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:38 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:02:38.582 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:38 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:02:38.582 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:38 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:02:38.582 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:38 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:02:38.582 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:38 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:02:38.582 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:38 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:02:38.582 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:38 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:02:38.582 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:38 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:02:38.582 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:38 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:02:38.582 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:38 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:02:38.582 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:38 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:02:38.583 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:38 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:02:38.583 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:38 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:02:38.583 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:38 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:02:38.583 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:38 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:02:38.583 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:38 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:02:38.583 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:38 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:02:38.583 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:38 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:02:38.583 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:38 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:02:38.583 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:38 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:02:38.583 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:38 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:02:38.583 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:38 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:02:38.584 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:38 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:02:38.584 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:38 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:02:38.584 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:38 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:02:38.584 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:38 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:02:38.584 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:38 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:02:38.584 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:38 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:02:38.584 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:38 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:02:38.584 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:38 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:02:38.584 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:38 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:02:38.584 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:38 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:02:38.584 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:38 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:02:38.584 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:38 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:02:38.584 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:38 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:02:38.584 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:38 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:02:38.584 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:38 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:02:38.585 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:38 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:02:38.585 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:38 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:02:38.585 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:38 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:02:38.585 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:38 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:02:38.585 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:38 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:02:38.585 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:38 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:02:38.585 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:38 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:02:38.585 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:38 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:02:38.585 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:38 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:02:38.585 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:38 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:02:38.585 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:38 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:02:38.585 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:38 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:02:38.585 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:38 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:02:38.585 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:38 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:02:38.585 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:38 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:02:38.586 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:38 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:02:38.586 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:38 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:02:38.586 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:38 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:02:38.586 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:38 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:02:38.586 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:38 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:02:38.586 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:38 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:02:38.587 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:38 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:02:38.587 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:38 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:02:38.587 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:38 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:02:38.587 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:38 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:02:38.587 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:38 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:02:38.587 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:38 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:02:38.587 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:38 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:02:38.587 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:38 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:02:38.587 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:38 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:02:38.587 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:38 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:02:38.588 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:38 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:02:38.588 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:38 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:02:38.588 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:38 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:02:38.588 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:38 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:02:38.588 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:38 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:02:38.588 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:38 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:02:38.588 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:38 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:02:38.588 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:38 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:02:38.588 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:38 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:02:38.589 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:38 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:02:38.589 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:38 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:02:38.589 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:38 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:02:38.589 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:38 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:02:38.589 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:38 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:02:38.589 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:38 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:02:38.589 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:38 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:02:38.589 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:38 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:02:38.589 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:38 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:02:38.589 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:38 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:02:38.589 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:38 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:02:38.589 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:38 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:02:38.589 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:38 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:02:38.589 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:38 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:02:38.590 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:38 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:02:38.590 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:38 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:02:38.590 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:38 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:02:38.590 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:38 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:02:38.590 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:38 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:02:38.590 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:38 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:02:38.590 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:38 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:02:38.590 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:38 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:02:38.590 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:38 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:02:38.590 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:38 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:02:38.590 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:38 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:02:38.591 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:38 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:02:38.591 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:38 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:02:38.591 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:38 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:02:38.591 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:38 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:02:38.591 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:38 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:02:38.591 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:38 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:02:38.591 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:38 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:02:38.591 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:38 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:02:38.591 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:38 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:02:38.591 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:38 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:02:38.591 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:38 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:02:38.591 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:38 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:02:38.592 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:38 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:02:38.592 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:38 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:02:38.592 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:38 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:02:38.592 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:38 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:02:38.592 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:38 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:02:38.592 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:38 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:02:38.592 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:38 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:02:38.592 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:38 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:02:38.592 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:38 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:02:39.499 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:39 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:02:39.500 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:39 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:02:39.500 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:39 smithi181 ceph-mon[115276]: pgmap v1719: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T14:02:39.500 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:39 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:02:39.500 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:39 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:02:39.500 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:39 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:02:39.501 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:39 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:02:39.501 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:39 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:02:39.501 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:39 smithi181 ceph-mon[115276]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:02:39.501 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:39 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:02:39.501 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:39 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:02:39.501 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:39 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:02:39.502 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:39 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:02:39.502 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:39 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:02:39.502 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:39 smithi181 ceph-mon[115276]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:02:39.502 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:39 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:02:39.502 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:39 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:02:39.502 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:39 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:02:39.503 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:39 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:02:39.503 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:39 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:02:39.503 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:39 smithi181 ceph-mon[115276]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:02:39.503 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:39 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:02:39.503 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:39 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:02:39.503 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:39 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:02:39.504 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:39 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:02:39.504 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:39 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:02:39.504 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:39 smithi181 ceph-mon[115276]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:02:39.504 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:39 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:02:39.504 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:39 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:02:39.504 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:39 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:02:39.504 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:39 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:02:39.505 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:39 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:02:39.505 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:39 smithi181 ceph-mon[115276]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:02:39.505 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:39 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:02:39.505 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:39 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:02:39.505 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:39 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:02:39.505 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:39 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:02:39.506 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:39 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:02:39.506 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:39 smithi181 ceph-mon[115276]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:02:39.506 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:39 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:02:39.506 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:39 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:02:39.506 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:39 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:02:39.507 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:39 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:02:39.507 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:39 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:02:39.507 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:39 smithi181 ceph-mon[115276]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:02:39.507 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:39 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:02:39.507 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:39 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:02:39.507 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:39 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:02:39.508 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:39 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:02:39.508 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:39 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:02:39.508 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:39 smithi181 ceph-mon[115276]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:02:39.508 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:39 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:02:39.508 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:39 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:02:39.508 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:39 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:02:39.509 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:39 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:02:39.509 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:39 smithi181 ceph-mon[115276]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:02:39.581 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:39 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:02:39.581 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:39 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:02:39.581 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:39 smithi099 ceph-mon[29691]: pgmap v1719: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T14:02:39.581 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:39 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:02:39.581 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:39 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:02:39.582 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:39 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:02:39.582 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:39 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:02:39.582 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:39 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:02:39.582 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:39 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:02:39.582 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:39 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:02:39.582 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:39 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:02:39.583 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:39 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:02:39.583 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:39 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:02:39.583 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:39 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:02:39.583 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:39 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:02:39.583 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:39 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:02:39.583 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:39 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:02:39.584 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:39 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:02:39.584 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:39 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:02:39.584 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:39 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:02:39.584 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:39 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:02:39.584 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:39 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:02:39.584 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:39 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:02:39.585 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:39 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:02:39.585 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:39 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:02:39.585 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:39 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:02:39.585 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:39 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:02:39.585 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:39 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:02:39.585 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:39 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:02:39.586 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:39 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:02:39.586 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:39 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:02:39.586 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:39 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:02:39.586 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:39 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:02:39.586 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:39 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:02:39.586 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:39 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:02:39.586 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:39 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:02:39.587 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:39 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:02:39.587 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:39 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:02:39.587 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:39 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:02:39.587 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:39 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:02:39.587 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:39 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:02:39.588 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:39 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:02:39.588 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:39 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:02:39.588 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:39 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:02:39.588 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:39 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:02:39.588 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:39 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:02:39.588 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:39 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:02:39.589 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:39 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:02:39.589 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:39 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:02:39.589 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:39 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:02:39.589 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:39 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:02:39.589 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:39 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:02:39.589 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:39 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:02:39.589 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:39 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:02:39.590 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:39 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:02:39.590 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:39 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:02:39.590 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:39 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:02:39.591 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:39 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:02:39.591 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:39 smithi099 ceph-mon[24912]: pgmap v1719: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T14:02:39.591 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:39 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:02:39.591 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:39 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:02:39.591 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:39 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:02:39.592 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:39 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:02:39.592 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:39 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:02:39.592 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:39 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:02:39.592 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:39 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:02:39.592 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:39 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:02:39.592 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:39 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:02:39.593 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:39 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:02:39.593 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:39 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:02:39.593 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:39 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:02:39.593 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:39 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:02:39.593 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:39 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:02:39.593 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:39 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:02:39.594 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:39 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:02:39.594 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:39 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:02:39.594 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:39 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:02:39.595 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:39 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:02:39.595 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:39 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:02:39.595 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:39 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:02:39.595 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:39 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:02:39.595 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:39 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:02:39.595 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:39 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:02:39.596 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:39 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:02:39.596 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:39 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:02:39.596 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:39 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:02:39.596 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:39 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:02:39.596 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:39 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:02:39.596 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:39 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:02:39.597 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:39 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:02:39.597 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:39 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:02:39.597 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:39 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:02:39.597 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:39 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:02:39.597 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:39 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:02:39.597 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:39 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:02:39.597 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:39 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:02:39.598 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:39 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:02:39.598 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:39 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:02:39.598 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:39 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:02:39.598 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:39 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:02:39.598 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:39 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:02:39.598 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:39 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:02:39.599 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:39 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:02:39.599 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:39 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:02:39.599 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:39 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:02:39.599 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:39 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:02:39.599 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:39 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:02:39.599 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:39 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:02:39.599 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:39 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:02:39.599 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:39 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:02:39.599 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:39 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:02:39.599 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:39 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:02:40.499 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:40 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:02:40.499 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:40 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:02:40.499 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:40 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:02:40.499 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:40 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:02:40.499 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:40 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:02:40.500 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:40 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:02:40.500 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:40 smithi181 ceph-mon[115276]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:02:40.500 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:40 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:02:40.500 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:40 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:02:40.500 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:40 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:02:40.500 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:40 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:02:40.500 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:40 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:02:40.500 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:40 smithi181 ceph-mon[115276]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:02:40.500 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:40 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:02:40.500 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:40 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:02:40.500 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:40 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:02:40.500 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:40 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:02:40.500 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:40 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:02:40.500 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:40 smithi181 ceph-mon[115276]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:02:40.501 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:40 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:02:40.501 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:40 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:02:40.501 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:40 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:02:40.501 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:40 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:02:40.501 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:40 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:02:40.501 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:40 smithi181 ceph-mon[115276]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:02:40.501 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:40 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:02:40.501 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:40 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:02:40.501 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:40 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:02:40.501 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:40 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:02:40.501 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:40 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:02:40.501 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:40 smithi181 ceph-mon[115276]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:02:40.501 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:40 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:02:40.501 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:40 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:02:40.502 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:40 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:02:40.502 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:40 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:02:40.502 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:40 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:02:40.502 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:40 smithi181 ceph-mon[115276]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:02:40.502 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:40 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:02:40.502 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:40 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:02:40.502 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:40 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:02:40.502 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:40 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:02:40.502 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:40 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:02:40.502 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:40 smithi181 ceph-mon[115276]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:02:40.502 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:40 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:02:40.502 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:40 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:02:40.502 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:40 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:02:40.502 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:40 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:02:40.503 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:40 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:02:40.503 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:40 smithi181 ceph-mon[115276]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:02:40.503 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:40 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:02:40.503 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:40 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:02:40.503 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:40 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:02:40.503 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:40 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:02:40.503 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:40 smithi181 ceph-mon[115276]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:02:40.503 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:40 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:02:40.503 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:40 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:02:40.503 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:40 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:02:40.503 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:40 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:02:40.503 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:40 smithi181 ceph-mon[115276]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:02:40.582 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:40 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:02:40.582 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:40 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:02:40.583 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:40 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:02:40.583 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:40 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:02:40.583 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:40 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:02:40.583 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:40 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:02:40.583 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:40 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:02:40.583 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:40 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:02:40.583 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:40 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:02:40.583 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:40 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:02:40.583 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:40 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:02:40.583 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:40 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:02:40.583 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:40 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:02:40.583 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:40 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:02:40.583 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:40 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:02:40.583 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:40 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:02:40.583 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:40 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:02:40.584 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:40 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:02:40.584 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:40 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:02:40.584 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:40 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:02:40.584 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:40 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:02:40.584 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:40 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:02:40.584 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:40 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:02:40.584 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:40 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:02:40.584 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:40 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:02:40.584 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:40 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:02:40.584 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:40 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:02:40.584 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:40 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:02:40.584 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:40 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:02:40.584 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:40 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:02:40.585 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:40 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:02:40.585 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:40 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:02:40.585 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:40 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:02:40.585 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:40 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:02:40.585 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:40 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:02:40.585 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:40 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:02:40.585 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:40 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:02:40.585 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:40 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:02:40.585 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:40 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:02:40.585 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:40 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:02:40.585 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:40 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:02:40.585 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:40 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:02:40.585 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:40 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:02:40.586 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:40 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:02:40.586 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:40 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:02:40.586 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:40 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:02:40.586 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:40 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:02:40.586 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:40 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:02:40.586 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:40 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:02:40.586 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:40 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:02:40.586 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:40 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:02:40.586 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:40 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:02:40.587 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:40 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:02:40.587 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:40 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:02:40.587 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:40 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:02:40.587 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:40 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:02:40.587 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:40 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:02:40.587 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:40 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:02:40.587 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:40 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:02:40.588 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:40 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:02:40.588 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:40 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:02:40.588 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:40 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:02:40.588 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:40 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:02:40.588 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:40 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:02:40.588 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:40 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:02:40.588 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:40 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:02:40.588 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:40 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:02:40.588 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:40 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:02:40.589 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:40 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:02:40.589 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:40 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:02:40.589 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:40 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:02:40.589 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:40 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:02:40.589 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:40 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:02:40.589 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:40 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:02:40.589 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:40 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:02:40.589 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:40 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:02:40.589 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:40 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:02:40.589 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:40 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:02:40.589 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:40 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:02:40.589 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:40 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:02:40.589 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:40 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:02:40.589 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:40 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:02:40.589 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:40 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:02:40.590 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:40 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:02:40.590 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:40 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:02:40.590 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:40 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:02:40.590 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:40 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:02:40.590 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:40 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:02:40.590 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:40 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:02:40.590 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:40 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:02:40.590 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:40 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:02:40.590 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:40 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:02:40.590 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:40 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:02:40.590 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:40 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:02:40.590 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:40 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:02:40.590 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:40 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:02:40.591 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:40 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:02:40.591 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:40 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:02:40.591 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:40 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:02:40.591 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:40 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:02:40.591 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:40 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:02:40.591 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:40 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:02:40.591 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:40 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:02:40.591 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:40 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:02:40.591 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:40 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:02:40.591 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:40 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:02:40.591 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:40 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:02:40.591 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:40 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:02:40.591 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:40 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:02:40.591 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:40 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:02:40.591 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:40 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:02:40.592 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:40 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:02:40.592 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:40 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:02:40.592 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:40 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:02:40.592 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:40 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:02:40.592 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:40 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:02:40.592 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:40 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:02:40.592 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:40 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:02:41.249 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:41 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:02:41.249 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:41 smithi181 ceph-mon[115276]: pgmap v1720: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T14:02:41.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:41 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:02:41.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:41 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:02:41.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:41 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:02:41.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:41 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:02:41.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:41 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:02:41.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:41 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:02:41.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:41 smithi181 ceph-mon[115276]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:02:41.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:41 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:02:41.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:41 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:02:41.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:41 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:02:41.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:41 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:02:41.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:41 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:02:41.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:41 smithi181 ceph-mon[115276]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:02:41.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:41 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:02:41.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:41 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:02:41.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:41 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:02:41.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:41 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:02:41.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:41 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:02:41.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:41 smithi181 ceph-mon[115276]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:02:41.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:41 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:02:41.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:41 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:02:41.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:41 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:02:41.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:41 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:02:41.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:41 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:02:41.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:41 smithi181 ceph-mon[115276]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:02:41.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:41 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:02:41.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:41 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:02:41.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:41 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:02:41.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:41 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:02:41.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:41 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:02:41.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:41 smithi181 ceph-mon[115276]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:02:41.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:41 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:02:41.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:41 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:02:41.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:41 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:02:41.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:41 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:02:41.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:41 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:02:41.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:41 smithi181 ceph-mon[115276]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:02:41.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:41 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:02:41.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:41 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:02:41.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:41 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:02:41.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:41 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:02:41.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:41 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:02:41.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:41 smithi181 ceph-mon[115276]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:02:41.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:41 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:02:41.253 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:41 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:02:41.253 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:41 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:02:41.253 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:41 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:02:41.253 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:41 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:02:41.253 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:41 smithi181 ceph-mon[115276]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:02:41.253 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:41 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:02:41.253 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:41 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:02:41.253 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:41 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:02:41.253 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:41 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:02:41.253 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:41 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:02:41.253 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:41 smithi181 ceph-mon[115276]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:02:41.253 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:41 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:02:41.253 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:41 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:02:41.253 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:41 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:02:41.253 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:41 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:02:41.254 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:41 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:02:41.254 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:41 smithi181 ceph-mon[115276]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:02:41.254 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:41 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:02:41.254 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:41 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:02:41.254 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:41 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:02:41.254 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:41 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:02:41.254 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:41 smithi181 ceph-mon[115276]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:02:41.254 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:41 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:02:41.254 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:41 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:02:41.254 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:41 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:02:41.254 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:41 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:02:41.254 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:41 smithi181 ceph-mon[115276]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:02:41.486 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:41 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:02:41.486 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:41 smithi099 ceph-mon[24912]: pgmap v1720: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T14:02:41.486 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:41 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:02:41.486 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:41 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:02:41.486 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:41 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:02:41.486 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:41 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:02:41.486 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:41 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:02:41.486 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:41 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:02:41.487 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:41 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:02:41.487 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:41 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:02:41.487 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:41 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:02:41.487 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:41 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:02:41.487 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:41 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:02:41.487 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:41 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:02:41.487 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:41 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:02:41.487 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:41 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:02:41.487 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:41 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:02:41.487 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:41 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:02:41.487 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:41 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:02:41.487 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:41 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:02:41.487 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:41 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:02:41.487 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:41 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:02:41.487 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:41 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:02:41.488 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:41 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:02:41.488 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:41 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:02:41.488 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:41 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:02:41.488 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:41 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:02:41.488 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:41 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:02:41.488 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:41 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:02:41.488 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:41 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:02:41.488 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:41 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:02:41.488 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:41 smithi099 ceph-mon[29691]: pgmap v1720: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T14:02:41.488 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:41 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:02:41.489 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:41 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:02:41.489 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:41 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:02:41.489 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:41 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:02:41.489 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:41 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:02:41.489 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:41 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:02:41.489 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:41 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:02:41.489 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:41 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:02:41.489 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:41 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:02:41.489 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:41 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:02:41.489 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:41 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:02:41.489 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:41 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:02:41.489 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:41 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:02:41.489 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:41 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:02:41.489 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:41 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:02:41.489 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:41 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:02:41.490 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:41 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:02:41.490 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:41 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:02:41.490 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:41 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:02:41.490 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:41 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:02:41.490 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:41 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:02:41.490 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:41 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:02:41.490 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:41 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:02:41.490 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:41 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:02:41.490 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:41 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:02:41.490 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:41 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:02:41.490 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:41 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:02:41.490 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:41 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:02:41.491 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:41 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:02:41.491 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:41 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:02:41.491 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:41 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:02:41.491 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:41 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:02:41.491 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:41 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:02:41.491 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:41 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:02:41.491 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:41 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:02:41.491 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:41 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:02:41.491 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:41 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:02:41.491 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:41 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:02:41.492 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:41 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:02:41.492 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:41 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:02:41.492 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:41 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:02:41.492 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:41 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:02:41.492 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:41 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:02:41.492 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:41 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:02:41.492 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:41 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:02:41.492 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:41 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:02:41.492 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:41 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:02:41.492 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:41 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:02:41.492 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:41 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:02:41.492 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:41 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:02:41.492 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:41 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:02:41.492 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:41 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:02:41.493 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:41 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:02:41.493 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:41 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:02:41.493 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:41 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:02:41.493 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:41 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:02:41.493 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:41 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:02:41.493 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:41 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:02:41.493 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:41 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:02:41.493 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:41 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:02:41.493 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:41 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:02:41.493 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:41 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:02:41.493 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:41 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:02:41.493 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:41 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:02:41.493 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:41 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:02:41.493 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:41 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:02:41.494 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:41 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:02:41.494 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:41 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:02:41.494 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:41 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:02:41.494 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:41 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:02:41.494 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:41 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:02:41.494 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:41 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:02:41.494 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:41 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:02:41.494 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:41 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:02:41.494 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:41 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:02:41.495 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:41 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:02:41.495 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:41 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:02:41.495 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:41 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:02:41.495 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:41 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:02:41.495 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:41 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:02:41.495 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:41 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:02:41.495 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:41 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:02:41.495 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:41 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:02:41.495 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:41 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:02:41.495 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:41 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:02:41.495 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:41 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:02:41.495 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:41 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:02:41.495 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:41 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:02:41.495 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:41 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:02:41.496 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:41 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:02:41.496 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:41 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:02:41.496 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:41 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:02:41.496 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:41 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:02:41.496 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:41 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:02:41.496 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:41 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:02:41.496 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:41 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:02:41.496 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:41 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:02:41.496 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:41 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:02:41.496 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:41 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:02:41.496 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:41 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:02:41.496 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:41 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:02:41.496 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:41 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:02:41.496 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:41 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:02:41.496 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:41 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:02:41.497 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:41 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:02:41.498 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:41 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:02:41.498 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:41 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:02:41.498 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:41 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:02:41.498 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:41 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:02:41.498 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:41 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:02:41.498 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:41 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:02:41.498 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:41 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:02:41.498 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:41 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:02:41.498 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:41 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:02:42.249 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:42 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:02:42.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:42 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:02:42.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:42 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:02:42.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:42 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:02:42.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:42 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:02:42.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:42 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:02:42.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:42 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:02:42.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:42 smithi181 ceph-mon[115276]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:02:42.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:42 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:02:42.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:42 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:02:42.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:42 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:02:42.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:42 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:02:42.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:42 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:02:42.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:42 smithi181 ceph-mon[115276]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:02:42.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:42 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:02:42.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:42 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:02:42.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:42 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:02:42.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:42 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:02:42.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:42 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:02:42.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:42 smithi181 ceph-mon[115276]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:02:42.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:42 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:02:42.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:42 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:02:42.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:42 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:02:42.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:42 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:02:42.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:42 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:02:42.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:42 smithi181 ceph-mon[115276]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:02:42.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:42 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:02:42.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:42 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:02:42.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:42 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:02:42.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:42 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:02:42.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:42 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:02:42.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:42 smithi181 ceph-mon[115276]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:02:42.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:42 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:02:42.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:42 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:02:42.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:42 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:02:42.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:42 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:02:42.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:42 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:02:42.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:42 smithi181 ceph-mon[115276]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:02:42.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:42 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:02:42.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:42 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:02:42.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:42 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:02:42.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:42 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:02:42.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:42 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:02:42.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:42 smithi181 ceph-mon[115276]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:02:42.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:42 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:02:42.253 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:42 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:02:42.253 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:42 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:02:42.253 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:42 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:02:42.253 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:42 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:02:42.253 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:42 smithi181 ceph-mon[115276]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:02:42.253 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:42 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:02:42.253 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:42 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:02:42.253 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:42 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:02:42.253 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:42 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:02:42.253 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:42 smithi181 ceph-mon[115276]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:02:42.580 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:42 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:02:42.580 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:42 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:02:42.580 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:42 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:02:42.580 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:42 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:02:42.580 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:42 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:02:42.580 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:42 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:02:42.580 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:42 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:02:42.580 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:42 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:02:42.581 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:42 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:02:42.581 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:42 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:02:42.581 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:42 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:02:42.581 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:42 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:02:42.581 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:42 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:02:42.581 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:42 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:02:42.581 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:42 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:02:42.581 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:42 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:02:42.581 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:42 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:02:42.581 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:42 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:02:42.581 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:42 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:02:42.581 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:42 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:02:42.581 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:42 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:02:42.582 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:42 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:02:42.582 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:42 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:02:42.582 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:42 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:02:42.582 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:42 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:02:42.582 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:42 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:02:42.582 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:42 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:02:42.582 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:42 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:02:42.582 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:42 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:02:42.582 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:42 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:02:42.582 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:42 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:02:42.583 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:42 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:02:42.583 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:42 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:02:42.583 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:42 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:02:42.583 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:42 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:02:42.583 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:42 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:02:42.583 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:42 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:02:42.583 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:42 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:02:42.583 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:42 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:02:42.583 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:42 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:02:42.583 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:42 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:02:42.583 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:42 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:02:42.583 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:42 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:02:42.584 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:42 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:02:42.584 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:42 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:02:42.584 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:42 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:02:42.584 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:42 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:02:42.584 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:42 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:02:42.584 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:42 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:02:42.584 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:42 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:02:42.584 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:42 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:02:42.584 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:42 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:02:42.584 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:42 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:02:42.584 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:42 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:02:42.584 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:42 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:02:42.584 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:42 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:02:42.585 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:42 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:02:42.585 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:42 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:02:42.585 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:42 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:02:42.585 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:42 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:02:42.585 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:42 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:02:42.585 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:42 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:02:42.585 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:42 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:02:42.585 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:42 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:02:42.585 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:42 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:02:42.586 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:42 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:02:42.586 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:42 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:02:42.586 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:42 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:02:42.586 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:42 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:02:42.586 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:42 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:02:42.586 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:42 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:02:42.586 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:42 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:02:42.586 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:42 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:02:42.586 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:42 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:02:42.586 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:42 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:02:42.586 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:42 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:02:42.586 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:42 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:02:42.586 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:42 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:02:42.586 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:42 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:02:42.587 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:42 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:02:42.587 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:42 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:02:42.587 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:42 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:02:42.587 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:42 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:02:42.587 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:42 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:02:42.587 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:42 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:02:42.587 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:42 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:02:42.587 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:42 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:02:42.587 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:42 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:02:42.587 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:42 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:02:42.587 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:42 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:02:42.587 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:42 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:02:42.588 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:42 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:02:42.588 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:42 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:02:42.588 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:42 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:02:42.588 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:42 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:02:42.588 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:42 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:02:42.588 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:42 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:02:42.588 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:42 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:02:42.588 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:42 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:02:42.588 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:42 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:02:42.588 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:42 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:02:42.588 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:42 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:02:42.588 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:42 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:02:42.588 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:42 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:02:42.588 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:42 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:02:42.589 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:42 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:02:42.589 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:42 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:02:42.589 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:42 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:02:42.589 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:42 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:02:42.589 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:42 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:02:43.363 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:43 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:02:43.363 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:43 smithi181 ceph-mon[115276]: pgmap v1721: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T14:02:43.363 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:43 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:02:43.363 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:43 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:02:43.363 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:43 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:02:43.364 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:43 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:02:43.364 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:43 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:02:43.364 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:43 smithi181 ceph-mon[115276]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:02:43.364 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:43 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:02:43.364 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:43 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:02:43.364 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:43 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:02:43.364 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:43 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:02:43.364 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:43 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:02:43.365 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:43 smithi181 ceph-mon[115276]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:02:43.365 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:43 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:02:43.365 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:43 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:02:43.365 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:43 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:02:43.365 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:43 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:02:43.365 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:43 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:02:43.365 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:43 smithi181 ceph-mon[115276]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:02:43.365 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:43 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:02:43.366 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:43 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:02:43.366 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:43 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:02:43.366 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:43 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:02:43.366 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:43 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:02:43.366 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:43 smithi181 ceph-mon[115276]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:02:43.366 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:43 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:02:43.366 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:43 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:02:43.366 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:43 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:02:43.367 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:43 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:02:43.367 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:43 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:02:43.367 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:43 smithi181 ceph-mon[115276]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:02:43.367 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:43 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:02:43.367 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:43 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:02:43.367 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:43 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:02:43.368 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:43 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:02:43.368 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:43 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:02:43.368 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:43 smithi181 ceph-mon[115276]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:02:43.368 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:43 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:02:43.368 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:43 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:02:43.368 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:43 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:02:43.368 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:43 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:02:43.369 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:43 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:02:43.369 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:43 smithi181 ceph-mon[115276]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:02:43.369 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:43 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:02:43.369 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:43 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:02:43.369 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:43 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:02:43.369 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:43 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:02:43.369 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:43 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:02:43.370 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:43 smithi181 ceph-mon[115276]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:02:43.370 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:43 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:02:43.370 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:43 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:02:43.370 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:43 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:02:43.370 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:43 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:02:43.370 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:43 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:02:43.370 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:43 smithi181 ceph-mon[115276]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:02:43.370 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:43 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:02:43.370 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:43 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:02:43.370 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:43 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:02:43.370 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:43 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:02:43.371 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:43 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:02:43.371 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:43 smithi181 ceph-mon[115276]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:02:43.371 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:43 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:02:43.371 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:43 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:02:43.371 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:43 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:02:43.371 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:43 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:02:43.371 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:43 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:02:43.371 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:43 smithi181 ceph-mon[115276]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:02:43.371 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:43 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:02:43.371 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:43 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:02:43.371 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:43 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:02:43.372 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:43 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:02:43.372 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:43 smithi181 ceph-mon[115276]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:02:43.372 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:43 smithi181 ceph-mon[115276]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:02:43.372 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:43 smithi181 ceph-mon[115276]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:02:43.372 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:43 smithi181 ceph-mon[115276]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:02:43.411 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:43 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:02:43.411 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:43 smithi099 ceph-mon[24912]: pgmap v1721: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T14:02:43.411 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:43 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:02:43.411 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:43 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:02:43.411 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:43 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:02:43.411 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:43 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:02:43.411 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:43 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:02:43.411 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:43 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:02:43.411 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:43 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:02:43.411 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:43 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:02:43.411 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:43 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:02:43.411 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:43 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:02:43.411 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:43 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:02:43.412 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:43 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:02:43.412 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:43 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:02:43.412 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:43 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:02:43.412 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:43 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:02:43.412 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:43 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:02:43.412 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:43 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:02:43.412 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:43 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:02:43.412 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:43 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:02:43.412 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:43 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:02:43.412 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:43 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:02:43.412 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:43 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:02:43.412 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:43 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:02:43.412 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:43 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:02:43.412 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:43 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:02:43.412 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:43 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:02:43.413 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:43 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:02:43.413 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:43 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:02:43.413 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:43 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:02:43.413 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:43 smithi099 ceph-mon[29691]: pgmap v1721: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T14:02:43.413 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:43 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:02:43.413 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:43 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:02:43.413 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:43 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:02:43.413 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:43 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:02:43.413 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:43 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:02:43.413 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:43 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:02:43.414 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:43 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:02:43.414 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:43 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:02:43.414 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:43 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:02:43.414 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:43 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:02:43.414 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:43 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:02:43.414 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:43 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:02:43.414 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:43 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:02:43.414 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:43 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:02:43.414 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:43 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:02:43.414 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:43 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:02:43.414 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:43 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:02:43.414 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:43 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:02:43.414 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:43 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:02:43.414 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:43 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:02:43.414 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:43 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:02:43.415 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:43 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:02:43.415 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:43 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:02:43.415 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:43 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:02:43.415 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:43 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:02:43.415 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:43 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:02:43.415 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:43 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:02:43.415 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:43 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:02:43.415 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:43 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:02:43.416 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:43 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:02:43.416 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:43 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:02:43.416 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:43 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:02:43.416 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:43 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:02:43.416 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:43 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:02:43.416 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:43 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:02:43.416 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:43 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:02:43.416 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:43 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:02:43.416 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:43 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:02:43.416 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:43 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:02:43.416 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:43 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:02:43.416 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:43 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:02:43.416 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:43 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:02:43.417 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:43 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:02:43.417 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:43 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:02:43.417 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:43 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:02:43.417 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:43 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:02:43.417 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:43 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:02:43.417 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:43 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:02:43.417 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:43 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:02:43.417 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:43 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:02:43.417 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:43 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:02:43.417 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:43 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:02:43.417 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:43 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:02:43.418 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:43 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:02:43.418 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:43 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:02:43.418 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:43 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:02:43.418 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:43 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:02:43.418 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:43 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:02:43.418 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:43 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:02:43.418 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:43 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:02:43.418 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:43 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:02:43.418 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:43 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:02:43.418 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:43 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:02:43.419 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:43 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:02:43.419 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:43 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:02:43.419 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:43 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:02:43.419 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:43 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:02:43.419 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:43 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:02:43.419 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:43 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:02:43.419 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:43 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:02:43.419 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:43 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:02:43.419 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:43 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:02:43.419 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:43 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:02:43.419 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:43 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:02:43.419 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:43 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:02:43.420 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:43 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:02:43.420 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:43 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:02:43.420 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:43 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:02:43.420 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:43 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:02:43.420 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:43 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:02:43.420 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:43 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:02:43.420 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:43 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:02:43.420 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:43 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:02:43.420 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:43 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:02:43.420 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:43 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:02:43.420 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:43 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:02:43.420 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:43 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:02:43.420 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:43 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:02:43.421 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:43 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:02:43.421 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:43 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:02:43.421 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:43 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:02:43.421 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:43 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:02:43.421 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:43 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:02:43.421 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:43 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:02:43.421 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:43 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:02:43.421 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:43 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:02:43.421 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:43 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:02:43.421 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:43 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:02:43.421 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:43 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:02:43.421 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:43 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:02:43.421 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:43 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:02:43.422 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:43 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:02:43.422 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:43 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:02:43.422 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:43 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:02:43.422 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:43 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:02:43.422 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:43 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:02:43.422 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:43 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:02:43.422 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:43 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:02:43.422 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:43 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:02:43.422 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:43 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:02:43.422 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:43 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:02:43.422 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:43 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:02:43.422 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:43 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:02:43.423 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:43 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:02:43.423 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:43 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:02:43.423 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:43 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:02:43.423 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:43 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:02:43.423 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:43 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:02:43.423 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:43 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:02:43.423 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:43 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:02:44.402 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:44 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:02:44.403 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:44 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:02:44.403 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:44 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:02:44.403 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:44 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:02:44.403 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:44 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:02:44.403 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:44 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:02:44.403 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:44 smithi181 ceph-mon[115276]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:02:44.403 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:44 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:02:44.403 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:44 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:02:44.403 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:44 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:02:44.404 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:44 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:02:44.404 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:44 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:02:44.404 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:44 smithi181 ceph-mon[115276]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:02:44.404 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:44 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:02:44.404 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:44 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:02:44.404 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:44 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:02:44.404 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:44 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:02:44.404 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:44 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:02:44.404 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:44 smithi181 ceph-mon[115276]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:02:44.404 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:44 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:02:44.404 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:44 smithi181 ceph-mon[115276]: from='client.25136 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T14:02:44.404 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:44 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:02:44.404 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:44 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:02:44.404 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:44 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:02:44.405 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:44 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:02:44.405 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:44 smithi181 ceph-mon[115276]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:02:44.405 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:44 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:02:44.405 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:44 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:02:44.405 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:44 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:02:44.405 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:44 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:02:44.405 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:44 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:02:44.405 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:44 smithi181 ceph-mon[115276]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:02:44.405 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:44 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:02:44.405 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:44 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:02:44.405 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:44 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:02:44.405 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:44 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:02:44.405 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:44 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:02:44.405 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:44 smithi181 ceph-mon[115276]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:02:44.405 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:44 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:02:44.405 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:44 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:02:44.406 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:44 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:02:44.406 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:44 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:02:44.406 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:44 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:02:44.406 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:44 smithi181 ceph-mon[115276]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:02:44.406 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:44 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:02:44.406 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:44 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:02:44.406 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:44 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:02:44.406 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:44 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:02:44.406 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:44 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:02:44.406 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:44 smithi181 ceph-mon[115276]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:02:44.406 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:44 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:02:44.406 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:44 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:02:44.406 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:44 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:02:44.406 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:44 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:02:44.407 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:44 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:02:44.407 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:44 smithi181 ceph-mon[115276]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:02:44.407 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:44 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:02:44.407 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:44 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:02:44.407 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:44 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:02:44.407 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:44 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:02:44.407 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:44 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:02:44.407 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:44 smithi181 ceph-mon[115276]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:02:44.407 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:44 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:02:44.407 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:44 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:02:44.407 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:44 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:02:44.407 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:44 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:02:44.407 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:44 smithi181 ceph-mon[115276]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:02:44.580 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:44 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:02:44.580 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:44 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:02:44.580 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:44 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:02:44.580 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:44 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:02:44.580 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:44 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:02:44.580 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:44 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:02:44.580 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:44 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:02:44.580 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:44 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:02:44.580 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:44 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:02:44.580 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:44 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:02:44.581 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:44 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:02:44.581 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:44 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:02:44.581 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:44 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:02:44.581 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:44 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:02:44.581 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:44 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:02:44.581 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:44 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:02:44.581 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:44 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:02:44.581 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:44 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:02:44.581 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:44 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:02:44.581 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:44 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:02:44.581 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:44 smithi099 ceph-mon[24912]: from='client.25136 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T14:02:44.581 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:44 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:02:44.581 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:44 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:02:44.581 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:44 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:02:44.582 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:44 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:02:44.582 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:44 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:02:44.582 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:44 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:02:44.582 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:44 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:02:44.582 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:44 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:02:44.582 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:44 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:02:44.582 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:44 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:02:44.583 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:44 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:02:44.583 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:44 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:02:44.583 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:44 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:02:44.583 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:44 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:02:44.583 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:44 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:02:44.583 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:44 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:02:44.583 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:44 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:02:44.583 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:44 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:02:44.583 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:44 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:02:44.583 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:44 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:02:44.583 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:44 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:02:44.583 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:44 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:02:44.583 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:44 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:02:44.583 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:44 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:02:44.584 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:44 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:02:44.584 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:44 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:02:44.584 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:44 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:02:44.584 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:44 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:02:44.584 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:44 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:02:44.584 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:44 smithi099 ceph-mon[29691]: from='client.25136 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T14:02:44.584 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:44 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:02:44.584 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:44 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:02:44.584 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:44 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:02:44.584 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:44 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:02:44.584 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:44 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:02:44.584 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:44 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:02:44.584 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:44 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:02:44.584 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:44 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:02:44.584 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:44 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:02:44.585 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:44 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:02:44.585 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:44 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:02:44.585 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:44 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:02:44.585 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:44 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:02:44.585 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:44 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:02:44.585 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:44 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:02:44.585 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:44 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:02:44.585 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:44 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:02:44.585 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:44 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:02:44.585 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:44 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:02:44.585 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:44 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:02:44.585 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:44 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:02:44.585 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:44 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:02:44.585 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:44 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:02:44.585 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:44 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:02:44.586 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:44 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:02:44.586 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:44 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:02:44.586 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:44 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:02:44.586 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:44 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:02:44.586 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:44 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:02:44.586 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:44 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:02:44.586 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:44 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:02:44.586 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:44 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:02:44.586 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:44 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:02:44.586 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:44 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:02:44.586 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:44 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:02:44.586 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:44 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:02:44.586 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:44 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:02:44.586 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:44 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:02:44.587 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:44 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:02:44.587 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:44 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:02:44.587 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:44 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:02:44.587 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:44 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:02:44.587 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:44 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:02:44.587 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:44 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:02:44.587 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:44 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:02:44.587 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:44 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:02:44.587 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:44 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:02:44.587 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:44 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:02:44.587 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:44 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:02:44.588 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:44 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:02:44.588 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:44 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:02:44.588 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:44 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:02:44.588 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:44 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:02:44.588 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:44 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:02:44.588 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:44 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:02:44.588 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:44 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:02:44.588 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:44 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:02:44.588 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:44 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:02:44.588 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:44 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:02:44.588 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:44 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:02:44.588 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:44 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:02:44.588 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:44 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:02:44.588 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:44 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:02:44.589 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:44 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:02:44.589 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:44 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:02:44.589 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:44 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:02:44.589 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:44 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:02:44.589 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:44 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:02:44.589 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:44 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:02:44.589 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:44 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:02:44.589 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:44 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:02:44.589 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:44 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:02:44.589 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:44 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:02:44.589 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:44 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:02:44.590 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:44 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:02:44.590 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:44 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:02:44.590 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:44 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:02:44.590 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:44 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:02:44.590 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:44 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:02:44.590 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:44 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:02:44.590 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:44 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:02:44.590 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:44 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:02:44.590 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:44 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:02:45.079 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 14:02:44 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[71049]: ::ffff:172.21.15.181 - - [30/Mar/2024:14:02:44] "GET /metrics HTTP/1.1" 200 37993 "" "Prometheus/2.43.0" 2024-03-30T14:02:45.502 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:45 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:02:45.502 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:45 smithi181 ceph-mon[115276]: pgmap v1722: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T14:02:45.502 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:45 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:02:45.502 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:45 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:02:45.502 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:45 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:02:45.502 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:45 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:02:45.502 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:45 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:02:45.502 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:45 smithi181 ceph-mon[115276]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:02:45.502 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:45 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:02:45.502 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:45 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:02:45.502 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:45 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:02:45.503 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:45 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:02:45.503 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:45 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:02:45.503 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:45 smithi181 ceph-mon[115276]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:02:45.503 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:45 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:02:45.503 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:45 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:02:45.503 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:45 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:02:45.503 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:45 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:02:45.503 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:45 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:02:45.503 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:45 smithi181 ceph-mon[115276]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:02:45.503 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:45 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:02:45.503 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:45 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:02:45.503 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:45 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:02:45.503 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:45 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:02:45.503 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:45 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:02:45.504 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:45 smithi181 ceph-mon[115276]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:02:45.504 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:45 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:02:45.504 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:45 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:02:45.504 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:45 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:02:45.504 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:45 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:02:45.504 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:45 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:02:45.504 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:45 smithi181 ceph-mon[115276]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:02:45.504 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:45 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:02:45.504 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:45 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:02:45.504 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:45 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:02:45.504 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:45 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:02:45.504 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:45 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:02:45.504 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:45 smithi181 ceph-mon[115276]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:02:45.504 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:45 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:02:45.504 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:45 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:02:45.505 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:45 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:02:45.505 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:45 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:02:45.505 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:45 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:02:45.505 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:45 smithi181 ceph-mon[115276]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:02:45.505 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:45 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:02:45.505 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:45 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:02:45.505 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:45 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:02:45.505 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:45 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:02:45.505 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:45 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:02:45.505 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:45 smithi181 ceph-mon[115276]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:02:45.505 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:45 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:02:45.505 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:45 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:02:45.505 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:45 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:02:45.505 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:45 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:02:45.506 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:45 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:02:45.506 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:45 smithi181 ceph-mon[115276]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:02:45.506 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:45 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:02:45.506 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:45 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:02:45.506 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:45 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:02:45.506 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:45 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:02:45.506 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:45 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:02:45.506 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:45 smithi181 ceph-mon[115276]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:02:45.506 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:45 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:02:45.506 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:45 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:02:45.506 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:45 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:02:45.506 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:45 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:02:45.506 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:45 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:02:45.506 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:45 smithi181 ceph-mon[115276]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:02:45.507 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:45 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:02:45.507 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:45 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:02:45.507 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:45 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:02:45.507 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:45 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:02:45.507 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:45 smithi181 ceph-mon[115276]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:02:45.580 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:45 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:02:45.580 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:45 smithi099 ceph-mon[24912]: pgmap v1722: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T14:02:45.580 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:45 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:02:45.580 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:45 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:02:45.580 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:45 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:02:45.580 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:45 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:02:45.580 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:45 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:02:45.580 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:45 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:02:45.580 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:45 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:02:45.580 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:45 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:02:45.581 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:45 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:02:45.581 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:45 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:02:45.581 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:45 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:02:45.581 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:45 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:02:45.581 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:45 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:02:45.581 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:45 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:02:45.581 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:45 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:02:45.581 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:45 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:02:45.581 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:45 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:02:45.581 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:45 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:02:45.581 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:45 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:02:45.581 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:45 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:02:45.581 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:45 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:02:45.581 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:45 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:02:45.582 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:45 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:02:45.582 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:45 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:02:45.582 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:45 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:02:45.582 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:45 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:02:45.582 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:45 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:02:45.582 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:45 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:02:45.582 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:45 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:02:45.582 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:45 smithi099 ceph-mon[29691]: pgmap v1722: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T14:02:45.582 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:45 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:02:45.582 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:45 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:02:45.582 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:45 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:02:45.583 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:45 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:02:45.583 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:45 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:02:45.583 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:45 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:02:45.583 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:45 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:02:45.583 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:45 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:02:45.583 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:45 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:02:45.583 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:45 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:02:45.583 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:45 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:02:45.583 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:45 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:02:45.583 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:45 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:02:45.583 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:45 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:02:45.583 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:45 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:02:45.583 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:45 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:02:45.583 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:45 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:02:45.583 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:45 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:02:45.584 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:45 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:02:45.584 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:45 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:02:45.584 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:45 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:02:45.584 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:45 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:02:45.584 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:45 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:02:45.584 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:45 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:02:45.584 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:45 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:02:45.584 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:45 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:02:45.584 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:45 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:02:45.584 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:45 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:02:45.585 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:45 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:02:45.585 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:45 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:02:45.585 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:45 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:02:45.585 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:45 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:02:45.585 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:45 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:02:45.585 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:45 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:02:45.585 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:45 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:02:45.585 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:45 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:02:45.585 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:45 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:02:45.585 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:45 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:02:45.585 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:45 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:02:45.585 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:45 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:02:45.585 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:45 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:02:45.585 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:45 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:02:45.586 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:45 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:02:45.586 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:45 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:02:45.586 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:45 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:02:45.586 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:45 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:02:45.586 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:45 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:02:45.586 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:45 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:02:45.586 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:45 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:02:45.586 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:45 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:02:45.586 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:45 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:02:45.586 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:45 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:02:45.586 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:45 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:02:45.586 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:45 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:02:45.586 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:45 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:02:45.587 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:45 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:02:45.587 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:45 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:02:45.587 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:45 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:02:45.587 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:45 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:02:45.587 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:45 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:02:45.587 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:45 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:02:45.587 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:45 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:02:45.587 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:45 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:02:45.587 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:45 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:02:45.587 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:45 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:02:45.587 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:45 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:02:45.587 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:45 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:02:45.587 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:45 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:02:45.587 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:45 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:02:45.587 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:45 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:02:45.588 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:45 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:02:45.588 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:45 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:02:45.588 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:45 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:02:45.588 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:45 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:02:45.588 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:45 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:02:45.588 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:45 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:02:45.588 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:45 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:02:45.588 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:45 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:02:45.588 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:45 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:02:45.589 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:45 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:02:45.589 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:45 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:02:45.589 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:45 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:02:45.589 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:45 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:02:45.589 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:45 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:02:45.589 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:45 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:02:45.589 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:45 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:02:45.589 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:45 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:02:45.589 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:45 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:02:45.589 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:45 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:02:45.589 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:45 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:02:45.589 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:45 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:02:45.589 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:45 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:02:45.589 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:45 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:02:45.589 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:45 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:02:45.590 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:45 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:02:45.590 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:45 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:02:45.590 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:45 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:02:45.590 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:45 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:02:45.590 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:45 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:02:45.590 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:45 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:02:45.590 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:45 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:02:45.590 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:45 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:02:45.590 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:45 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:02:45.590 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:45 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:02:45.590 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:45 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:02:45.590 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:45 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:02:45.590 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:45 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:02:45.590 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:45 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:02:45.590 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:45 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:02:45.591 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:45 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:02:45.591 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:45 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:02:45.591 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:45 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:02:45.591 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:45 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:02:45.591 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:45 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:02:46.249 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:46 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:02:46.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:46 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:02:46.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:46 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:02:46.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:46 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:02:46.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:46 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:02:46.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:46 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:02:46.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:46 smithi181 ceph-mon[115276]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:02:46.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:46 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:02:46.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:46 smithi181 ceph-mon[115276]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:02:46.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:46 smithi181 ceph-mon[115276]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:02:46.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:46 smithi181 ceph-mon[115276]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:02:46.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:46 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:02:46.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:46 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:02:46.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:46 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:02:46.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:46 smithi181 ceph-mon[115276]: Upgrade: Setting container_image for all crash 2024-03-30T14:02:46.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:46 smithi181 ceph-mon[115276]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:02:46.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:46 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:02:46.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:46 smithi181 ceph-mon[115276]: Upgrade: Setting container_image for all mds 2024-03-30T14:02:46.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:46 smithi181 ceph-mon[115276]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:02:46.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:46 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:02:46.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:46 smithi181 ceph-mon[115276]: Upgrade: Setting container_image for all rbd-mirror 2024-03-30T14:02:46.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:46 smithi181 ceph-mon[115276]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:02:46.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:46 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:02:46.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:46 smithi181 ceph-mon[115276]: Upgrade: Setting container_image for all cephfs-mirror 2024-03-30T14:02:46.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:46 smithi181 ceph-mon[115276]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:02:46.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:46 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.b"}]: dispatch 2024-03-30T14:02:46.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:46 smithi181 ceph-mon[115276]: from='mgr.25183 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.b"}]: dispatch 2024-03-30T14:02:46.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:46 smithi181 ceph-mon[115276]: from='mgr.25183 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.b"}]': finished 2024-03-30T14:02:46.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:46 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:02:46.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:46 smithi181 ceph-mon[115276]: Upgrade: Setting container_image for all ceph-exporter 2024-03-30T14:02:46.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:46 smithi181 ceph-mon[115276]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:02:46.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:46 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:02:46.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:46 smithi181 ceph-mon[115276]: Upgrade: Setting container_image for all nfs 2024-03-30T14:02:46.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:46 smithi181 ceph-mon[115276]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:02:46.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:46 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:02:46.253 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:46 smithi181 ceph-mon[115276]: Upgrade: Setting container_image for all nvmeof 2024-03-30T14:02:46.253 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:46 smithi181 ceph-mon[115276]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:02:46.253 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:46 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:02:46.253 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:46 smithi181 ceph-mon[115276]: Upgrade: Setting container_image for all node-exporter 2024-03-30T14:02:46.253 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:46 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.b"}]: dispatch 2024-03-30T14:02:46.253 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:46 smithi181 ceph-mon[115276]: from='mgr.25183 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.b"}]: dispatch 2024-03-30T14:02:46.253 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:46 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:02:46.253 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:46 smithi181 ceph-mon[115276]: Upgrade: Setting container_image for all prometheus 2024-03-30T14:02:46.253 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:46 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.b"}]: dispatch 2024-03-30T14:02:46.253 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:46 smithi181 ceph-mon[115276]: from='mgr.25183 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.b"}]: dispatch 2024-03-30T14:02:46.254 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:46 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:02:46.254 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:46 smithi181 ceph-mon[115276]: Upgrade: Setting container_image for all alertmanager 2024-03-30T14:02:46.254 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:46 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.b"}]: dispatch 2024-03-30T14:02:46.254 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:46 smithi181 ceph-mon[115276]: from='mgr.25183 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.b"}]: dispatch 2024-03-30T14:02:46.254 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:46 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:02:46.254 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:46 smithi181 ceph-mon[115276]: Upgrade: Setting container_image for all grafana 2024-03-30T14:02:46.254 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:46 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.b"}]: dispatch 2024-03-30T14:02:46.254 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:46 smithi181 ceph-mon[115276]: from='mgr.25183 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.b"}]: dispatch 2024-03-30T14:02:46.254 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:46 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:02:46.254 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:46 smithi181 ceph-mon[115276]: Upgrade: Setting container_image for all loki 2024-03-30T14:02:46.254 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:46 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.b"}]: dispatch 2024-03-30T14:02:46.254 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:46 smithi181 ceph-mon[115276]: from='mgr.25183 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.b"}]: dispatch 2024-03-30T14:02:46.254 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:46 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:02:46.255 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:46 smithi181 ceph-mon[115276]: Upgrade: Setting container_image for all promtail 2024-03-30T14:02:46.255 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:46 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.b"}]: dispatch 2024-03-30T14:02:46.255 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:46 smithi181 ceph-mon[115276]: from='mgr.25183 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.b"}]: dispatch 2024-03-30T14:02:46.255 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:46 smithi181 ceph-mon[115276]: Upgrade: Finalizing container_image settings 2024-03-30T14:02:46.255 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:46 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]: dispatch 2024-03-30T14:02:46.255 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:46 smithi181 ceph-mon[115276]: from='mgr.25183 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]: dispatch 2024-03-30T14:02:46.255 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:46 smithi181 ceph-mon[115276]: from='mgr.25183 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]': finished 2024-03-30T14:02:46.255 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:46 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-03-30T14:02:46.255 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:46 smithi181 ceph-mon[115276]: from='mgr.25183 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-03-30T14:02:46.255 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:46 smithi181 ceph-mon[115276]: from='mgr.25183 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon"}]': finished 2024-03-30T14:02:46.256 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:46 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]: dispatch 2024-03-30T14:02:46.256 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:46 smithi181 ceph-mon[115276]: from='mgr.25183 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]: dispatch 2024-03-30T14:02:46.256 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:46 smithi181 ceph-mon[115276]: from='mgr.25183 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]': finished 2024-03-30T14:02:46.256 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:46 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd"}]: dispatch 2024-03-30T14:02:46.256 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:46 smithi181 ceph-mon[115276]: from='mgr.25183 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd"}]: dispatch 2024-03-30T14:02:46.256 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:46 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds"}]: dispatch 2024-03-30T14:02:46.256 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:46 smithi181 ceph-mon[115276]: from='mgr.25183 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds"}]: dispatch 2024-03-30T14:02:46.256 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:46 smithi181 ceph-mon[115276]: from='mgr.25183 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds"}]': finished 2024-03-30T14:02:46.256 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:46 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]: dispatch 2024-03-30T14:02:46.256 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:46 smithi181 ceph-mon[115276]: from='mgr.25183 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]: dispatch 2024-03-30T14:02:46.256 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:46 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]: dispatch 2024-03-30T14:02:46.256 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:46 smithi181 ceph-mon[115276]: from='mgr.25183 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]: dispatch 2024-03-30T14:02:46.256 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:46 smithi181 ceph-mon[115276]: from='mgr.25183 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]': finished 2024-03-30T14:02:46.256 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:46 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-03-30T14:02:46.256 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:46 smithi181 ceph-mon[115276]: from='mgr.25183 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-03-30T14:02:46.257 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:46 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"}]: dispatch 2024-03-30T14:02:46.257 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:46 smithi181 ceph-mon[115276]: from='mgr.25183 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"}]: dispatch 2024-03-30T14:02:46.257 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:46 smithi181 ceph-mon[115276]: from='mgr.25183 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"}]': finished 2024-03-30T14:02:46.257 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:46 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]: dispatch 2024-03-30T14:02:46.257 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:46 smithi181 ceph-mon[115276]: from='mgr.25183 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]: dispatch 2024-03-30T14:02:46.257 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:46 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]: dispatch 2024-03-30T14:02:46.257 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:46 smithi181 ceph-mon[115276]: from='mgr.25183 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]: dispatch 2024-03-30T14:02:46.257 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:46 smithi181 ceph-mon[115276]: from='mgr.25183 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]': finished 2024-03-30T14:02:46.257 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:46 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]: dispatch 2024-03-30T14:02:46.257 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:46 smithi181 ceph-mon[115276]: from='mgr.25183 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]: dispatch 2024-03-30T14:02:46.257 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:46 smithi181 ceph-mon[115276]: from='mgr.25183 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]': finished 2024-03-30T14:02:46.257 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:46 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-03-30T14:02:46.257 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:46 smithi181 ceph-mon[115276]: from='mgr.25183 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-03-30T14:02:46.257 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:46 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-03-30T14:02:46.258 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:46 smithi181 ceph-mon[115276]: from='mgr.25183 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-03-30T14:02:46.258 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:46 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-03-30T14:02:46.258 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:46 smithi181 ceph-mon[115276]: from='mgr.25183 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-03-30T14:02:46.258 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:46 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-03-30T14:02:46.258 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:46 smithi181 ceph-mon[115276]: from='mgr.25183 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-03-30T14:02:46.258 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:46 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-03-30T14:02:46.258 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:46 smithi181 ceph-mon[115276]: from='mgr.25183 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-03-30T14:02:46.258 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:46 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-03-30T14:02:46.258 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:46 smithi181 ceph-mon[115276]: from='mgr.25183 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-03-30T14:02:46.258 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:46 smithi181 ceph-mon[115276]: Upgrade: Complete! 2024-03-30T14:02:46.259 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:46 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]: dispatch 2024-03-30T14:02:46.259 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:46 smithi181 ceph-mon[115276]: from='mgr.25183 ' entity='mgr.y' cmd=[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]: dispatch 2024-03-30T14:02:46.259 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:46 smithi181 ceph-mon[115276]: from='mgr.25183 ' entity='mgr.y' cmd='[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]': finished 2024-03-30T14:02:46.259 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:46 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:02:46.259 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:46 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:02:46.260 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:46 smithi181 ceph-mon[115276]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:02:46.260 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:46 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:02:46.260 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:46 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:02:46.260 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:46 smithi181 ceph-mon[115276]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:02:46.260 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:46 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T14:02:46.260 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:46 smithi181 ceph-mon[115276]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:02:46.580 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:46 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:02:46.580 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:46 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:02:46.580 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:46 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:02:46.580 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:46 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:02:46.580 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:46 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:02:46.581 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:46 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:02:46.581 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:46 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:02:46.581 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:46 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:02:46.581 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:46 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:02:46.581 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:46 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:02:46.581 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:46 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:02:46.581 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:46 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:02:46.581 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:46 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:02:46.581 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:46 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:02:46.581 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:46 smithi099 ceph-mon[29691]: Upgrade: Setting container_image for all crash 2024-03-30T14:02:46.581 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:46 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:02:46.581 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:46 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:02:46.582 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:46 smithi099 ceph-mon[29691]: Upgrade: Setting container_image for all mds 2024-03-30T14:02:46.582 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:46 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:02:46.582 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:46 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:02:46.582 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:46 smithi099 ceph-mon[29691]: Upgrade: Setting container_image for all rbd-mirror 2024-03-30T14:02:46.582 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:46 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:02:46.582 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:46 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:02:46.582 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:46 smithi099 ceph-mon[29691]: Upgrade: Setting container_image for all cephfs-mirror 2024-03-30T14:02:46.582 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:46 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:02:46.582 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:46 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.b"}]: dispatch 2024-03-30T14:02:46.582 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:46 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.b"}]: dispatch 2024-03-30T14:02:46.582 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:46 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.b"}]': finished 2024-03-30T14:02:46.582 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:46 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:02:46.582 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:46 smithi099 ceph-mon[29691]: Upgrade: Setting container_image for all ceph-exporter 2024-03-30T14:02:46.583 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:46 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:02:46.583 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:46 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:02:46.583 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:46 smithi099 ceph-mon[29691]: Upgrade: Setting container_image for all nfs 2024-03-30T14:02:46.583 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:46 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:02:46.583 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:46 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:02:46.583 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:46 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:02:46.583 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:46 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:02:46.583 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:46 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:02:46.583 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:46 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:02:46.583 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:46 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:02:46.583 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:46 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:02:46.584 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:46 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:02:46.584 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:46 smithi099 ceph-mon[24912]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:02:46.584 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:46 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:02:46.584 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:46 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:02:46.584 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:46 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:02:46.584 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:46 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:02:46.584 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:46 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:02:46.584 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:46 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:02:46.584 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:46 smithi099 ceph-mon[24912]: Upgrade: Setting container_image for all crash 2024-03-30T14:02:46.584 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:46 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:02:46.584 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:46 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:02:46.584 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:46 smithi099 ceph-mon[24912]: Upgrade: Setting container_image for all mds 2024-03-30T14:02:46.584 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:46 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:02:46.584 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:46 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:02:46.585 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:46 smithi099 ceph-mon[24912]: Upgrade: Setting container_image for all rbd-mirror 2024-03-30T14:02:46.585 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:46 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:02:46.585 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:46 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:02:46.585 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:46 smithi099 ceph-mon[24912]: Upgrade: Setting container_image for all cephfs-mirror 2024-03-30T14:02:46.585 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:46 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:02:46.585 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:46 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.b"}]: dispatch 2024-03-30T14:02:46.585 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:46 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.b"}]: dispatch 2024-03-30T14:02:46.585 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:46 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.b"}]': finished 2024-03-30T14:02:46.585 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:46 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:02:46.585 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:46 smithi099 ceph-mon[24912]: Upgrade: Setting container_image for all ceph-exporter 2024-03-30T14:02:46.585 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:46 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:02:46.585 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:46 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:02:46.585 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:46 smithi099 ceph-mon[24912]: Upgrade: Setting container_image for all nfs 2024-03-30T14:02:46.585 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:46 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:02:46.586 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:46 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:02:46.586 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:46 smithi099 ceph-mon[29691]: Upgrade: Setting container_image for all nvmeof 2024-03-30T14:02:46.586 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:46 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:02:46.586 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:46 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:02:46.586 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:46 smithi099 ceph-mon[29691]: Upgrade: Setting container_image for all node-exporter 2024-03-30T14:02:46.586 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:46 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.b"}]: dispatch 2024-03-30T14:02:46.586 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:46 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.b"}]: dispatch 2024-03-30T14:02:46.586 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:46 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:02:46.587 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:46 smithi099 ceph-mon[29691]: Upgrade: Setting container_image for all prometheus 2024-03-30T14:02:46.587 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:46 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.b"}]: dispatch 2024-03-30T14:02:46.587 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:46 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.b"}]: dispatch 2024-03-30T14:02:46.587 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:46 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:02:46.587 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:46 smithi099 ceph-mon[29691]: Upgrade: Setting container_image for all alertmanager 2024-03-30T14:02:46.587 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:46 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.b"}]: dispatch 2024-03-30T14:02:46.587 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:46 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.b"}]: dispatch 2024-03-30T14:02:46.587 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:46 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:02:46.587 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:46 smithi099 ceph-mon[29691]: Upgrade: Setting container_image for all grafana 2024-03-30T14:02:46.587 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:46 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.b"}]: dispatch 2024-03-30T14:02:46.587 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:46 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.b"}]: dispatch 2024-03-30T14:02:46.587 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:46 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:02:46.587 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:46 smithi099 ceph-mon[29691]: Upgrade: Setting container_image for all loki 2024-03-30T14:02:46.587 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:46 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.b"}]: dispatch 2024-03-30T14:02:46.588 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:46 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.b"}]: dispatch 2024-03-30T14:02:46.588 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:46 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:02:46.588 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:46 smithi099 ceph-mon[29691]: Upgrade: Setting container_image for all promtail 2024-03-30T14:02:46.588 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:46 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.b"}]: dispatch 2024-03-30T14:02:46.588 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:46 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.b"}]: dispatch 2024-03-30T14:02:46.588 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:46 smithi099 ceph-mon[29691]: Upgrade: Finalizing container_image settings 2024-03-30T14:02:46.588 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:46 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]: dispatch 2024-03-30T14:02:46.588 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:46 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]: dispatch 2024-03-30T14:02:46.588 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:46 smithi099 ceph-mon[24912]: Upgrade: Setting container_image for all nvmeof 2024-03-30T14:02:46.588 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:46 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:02:46.589 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:46 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:02:46.589 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:46 smithi099 ceph-mon[24912]: Upgrade: Setting container_image for all node-exporter 2024-03-30T14:02:46.589 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:46 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.b"}]: dispatch 2024-03-30T14:02:46.589 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:46 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.b"}]: dispatch 2024-03-30T14:02:46.589 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:46 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:02:46.589 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:46 smithi099 ceph-mon[24912]: Upgrade: Setting container_image for all prometheus 2024-03-30T14:02:46.589 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:46 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.b"}]: dispatch 2024-03-30T14:02:46.589 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:46 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.b"}]: dispatch 2024-03-30T14:02:46.589 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:46 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:02:46.589 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:46 smithi099 ceph-mon[24912]: Upgrade: Setting container_image for all alertmanager 2024-03-30T14:02:46.589 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:46 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.b"}]: dispatch 2024-03-30T14:02:46.589 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:46 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.b"}]: dispatch 2024-03-30T14:02:46.589 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:46 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:02:46.589 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:46 smithi099 ceph-mon[24912]: Upgrade: Setting container_image for all grafana 2024-03-30T14:02:46.590 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:46 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.b"}]: dispatch 2024-03-30T14:02:46.590 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:46 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.b"}]: dispatch 2024-03-30T14:02:46.590 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:46 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:02:46.590 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:46 smithi099 ceph-mon[24912]: Upgrade: Setting container_image for all loki 2024-03-30T14:02:46.590 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:46 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.b"}]: dispatch 2024-03-30T14:02:46.590 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:46 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.b"}]: dispatch 2024-03-30T14:02:46.590 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:46 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:02:46.590 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:46 smithi099 ceph-mon[24912]: Upgrade: Setting container_image for all promtail 2024-03-30T14:02:46.590 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:46 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.b"}]: dispatch 2024-03-30T14:02:46.590 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:46 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.b"}]: dispatch 2024-03-30T14:02:46.590 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:46 smithi099 ceph-mon[24912]: Upgrade: Finalizing container_image settings 2024-03-30T14:02:46.590 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:46 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]: dispatch 2024-03-30T14:02:46.590 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:46 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]: dispatch 2024-03-30T14:02:46.591 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:46 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]': finished 2024-03-30T14:02:46.591 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:46 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-03-30T14:02:46.591 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:46 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-03-30T14:02:46.591 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:46 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon"}]': finished 2024-03-30T14:02:46.591 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:46 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]: dispatch 2024-03-30T14:02:46.591 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:46 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]: dispatch 2024-03-30T14:02:46.591 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:46 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]': finished 2024-03-30T14:02:46.591 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:46 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd"}]: dispatch 2024-03-30T14:02:46.591 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:46 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd"}]: dispatch 2024-03-30T14:02:46.591 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:46 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds"}]: dispatch 2024-03-30T14:02:46.591 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:46 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds"}]: dispatch 2024-03-30T14:02:46.591 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:46 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds"}]': finished 2024-03-30T14:02:46.592 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:46 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]: dispatch 2024-03-30T14:02:46.592 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:46 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]: dispatch 2024-03-30T14:02:46.592 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:46 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]: dispatch 2024-03-30T14:02:46.592 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:46 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]: dispatch 2024-03-30T14:02:46.592 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:46 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]': finished 2024-03-30T14:02:46.592 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:46 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-03-30T14:02:46.592 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:46 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-03-30T14:02:46.592 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:46 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"}]: dispatch 2024-03-30T14:02:46.592 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:46 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"}]: dispatch 2024-03-30T14:02:46.592 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:46 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"}]': finished 2024-03-30T14:02:46.592 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:46 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]: dispatch 2024-03-30T14:02:46.592 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:46 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]: dispatch 2024-03-30T14:02:46.593 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:46 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]': finished 2024-03-30T14:02:46.593 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:46 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-03-30T14:02:46.593 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:46 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-03-30T14:02:46.593 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:46 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon"}]': finished 2024-03-30T14:02:46.593 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:46 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]: dispatch 2024-03-30T14:02:46.593 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:46 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]: dispatch 2024-03-30T14:02:46.593 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:46 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]': finished 2024-03-30T14:02:46.593 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:46 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd"}]: dispatch 2024-03-30T14:02:46.593 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:46 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd"}]: dispatch 2024-03-30T14:02:46.593 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:46 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds"}]: dispatch 2024-03-30T14:02:46.593 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:46 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds"}]: dispatch 2024-03-30T14:02:46.594 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:46 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds"}]': finished 2024-03-30T14:02:46.594 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:46 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]: dispatch 2024-03-30T14:02:46.594 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:46 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]: dispatch 2024-03-30T14:02:46.594 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:46 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]: dispatch 2024-03-30T14:02:46.594 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:46 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]: dispatch 2024-03-30T14:02:46.594 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:46 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]': finished 2024-03-30T14:02:46.594 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:46 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-03-30T14:02:46.594 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:46 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-03-30T14:02:46.594 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:46 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"}]: dispatch 2024-03-30T14:02:46.594 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:46 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"}]: dispatch 2024-03-30T14:02:46.594 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:46 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"}]': finished 2024-03-30T14:02:46.594 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:46 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]: dispatch 2024-03-30T14:02:46.594 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:46 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]: dispatch 2024-03-30T14:02:46.595 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:46 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]: dispatch 2024-03-30T14:02:46.595 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:46 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]: dispatch 2024-03-30T14:02:46.595 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:46 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]': finished 2024-03-30T14:02:46.595 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:46 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]: dispatch 2024-03-30T14:02:46.595 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:46 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]: dispatch 2024-03-30T14:02:46.595 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:46 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]': finished 2024-03-30T14:02:46.595 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:46 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-03-30T14:02:46.595 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:46 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-03-30T14:02:46.595 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:46 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-03-30T14:02:46.596 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:46 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-03-30T14:02:46.596 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:46 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-03-30T14:02:46.596 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:46 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-03-30T14:02:46.598 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:46 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-03-30T14:02:46.598 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:46 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-03-30T14:02:46.598 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:46 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-03-30T14:02:46.599 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:46 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-03-30T14:02:46.599 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:46 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-03-30T14:02:46.599 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:46 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-03-30T14:02:46.599 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:46 smithi099 ceph-mon[29691]: Upgrade: Complete! 2024-03-30T14:02:46.599 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:46 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]: dispatch 2024-03-30T14:02:46.599 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:46 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' cmd=[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]: dispatch 2024-03-30T14:02:46.599 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:46 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' cmd='[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]': finished 2024-03-30T14:02:46.599 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:46 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:02:46.599 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:46 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:02:46.599 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:46 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:02:46.599 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:46 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:02:46.599 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:46 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:02:46.600 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:46 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:02:46.600 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:46 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T14:02:46.600 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:46 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:02:46.600 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:46 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]: dispatch 2024-03-30T14:02:46.600 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:46 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]: dispatch 2024-03-30T14:02:46.600 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:46 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]': finished 2024-03-30T14:02:46.600 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:46 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]: dispatch 2024-03-30T14:02:46.600 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:46 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]: dispatch 2024-03-30T14:02:46.601 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:46 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]': finished 2024-03-30T14:02:46.601 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:46 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-03-30T14:02:46.601 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:46 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-03-30T14:02:46.601 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:46 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-03-30T14:02:46.601 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:46 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-03-30T14:02:46.601 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:46 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-03-30T14:02:46.601 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:46 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-03-30T14:02:46.601 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:46 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-03-30T14:02:46.601 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:46 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-03-30T14:02:46.601 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:46 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-03-30T14:02:46.601 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:46 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-03-30T14:02:46.601 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:46 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-03-30T14:02:46.601 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:46 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-03-30T14:02:46.601 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:46 smithi099 ceph-mon[24912]: Upgrade: Complete! 2024-03-30T14:02:46.601 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:46 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]: dispatch 2024-03-30T14:02:46.602 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:46 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' cmd=[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]: dispatch 2024-03-30T14:02:46.602 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:46 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' cmd='[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]': finished 2024-03-30T14:02:46.602 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:46 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:02:46.602 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:46 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:02:46.602 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:46 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:02:46.602 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:46 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:02:46.602 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:46 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:02:46.602 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:46 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:02:46.602 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:46 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T14:02:46.602 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:46 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:02:47.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:47 smithi181 ceph-mon[115276]: pgmap v1723: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T14:02:47.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:47 smithi181 ceph-mon[115276]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:02:47.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:47 smithi181 ceph-mon[115276]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:02:47.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:47 smithi181 ceph-mon[115276]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:02:48.070 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:47 smithi099 ceph-mon[24912]: pgmap v1723: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T14:02:48.070 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:47 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:02:48.070 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:47 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:02:48.070 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:47 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:02:48.071 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:47 smithi099 ceph-mon[29691]: pgmap v1723: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T14:02:48.071 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:47 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:02:48.071 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:47 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:02:48.071 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:47 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:02:50.248 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:49 smithi181 ceph-mon[115276]: pgmap v1724: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T14:02:50.330 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:49 smithi099 ceph-mon[24912]: pgmap v1724: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T14:02:50.330 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:49 smithi099 ceph-mon[29691]: pgmap v1724: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T14:02:52.191 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:51 smithi099 ceph-mon[24912]: pgmap v1725: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T14:02:52.192 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:51 smithi099 ceph-mon[29691]: pgmap v1725: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T14:02:52.249 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:51 smithi181 ceph-mon[115276]: pgmap v1725: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T14:02:54.249 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:53 smithi181 ceph-mon[115276]: pgmap v1726: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T14:02:54.329 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:53 smithi099 ceph-mon[29691]: pgmap v1726: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T14:02:54.330 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:53 smithi099 ceph-mon[24912]: pgmap v1726: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T14:02:55.079 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:54 smithi099 ceph-mon[24912]: from='client.25136 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T14:02:55.080 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:54 smithi099 ceph-mon[29691]: from='client.25136 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T14:02:55.080 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 14:02:54 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[71049]: ::ffff:172.21.15.181 - - [30/Mar/2024:14:02:54] "GET /metrics HTTP/1.1" 200 38003 "" "Prometheus/2.43.0" 2024-03-30T14:02:55.248 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:54 smithi181 ceph-mon[115276]: from='client.25136 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T14:02:56.248 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:55 smithi181 ceph-mon[115276]: pgmap v1727: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T14:02:56.329 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:55 smithi099 ceph-mon[24912]: pgmap v1727: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T14:02:56.330 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:55 smithi099 ceph-mon[29691]: pgmap v1727: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T14:02:58.249 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:57 smithi181 ceph-mon[115276]: pgmap v1728: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T14:02:58.329 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:57 smithi099 ceph-mon[24912]: pgmap v1728: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T14:02:58.330 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:57 smithi099 ceph-mon[29691]: pgmap v1728: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T14:03:00.248 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:02:59 smithi181 ceph-mon[115276]: pgmap v1729: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T14:03:00.329 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:02:59 smithi099 ceph-mon[24912]: pgmap v1729: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T14:03:00.330 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:02:59 smithi099 ceph-mon[29691]: pgmap v1729: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T14:03:01.079 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:00 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T14:03:01.080 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:00 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T14:03:01.222 DEBUG:teuthology.orchestra.run.smithi099:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 98ebaeb8-ee99-11ee-b647-cb9ed24678a4 -e sha1=4e50bbcdd1630c7760b708f3a5b4d38a121e66cb -- bash -c 'ceph orch ps' 2024-03-30T14:03:01.248 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:00 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T14:03:02.079 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:01 smithi099 ceph-mon[24912]: pgmap v1730: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T14:03:02.080 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:01 smithi099 ceph-mon[24912]: from='client.15786 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T14:03:02.080 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:01 smithi099 ceph-mon[29691]: pgmap v1730: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T14:03:02.080 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:01 smithi099 ceph-mon[29691]: from='client.15786 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T14:03:02.249 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:01 smithi181 ceph-mon[115276]: pgmap v1730: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T14:03:02.249 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:01 smithi181 ceph-mon[115276]: from='client.15786 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T14:03:03.428 INFO:teuthology.orchestra.run.smithi099.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-03-30T14:03:03.428 INFO:teuthology.orchestra.run.smithi099.stdout:agent.smithi099 smithi099 running 0s ago 31m - - 2024-03-30T14:03:03.428 INFO:teuthology.orchestra.run.smithi099.stdout:agent.smithi181 smithi181 running 16s ago 31m - - 2024-03-30T14:03:03.428 INFO:teuthology.orchestra.run.smithi099.stdout:alertmanager.a smithi099 *:9093,9094 running (112s) 0s ago 25m 18.8M - 0.25.0 c8568f914cd2 08735152b67d 2024-03-30T14:03:03.428 INFO:teuthology.orchestra.run.smithi099.stdout:grafana.a smithi181 *:3000 running (81s) 16s ago 25m 76.0M - 9.4.12 2bacad6d85d8 d599aa7730d6 2024-03-30T14:03:03.428 INFO:teuthology.orchestra.run.smithi099.stdout:iscsi.foo.smithi099.qyjuvr smithi099 running (4m) 0s ago 24m 55.7M - 3.5 e1d6a67b021e 2f859af6bc2a 2024-03-30T14:03:03.428 INFO:teuthology.orchestra.run.smithi099.stdout:mgr.x smithi181 *:8443,9283,8765 running (3m) 16s ago 30m 452M - 19.0.0-1967-g4e50bbcd b0c4478f1d83 f269106f7913 2024-03-30T14:03:03.429 INFO:teuthology.orchestra.run.smithi099.stdout:mgr.y smithi099 *:8443,9283,8765 running (14m) 0s ago 32m 531M - 19.0.0-1967-g4e50bbcd b0c4478f1d83 0d464b8c1d18 2024-03-30T14:03:03.429 INFO:teuthology.orchestra.run.smithi099.stdout:mon.a smithi099 running (32m) 0s ago 32m 139M 2048M 17.2.0 e1d6a67b021e af06ebb19fd8 2024-03-30T14:03:03.429 INFO:teuthology.orchestra.run.smithi099.stdout:mon.b smithi181 running (31s) 16s ago 30m 34.6M 2048M 19.0.0-1967-g4e50bbcd b0c4478f1d83 0468ed087cdd 2024-03-30T14:03:03.429 INFO:teuthology.orchestra.run.smithi099.stdout:mon.c smithi099 running (31m) 0s ago 31m 79.4M 2048M 17.2.0 e1d6a67b021e 0f1e98917718 2024-03-30T14:03:03.429 INFO:teuthology.orchestra.run.smithi099.stdout:node-exporter.a smithi099 *:9100 running (2m) 0s ago 26m 8438k - 1.5.0 0da6a335fe13 4a3f1f6e7068 2024-03-30T14:03:03.429 INFO:teuthology.orchestra.run.smithi099.stdout:node-exporter.b smithi181 *:9100 running (2m) 16s ago 26m 15.1M - 1.5.0 0da6a335fe13 acea317b5f5d 2024-03-30T14:03:03.429 INFO:teuthology.orchestra.run.smithi099.stdout:osd.0 smithi099 running (30m) 0s ago 30m 54.6M 4096M 17.2.0 e1d6a67b021e 3158ee1b0c67 2024-03-30T14:03:03.429 INFO:teuthology.orchestra.run.smithi099.stdout:osd.1 smithi099 running (29m) 0s ago 29m 57.7M 4096M 17.2.0 e1d6a67b021e c4af0fd7071a 2024-03-30T14:03:03.429 INFO:teuthology.orchestra.run.smithi099.stdout:osd.2 smithi099 running (29m) 0s ago 29m 49.8M 4096M 17.2.0 e1d6a67b021e 8e4e805a7e20 2024-03-30T14:03:03.429 INFO:teuthology.orchestra.run.smithi099.stdout:osd.3 smithi099 running (29m) 0s ago 29m 53.7M 4096M 17.2.0 e1d6a67b021e 718812bcf065 2024-03-30T14:03:03.429 INFO:teuthology.orchestra.run.smithi099.stdout:osd.4 smithi181 running (28m) 16s ago 28m 55.3M 4096M 17.2.0 e1d6a67b021e 5e205434e973 2024-03-30T14:03:03.429 INFO:teuthology.orchestra.run.smithi099.stdout:osd.5 smithi181 running (28m) 16s ago 28m 52.9M 4096M 17.2.0 e1d6a67b021e e330c920f152 2024-03-30T14:03:03.429 INFO:teuthology.orchestra.run.smithi099.stdout:osd.6 smithi181 running (27m) 16s ago 27m 52.4M 4096M 17.2.0 e1d6a67b021e 81d889ea213d 2024-03-30T14:03:03.429 INFO:teuthology.orchestra.run.smithi099.stdout:osd.7 smithi181 running (27m) 16s ago 27m 53.0M 4096M 17.2.0 e1d6a67b021e c08b1839dd7e 2024-03-30T14:03:03.429 INFO:teuthology.orchestra.run.smithi099.stdout:prometheus.a smithi181 *:9095 running (2m) 16s ago 26m 63.7M - 2.43.0 a07b618ecd1d 004088bdf70e 2024-03-30T14:03:03.429 INFO:teuthology.orchestra.run.smithi099.stdout:rgw.foo.smithi099.fxjbmp smithi099 *:8000 running (24m) 0s ago 24m 77.0M - 17.2.0 e1d6a67b021e 400b28b3f650 2024-03-30T14:03:03.430 INFO:teuthology.orchestra.run.smithi099.stdout:rgw.foo.smithi181.wfqwti smithi181 *:8000 running (24m) 16s ago 24m 76.7M - 17.2.0 e1d6a67b021e 97e1b130f9d4 2024-03-30T14:03:04.038 DEBUG:teuthology.orchestra.run.smithi099:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 98ebaeb8-ee99-11ee-b647-cb9ed24678a4 -e sha1=4e50bbcdd1630c7760b708f3a5b4d38a121e66cb -- bash -c 'ceph versions | jq -e '"'"'.mon | length == 2'"'"'' 2024-03-30T14:03:04.065 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:03 smithi099 ceph-mon[29691]: pgmap v1731: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T14:03:04.065 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:03 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:03:04.065 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:03 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:03:04.065 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:03 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:03:04.065 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:03 smithi099 ceph-mon[24912]: pgmap v1731: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T14:03:04.065 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:03 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:03:04.065 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:03 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:03:04.065 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:03 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:03:04.249 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:03 smithi181 ceph-mon[115276]: pgmap v1731: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T14:03:04.249 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:03 smithi181 ceph-mon[115276]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:03:04.249 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:03 smithi181 ceph-mon[115276]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:03:04.249 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:03 smithi181 ceph-mon[115276]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:03:04.947 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 14:03:04 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[71049]: ::ffff:172.21.15.181 - - [30/Mar/2024:14:03:04] "GET /metrics HTTP/1.1" 200 38001 "" "Prometheus/2.43.0" 2024-03-30T14:03:05.249 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:04 smithi181 ceph-mon[115276]: from='client.15792 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T14:03:05.249 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:04 smithi181 ceph-mon[115276]: from='client.25136 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T14:03:05.330 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:04 smithi099 ceph-mon[24912]: from='client.15792 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T14:03:05.330 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:04 smithi099 ceph-mon[24912]: from='client.25136 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T14:03:05.330 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:04 smithi099 ceph-mon[29691]: from='client.15792 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T14:03:05.330 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:04 smithi099 ceph-mon[29691]: from='client.25136 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T14:03:06.050 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:05 smithi099 ceph-mon[24912]: pgmap v1732: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T14:03:06.050 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:05 smithi099 ceph-mon[29691]: pgmap v1732: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T14:03:06.249 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:05 smithi181 ceph-mon[115276]: pgmap v1732: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T14:03:06.353 INFO:teuthology.orchestra.run.smithi099.stdout:true 2024-03-30T14:03:07.038 DEBUG:teuthology.orchestra.run.smithi099:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 98ebaeb8-ee99-11ee-b647-cb9ed24678a4 -e sha1=4e50bbcdd1630c7760b708f3a5b4d38a121e66cb -- bash -c 'ceph orch upgrade status' 2024-03-30T14:03:07.248 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:06 smithi181 ceph-mon[115276]: from='client.? 172.21.15.99:0/1034624299' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:03:07.310 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:06 smithi099 ceph-mon[29691]: from='client.? 172.21.15.99:0/1034624299' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:03:07.311 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:06 smithi099 ceph-mon[24912]: from='client.? 172.21.15.99:0/1034624299' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:03:08.146 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:07 smithi099 ceph-mon[24912]: pgmap v1733: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T14:03:08.146 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:07 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:03:08.146 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:07 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:03:08.146 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:07 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:03:08.146 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:07 smithi099 ceph-mon[29691]: pgmap v1733: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T14:03:08.146 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:07 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:03:08.146 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:07 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:03:08.147 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:07 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:03:08.249 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:07 smithi181 ceph-mon[115276]: pgmap v1733: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T14:03:08.249 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:07 smithi181 ceph-mon[115276]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:03:08.249 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:07 smithi181 ceph-mon[115276]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:03:08.249 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:07 smithi181 ceph-mon[115276]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:03:10.195 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:09 smithi099 ceph-mon[24912]: pgmap v1734: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T14:03:10.195 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:09 smithi099 ceph-mon[29691]: pgmap v1734: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T14:03:10.248 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:09 smithi181 ceph-mon[115276]: pgmap v1734: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T14:03:11.202 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-03-30T14:03:11.202 INFO:teuthology.orchestra.run.smithi099.stdout: "target_image": null, 2024-03-30T14:03:11.202 INFO:teuthology.orchestra.run.smithi099.stdout: "in_progress": false, 2024-03-30T14:03:11.202 INFO:teuthology.orchestra.run.smithi099.stdout: "which": "", 2024-03-30T14:03:11.202 INFO:teuthology.orchestra.run.smithi099.stdout: "services_complete": [], 2024-03-30T14:03:11.202 INFO:teuthology.orchestra.run.smithi099.stdout: "progress": null, 2024-03-30T14:03:11.202 INFO:teuthology.orchestra.run.smithi099.stdout: "message": "", 2024-03-30T14:03:11.202 INFO:teuthology.orchestra.run.smithi099.stdout: "is_paused": false 2024-03-30T14:03:11.202 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-03-30T14:03:12.080 DEBUG:teuthology.orchestra.run.smithi099:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 98ebaeb8-ee99-11ee-b647-cb9ed24678a4 -e sha1=4e50bbcdd1630c7760b708f3a5b4d38a121e66cb -- bash -c 'ceph health detail' 2024-03-30T14:03:12.248 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:11 smithi181 ceph-mon[115276]: pgmap v1735: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T14:03:12.329 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:11 smithi099 ceph-mon[24912]: pgmap v1735: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T14:03:12.330 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:11 smithi099 ceph-mon[29691]: pgmap v1735: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T14:03:13.248 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:12 smithi181 ceph-mon[115276]: from='client.15804 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T14:03:13.329 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:12 smithi099 ceph-mon[24912]: from='client.15804 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T14:03:13.330 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:12 smithi099 ceph-mon[29691]: from='client.15804 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T14:03:14.170 INFO:teuthology.orchestra.run.smithi099.stdout:HEALTH_OK 2024-03-30T14:03:14.248 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:13 smithi181 ceph-mon[115276]: pgmap v1736: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T14:03:14.329 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:13 smithi099 ceph-mon[29691]: pgmap v1736: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T14:03:14.330 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:13 smithi099 ceph-mon[24912]: pgmap v1736: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T14:03:14.744 DEBUG:teuthology.orchestra.run.smithi099:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 98ebaeb8-ee99-11ee-b647-cb9ed24678a4 -e sha1=4e50bbcdd1630c7760b708f3a5b4d38a121e66cb -- bash -c 'ceph orch upgrade start --image quay.ceph.io/ceph-ci/ceph:$sha1 --daemon-types mon --hosts $(ceph orch ps | grep mgr.y | awk '"'"'{print $2}'"'"')' 2024-03-30T14:03:14.978 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 14:03:14 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[71049]: ::ffff:172.21.15.181 - - [30/Mar/2024:14:03:14] "GET /metrics HTTP/1.1" 200 38001 "" "Prometheus/2.43.0" 2024-03-30T14:03:15.248 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:14 smithi181 ceph-mon[115276]: from='client.25136 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T14:03:15.249 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:14 smithi181 ceph-mon[115276]: from='client.? 172.21.15.99:0/4023869678' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-03-30T14:03:15.265 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:14 smithi099 ceph-mon[24912]: from='client.25136 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T14:03:15.266 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:14 smithi099 ceph-mon[24912]: from='client.? 172.21.15.99:0/4023869678' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-03-30T14:03:15.266 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:14 smithi099 ceph-mon[29691]: from='client.25136 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T14:03:15.266 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:14 smithi099 ceph-mon[29691]: from='client.? 172.21.15.99:0/4023869678' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-03-30T14:03:16.232 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:15 smithi099 ceph-mon[29691]: pgmap v1737: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T14:03:16.232 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:15 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T14:03:16.232 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:15 smithi099 ceph-mon[24912]: pgmap v1737: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T14:03:16.232 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:15 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T14:03:16.248 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:15 smithi181 ceph-mon[115276]: pgmap v1737: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T14:03:16.248 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:15 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T14:03:18.045 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:17 smithi099 ceph-mon[24912]: pgmap v1738: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T14:03:18.045 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:17 smithi099 ceph-mon[24912]: from='client.15816 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T14:03:18.045 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:17 smithi099 ceph-mon[24912]: from='client.25714 -' entity='client.admin' cmd=[{"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:4e50bbcdd1630c7760b708f3a5b4d38a121e66cb", "daemon_types": "mon", "hosts": "smithi099", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T14:03:18.045 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:17 smithi099 ceph-mon[29691]: pgmap v1738: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T14:03:18.045 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:17 smithi099 ceph-mon[29691]: from='client.15816 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T14:03:18.045 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:17 smithi099 ceph-mon[29691]: from='client.25714 -' entity='client.admin' cmd=[{"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:4e50bbcdd1630c7760b708f3a5b4d38a121e66cb", "daemon_types": "mon", "hosts": "smithi099", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T14:03:18.248 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:17 smithi181 ceph-mon[115276]: pgmap v1738: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T14:03:18.248 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:17 smithi181 ceph-mon[115276]: from='client.15816 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T14:03:18.248 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:17 smithi181 ceph-mon[115276]: from='client.25714 -' entity='client.admin' cmd=[{"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:4e50bbcdd1630c7760b708f3a5b4d38a121e66cb", "daemon_types": "mon", "hosts": "smithi099", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T14:03:18.825 INFO:teuthology.orchestra.run.smithi099.stdout:Initiating upgrade to quay.ceph.io/ceph-ci/ceph:4e50bbcdd1630c7760b708f3a5b4d38a121e66cb 2024-03-30T14:03:19.537 DEBUG:teuthology.orchestra.run.smithi099:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 98ebaeb8-ee99-11ee-b647-cb9ed24678a4 -e sha1=4e50bbcdd1630c7760b708f3a5b4d38a121e66cb -- bash -c 'while ceph orch upgrade status | jq '"'"'.in_progress'"'"' | grep true && ! ceph orch upgrade status | jq '"'"'.message'"'"' | grep Error ; do ceph orch ps ; ceph versions ; ceph orch upgrade status ; sleep 30 ; done' 2024-03-30T14:03:20.079 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:19 smithi181 ceph-mon[115276]: pgmap v1739: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T14:03:20.079 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:19 smithi181 ceph-mon[115276]: Upgrade: Started with target quay.ceph.io/ceph-ci/ceph:4e50bbcdd1630c7760b708f3a5b4d38a121e66cb 2024-03-30T14:03:20.079 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:19 smithi181 ceph-mon[115276]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:03:20.079 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:19 smithi181 ceph-mon[115276]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:03:20.079 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:19 smithi181 ceph-mon[115276]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:03:20.079 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:19 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:03:20.079 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:19 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:03:20.079 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:19 smithi181 ceph-mon[115276]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:03:20.080 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:19 smithi099 ceph-mon[24912]: pgmap v1739: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T14:03:20.080 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:19 smithi099 ceph-mon[24912]: Upgrade: Started with target quay.ceph.io/ceph-ci/ceph:4e50bbcdd1630c7760b708f3a5b4d38a121e66cb 2024-03-30T14:03:20.080 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:19 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:03:20.080 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:19 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:03:20.080 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:19 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:03:20.080 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:19 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:03:20.080 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:19 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:03:20.080 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:19 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:03:20.080 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:19 smithi099 ceph-mon[29691]: pgmap v1739: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T14:03:20.080 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:19 smithi099 ceph-mon[29691]: Upgrade: Started with target quay.ceph.io/ceph-ci/ceph:4e50bbcdd1630c7760b708f3a5b4d38a121e66cb 2024-03-30T14:03:20.080 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:19 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:03:20.081 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:19 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:03:20.081 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:19 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:03:20.081 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:19 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:03:20.081 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:19 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:03:20.081 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:19 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:03:21.079 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:20 smithi099 ceph-mon[24912]: Upgrade: First pull of quay.ceph.io/ceph-ci/ceph:4e50bbcdd1630c7760b708f3a5b4d38a121e66cb 2024-03-30T14:03:21.080 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:20 smithi099 ceph-mon[29691]: Upgrade: First pull of quay.ceph.io/ceph-ci/ceph:4e50bbcdd1630c7760b708f3a5b4d38a121e66cb 2024-03-30T14:03:21.248 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:20 smithi181 ceph-mon[115276]: Upgrade: First pull of quay.ceph.io/ceph-ci/ceph:4e50bbcdd1630c7760b708f3a5b4d38a121e66cb 2024-03-30T14:03:21.650 INFO:teuthology.orchestra.run.smithi099.stdout:true 2024-03-30T14:03:22.197 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:21 smithi099 ceph-mon[24912]: pgmap v1740: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T14:03:22.198 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:21 smithi099 ceph-mon[29691]: pgmap v1740: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T14:03:22.248 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:21 smithi181 ceph-mon[115276]: pgmap v1740: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T14:03:22.310 INFO:teuthology.orchestra.run.smithi099.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-03-30T14:03:22.310 INFO:teuthology.orchestra.run.smithi099.stdout:agent.smithi099 smithi099 running 19s ago 31m - - 2024-03-30T14:03:22.310 INFO:teuthology.orchestra.run.smithi099.stdout:agent.smithi181 smithi181 running 14s ago 31m - - 2024-03-30T14:03:22.310 INFO:teuthology.orchestra.run.smithi099.stdout:alertmanager.a smithi099 *:9093,9094 running (2m) 19s ago 25m 18.8M - 0.25.0 c8568f914cd2 08735152b67d 2024-03-30T14:03:22.310 INFO:teuthology.orchestra.run.smithi099.stdout:grafana.a smithi181 *:3000 running (100s) 14s ago 25m 80.8M - 9.4.12 2bacad6d85d8 d599aa7730d6 2024-03-30T14:03:22.310 INFO:teuthology.orchestra.run.smithi099.stdout:iscsi.foo.smithi099.qyjuvr smithi099 running (4m) 19s ago 24m 55.7M - 3.5 e1d6a67b021e 2f859af6bc2a 2024-03-30T14:03:22.310 INFO:teuthology.orchestra.run.smithi099.stdout:mgr.x smithi181 *:8443,9283,8765 running (3m) 14s ago 30m 452M - 19.0.0-1967-g4e50bbcd b0c4478f1d83 f269106f7913 2024-03-30T14:03:22.310 INFO:teuthology.orchestra.run.smithi099.stdout:mgr.y smithi099 *:8443,9283,8765 running (14m) 19s ago 32m 531M - 19.0.0-1967-g4e50bbcd b0c4478f1d83 0d464b8c1d18 2024-03-30T14:03:22.310 INFO:teuthology.orchestra.run.smithi099.stdout:mon.a smithi099 running (32m) 19s ago 32m 139M 2048M 17.2.0 e1d6a67b021e af06ebb19fd8 2024-03-30T14:03:22.310 INFO:teuthology.orchestra.run.smithi099.stdout:mon.b smithi181 running (50s) 14s ago 31m 35.1M 2048M 19.0.0-1967-g4e50bbcd b0c4478f1d83 0468ed087cdd 2024-03-30T14:03:22.310 INFO:teuthology.orchestra.run.smithi099.stdout:mon.c smithi099 running (31m) 19s ago 31m 79.4M 2048M 17.2.0 e1d6a67b021e 0f1e98917718 2024-03-30T14:03:22.310 INFO:teuthology.orchestra.run.smithi099.stdout:node-exporter.a smithi099 *:9100 running (3m) 19s ago 26m 8438k - 1.5.0 0da6a335fe13 4a3f1f6e7068 2024-03-30T14:03:22.311 INFO:teuthology.orchestra.run.smithi099.stdout:node-exporter.b smithi181 *:9100 running (3m) 14s ago 26m 16.0M - 1.5.0 0da6a335fe13 acea317b5f5d 2024-03-30T14:03:22.311 INFO:teuthology.orchestra.run.smithi099.stdout:osd.0 smithi099 running (30m) 19s ago 30m 54.6M 4096M 17.2.0 e1d6a67b021e 3158ee1b0c67 2024-03-30T14:03:22.311 INFO:teuthology.orchestra.run.smithi099.stdout:osd.1 smithi099 running (30m) 19s ago 30m 57.7M 4096M 17.2.0 e1d6a67b021e c4af0fd7071a 2024-03-30T14:03:22.311 INFO:teuthology.orchestra.run.smithi099.stdout:osd.2 smithi099 running (29m) 19s ago 29m 49.8M 4096M 17.2.0 e1d6a67b021e 8e4e805a7e20 2024-03-30T14:03:22.311 INFO:teuthology.orchestra.run.smithi099.stdout:osd.3 smithi099 running (29m) 19s ago 29m 53.7M 4096M 17.2.0 e1d6a67b021e 718812bcf065 2024-03-30T14:03:22.311 INFO:teuthology.orchestra.run.smithi099.stdout:osd.4 smithi181 running (28m) 14s ago 28m 55.3M 4096M 17.2.0 e1d6a67b021e 5e205434e973 2024-03-30T14:03:22.311 INFO:teuthology.orchestra.run.smithi099.stdout:osd.5 smithi181 running (28m) 14s ago 28m 52.9M 4096M 17.2.0 e1d6a67b021e e330c920f152 2024-03-30T14:03:22.311 INFO:teuthology.orchestra.run.smithi099.stdout:osd.6 smithi181 running (28m) 14s ago 28m 52.4M 4096M 17.2.0 e1d6a67b021e 81d889ea213d 2024-03-30T14:03:22.311 INFO:teuthology.orchestra.run.smithi099.stdout:osd.7 smithi181 running (27m) 14s ago 27m 53.0M 4096M 17.2.0 e1d6a67b021e c08b1839dd7e 2024-03-30T14:03:22.311 INFO:teuthology.orchestra.run.smithi099.stdout:prometheus.a smithi181 *:9095 running (2m) 14s ago 27m 68.0M - 2.43.0 a07b618ecd1d 004088bdf70e 2024-03-30T14:03:22.311 INFO:teuthology.orchestra.run.smithi099.stdout:rgw.foo.smithi099.fxjbmp smithi099 *:8000 running (25m) 19s ago 25m 77.0M - 17.2.0 e1d6a67b021e 400b28b3f650 2024-03-30T14:03:22.311 INFO:teuthology.orchestra.run.smithi099.stdout:rgw.foo.smithi181.wfqwti smithi181 *:8000 running (25m) 14s ago 25m 76.7M - 17.2.0 e1d6a67b021e 97e1b130f9d4 2024-03-30T14:03:22.707 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-03-30T14:03:22.708 INFO:teuthology.orchestra.run.smithi099.stdout: "mon": { 2024-03-30T14:03:22.708 INFO:teuthology.orchestra.run.smithi099.stdout: "ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)": 2, 2024-03-30T14:03:22.708 INFO:teuthology.orchestra.run.smithi099.stdout: "ceph version 19.0.0-1967-g4e50bbcd (4e50bbcdd1630c7760b708f3a5b4d38a121e66cb) squid (dev)": 1 2024-03-30T14:03:22.708 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T14:03:22.708 INFO:teuthology.orchestra.run.smithi099.stdout: "mgr": { 2024-03-30T14:03:22.708 INFO:teuthology.orchestra.run.smithi099.stdout: "ceph version 19.0.0-1967-g4e50bbcd (4e50bbcdd1630c7760b708f3a5b4d38a121e66cb) squid (dev)": 2 2024-03-30T14:03:22.708 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T14:03:22.708 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": { 2024-03-30T14:03:22.708 INFO:teuthology.orchestra.run.smithi099.stdout: "ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)": 8 2024-03-30T14:03:22.708 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T14:03:22.708 INFO:teuthology.orchestra.run.smithi099.stdout: "mds": {}, 2024-03-30T14:03:22.709 INFO:teuthology.orchestra.run.smithi099.stdout: "rgw": { 2024-03-30T14:03:22.709 INFO:teuthology.orchestra.run.smithi099.stdout: "ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)": 2 2024-03-30T14:03:22.709 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T14:03:22.709 INFO:teuthology.orchestra.run.smithi099.stdout: "overall": { 2024-03-30T14:03:22.709 INFO:teuthology.orchestra.run.smithi099.stdout: "ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)": 12, 2024-03-30T14:03:22.709 INFO:teuthology.orchestra.run.smithi099.stdout: "ceph version 19.0.0-1967-g4e50bbcd (4e50bbcdd1630c7760b708f3a5b4d38a121e66cb) squid (dev)": 3 2024-03-30T14:03:22.709 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-03-30T14:03:22.709 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-03-30T14:03:23.053 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-03-30T14:03:23.053 INFO:teuthology.orchestra.run.smithi099.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph:4e50bbcdd1630c7760b708f3a5b4d38a121e66cb", 2024-03-30T14:03:23.053 INFO:teuthology.orchestra.run.smithi099.stdout: "in_progress": true, 2024-03-30T14:03:23.053 INFO:teuthology.orchestra.run.smithi099.stdout: "which": "Upgrading daemons of type(s) mon on host(s) smithi099", 2024-03-30T14:03:23.053 INFO:teuthology.orchestra.run.smithi099.stdout: "services_complete": [], 2024-03-30T14:03:23.053 INFO:teuthology.orchestra.run.smithi099.stdout: "progress": "0/2 daemons upgraded", 2024-03-30T14:03:23.053 INFO:teuthology.orchestra.run.smithi099.stdout: "message": "Currently upgrading mon daemons", 2024-03-30T14:03:23.053 INFO:teuthology.orchestra.run.smithi099.stdout: "is_paused": false 2024-03-30T14:03:23.054 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-03-30T14:03:23.207 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:22 smithi099 ceph-mon[29691]: from='client.15828 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T14:03:23.207 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:22 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:03:23.207 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:22 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:03:23.207 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:22 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:03:23.207 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:22 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:03:23.207 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:22 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "quorum_status"}]: dispatch 2024-03-30T14:03:23.207 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:22 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "mon ok-to-stop", "ids": ["a"]}]: dispatch 2024-03-30T14:03:23.208 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:22 smithi099 ceph-mon[29691]: from='client.? 172.21.15.99:0/1778565805' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:03:23.208 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:22 smithi099 ceph-mon[24912]: from='client.15828 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T14:03:23.208 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:22 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:03:23.208 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:22 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:03:23.208 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:22 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:03:23.208 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:22 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:03:23.208 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:22 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "quorum_status"}]: dispatch 2024-03-30T14:03:23.208 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:22 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "mon ok-to-stop", "ids": ["a"]}]: dispatch 2024-03-30T14:03:23.208 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:22 smithi099 ceph-mon[24912]: from='client.? 172.21.15.99:0/1778565805' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:03:23.249 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:22 smithi181 ceph-mon[115276]: from='client.15828 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T14:03:23.249 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:22 smithi181 ceph-mon[115276]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:03:23.249 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:22 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:03:23.249 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:22 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:03:23.249 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:22 smithi181 ceph-mon[115276]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:03:23.249 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:22 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "quorum_status"}]: dispatch 2024-03-30T14:03:23.249 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:22 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "mon ok-to-stop", "ids": ["a"]}]: dispatch 2024-03-30T14:03:23.249 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:22 smithi181 ceph-mon[115276]: from='client.? 172.21.15.99:0/1778565805' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:03:24.210 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:23 smithi099 ceph-mon[24912]: from='client.25726 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T14:03:24.211 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:23 smithi099 ceph-mon[24912]: pgmap v1741: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T14:03:24.211 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:23 smithi099 ceph-mon[24912]: from='client.25732 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T14:03:24.211 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:23 smithi099 ceph-mon[24912]: Upgrade: Target is version 19.0.0-1967-g4e50bbcd (squid) 2024-03-30T14:03:24.211 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:23 smithi099 ceph-mon[24912]: Upgrade: Target container is quay.ceph.io/ceph-ci/ceph:4e50bbcdd1630c7760b708f3a5b4d38a121e66cb, digests ['quay.ceph.io/ceph-ci/ceph@sha256:8f3809717761e681477c3ef1d8d2c03114aee2c597cd7380b93b8c10f47fcb5d'] 2024-03-30T14:03:24.211 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:23 smithi099 ceph-mon[24912]: Upgrade: Setting container_image for all mgr 2024-03-30T14:03:24.211 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:23 smithi099 ceph-mon[24912]: Upgrade: It appears safe to stop mon.a 2024-03-30T14:03:24.211 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:23 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:03:24.211 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:23 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:03:24.211 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:23 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:03:24.211 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:23 smithi099 ceph-mon[29691]: from='client.25726 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T14:03:24.211 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:23 smithi099 ceph-mon[29691]: pgmap v1741: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T14:03:24.212 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:23 smithi099 ceph-mon[29691]: from='client.25732 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T14:03:24.212 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:23 smithi099 ceph-mon[29691]: Upgrade: Target is version 19.0.0-1967-g4e50bbcd (squid) 2024-03-30T14:03:24.212 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:23 smithi099 ceph-mon[29691]: Upgrade: Target container is quay.ceph.io/ceph-ci/ceph:4e50bbcdd1630c7760b708f3a5b4d38a121e66cb, digests ['quay.ceph.io/ceph-ci/ceph@sha256:8f3809717761e681477c3ef1d8d2c03114aee2c597cd7380b93b8c10f47fcb5d'] 2024-03-30T14:03:24.212 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:23 smithi099 ceph-mon[29691]: Upgrade: Setting container_image for all mgr 2024-03-30T14:03:24.212 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:23 smithi099 ceph-mon[29691]: Upgrade: It appears safe to stop mon.a 2024-03-30T14:03:24.212 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:23 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:03:24.212 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:23 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:03:24.212 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:23 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:03:24.249 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:23 smithi181 ceph-mon[115276]: from='client.25726 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T14:03:24.249 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:23 smithi181 ceph-mon[115276]: pgmap v1741: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T14:03:24.249 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:23 smithi181 ceph-mon[115276]: from='client.25732 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T14:03:24.249 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:23 smithi181 ceph-mon[115276]: Upgrade: Target is version 19.0.0-1967-g4e50bbcd (squid) 2024-03-30T14:03:24.249 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:23 smithi181 ceph-mon[115276]: Upgrade: Target container is quay.ceph.io/ceph-ci/ceph:4e50bbcdd1630c7760b708f3a5b4d38a121e66cb, digests ['quay.ceph.io/ceph-ci/ceph@sha256:8f3809717761e681477c3ef1d8d2c03114aee2c597cd7380b93b8c10f47fcb5d'] 2024-03-30T14:03:24.249 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:23 smithi181 ceph-mon[115276]: Upgrade: Setting container_image for all mgr 2024-03-30T14:03:24.249 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:23 smithi181 ceph-mon[115276]: Upgrade: It appears safe to stop mon.a 2024-03-30T14:03:24.249 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:23 smithi181 ceph-mon[115276]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:03:24.249 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:23 smithi181 ceph-mon[115276]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:03:24.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:23 smithi181 ceph-mon[115276]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:03:25.067 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:24 smithi099 ceph-mon[24912]: from='client.15852 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T14:03:25.067 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:24 smithi099 ceph-mon[24912]: from='client.25136 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T14:03:25.067 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:24 smithi099 ceph-mon[24912]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:03:25.067 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:24 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-03-30T14:03:25.067 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:24 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-03-30T14:03:25.067 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:24 smithi099 ceph-mon[24912]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:03:25.068 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 14:03:24 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[71049]: ::ffff:172.21.15.181 - - [30/Mar/2024:14:03:24] "GET /metrics HTTP/1.1" 200 38001 "" "Prometheus/2.43.0" 2024-03-30T14:03:25.068 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:24 smithi099 ceph-mon[29691]: from='client.15852 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T14:03:25.068 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:24 smithi099 ceph-mon[29691]: from='client.25136 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T14:03:25.068 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:24 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:03:25.068 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:24 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-03-30T14:03:25.068 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:24 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-03-30T14:03:25.068 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:24 smithi099 ceph-mon[29691]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:03:25.249 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:24 smithi181 ceph-mon[115276]: from='client.15852 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T14:03:25.249 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:24 smithi181 ceph-mon[115276]: from='client.25136 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T14:03:25.249 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:24 smithi181 ceph-mon[115276]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:03:25.249 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:24 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-03-30T14:03:25.249 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:24 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-03-30T14:03:25.249 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:24 smithi181 ceph-mon[115276]: from='mgr.25183 172.21.15.99:0/3462319296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:03:26.192 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:25 smithi099 ceph-mon[29691]: pgmap v1742: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T14:03:26.192 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:25 smithi099 ceph-mon[29691]: Upgrade: Updating mon.a 2024-03-30T14:03:26.193 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:25 smithi099 ceph-mon[29691]: Deploying daemon mon.a on smithi099 2024-03-30T14:03:26.193 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:25 smithi099 ceph-mon[24912]: pgmap v1742: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T14:03:26.193 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:25 smithi099 ceph-mon[24912]: Upgrade: Updating mon.a 2024-03-30T14:03:26.193 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:25 smithi099 ceph-mon[24912]: Deploying daemon mon.a on smithi099 2024-03-30T14:03:26.193 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:26 smithi099 systemd[1]: Stopping Ceph mon.a for 98ebaeb8-ee99-11ee-b647-cb9ed24678a4... 2024-03-30T14:03:26.249 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:25 smithi181 ceph-mon[115276]: pgmap v1742: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T14:03:26.249 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:25 smithi181 ceph-mon[115276]: Upgrade: Updating mon.a 2024-03-30T14:03:26.249 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:25 smithi181 ceph-mon[115276]: Deploying daemon mon.a on smithi099 2024-03-30T14:03:26.580 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:26 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mon-a[24908]: 2024-03-30T14:03:26.430+0000 7f0673f71700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-03-30T14:03:26.580 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:26 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mon-a[24908]: 2024-03-30T14:03:26.430+0000 7f0673f71700 -1 mon.a@0(leader) e3 *** Got Signal Terminated *** 2024-03-30T14:03:26.951 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:26 smithi099 podman[133344]: 2024-03-30 14:03:26.708172045 +0000 UTC m=+0.368916003 container died af06ebb19fd8580cc4e94089c0e786286e13dad706d7c07e98d7eff570805eb5 (image=quay.io/ceph/ceph:v17.2.0, name=ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mon-a, io.buildah.version=1.19.8, com.redhat.build-host=cpt-1002.osbs.prod.upshift.rdu2.redhat.com, architecture=x86_64, vcs-type=git, description=CentOS Stream is a continuously delivered distro that tracks just ahead of Red Hat Enterprise Linux development. This image takes the Red Hat UBI and layers on content from CentOS Stream, CEPH_POINT_RELEASE=-17.2.0, distribution-scope=public, io.k8s.description=The Universal Base Image is designed and engineered to be the base layer for all of your containerized applications, middleware and utilities. This base image is freely redistributable, but Red Hat only supports Red Hat technologies through subscriptions for Red Hat products. This image is maintained by Red Hat and updated regularly., io.openshift.expose-services=, maintainer=Guillaume Abrioux , name=centos-stream, build-date=2022-05-03T08:36:31.336870, GIT_BRANCH=HEAD, release=754, com.redhat.license_terms=https://centos.org/legal/licensing-policy/, io.k8s.display-name=CentOS Stream 8, ceph=True, RELEASE=HEAD, io.openshift.tags=base centos centos-stream, GIT_COMMIT=b613db0f44179c0940781c1c7fe04e1acb7093ac, vendor=Red Hat, Inc., GIT_CLEAN=True, vcs-ref=f1ee6e37554363ec55e0035aba1a693d3627fdeb, com.redhat.component=centos-stream-container, url=https://access.redhat.com/containers/#/registry.access.redhat.com/ubi8/images/8.6-754, version=8, summary=Provides a CentOS Stream container based on the Red Hat Universal Base Image, GIT_REPO=https://github.com/ceph/ceph-container.git) 2024-03-30T14:03:27.330 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:27 smithi099 podman[133344]: 2024-03-30 14:03:27.166120197 +0000 UTC m=+0.826864149 container cleanup af06ebb19fd8580cc4e94089c0e786286e13dad706d7c07e98d7eff570805eb5 (image=quay.io/ceph/ceph:v17.2.0, name=ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mon-a, GIT_BRANCH=HEAD, version=8, maintainer=Guillaume Abrioux , ceph=True, description=CentOS Stream is a continuously delivered distro that tracks just ahead of Red Hat Enterprise Linux development. This image takes the Red Hat UBI and layers on content from CentOS Stream, com.redhat.component=centos-stream-container, url=https://access.redhat.com/containers/#/registry.access.redhat.com/ubi8/images/8.6-754, vcs-type=git, GIT_REPO=https://github.com/ceph/ceph-container.git, GIT_CLEAN=True, GIT_COMMIT=b613db0f44179c0940781c1c7fe04e1acb7093ac, vcs-ref=f1ee6e37554363ec55e0035aba1a693d3627fdeb, io.openshift.tags=base centos centos-stream, RELEASE=HEAD, com.redhat.license_terms=https://centos.org/legal/licensing-policy/, summary=Provides a CentOS Stream container based on the Red Hat Universal Base Image, com.redhat.build-host=cpt-1002.osbs.prod.upshift.rdu2.redhat.com, release=754, io.buildah.version=1.19.8, name=centos-stream, build-date=2022-05-03T08:36:31.336870, CEPH_POINT_RELEASE=-17.2.0, io.k8s.description=The Universal Base Image is designed and engineered to be the base layer for all of your containerized applications, middleware and utilities. This base image is freely redistributable, but Red Hat only supports Red Hat technologies through subscriptions for Red Hat products. This image is maintained by Red Hat and updated regularly., io.openshift.expose-services=, distribution-scope=public, io.k8s.display-name=CentOS Stream 8, vendor=Red Hat, Inc., architecture=x86_64) 2024-03-30T14:03:27.330 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:27 smithi099 bash[133344]: ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mon-a 2024-03-30T14:03:27.787 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:27 smithi099 podman[133358]: 2024-03-30 14:03:27.442593811 +0000 UTC m=+0.732184253 container remove af06ebb19fd8580cc4e94089c0e786286e13dad706d7c07e98d7eff570805eb5 (image=quay.io/ceph/ceph:v17.2.0, name=ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mon-a, ceph=True, GIT_CLEAN=True, name=centos-stream, com.redhat.component=centos-stream-container, io.k8s.display-name=CentOS Stream 8, io.openshift.expose-services=, build-date=2022-05-03T08:36:31.336870, com.redhat.license_terms=https://centos.org/legal/licensing-policy/, GIT_COMMIT=b613db0f44179c0940781c1c7fe04e1acb7093ac, architecture=x86_64, io.openshift.tags=base centos centos-stream, vendor=Red Hat, Inc., release=754, vcs-type=git, io.k8s.description=The Universal Base Image is designed and engineered to be the base layer for all of your containerized applications, middleware and utilities. This base image is freely redistributable, but Red Hat only supports Red Hat technologies through subscriptions for Red Hat products. This image is maintained by Red Hat and updated regularly., version=8, url=https://access.redhat.com/containers/#/registry.access.redhat.com/ubi8/images/8.6-754, GIT_REPO=https://github.com/ceph/ceph-container.git, RELEASE=HEAD, GIT_BRANCH=HEAD, summary=Provides a CentOS Stream container based on the Red Hat Universal Base Image, description=CentOS Stream is a continuously delivered distro that tracks just ahead of Red Hat Enterprise Linux development. This image takes the Red Hat UBI and layers on content from CentOS Stream, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=-17.2.0, com.redhat.build-host=cpt-1002.osbs.prod.upshift.rdu2.redhat.com, distribution-scope=public, io.buildah.version=1.19.8, vcs-ref=f1ee6e37554363ec55e0035aba1a693d3627fdeb) 2024-03-30T14:03:27.787 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:27 smithi099 systemd[1]: ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4@mon.a.service: Deactivated successfully. 2024-03-30T14:03:27.787 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:27 smithi099 systemd[1]: Stopped Ceph mon.a for 98ebaeb8-ee99-11ee-b647-cb9ed24678a4. 2024-03-30T14:03:27.787 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:27 smithi099 systemd[1]: ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4@mon.a.service: Consumed 37.075s CPU time. 2024-03-30T14:03:28.056 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:27 smithi099 systemd[1]: Starting Ceph mon.a for 98ebaeb8-ee99-11ee-b647-cb9ed24678a4... 2024-03-30T14:03:29.259 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:29 smithi099 podman[133525]: 2024-03-30 14:03:29.000851254 +0000 UTC m=+0.018907629 image pull b0c4478f1d83795df4d538bf108aee5fac57194348fb16dcdbb3115f3e2fe95e quay.ceph.io/ceph-ci/ceph:4e50bbcdd1630c7760b708f3a5b4d38a121e66cb 2024-03-30T14:03:29.259 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:29 smithi099 podman[133525]: 2024-03-30 14:03:29.141742108 +0000 UTC m=+0.159798444 container create 49273c0f848ca2a17b3ff755d9cb97cb5df6edd6b9e3c104a1f521f3f02766c7 (image=quay.ceph.io/ceph-ci/ceph:4e50bbcdd1630c7760b708f3a5b4d38a121e66cb, name=ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mon-a, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, RELEASE=squid-4e50bbc, GIT_CLEAN=True, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240326, GIT_BRANCH=HEAD) 2024-03-30T14:03:29.579 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:29 smithi099 podman[133525]: 2024-03-30 14:03:29.386127186 +0000 UTC m=+0.404183521 container init 49273c0f848ca2a17b3ff755d9cb97cb5df6edd6b9e3c104a1f521f3f02766c7 (image=quay.ceph.io/ceph-ci/ceph:4e50bbcdd1630c7760b708f3a5b4d38a121e66cb, name=ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mon-a, RELEASE=squid-4e50bbc, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, GIT_CLEAN=True, org.label-schema.vendor=CentOS, ceph=True, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240326, io.buildah.version=1.33.5) 2024-03-30T14:03:29.580 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:29 smithi099 podman[133525]: 2024-03-30 14:03:29.389099491 +0000 UTC m=+0.407155837 container start 49273c0f848ca2a17b3ff755d9cb97cb5df6edd6b9e3c104a1f521f3f02766c7 (image=quay.ceph.io/ceph-ci/ceph:4e50bbcdd1630c7760b708f3a5b4d38a121e66cb, name=ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mon-a, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-4e50bbc, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_CLEAN=True, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240326) 2024-03-30T14:03:29.580 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:29 smithi099 ceph-mon[133544]: set uid:gid to 167:167 (ceph:ceph) 2024-03-30T14:03:29.580 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:29 smithi099 ceph-mon[133544]: ceph version 19.0.0-1967-g4e50bbcd (4e50bbcdd1630c7760b708f3a5b4d38a121e66cb) squid (dev), process ceph-mon, pid 2 2024-03-30T14:03:29.580 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:29 smithi099 ceph-mon[133544]: pidfile_write: ignore empty --pid-file 2024-03-30T14:03:29.580 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:29 smithi099 ceph-mon[133544]: load: jerasure load: lrc 2024-03-30T14:03:29.580 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:29 smithi099 ceph-mon[133544]: rocksdb: RocksDB version: 7.9.2 2024-03-30T14:03:29.580 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:29 smithi099 ceph-mon[133544]: rocksdb: Git sha 0 2024-03-30T14:03:29.580 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:29 smithi099 ceph-mon[133544]: rocksdb: Compile date 2024-03-29 15:06:16 2024-03-30T14:03:29.580 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:29 smithi099 ceph-mon[133544]: rocksdb: DB SUMMARY 2024-03-30T14:03:29.580 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:29 smithi099 ceph-mon[133544]: rocksdb: DB Session ID: 9Y48KTZO2A01P06DJLWU 2024-03-30T14:03:29.580 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:29 smithi099 ceph-mon[133544]: rocksdb: CURRENT file: CURRENT 2024-03-30T14:03:29.580 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:29 smithi099 ceph-mon[133544]: rocksdb: IDENTITY file: IDENTITY 2024-03-30T14:03:29.580 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:29 smithi099 ceph-mon[133544]: rocksdb: MANIFEST file: MANIFEST-000015 size: 5655 Bytes 2024-03-30T14:03:29.581 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:29 smithi099 ceph-mon[133544]: rocksdb: SST files in /var/lib/ceph/mon/ceph-a/store.db dir, Total Num: 1, files: 000102.sst 2024-03-30T14:03:29.581 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:29 smithi099 ceph-mon[133544]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-a/store.db: 000100.log size: 1640048 ; 2024-03-30T14:03:29.581 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:29 smithi099 ceph-mon[133544]: rocksdb: Options.error_if_exists: 0 2024-03-30T14:03:29.581 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:29 smithi099 ceph-mon[133544]: rocksdb: Options.create_if_missing: 0 2024-03-30T14:03:29.581 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:29 smithi099 ceph-mon[133544]: rocksdb: Options.paranoid_checks: 1 2024-03-30T14:03:29.581 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:29 smithi099 ceph-mon[133544]: rocksdb: Options.flush_verify_memtable_count: 1 2024-03-30T14:03:29.581 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:29 smithi099 ceph-mon[133544]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-03-30T14:03:29.581 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:29 smithi099 ceph-mon[133544]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-03-30T14:03:29.581 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:29 smithi099 ceph-mon[133544]: rocksdb: Options.env: 0x559e4034cc60 2024-03-30T14:03:29.581 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:29 smithi099 ceph-mon[133544]: rocksdb: Options.fs: PosixFileSystem 2024-03-30T14:03:29.581 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:29 smithi099 ceph-mon[133544]: rocksdb: Options.info_log: 0x559e42a6dae0 2024-03-30T14:03:29.581 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:29 smithi099 ceph-mon[133544]: rocksdb: Options.max_file_opening_threads: 16 2024-03-30T14:03:29.581 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:29 smithi099 ceph-mon[133544]: rocksdb: Options.statistics: (nil) 2024-03-30T14:03:29.582 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:29 smithi099 ceph-mon[133544]: rocksdb: Options.use_fsync: 0 2024-03-30T14:03:29.583 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:29 smithi099 ceph-mon[133544]: rocksdb: Options.max_log_file_size: 0 2024-03-30T14:03:29.583 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:29 smithi099 ceph-mon[133544]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-03-30T14:03:29.583 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:29 smithi099 ceph-mon[133544]: rocksdb: Options.log_file_time_to_roll: 0 2024-03-30T14:03:29.583 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:29 smithi099 ceph-mon[133544]: rocksdb: Options.keep_log_file_num: 1000 2024-03-30T14:03:29.583 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:29 smithi099 ceph-mon[133544]: rocksdb: Options.recycle_log_file_num: 0 2024-03-30T14:03:29.583 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:29 smithi099 ceph-mon[133544]: rocksdb: Options.allow_fallocate: 1 2024-03-30T14:03:29.583 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:29 smithi099 ceph-mon[133544]: rocksdb: Options.allow_mmap_reads: 0 2024-03-30T14:03:29.583 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:29 smithi099 ceph-mon[133544]: rocksdb: Options.allow_mmap_writes: 0 2024-03-30T14:03:29.583 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:29 smithi099 ceph-mon[133544]: rocksdb: Options.use_direct_reads: 0 2024-03-30T14:03:29.583 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:29 smithi099 ceph-mon[133544]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-03-30T14:03:29.583 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:29 smithi099 ceph-mon[133544]: rocksdb: Options.create_missing_column_families: 0 2024-03-30T14:03:29.583 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:29 smithi099 ceph-mon[133544]: rocksdb: Options.db_log_dir: 2024-03-30T14:03:29.583 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:29 smithi099 ceph-mon[133544]: rocksdb: Options.wal_dir: 2024-03-30T14:03:29.583 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:29 smithi099 ceph-mon[133544]: rocksdb: Options.table_cache_numshardbits: 6 2024-03-30T14:03:29.584 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:29 smithi099 ceph-mon[133544]: rocksdb: Options.WAL_ttl_seconds: 0 2024-03-30T14:03:29.584 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:29 smithi099 ceph-mon[133544]: rocksdb: Options.WAL_size_limit_MB: 0 2024-03-30T14:03:29.584 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:29 smithi099 ceph-mon[133544]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-03-30T14:03:29.584 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:29 smithi099 ceph-mon[133544]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-03-30T14:03:29.584 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:29 smithi099 ceph-mon[133544]: rocksdb: Options.is_fd_close_on_exec: 1 2024-03-30T14:03:29.584 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:29 smithi099 ceph-mon[133544]: rocksdb: Options.advise_random_on_open: 1 2024-03-30T14:03:29.584 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:29 smithi099 ceph-mon[133544]: rocksdb: Options.db_write_buffer_size: 0 2024-03-30T14:03:29.584 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:29 smithi099 ceph-mon[133544]: rocksdb: Options.write_buffer_manager: 0x559e42a40820 2024-03-30T14:03:29.584 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:29 smithi099 ceph-mon[133544]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-03-30T14:03:29.584 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:29 smithi099 ceph-mon[133544]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-03-30T14:03:29.584 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:29 smithi099 ceph-mon[133544]: rocksdb: Options.use_adaptive_mutex: 0 2024-03-30T14:03:29.584 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:29 smithi099 ceph-mon[133544]: rocksdb: Options.rate_limiter: (nil) 2024-03-30T14:03:29.584 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:29 smithi099 ceph-mon[133544]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-03-30T14:03:29.584 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:29 smithi099 ceph-mon[133544]: rocksdb: Options.wal_recovery_mode: 2 2024-03-30T14:03:29.584 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:29 smithi099 ceph-mon[133544]: rocksdb: Options.enable_thread_tracking: 0 2024-03-30T14:03:29.585 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:29 smithi099 ceph-mon[133544]: rocksdb: Options.enable_pipelined_write: 0 2024-03-30T14:03:29.585 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:29 smithi099 ceph-mon[133544]: rocksdb: Options.unordered_write: 0 2024-03-30T14:03:29.585 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:29 smithi099 ceph-mon[133544]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-03-30T14:03:29.585 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:29 smithi099 ceph-mon[133544]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-03-30T14:03:29.585 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:29 smithi099 ceph-mon[133544]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-03-30T14:03:29.585 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:29 smithi099 ceph-mon[133544]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-03-30T14:03:29.585 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:29 smithi099 ceph-mon[133544]: rocksdb: Options.row_cache: None 2024-03-30T14:03:29.585 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:29 smithi099 ceph-mon[133544]: rocksdb: Options.wal_filter: None 2024-03-30T14:03:29.585 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:29 smithi099 ceph-mon[133544]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-03-30T14:03:29.585 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:29 smithi099 ceph-mon[133544]: rocksdb: Options.allow_ingest_behind: 0 2024-03-30T14:03:29.585 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:29 smithi099 ceph-mon[133544]: rocksdb: Options.two_write_queues: 0 2024-03-30T14:03:29.586 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:29 smithi099 ceph-mon[133544]: rocksdb: Options.manual_wal_flush: 0 2024-03-30T14:03:29.586 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:29 smithi099 ceph-mon[133544]: rocksdb: Options.wal_compression: 0 2024-03-30T14:03:29.586 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:29 smithi099 ceph-mon[133544]: rocksdb: Options.atomic_flush: 0 2024-03-30T14:03:29.586 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:29 smithi099 ceph-mon[133544]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-03-30T14:03:29.586 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:29 smithi099 ceph-mon[133544]: rocksdb: Options.persist_stats_to_disk: 0 2024-03-30T14:03:29.586 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:29 smithi099 ceph-mon[133544]: rocksdb: Options.write_dbid_to_manifest: 0 2024-03-30T14:03:29.586 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:29 smithi099 ceph-mon[133544]: rocksdb: Options.log_readahead_size: 0 2024-03-30T14:03:29.586 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:29 smithi099 ceph-mon[133544]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-03-30T14:03:29.586 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:29 smithi099 ceph-mon[133544]: rocksdb: Options.best_efforts_recovery: 0 2024-03-30T14:03:29.586 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:29 smithi099 ceph-mon[133544]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-03-30T14:03:29.586 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:29 smithi099 ceph-mon[133544]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-03-30T14:03:29.586 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:29 smithi099 ceph-mon[133544]: rocksdb: Options.allow_data_in_errors: 0 2024-03-30T14:03:29.586 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:29 smithi099 ceph-mon[133544]: rocksdb: Options.db_host_id: __hostname__ 2024-03-30T14:03:29.586 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:29 smithi099 ceph-mon[133544]: rocksdb: Options.enforce_single_del_contracts: true 2024-03-30T14:03:29.586 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:29 smithi099 ceph-mon[133544]: rocksdb: Options.max_background_jobs: 2 2024-03-30T14:03:29.587 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:29 smithi099 ceph-mon[133544]: rocksdb: Options.max_background_compactions: -1 2024-03-30T14:03:29.587 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:29 smithi099 ceph-mon[133544]: rocksdb: Options.max_subcompactions: 1 2024-03-30T14:03:29.587 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:29 smithi099 ceph-mon[133544]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-03-30T14:03:29.587 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:29 smithi099 ceph-mon[133544]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-03-30T14:03:29.587 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:29 smithi099 ceph-mon[133544]: rocksdb: Options.delayed_write_rate : 16777216 2024-03-30T14:03:29.587 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:29 smithi099 ceph-mon[133544]: rocksdb: Options.max_total_wal_size: 0 2024-03-30T14:03:29.587 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:29 smithi099 ceph-mon[133544]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-03-30T14:03:29.587 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:29 smithi099 ceph-mon[133544]: rocksdb: Options.stats_dump_period_sec: 600 2024-03-30T14:03:29.587 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:29 smithi099 ceph-mon[133544]: rocksdb: Options.stats_persist_period_sec: 600 2024-03-30T14:03:29.587 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:29 smithi099 ceph-mon[133544]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-03-30T14:03:29.587 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:29 smithi099 ceph-mon[133544]: rocksdb: Options.max_open_files: -1 2024-03-30T14:03:29.587 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:29 smithi099 ceph-mon[133544]: rocksdb: Options.bytes_per_sync: 0 2024-03-30T14:03:29.587 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:29 smithi099 ceph-mon[133544]: rocksdb: Options.wal_bytes_per_sync: 0 2024-03-30T14:03:29.587 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:29 smithi099 ceph-mon[133544]: rocksdb: Options.strict_bytes_per_sync: 0 2024-03-30T14:03:29.587 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:29 smithi099 ceph-mon[133544]: rocksdb: Options.compaction_readahead_size: 0 2024-03-30T14:03:29.587 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:29 smithi099 ceph-mon[133544]: rocksdb: Options.max_background_flushes: -1 2024-03-30T14:03:29.588 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:29 smithi099 ceph-mon[133544]: rocksdb: Compression algorithms supported: 2024-03-30T14:03:29.588 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:29 smithi099 ceph-mon[133544]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-03-30T14:03:29.588 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:29 smithi099 ceph-mon[133544]: rocksdb: kZSTD supported: 0 2024-03-30T14:03:29.588 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:29 smithi099 ceph-mon[133544]: rocksdb: kXpressCompression supported: 0 2024-03-30T14:03:29.588 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:29 smithi099 ceph-mon[133544]: rocksdb: kLZ4HCCompression supported: 1 2024-03-30T14:03:29.588 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:29 smithi099 ceph-mon[133544]: rocksdb: kZlibCompression supported: 1 2024-03-30T14:03:29.588 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:29 smithi099 ceph-mon[133544]: rocksdb: kSnappyCompression supported: 1 2024-03-30T14:03:29.588 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:29 smithi099 ceph-mon[133544]: rocksdb: kLZ4Compression supported: 1 2024-03-30T14:03:29.588 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:29 smithi099 ceph-mon[133544]: rocksdb: kBZip2Compression supported: 0 2024-03-30T14:03:29.588 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:29 smithi099 ceph-mon[133544]: rocksdb: Fast CRC32 supported: Supported on x86 2024-03-30T14:03:29.588 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:29 smithi099 ceph-mon[133544]: rocksdb: DMutex implementation: pthread_mutex_t 2024-03-30T14:03:29.588 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:29 smithi099 ceph-mon[133544]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000015 2024-03-30T14:03:29.588 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:29 smithi099 ceph-mon[133544]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-03-30T14:03:29.588 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:29 smithi099 ceph-mon[133544]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-03-30T14:03:29.588 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:29 smithi099 ceph-mon[133544]: rocksdb: Options.merge_operator: 2024-03-30T14:03:29.589 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:29 smithi099 ceph-mon[133544]: rocksdb: Options.compaction_filter: None 2024-03-30T14:03:29.589 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:29 smithi099 ceph-mon[133544]: rocksdb: Options.compaction_filter_factory: None 2024-03-30T14:03:29.589 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:29 smithi099 ceph-mon[133544]: rocksdb: Options.sst_partitioner_factory: None 2024-03-30T14:03:29.589 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:29 smithi099 ceph-mon[133544]: rocksdb: Options.memtable_factory: SkipListFactory 2024-03-30T14:03:29.589 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:29 smithi099 ceph-mon[133544]: rocksdb: Options.table_factory: BlockBasedTable 2024-03-30T14:03:29.589 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:29 smithi099 ceph-mon[133544]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x559e42a6dbe0) 2024-03-30T14:03:29.589 INFO:journalctl@ceph.mon.a.smithi099.stdout: cache_index_and_filter_blocks: 1 2024-03-30T14:03:29.589 INFO:journalctl@ceph.mon.a.smithi099.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-03-30T14:03:29.589 INFO:journalctl@ceph.mon.a.smithi099.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-03-30T14:03:29.589 INFO:journalctl@ceph.mon.a.smithi099.stdout: pin_top_level_index_and_filter: 1 2024-03-30T14:03:29.589 INFO:journalctl@ceph.mon.a.smithi099.stdout: index_type: 0 2024-03-30T14:03:29.589 INFO:journalctl@ceph.mon.a.smithi099.stdout: data_block_index_type: 0 2024-03-30T14:03:29.589 INFO:journalctl@ceph.mon.a.smithi099.stdout: index_shortening: 1 2024-03-30T14:03:29.589 INFO:journalctl@ceph.mon.a.smithi099.stdout: data_block_hash_table_util_ratio: 0.750000 2024-03-30T14:03:29.589 INFO:journalctl@ceph.mon.a.smithi099.stdout: checksum: 4 2024-03-30T14:03:29.590 INFO:journalctl@ceph.mon.a.smithi099.stdout: no_block_cache: 0 2024-03-30T14:03:29.590 INFO:journalctl@ceph.mon.a.smithi099.stdout: block_cache: 0x559e42a71090 2024-03-30T14:03:29.590 INFO:journalctl@ceph.mon.a.smithi099.stdout: block_cache_name: BinnedLRUCache 2024-03-30T14:03:29.590 INFO:journalctl@ceph.mon.a.smithi099.stdout: block_cache_options: 2024-03-30T14:03:29.590 INFO:journalctl@ceph.mon.a.smithi099.stdout: capacity : 536870912 2024-03-30T14:03:29.590 INFO:journalctl@ceph.mon.a.smithi099.stdout: num_shard_bits : 4 2024-03-30T14:03:29.590 INFO:journalctl@ceph.mon.a.smithi099.stdout: strict_capacity_limit : 0 2024-03-30T14:03:29.590 INFO:journalctl@ceph.mon.a.smithi099.stdout: high_pri_pool_ratio: 0.000 2024-03-30T14:03:29.590 INFO:journalctl@ceph.mon.a.smithi099.stdout: block_cache_compressed: (nil) 2024-03-30T14:03:29.590 INFO:journalctl@ceph.mon.a.smithi099.stdout: persistent_cache: (nil) 2024-03-30T14:03:29.590 INFO:journalctl@ceph.mon.a.smithi099.stdout: block_size: 4096 2024-03-30T14:03:29.590 INFO:journalctl@ceph.mon.a.smithi099.stdout: block_size_deviation: 10 2024-03-30T14:03:29.590 INFO:journalctl@ceph.mon.a.smithi099.stdout: block_restart_interval: 16 2024-03-30T14:03:29.590 INFO:journalctl@ceph.mon.a.smithi099.stdout: index_block_restart_interval: 1 2024-03-30T14:03:29.590 INFO:journalctl@ceph.mon.a.smithi099.stdout: metadata_block_size: 4096 2024-03-30T14:03:29.590 INFO:journalctl@ceph.mon.a.smithi099.stdout: partition_filters: 0 2024-03-30T14:03:29.591 INFO:journalctl@ceph.mon.a.smithi099.stdout: use_delta_encoding: 1 2024-03-30T14:03:29.591 INFO:journalctl@ceph.mon.a.smithi099.stdout: filter_policy: bloomfilter 2024-03-30T14:03:29.591 INFO:journalctl@ceph.mon.a.smithi099.stdout: whole_key_filtering: 1 2024-03-30T14:03:29.591 INFO:journalctl@ceph.mon.a.smithi099.stdout: verify_compression: 0 2024-03-30T14:03:29.591 INFO:journalctl@ceph.mon.a.smithi099.stdout: read_amp_bytes_per_bit: 0 2024-03-30T14:03:29.591 INFO:journalctl@ceph.mon.a.smithi099.stdout: format_version: 5 2024-03-30T14:03:29.591 INFO:journalctl@ceph.mon.a.smithi099.stdout: enable_index_compression: 1 2024-03-30T14:03:29.591 INFO:journalctl@ceph.mon.a.smithi099.stdout: block_align: 0 2024-03-30T14:03:29.591 INFO:journalctl@ceph.mon.a.smithi099.stdout: max_auto_readahead_size: 262144 2024-03-30T14:03:29.591 INFO:journalctl@ceph.mon.a.smithi099.stdout: prepopulate_block_cache: 0 2024-03-30T14:03:29.591 INFO:journalctl@ceph.mon.a.smithi099.stdout: initial_auto_readahead_size: 8192 2024-03-30T14:03:29.591 INFO:journalctl@ceph.mon.a.smithi099.stdout: num_file_reads_for_auto_readahead: 2 2024-03-30T14:03:29.591 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:29 smithi099 ceph-mon[133544]: rocksdb: Options.write_buffer_size: 33554432 2024-03-30T14:03:29.591 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:29 smithi099 ceph-mon[133544]: rocksdb: Options.max_write_buffer_number: 2 2024-03-30T14:03:29.591 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:29 smithi099 ceph-mon[133544]: rocksdb: Options.compression: NoCompression 2024-03-30T14:03:29.591 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:29 smithi099 ceph-mon[133544]: rocksdb: Options.bottommost_compression: Disabled 2024-03-30T14:03:29.592 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:29 smithi099 ceph-mon[133544]: rocksdb: Options.prefix_extractor: nullptr 2024-03-30T14:03:29.592 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:29 smithi099 ceph-mon[133544]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-03-30T14:03:29.592 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:29 smithi099 ceph-mon[133544]: rocksdb: Options.num_levels: 7 2024-03-30T14:03:29.592 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:29 smithi099 ceph-mon[133544]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-03-30T14:03:29.592 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:29 smithi099 ceph-mon[133544]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-03-30T14:03:29.592 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:29 smithi099 ceph-mon[133544]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-03-30T14:03:29.592 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:29 smithi099 ceph-mon[133544]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-03-30T14:03:29.592 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:29 smithi099 ceph-mon[133544]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-03-30T14:03:29.592 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:29 smithi099 ceph-mon[133544]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-03-30T14:03:29.592 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:29 smithi099 ceph-mon[133544]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-03-30T14:03:29.592 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:29 smithi099 ceph-mon[133544]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-03-30T14:03:29.592 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:29 smithi099 ceph-mon[133544]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-03-30T14:03:29.592 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:29 smithi099 ceph-mon[133544]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-03-30T14:03:29.592 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:29 smithi099 ceph-mon[133544]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-03-30T14:03:29.592 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:29 smithi099 ceph-mon[133544]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-03-30T14:03:29.593 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:29 smithi099 ceph-mon[133544]: rocksdb: Options.compression_opts.window_bits: -14 2024-03-30T14:03:29.593 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:29 smithi099 ceph-mon[133544]: rocksdb: Options.compression_opts.level: 32767 2024-03-30T14:03:29.593 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:29 smithi099 ceph-mon[133544]: rocksdb: Options.compression_opts.strategy: 0 2024-03-30T14:03:29.593 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:29 smithi099 ceph-mon[133544]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-03-30T14:03:29.593 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:29 smithi099 ceph-mon[133544]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-03-30T14:03:29.593 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:29 smithi099 ceph-mon[133544]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-03-30T14:03:29.593 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:29 smithi099 ceph-mon[133544]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-03-30T14:03:29.593 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:29 smithi099 ceph-mon[133544]: rocksdb: Options.compression_opts.enabled: false 2024-03-30T14:03:29.593 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:29 smithi099 ceph-mon[133544]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-03-30T14:03:29.593 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:29 smithi099 ceph-mon[133544]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-03-30T14:03:29.593 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:29 smithi099 ceph-mon[133544]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-03-30T14:03:29.593 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:29 smithi099 ceph-mon[133544]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-03-30T14:03:29.593 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:29 smithi099 ceph-mon[133544]: rocksdb: Options.target_file_size_base: 67108864 2024-03-30T14:03:29.593 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:29 smithi099 ceph-mon[133544]: rocksdb: Options.target_file_size_multiplier: 1 2024-03-30T14:03:29.593 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:29 smithi099 ceph-mon[133544]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-03-30T14:03:29.593 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:29 smithi099 ceph-mon[133544]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-03-30T14:03:29.593 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:29 smithi099 ceph-mon[133544]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-03-30T14:03:29.593 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:29 smithi099 ceph-mon[133544]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-03-30T14:03:29.594 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:29 smithi099 ceph-mon[133544]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-03-30T14:03:29.594 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:29 smithi099 ceph-mon[133544]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-03-30T14:03:29.594 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:29 smithi099 ceph-mon[133544]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-03-30T14:03:29.594 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:29 smithi099 ceph-mon[133544]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-03-30T14:03:29.594 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:29 smithi099 ceph-mon[133544]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-03-30T14:03:29.594 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:29 smithi099 ceph-mon[133544]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-03-30T14:03:29.594 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:29 smithi099 ceph-mon[133544]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-03-30T14:03:29.594 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:29 smithi099 ceph-mon[133544]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-03-30T14:03:29.594 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:29 smithi099 ceph-mon[133544]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-03-30T14:03:29.594 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:29 smithi099 ceph-mon[133544]: rocksdb: Options.arena_block_size: 1048576 2024-03-30T14:03:29.594 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:29 smithi099 ceph-mon[133544]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-03-30T14:03:29.594 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:29 smithi099 ceph-mon[133544]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-03-30T14:03:29.594 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:29 smithi099 ceph-mon[133544]: rocksdb: Options.disable_auto_compactions: 0 2024-03-30T14:03:29.594 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:29 smithi099 ceph-mon[133544]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-03-30T14:03:29.594 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:29 smithi099 ceph-mon[133544]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-03-30T14:03:29.595 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:29 smithi099 ceph-mon[133544]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-03-30T14:03:29.595 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:29 smithi099 ceph-mon[133544]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-03-30T14:03:29.595 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:29 smithi099 ceph-mon[133544]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-03-30T14:03:29.595 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:29 smithi099 ceph-mon[133544]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-03-30T14:03:29.595 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:29 smithi099 ceph-mon[133544]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-03-30T14:03:29.595 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:29 smithi099 ceph-mon[133544]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-03-30T14:03:29.595 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:29 smithi099 ceph-mon[133544]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-03-30T14:03:29.595 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:29 smithi099 ceph-mon[133544]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-03-30T14:03:29.595 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:29 smithi099 ceph-mon[133544]: rocksdb: Options.table_properties_collectors: 2024-03-30T14:03:29.595 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:29 smithi099 ceph-mon[133544]: rocksdb: Options.inplace_update_support: 0 2024-03-30T14:03:29.595 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:29 smithi099 ceph-mon[133544]: rocksdb: Options.inplace_update_num_locks: 10000 2024-03-30T14:03:29.595 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:29 smithi099 ceph-mon[133544]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-03-30T14:03:29.595 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:29 smithi099 ceph-mon[133544]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-03-30T14:03:29.595 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:29 smithi099 ceph-mon[133544]: rocksdb: Options.memtable_huge_page_size: 0 2024-03-30T14:03:29.595 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:29 smithi099 ceph-mon[133544]: rocksdb: Options.bloom_locality: 0 2024-03-30T14:03:29.596 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:29 smithi099 ceph-mon[133544]: rocksdb: Options.max_successive_merges: 0 2024-03-30T14:03:29.596 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:29 smithi099 ceph-mon[133544]: rocksdb: Options.optimize_filters_for_hits: 0 2024-03-30T14:03:29.596 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:29 smithi099 ceph-mon[133544]: rocksdb: Options.paranoid_file_checks: 0 2024-03-30T14:03:29.596 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:29 smithi099 ceph-mon[133544]: rocksdb: Options.force_consistency_checks: 1 2024-03-30T14:03:29.596 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:29 smithi099 ceph-mon[133544]: rocksdb: Options.report_bg_io_stats: 0 2024-03-30T14:03:29.596 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:29 smithi099 ceph-mon[133544]: rocksdb: Options.ttl: 2592000 2024-03-30T14:03:29.596 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:29 smithi099 ceph-mon[133544]: rocksdb: Options.periodic_compaction_seconds: 0 2024-03-30T14:03:29.596 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:29 smithi099 ceph-mon[133544]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-03-30T14:03:29.596 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:29 smithi099 ceph-mon[133544]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-03-30T14:03:29.596 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:29 smithi099 ceph-mon[133544]: rocksdb: Options.enable_blob_files: false 2024-03-30T14:03:29.596 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:29 smithi099 ceph-mon[133544]: rocksdb: Options.min_blob_size: 0 2024-03-30T14:03:29.596 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:29 smithi099 ceph-mon[133544]: rocksdb: Options.blob_file_size: 268435456 2024-03-30T14:03:29.596 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:29 smithi099 ceph-mon[133544]: rocksdb: Options.blob_compression_type: NoCompression 2024-03-30T14:03:29.596 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:29 smithi099 ceph-mon[133544]: rocksdb: Options.enable_blob_garbage_collection: false 2024-03-30T14:03:29.596 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:29 smithi099 ceph-mon[133544]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-03-30T14:03:29.596 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:29 smithi099 ceph-mon[133544]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-03-30T14:03:29.597 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:29 smithi099 ceph-mon[133544]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-03-30T14:03:29.597 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:29 smithi099 ceph-mon[133544]: rocksdb: Options.blob_file_starting_level: 0 2024-03-30T14:03:29.597 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:29 smithi099 ceph-mon[133544]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-03-30T14:03:29.597 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:29 smithi099 ceph-mon[133544]: rocksdb: [table/block_based/block_based_table_reader.cc:721] At least one SST file opened without unique ID to verify: 102.sst 2024-03-30T14:03:29.597 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:29 smithi099 ceph-mon[133544]: rocksdb: [db/version_set.cc:4390] More existing levels in DB than needed. max_bytes_for_level_multiplier may not be guaranteed. 2024-03-30T14:03:29.597 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:29 smithi099 ceph-mon[133544]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000015 succeeded,manifest_file_number is 15, next_file_number is 104, last_sequence is 53130, log_number is 100,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2024-03-30T14:03:29.597 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:29 smithi099 ceph-mon[133544]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 100 2024-03-30T14:03:29.597 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:29 smithi099 ceph-mon[133544]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: 53488779-88f1-4b5b-98f2-7b717f8062ca 2024-03-30T14:03:29.597 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:29 smithi099 ceph-mon[133544]: rocksdb: EVENT_LOG_v1 {"time_micros": 1711807409418781, "job": 1, "event": "recovery_started", "wal_files": [100]} 2024-03-30T14:03:29.597 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:29 smithi099 ceph-mon[133544]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #100 mode 2 2024-03-30T14:03:29.597 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:29 smithi099 ceph-mon[133544]: rocksdb: EVENT_LOG_v1 {"time_micros": 1711807409426853, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 105, "file_size": 1440923, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 53131, "largest_seqno": 55378, "table_properties": {"data_size": 1433054, "index_size": 3524, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 3333, "raw_key_size": 32056, "raw_average_key_size": 24, "raw_value_size": 1410558, "raw_average_value_size": 1061, "num_data_blocks": 147, "num_entries": 1329, "num_filter_entries": 1329, "num_deletions": 258, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1711807409, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "53488779-88f1-4b5b-98f2-7b717f8062ca", "db_session_id": "9Y48KTZO2A01P06DJLWU", "orig_file_number": 105, "seqno_to_time_mapping": "N/A"}} 2024-03-30T14:03:29.597 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:29 smithi099 ceph-mon[133544]: rocksdb: EVENT_LOG_v1 {"time_micros": 1711807409426990, "job": 1, "event": "recovery_finished"} 2024-03-30T14:03:29.597 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:29 smithi099 ceph-mon[133544]: rocksdb: [db/version_set.cc:5047] Creating manifest 107 2024-03-30T14:03:29.597 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:29 smithi099 ceph-mon[133544]: rocksdb: [db/version_set.cc:4390] More existing levels in DB than needed. max_bytes_for_level_multiplier may not be guaranteed. 2024-03-30T14:03:29.597 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:29 smithi099 ceph-mon[133544]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-a/store.db/000100.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-03-30T14:03:29.597 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:29 smithi099 ceph-mon[133544]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x559e42b62000 2024-03-30T14:03:29.598 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:29 smithi099 ceph-mon[133544]: rocksdb: DB pointer 0x559e42b4c000 2024-03-30T14:03:29.598 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:29 smithi099 ceph-mon[133544]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-03-30T14:03:29.598 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:29 smithi099 ceph-mon[133544]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-03-30T14:03:29.598 INFO:journalctl@ceph.mon.a.smithi099.stdout: ** DB Stats ** 2024-03-30T14:03:29.598 INFO:journalctl@ceph.mon.a.smithi099.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-03-30T14:03:29.598 INFO:journalctl@ceph.mon.a.smithi099.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-03-30T14:03:29.598 INFO:journalctl@ceph.mon.a.smithi099.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-03-30T14:03:29.598 INFO:journalctl@ceph.mon.a.smithi099.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-03-30T14:03:29.598 INFO:journalctl@ceph.mon.a.smithi099.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-03-30T14:03:29.598 INFO:journalctl@ceph.mon.a.smithi099.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-03-30T14:03:29.598 INFO:journalctl@ceph.mon.a.smithi099.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-03-30T14:03:29.598 INFO:journalctl@ceph.mon.a.smithi099.stdout: 2024-03-30T14:03:29.598 INFO:journalctl@ceph.mon.a.smithi099.stdout: ** Compaction Stats [default] ** 2024-03-30T14:03:29.598 INFO:journalctl@ceph.mon.a.smithi099.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-03-30T14:03:29.598 INFO:journalctl@ceph.mon.a.smithi099.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-03-30T14:03:29.599 INFO:journalctl@ceph.mon.a.smithi099.stdout: L0 1/0 1.37 MB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 359.6 0.00 0.00 1 0.004 0 0 0.0 0.0 2024-03-30T14:03:29.599 INFO:journalctl@ceph.mon.a.smithi099.stdout: L6 1/0 12.09 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 2024-03-30T14:03:29.599 INFO:journalctl@ceph.mon.a.smithi099.stdout: Sum 2/0 13.47 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 359.6 0.00 0.00 1 0.004 0 0 0.0 0.0 2024-03-30T14:03:29.599 INFO:journalctl@ceph.mon.a.smithi099.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 359.6 0.00 0.00 1 0.004 0 0 0.0 0.0 2024-03-30T14:03:29.599 INFO:journalctl@ceph.mon.a.smithi099.stdout: 2024-03-30T14:03:29.599 INFO:journalctl@ceph.mon.a.smithi099.stdout: ** Compaction Stats [default] ** 2024-03-30T14:03:29.599 INFO:journalctl@ceph.mon.a.smithi099.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-03-30T14:03:29.599 INFO:journalctl@ceph.mon.a.smithi099.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-03-30T14:03:29.599 INFO:journalctl@ceph.mon.a.smithi099.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 359.6 0.00 0.00 1 0.004 0 0 0.0 0.0 2024-03-30T14:03:29.599 INFO:journalctl@ceph.mon.a.smithi099.stdout: 2024-03-30T14:03:29.599 INFO:journalctl@ceph.mon.a.smithi099.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-03-30T14:03:29.599 INFO:journalctl@ceph.mon.a.smithi099.stdout: 2024-03-30T14:03:29.599 INFO:journalctl@ceph.mon.a.smithi099.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-03-30T14:03:29.599 INFO:journalctl@ceph.mon.a.smithi099.stdout: Flush(GB): cumulative 0.001, interval 0.001 2024-03-30T14:03:29.599 INFO:journalctl@ceph.mon.a.smithi099.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-03-30T14:03:29.599 INFO:journalctl@ceph.mon.a.smithi099.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-03-30T14:03:29.599 INFO:journalctl@ceph.mon.a.smithi099.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-03-30T14:03:29.600 INFO:journalctl@ceph.mon.a.smithi099.stdout: AddFile(Keys): cumulative 0, interval 0 2024-03-30T14:03:29.600 INFO:journalctl@ceph.mon.a.smithi099.stdout: Cumulative compaction: 0.00 GB write, 126.41 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-03-30T14:03:29.600 INFO:journalctl@ceph.mon.a.smithi099.stdout: Interval compaction: 0.00 GB write, 126.41 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-03-30T14:03:29.600 INFO:journalctl@ceph.mon.a.smithi099.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-03-30T14:03:29.600 INFO:journalctl@ceph.mon.a.smithi099.stdout: Block cache BinnedLRUCache@0x559e42a71090#2 capacity: 512.00 MB usage: 8.11 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 1.1e-05 secs_since: 0 2024-03-30T14:03:29.600 INFO:journalctl@ceph.mon.a.smithi099.stdout: Block cache entry stats(count,size,portion): FilterBlock(1,4.03 KB,0.0007689%) IndexBlock(1,4.08 KB,0.000777841%) Misc(1,0.00 KB,0%) 2024-03-30T14:03:29.600 INFO:journalctl@ceph.mon.a.smithi099.stdout: 2024-03-30T14:03:29.600 INFO:journalctl@ceph.mon.a.smithi099.stdout: ** File Read Latency Histogram By Level [default] ** 2024-03-30T14:03:29.600 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:29 smithi099 ceph-mon[133544]: starting mon.a rank 0 at public addrs [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] at bind addrs [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] mon_data /var/lib/ceph/mon/ceph-a fsid 98ebaeb8-ee99-11ee-b647-cb9ed24678a4 2024-03-30T14:03:29.600 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:29 smithi099 ceph-mon[133544]: mon.a@-1(???) e3 preinit fsid 98ebaeb8-ee99-11ee-b647-cb9ed24678a4 2024-03-30T14:03:29.600 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:29 smithi099 ceph-mon[133544]: mon.a@-1(???).mds e1 new map 2024-03-30T14:03:29.600 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:29 smithi099 ceph-mon[133544]: mon.a@-1(???).mds e1 print_map 2024-03-30T14:03:29.600 INFO:journalctl@ceph.mon.a.smithi099.stdout: e1 2024-03-30T14:03:29.600 INFO:journalctl@ceph.mon.a.smithi099.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-03-30T14:03:29.600 INFO:journalctl@ceph.mon.a.smithi099.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-03-30T14:03:29.600 INFO:journalctl@ceph.mon.a.smithi099.stdout: legacy client fscid: -1 2024-03-30T14:03:29.600 INFO:journalctl@ceph.mon.a.smithi099.stdout: 2024-03-30T14:03:29.601 INFO:journalctl@ceph.mon.a.smithi099.stdout: No filesystems configured 2024-03-30T14:03:29.601 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:29 smithi099 ceph-mon[133544]: mon.a@-1(???).osd e112 crush map has features 3314933000854323200, adjusting msgr requires 2024-03-30T14:03:29.601 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:29 smithi099 ceph-mon[133544]: mon.a@-1(???).osd e112 crush map has features 432629239337189376, adjusting msgr requires 2024-03-30T14:03:29.601 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:29 smithi099 ceph-mon[133544]: mon.a@-1(???).osd e112 crush map has features 432629239337189376, adjusting msgr requires 2024-03-30T14:03:29.601 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:29 smithi099 ceph-mon[133544]: mon.a@-1(???).osd e112 crush map has features 432629239337189376, adjusting msgr requires 2024-03-30T14:03:29.601 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:29 smithi099 ceph-mon[133544]: mon.a@-1(???).paxosservice(auth 1..29) refresh upgraded, format 0 -> 3 2024-03-30T14:03:29.601 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:29 smithi099 bash[133525]: 49273c0f848ca2a17b3ff755d9cb97cb5df6edd6b9e3c104a1f521f3f02766c7 2024-03-30T14:03:29.601 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:29 smithi099 systemd[1]: Started Ceph mon.a for 98ebaeb8-ee99-11ee-b647-cb9ed24678a4. 2024-03-30T14:03:29.951 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 14:03:29 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[71049]: ignoring --setuser ceph since I am not root 2024-03-30T14:03:29.951 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 14:03:29 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[71049]: ignoring --setgroup ceph since I am not root 2024-03-30T14:03:29.951 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 14:03:29 smithi099 ceph-mgr[71053]: -- 172.21.15.99:0/3097062444 <== mon.0 v2:172.21.15.99:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5621f59a05a0 con 0x5621f5975000 2024-03-30T14:03:29.951 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:29 smithi099 ceph-mon[133544]: pgmap v1743: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T14:03:29.951 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:29 smithi099 ceph-mon[133544]: pgmap v1744: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T14:03:29.952 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:29 smithi099 ceph-mon[133544]: mon.a calling monitor election 2024-03-30T14:03:29.952 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:29 smithi099 ceph-mon[133544]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-03-30T14:03:29.952 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:29 smithi099 ceph-mon[133544]: monmap epoch 3 2024-03-30T14:03:29.952 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:29 smithi099 ceph-mon[133544]: fsid 98ebaeb8-ee99-11ee-b647-cb9ed24678a4 2024-03-30T14:03:29.952 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:29 smithi099 ceph-mon[133544]: last_changed 2024-03-30T13:32:12.662639+0000 2024-03-30T14:03:29.952 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:29 smithi099 ceph-mon[133544]: created 2024-03-30T13:30:34.451427+0000 2024-03-30T14:03:29.952 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:29 smithi099 ceph-mon[133544]: min_mon_release 17 (quincy) 2024-03-30T14:03:29.952 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:29 smithi099 ceph-mon[133544]: election_strategy: 1 2024-03-30T14:03:29.952 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:29 smithi099 ceph-mon[133544]: 0: [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] mon.a 2024-03-30T14:03:29.952 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:29 smithi099 ceph-mon[133544]: 1: [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] mon.c 2024-03-30T14:03:29.952 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:29 smithi099 ceph-mon[133544]: 2: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.b 2024-03-30T14:03:29.952 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:29 smithi099 ceph-mon[133544]: fsmap 2024-03-30T14:03:29.952 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:29 smithi099 ceph-mon[133544]: osdmap e112: 8 total, 8 up, 8 in 2024-03-30T14:03:29.952 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:29 smithi099 ceph-mon[133544]: mgrmap e44: y(active, since 5m), standbys: x 2024-03-30T14:03:29.952 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:29 smithi099 ceph-mon[133544]: overall HEALTH_OK 2024-03-30T14:03:29.953 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:29 smithi099 ceph-mon[133544]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:03:29.953 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:29 smithi099 ceph-mon[133544]: mgrmap e45: y(active, since 5m), standbys: x 2024-03-30T14:03:29.953 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:29 smithi099 ceph-mon[133544]: from='mgr.25183 ' entity='' 2024-03-30T14:03:29.953 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:29 smithi099 ceph-mon[133544]: from='mgr.25183 ' entity='' 2024-03-30T14:03:29.953 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:29 smithi099 ceph-mon[29691]: pgmap v1743: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T14:03:29.953 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:29 smithi099 ceph-mon[29691]: pgmap v1744: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T14:03:29.953 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:29 smithi099 ceph-mon[29691]: mon.a calling monitor election 2024-03-30T14:03:29.953 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:29 smithi099 ceph-mon[29691]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-03-30T14:03:29.953 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:29 smithi099 ceph-mon[29691]: monmap epoch 3 2024-03-30T14:03:29.953 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:29 smithi099 ceph-mon[29691]: fsid 98ebaeb8-ee99-11ee-b647-cb9ed24678a4 2024-03-30T14:03:29.953 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:29 smithi099 ceph-mon[29691]: last_changed 2024-03-30T13:32:12.662639+0000 2024-03-30T14:03:29.953 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:29 smithi099 ceph-mon[29691]: created 2024-03-30T13:30:34.451427+0000 2024-03-30T14:03:29.953 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:29 smithi099 ceph-mon[29691]: min_mon_release 17 (quincy) 2024-03-30T14:03:29.954 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:29 smithi099 ceph-mon[29691]: election_strategy: 1 2024-03-30T14:03:29.954 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:29 smithi099 ceph-mon[29691]: 0: [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] mon.a 2024-03-30T14:03:29.954 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:29 smithi099 ceph-mon[29691]: 1: [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] mon.c 2024-03-30T14:03:29.954 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:29 smithi099 ceph-mon[29691]: 2: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.b 2024-03-30T14:03:29.954 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:29 smithi099 ceph-mon[29691]: fsmap 2024-03-30T14:03:29.954 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:29 smithi099 ceph-mon[29691]: osdmap e112: 8 total, 8 up, 8 in 2024-03-30T14:03:29.954 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:29 smithi099 ceph-mon[29691]: mgrmap e44: y(active, since 5m), standbys: x 2024-03-30T14:03:29.954 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:29 smithi099 ceph-mon[29691]: overall HEALTH_OK 2024-03-30T14:03:29.954 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:29 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:03:29.954 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:29 smithi099 ceph-mon[29691]: mgrmap e45: y(active, since 5m), standbys: x 2024-03-30T14:03:29.954 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:29 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='' 2024-03-30T14:03:29.954 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:29 smithi099 ceph-mon[29691]: from='mgr.25183 ' entity='' 2024-03-30T14:03:29.998 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 14:03:29 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-x[85749]: ignoring --setuser ceph since I am not root 2024-03-30T14:03:29.998 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 14:03:29 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-x[85749]: ignoring --setgroup ceph since I am not root 2024-03-30T14:03:29.998 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 14:03:29 smithi181 ceph-mgr[85753]: -- 172.21.15.181:0/1587662962 <== mon.2 v2:172.21.15.181:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5571189e85a0 con 0x5571189bd000 2024-03-30T14:03:29.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:29 smithi181 ceph-mon[115276]: pgmap v1743: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T14:03:29.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:29 smithi181 ceph-mon[115276]: pgmap v1744: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T14:03:29.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:29 smithi181 ceph-mon[115276]: mon.a calling monitor election 2024-03-30T14:03:29.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:29 smithi181 ceph-mon[115276]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-03-30T14:03:29.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:29 smithi181 ceph-mon[115276]: monmap epoch 3 2024-03-30T14:03:29.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:29 smithi181 ceph-mon[115276]: fsid 98ebaeb8-ee99-11ee-b647-cb9ed24678a4 2024-03-30T14:03:29.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:29 smithi181 ceph-mon[115276]: last_changed 2024-03-30T13:32:12.662639+0000 2024-03-30T14:03:29.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:29 smithi181 ceph-mon[115276]: created 2024-03-30T13:30:34.451427+0000 2024-03-30T14:03:29.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:29 smithi181 ceph-mon[115276]: min_mon_release 17 (quincy) 2024-03-30T14:03:29.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:29 smithi181 ceph-mon[115276]: election_strategy: 1 2024-03-30T14:03:29.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:29 smithi181 ceph-mon[115276]: 0: [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] mon.a 2024-03-30T14:03:29.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:29 smithi181 ceph-mon[115276]: 1: [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] mon.c 2024-03-30T14:03:29.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:29 smithi181 ceph-mon[115276]: 2: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.b 2024-03-30T14:03:29.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:29 smithi181 ceph-mon[115276]: fsmap 2024-03-30T14:03:30.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:29 smithi181 ceph-mon[115276]: osdmap e112: 8 total, 8 up, 8 in 2024-03-30T14:03:30.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:29 smithi181 ceph-mon[115276]: mgrmap e44: y(active, since 5m), standbys: x 2024-03-30T14:03:30.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:29 smithi181 ceph-mon[115276]: overall HEALTH_OK 2024-03-30T14:03:30.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:29 smithi181 ceph-mon[115276]: from='mgr.25183 ' entity='mgr.y' 2024-03-30T14:03:30.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:29 smithi181 ceph-mon[115276]: mgrmap e45: y(active, since 5m), standbys: x 2024-03-30T14:03:30.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:29 smithi181 ceph-mon[115276]: from='mgr.25183 ' entity='' 2024-03-30T14:03:30.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:29 smithi181 ceph-mon[115276]: from='mgr.25183 ' entity='' 2024-03-30T14:03:30.498 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 14:03:30 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-x[85749]: 2024-03-30T14:03:30.243+0000 7f20e3a37200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-03-30T14:03:30.498 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 14:03:30 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-x[85749]: 2024-03-30T14:03:30.338+0000 7f20e3a37200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-03-30T14:03:30.579 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 14:03:30 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[71049]: 2024-03-30T14:03:30.253+0000 7f3c4a742200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-03-30T14:03:30.580 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 14:03:30 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[71049]: 2024-03-30T14:03:30.352+0000 7f3c4a742200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-03-30T14:03:31.242 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 14:03:31 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-x[85749]: 2024-03-30T14:03:31.003+0000 7f20e3a37200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-03-30T14:03:31.243 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 14:03:31 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-x[85749]: 2024-03-30T14:03:31.098+0000 7f20e3a37200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-03-30T14:03:31.243 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 14:03:31 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-x[85749]: 2024-03-30T14:03:31.248+0000 7f20e3a37200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-03-30T14:03:31.258 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 14:03:31 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[71049]: 2024-03-30T14:03:31.023+0000 7f3c4a742200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-03-30T14:03:31.258 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 14:03:31 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[71049]: 2024-03-30T14:03:31.118+0000 7f3c4a742200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-03-30T14:03:31.258 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 14:03:31 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[71049]: 2024-03-30T14:03:31.264+0000 7f3c4a742200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-03-30T14:03:31.499 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 14:03:31 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-x[85749]: 2024-03-30T14:03:31.349+0000 7f20e3a37200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-03-30T14:03:31.499 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 14:03:31 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-x[85749]: 2024-03-30T14:03:31.437+0000 7f20e3a37200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-03-30T14:03:31.579 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 14:03:31 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[71049]: 2024-03-30T14:03:31.362+0000 7f3c4a742200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-03-30T14:03:31.580 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 14:03:31 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[71049]: 2024-03-30T14:03:31.446+0000 7f3c4a742200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-03-30T14:03:31.908 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:31 smithi099 ceph-mon[29691]: mgrmap e46: y(active, since 5m), standbys: x 2024-03-30T14:03:31.909 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:31 smithi099 ceph-mon[133544]: mgrmap e46: y(active, since 5m), standbys: x 2024-03-30T14:03:31.909 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 14:03:31 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[71049]: 2024-03-30T14:03:31.714+0000 7f3c4a742200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-03-30T14:03:31.909 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 14:03:31 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[71049]: 2024-03-30T14:03:31.826+0000 7f3c4a742200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-03-30T14:03:31.909 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 14:03:31 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[71049]: 2024-03-30T14:03:31.914+0000 7f3c4a742200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-03-30T14:03:31.924 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:31 smithi181 ceph-mon[115276]: mgrmap e46: y(active, since 5m), standbys: x 2024-03-30T14:03:31.924 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 14:03:31 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-x[85749]: 2024-03-30T14:03:31.717+0000 7f20e3a37200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-03-30T14:03:31.924 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 14:03:31 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-x[85749]: 2024-03-30T14:03:31.837+0000 7f20e3a37200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-03-30T14:03:31.924 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 14:03:31 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-x[85749]: 2024-03-30T14:03:31.929+0000 7f20e3a37200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-03-30T14:03:32.187 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 14:03:32 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[71049]: 2024-03-30T14:03:32.011+0000 7f3c4a742200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-03-30T14:03:32.217 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 14:03:32 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-x[85749]: 2024-03-30T14:03:32.032+0000 7f20e3a37200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-03-30T14:03:32.498 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 14:03:32 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-x[85749]: 2024-03-30T14:03:32.223+0000 7f20e3a37200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-03-30T14:03:32.579 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 14:03:32 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[71049]: 2024-03-30T14:03:32.193+0000 7f3c4a742200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-03-30T14:03:33.341 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 14:03:33 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-x[85749]: 2024-03-30T14:03:33.215+0000 7f20e3a37200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-03-30T14:03:33.342 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 14:03:33 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-x[85749]: 2024-03-30T14:03:33.347+0000 7f20e3a37200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-03-30T14:03:33.579 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 14:03:33 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[71049]: 2024-03-30T14:03:33.167+0000 7f3c4a742200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-03-30T14:03:33.579 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 14:03:33 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[71049]: 2024-03-30T14:03:33.300+0000 7f3c4a742200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-03-30T14:03:33.936 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 14:03:33 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[71049]: 2024-03-30T14:03:33.644+0000 7f3c4a742200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-03-30T14:03:33.936 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 14:03:33 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[71049]: 2024-03-30T14:03:33.737+0000 7f3c4a742200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-03-30T14:03:33.936 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 14:03:33 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[71049]: 2024-03-30T14:03:33.942+0000 7f3c4a742200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-03-30T14:03:33.976 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 14:03:33 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-x[85749]: 2024-03-30T14:03:33.688+0000 7f20e3a37200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-03-30T14:03:33.976 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 14:03:33 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-x[85749]: 2024-03-30T14:03:33.781+0000 7f20e3a37200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-03-30T14:03:33.976 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 14:03:33 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-x[85749]: 2024-03-30T14:03:33.982+0000 7f20e3a37200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-03-30T14:03:34.248 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 14:03:34 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-x[85749]: 2024-03-30T14:03:34.172+0000 7f20e3a37200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-03-30T14:03:34.329 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 14:03:34 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[71049]: 2024-03-30T14:03:34.133+0000 7f3c4a742200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-03-30T14:03:34.692 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 14:03:34 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[71049]: 2024-03-30T14:03:34.429+0000 7f3c4a742200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-03-30T14:03:34.739 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 14:03:34 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-x[85749]: 2024-03-30T14:03:34.479+0000 7f20e3a37200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-03-30T14:03:34.998 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 14:03:34 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-x[85749]: 2024-03-30T14:03:34.745+0000 7f20e3a37200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-03-30T14:03:34.999 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 14:03:34 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-x[85749]: 2024-03-30T14:03:34.986+0000 7f20e3a37200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-03-30T14:03:35.079 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 14:03:34 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[71049]: 2024-03-30T14:03:34.698+0000 7f3c4a742200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-03-30T14:03:35.079 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 14:03:34 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[71049]: 2024-03-30T14:03:34.941+0000 7f3c4a742200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-03-30T14:03:36.079 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 14:03:35 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[71049]: 2024-03-30T14:03:35.768+0000 7f3c4a742200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-03-30T14:03:36.248 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 14:03:35 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-x[85749]: 2024-03-30T14:03:35.802+0000 7f20e3a37200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-03-30T14:03:36.667 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 14:03:36 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[71049]: 2024-03-30T14:03:36.345+0000 7f3c4a742200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-03-30T14:03:36.668 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 14:03:36 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[71049]: 2024-03-30T14:03:36.448+0000 7f3c4a742200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-03-30T14:03:36.668 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 14:03:36 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[71049]: 2024-03-30T14:03:36.673+0000 7f3c4a742200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-03-30T14:03:36.705 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 14:03:36 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-x[85749]: 2024-03-30T14:03:36.382+0000 7f20e3a37200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-03-30T14:03:36.705 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 14:03:36 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-x[85749]: 2024-03-30T14:03:36.483+0000 7f20e3a37200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-03-30T14:03:36.999 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 14:03:36 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-x[85749]: 2024-03-30T14:03:36.711+0000 7f20e3a37200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-03-30T14:03:36.999 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 14:03:36 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-x[85749]: [30/Mar/2024:14:03:36] ENGINE Bus STARTING 2024-03-30T14:03:36.999 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 14:03:36 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-x[85749]: CherryPy Checker: 2024-03-30T14:03:36.999 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 14:03:36 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-x[85749]: The Application mounted at '' has an empty config. 2024-03-30T14:03:36.999 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 14:03:36 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-x[85749]: 2024-03-30T14:03:36.999 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 14:03:36 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-x[85749]: [30/Mar/2024:14:03:36] ENGINE Serving on http://:::9283 2024-03-30T14:03:36.999 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 14:03:36 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-x[85749]: [30/Mar/2024:14:03:36] ENGINE Bus STARTED 2024-03-30T14:03:37.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:36 smithi181 ceph-mon[115276]: Active manager daemon y restarted 2024-03-30T14:03:37.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:36 smithi181 ceph-mon[115276]: Activating manager daemon y 2024-03-30T14:03:37.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:36 smithi181 ceph-mon[115276]: osdmap e113: 8 total, 8 up, 8 in 2024-03-30T14:03:37.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:36 smithi181 ceph-mon[115276]: mgrmap e47: y(active, starting, since 0.00666988s), standbys: x 2024-03-30T14:03:37.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:36 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-03-30T14:03:37.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:36 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-30T14:03:37.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:36 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-30T14:03:37.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:36 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-03-30T14:03:37.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:36 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-03-30T14:03:37.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:36 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-03-30T14:03:37.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:36 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-03-30T14:03:37.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:36 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-03-30T14:03:37.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:36 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-03-30T14:03:37.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:36 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-03-30T14:03:37.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:36 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-03-30T14:03:37.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:36 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-03-30T14:03:37.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:36 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-03-30T14:03:37.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:36 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-03-30T14:03:37.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:36 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-03-30T14:03:37.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:36 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-03-30T14:03:37.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:36 smithi181 ceph-mon[115276]: Manager daemon y is now available 2024-03-30T14:03:37.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:36 smithi181 ceph-mon[115276]: Standby manager daemon x restarted 2024-03-30T14:03:37.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:36 smithi181 ceph-mon[115276]: Standby manager daemon x started 2024-03-30T14:03:37.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:36 smithi181 ceph-mon[115276]: from='mgr.? 172.21.15.181:0/3494970047' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/crt"}]: dispatch 2024-03-30T14:03:37.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:36 smithi181 ceph-mon[115276]: from='mgr.? 172.21.15.181:0/3494970047' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-03-30T14:03:37.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:36 smithi181 ceph-mon[115276]: from='mgr.? 172.21.15.181:0/3494970047' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/key"}]: dispatch 2024-03-30T14:03:37.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:36 smithi181 ceph-mon[115276]: from='mgr.? 172.21.15.181:0/3494970047' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-03-30T14:03:37.079 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 14:03:36 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[71049]: [30/Mar/2024:14:03:36] ENGINE Bus STARTING 2024-03-30T14:03:37.079 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 14:03:36 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[71049]: CherryPy Checker: 2024-03-30T14:03:37.080 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 14:03:36 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[71049]: The Application mounted at '' has an empty config. 2024-03-30T14:03:37.080 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 14:03:36 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[71049]: 2024-03-30T14:03:37.080 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 14:03:36 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[71049]: [30/Mar/2024:14:03:36] ENGINE Serving on http://:::9283 2024-03-30T14:03:37.080 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 14:03:36 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[71049]: [30/Mar/2024:14:03:36] ENGINE Bus STARTED 2024-03-30T14:03:37.080 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:36 smithi099 ceph-mon[133544]: Active manager daemon y restarted 2024-03-30T14:03:37.080 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:36 smithi099 ceph-mon[133544]: Activating manager daemon y 2024-03-30T14:03:37.080 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:36 smithi099 ceph-mon[133544]: osdmap e113: 8 total, 8 up, 8 in 2024-03-30T14:03:37.080 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:36 smithi099 ceph-mon[133544]: mgrmap e47: y(active, starting, since 0.00666988s), standbys: x 2024-03-30T14:03:37.080 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:36 smithi099 ceph-mon[133544]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-03-30T14:03:37.080 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:36 smithi099 ceph-mon[133544]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-30T14:03:37.081 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:36 smithi099 ceph-mon[133544]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-30T14:03:37.081 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:36 smithi099 ceph-mon[133544]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-03-30T14:03:37.081 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:36 smithi099 ceph-mon[133544]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-03-30T14:03:37.081 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:36 smithi099 ceph-mon[133544]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-03-30T14:03:37.081 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:36 smithi099 ceph-mon[133544]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-03-30T14:03:37.081 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:36 smithi099 ceph-mon[133544]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-03-30T14:03:37.081 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:36 smithi099 ceph-mon[133544]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-03-30T14:03:37.081 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:36 smithi099 ceph-mon[133544]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-03-30T14:03:37.081 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:36 smithi099 ceph-mon[133544]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-03-30T14:03:37.081 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:36 smithi099 ceph-mon[133544]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-03-30T14:03:37.081 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:36 smithi099 ceph-mon[133544]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-03-30T14:03:37.081 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:36 smithi099 ceph-mon[133544]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-03-30T14:03:37.081 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:36 smithi099 ceph-mon[133544]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-03-30T14:03:37.081 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:36 smithi099 ceph-mon[133544]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-03-30T14:03:37.081 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:36 smithi099 ceph-mon[133544]: Manager daemon y is now available 2024-03-30T14:03:37.081 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:36 smithi099 ceph-mon[133544]: Standby manager daemon x restarted 2024-03-30T14:03:37.082 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:36 smithi099 ceph-mon[133544]: Standby manager daemon x started 2024-03-30T14:03:37.082 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:36 smithi099 ceph-mon[133544]: from='mgr.? 172.21.15.181:0/3494970047' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/crt"}]: dispatch 2024-03-30T14:03:37.082 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:36 smithi099 ceph-mon[133544]: from='mgr.? 172.21.15.181:0/3494970047' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-03-30T14:03:37.082 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:36 smithi099 ceph-mon[133544]: from='mgr.? 172.21.15.181:0/3494970047' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/key"}]: dispatch 2024-03-30T14:03:37.082 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:36 smithi099 ceph-mon[133544]: from='mgr.? 172.21.15.181:0/3494970047' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-03-30T14:03:37.082 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:36 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mon-c[29687]: 2024-03-30T14:03:36.678+0000 7f973a2c4700 -1 mon.c@1(peon).osd e113 update_from_paxos full map CRC mismatch, resetting to canonical 2024-03-30T14:03:37.082 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:36 smithi099 ceph-mon[29691]: Active manager daemon y restarted 2024-03-30T14:03:37.082 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:36 smithi099 ceph-mon[29691]: Activating manager daemon y 2024-03-30T14:03:37.082 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:36 smithi099 ceph-mon[29691]: osdmap e113: 8 total, 8 up, 8 in 2024-03-30T14:03:37.082 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:36 smithi099 ceph-mon[29691]: mgrmap e47: y(active, starting, since 0.00666988s), standbys: x 2024-03-30T14:03:37.082 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:36 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-03-30T14:03:37.082 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:36 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-30T14:03:37.082 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:36 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-30T14:03:37.083 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:36 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-03-30T14:03:37.083 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:36 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-03-30T14:03:37.083 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:36 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-03-30T14:03:37.083 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:36 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-03-30T14:03:37.083 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:36 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-03-30T14:03:37.083 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:36 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-03-30T14:03:37.083 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:36 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-03-30T14:03:37.083 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:36 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-03-30T14:03:37.083 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:36 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-03-30T14:03:37.083 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:36 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-03-30T14:03:37.083 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:36 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-03-30T14:03:37.083 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:36 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-03-30T14:03:37.083 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:36 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-03-30T14:03:37.083 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:36 smithi099 ceph-mon[29691]: Manager daemon y is now available 2024-03-30T14:03:37.083 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:36 smithi099 ceph-mon[29691]: Standby manager daemon x restarted 2024-03-30T14:03:37.083 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:36 smithi099 ceph-mon[29691]: Standby manager daemon x started 2024-03-30T14:03:37.084 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:36 smithi099 ceph-mon[29691]: from='mgr.? 172.21.15.181:0/3494970047' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/crt"}]: dispatch 2024-03-30T14:03:37.084 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:36 smithi099 ceph-mon[29691]: from='mgr.? 172.21.15.181:0/3494970047' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-03-30T14:03:37.084 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:36 smithi099 ceph-mon[29691]: from='mgr.? 172.21.15.181:0/3494970047' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/key"}]: dispatch 2024-03-30T14:03:37.084 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:36 smithi099 ceph-mon[29691]: from='mgr.? 172.21.15.181:0/3494970047' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-03-30T14:03:37.998 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:37 smithi181 ceph-mon[115276]: failed to encode map e113 with expected crc 2024-03-30T14:03:37.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:37 smithi181 ceph-mon[115276]: failed to encode map e113 with expected crc 2024-03-30T14:03:37.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:37 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' 2024-03-30T14:03:37.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:37 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd/host:smithi099", "name": "osd_memory_target"}]: dispatch 2024-03-30T14:03:37.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:37 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd/host:smithi181", "name": "osd_memory_target"}]: dispatch 2024-03-30T14:03:37.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:37 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:03:37.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:37 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:03:37.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:37 smithi181 ceph-mon[115276]: Updating smithi099:/etc/ceph/ceph.conf 2024-03-30T14:03:37.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:37 smithi181 ceph-mon[115276]: Updating smithi181:/etc/ceph/ceph.conf 2024-03-30T14:03:37.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:37 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T14:03:37.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:37 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-03-30T14:03:37.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:37 smithi181 ceph-mon[115276]: failed to encode map e113 with expected crc 2024-03-30T14:03:37.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:37 smithi181 ceph-mon[115276]: failed to encode map e113 with expected crc 2024-03-30T14:03:37.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:37 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-03-30T14:03:38.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:37 smithi181 ceph-mon[115276]: failed to encode map e113 with expected crc 2024-03-30T14:03:38.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:37 smithi181 ceph-mon[115276]: failed to encode map e113 with expected crc 2024-03-30T14:03:38.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:37 smithi181 ceph-mon[115276]: failed to encode map e113 with expected crc 2024-03-30T14:03:38.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:37 smithi181 ceph-mon[115276]: failed to encode map e113 with expected crc 2024-03-30T14:03:38.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:37 smithi181 ceph-mon[115276]: Updating smithi181:/var/lib/ceph/98ebaeb8-ee99-11ee-b647-cb9ed24678a4/config/ceph.conf 2024-03-30T14:03:38.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:37 smithi181 ceph-mon[115276]: Updating smithi099:/var/lib/ceph/98ebaeb8-ee99-11ee-b647-cb9ed24678a4/config/ceph.conf 2024-03-30T14:03:38.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:37 smithi181 ceph-mon[115276]: [30/Mar/2024:14:03:37] ENGINE Bus STARTING 2024-03-30T14:03:38.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:37 smithi181 ceph-mon[115276]: [30/Mar/2024:14:03:37] ENGINE Serving on http://172.21.15.99:8765 2024-03-30T14:03:38.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:37 smithi181 ceph-mon[115276]: Updating smithi181:/etc/ceph/ceph.client.admin.keyring 2024-03-30T14:03:38.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:37 smithi181 ceph-mon[115276]: Updating smithi099:/etc/ceph/ceph.client.admin.keyring 2024-03-30T14:03:38.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:37 smithi181 ceph-mon[115276]: [30/Mar/2024:14:03:37] ENGINE Serving on https://172.21.15.99:7151 2024-03-30T14:03:38.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:37 smithi181 ceph-mon[115276]: [30/Mar/2024:14:03:37] ENGINE Bus STARTED 2024-03-30T14:03:38.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:37 smithi181 ceph-mon[115276]: mgrmap e48: y(active, since 1.01027s), standbys: x 2024-03-30T14:03:38.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:37 smithi181 ceph-mon[115276]: from='client.25136 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T14:03:38.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:37 smithi181 ceph-mon[115276]: pgmap v3: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:03:38.079 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 14:03:37 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[71049]: 2024-03-30T14:03:37.693+0000 7f3c008ec700 -1 mgr.server handle_report got status from non-daemon mon.a 2024-03-30T14:03:38.079 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:37 smithi099 ceph-mon[29691]: failed to encode map e113 with expected crc 2024-03-30T14:03:38.079 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:37 smithi099 ceph-mon[29691]: failed to encode map e113 with expected crc 2024-03-30T14:03:38.080 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:37 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' 2024-03-30T14:03:38.080 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:37 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd/host:smithi099", "name": "osd_memory_target"}]: dispatch 2024-03-30T14:03:38.080 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:37 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd/host:smithi181", "name": "osd_memory_target"}]: dispatch 2024-03-30T14:03:38.080 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:37 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:03:38.080 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:37 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:03:38.080 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:37 smithi099 ceph-mon[29691]: Updating smithi099:/etc/ceph/ceph.conf 2024-03-30T14:03:38.080 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:37 smithi099 ceph-mon[29691]: Updating smithi181:/etc/ceph/ceph.conf 2024-03-30T14:03:38.080 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:37 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T14:03:38.080 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:37 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-03-30T14:03:38.080 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:37 smithi099 ceph-mon[29691]: failed to encode map e113 with expected crc 2024-03-30T14:03:38.080 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:37 smithi099 ceph-mon[29691]: failed to encode map e113 with expected crc 2024-03-30T14:03:38.080 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:37 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-03-30T14:03:38.080 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:37 smithi099 ceph-mon[29691]: failed to encode map e113 with expected crc 2024-03-30T14:03:38.081 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:37 smithi099 ceph-mon[29691]: failed to encode map e113 with expected crc 2024-03-30T14:03:38.081 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:37 smithi099 ceph-mon[29691]: failed to encode map e113 with expected crc 2024-03-30T14:03:38.081 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:37 smithi099 ceph-mon[29691]: failed to encode map e113 with expected crc 2024-03-30T14:03:38.081 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:37 smithi099 ceph-mon[29691]: Updating smithi181:/var/lib/ceph/98ebaeb8-ee99-11ee-b647-cb9ed24678a4/config/ceph.conf 2024-03-30T14:03:38.081 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:37 smithi099 ceph-mon[29691]: Updating smithi099:/var/lib/ceph/98ebaeb8-ee99-11ee-b647-cb9ed24678a4/config/ceph.conf 2024-03-30T14:03:38.081 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:37 smithi099 ceph-mon[29691]: [30/Mar/2024:14:03:37] ENGINE Bus STARTING 2024-03-30T14:03:38.081 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:37 smithi099 ceph-mon[29691]: [30/Mar/2024:14:03:37] ENGINE Serving on http://172.21.15.99:8765 2024-03-30T14:03:38.081 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:37 smithi099 ceph-mon[29691]: Updating smithi181:/etc/ceph/ceph.client.admin.keyring 2024-03-30T14:03:38.081 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:37 smithi099 ceph-mon[29691]: Updating smithi099:/etc/ceph/ceph.client.admin.keyring 2024-03-30T14:03:38.081 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:37 smithi099 ceph-mon[29691]: [30/Mar/2024:14:03:37] ENGINE Serving on https://172.21.15.99:7151 2024-03-30T14:03:38.081 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:37 smithi099 ceph-mon[29691]: [30/Mar/2024:14:03:37] ENGINE Bus STARTED 2024-03-30T14:03:38.081 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:37 smithi099 ceph-mon[29691]: mgrmap e48: y(active, since 1.01027s), standbys: x 2024-03-30T14:03:38.081 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:37 smithi099 ceph-mon[29691]: from='client.25136 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T14:03:38.081 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:37 smithi099 ceph-mon[29691]: pgmap v3: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:03:38.082 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:37 smithi099 ceph-mon[133544]: failed to encode map e113 with expected crc 2024-03-30T14:03:38.082 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:37 smithi099 ceph-mon[133544]: failed to encode map e113 with expected crc 2024-03-30T14:03:38.082 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:37 smithi099 ceph-mon[133544]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' 2024-03-30T14:03:38.082 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:37 smithi099 ceph-mon[133544]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd/host:smithi099", "name": "osd_memory_target"}]: dispatch 2024-03-30T14:03:38.082 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:37 smithi099 ceph-mon[133544]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd/host:smithi181", "name": "osd_memory_target"}]: dispatch 2024-03-30T14:03:38.082 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:37 smithi099 ceph-mon[133544]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:03:38.082 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:37 smithi099 ceph-mon[133544]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:03:38.082 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:37 smithi099 ceph-mon[133544]: Updating smithi099:/etc/ceph/ceph.conf 2024-03-30T14:03:38.082 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:37 smithi099 ceph-mon[133544]: Updating smithi181:/etc/ceph/ceph.conf 2024-03-30T14:03:38.082 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:37 smithi099 ceph-mon[133544]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T14:03:38.082 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:37 smithi099 ceph-mon[133544]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-03-30T14:03:38.082 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:37 smithi099 ceph-mon[133544]: failed to encode map e113 with expected crc 2024-03-30T14:03:38.083 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:37 smithi099 ceph-mon[133544]: failed to encode map e113 with expected crc 2024-03-30T14:03:38.083 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:37 smithi099 ceph-mon[133544]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-03-30T14:03:38.083 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:37 smithi099 ceph-mon[133544]: failed to encode map e113 with expected crc 2024-03-30T14:03:38.083 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:37 smithi099 ceph-mon[133544]: failed to encode map e113 with expected crc 2024-03-30T14:03:38.083 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:37 smithi099 ceph-mon[133544]: failed to encode map e113 with expected crc 2024-03-30T14:03:38.083 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:37 smithi099 ceph-mon[133544]: failed to encode map e113 with expected crc 2024-03-30T14:03:38.083 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:37 smithi099 ceph-mon[133544]: Updating smithi181:/var/lib/ceph/98ebaeb8-ee99-11ee-b647-cb9ed24678a4/config/ceph.conf 2024-03-30T14:03:38.083 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:37 smithi099 ceph-mon[133544]: Updating smithi099:/var/lib/ceph/98ebaeb8-ee99-11ee-b647-cb9ed24678a4/config/ceph.conf 2024-03-30T14:03:38.083 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:37 smithi099 ceph-mon[133544]: [30/Mar/2024:14:03:37] ENGINE Bus STARTING 2024-03-30T14:03:38.083 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:37 smithi099 ceph-mon[133544]: [30/Mar/2024:14:03:37] ENGINE Serving on http://172.21.15.99:8765 2024-03-30T14:03:38.083 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:37 smithi099 ceph-mon[133544]: Updating smithi181:/etc/ceph/ceph.client.admin.keyring 2024-03-30T14:03:38.083 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:37 smithi099 ceph-mon[133544]: Updating smithi099:/etc/ceph/ceph.client.admin.keyring 2024-03-30T14:03:38.083 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:37 smithi099 ceph-mon[133544]: [30/Mar/2024:14:03:37] ENGINE Serving on https://172.21.15.99:7151 2024-03-30T14:03:38.083 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:37 smithi099 ceph-mon[133544]: [30/Mar/2024:14:03:37] ENGINE Bus STARTED 2024-03-30T14:03:38.083 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:37 smithi099 ceph-mon[133544]: mgrmap e48: y(active, since 1.01027s), standbys: x 2024-03-30T14:03:38.084 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:37 smithi099 ceph-mon[133544]: from='client.25136 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T14:03:38.084 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:37 smithi099 ceph-mon[133544]: pgmap v3: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:03:39.329 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:39 smithi099 ceph-mon[133544]: Updating smithi181:/var/lib/ceph/98ebaeb8-ee99-11ee-b647-cb9ed24678a4/config/ceph.client.admin.keyring 2024-03-30T14:03:39.330 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:39 smithi099 ceph-mon[133544]: Updating smithi099:/var/lib/ceph/98ebaeb8-ee99-11ee-b647-cb9ed24678a4/config/ceph.client.admin.keyring 2024-03-30T14:03:39.330 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:39 smithi099 ceph-mon[133544]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' 2024-03-30T14:03:39.330 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:39 smithi099 ceph-mon[133544]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' 2024-03-30T14:03:39.330 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:39 smithi099 ceph-mon[133544]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' 2024-03-30T14:03:39.330 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:39 smithi099 ceph-mon[133544]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' 2024-03-30T14:03:39.330 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:39 smithi099 ceph-mon[133544]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' 2024-03-30T14:03:39.330 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:39 smithi099 ceph-mon[133544]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' 2024-03-30T14:03:39.330 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:39 smithi099 ceph-mon[133544]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.agent.smithi099", "caps": []}]: dispatch 2024-03-30T14:03:39.330 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:39 smithi099 ceph-mon[133544]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.agent.smithi181", "caps": []}]: dispatch 2024-03-30T14:03:39.330 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:39 smithi099 ceph-mon[133544]: pgmap v4: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:03:39.330 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:39 smithi099 ceph-mon[29691]: Updating smithi181:/var/lib/ceph/98ebaeb8-ee99-11ee-b647-cb9ed24678a4/config/ceph.client.admin.keyring 2024-03-30T14:03:39.331 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:39 smithi099 ceph-mon[29691]: Updating smithi099:/var/lib/ceph/98ebaeb8-ee99-11ee-b647-cb9ed24678a4/config/ceph.client.admin.keyring 2024-03-30T14:03:39.331 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:39 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' 2024-03-30T14:03:39.331 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:39 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' 2024-03-30T14:03:39.331 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:39 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' 2024-03-30T14:03:39.331 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:39 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' 2024-03-30T14:03:39.331 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:39 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' 2024-03-30T14:03:39.331 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:39 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' 2024-03-30T14:03:39.331 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:39 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.agent.smithi099", "caps": []}]: dispatch 2024-03-30T14:03:39.331 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:39 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.agent.smithi181", "caps": []}]: dispatch 2024-03-30T14:03:39.331 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:39 smithi099 ceph-mon[29691]: pgmap v4: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:03:39.498 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:39 smithi181 ceph-mon[115276]: Updating smithi181:/var/lib/ceph/98ebaeb8-ee99-11ee-b647-cb9ed24678a4/config/ceph.client.admin.keyring 2024-03-30T14:03:39.499 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:39 smithi181 ceph-mon[115276]: Updating smithi099:/var/lib/ceph/98ebaeb8-ee99-11ee-b647-cb9ed24678a4/config/ceph.client.admin.keyring 2024-03-30T14:03:39.499 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:39 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' 2024-03-30T14:03:39.499 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:39 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' 2024-03-30T14:03:39.499 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:39 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' 2024-03-30T14:03:39.499 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:39 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' 2024-03-30T14:03:39.499 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:39 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' 2024-03-30T14:03:39.499 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:39 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' 2024-03-30T14:03:39.499 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:39 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.agent.smithi099", "caps": []}]: dispatch 2024-03-30T14:03:39.499 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:39 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.agent.smithi181", "caps": []}]: dispatch 2024-03-30T14:03:39.499 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:39 smithi181 ceph-mon[115276]: pgmap v4: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:03:40.270 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:40 smithi099 ceph-mon[133544]: mgrmap e49: y(active, since 2s), standbys: x 2024-03-30T14:03:40.270 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:40 smithi099 ceph-mon[133544]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' 2024-03-30T14:03:40.270 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:40 smithi099 ceph-mon[133544]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' 2024-03-30T14:03:40.270 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:40 smithi099 ceph-mon[133544]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:03:40.270 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:40 smithi099 ceph-mon[133544]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:03:40.270 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:40 smithi099 ceph-mon[133544]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.agent.smithi181", "caps": []}]: dispatch 2024-03-30T14:03:40.271 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:40 smithi099 ceph-mon[29691]: mgrmap e49: y(active, since 2s), standbys: x 2024-03-30T14:03:40.271 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:40 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' 2024-03-30T14:03:40.271 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:40 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' 2024-03-30T14:03:40.271 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:40 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:03:40.271 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:40 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:03:40.271 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:40 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.agent.smithi181", "caps": []}]: dispatch 2024-03-30T14:03:40.498 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:40 smithi181 ceph-mon[115276]: mgrmap e49: y(active, since 2s), standbys: x 2024-03-30T14:03:40.498 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:40 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' 2024-03-30T14:03:40.499 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:40 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' 2024-03-30T14:03:40.499 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:40 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:03:40.499 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:40 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:03:40.499 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:40 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.agent.smithi181", "caps": []}]: dispatch 2024-03-30T14:03:41.080 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:41 smithi099 ceph-mon[133544]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:03:41.080 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:41 smithi099 ceph-mon[133544]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:03:41.080 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:41 smithi099 ceph-mon[133544]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' 2024-03-30T14:03:41.080 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:41 smithi099 ceph-mon[133544]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:03:41.080 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:41 smithi099 ceph-mon[133544]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.agent.smithi181", "caps": []}]: dispatch 2024-03-30T14:03:41.080 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:41 smithi099 ceph-mon[133544]: pgmap v5: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:03:41.080 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:41 smithi099 ceph-mon[133544]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' 2024-03-30T14:03:41.080 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:41 smithi099 ceph-mon[133544]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:03:41.080 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:41 smithi099 ceph-mon[133544]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:03:41.080 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:41 smithi099 ceph-mon[133544]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:03:41.080 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:41 smithi099 ceph-mon[133544]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:03:41.081 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:41 smithi099 ceph-mon[133544]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' 2024-03-30T14:03:41.081 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:41 smithi099 ceph-mon[133544]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' 2024-03-30T14:03:41.081 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:41 smithi099 ceph-mon[133544]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' 2024-03-30T14:03:41.081 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:41 smithi099 ceph-mon[133544]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:03:41.081 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:41 smithi099 ceph-mon[133544]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:03:41.081 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:41 smithi099 ceph-mon[133544]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:03:41.081 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:41 smithi099 ceph-mon[133544]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:03:41.081 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:41 smithi099 ceph-mon[133544]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' 2024-03-30T14:03:41.081 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:41 smithi099 ceph-mon[133544]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' 2024-03-30T14:03:41.081 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:41 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:03:41.081 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:41 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:03:41.081 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:41 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' 2024-03-30T14:03:41.081 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:41 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:03:41.081 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:41 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.agent.smithi181", "caps": []}]: dispatch 2024-03-30T14:03:41.082 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:41 smithi099 ceph-mon[29691]: pgmap v5: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:03:41.082 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:41 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' 2024-03-30T14:03:41.082 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:41 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:03:41.082 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:41 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:03:41.082 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:41 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:03:41.082 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:41 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:03:41.082 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:41 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' 2024-03-30T14:03:41.082 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:41 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' 2024-03-30T14:03:41.082 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:41 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' 2024-03-30T14:03:41.082 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:41 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:03:41.082 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:41 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:03:41.082 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:41 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:03:41.082 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:41 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:03:41.082 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:41 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' 2024-03-30T14:03:41.082 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:41 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' 2024-03-30T14:03:41.378 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:41 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:03:41.378 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:41 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:03:41.378 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:41 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' 2024-03-30T14:03:41.378 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:41 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:03:41.378 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:41 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.agent.smithi181", "caps": []}]: dispatch 2024-03-30T14:03:41.379 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:41 smithi181 ceph-mon[115276]: pgmap v5: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:03:41.379 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:41 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' 2024-03-30T14:03:41.379 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:41 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:03:41.379 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:41 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:03:41.379 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:41 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:03:41.379 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:41 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:03:41.379 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:41 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' 2024-03-30T14:03:41.379 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:41 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' 2024-03-30T14:03:41.379 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:41 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' 2024-03-30T14:03:41.379 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:41 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:03:41.379 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:41 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:03:41.379 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:41 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:03:41.379 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:41 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:03:41.379 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:41 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' 2024-03-30T14:03:41.379 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:41 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' 2024-03-30T14:03:42.381 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:42 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:03:42.381 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:42 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:03:42.381 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:42 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' 2024-03-30T14:03:42.381 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:42 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:03:42.381 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:42 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:03:42.381 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:42 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:03:42.381 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:42 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:03:42.381 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:42 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' 2024-03-30T14:03:42.381 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:42 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:03:42.381 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:42 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' 2024-03-30T14:03:42.381 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:42 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:03:42.382 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:42 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:03:42.382 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:42 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:03:42.382 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:42 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:03:42.382 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:42 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' 2024-03-30T14:03:42.382 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:42 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:03:42.382 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:42 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' 2024-03-30T14:03:42.382 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:42 smithi181 ceph-mon[115276]: mgrmap e50: y(active, since 4s), standbys: x 2024-03-30T14:03:42.382 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:42 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:03:42.382 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:42 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:03:42.382 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:42 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:03:42.382 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:42 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:03:42.382 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:42 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' 2024-03-30T14:03:42.382 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:42 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:03:42.383 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:42 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:03:42.383 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:42 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:03:42.383 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:42 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:03:42.383 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:42 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:03:42.383 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:42 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' 2024-03-30T14:03:42.383 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:42 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:03:42.383 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:42 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:03:42.383 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:42 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:03:42.383 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:42 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:03:42.383 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:42 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:03:42.383 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:42 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' 2024-03-30T14:03:42.383 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:42 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' 2024-03-30T14:03:42.383 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:42 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' 2024-03-30T14:03:42.383 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:42 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' 2024-03-30T14:03:42.384 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:42 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:03:42.384 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:42 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:03:42.384 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:42 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:03:42.384 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:42 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:03:42.384 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:42 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' 2024-03-30T14:03:42.384 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:42 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:03:42.384 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:42 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:03:42.384 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:42 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:03:42.384 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:42 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:03:42.384 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:42 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' 2024-03-30T14:03:42.384 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:42 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:03:42.384 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:42 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:03:42.384 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:42 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:03:42.384 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:42 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:03:42.385 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:42 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' 2024-03-30T14:03:42.549 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:42 smithi099 ceph-mon[133544]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:03:42.549 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:42 smithi099 ceph-mon[133544]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:03:42.549 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:42 smithi099 ceph-mon[133544]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' 2024-03-30T14:03:42.549 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:42 smithi099 ceph-mon[133544]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:03:42.549 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:42 smithi099 ceph-mon[133544]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:03:42.550 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:42 smithi099 ceph-mon[133544]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:03:42.550 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:42 smithi099 ceph-mon[133544]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:03:42.550 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:42 smithi099 ceph-mon[133544]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' 2024-03-30T14:03:42.550 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:42 smithi099 ceph-mon[133544]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:03:42.550 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:42 smithi099 ceph-mon[133544]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' 2024-03-30T14:03:42.550 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:42 smithi099 ceph-mon[133544]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:03:42.550 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:42 smithi099 ceph-mon[133544]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:03:42.550 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:42 smithi099 ceph-mon[133544]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:03:42.550 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:42 smithi099 ceph-mon[133544]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:03:42.550 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:42 smithi099 ceph-mon[133544]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' 2024-03-30T14:03:42.550 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:42 smithi099 ceph-mon[133544]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:03:42.550 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:42 smithi099 ceph-mon[133544]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' 2024-03-30T14:03:42.550 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:42 smithi099 ceph-mon[133544]: mgrmap e50: y(active, since 4s), standbys: x 2024-03-30T14:03:42.550 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:42 smithi099 ceph-mon[133544]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:03:42.551 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:42 smithi099 ceph-mon[133544]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:03:42.551 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:42 smithi099 ceph-mon[133544]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:03:42.551 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:42 smithi099 ceph-mon[133544]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:03:42.551 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:42 smithi099 ceph-mon[133544]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' 2024-03-30T14:03:42.551 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:42 smithi099 ceph-mon[133544]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:03:42.551 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:42 smithi099 ceph-mon[133544]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:03:42.551 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:42 smithi099 ceph-mon[133544]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:03:42.551 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:42 smithi099 ceph-mon[133544]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:03:42.551 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:42 smithi099 ceph-mon[133544]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:03:42.551 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:42 smithi099 ceph-mon[133544]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' 2024-03-30T14:03:42.551 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:42 smithi099 ceph-mon[133544]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:03:42.552 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:42 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:03:42.552 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:42 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:03:42.552 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:42 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' 2024-03-30T14:03:42.552 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:42 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:03:42.552 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:42 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:03:42.552 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:42 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:03:42.552 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:42 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:03:42.552 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:42 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' 2024-03-30T14:03:42.552 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:42 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:03:42.552 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:42 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' 2024-03-30T14:03:42.552 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:42 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:03:42.552 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:42 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:03:42.552 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:42 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:03:42.552 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:42 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:03:42.553 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:42 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' 2024-03-30T14:03:42.553 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:42 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:03:42.553 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:42 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' 2024-03-30T14:03:42.553 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:42 smithi099 ceph-mon[29691]: mgrmap e50: y(active, since 4s), standbys: x 2024-03-30T14:03:42.553 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:42 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:03:42.553 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:42 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:03:42.553 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:42 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:03:42.553 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:42 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:03:42.553 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:42 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' 2024-03-30T14:03:42.553 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:42 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:03:42.553 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:42 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:03:42.553 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:42 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:03:42.553 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:42 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:03:42.553 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:42 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:03:42.553 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:42 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' 2024-03-30T14:03:42.554 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:42 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:03:42.554 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:42 smithi099 ceph-mon[133544]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:03:42.554 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:42 smithi099 ceph-mon[133544]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:03:42.554 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:42 smithi099 ceph-mon[133544]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:03:42.554 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:42 smithi099 ceph-mon[133544]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:03:42.554 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:42 smithi099 ceph-mon[133544]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' 2024-03-30T14:03:42.554 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:42 smithi099 ceph-mon[133544]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' 2024-03-30T14:03:42.554 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:42 smithi099 ceph-mon[133544]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' 2024-03-30T14:03:42.554 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:42 smithi099 ceph-mon[133544]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' 2024-03-30T14:03:42.554 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:42 smithi099 ceph-mon[133544]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:03:42.554 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:42 smithi099 ceph-mon[133544]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:03:42.555 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:42 smithi099 ceph-mon[133544]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:03:42.555 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:42 smithi099 ceph-mon[133544]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:03:42.555 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:42 smithi099 ceph-mon[133544]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' 2024-03-30T14:03:42.555 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:42 smithi099 ceph-mon[133544]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:03:42.555 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:42 smithi099 ceph-mon[133544]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:03:42.555 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:42 smithi099 ceph-mon[133544]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:03:42.555 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:42 smithi099 ceph-mon[133544]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:03:42.555 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:42 smithi099 ceph-mon[133544]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' 2024-03-30T14:03:42.555 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:42 smithi099 ceph-mon[133544]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:03:42.555 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:42 smithi099 ceph-mon[133544]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:03:42.555 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:42 smithi099 ceph-mon[133544]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:03:42.555 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:42 smithi099 ceph-mon[133544]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:03:42.555 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:42 smithi099 ceph-mon[133544]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' 2024-03-30T14:03:42.555 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:42 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:03:42.556 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:42 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:03:42.556 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:42 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:03:42.556 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:42 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:03:42.556 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:42 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' 2024-03-30T14:03:42.556 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:42 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' 2024-03-30T14:03:42.556 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:42 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' 2024-03-30T14:03:42.556 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:42 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' 2024-03-30T14:03:42.556 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:42 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:03:42.556 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:42 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:03:42.556 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:42 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:03:42.556 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:42 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:03:42.556 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:42 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' 2024-03-30T14:03:42.556 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:42 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:03:42.557 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:42 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:03:42.557 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:42 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:03:42.557 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:42 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:03:42.557 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:42 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' 2024-03-30T14:03:42.557 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:42 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:03:42.557 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:42 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:03:42.557 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:42 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:03:42.557 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:42 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:03:42.557 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:42 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' 2024-03-30T14:03:43.499 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:43 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:03:43.499 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:43 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:03:43.499 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:43 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:03:43.499 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:43 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:03:43.499 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:43 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:03:43.500 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:43 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:03:43.500 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:43 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:03:43.500 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:43 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:03:43.500 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:43 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' 2024-03-30T14:03:43.500 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:43 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:03:43.500 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:43 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:03:43.500 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:43 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:03:43.500 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:43 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:03:43.500 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:43 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:03:43.500 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:43 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' 2024-03-30T14:03:43.500 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:43 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:03:43.500 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:43 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:03:43.501 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:43 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:03:43.501 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:43 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:03:43.501 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:43 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:03:43.501 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:43 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' 2024-03-30T14:03:43.501 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:43 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:03:43.501 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:43 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:03:43.501 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:43 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:03:43.501 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:43 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:03:43.501 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:43 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:03:43.501 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:43 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' 2024-03-30T14:03:43.501 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:43 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:03:43.501 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:43 smithi181 ceph-mon[115276]: pgmap v6: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:03:43.502 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:43 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' 2024-03-30T14:03:43.502 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:43 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' 2024-03-30T14:03:43.502 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:43 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' 2024-03-30T14:03:43.502 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:43 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:03:43.502 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:43 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:03:43.502 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:43 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:03:43.502 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:43 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:03:43.502 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:43 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' 2024-03-30T14:03:43.502 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:43 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:03:43.502 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:43 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:03:43.503 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:43 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:03:43.503 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:43 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:03:43.503 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:43 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' 2024-03-30T14:03:43.503 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:43 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:03:43.503 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:43 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:03:43.503 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:43 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:03:43.503 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:43 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:03:43.503 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:43 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' 2024-03-30T14:03:43.503 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:43 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:03:43.503 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:43 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:03:43.580 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:43 smithi099 ceph-mon[133544]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:03:43.580 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:43 smithi099 ceph-mon[133544]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:03:43.580 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:43 smithi099 ceph-mon[133544]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:03:43.580 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:43 smithi099 ceph-mon[133544]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:03:43.580 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:43 smithi099 ceph-mon[133544]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:03:43.580 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:43 smithi099 ceph-mon[133544]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:03:43.580 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:43 smithi099 ceph-mon[133544]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:03:43.580 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:43 smithi099 ceph-mon[133544]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:03:43.580 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:43 smithi099 ceph-mon[133544]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' 2024-03-30T14:03:43.580 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:43 smithi099 ceph-mon[133544]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:03:43.580 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:43 smithi099 ceph-mon[133544]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:03:43.580 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:43 smithi099 ceph-mon[133544]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:03:43.580 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:43 smithi099 ceph-mon[133544]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:03:43.580 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:43 smithi099 ceph-mon[133544]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:03:43.581 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:43 smithi099 ceph-mon[133544]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' 2024-03-30T14:03:43.581 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:43 smithi099 ceph-mon[133544]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:03:43.581 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:43 smithi099 ceph-mon[133544]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:03:43.581 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:43 smithi099 ceph-mon[133544]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:03:43.581 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:43 smithi099 ceph-mon[133544]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:03:43.581 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:43 smithi099 ceph-mon[133544]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:03:43.581 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:43 smithi099 ceph-mon[133544]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' 2024-03-30T14:03:43.581 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:43 smithi099 ceph-mon[133544]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:03:43.581 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:43 smithi099 ceph-mon[133544]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:03:43.581 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:43 smithi099 ceph-mon[133544]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:03:43.581 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:43 smithi099 ceph-mon[133544]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:03:43.581 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:43 smithi099 ceph-mon[133544]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:03:43.581 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:43 smithi099 ceph-mon[133544]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' 2024-03-30T14:03:43.581 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:43 smithi099 ceph-mon[133544]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:03:43.582 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:43 smithi099 ceph-mon[133544]: pgmap v6: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:03:43.582 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:43 smithi099 ceph-mon[133544]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' 2024-03-30T14:03:43.582 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:43 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:03:43.582 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:43 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:03:43.582 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:43 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:03:43.582 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:43 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:03:43.582 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:43 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:03:43.582 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:43 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:03:43.582 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:43 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:03:43.582 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:43 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:03:43.583 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:43 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' 2024-03-30T14:03:43.583 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:43 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:03:43.583 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:43 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:03:43.583 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:43 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:03:43.583 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:43 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:03:43.583 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:43 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:03:43.583 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:43 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' 2024-03-30T14:03:43.583 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:43 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:03:43.583 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:43 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:03:43.583 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:43 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:03:43.583 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:43 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:03:43.583 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:43 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:03:43.583 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:43 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' 2024-03-30T14:03:43.583 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:43 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:03:43.583 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:43 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:03:43.584 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:43 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:03:43.584 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:43 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:03:43.584 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:43 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:03:43.584 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:43 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' 2024-03-30T14:03:43.584 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:43 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:03:43.584 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:43 smithi099 ceph-mon[29691]: pgmap v6: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:03:43.584 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:43 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' 2024-03-30T14:03:43.584 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:43 smithi099 ceph-mon[133544]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' 2024-03-30T14:03:43.584 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:43 smithi099 ceph-mon[133544]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' 2024-03-30T14:03:43.584 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:43 smithi099 ceph-mon[133544]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:03:43.585 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:43 smithi099 ceph-mon[133544]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:03:43.585 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:43 smithi099 ceph-mon[133544]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:03:43.585 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:43 smithi099 ceph-mon[133544]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:03:43.585 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:43 smithi099 ceph-mon[133544]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' 2024-03-30T14:03:43.585 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:43 smithi099 ceph-mon[133544]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:03:43.585 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:43 smithi099 ceph-mon[133544]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:03:43.585 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:43 smithi099 ceph-mon[133544]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:03:43.585 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:43 smithi099 ceph-mon[133544]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:03:43.585 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:43 smithi099 ceph-mon[133544]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' 2024-03-30T14:03:43.585 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:43 smithi099 ceph-mon[133544]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:03:43.585 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:43 smithi099 ceph-mon[133544]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:03:43.585 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:43 smithi099 ceph-mon[133544]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:03:43.585 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:43 smithi099 ceph-mon[133544]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:03:43.585 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:43 smithi099 ceph-mon[133544]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' 2024-03-30T14:03:43.585 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:43 smithi099 ceph-mon[133544]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:03:43.585 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:43 smithi099 ceph-mon[133544]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:03:43.586 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:43 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' 2024-03-30T14:03:43.586 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:43 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' 2024-03-30T14:03:43.586 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:43 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:03:43.586 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:43 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:03:43.586 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:43 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:03:43.586 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:43 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:03:43.586 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:43 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' 2024-03-30T14:03:43.586 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:43 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:03:43.586 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:43 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:03:43.586 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:43 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:03:43.586 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:43 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:03:43.586 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:43 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' 2024-03-30T14:03:43.587 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:43 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:03:43.587 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:43 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:03:43.587 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:43 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:03:43.587 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:43 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:03:43.587 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:43 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' 2024-03-30T14:03:43.587 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:43 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:03:43.587 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:43 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:03:44.202 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:44 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:03:44.202 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:44 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:03:44.202 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:44 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:03:44.202 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:44 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:03:44.202 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:44 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:03:44.202 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:44 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' 2024-03-30T14:03:44.202 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:44 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:03:44.202 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:44 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' 2024-03-30T14:03:44.202 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:44 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' 2024-03-30T14:03:44.202 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:44 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' 2024-03-30T14:03:44.202 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:44 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:03:44.202 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:44 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:03:44.202 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:44 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "quorum_status"}]: dispatch 2024-03-30T14:03:44.203 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:44 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "mon ok-to-stop", "ids": ["a"]}]: dispatch 2024-03-30T14:03:44.203 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:44 smithi181 ceph-mon[115276]: Upgrade: It appears safe to stop mon.a 2024-03-30T14:03:44.203 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:44 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' 2024-03-30T14:03:44.203 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:44 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' 2024-03-30T14:03:44.203 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:44 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' 2024-03-30T14:03:44.271 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:44 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:03:44.271 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:44 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:03:44.271 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:44 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:03:44.271 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:44 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:03:44.271 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:44 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:03:44.271 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:44 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' 2024-03-30T14:03:44.271 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:44 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:03:44.271 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:44 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' 2024-03-30T14:03:44.271 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:44 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' 2024-03-30T14:03:44.272 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:44 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' 2024-03-30T14:03:44.272 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:44 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:03:44.272 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:44 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:03:44.272 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:44 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "quorum_status"}]: dispatch 2024-03-30T14:03:44.272 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:44 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "mon ok-to-stop", "ids": ["a"]}]: dispatch 2024-03-30T14:03:44.272 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:44 smithi099 ceph-mon[29691]: Upgrade: It appears safe to stop mon.a 2024-03-30T14:03:44.272 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:44 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' 2024-03-30T14:03:44.272 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:44 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' 2024-03-30T14:03:44.272 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:44 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' 2024-03-30T14:03:44.272 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:44 smithi099 ceph-mon[133544]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:03:44.272 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:44 smithi099 ceph-mon[133544]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:03:44.272 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:44 smithi099 ceph-mon[133544]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:03:44.273 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:44 smithi099 ceph-mon[133544]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:03:44.273 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:44 smithi099 ceph-mon[133544]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:03:44.273 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:44 smithi099 ceph-mon[133544]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' 2024-03-30T14:03:44.273 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:44 smithi099 ceph-mon[133544]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:03:44.273 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:44 smithi099 ceph-mon[133544]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' 2024-03-30T14:03:44.273 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:44 smithi099 ceph-mon[133544]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' 2024-03-30T14:03:44.273 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:44 smithi099 ceph-mon[133544]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' 2024-03-30T14:03:44.273 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:44 smithi099 ceph-mon[133544]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:03:44.273 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:44 smithi099 ceph-mon[133544]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:03:44.273 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:44 smithi099 ceph-mon[133544]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "quorum_status"}]: dispatch 2024-03-30T14:03:44.273 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:44 smithi099 ceph-mon[133544]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "mon ok-to-stop", "ids": ["a"]}]: dispatch 2024-03-30T14:03:44.273 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:44 smithi099 ceph-mon[133544]: Upgrade: It appears safe to stop mon.a 2024-03-30T14:03:44.273 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:44 smithi099 ceph-mon[133544]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' 2024-03-30T14:03:44.273 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:44 smithi099 ceph-mon[133544]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' 2024-03-30T14:03:44.273 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:44 smithi099 ceph-mon[133544]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' 2024-03-30T14:03:44.952 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 14:03:44 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[71049]: ::ffff:172.21.15.181 - - [30/Mar/2024:14:03:44] "GET /metrics HTTP/1.1" 200 35203 "" "Prometheus/2.43.0" 2024-03-30T14:03:45.329 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:45 smithi099 ceph-mon[133544]: pgmap v7: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 30 KiB/s rd, 0 B/s wr, 17 op/s 2024-03-30T14:03:45.329 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:45 smithi099 ceph-mon[29691]: pgmap v7: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 30 KiB/s rd, 0 B/s wr, 17 op/s 2024-03-30T14:03:45.341 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:45 smithi181 ceph-mon[115276]: pgmap v7: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 30 KiB/s rd, 0 B/s wr, 17 op/s 2024-03-30T14:03:47.248 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:46 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' 2024-03-30T14:03:47.249 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:46 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' 2024-03-30T14:03:47.249 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:46 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' 2024-03-30T14:03:47.249 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:46 smithi181 ceph-mon[115276]: pgmap v8: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 23 KiB/s rd, 0 B/s wr, 13 op/s 2024-03-30T14:03:47.329 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:46 smithi099 ceph-mon[133544]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' 2024-03-30T14:03:47.329 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:46 smithi099 ceph-mon[133544]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' 2024-03-30T14:03:47.329 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:46 smithi099 ceph-mon[133544]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' 2024-03-30T14:03:47.329 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:46 smithi099 ceph-mon[133544]: pgmap v8: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 23 KiB/s rd, 0 B/s wr, 13 op/s 2024-03-30T14:03:47.330 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:46 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' 2024-03-30T14:03:47.330 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:46 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' 2024-03-30T14:03:47.330 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:46 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' 2024-03-30T14:03:47.330 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:46 smithi099 ceph-mon[29691]: pgmap v8: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 23 KiB/s rd, 0 B/s wr, 13 op/s 2024-03-30T14:03:48.219 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:48 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' 2024-03-30T14:03:48.219 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:48 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' 2024-03-30T14:03:48.219 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:48 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' 2024-03-30T14:03:48.219 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:48 smithi099 ceph-mon[29691]: from='client.25136 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T14:03:48.219 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:48 smithi099 ceph-mon[133544]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' 2024-03-30T14:03:48.220 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:48 smithi099 ceph-mon[133544]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' 2024-03-30T14:03:48.220 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:48 smithi099 ceph-mon[133544]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' 2024-03-30T14:03:48.220 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:48 smithi099 ceph-mon[133544]: from='client.25136 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T14:03:48.498 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:48 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' 2024-03-30T14:03:48.499 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:48 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' 2024-03-30T14:03:48.499 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:48 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' 2024-03-30T14:03:48.499 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:48 smithi181 ceph-mon[115276]: from='client.25136 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T14:03:49.293 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:49 smithi099 ceph-mon[133544]: Upgrade: Updating mon.a 2024-03-30T14:03:49.293 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:49 smithi099 ceph-mon[133544]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-03-30T14:03:49.293 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:49 smithi099 ceph-mon[133544]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-03-30T14:03:49.293 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:49 smithi099 ceph-mon[133544]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:03:49.293 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:49 smithi099 ceph-mon[133544]: Deploying daemon mon.a on smithi099 2024-03-30T14:03:49.293 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:49 smithi099 ceph-mon[133544]: pgmap v9: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 20 KiB/s rd, 0 B/s wr, 11 op/s 2024-03-30T14:03:49.293 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:49 smithi099 ceph-mon[29691]: Upgrade: Updating mon.a 2024-03-30T14:03:49.293 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:49 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-03-30T14:03:49.293 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:49 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-03-30T14:03:49.293 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:49 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:03:49.294 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:49 smithi099 ceph-mon[29691]: Deploying daemon mon.a on smithi099 2024-03-30T14:03:49.294 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:49 smithi099 ceph-mon[29691]: pgmap v9: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 20 KiB/s rd, 0 B/s wr, 11 op/s 2024-03-30T14:03:49.407 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:49 smithi181 ceph-mon[115276]: Upgrade: Updating mon.a 2024-03-30T14:03:49.407 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:49 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-03-30T14:03:49.408 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:49 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-03-30T14:03:49.408 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:49 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:03:49.408 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:49 smithi181 ceph-mon[115276]: Deploying daemon mon.a on smithi099 2024-03-30T14:03:49.408 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:49 smithi181 ceph-mon[115276]: pgmap v9: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 20 KiB/s rd, 0 B/s wr, 11 op/s 2024-03-30T14:03:51.079 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:50 smithi099 ceph-mon[133544]: pgmap v10: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 18 KiB/s rd, 0 B/s wr, 10 op/s 2024-03-30T14:03:51.080 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:50 smithi099 ceph-mon[29691]: pgmap v10: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 18 KiB/s rd, 0 B/s wr, 10 op/s 2024-03-30T14:03:51.248 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:50 smithi181 ceph-mon[115276]: pgmap v10: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 18 KiB/s rd, 0 B/s wr, 10 op/s 2024-03-30T14:03:51.830 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:51 smithi099 ceph-mon[133544]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T14:03:51.830 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:51 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T14:03:52.248 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:51 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T14:03:52.520 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:52 smithi099 systemd[1]: Stopping Ceph mon.a for 98ebaeb8-ee99-11ee-b647-cb9ed24678a4... 2024-03-30T14:03:53.079 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:52 smithi099 ceph-mon[133544]: pgmap v11: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 18 KiB/s rd, 0 B/s wr, 10 op/s 2024-03-30T14:03:53.079 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:52 smithi099 ceph-mon[29691]: pgmap v11: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 18 KiB/s rd, 0 B/s wr, 10 op/s 2024-03-30T14:03:53.248 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:52 smithi181 ceph-mon[115276]: pgmap v11: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 18 KiB/s rd, 0 B/s wr, 10 op/s 2024-03-30T14:03:53.421 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:53 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mon-a[133540]: 2024-03-30T14:03:53.087+0000 7fe4ed634700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-03-30T14:03:53.422 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:53 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mon-a[133540]: 2024-03-30T14:03:53.087+0000 7fe4ed634700 -1 mon.a@0(leader) e3 *** Got Signal Terminated *** 2024-03-30T14:03:53.422 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:53 smithi099 podman[136671]: 2024-03-30 14:03:53.169607138 +0000 UTC m=+0.641686793 container died 49273c0f848ca2a17b3ff755d9cb97cb5df6edd6b9e3c104a1f521f3f02766c7 (image=quay.ceph.io/ceph-ci/ceph:4e50bbcdd1630c7760b708f3a5b4d38a121e66cb, name=ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mon-a, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, ceph=True, org.label-schema.build-date=20240326, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-4e50bbc, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, org.label-schema.vendor=CentOS) 2024-03-30T14:03:53.422 INFO:teuthology.orchestra.run.smithi099.stdout:true 2024-03-30T14:03:53.422 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 14:03:53 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[71049]: [30/Mar/2024:14:03:53] ENGINE Bus STOPPING 2024-03-30T14:03:53.422 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 14:03:53 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[71049]: [30/Mar/2024:14:03:53] ENGINE HTTP Server cherrypy._cpwsgi_server.CPWSGIServer(('::', 9283)) shut down 2024-03-30T14:03:53.423 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 14:03:53 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[71049]: [30/Mar/2024:14:03:53] ENGINE Bus STOPPED 2024-03-30T14:03:53.423 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 14:03:53 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[71049]: [30/Mar/2024:14:03:53] ENGINE Bus STARTING 2024-03-30T14:03:53.423 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 14:03:53 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[71049]: [30/Mar/2024:14:03:53] ENGINE Serving on http://:::9283 2024-03-30T14:03:53.423 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 14:03:53 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[71049]: [30/Mar/2024:14:03:53] ENGINE Bus STARTED 2024-03-30T14:03:53.829 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:53 smithi099 podman[136671]: 2024-03-30 14:03:53.547010154 +0000 UTC m=+1.019089800 container cleanup 49273c0f848ca2a17b3ff755d9cb97cb5df6edd6b9e3c104a1f521f3f02766c7 (image=quay.ceph.io/ceph-ci/ceph:4e50bbcdd1630c7760b708f3a5b4d38a121e66cb, name=ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mon-a, io.buildah.version=1.33.5, org.label-schema.build-date=20240326, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, RELEASE=squid-4e50bbc, org.label-schema.vendor=CentOS, ceph=True) 2024-03-30T14:03:53.829 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:53 smithi099 bash[136671]: ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mon-a 2024-03-30T14:03:54.116 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:53 smithi099 podman[136819]: 2024-03-30 14:03:53.840514564 +0000 UTC m=+0.665656875 container remove 49273c0f848ca2a17b3ff755d9cb97cb5df6edd6b9e3c104a1f521f3f02766c7 (image=quay.ceph.io/ceph-ci/ceph:4e50bbcdd1630c7760b708f3a5b4d38a121e66cb, name=ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mon-a, GIT_CLEAN=True, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=squid-4e50bbc, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240326, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0) 2024-03-30T14:03:54.116 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:53 smithi099 systemd[1]: ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4@mon.a.service: Deactivated successfully. 2024-03-30T14:03:54.116 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:53 smithi099 systemd[1]: Stopped Ceph mon.a for 98ebaeb8-ee99-11ee-b647-cb9ed24678a4. 2024-03-30T14:03:54.116 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:53 smithi099 systemd[1]: ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4@mon.a.service: Consumed 1.625s CPU time. 2024-03-30T14:03:54.117 INFO:teuthology.orchestra.run.smithi099.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-03-30T14:03:54.117 INFO:teuthology.orchestra.run.smithi099.stdout:agent.smithi099 smithi099 running 0s ago 32m - - 2024-03-30T14:03:54.117 INFO:teuthology.orchestra.run.smithi099.stdout:agent.smithi181 smithi181 running 7s ago 32m - - 2024-03-30T14:03:54.117 INFO:teuthology.orchestra.run.smithi099.stdout:alertmanager.a smithi099 *:9093,9094 running (2m) 0s ago 26m 18.8M - 0.25.0 c8568f914cd2 08735152b67d 2024-03-30T14:03:54.117 INFO:teuthology.orchestra.run.smithi099.stdout:grafana.a smithi181 *:3000 running (2m) 7s ago 26m 77.2M - 9.4.12 2bacad6d85d8 d599aa7730d6 2024-03-30T14:03:54.117 INFO:teuthology.orchestra.run.smithi099.stdout:iscsi.foo.smithi099.qyjuvr smithi099 running (5m) 0s ago 25m 56.5M - 3.5 e1d6a67b021e 2f859af6bc2a 2024-03-30T14:03:54.117 INFO:teuthology.orchestra.run.smithi099.stdout:mgr.x smithi181 *:8443,9283,8765 running (4m) 7s ago 31m 447M - 19.0.0-1967-g4e50bbcd b0c4478f1d83 f269106f7913 2024-03-30T14:03:54.117 INFO:teuthology.orchestra.run.smithi099.stdout:mgr.y smithi099 *:8443,9283,8765 running (15m) 0s ago 32m 499M - 19.0.0-1967-g4e50bbcd b0c4478f1d83 0d464b8c1d18 2024-03-30T14:03:54.117 INFO:teuthology.orchestra.run.smithi099.stdout:mon.a smithi099 unknown 0s ago 33m 42.4M 2048M 19.0.0-1967-g4e50bbcd b0c4478f1d83 49273c0f848c 2024-03-30T14:03:54.117 INFO:teuthology.orchestra.run.smithi099.stdout:mon.b smithi181 running (82s) 7s ago 31m 42.6M 2048M 19.0.0-1967-g4e50bbcd b0c4478f1d83 0468ed087cdd 2024-03-30T14:03:54.117 INFO:teuthology.orchestra.run.smithi099.stdout:mon.c smithi099 running (31m) 0s ago 31m 82.5M 2048M 17.2.0 e1d6a67b021e 0f1e98917718 2024-03-30T14:03:54.118 INFO:teuthology.orchestra.run.smithi099.stdout:node-exporter.a smithi099 *:9100 running (3m) 0s ago 27m 8665k - 1.5.0 0da6a335fe13 4a3f1f6e7068 2024-03-30T14:03:54.118 INFO:teuthology.orchestra.run.smithi099.stdout:node-exporter.b smithi181 *:9100 running (3m) 7s ago 27m 15.5M - 1.5.0 0da6a335fe13 acea317b5f5d 2024-03-30T14:03:54.118 INFO:teuthology.orchestra.run.smithi099.stdout:osd.0 smithi099 running (31m) 0s ago 31m 53.8M 4096M 17.2.0 e1d6a67b021e 3158ee1b0c67 2024-03-30T14:03:54.118 INFO:teuthology.orchestra.run.smithi099.stdout:osd.1 smithi099 running (30m) 0s ago 30m 58.0M 4096M 17.2.0 e1d6a67b021e c4af0fd7071a 2024-03-30T14:03:54.118 INFO:teuthology.orchestra.run.smithi099.stdout:osd.2 smithi099 running (30m) 0s ago 30m 49.9M 4096M 17.2.0 e1d6a67b021e 8e4e805a7e20 2024-03-30T14:03:54.118 INFO:teuthology.orchestra.run.smithi099.stdout:osd.3 smithi099 running (29m) 0s ago 29m 54.0M 4096M 17.2.0 e1d6a67b021e 718812bcf065 2024-03-30T14:03:54.118 INFO:teuthology.orchestra.run.smithi099.stdout:osd.4 smithi181 running (29m) 7s ago 29m 55.4M 4096M 17.2.0 e1d6a67b021e 5e205434e973 2024-03-30T14:03:54.118 INFO:teuthology.orchestra.run.smithi099.stdout:osd.5 smithi181 running (29m) 7s ago 29m 53.0M 4096M 17.2.0 e1d6a67b021e e330c920f152 2024-03-30T14:03:54.118 INFO:teuthology.orchestra.run.smithi099.stdout:osd.6 smithi181 running (28m) 7s ago 28m 52.8M 4096M 17.2.0 e1d6a67b021e 81d889ea213d 2024-03-30T14:03:54.118 INFO:teuthology.orchestra.run.smithi099.stdout:osd.7 smithi181 running (28m) 7s ago 28m 53.2M 4096M 17.2.0 e1d6a67b021e c08b1839dd7e 2024-03-30T14:03:54.118 INFO:teuthology.orchestra.run.smithi099.stdout:prometheus.a smithi181 *:9095 running (3m) 7s ago 27m 68.0M - 2.43.0 a07b618ecd1d 004088bdf70e 2024-03-30T14:03:54.118 INFO:teuthology.orchestra.run.smithi099.stdout:rgw.foo.smithi099.fxjbmp smithi099 *:8000 running (25m) 0s ago 25m 77.4M - 17.2.0 e1d6a67b021e 400b28b3f650 2024-03-30T14:03:54.118 INFO:teuthology.orchestra.run.smithi099.stdout:rgw.foo.smithi181.wfqwti smithi181 *:8000 running (25m) 7s ago 25m 77.1M - 17.2.0 e1d6a67b021e 97e1b130f9d4 2024-03-30T14:03:54.399 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:54 smithi099 systemd[1]: Starting Ceph mon.a for 98ebaeb8-ee99-11ee-b647-cb9ed24678a4... 2024-03-30T14:03:54.527 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-03-30T14:03:54.527 INFO:teuthology.orchestra.run.smithi099.stdout: "mon": { 2024-03-30T14:03:54.527 INFO:teuthology.orchestra.run.smithi099.stdout: "ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)": 1, 2024-03-30T14:03:54.527 INFO:teuthology.orchestra.run.smithi099.stdout: "ceph version 19.0.0-1967-g4e50bbcd (4e50bbcdd1630c7760b708f3a5b4d38a121e66cb) squid (dev)": 2 2024-03-30T14:03:54.527 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T14:03:54.527 INFO:teuthology.orchestra.run.smithi099.stdout: "mgr": { 2024-03-30T14:03:54.527 INFO:teuthology.orchestra.run.smithi099.stdout: "ceph version 19.0.0-1967-g4e50bbcd (4e50bbcdd1630c7760b708f3a5b4d38a121e66cb) squid (dev)": 2 2024-03-30T14:03:54.527 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T14:03:54.528 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": { 2024-03-30T14:03:54.528 INFO:teuthology.orchestra.run.smithi099.stdout: "ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)": 8 2024-03-30T14:03:54.528 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T14:03:54.528 INFO:teuthology.orchestra.run.smithi099.stdout: "mds": {}, 2024-03-30T14:03:54.528 INFO:teuthology.orchestra.run.smithi099.stdout: "rgw": { 2024-03-30T14:03:54.528 INFO:teuthology.orchestra.run.smithi099.stdout: "ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)": 2 2024-03-30T14:03:54.528 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T14:03:54.528 INFO:teuthology.orchestra.run.smithi099.stdout: "overall": { 2024-03-30T14:03:54.528 INFO:teuthology.orchestra.run.smithi099.stdout: "ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)": 11, 2024-03-30T14:03:54.528 INFO:teuthology.orchestra.run.smithi099.stdout: "ceph version 19.0.0-1967-g4e50bbcd (4e50bbcdd1630c7760b708f3a5b4d38a121e66cb) squid (dev)": 4 2024-03-30T14:03:54.528 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-03-30T14:03:54.528 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-03-30T14:03:54.673 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:54 smithi099 podman[137050]: 2024-03-30 14:03:54.308767314 +0000 UTC m=+0.018098262 image pull b0c4478f1d83795df4d538bf108aee5fac57194348fb16dcdbb3115f3e2fe95e quay.ceph.io/ceph-ci/ceph:4e50bbcdd1630c7760b708f3a5b4d38a121e66cb 2024-03-30T14:03:54.673 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:54 smithi099 podman[137050]: 2024-03-30 14:03:54.450047927 +0000 UTC m=+0.159378850 container create f19388464dfd748aa01003e3f475731ec12333ca4d1d17c4de98678bf70c5574 (image=quay.ceph.io/ceph-ci/ceph:4e50bbcdd1630c7760b708f3a5b4d38a121e66cb, name=ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mon-a, org.label-schema.vendor=CentOS, RELEASE=squid-4e50bbc, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, ceph=True, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240326, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD) 2024-03-30T14:03:54.673 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:54 smithi099 podman[137050]: 2024-03-30 14:03:54.652658571 +0000 UTC m=+0.361989497 container init f19388464dfd748aa01003e3f475731ec12333ca4d1d17c4de98678bf70c5574 (image=quay.ceph.io/ceph-ci/ceph:4e50bbcdd1630c7760b708f3a5b4d38a121e66cb, name=ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mon-a, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, GIT_CLEAN=True, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, ceph=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240326, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-4e50bbc, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0) 2024-03-30T14:03:54.673 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:54 smithi099 podman[137050]: 2024-03-30 14:03:54.655801943 +0000 UTC m=+0.365132867 container start f19388464dfd748aa01003e3f475731ec12333ca4d1d17c4de98678bf70c5574 (image=quay.ceph.io/ceph-ci/ceph:4e50bbcdd1630c7760b708f3a5b4d38a121e66cb, name=ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mon-a, org.label-schema.schema-version=1.0, RELEASE=squid-4e50bbc, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_CLEAN=True, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, org.label-schema.build-date=20240326, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-03-30T14:03:54.871 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-03-30T14:03:54.871 INFO:teuthology.orchestra.run.smithi099.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph:4e50bbcdd1630c7760b708f3a5b4d38a121e66cb", 2024-03-30T14:03:54.871 INFO:teuthology.orchestra.run.smithi099.stdout: "in_progress": true, 2024-03-30T14:03:54.871 INFO:teuthology.orchestra.run.smithi099.stdout: "which": "Upgrading daemons of type(s) mon on host(s) smithi099", 2024-03-30T14:03:54.871 INFO:teuthology.orchestra.run.smithi099.stdout: "services_complete": [], 2024-03-30T14:03:54.871 INFO:teuthology.orchestra.run.smithi099.stdout: "progress": "0/2 daemons upgraded", 2024-03-30T14:03:54.871 INFO:teuthology.orchestra.run.smithi099.stdout: "message": "Currently upgrading mon daemons", 2024-03-30T14:03:54.871 INFO:teuthology.orchestra.run.smithi099.stdout: "is_paused": false 2024-03-30T14:03:54.871 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-03-30T14:03:54.929 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 14:03:54 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[71049]: ::ffff:172.21.15.181 - - [30/Mar/2024:14:03:54] "GET /metrics HTTP/1.1" 200 38013 "" "Prometheus/2.43.0" 2024-03-30T14:03:54.930 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:54 smithi099 ceph-mon[137093]: set uid:gid to 167:167 (ceph:ceph) 2024-03-30T14:03:54.930 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:54 smithi099 ceph-mon[137093]: ceph version 19.0.0-1967-g4e50bbcd (4e50bbcdd1630c7760b708f3a5b4d38a121e66cb) squid (dev), process ceph-mon, pid 2 2024-03-30T14:03:54.930 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:54 smithi099 ceph-mon[137093]: pidfile_write: ignore empty --pid-file 2024-03-30T14:03:54.930 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:54 smithi099 ceph-mon[137093]: load: jerasure load: lrc 2024-03-30T14:03:54.930 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:54 smithi099 ceph-mon[137093]: rocksdb: RocksDB version: 7.9.2 2024-03-30T14:03:54.930 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:54 smithi099 ceph-mon[137093]: rocksdb: Git sha 0 2024-03-30T14:03:54.930 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:54 smithi099 ceph-mon[137093]: rocksdb: Compile date 2024-03-29 15:06:16 2024-03-30T14:03:54.930 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:54 smithi099 ceph-mon[137093]: rocksdb: DB SUMMARY 2024-03-30T14:03:54.930 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:54 smithi099 ceph-mon[137093]: rocksdb: DB Session ID: F2NT8GR0H4T2KEKH3YCU 2024-03-30T14:03:54.930 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:54 smithi099 ceph-mon[137093]: rocksdb: CURRENT file: CURRENT 2024-03-30T14:03:54.931 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:54 smithi099 ceph-mon[137093]: rocksdb: IDENTITY file: IDENTITY 2024-03-30T14:03:54.931 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:54 smithi099 ceph-mon[137093]: rocksdb: MANIFEST file: MANIFEST-000107 size: 755 Bytes 2024-03-30T14:03:54.931 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:54 smithi099 ceph-mon[137093]: rocksdb: SST files in /var/lib/ceph/mon/ceph-a/store.db dir, Total Num: 1, files: 000115.sst 2024-03-30T14:03:54.931 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:54 smithi099 ceph-mon[137093]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-a/store.db: 000113.log size: 470131 ; 2024-03-30T14:03:54.931 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:54 smithi099 ceph-mon[137093]: rocksdb: Options.error_if_exists: 0 2024-03-30T14:03:54.931 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:54 smithi099 ceph-mon[137093]: rocksdb: Options.create_if_missing: 0 2024-03-30T14:03:54.931 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:54 smithi099 ceph-mon[137093]: rocksdb: Options.paranoid_checks: 1 2024-03-30T14:03:54.931 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:54 smithi099 ceph-mon[137093]: rocksdb: Options.flush_verify_memtable_count: 1 2024-03-30T14:03:54.931 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:54 smithi099 ceph-mon[137093]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-03-30T14:03:54.931 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:54 smithi099 ceph-mon[137093]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-03-30T14:03:54.931 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:54 smithi099 ceph-mon[137093]: rocksdb: Options.env: 0x55db06e06c60 2024-03-30T14:03:54.931 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:54 smithi099 ceph-mon[137093]: rocksdb: Options.fs: PosixFileSystem 2024-03-30T14:03:54.932 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:54 smithi099 ceph-mon[137093]: rocksdb: Options.info_log: 0x55db077e3ae0 2024-03-30T14:03:54.932 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:54 smithi099 ceph-mon[137093]: rocksdb: Options.max_file_opening_threads: 16 2024-03-30T14:03:54.932 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:54 smithi099 ceph-mon[137093]: rocksdb: Options.statistics: (nil) 2024-03-30T14:03:54.932 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:54 smithi099 ceph-mon[137093]: rocksdb: Options.use_fsync: 0 2024-03-30T14:03:54.932 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:54 smithi099 ceph-mon[137093]: rocksdb: Options.max_log_file_size: 0 2024-03-30T14:03:54.932 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:54 smithi099 ceph-mon[137093]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-03-30T14:03:54.932 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:54 smithi099 ceph-mon[137093]: rocksdb: Options.log_file_time_to_roll: 0 2024-03-30T14:03:54.932 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:54 smithi099 ceph-mon[137093]: rocksdb: Options.keep_log_file_num: 1000 2024-03-30T14:03:54.932 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:54 smithi099 ceph-mon[137093]: rocksdb: Options.recycle_log_file_num: 0 2024-03-30T14:03:54.932 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:54 smithi099 ceph-mon[137093]: rocksdb: Options.allow_fallocate: 1 2024-03-30T14:03:54.932 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:54 smithi099 ceph-mon[137093]: rocksdb: Options.allow_mmap_reads: 0 2024-03-30T14:03:54.932 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:54 smithi099 ceph-mon[137093]: rocksdb: Options.allow_mmap_writes: 0 2024-03-30T14:03:54.932 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:54 smithi099 ceph-mon[137093]: rocksdb: Options.use_direct_reads: 0 2024-03-30T14:03:54.932 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:54 smithi099 ceph-mon[137093]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-03-30T14:03:54.932 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:54 smithi099 ceph-mon[137093]: rocksdb: Options.create_missing_column_families: 0 2024-03-30T14:03:54.932 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:54 smithi099 ceph-mon[137093]: rocksdb: Options.db_log_dir: 2024-03-30T14:03:54.932 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:54 smithi099 ceph-mon[137093]: rocksdb: Options.wal_dir: 2024-03-30T14:03:54.933 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:54 smithi099 ceph-mon[137093]: rocksdb: Options.table_cache_numshardbits: 6 2024-03-30T14:03:54.933 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:54 smithi099 ceph-mon[137093]: rocksdb: Options.WAL_ttl_seconds: 0 2024-03-30T14:03:54.933 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:54 smithi099 ceph-mon[137093]: rocksdb: Options.WAL_size_limit_MB: 0 2024-03-30T14:03:54.933 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:54 smithi099 ceph-mon[137093]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-03-30T14:03:54.933 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:54 smithi099 ceph-mon[137093]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-03-30T14:03:54.933 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:54 smithi099 ceph-mon[137093]: rocksdb: Options.is_fd_close_on_exec: 1 2024-03-30T14:03:54.933 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:54 smithi099 ceph-mon[137093]: rocksdb: Options.advise_random_on_open: 1 2024-03-30T14:03:54.933 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:54 smithi099 ceph-mon[137093]: rocksdb: Options.db_write_buffer_size: 0 2024-03-30T14:03:54.933 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:54 smithi099 ceph-mon[137093]: rocksdb: Options.write_buffer_manager: 0x55db077b6820 2024-03-30T14:03:54.933 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:54 smithi099 ceph-mon[137093]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-03-30T14:03:54.933 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:54 smithi099 ceph-mon[137093]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-03-30T14:03:54.933 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:54 smithi099 ceph-mon[137093]: rocksdb: Options.use_adaptive_mutex: 0 2024-03-30T14:03:54.933 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:54 smithi099 ceph-mon[137093]: rocksdb: Options.rate_limiter: (nil) 2024-03-30T14:03:54.933 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:54 smithi099 ceph-mon[137093]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-03-30T14:03:54.933 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:54 smithi099 ceph-mon[137093]: rocksdb: Options.wal_recovery_mode: 2 2024-03-30T14:03:54.934 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:54 smithi099 ceph-mon[137093]: rocksdb: Options.enable_thread_tracking: 0 2024-03-30T14:03:54.934 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:54 smithi099 ceph-mon[137093]: rocksdb: Options.enable_pipelined_write: 0 2024-03-30T14:03:54.934 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:54 smithi099 ceph-mon[137093]: rocksdb: Options.unordered_write: 0 2024-03-30T14:03:54.934 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:54 smithi099 ceph-mon[137093]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-03-30T14:03:54.934 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:54 smithi099 ceph-mon[137093]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-03-30T14:03:54.934 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:54 smithi099 ceph-mon[137093]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-03-30T14:03:54.934 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:54 smithi099 ceph-mon[137093]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-03-30T14:03:54.934 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:54 smithi099 ceph-mon[137093]: rocksdb: Options.row_cache: None 2024-03-30T14:03:54.934 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:54 smithi099 ceph-mon[137093]: rocksdb: Options.wal_filter: None 2024-03-30T14:03:54.934 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:54 smithi099 ceph-mon[137093]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-03-30T14:03:54.934 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:54 smithi099 ceph-mon[137093]: rocksdb: Options.allow_ingest_behind: 0 2024-03-30T14:03:54.934 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:54 smithi099 ceph-mon[137093]: rocksdb: Options.two_write_queues: 0 2024-03-30T14:03:54.934 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:54 smithi099 ceph-mon[137093]: rocksdb: Options.manual_wal_flush: 0 2024-03-30T14:03:54.934 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:54 smithi099 ceph-mon[137093]: rocksdb: Options.wal_compression: 0 2024-03-30T14:03:54.935 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:54 smithi099 ceph-mon[137093]: rocksdb: Options.atomic_flush: 0 2024-03-30T14:03:54.935 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:54 smithi099 ceph-mon[137093]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-03-30T14:03:54.935 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:54 smithi099 ceph-mon[137093]: rocksdb: Options.persist_stats_to_disk: 0 2024-03-30T14:03:54.935 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:54 smithi099 ceph-mon[137093]: rocksdb: Options.write_dbid_to_manifest: 0 2024-03-30T14:03:54.935 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:54 smithi099 ceph-mon[137093]: rocksdb: Options.log_readahead_size: 0 2024-03-30T14:03:54.935 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:54 smithi099 ceph-mon[137093]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-03-30T14:03:54.935 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:54 smithi099 ceph-mon[137093]: rocksdb: Options.best_efforts_recovery: 0 2024-03-30T14:03:54.935 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:54 smithi099 ceph-mon[137093]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-03-30T14:03:54.935 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:54 smithi099 ceph-mon[137093]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-03-30T14:03:54.935 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:54 smithi099 ceph-mon[137093]: rocksdb: Options.allow_data_in_errors: 0 2024-03-30T14:03:54.935 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:54 smithi099 ceph-mon[137093]: rocksdb: Options.db_host_id: __hostname__ 2024-03-30T14:03:54.936 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:54 smithi099 ceph-mon[137093]: rocksdb: Options.enforce_single_del_contracts: true 2024-03-30T14:03:54.936 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:54 smithi099 ceph-mon[137093]: rocksdb: Options.max_background_jobs: 2 2024-03-30T14:03:54.937 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:54 smithi099 ceph-mon[137093]: rocksdb: Options.max_background_compactions: -1 2024-03-30T14:03:54.937 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:54 smithi099 ceph-mon[137093]: rocksdb: Options.max_subcompactions: 1 2024-03-30T14:03:54.937 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:54 smithi099 ceph-mon[137093]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-03-30T14:03:54.937 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:54 smithi099 ceph-mon[137093]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-03-30T14:03:54.937 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:54 smithi099 ceph-mon[137093]: rocksdb: Options.delayed_write_rate : 16777216 2024-03-30T14:03:54.937 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:54 smithi099 ceph-mon[137093]: rocksdb: Options.max_total_wal_size: 0 2024-03-30T14:03:54.937 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:54 smithi099 ceph-mon[137093]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-03-30T14:03:54.937 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:54 smithi099 ceph-mon[137093]: rocksdb: Options.stats_dump_period_sec: 600 2024-03-30T14:03:54.937 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:54 smithi099 ceph-mon[137093]: rocksdb: Options.stats_persist_period_sec: 600 2024-03-30T14:03:54.937 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:54 smithi099 ceph-mon[137093]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-03-30T14:03:54.937 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:54 smithi099 ceph-mon[137093]: rocksdb: Options.max_open_files: -1 2024-03-30T14:03:54.937 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:54 smithi099 ceph-mon[137093]: rocksdb: Options.bytes_per_sync: 0 2024-03-30T14:03:54.937 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:54 smithi099 ceph-mon[137093]: rocksdb: Options.wal_bytes_per_sync: 0 2024-03-30T14:03:54.937 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:54 smithi099 ceph-mon[137093]: rocksdb: Options.strict_bytes_per_sync: 0 2024-03-30T14:03:54.938 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:54 smithi099 ceph-mon[137093]: rocksdb: Options.compaction_readahead_size: 0 2024-03-30T14:03:54.938 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:54 smithi099 ceph-mon[137093]: rocksdb: Options.max_background_flushes: -1 2024-03-30T14:03:54.938 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:54 smithi099 ceph-mon[137093]: rocksdb: Compression algorithms supported: 2024-03-30T14:03:54.938 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:54 smithi099 ceph-mon[137093]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-03-30T14:03:54.938 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:54 smithi099 ceph-mon[137093]: rocksdb: kZSTD supported: 0 2024-03-30T14:03:54.938 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:54 smithi099 ceph-mon[137093]: rocksdb: kXpressCompression supported: 0 2024-03-30T14:03:54.938 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:54 smithi099 ceph-mon[137093]: rocksdb: kLZ4HCCompression supported: 1 2024-03-30T14:03:54.938 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:54 smithi099 ceph-mon[137093]: rocksdb: kZlibCompression supported: 1 2024-03-30T14:03:54.938 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:54 smithi099 ceph-mon[137093]: rocksdb: kSnappyCompression supported: 1 2024-03-30T14:03:54.938 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:54 smithi099 ceph-mon[137093]: rocksdb: kLZ4Compression supported: 1 2024-03-30T14:03:54.938 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:54 smithi099 ceph-mon[137093]: rocksdb: kBZip2Compression supported: 0 2024-03-30T14:03:54.938 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:54 smithi099 ceph-mon[137093]: rocksdb: Fast CRC32 supported: Supported on x86 2024-03-30T14:03:54.938 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:54 smithi099 ceph-mon[137093]: rocksdb: DMutex implementation: pthread_mutex_t 2024-03-30T14:03:54.938 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:54 smithi099 ceph-mon[137093]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000107 2024-03-30T14:03:54.939 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:54 smithi099 ceph-mon[137093]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-03-30T14:03:54.939 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:54 smithi099 ceph-mon[137093]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-03-30T14:03:54.939 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:54 smithi099 ceph-mon[137093]: rocksdb: Options.merge_operator: 2024-03-30T14:03:54.939 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:54 smithi099 ceph-mon[137093]: rocksdb: Options.compaction_filter: None 2024-03-30T14:03:54.939 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:54 smithi099 ceph-mon[137093]: rocksdb: Options.compaction_filter_factory: None 2024-03-30T14:03:54.939 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:54 smithi099 ceph-mon[137093]: rocksdb: Options.sst_partitioner_factory: None 2024-03-30T14:03:54.939 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:54 smithi099 ceph-mon[137093]: rocksdb: Options.memtable_factory: SkipListFactory 2024-03-30T14:03:54.939 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:54 smithi099 ceph-mon[137093]: rocksdb: Options.table_factory: BlockBasedTable 2024-03-30T14:03:54.939 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:54 smithi099 ceph-mon[137093]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x55db077e3be0) 2024-03-30T14:03:54.939 INFO:journalctl@ceph.mon.a.smithi099.stdout: cache_index_and_filter_blocks: 1 2024-03-30T14:03:54.939 INFO:journalctl@ceph.mon.a.smithi099.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-03-30T14:03:54.939 INFO:journalctl@ceph.mon.a.smithi099.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-03-30T14:03:54.939 INFO:journalctl@ceph.mon.a.smithi099.stdout: pin_top_level_index_and_filter: 1 2024-03-30T14:03:54.939 INFO:journalctl@ceph.mon.a.smithi099.stdout: index_type: 0 2024-03-30T14:03:54.939 INFO:journalctl@ceph.mon.a.smithi099.stdout: data_block_index_type: 0 2024-03-30T14:03:54.940 INFO:journalctl@ceph.mon.a.smithi099.stdout: index_shortening: 1 2024-03-30T14:03:54.940 INFO:journalctl@ceph.mon.a.smithi099.stdout: data_block_hash_table_util_ratio: 0.750000 2024-03-30T14:03:54.940 INFO:journalctl@ceph.mon.a.smithi099.stdout: checksum: 4 2024-03-30T14:03:54.940 INFO:journalctl@ceph.mon.a.smithi099.stdout: no_block_cache: 0 2024-03-30T14:03:54.940 INFO:journalctl@ceph.mon.a.smithi099.stdout: block_cache: 0x55db077e7090 2024-03-30T14:03:54.940 INFO:journalctl@ceph.mon.a.smithi099.stdout: block_cache_name: BinnedLRUCache 2024-03-30T14:03:54.940 INFO:journalctl@ceph.mon.a.smithi099.stdout: block_cache_options: 2024-03-30T14:03:54.940 INFO:journalctl@ceph.mon.a.smithi099.stdout: capacity : 536870912 2024-03-30T14:03:54.940 INFO:journalctl@ceph.mon.a.smithi099.stdout: num_shard_bits : 4 2024-03-30T14:03:54.940 INFO:journalctl@ceph.mon.a.smithi099.stdout: strict_capacity_limit : 0 2024-03-30T14:03:54.940 INFO:journalctl@ceph.mon.a.smithi099.stdout: high_pri_pool_ratio: 0.000 2024-03-30T14:03:54.940 INFO:journalctl@ceph.mon.a.smithi099.stdout: block_cache_compressed: (nil) 2024-03-30T14:03:54.940 INFO:journalctl@ceph.mon.a.smithi099.stdout: persistent_cache: (nil) 2024-03-30T14:03:54.940 INFO:journalctl@ceph.mon.a.smithi099.stdout: block_size: 4096 2024-03-30T14:03:54.940 INFO:journalctl@ceph.mon.a.smithi099.stdout: block_size_deviation: 10 2024-03-30T14:03:54.941 INFO:journalctl@ceph.mon.a.smithi099.stdout: block_restart_interval: 16 2024-03-30T14:03:54.941 INFO:journalctl@ceph.mon.a.smithi099.stdout: index_block_restart_interval: 1 2024-03-30T14:03:54.941 INFO:journalctl@ceph.mon.a.smithi099.stdout: metadata_block_size: 4096 2024-03-30T14:03:54.941 INFO:journalctl@ceph.mon.a.smithi099.stdout: partition_filters: 0 2024-03-30T14:03:54.941 INFO:journalctl@ceph.mon.a.smithi099.stdout: use_delta_encoding: 1 2024-03-30T14:03:54.941 INFO:journalctl@ceph.mon.a.smithi099.stdout: filter_policy: bloomfilter 2024-03-30T14:03:54.941 INFO:journalctl@ceph.mon.a.smithi099.stdout: whole_key_filtering: 1 2024-03-30T14:03:54.941 INFO:journalctl@ceph.mon.a.smithi099.stdout: verify_compression: 0 2024-03-30T14:03:54.941 INFO:journalctl@ceph.mon.a.smithi099.stdout: read_amp_bytes_per_bit: 0 2024-03-30T14:03:54.941 INFO:journalctl@ceph.mon.a.smithi099.stdout: format_version: 5 2024-03-30T14:03:54.941 INFO:journalctl@ceph.mon.a.smithi099.stdout: enable_index_compression: 1 2024-03-30T14:03:54.941 INFO:journalctl@ceph.mon.a.smithi099.stdout: block_align: 0 2024-03-30T14:03:54.941 INFO:journalctl@ceph.mon.a.smithi099.stdout: max_auto_readahead_size: 262144 2024-03-30T14:03:54.941 INFO:journalctl@ceph.mon.a.smithi099.stdout: prepopulate_block_cache: 0 2024-03-30T14:03:54.941 INFO:journalctl@ceph.mon.a.smithi099.stdout: initial_auto_readahead_size: 8192 2024-03-30T14:03:54.941 INFO:journalctl@ceph.mon.a.smithi099.stdout: num_file_reads_for_auto_readahead: 2 2024-03-30T14:03:54.941 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:54 smithi099 ceph-mon[137093]: rocksdb: Options.write_buffer_size: 33554432 2024-03-30T14:03:54.942 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:54 smithi099 ceph-mon[137093]: rocksdb: Options.max_write_buffer_number: 2 2024-03-30T14:03:54.942 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:54 smithi099 ceph-mon[137093]: rocksdb: Options.compression: NoCompression 2024-03-30T14:03:54.942 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:54 smithi099 ceph-mon[137093]: rocksdb: Options.bottommost_compression: Disabled 2024-03-30T14:03:54.942 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:54 smithi099 ceph-mon[137093]: rocksdb: Options.prefix_extractor: nullptr 2024-03-30T14:03:54.942 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:54 smithi099 ceph-mon[137093]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-03-30T14:03:54.942 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:54 smithi099 ceph-mon[137093]: rocksdb: Options.num_levels: 7 2024-03-30T14:03:54.942 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:54 smithi099 ceph-mon[137093]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-03-30T14:03:54.942 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:54 smithi099 ceph-mon[137093]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-03-30T14:03:54.942 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:54 smithi099 ceph-mon[137093]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-03-30T14:03:54.942 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:54 smithi099 ceph-mon[137093]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-03-30T14:03:54.942 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:54 smithi099 ceph-mon[137093]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-03-30T14:03:54.942 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:54 smithi099 ceph-mon[137093]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-03-30T14:03:54.942 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:54 smithi099 ceph-mon[137093]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-03-30T14:03:54.942 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:54 smithi099 ceph-mon[137093]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-03-30T14:03:54.943 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:54 smithi099 ceph-mon[137093]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-03-30T14:03:54.943 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:54 smithi099 ceph-mon[137093]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-03-30T14:03:54.943 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:54 smithi099 ceph-mon[137093]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-03-30T14:03:54.943 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:54 smithi099 ceph-mon[137093]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-03-30T14:03:54.943 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:54 smithi099 ceph-mon[137093]: rocksdb: Options.compression_opts.window_bits: -14 2024-03-30T14:03:54.943 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:54 smithi099 ceph-mon[137093]: rocksdb: Options.compression_opts.level: 32767 2024-03-30T14:03:54.943 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:54 smithi099 ceph-mon[137093]: rocksdb: Options.compression_opts.strategy: 0 2024-03-30T14:03:54.943 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:54 smithi099 ceph-mon[137093]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-03-30T14:03:54.943 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:54 smithi099 ceph-mon[137093]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-03-30T14:03:54.943 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:54 smithi099 ceph-mon[137093]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-03-30T14:03:54.943 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:54 smithi099 ceph-mon[137093]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-03-30T14:03:54.943 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:54 smithi099 ceph-mon[137093]: rocksdb: Options.compression_opts.enabled: false 2024-03-30T14:03:54.943 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:54 smithi099 ceph-mon[137093]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-03-30T14:03:54.943 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:54 smithi099 ceph-mon[137093]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-03-30T14:03:54.943 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:54 smithi099 ceph-mon[137093]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-03-30T14:03:54.944 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:54 smithi099 ceph-mon[137093]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-03-30T14:03:54.944 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:54 smithi099 ceph-mon[137093]: rocksdb: Options.target_file_size_base: 67108864 2024-03-30T14:03:54.944 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:54 smithi099 ceph-mon[137093]: rocksdb: Options.target_file_size_multiplier: 1 2024-03-30T14:03:54.944 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:54 smithi099 ceph-mon[137093]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-03-30T14:03:54.944 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:54 smithi099 ceph-mon[137093]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-03-30T14:03:54.944 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:54 smithi099 ceph-mon[137093]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-03-30T14:03:54.944 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:54 smithi099 ceph-mon[137093]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-03-30T14:03:54.944 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:54 smithi099 ceph-mon[137093]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-03-30T14:03:54.944 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:54 smithi099 ceph-mon[137093]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-03-30T14:03:54.944 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:54 smithi099 ceph-mon[137093]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-03-30T14:03:54.944 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:54 smithi099 ceph-mon[137093]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-03-30T14:03:54.944 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:54 smithi099 ceph-mon[137093]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-03-30T14:03:54.944 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:54 smithi099 ceph-mon[137093]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-03-30T14:03:54.944 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:54 smithi099 ceph-mon[137093]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-03-30T14:03:54.944 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:54 smithi099 ceph-mon[137093]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-03-30T14:03:54.944 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:54 smithi099 ceph-mon[137093]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-03-30T14:03:54.945 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:54 smithi099 ceph-mon[137093]: rocksdb: Options.arena_block_size: 1048576 2024-03-30T14:03:54.945 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:54 smithi099 ceph-mon[137093]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-03-30T14:03:54.945 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:54 smithi099 ceph-mon[137093]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-03-30T14:03:54.945 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:54 smithi099 ceph-mon[137093]: rocksdb: Options.disable_auto_compactions: 0 2024-03-30T14:03:54.945 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:54 smithi099 ceph-mon[137093]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-03-30T14:03:54.945 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:54 smithi099 ceph-mon[137093]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-03-30T14:03:54.945 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:54 smithi099 ceph-mon[137093]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-03-30T14:03:54.945 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:54 smithi099 ceph-mon[137093]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-03-30T14:03:54.945 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:54 smithi099 ceph-mon[137093]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-03-30T14:03:54.945 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:54 smithi099 ceph-mon[137093]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-03-30T14:03:54.945 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:54 smithi099 ceph-mon[137093]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-03-30T14:03:54.945 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:54 smithi099 ceph-mon[137093]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-03-30T14:03:54.945 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:54 smithi099 ceph-mon[137093]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-03-30T14:03:54.945 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:54 smithi099 ceph-mon[137093]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-03-30T14:03:54.945 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:54 smithi099 ceph-mon[137093]: rocksdb: Options.table_properties_collectors: 2024-03-30T14:03:54.945 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:54 smithi099 ceph-mon[137093]: rocksdb: Options.inplace_update_support: 0 2024-03-30T14:03:54.946 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:54 smithi099 ceph-mon[137093]: rocksdb: Options.inplace_update_num_locks: 10000 2024-03-30T14:03:54.946 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:54 smithi099 ceph-mon[137093]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-03-30T14:03:54.946 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:54 smithi099 ceph-mon[137093]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-03-30T14:03:54.946 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:54 smithi099 ceph-mon[137093]: rocksdb: Options.memtable_huge_page_size: 0 2024-03-30T14:03:54.946 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:54 smithi099 ceph-mon[137093]: rocksdb: Options.bloom_locality: 0 2024-03-30T14:03:54.946 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:54 smithi099 ceph-mon[137093]: rocksdb: Options.max_successive_merges: 0 2024-03-30T14:03:54.946 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:54 smithi099 ceph-mon[137093]: rocksdb: Options.optimize_filters_for_hits: 0 2024-03-30T14:03:54.946 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:54 smithi099 ceph-mon[137093]: rocksdb: Options.paranoid_file_checks: 0 2024-03-30T14:03:54.946 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:54 smithi099 ceph-mon[137093]: rocksdb: Options.force_consistency_checks: 1 2024-03-30T14:03:54.946 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:54 smithi099 ceph-mon[137093]: rocksdb: Options.report_bg_io_stats: 0 2024-03-30T14:03:54.946 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:54 smithi099 ceph-mon[137093]: rocksdb: Options.ttl: 2592000 2024-03-30T14:03:54.946 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:54 smithi099 ceph-mon[137093]: rocksdb: Options.periodic_compaction_seconds: 0 2024-03-30T14:03:54.946 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:54 smithi099 ceph-mon[137093]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-03-30T14:03:54.946 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:54 smithi099 ceph-mon[137093]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-03-30T14:03:54.947 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:54 smithi099 ceph-mon[137093]: rocksdb: Options.enable_blob_files: false 2024-03-30T14:03:54.947 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:54 smithi099 ceph-mon[137093]: rocksdb: Options.min_blob_size: 0 2024-03-30T14:03:54.947 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:54 smithi099 ceph-mon[137093]: rocksdb: Options.blob_file_size: 268435456 2024-03-30T14:03:54.947 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:54 smithi099 ceph-mon[137093]: rocksdb: Options.blob_compression_type: NoCompression 2024-03-30T14:03:54.947 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:54 smithi099 ceph-mon[137093]: rocksdb: Options.enable_blob_garbage_collection: false 2024-03-30T14:03:54.947 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:54 smithi099 ceph-mon[137093]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-03-30T14:03:54.947 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:54 smithi099 ceph-mon[137093]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-03-30T14:03:54.947 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:54 smithi099 ceph-mon[137093]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-03-30T14:03:54.947 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:54 smithi099 ceph-mon[137093]: rocksdb: Options.blob_file_starting_level: 0 2024-03-30T14:03:54.947 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:54 smithi099 ceph-mon[137093]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-03-30T14:03:54.947 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:54 smithi099 ceph-mon[137093]: rocksdb: [db/version_set.cc:4390] More existing levels in DB than needed. max_bytes_for_level_multiplier may not be guaranteed. 2024-03-30T14:03:54.947 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:54 smithi099 ceph-mon[137093]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000107 succeeded,manifest_file_number is 107, next_file_number is 117, last_sequence is 56629, log_number is 113,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 113 2024-03-30T14:03:54.947 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:54 smithi099 ceph-mon[137093]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 113 2024-03-30T14:03:54.947 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:54 smithi099 ceph-mon[137093]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: 53488779-88f1-4b5b-98f2-7b717f8062ca 2024-03-30T14:03:54.948 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:54 smithi099 ceph-mon[137093]: rocksdb: EVENT_LOG_v1 {"time_micros": 1711807434686306, "job": 1, "event": "recovery_started", "wal_files": [113]} 2024-03-30T14:03:54.948 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:54 smithi099 ceph-mon[137093]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #113 mode 2 2024-03-30T14:03:54.948 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:54 smithi099 ceph-mon[137093]: rocksdb: EVENT_LOG_v1 {"time_micros": 1711807434689485, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 118, "file_size": 434445, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 56630, "largest_seqno": 56925, "table_properties": {"data_size": 431863, "index_size": 1120, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 453, "raw_key_size": 4062, "raw_average_key_size": 24, "raw_value_size": 428199, "raw_average_value_size": 2595, "num_data_blocks": 48, "num_entries": 165, "num_filter_entries": 165, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1711807434, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "53488779-88f1-4b5b-98f2-7b717f8062ca", "db_session_id": "F2NT8GR0H4T2KEKH3YCU", "orig_file_number": 118, "seqno_to_time_mapping": "N/A"}} 2024-03-30T14:03:54.948 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:54 smithi099 ceph-mon[137093]: rocksdb: EVENT_LOG_v1 {"time_micros": 1711807434689596, "job": 1, "event": "recovery_finished"} 2024-03-30T14:03:54.948 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:54 smithi099 ceph-mon[137093]: rocksdb: [db/version_set.cc:5047] Creating manifest 120 2024-03-30T14:03:54.948 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:54 smithi099 ceph-mon[137093]: rocksdb: [db/version_set.cc:4390] More existing levels in DB than needed. max_bytes_for_level_multiplier may not be guaranteed. 2024-03-30T14:03:54.948 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:54 smithi099 ceph-mon[137093]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-a/store.db/000113.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-03-30T14:03:54.948 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:54 smithi099 ceph-mon[137093]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x55db078d8000 2024-03-30T14:03:54.948 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:54 smithi099 ceph-mon[137093]: rocksdb: DB pointer 0x55db078c2000 2024-03-30T14:03:54.948 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:54 smithi099 ceph-mon[137093]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-03-30T14:03:54.948 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:54 smithi099 ceph-mon[137093]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-03-30T14:03:54.948 INFO:journalctl@ceph.mon.a.smithi099.stdout: ** DB Stats ** 2024-03-30T14:03:54.948 INFO:journalctl@ceph.mon.a.smithi099.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-03-30T14:03:54.948 INFO:journalctl@ceph.mon.a.smithi099.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-03-30T14:03:54.949 INFO:journalctl@ceph.mon.a.smithi099.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-03-30T14:03:54.949 INFO:journalctl@ceph.mon.a.smithi099.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-03-30T14:03:54.949 INFO:journalctl@ceph.mon.a.smithi099.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-03-30T14:03:54.949 INFO:journalctl@ceph.mon.a.smithi099.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-03-30T14:03:54.949 INFO:journalctl@ceph.mon.a.smithi099.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-03-30T14:03:54.949 INFO:journalctl@ceph.mon.a.smithi099.stdout: 2024-03-30T14:03:54.949 INFO:journalctl@ceph.mon.a.smithi099.stdout: ** Compaction Stats [default] ** 2024-03-30T14:03:54.949 INFO:journalctl@ceph.mon.a.smithi099.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-03-30T14:03:54.949 INFO:journalctl@ceph.mon.a.smithi099.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-03-30T14:03:54.949 INFO:journalctl@ceph.mon.a.smithi099.stdout: L0 1/0 424.26 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 212.6 0.00 0.00 1 0.002 0 0 0.0 0.0 2024-03-30T14:03:54.949 INFO:journalctl@ceph.mon.a.smithi099.stdout: L6 1/0 11.67 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 2024-03-30T14:03:54.949 INFO:journalctl@ceph.mon.a.smithi099.stdout: Sum 2/0 12.09 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 212.6 0.00 0.00 1 0.002 0 0 0.0 0.0 2024-03-30T14:03:54.949 INFO:journalctl@ceph.mon.a.smithi099.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 212.6 0.00 0.00 1 0.002 0 0 0.0 0.0 2024-03-30T14:03:54.949 INFO:journalctl@ceph.mon.a.smithi099.stdout: 2024-03-30T14:03:54.949 INFO:journalctl@ceph.mon.a.smithi099.stdout: ** Compaction Stats [default] ** 2024-03-30T14:03:54.950 INFO:journalctl@ceph.mon.a.smithi099.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-03-30T14:03:54.950 INFO:journalctl@ceph.mon.a.smithi099.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-03-30T14:03:54.950 INFO:journalctl@ceph.mon.a.smithi099.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 212.6 0.00 0.00 1 0.002 0 0 0.0 0.0 2024-03-30T14:03:54.950 INFO:journalctl@ceph.mon.a.smithi099.stdout: 2024-03-30T14:03:54.950 INFO:journalctl@ceph.mon.a.smithi099.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-03-30T14:03:54.950 INFO:journalctl@ceph.mon.a.smithi099.stdout: 2024-03-30T14:03:54.950 INFO:journalctl@ceph.mon.a.smithi099.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-03-30T14:03:54.950 INFO:journalctl@ceph.mon.a.smithi099.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-03-30T14:03:54.950 INFO:journalctl@ceph.mon.a.smithi099.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-03-30T14:03:54.950 INFO:journalctl@ceph.mon.a.smithi099.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-03-30T14:03:54.950 INFO:journalctl@ceph.mon.a.smithi099.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-03-30T14:03:54.950 INFO:journalctl@ceph.mon.a.smithi099.stdout: AddFile(Keys): cumulative 0, interval 0 2024-03-30T14:03:54.950 INFO:journalctl@ceph.mon.a.smithi099.stdout: Cumulative compaction: 0.00 GB write, 67.23 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-03-30T14:03:54.950 INFO:journalctl@ceph.mon.a.smithi099.stdout: Interval compaction: 0.00 GB write, 67.23 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-03-30T14:03:54.951 INFO:journalctl@ceph.mon.a.smithi099.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-03-30T14:03:54.951 INFO:journalctl@ceph.mon.a.smithi099.stdout: Block cache BinnedLRUCache@0x55db077e7090#2 capacity: 512.00 MB usage: 1.70 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 9e-06 secs_since: 0 2024-03-30T14:03:54.951 INFO:journalctl@ceph.mon.a.smithi099.stdout: Block cache entry stats(count,size,portion): FilterBlock(1,0.50 KB,9.53674e-05%) IndexBlock(1,1.20 KB,0.000229478%) Misc(1,0.00 KB,0%) 2024-03-30T14:03:54.951 INFO:journalctl@ceph.mon.a.smithi099.stdout: 2024-03-30T14:03:54.951 INFO:journalctl@ceph.mon.a.smithi099.stdout: ** File Read Latency Histogram By Level [default] ** 2024-03-30T14:03:54.951 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:54 smithi099 ceph-mon[137093]: starting mon.a rank 0 at public addrs [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] at bind addrs [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] mon_data /var/lib/ceph/mon/ceph-a fsid 98ebaeb8-ee99-11ee-b647-cb9ed24678a4 2024-03-30T14:03:54.951 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:54 smithi099 ceph-mon[137093]: mon.a@-1(???) e3 preinit fsid 98ebaeb8-ee99-11ee-b647-cb9ed24678a4 2024-03-30T14:03:54.951 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:54 smithi099 ceph-mon[137093]: mon.a@-1(???).mds e1 new map 2024-03-30T14:03:54.951 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:54 smithi099 ceph-mon[137093]: mon.a@-1(???).mds e1 print_map 2024-03-30T14:03:54.951 INFO:journalctl@ceph.mon.a.smithi099.stdout: e1 2024-03-30T14:03:54.951 INFO:journalctl@ceph.mon.a.smithi099.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-03-30T14:03:54.951 INFO:journalctl@ceph.mon.a.smithi099.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-03-30T14:03:54.951 INFO:journalctl@ceph.mon.a.smithi099.stdout: legacy client fscid: -1 2024-03-30T14:03:54.951 INFO:journalctl@ceph.mon.a.smithi099.stdout: 2024-03-30T14:03:54.951 INFO:journalctl@ceph.mon.a.smithi099.stdout: No filesystems configured 2024-03-30T14:03:54.952 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:54 smithi099 ceph-mon[137093]: mon.a@-1(???).osd e113 crush map has features 3314933000854323200, adjusting msgr requires 2024-03-30T14:03:54.952 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:54 smithi099 ceph-mon[137093]: mon.a@-1(???).osd e113 crush map has features 432629239337189376, adjusting msgr requires 2024-03-30T14:03:54.952 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:54 smithi099 ceph-mon[137093]: mon.a@-1(???).osd e113 crush map has features 432629239337189376, adjusting msgr requires 2024-03-30T14:03:54.952 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:54 smithi099 ceph-mon[137093]: mon.a@-1(???).osd e113 crush map has features 432629239337189376, adjusting msgr requires 2024-03-30T14:03:54.952 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:54 smithi099 ceph-mon[137093]: mon.a@-1(???).paxosservice(auth 1..31) refresh upgraded, format 0 -> 3 2024-03-30T14:03:54.952 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:54 smithi099 bash[137050]: f19388464dfd748aa01003e3f475731ec12333ca4d1d17c4de98678bf70c5574 2024-03-30T14:03:54.952 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:54 smithi099 systemd[1]: Started Ceph mon.a for 98ebaeb8-ee99-11ee-b647-cb9ed24678a4. 2024-03-30T14:03:55.248 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:54 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-03-30T14:03:55.249 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:54 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-30T14:03:55.249 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:54 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-30T14:03:55.249 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:54 smithi181 ceph-mon[115276]: from='client.25786 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T14:03:55.249 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:54 smithi181 ceph-mon[115276]: from='client.25792 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T14:03:55.249 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:54 smithi181 ceph-mon[115276]: from='client.25798 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T14:03:55.249 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:54 smithi181 ceph-mon[115276]: from='client.? 172.21.15.99:0/954468645' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:03:55.249 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:54 smithi181 ceph-mon[115276]: pgmap v12: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 18 KiB/s rd, 0 B/s wr, 10 op/s 2024-03-30T14:03:55.249 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:54 smithi181 ceph-mon[115276]: mon.a calling monitor election 2024-03-30T14:03:55.249 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:54 smithi181 ceph-mon[115276]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-03-30T14:03:55.249 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:54 smithi181 ceph-mon[115276]: monmap epoch 3 2024-03-30T14:03:55.249 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:54 smithi181 ceph-mon[115276]: fsid 98ebaeb8-ee99-11ee-b647-cb9ed24678a4 2024-03-30T14:03:55.249 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:54 smithi181 ceph-mon[115276]: last_changed 2024-03-30T13:32:12.662639+0000 2024-03-30T14:03:55.249 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:54 smithi181 ceph-mon[115276]: created 2024-03-30T13:30:34.451427+0000 2024-03-30T14:03:55.249 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:54 smithi181 ceph-mon[115276]: min_mon_release 17 (quincy) 2024-03-30T14:03:55.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:54 smithi181 ceph-mon[115276]: election_strategy: 1 2024-03-30T14:03:55.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:54 smithi181 ceph-mon[115276]: 0: [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] mon.a 2024-03-30T14:03:55.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:54 smithi181 ceph-mon[115276]: 1: [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] mon.c 2024-03-30T14:03:55.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:54 smithi181 ceph-mon[115276]: 2: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.b 2024-03-30T14:03:55.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:54 smithi181 ceph-mon[115276]: fsmap 2024-03-30T14:03:55.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:54 smithi181 ceph-mon[115276]: osdmap e113: 8 total, 8 up, 8 in 2024-03-30T14:03:55.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:54 smithi181 ceph-mon[115276]: mgrmap e50: y(active, since 18s), standbys: x 2024-03-30T14:03:55.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:54 smithi181 ceph-mon[115276]: overall HEALTH_OK 2024-03-30T14:03:55.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:54 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='' 2024-03-30T14:03:55.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:54 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='' 2024-03-30T14:03:55.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:54 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:03:55.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:54 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:03:55.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:54 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:03:55.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:54 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:03:55.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:54 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:03:55.329 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:54 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-03-30T14:03:55.330 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:54 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-30T14:03:55.330 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:54 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-30T14:03:55.330 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:54 smithi099 ceph-mon[137093]: from='client.25786 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T14:03:55.330 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:54 smithi099 ceph-mon[137093]: from='client.25792 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T14:03:55.330 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:54 smithi099 ceph-mon[137093]: from='client.25798 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T14:03:55.330 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:54 smithi099 ceph-mon[137093]: from='client.? 172.21.15.99:0/954468645' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:03:55.330 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:54 smithi099 ceph-mon[137093]: pgmap v12: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 18 KiB/s rd, 0 B/s wr, 10 op/s 2024-03-30T14:03:55.330 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:54 smithi099 ceph-mon[137093]: mon.a calling monitor election 2024-03-30T14:03:55.330 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:54 smithi099 ceph-mon[137093]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-03-30T14:03:55.330 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:54 smithi099 ceph-mon[137093]: monmap epoch 3 2024-03-30T14:03:55.330 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:54 smithi099 ceph-mon[137093]: fsid 98ebaeb8-ee99-11ee-b647-cb9ed24678a4 2024-03-30T14:03:55.330 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:54 smithi099 ceph-mon[137093]: last_changed 2024-03-30T13:32:12.662639+0000 2024-03-30T14:03:55.331 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:54 smithi099 ceph-mon[137093]: created 2024-03-30T13:30:34.451427+0000 2024-03-30T14:03:55.331 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:54 smithi099 ceph-mon[137093]: min_mon_release 17 (quincy) 2024-03-30T14:03:55.331 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:54 smithi099 ceph-mon[137093]: election_strategy: 1 2024-03-30T14:03:55.331 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:54 smithi099 ceph-mon[137093]: 0: [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] mon.a 2024-03-30T14:03:55.331 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:54 smithi099 ceph-mon[137093]: 1: [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] mon.c 2024-03-30T14:03:55.331 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:54 smithi099 ceph-mon[137093]: 2: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.b 2024-03-30T14:03:55.331 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:54 smithi099 ceph-mon[137093]: fsmap 2024-03-30T14:03:55.331 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:54 smithi099 ceph-mon[137093]: osdmap e113: 8 total, 8 up, 8 in 2024-03-30T14:03:55.331 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:54 smithi099 ceph-mon[137093]: mgrmap e50: y(active, since 18s), standbys: x 2024-03-30T14:03:55.331 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:54 smithi099 ceph-mon[137093]: overall HEALTH_OK 2024-03-30T14:03:55.331 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:54 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='' 2024-03-30T14:03:55.331 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:54 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='' 2024-03-30T14:03:55.331 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:54 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:03:55.331 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:54 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:03:55.331 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:54 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:03:55.332 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:54 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:03:55.332 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:54 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:03:55.332 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:54 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-03-30T14:03:55.332 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:54 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-30T14:03:55.332 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:54 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-30T14:03:55.332 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:54 smithi099 ceph-mon[29691]: from='client.25786 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T14:03:55.332 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:54 smithi099 ceph-mon[29691]: from='client.25792 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T14:03:55.332 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:54 smithi099 ceph-mon[29691]: from='client.25798 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T14:03:55.332 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:54 smithi099 ceph-mon[29691]: from='client.? 172.21.15.99:0/954468645' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:03:55.332 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:54 smithi099 ceph-mon[29691]: pgmap v12: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 18 KiB/s rd, 0 B/s wr, 10 op/s 2024-03-30T14:03:55.332 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:54 smithi099 ceph-mon[29691]: mon.a calling monitor election 2024-03-30T14:03:55.332 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:54 smithi099 ceph-mon[29691]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-03-30T14:03:55.332 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:54 smithi099 ceph-mon[29691]: monmap epoch 3 2024-03-30T14:03:55.332 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:54 smithi099 ceph-mon[29691]: fsid 98ebaeb8-ee99-11ee-b647-cb9ed24678a4 2024-03-30T14:03:55.333 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:54 smithi099 ceph-mon[29691]: last_changed 2024-03-30T13:32:12.662639+0000 2024-03-30T14:03:55.333 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:54 smithi099 ceph-mon[29691]: created 2024-03-30T13:30:34.451427+0000 2024-03-30T14:03:55.333 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:54 smithi099 ceph-mon[29691]: min_mon_release 17 (quincy) 2024-03-30T14:03:55.333 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:54 smithi099 ceph-mon[29691]: election_strategy: 1 2024-03-30T14:03:55.333 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:54 smithi099 ceph-mon[29691]: 0: [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] mon.a 2024-03-30T14:03:55.333 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:54 smithi099 ceph-mon[29691]: 1: [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] mon.c 2024-03-30T14:03:55.333 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:54 smithi099 ceph-mon[29691]: 2: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.b 2024-03-30T14:03:55.333 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:54 smithi099 ceph-mon[29691]: fsmap 2024-03-30T14:03:55.333 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:54 smithi099 ceph-mon[29691]: osdmap e113: 8 total, 8 up, 8 in 2024-03-30T14:03:55.333 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:54 smithi099 ceph-mon[29691]: mgrmap e50: y(active, since 18s), standbys: x 2024-03-30T14:03:55.333 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:54 smithi099 ceph-mon[29691]: overall HEALTH_OK 2024-03-30T14:03:55.333 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:54 smithi099 ceph-mon[29691]: from='mgr.44103 ' entity='' 2024-03-30T14:03:55.333 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:54 smithi099 ceph-mon[29691]: from='mgr.44103 ' entity='' 2024-03-30T14:03:55.333 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:54 smithi099 ceph-mon[29691]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:03:55.333 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:54 smithi099 ceph-mon[29691]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:03:55.333 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:54 smithi099 ceph-mon[29691]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:03:55.334 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:54 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:03:55.334 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:54 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:03:56.079 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:55 smithi099 ceph-mon[137093]: from='client.25810 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T14:03:56.080 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:55 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:03:56.080 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:55 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:03:56.080 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:55 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:03:56.080 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:55 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:03:56.080 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:55 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:03:56.080 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:55 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:03:56.080 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:55 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:03:56.080 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:55 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:03:56.080 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:55 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:03:56.080 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:55 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:03:56.080 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:55 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:03:56.080 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:55 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:03:56.080 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:55 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:03:56.080 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:55 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:03:56.081 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:55 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:03:56.081 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:55 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:03:56.081 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:55 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:03:56.081 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:55 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:03:56.081 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:55 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:03:56.081 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:55 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:03:56.081 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:55 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:03:56.081 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:55 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:03:56.081 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:55 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:03:56.081 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:55 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:03:56.081 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:55 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:03:56.081 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:55 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:03:56.081 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:55 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:03:56.081 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:55 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:03:56.081 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:55 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:03:56.082 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:55 smithi099 ceph-mon[29691]: from='client.25810 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T14:03:56.082 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:55 smithi099 ceph-mon[29691]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:03:56.082 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:55 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:03:56.082 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:55 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:03:56.082 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:55 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:03:56.082 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:55 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:03:56.082 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:55 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:03:56.082 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:55 smithi099 ceph-mon[29691]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:03:56.083 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:55 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:03:56.083 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:55 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:03:56.083 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:55 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:03:56.083 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:55 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:03:56.083 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:55 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:03:56.083 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:55 smithi099 ceph-mon[29691]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:03:56.083 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:55 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:03:56.083 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:55 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:03:56.083 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:55 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:03:56.083 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:55 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:03:56.083 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:55 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:03:56.083 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:55 smithi099 ceph-mon[29691]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:03:56.083 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:55 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:03:56.083 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:55 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:03:56.083 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:55 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:03:56.083 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:55 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:03:56.084 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:55 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:03:56.084 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:55 smithi099 ceph-mon[29691]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:03:56.084 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:55 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:03:56.084 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:55 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:03:56.084 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:55 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:03:56.084 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:55 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:03:56.084 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:55 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:03:56.084 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:55 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:03:56.084 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:55 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:03:56.084 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:55 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:03:56.084 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:55 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:03:56.084 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:55 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:03:56.085 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:55 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:03:56.085 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:55 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:03:56.085 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:55 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:03:56.085 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:55 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:03:56.085 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:55 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:03:56.085 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:55 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:03:56.085 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:55 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:03:56.085 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:55 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:03:56.085 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:55 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:03:56.085 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:55 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:03:56.085 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:55 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:03:56.085 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:55 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:03:56.085 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:55 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:03:56.085 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:55 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:03:56.086 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:55 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:03:56.086 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:55 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:03:56.086 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:55 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:03:56.086 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:55 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:03:56.086 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:55 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:03:56.086 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:55 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:03:56.086 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:55 smithi099 ceph-mon[29691]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:03:56.086 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:55 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:03:56.086 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:55 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:03:56.086 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:55 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:03:56.086 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:55 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:03:56.086 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:55 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:03:56.086 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:55 smithi099 ceph-mon[29691]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:03:56.087 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:55 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:03:56.087 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:55 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:03:56.087 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:55 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:03:56.087 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:55 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:03:56.087 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:55 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:03:56.087 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:55 smithi099 ceph-mon[29691]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:03:56.087 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:55 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:03:56.087 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:55 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:03:56.087 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:55 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:03:56.087 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:55 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:03:56.087 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:55 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:03:56.087 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:55 smithi099 ceph-mon[29691]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:03:56.087 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:55 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:03:56.087 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:55 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:03:56.087 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:55 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:03:56.088 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:55 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:03:56.088 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:55 smithi099 ceph-mon[29691]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:03:56.249 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:55 smithi181 ceph-mon[115276]: from='client.25810 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T14:03:56.249 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:55 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:03:56.249 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:55 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:03:56.249 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:55 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:03:56.249 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:55 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:03:56.249 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:55 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:03:56.249 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:55 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:03:56.249 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:55 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:03:56.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:55 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:03:56.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:55 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:03:56.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:55 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:03:56.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:55 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:03:56.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:55 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:03:56.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:55 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:03:56.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:55 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:03:56.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:55 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:03:56.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:55 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:03:56.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:55 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:03:56.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:55 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:03:56.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:55 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:03:56.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:55 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:03:56.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:55 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:03:56.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:55 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:03:56.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:55 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:03:56.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:55 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:03:56.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:55 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:03:56.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:55 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:03:56.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:55 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:03:56.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:55 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:03:56.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:55 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:03:56.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:55 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:03:56.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:55 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:03:56.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:55 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:03:56.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:55 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:03:56.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:55 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:03:56.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:55 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:03:56.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:55 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:03:56.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:55 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:03:56.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:55 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:03:56.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:55 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:03:56.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:55 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:03:56.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:55 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:03:56.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:55 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:03:56.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:55 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:03:56.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:55 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:03:56.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:55 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:03:56.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:55 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:03:56.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:55 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:03:56.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:55 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:03:56.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:55 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:03:56.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:55 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:03:56.253 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:55 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:03:56.253 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:55 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:03:56.253 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:55 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:03:56.253 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:55 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:03:57.249 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:56 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:03:57.249 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:56 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:03:57.249 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:56 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:03:57.249 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:56 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:03:57.249 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:56 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:03:57.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:56 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:03:57.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:56 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:03:57.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:56 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:03:57.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:56 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:03:57.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:56 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:03:57.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:56 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:03:57.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:56 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:03:57.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:56 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:03:57.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:56 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:03:57.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:56 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:03:57.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:56 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:03:57.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:56 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:03:57.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:56 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:03:57.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:56 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:03:57.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:56 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:03:57.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:56 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:03:57.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:56 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:03:57.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:56 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:03:57.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:56 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:03:57.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:56 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:03:57.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:56 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:03:57.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:56 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:03:57.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:56 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:03:57.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:56 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:03:57.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:56 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:03:57.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:56 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:03:57.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:56 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:03:57.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:56 smithi181 ceph-mon[115276]: pgmap v13: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T14:03:57.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:56 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:03:57.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:56 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:03:57.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:56 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:03:57.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:56 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:03:57.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:56 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:03:57.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:56 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:03:57.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:56 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:03:57.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:56 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:03:57.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:56 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:03:57.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:56 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:03:57.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:56 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:03:57.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:56 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:03:57.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:56 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:03:57.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:56 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:03:57.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:56 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:03:57.253 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:56 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:03:57.253 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:56 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:03:57.253 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:56 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:03:57.253 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:56 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:03:57.329 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:56 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:03:57.330 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:56 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:03:57.330 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:56 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:03:57.330 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:56 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:03:57.330 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:56 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:03:57.330 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:56 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:03:57.330 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:56 smithi099 ceph-mon[29691]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:03:57.330 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:56 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:03:57.330 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:56 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:03:57.330 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:56 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:03:57.330 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:56 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:03:57.330 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:56 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:03:57.330 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:56 smithi099 ceph-mon[29691]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:03:57.330 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:56 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:03:57.330 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:56 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:03:57.331 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:56 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:03:57.331 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:56 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:03:57.331 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:56 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:03:57.331 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:56 smithi099 ceph-mon[29691]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:03:57.331 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:56 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:03:57.331 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:56 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:03:57.331 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:56 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:03:57.331 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:56 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:03:57.331 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:56 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:03:57.331 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:56 smithi099 ceph-mon[29691]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:03:57.331 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:56 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:03:57.331 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:56 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:03:57.331 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:56 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:03:57.331 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:56 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:03:57.332 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:56 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:03:57.332 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:56 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:03:57.332 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:56 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:03:57.332 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:56 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:03:57.332 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:56 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:03:57.332 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:56 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:03:57.332 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:56 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:03:57.332 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:56 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:03:57.332 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:56 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:03:57.332 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:56 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:03:57.332 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:56 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:03:57.332 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:56 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:03:57.332 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:56 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:03:57.333 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:56 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:03:57.333 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:56 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:03:57.333 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:56 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:03:57.333 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:56 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:03:57.333 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:56 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:03:57.333 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:56 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:03:57.333 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:56 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:03:57.333 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:56 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:03:57.333 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:56 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:03:57.333 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:56 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:03:57.333 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:56 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:03:57.333 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:56 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:03:57.333 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:56 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:03:57.333 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:56 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:03:57.333 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:56 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:03:57.333 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:56 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:03:57.334 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:56 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:03:57.334 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:56 smithi099 ceph-mon[29691]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:03:57.334 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:56 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:03:57.334 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:56 smithi099 ceph-mon[29691]: pgmap v13: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T14:03:57.334 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:56 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:03:57.334 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:56 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:03:57.334 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:56 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:03:57.334 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:56 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:03:57.334 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:56 smithi099 ceph-mon[29691]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:03:57.334 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:56 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:03:57.335 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:56 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:03:57.335 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:56 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:03:57.335 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:56 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:03:57.335 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:56 smithi099 ceph-mon[29691]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:03:57.335 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:56 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:03:57.335 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:56 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:03:57.335 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:56 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:03:57.335 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:56 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:03:57.335 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:56 smithi099 ceph-mon[29691]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:03:57.335 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:56 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:03:57.335 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:56 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:03:57.335 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:56 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:03:57.335 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:56 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:03:57.335 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:56 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:03:57.337 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:56 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:03:57.337 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:56 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:03:57.337 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:56 smithi099 ceph-mon[137093]: pgmap v13: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T14:03:57.337 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:56 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:03:57.337 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:56 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:03:57.337 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:56 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:03:57.337 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:56 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:03:57.337 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:56 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:03:57.337 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:56 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:03:57.337 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:56 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:03:57.338 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:56 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:03:57.338 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:56 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:03:57.338 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:56 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:03:57.338 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:56 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:03:57.338 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:56 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:03:57.338 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:56 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:03:57.338 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:56 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:03:57.338 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:56 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:03:57.338 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:56 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:03:57.338 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:56 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:03:57.338 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:56 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:03:57.338 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:56 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:03:58.249 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:57 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:03:58.249 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:57 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:03:58.249 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:57 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:03:58.249 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:57 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:03:58.249 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:57 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:03:58.249 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:57 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:03:58.249 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:57 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:03:58.249 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:57 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:03:58.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:57 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:03:58.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:57 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:03:58.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:57 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:03:58.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:57 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:03:58.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:57 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:03:58.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:57 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:03:58.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:57 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:03:58.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:57 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:03:58.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:57 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:03:58.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:57 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:03:58.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:57 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:03:58.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:57 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:03:58.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:57 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:03:58.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:57 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:03:58.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:57 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:03:58.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:57 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:03:58.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:57 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:03:58.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:57 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:03:58.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:57 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:03:58.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:57 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:03:58.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:57 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:03:58.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:57 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:03:58.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:57 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:03:58.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:57 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:03:58.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:57 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:03:58.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:57 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:03:58.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:57 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:03:58.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:57 smithi181 ceph-mon[115276]: from='client.25136 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T14:03:58.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:57 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:03:58.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:57 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:03:58.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:57 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:03:58.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:57 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:03:58.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:57 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:03:58.253 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:57 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:03:58.253 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:57 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:03:58.253 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:57 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:03:58.253 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:57 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:03:58.253 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:57 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:03:58.253 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:57 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:03:58.253 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:57 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:03:58.253 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:57 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:03:58.253 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:57 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:03:58.253 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:57 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:03:58.329 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:57 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:03:58.330 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:57 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:03:58.330 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:57 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:03:58.330 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:57 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:03:58.330 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:57 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:03:58.330 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:57 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:03:58.330 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:57 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:03:58.330 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:57 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:03:58.330 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:57 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:03:58.330 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:57 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:03:58.330 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:57 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:03:58.330 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:57 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:03:58.330 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:57 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:03:58.331 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:57 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:03:58.331 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:57 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:03:58.331 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:57 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:03:58.331 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:57 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:03:58.331 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:57 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:03:58.331 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:57 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:03:58.331 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:57 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:03:58.331 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:57 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:03:58.331 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:57 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:03:58.331 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:57 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:03:58.331 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:57 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:03:58.331 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:57 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:03:58.331 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:57 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:03:58.332 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:57 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:03:58.332 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:57 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:03:58.332 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:57 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:03:58.332 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:57 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:03:58.332 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:57 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:03:58.332 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:57 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:03:58.332 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:57 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:03:58.332 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:57 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:03:58.332 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:57 smithi099 ceph-mon[29691]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:03:58.332 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:57 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:03:58.332 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:57 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:03:58.333 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:57 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:03:58.333 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:57 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:03:58.333 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:57 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:03:58.333 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:57 smithi099 ceph-mon[29691]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:03:58.333 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:57 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:03:58.333 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:57 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:03:58.333 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:57 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:03:58.333 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:57 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:03:58.333 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:57 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:03:58.333 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:57 smithi099 ceph-mon[29691]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:03:58.333 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:57 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:03:58.333 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:57 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:03:58.334 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:57 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:03:58.334 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:57 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:03:58.334 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:57 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:03:58.334 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:57 smithi099 ceph-mon[29691]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:03:58.334 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:57 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:03:58.334 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:57 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:03:58.334 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:57 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:03:58.334 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:57 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:03:58.334 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:57 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:03:58.334 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:57 smithi099 ceph-mon[29691]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:03:58.334 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:57 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:03:58.334 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:57 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:03:58.335 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:57 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:03:58.335 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:57 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:03:58.335 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:57 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:03:58.335 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:57 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:03:58.335 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:57 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:03:58.335 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:57 smithi099 ceph-mon[137093]: from='client.25136 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T14:03:58.335 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:57 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:03:58.335 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:57 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:03:58.335 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:57 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:03:58.336 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:57 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:03:58.336 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:57 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:03:58.336 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:57 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:03:58.336 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:57 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:03:58.336 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:57 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:03:58.336 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:57 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:03:58.336 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:57 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:03:58.336 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:57 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:03:58.336 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:57 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:03:58.336 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:57 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:03:58.336 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:57 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:03:58.336 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:57 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:03:58.337 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:57 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:03:58.337 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:57 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:03:58.337 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:57 smithi099 ceph-mon[29691]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:03:58.337 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:57 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:03:58.337 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:57 smithi099 ceph-mon[29691]: from='client.25136 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T14:03:58.337 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:57 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:03:58.337 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:57 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:03:58.337 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:57 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:03:58.337 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:57 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:03:58.337 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:57 smithi099 ceph-mon[29691]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:03:58.337 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:57 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:03:58.338 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:57 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:03:58.338 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:57 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:03:58.338 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:57 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:03:58.338 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:57 smithi099 ceph-mon[29691]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:03:58.338 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:57 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:03:58.338 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:57 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:03:58.338 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:57 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:03:58.338 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:57 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:03:58.338 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:57 smithi099 ceph-mon[29691]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:03:59.080 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:58 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:03:59.081 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:58 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:03:59.081 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:58 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:03:59.081 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:58 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:03:59.081 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:58 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:03:59.081 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:58 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:03:59.081 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:58 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:03:59.081 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:58 smithi099 ceph-mon[29691]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:03:59.081 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:58 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:03:59.081 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:58 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:03:59.081 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:58 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:03:59.081 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:58 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:03:59.082 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:58 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:03:59.082 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:58 smithi099 ceph-mon[29691]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:03:59.082 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:58 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:03:59.082 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:58 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:03:59.082 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:58 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:03:59.082 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:58 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:03:59.082 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:58 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:03:59.082 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:58 smithi099 ceph-mon[29691]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:03:59.082 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:58 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:03:59.082 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:58 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:03:59.082 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:58 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:03:59.082 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:58 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:03:59.082 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:58 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:03:59.083 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:58 smithi099 ceph-mon[29691]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:03:59.083 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:58 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:03:59.083 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:58 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:03:59.083 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:58 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:03:59.083 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:58 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:03:59.083 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:58 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:03:59.083 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:58 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:03:59.083 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:58 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:03:59.084 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:58 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:03:59.084 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:58 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:03:59.084 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:58 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:03:59.084 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:58 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:03:59.084 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:58 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:03:59.084 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:58 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:03:59.084 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:58 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:03:59.084 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:58 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:03:59.084 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:58 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:03:59.084 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:58 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:03:59.084 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:58 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:03:59.084 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:58 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:03:59.084 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:58 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:03:59.084 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:58 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:03:59.085 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:58 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:03:59.085 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:58 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:03:59.085 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:58 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:03:59.085 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:58 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:03:59.085 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:58 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:03:59.085 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:58 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:03:59.085 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:58 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:03:59.085 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:58 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:03:59.085 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:58 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:03:59.085 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:58 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:03:59.085 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:58 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:03:59.085 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:58 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:03:59.085 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:58 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:03:59.085 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:58 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:03:59.085 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:58 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:03:59.086 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:58 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:03:59.086 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:58 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:03:59.086 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:58 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:03:59.086 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:58 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:03:59.086 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:58 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:03:59.086 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:58 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:03:59.086 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:58 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:03:59.086 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:58 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:03:59.086 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:58 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:03:59.086 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:58 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:03:59.086 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:58 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:03:59.086 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:58 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:03:59.086 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:58 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:03:59.087 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:58 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:03:59.087 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:58 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:03:59.087 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:58 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:03:59.087 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:58 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:03:59.087 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:58 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:03:59.087 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:58 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:03:59.087 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:58 smithi099 ceph-mon[137093]: pgmap v14: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T14:03:59.087 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:58 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:03:59.087 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:58 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:03:59.087 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:58 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:03:59.087 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:58 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:03:59.087 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:58 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:03:59.087 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:58 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:03:59.087 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:58 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:03:59.087 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:58 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:03:59.088 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:58 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:03:59.088 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:58 smithi099 ceph-mon[29691]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:03:59.088 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:58 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:03:59.088 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:58 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:03:59.088 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:58 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:03:59.088 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:58 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:03:59.088 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:58 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:03:59.088 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:58 smithi099 ceph-mon[29691]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:03:59.088 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:58 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:03:59.088 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:58 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:03:59.088 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:58 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:03:59.088 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:58 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:03:59.088 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:58 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:03:59.088 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:58 smithi099 ceph-mon[29691]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:03:59.089 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:58 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:03:59.089 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:58 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:03:59.089 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:58 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:03:59.089 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:58 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:03:59.089 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:58 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:03:59.089 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:58 smithi099 ceph-mon[29691]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:03:59.089 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:58 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:03:59.089 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:58 smithi099 ceph-mon[29691]: pgmap v14: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T14:03:59.089 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:58 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:03:59.089 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:58 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:03:59.089 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:58 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:03:59.089 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:58 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:03:59.089 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:58 smithi099 ceph-mon[29691]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:03:59.089 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:58 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:03:59.089 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:58 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:03:59.089 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:58 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:03:59.090 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:58 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:03:59.090 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:58 smithi099 ceph-mon[29691]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:03:59.090 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:58 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:03:59.090 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:58 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:03:59.090 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:58 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:03:59.090 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:58 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:03:59.090 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:58 smithi099 ceph-mon[29691]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:03:59.090 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:58 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:03:59.090 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:58 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:03:59.090 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:58 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:03:59.090 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:58 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:03:59.090 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:58 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:03:59.090 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:58 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:03:59.091 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:58 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:03:59.249 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:58 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:03:59.249 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:58 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:03:59.249 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:58 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:03:59.249 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:58 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:03:59.249 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:58 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:03:59.249 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:58 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:03:59.249 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:58 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:03:59.249 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:58 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:03:59.249 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:58 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:03:59.249 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:58 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:03:59.249 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:58 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:03:59.249 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:58 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:03:59.249 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:58 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:03:59.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:58 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:03:59.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:58 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:03:59.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:58 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:03:59.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:58 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:03:59.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:58 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:03:59.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:58 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:03:59.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:58 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:03:59.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:58 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:03:59.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:58 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:03:59.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:58 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:03:59.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:58 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:03:59.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:58 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:03:59.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:58 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:03:59.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:58 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:03:59.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:58 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:03:59.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:58 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:03:59.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:58 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:03:59.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:58 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:03:59.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:58 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:03:59.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:58 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:03:59.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:58 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:03:59.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:58 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:03:59.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:58 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:03:59.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:58 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:03:59.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:58 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:03:59.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:58 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:03:59.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:58 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:03:59.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:58 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:03:59.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:58 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:03:59.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:58 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:03:59.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:58 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:03:59.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:58 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:03:59.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:58 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:03:59.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:58 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:03:59.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:58 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:03:59.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:58 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:03:59.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:58 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:03:59.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:58 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:03:59.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:58 smithi181 ceph-mon[115276]: pgmap v14: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T14:03:59.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:58 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:03:59.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:58 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:03:59.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:58 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:03:59.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:58 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:03:59.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:58 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:03:59.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:58 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:03:59.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:58 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:03:59.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:58 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:03:59.253 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:58 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:03:59.253 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:58 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:03:59.253 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:58 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:03:59.253 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:58 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:03:59.253 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:58 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:03:59.253 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:58 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:03:59.253 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:58 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:04:00.249 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:59 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:04:00.249 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:59 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:04:00.249 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:59 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:04:00.249 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:59 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:04:00.249 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:59 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:04:00.249 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:59 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:04:00.249 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:59 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:04:00.249 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:59 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:04:00.249 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:59 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:04:00.249 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:59 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:04:00.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:59 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:04:00.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:59 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:04:00.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:59 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:04:00.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:59 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:04:00.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:59 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:04:00.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:59 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:04:00.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:59 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:04:00.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:59 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:04:00.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:59 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:04:00.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:59 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:04:00.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:59 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:04:00.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:59 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:04:00.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:59 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:04:00.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:59 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:04:00.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:59 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:04:00.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:59 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:04:00.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:59 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:04:00.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:59 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:04:00.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:59 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:04:00.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:59 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:04:00.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:59 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:04:00.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:59 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:04:00.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:59 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:04:00.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:59 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:04:00.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:59 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:04:00.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:59 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:04:00.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:59 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:04:00.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:59 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:04:00.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:59 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:04:00.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:59 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:04:00.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:59 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:04:00.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:59 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:04:00.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:59 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:04:00.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:59 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:04:00.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:59 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:04:00.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:59 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:04:00.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:59 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:04:00.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:59 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:04:00.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:59 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:04:00.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:59 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:04:00.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:59 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:04:00.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:59 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:04:00.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:59 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:04:00.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:59 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:04:00.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:03:59 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:04:00.265 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:59 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:04:00.265 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:59 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:04:00.265 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:59 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:04:00.266 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:59 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:04:00.266 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:59 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:04:00.266 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:59 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:04:00.266 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:59 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:04:00.266 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:59 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:04:00.266 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:59 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:04:00.266 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:59 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:04:00.266 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:59 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:04:00.266 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:59 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:04:00.266 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:59 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:04:00.266 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:59 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:04:00.266 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:59 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:04:00.266 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:59 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:04:00.266 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:59 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:04:00.267 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:59 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:04:00.267 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:59 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:04:00.267 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:59 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:04:00.267 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:59 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:04:00.267 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:59 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:04:00.267 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:59 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:04:00.267 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:59 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:04:00.267 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:59 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:04:00.267 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:59 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:04:00.267 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:59 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:04:00.267 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:59 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:04:00.267 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:59 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:04:00.267 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:59 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:04:00.268 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:59 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:04:00.268 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:59 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:04:00.268 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:59 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:04:00.268 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:59 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:04:00.268 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:59 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:04:00.268 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:59 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:04:00.268 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:59 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:04:00.268 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:59 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:04:00.268 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:59 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:04:00.268 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:59 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:04:00.268 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:59 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:04:00.269 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:59 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:04:00.269 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:59 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:04:00.269 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:59 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:04:00.269 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:59 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:04:00.269 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:59 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:04:00.269 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:59 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:04:00.269 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:59 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:04:00.269 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:59 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:04:00.269 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:59 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:04:00.269 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:59 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:04:00.269 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:59 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:04:00.269 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:59 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:04:00.269 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:59 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:04:00.269 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:03:59 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:04:00.270 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:59 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:04:00.270 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:59 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:04:00.270 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:59 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:04:00.270 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:59 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:04:00.270 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:59 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:04:00.270 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:59 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:04:00.270 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:59 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:04:00.270 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:59 smithi099 ceph-mon[29691]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:04:00.270 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:59 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:04:00.270 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:59 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:04:00.270 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:59 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:04:00.270 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:59 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:04:00.271 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:59 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:04:00.271 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:59 smithi099 ceph-mon[29691]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:04:00.271 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:59 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:04:00.271 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:59 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:04:00.271 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:59 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:04:00.271 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:59 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:04:00.271 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:59 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:04:00.271 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:59 smithi099 ceph-mon[29691]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:04:00.271 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:59 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:04:00.271 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:59 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:04:00.271 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:59 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:04:00.271 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:59 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:04:00.271 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:59 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:04:00.271 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:59 smithi099 ceph-mon[29691]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:04:00.271 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:59 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:04:00.271 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:59 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:04:00.272 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:59 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:04:00.272 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:59 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:04:00.272 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:59 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:04:00.272 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:59 smithi099 ceph-mon[29691]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:04:00.272 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:59 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:04:00.272 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:59 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:04:00.272 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:59 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:04:00.272 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:59 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:04:00.272 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:59 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:04:00.272 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:59 smithi099 ceph-mon[29691]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:04:00.272 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:59 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:04:00.272 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:59 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:04:00.272 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:59 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:04:00.272 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:59 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:04:00.272 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:59 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:04:00.272 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:59 smithi099 ceph-mon[29691]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:04:00.273 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:59 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:04:00.273 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:59 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:04:00.273 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:59 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:04:00.273 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:59 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:04:00.273 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:59 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:04:00.273 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:59 smithi099 ceph-mon[29691]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:04:00.273 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:59 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:04:00.273 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:59 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:04:00.273 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:59 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:04:00.273 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:59 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:04:00.273 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:03:59 smithi099 ceph-mon[29691]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:04:01.249 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:00 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:04:01.249 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:00 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:04:01.249 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:00 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:04:01.249 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:00 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:04:01.249 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:00 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:04:01.249 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:00 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:04:01.249 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:00 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:04:01.249 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:00 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:04:01.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:00 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:04:01.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:00 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:04:01.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:00 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:04:01.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:00 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:04:01.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:00 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:04:01.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:00 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:04:01.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:00 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:04:01.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:00 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:04:01.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:00 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:04:01.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:00 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:04:01.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:00 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:04:01.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:00 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:04:01.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:00 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:04:01.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:00 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:04:01.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:00 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:04:01.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:00 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:04:01.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:00 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:04:01.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:00 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:04:01.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:00 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:04:01.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:00 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:04:01.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:00 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:04:01.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:00 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:04:01.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:00 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:04:01.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:00 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:04:01.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:00 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:04:01.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:00 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:04:01.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:00 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:04:01.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:00 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:04:01.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:00 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:04:01.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:00 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:04:01.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:00 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:04:01.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:00 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:04:01.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:00 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:04:01.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:00 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:04:01.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:00 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:04:01.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:00 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:04:01.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:00 smithi181 ceph-mon[115276]: pgmap v15: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T14:04:01.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:00 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:04:01.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:00 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:04:01.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:00 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:04:01.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:00 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:04:01.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:00 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:04:01.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:00 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:04:01.253 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:00 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:04:01.253 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:00 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:04:01.253 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:00 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:04:01.253 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:00 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:04:01.253 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:00 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:04:01.253 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:00 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:04:01.253 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:00 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:04:01.253 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:00 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:04:01.253 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:00 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:04:01.253 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:00 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:04:01.319 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:00 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:04:01.319 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:00 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:04:01.319 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:00 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:04:01.319 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:00 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:04:01.319 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:00 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:04:01.319 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:00 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:04:01.319 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:00 smithi099 ceph-mon[29691]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:04:01.319 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:00 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:04:01.319 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:00 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:04:01.319 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:00 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:04:01.320 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:00 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:04:01.320 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:00 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:04:01.320 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:00 smithi099 ceph-mon[29691]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:04:01.320 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:00 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:04:01.320 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:00 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:04:01.320 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:00 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:04:01.320 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:00 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:04:01.320 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:00 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:04:01.320 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:00 smithi099 ceph-mon[29691]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:04:01.320 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:00 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:04:01.320 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:00 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:04:01.320 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:00 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:04:01.320 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:00 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:04:01.320 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:00 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:04:01.320 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:00 smithi099 ceph-mon[29691]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:04:01.320 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:00 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:04:01.321 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:00 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:04:01.321 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:00 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:04:01.321 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:00 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:04:01.321 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:00 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:04:01.321 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:00 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:04:01.321 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:00 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:04:01.321 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:00 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:04:01.321 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:00 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:04:01.321 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:00 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:04:01.321 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:00 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:04:01.321 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:00 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:04:01.322 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:00 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:04:01.322 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:00 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:04:01.322 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:00 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:04:01.322 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:00 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:04:01.322 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:00 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:04:01.322 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:00 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:04:01.322 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:00 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:04:01.322 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:00 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:04:01.322 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:00 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:04:01.322 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:00 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:04:01.322 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:00 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:04:01.322 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:00 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:04:01.322 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:00 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:04:01.323 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:00 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:04:01.323 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:00 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:04:01.323 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:00 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:04:01.323 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:00 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:04:01.323 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:00 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:04:01.323 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:00 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:04:01.323 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:00 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:04:01.323 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:00 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:04:01.323 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:00 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:04:01.323 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:00 smithi099 ceph-mon[29691]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:04:01.324 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:00 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:04:01.324 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:00 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:04:01.324 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:00 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:04:01.324 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:00 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:04:01.324 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:00 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:04:01.324 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:00 smithi099 ceph-mon[29691]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:04:01.324 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:00 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:04:01.324 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:00 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:04:01.324 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:00 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:04:01.324 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:00 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:04:01.324 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:00 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:04:01.324 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:00 smithi099 ceph-mon[29691]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:04:01.324 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:00 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:04:01.324 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:00 smithi099 ceph-mon[29691]: pgmap v15: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T14:04:01.324 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:00 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:04:01.324 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:00 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:04:01.325 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:00 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:04:01.325 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:00 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:04:01.325 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:00 smithi099 ceph-mon[29691]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:04:01.325 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:00 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:04:01.325 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:00 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:04:01.325 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:00 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:04:01.325 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:00 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:04:01.325 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:00 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:04:01.325 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:00 smithi099 ceph-mon[29691]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:04:01.325 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:00 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:04:01.325 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:00 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:04:01.325 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:00 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:04:01.325 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:00 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:04:01.325 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:00 smithi099 ceph-mon[29691]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:04:01.326 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:00 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:04:01.326 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:00 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:04:01.326 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:00 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:04:01.326 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:00 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:04:01.326 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:00 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:04:01.326 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:00 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:04:01.326 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:00 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:04:01.326 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:00 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:04:01.326 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:00 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:04:01.326 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:00 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:04:01.326 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:00 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:04:01.326 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:00 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:04:01.326 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:00 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:04:01.327 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:00 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:04:01.327 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:00 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:04:01.327 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:00 smithi099 ceph-mon[137093]: pgmap v15: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T14:04:01.327 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:00 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:04:01.327 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:00 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:04:01.327 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:00 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:04:01.327 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:00 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:04:01.327 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:00 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:04:01.327 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:00 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:04:01.327 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:00 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:04:01.327 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:00 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:04:01.327 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:00 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:04:01.327 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:00 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:04:01.327 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:00 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:04:01.327 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:00 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:04:01.328 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:00 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:04:01.328 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:00 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:04:01.328 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:00 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:04:01.328 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:00 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:04:02.206 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:01 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:04:02.207 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:01 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:04:02.207 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:01 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:04:02.207 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:01 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:04:02.207 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:01 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:04:02.207 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:01 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:04:02.207 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:01 smithi099 ceph-mon[29691]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:04:02.207 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:01 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:04:02.207 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:01 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:04:02.207 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:01 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:04:02.207 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:01 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:04:02.207 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:01 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:04:02.207 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:01 smithi099 ceph-mon[29691]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:04:02.207 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:01 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:04:02.207 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:01 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:04:02.208 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:01 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:04:02.208 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:01 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:04:02.208 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:01 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:04:02.208 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:01 smithi099 ceph-mon[29691]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:04:02.208 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:01 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:04:02.208 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:01 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:04:02.208 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:01 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:04:02.208 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:01 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:04:02.208 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:01 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:04:02.208 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:01 smithi099 ceph-mon[29691]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:04:02.208 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:01 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:04:02.208 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:01 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:04:02.208 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:01 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:04:02.208 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:01 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:04:02.208 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:01 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:04:02.209 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:01 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:04:02.209 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:01 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:04:02.209 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:01 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:04:02.209 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:01 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:04:02.209 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:01 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:04:02.209 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:01 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:04:02.209 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:01 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:04:02.209 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:01 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:04:02.209 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:01 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:04:02.210 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:01 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:04:02.210 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:01 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:04:02.210 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:01 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:04:02.210 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:01 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:04:02.210 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:01 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:04:02.210 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:01 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:04:02.210 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:01 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:04:02.210 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:01 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:04:02.210 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:01 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:04:02.210 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:01 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:04:02.210 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:01 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:04:02.210 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:01 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:04:02.210 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:01 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:04:02.210 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:01 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:04:02.210 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:01 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:04:02.211 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:01 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:04:02.211 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:01 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:04:02.211 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:01 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:04:02.211 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:01 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:04:02.211 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:01 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:04:02.211 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:01 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:04:02.211 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:01 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:04:02.211 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:01 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:04:02.211 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:01 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:04:02.211 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:01 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:04:02.211 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:01 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:04:02.211 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:01 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:04:02.211 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:01 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:04:02.211 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:01 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:04:02.211 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:01 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:04:02.211 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:01 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:04:02.212 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:01 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:04:02.212 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:01 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:04:02.212 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:01 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:04:02.212 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:01 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:04:02.212 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:01 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:04:02.212 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:01 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:04:02.212 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:01 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:04:02.212 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:01 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:04:02.212 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:01 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:04:02.212 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:01 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:04:02.212 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:01 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:04:02.212 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:01 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:04:02.212 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:01 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:04:02.212 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:01 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:04:02.212 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:01 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:04:02.213 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:01 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:04:02.213 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:01 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:04:02.213 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:01 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:04:02.213 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:01 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:04:02.213 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:01 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:04:02.213 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:01 smithi099 ceph-mon[29691]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:04:02.213 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:01 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:04:02.213 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:01 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:04:02.213 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:01 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:04:02.213 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:01 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:04:02.214 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:01 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:04:02.214 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:01 smithi099 ceph-mon[29691]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:04:02.214 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:01 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:04:02.214 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:01 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:04:02.214 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:01 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:04:02.214 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:01 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:04:02.214 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:01 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:04:02.214 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:01 smithi099 ceph-mon[29691]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:04:02.214 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:01 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:04:02.214 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:01 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:04:02.214 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:01 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:04:02.214 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:01 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:04:02.214 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:01 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:04:02.214 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:01 smithi099 ceph-mon[29691]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:04:02.214 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:01 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:04:02.215 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:01 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:04:02.215 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:01 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:04:02.215 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:01 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:04:02.215 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:01 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:04:02.215 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:01 smithi099 ceph-mon[29691]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:04:02.215 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:01 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:04:02.215 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:01 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:04:02.215 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:01 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:04:02.215 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:01 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:04:02.215 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:01 smithi099 ceph-mon[29691]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:04:02.215 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:01 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:04:02.215 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:01 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:04:02.215 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:01 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:04:02.216 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:01 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:04:02.216 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:01 smithi099 ceph-mon[29691]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:04:02.216 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:01 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:04:02.216 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:01 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:04:02.216 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:01 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:04:02.216 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:01 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:04:02.216 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:01 smithi099 ceph-mon[29691]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:04:02.216 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:01 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:04:02.216 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:01 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:04:02.216 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:01 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:04:02.216 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:01 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:04:02.216 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:01 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:04:02.216 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:01 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:04:02.217 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:01 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:04:02.217 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:01 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:04:02.217 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:01 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:04:02.217 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:01 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:04:02.249 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:01 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:04:02.249 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:01 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:04:02.249 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:01 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:04:02.249 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:01 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:04:02.249 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:01 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:04:02.249 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:01 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:04:02.249 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:01 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:04:02.249 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:01 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:04:02.249 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:01 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:04:02.249 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:01 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:04:02.249 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:01 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:04:02.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:01 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:04:02.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:01 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:04:02.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:01 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:04:02.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:01 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:04:02.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:01 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:04:02.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:01 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:04:02.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:01 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:04:02.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:01 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:04:02.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:01 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:04:02.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:01 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:04:02.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:01 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:04:02.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:01 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:04:02.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:01 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:04:02.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:01 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:04:02.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:01 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:04:02.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:01 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:04:02.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:01 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:04:02.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:01 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:04:02.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:01 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:04:02.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:01 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:04:02.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:01 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:04:02.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:01 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:04:02.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:01 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:04:02.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:01 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:04:02.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:01 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:04:02.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:01 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:04:02.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:01 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:04:02.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:01 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:04:02.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:01 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:04:02.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:01 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:04:02.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:01 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:04:02.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:01 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:04:02.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:01 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:04:02.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:01 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:04:02.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:01 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:04:02.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:01 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:04:02.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:01 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:04:02.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:01 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:04:02.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:01 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:04:02.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:01 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:04:02.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:01 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:04:02.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:01 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:04:02.253 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:01 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:04:02.253 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:01 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:04:02.253 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:01 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:04:02.253 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:01 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:04:02.253 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:01 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:04:02.253 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:01 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:04:02.253 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:01 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:04:02.253 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:01 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:04:02.253 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:01 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:04:02.253 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:01 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:04:02.253 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:01 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:04:02.253 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:01 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:04:02.253 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:01 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:04:02.253 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:01 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:04:02.254 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:01 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:04:02.254 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:01 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:04:02.254 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:01 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:04:02.985 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:02 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:04:02.985 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:02 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:04:02.985 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:02 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:04:02.985 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:02 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:04:02.985 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:02 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:04:02.986 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:02 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:04:02.986 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:02 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:04:02.986 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:02 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:04:02.986 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:02 smithi099 ceph-mon[29691]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:04:02.986 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:02 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:04:02.986 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:02 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:04:02.986 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:02 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:04:02.986 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:02 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:04:02.986 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:02 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:04:02.986 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:02 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:04:02.986 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:02 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:04:02.986 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:02 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:04:02.987 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:02 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:04:02.987 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:02 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:04:02.987 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:02 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:04:03.249 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:02 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:04:03.249 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:02 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:04:03.249 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:02 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:04:03.249 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:02 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:04:03.249 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:02 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:04:03.249 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:02 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:04:03.249 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:02 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:04:03.249 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:02 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:04:03.249 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:02 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:04:03.249 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:02 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:04:03.249 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:02 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:04:03.249 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:02 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:04:03.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:02 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:04:03.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:02 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:04:03.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:02 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:04:03.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:02 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:04:03.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:02 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:04:03.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:02 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:04:03.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:02 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:04:03.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:02 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:04:03.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:02 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:04:03.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:02 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:04:03.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:02 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:04:03.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:02 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:04:03.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:02 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:04:03.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:02 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:04:03.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:02 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:04:03.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:02 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:04:03.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:02 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:04:03.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:02 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:04:03.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:02 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:04:03.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:02 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:04:03.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:02 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:04:03.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:02 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:04:03.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:02 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:04:03.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:02 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:04:03.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:02 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:04:03.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:02 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:04:03.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:02 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:04:03.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:02 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:04:03.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:02 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:04:03.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:02 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:04:03.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:02 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:04:03.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:02 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:04:03.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:02 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:04:03.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:02 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:04:03.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:02 smithi181 ceph-mon[115276]: pgmap v16: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T14:04:03.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:02 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:04:03.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:02 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:04:03.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:02 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:04:03.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:02 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:04:03.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:02 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:04:03.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:02 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:04:03.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:02 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:04:03.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:02 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:04:03.253 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:02 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:04:03.253 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:02 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:04:03.253 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:02 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:04:03.253 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:02 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:04:03.253 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:02 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:04:03.253 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:02 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:04:03.253 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:02 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:04:03.268 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:02 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:04:03.268 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:02 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:04:03.268 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:02 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:04:03.268 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:02 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:04:03.268 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:02 smithi099 ceph-mon[29691]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:04:03.268 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:02 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:04:03.268 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:02 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:04:03.268 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:02 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:04:03.268 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:02 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:04:03.268 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:02 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:04:03.268 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:02 smithi099 ceph-mon[29691]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:04:03.268 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:02 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:04:03.268 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:02 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:04:03.269 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:02 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:04:03.269 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:02 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:04:03.269 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:02 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:04:03.269 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:02 smithi099 ceph-mon[29691]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:04:03.269 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:02 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:04:03.269 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:02 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:04:03.269 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:02 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:04:03.269 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:02 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:04:03.269 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:02 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:04:03.269 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:02 smithi099 ceph-mon[29691]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:04:03.269 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:02 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:04:03.269 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:02 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:04:03.269 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:02 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:04:03.269 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:02 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:04:03.270 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:02 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:04:03.270 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:02 smithi099 ceph-mon[29691]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:04:03.270 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:02 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:04:03.270 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:02 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:04:03.270 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:02 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:04:03.270 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:02 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:04:03.270 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:02 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:04:03.270 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:02 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:04:03.270 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:02 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:04:03.270 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:02 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:04:03.270 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:02 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:04:03.271 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:02 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:04:03.271 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:02 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:04:03.271 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:02 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:04:03.271 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:02 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:04:03.271 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:02 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:04:03.271 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:02 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:04:03.271 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:02 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:04:03.271 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:02 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:04:03.271 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:02 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:04:03.271 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:02 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:04:03.271 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:02 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:04:03.271 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:02 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:04:03.271 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:02 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:04:03.271 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:02 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:04:03.272 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:02 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:04:03.272 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:02 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:04:03.272 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:02 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:04:03.272 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:02 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:04:03.272 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:02 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:04:03.272 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:02 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:04:03.272 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:02 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:04:03.272 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:02 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:04:03.272 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:02 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:04:03.272 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:02 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:04:03.272 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:02 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:04:03.272 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:02 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:04:03.273 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:02 smithi099 ceph-mon[29691]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:04:03.273 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:02 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:04:03.273 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:02 smithi099 ceph-mon[29691]: pgmap v16: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T14:04:03.273 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:02 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:04:03.273 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:02 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:04:03.273 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:02 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:04:03.273 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:02 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:04:03.273 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:02 smithi099 ceph-mon[29691]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:04:03.273 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:02 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:04:03.273 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:02 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:04:03.273 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:02 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:04:03.273 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:02 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:04:03.273 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:02 smithi099 ceph-mon[29691]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:04:03.273 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:02 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:04:03.273 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:02 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:04:03.273 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:02 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:04:03.274 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:02 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:04:03.274 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:02 smithi099 ceph-mon[29691]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:04:03.274 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:02 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:04:03.274 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:02 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:04:03.274 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:02 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:04:03.274 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:02 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:04:03.274 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:02 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:04:03.274 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:02 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:04:03.274 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:02 smithi099 ceph-mon[137093]: pgmap v16: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T14:04:03.274 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:02 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:04:03.274 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:02 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:04:03.274 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:02 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:04:03.275 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:02 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:04:03.275 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:02 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:04:03.275 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:02 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:04:03.275 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:02 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:04:03.275 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:02 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:04:03.275 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:02 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:04:03.275 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:02 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:04:03.275 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:02 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:04:03.275 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:02 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:04:03.275 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:02 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:04:03.275 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:02 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:04:03.275 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:02 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:04:04.249 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:03 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:04:04.249 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:03 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:04:04.249 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:03 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:04:04.249 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:03 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:04:04.249 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:03 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:04:04.249 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:03 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:04:04.249 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:03 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:04:04.249 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:03 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:04:04.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:03 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:04:04.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:03 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:04:04.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:03 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:04:04.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:03 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:04:04.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:03 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:04:04.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:03 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:04:04.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:03 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:04:04.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:03 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:04:04.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:03 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:04:04.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:03 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:04:04.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:03 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:04:04.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:03 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:04:04.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:03 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:04:04.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:03 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:04:04.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:03 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:04:04.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:03 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:04:04.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:03 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:04:04.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:03 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:04:04.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:03 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:04:04.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:03 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:04:04.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:03 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:04:04.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:03 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:04:04.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:03 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:04:04.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:03 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:04:04.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:03 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:04:04.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:03 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:04:04.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:03 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:04:04.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:03 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:04:04.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:03 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:04:04.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:03 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:04:04.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:03 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:04:04.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:03 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:04:04.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:03 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:04:04.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:03 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:04:04.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:03 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:04:04.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:03 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:04:04.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:03 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:04:04.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:03 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:04:04.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:03 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:04:04.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:03 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:04:04.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:03 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:04:04.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:03 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:04:04.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:03 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:04:04.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:03 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:04:04.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:03 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:04:04.253 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:03 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:04:04.330 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:03 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:04:04.330 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:04 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:04:04.330 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:04 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:04:04.330 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:04 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:04:04.330 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:04 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:04:04.330 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:04 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:04:04.330 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:04 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:04:04.330 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:04 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:04:04.331 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:04 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:04:04.331 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:04 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:04:04.331 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:04 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:04:04.331 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:04 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:04:04.331 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:04 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:04:04.331 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:04 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:04:04.331 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:04 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:04:04.331 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:04 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:04:04.331 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:04 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:04:04.331 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:04 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:04:04.331 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:04 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:04:04.331 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:04 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:04:04.331 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:04 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:04:04.331 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:04 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:04:04.332 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:04 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:04:04.332 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:04 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:04:04.332 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:04 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:04:04.332 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:04 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:04:04.332 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:04 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:04:04.332 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:04 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:04:04.332 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:04 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:04:04.332 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:04 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:04:04.332 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:03 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:04:04.333 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:04 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:04:04.333 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:04 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:04:04.333 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:04 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:04:04.333 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:04 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:04:04.333 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:04 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:04:04.333 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:04 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:04:04.333 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:04 smithi099 ceph-mon[29691]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:04:04.333 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:04 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:04:04.333 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:04 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:04:04.333 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:04 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:04:04.333 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:04 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:04:04.333 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:04 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:04:04.334 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:04 smithi099 ceph-mon[29691]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:04:04.334 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:04 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:04:04.334 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:04 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:04:04.334 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:04 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:04:04.334 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:04 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:04:04.334 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:04 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:04:04.334 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:04 smithi099 ceph-mon[29691]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:04:04.334 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:04 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:04:04.334 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:04 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:04:04.334 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:04 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:04:04.334 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:04 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:04:04.334 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:04 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:04:04.334 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:04 smithi099 ceph-mon[29691]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:04:04.334 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:04 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:04:04.335 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:04 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:04:04.335 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:04 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:04:04.335 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:04 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:04:04.335 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:04 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:04:04.335 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:04 smithi099 ceph-mon[29691]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:04:04.335 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:04 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:04:04.335 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:04 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:04:04.335 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:04 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:04:04.335 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:04 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:04:04.335 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:04 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:04:04.335 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:04 smithi099 ceph-mon[29691]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:04:04.335 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:04 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:04:04.335 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:04 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:04:04.335 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:04 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:04:04.336 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:04 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:04:04.336 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:04 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:04:04.336 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:04 smithi099 ceph-mon[29691]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:04:04.336 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:04 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:04:04.336 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:04 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:04:04.336 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:04 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:04:04.336 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:04 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:04:04.336 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:04 smithi099 ceph-mon[29691]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:04:04.336 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:04 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:04:04.336 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:04 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:04:04.336 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:04 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:04:04.336 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:04 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:04:04.336 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:04 smithi099 ceph-mon[29691]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:04:04.337 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:04 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:04:04.337 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:04 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:04:04.337 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:04 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:04:04.337 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:04 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:04:04.337 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:04 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:04:04.337 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:04 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:04:04.337 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:04 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:04:04.337 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:04 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:04:04.337 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:04 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:04:04.337 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:04 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:04:04.337 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:04 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:04:04.337 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:04 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:04:04.337 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:04 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:04:04.337 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:04 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:04:04.337 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:04 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:04:04.337 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:04 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:04:04.338 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:04 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:04:04.338 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:04 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:04:04.338 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:04 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:04:04.338 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:04 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:04:04.338 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:04 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:04:04.338 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:04 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:04:04.338 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:04 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:04:04.338 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:04 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:04:05.079 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 14:04:04 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[71049]: ::ffff:172.21.15.181 - - [30/Mar/2024:14:04:04] "GET /metrics HTTP/1.1" 200 38013 "" "Prometheus/2.43.0" 2024-03-30T14:04:05.080 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:04 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:04:05.080 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:04 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:04:05.080 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:04 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:04:05.080 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:04 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:04:05.080 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:04 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:04:05.080 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:04 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:04:05.080 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:04 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:04:05.080 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:04 smithi099 ceph-mon[29691]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:04:05.080 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:04 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:04:05.080 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:04 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:04:05.080 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:04 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:04:05.080 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:04 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:04:05.080 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:04 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:04:05.081 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:04 smithi099 ceph-mon[29691]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:04:05.081 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:04 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:04:05.081 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:04 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:04:05.081 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:04 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:04:05.081 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:04 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:04:05.081 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:04 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:04:05.081 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:04 smithi099 ceph-mon[29691]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:04:05.081 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:04 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:04:05.081 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:04 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:04:05.081 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:04 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:04:05.081 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:04 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:04:05.081 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:04 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:04:05.081 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:04 smithi099 ceph-mon[29691]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:04:05.081 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:04 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:04:05.081 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:04 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:04:05.081 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:04 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:04:05.082 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:04 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:04:05.082 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:04 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:04:05.082 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:04 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:04:05.082 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:04 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:04:05.082 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:04 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:04:05.082 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:04 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:04:05.082 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:04 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:04:05.082 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:04 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:04:05.082 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:04 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:04:05.082 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:04 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:04:05.083 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:04 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:04:05.083 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:04 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:04:05.083 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:04 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:04:05.083 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:04 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:04:05.083 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:04 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:04:05.083 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:04 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:04:05.083 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:04 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:04:05.083 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:04 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:04:05.083 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:04 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:04:05.083 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:04 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:04:05.083 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:04 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:04:05.083 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:04 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:04:05.083 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:04 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:04:05.083 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:04 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:04:05.084 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:04 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:04:05.084 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:04 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:04:05.084 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:04 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:04:05.084 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:04 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:04:05.084 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:04 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:04:05.084 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:04 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:04:05.084 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:04 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:04:05.084 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:04 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:04:05.084 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:04 smithi099 ceph-mon[29691]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:04:05.084 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:04 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:04:05.084 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:04 smithi099 ceph-mon[29691]: pgmap v17: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T14:04:05.085 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:04 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:04:05.085 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:04 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:04:05.085 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:04 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:04:05.085 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:04 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:04:05.085 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:04 smithi099 ceph-mon[29691]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:04:05.085 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:04 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:04:05.085 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:04 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:04:05.085 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:04 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:04:05.085 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:04 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:04:05.085 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:04 smithi099 ceph-mon[29691]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:04:05.085 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:04 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:04:05.085 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:04 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:04:05.085 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:04 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:04:05.085 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:04 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:04:05.085 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:04 smithi099 ceph-mon[29691]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:04:05.086 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:04 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:04:05.086 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:04 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:04:05.086 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:04 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:04:05.086 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:04 smithi099 ceph-mon[137093]: pgmap v17: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T14:04:05.086 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:04 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:04:05.086 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:04 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:04:05.086 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:04 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:04:05.086 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:04 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:04:05.086 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:04 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:04:05.086 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:04 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:04:05.086 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:04 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:04:05.086 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:04 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:04:05.087 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:04 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:04:05.087 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:04 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:04:05.087 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:04 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:04:05.087 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:04 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:04:05.087 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:04 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:04:05.087 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:04 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:04:05.087 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:04 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:04:05.249 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:04 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:04:05.249 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:04 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:04:05.249 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:04 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:04:05.249 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:04 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:04:05.249 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:04 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:04:05.249 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:04 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:04:05.249 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:04 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:04:05.249 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:04 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:04:05.249 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:04 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:04:05.249 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:04 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:04:05.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:04 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:04:05.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:04 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:04:05.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:04 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:04:05.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:04 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:04:05.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:04 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:04:05.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:04 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:04:05.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:04 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:04:05.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:04 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:04:05.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:04 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:04:05.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:04 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:04:05.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:04 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:04:05.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:04 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:04:05.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:04 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:04:05.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:04 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:04:05.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:04 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:04:05.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:04 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:04:05.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:04 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:04:05.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:04 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:04:05.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:04 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:04:05.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:04 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:04:05.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:04 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:04:05.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:04 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:04:05.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:04 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:04:05.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:04 smithi181 ceph-mon[115276]: pgmap v17: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T14:04:05.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:04 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:04:05.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:04 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:04:05.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:04 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:04:05.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:04 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:04:05.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:04 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:04:05.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:04 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:04:05.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:04 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:04:05.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:04 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:04:05.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:04 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:04:05.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:04 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:04:05.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:04 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:04:05.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:04 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:04:05.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:04 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:04:05.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:04 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:04:05.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:04 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:04:06.054 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:06 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:04:06.054 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:06 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:04:06.055 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:06 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:04:06.055 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:06 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:04:06.055 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:06 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:04:06.055 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:06 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:04:06.055 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:06 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:04:06.055 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:06 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:04:06.055 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:06 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:04:06.055 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:06 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:04:06.055 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:06 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:04:06.055 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:06 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:04:06.055 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:06 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:04:06.055 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:06 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:04:06.055 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:06 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:04:06.055 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:06 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:04:06.056 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:06 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:04:06.056 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:06 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:04:06.056 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:06 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:04:06.056 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:06 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:04:06.056 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:06 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:04:06.056 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:06 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:04:06.056 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:06 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:04:06.056 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:06 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:04:06.056 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:06 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:04:06.056 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:06 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:04:06.056 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:06 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:04:06.056 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:06 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:04:06.056 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:06 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:04:06.056 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:06 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:04:06.057 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:06 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:04:06.057 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:06 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:04:06.057 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:06 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:04:06.057 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:06 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:04:06.057 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:06 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:04:06.057 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:06 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:04:06.057 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:06 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:04:06.057 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:06 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:04:06.057 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:06 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:04:06.057 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:06 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:04:06.057 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:06 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:04:06.057 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:06 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:04:06.058 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:06 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:04:06.058 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:06 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:04:06.058 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:06 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:04:06.058 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:06 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:04:06.058 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:06 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:04:06.058 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:06 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:04:06.058 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:06 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:04:06.058 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:06 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:04:06.058 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:06 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:04:06.058 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:06 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:04:06.058 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:06 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:04:06.058 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:06 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:04:06.058 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:06 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:04:06.058 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:06 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:04:06.058 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:06 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:04:06.058 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:06 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:04:06.059 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:06 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:04:06.059 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:06 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:04:06.059 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:06 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:04:06.059 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:06 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:04:06.059 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:06 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:04:06.059 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:06 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:04:06.059 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:06 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:04:06.059 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:06 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:04:06.059 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:06 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:04:06.059 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:06 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:04:06.059 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:06 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:04:06.059 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:06 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:04:06.059 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:06 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:04:06.059 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:06 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:04:06.330 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:06 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:04:06.330 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:06 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:04:06.330 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:06 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:04:06.330 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:06 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:04:06.330 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:06 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:04:06.331 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:06 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:04:06.331 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:06 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:04:06.331 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:06 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:04:06.331 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:06 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:04:06.331 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:06 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:04:06.331 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:06 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:04:06.331 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:06 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:04:06.331 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:06 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:04:06.331 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:06 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:04:06.331 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:06 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:04:06.331 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:06 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:04:06.331 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:06 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:04:06.331 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:06 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:04:06.332 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:06 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:04:06.332 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:06 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:04:06.332 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:06 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:04:06.332 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:06 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:04:06.332 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:06 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:04:06.332 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:06 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:04:06.332 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:06 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:04:06.332 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:06 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:04:06.332 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:06 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:04:06.332 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:06 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:04:06.332 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:06 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:04:06.332 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:06 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:04:06.333 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:06 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:04:06.333 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:06 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:04:06.333 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:06 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:04:06.333 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:06 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:04:06.333 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:06 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:04:06.333 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:06 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:04:06.333 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:06 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:04:06.333 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:06 smithi099 ceph-mon[29691]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:04:06.333 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:06 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:04:06.334 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:06 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:04:06.334 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:06 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:04:06.334 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:06 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:04:06.334 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:06 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:04:06.334 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:06 smithi099 ceph-mon[29691]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:04:06.334 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:06 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:04:06.334 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:06 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:04:06.334 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:06 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:04:06.334 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:06 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:04:06.334 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:06 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:04:06.334 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:06 smithi099 ceph-mon[29691]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:04:06.334 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:06 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:04:06.335 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:06 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:04:06.335 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:06 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:04:06.335 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:06 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:04:06.335 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:06 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:04:06.335 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:06 smithi099 ceph-mon[29691]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:04:06.335 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:06 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:04:06.335 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:06 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:04:06.335 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:06 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:04:06.335 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:06 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:04:06.335 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:06 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:04:06.336 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:06 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:04:06.336 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:06 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:04:06.336 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:06 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:04:06.336 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:06 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:04:06.336 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:06 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:04:06.336 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:06 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:04:06.336 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:06 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:04:06.336 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:06 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:04:06.336 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:06 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:04:06.336 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:06 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:04:06.336 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:06 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:04:06.337 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:06 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:04:06.337 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:06 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:04:06.337 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:06 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:04:06.337 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:06 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:04:06.337 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:06 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:04:06.337 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:06 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:04:06.337 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:06 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:04:06.337 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:06 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:04:06.337 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:06 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:04:06.337 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:06 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:04:06.337 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:06 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:04:06.337 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:06 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:04:06.337 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:06 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:04:06.338 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:06 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:04:06.338 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:06 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:04:06.338 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:06 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:04:06.338 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:06 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:04:06.338 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:06 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:04:06.338 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:06 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:04:06.338 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:06 smithi099 ceph-mon[29691]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:04:06.338 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:06 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:04:06.339 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:06 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:04:06.339 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:06 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:04:06.339 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:06 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:04:06.339 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:06 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:04:06.339 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:06 smithi099 ceph-mon[29691]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:04:06.339 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:06 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:04:06.339 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:06 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:04:06.339 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:06 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:04:06.339 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:06 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:04:06.339 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:06 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:04:06.339 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:06 smithi099 ceph-mon[29691]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:04:06.339 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:06 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:04:06.339 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:06 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:04:06.340 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:06 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:04:06.340 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:06 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:04:06.340 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:06 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:04:06.340 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:06 smithi099 ceph-mon[29691]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:04:06.340 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:06 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:04:06.340 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:06 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:04:06.340 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:06 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:04:06.340 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:06 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:04:06.340 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:06 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:04:06.340 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:06 smithi099 ceph-mon[29691]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:04:06.340 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:06 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:04:06.340 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:06 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:04:06.341 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:06 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:04:06.341 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:06 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:04:06.341 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:06 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:04:06.341 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:06 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:04:06.341 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:06 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:04:06.341 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:06 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:04:06.341 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:06 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:04:06.341 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:06 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:04:06.341 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:06 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:04:06.341 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:06 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:04:06.341 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:06 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:04:06.341 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:06 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:04:06.342 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:06 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:04:06.342 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:06 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:04:06.342 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:06 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:04:06.342 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:06 smithi099 ceph-mon[29691]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:04:06.342 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:06 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:04:06.342 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:06 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:04:06.342 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:06 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:04:06.342 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:06 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:04:06.342 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:06 smithi099 ceph-mon[29691]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:04:06.343 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:06 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:04:06.343 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:06 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:04:06.343 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:06 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:04:06.343 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:06 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:04:06.343 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:06 smithi099 ceph-mon[29691]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:04:07.191 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:07 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:04:07.191 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:07 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:04:07.191 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:07 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:04:07.191 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:07 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:04:07.191 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:07 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:04:07.191 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:07 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:04:07.191 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:07 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:04:07.191 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:07 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:04:07.192 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:07 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:04:07.192 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:07 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:04:07.192 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:07 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:04:07.192 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:07 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:04:07.192 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:07 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:04:07.192 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:07 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:04:07.192 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:07 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:04:07.192 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:07 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:04:07.192 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:07 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:04:07.192 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:07 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:04:07.192 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:07 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:04:07.192 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:07 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:04:07.192 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:07 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:04:07.192 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:07 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:04:07.192 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:07 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:04:07.193 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:07 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:04:07.193 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:07 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:04:07.193 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:07 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:04:07.193 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:07 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:04:07.193 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:07 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:04:07.193 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:07 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:04:07.193 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:07 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:04:07.193 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:07 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:04:07.193 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:07 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:04:07.193 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:07 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:04:07.194 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:07 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:04:07.194 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:07 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:04:07.194 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:07 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:04:07.194 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:07 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:04:07.194 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:07 smithi099 ceph-mon[29691]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:04:07.194 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:07 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:04:07.194 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:07 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:04:07.194 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:07 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:04:07.194 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:07 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:04:07.194 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:07 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:04:07.194 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:07 smithi099 ceph-mon[29691]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:04:07.194 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:07 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:04:07.195 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:07 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:04:07.195 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:07 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:04:07.195 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:07 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:04:07.195 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:07 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:04:07.195 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:07 smithi099 ceph-mon[29691]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:04:07.195 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:07 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:04:07.195 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:07 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:04:07.195 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:07 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:04:07.195 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:07 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:04:07.195 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:07 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:04:07.195 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:07 smithi099 ceph-mon[29691]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:04:07.195 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:07 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:04:07.195 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:07 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:04:07.195 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:07 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:04:07.195 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:07 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:04:07.195 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:07 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:04:07.196 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:07 smithi099 ceph-mon[29691]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:04:07.196 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:07 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:04:07.196 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:07 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:04:07.196 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:07 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:04:07.196 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:07 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:04:07.196 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:07 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:04:07.196 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:07 smithi099 ceph-mon[29691]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:04:07.196 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:07 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:04:07.196 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:07 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:04:07.196 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:07 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:04:07.196 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:07 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:04:07.196 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:07 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:04:07.196 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:07 smithi099 ceph-mon[29691]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:04:07.197 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:07 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:04:07.197 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:07 smithi099 ceph-mon[29691]: pgmap v18: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T14:04:07.197 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:07 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:04:07.197 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:07 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:04:07.197 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:07 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:04:07.197 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:07 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:04:07.197 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:07 smithi099 ceph-mon[29691]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:04:07.197 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:07 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T14:04:07.197 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:07 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:04:07.197 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:07 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:04:07.197 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:07 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:04:07.197 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:07 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:04:07.197 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:07 smithi099 ceph-mon[29691]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:04:07.198 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:07 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:04:07.198 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:07 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:04:07.198 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:07 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:04:07.198 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:07 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:04:07.198 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:07 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:04:07.198 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:07 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:04:07.198 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:07 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:04:07.198 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:07 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:04:07.198 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:07 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:04:07.198 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:07 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:04:07.198 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:07 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:04:07.199 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:07 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:04:07.199 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:07 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:04:07.199 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:07 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:04:07.199 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:07 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:04:07.199 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:07 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:04:07.199 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:07 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:04:07.199 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:07 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:04:07.199 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:07 smithi099 ceph-mon[137093]: pgmap v18: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T14:04:07.199 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:07 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:04:07.199 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:07 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:04:07.199 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:07 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:04:07.199 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:07 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:04:07.199 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:07 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:04:07.199 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:07 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T14:04:07.199 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:07 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:04:07.200 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:07 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:04:07.200 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:07 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:04:07.200 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:07 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:04:07.200 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:07 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:04:07.200 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:07 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:04:07.200 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:07 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:04:07.200 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:07 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:04:07.200 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:07 smithi099 ceph-mon[29691]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:04:07.200 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:07 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:04:07.200 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:07 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:04:07.201 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:07 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:04:07.249 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:07 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:04:07.249 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:07 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:04:07.249 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:07 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:04:07.249 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:07 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:04:07.249 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:07 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:04:07.249 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:07 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:04:07.249 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:07 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:04:07.249 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:07 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:04:07.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:07 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:04:07.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:07 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:04:07.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:07 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:04:07.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:07 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:04:07.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:07 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:04:07.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:07 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:04:07.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:07 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:04:07.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:07 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:04:07.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:07 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:04:07.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:07 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:04:07.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:07 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:04:07.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:07 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:04:07.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:07 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:04:07.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:07 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:04:07.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:07 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:04:07.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:07 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:04:07.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:07 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:04:07.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:07 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:04:07.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:07 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:04:07.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:07 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:04:07.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:07 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:04:07.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:07 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:04:07.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:07 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:04:07.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:07 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:04:07.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:07 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:04:07.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:07 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:04:07.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:07 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:04:07.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:07 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:04:07.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:07 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:04:07.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:07 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:04:07.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:07 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:04:07.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:07 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:04:07.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:07 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:04:07.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:07 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:04:07.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:07 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:04:07.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:07 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:04:07.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:07 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:04:07.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:07 smithi181 ceph-mon[115276]: pgmap v18: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T14:04:07.253 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:07 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:04:07.253 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:07 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:04:07.253 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:07 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:04:07.253 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:07 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:04:07.253 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:07 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:04:07.253 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:07 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T14:04:07.253 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:07 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:04:07.253 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:07 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:04:07.253 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:07 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:04:07.253 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:07 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:04:07.253 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:07 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:04:07.253 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:07 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:04:07.253 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:07 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:04:07.253 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:07 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:04:07.253 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:07 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:04:07.254 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:07 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:04:08.249 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:08 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:04:08.249 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:08 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:04:08.249 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:08 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:04:08.249 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:08 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:04:08.249 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:08 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:04:08.249 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:08 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:04:08.249 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:08 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:04:08.249 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:08 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:04:08.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:08 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:04:08.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:08 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:04:08.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:08 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:04:08.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:08 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:04:08.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:08 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:04:08.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:08 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:04:08.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:08 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:04:08.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:08 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:04:08.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:08 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:04:08.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:08 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:04:08.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:08 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:04:08.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:08 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:04:08.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:08 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:04:08.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:08 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:04:08.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:08 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:04:08.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:08 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:04:08.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:08 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:04:08.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:08 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:04:08.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:08 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:04:08.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:08 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:04:08.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:08 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:04:08.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:08 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:04:08.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:08 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:04:08.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:08 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:04:08.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:08 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:04:08.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:08 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:04:08.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:08 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:04:08.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:08 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:04:08.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:08 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:04:08.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:08 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:04:08.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:08 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:04:08.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:08 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:04:08.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:08 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:04:08.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:08 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:04:08.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:08 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:04:08.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:08 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:04:08.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:08 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:04:08.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:08 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:04:08.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:08 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:04:08.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:08 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:04:08.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:08 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:04:08.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:08 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:04:08.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:08 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:04:08.253 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:08 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:04:08.253 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:08 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:04:08.253 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:08 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:04:08.253 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:08 smithi181 ceph-mon[115276]: from='client.25136 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T14:04:08.253 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:08 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:04:08.253 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:08 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:04:08.253 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:08 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:04:08.253 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:08 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:04:08.253 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:08 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:04:08.253 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:08 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:04:08.253 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:08 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:04:08.253 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:08 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:04:08.253 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:08 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:04:08.253 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:08 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:04:08.253 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:08 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:04:08.253 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:08 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:04:08.253 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:08 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:04:08.254 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:08 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:04:08.254 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:08 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:04:08.329 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:08 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:04:08.329 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:08 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:04:08.329 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:08 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:04:08.329 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:08 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:04:08.330 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:08 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:04:08.330 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:08 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:04:08.330 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:08 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:04:08.330 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:08 smithi099 ceph-mon[29691]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:04:08.330 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:08 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:04:08.330 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:08 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:04:08.330 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:08 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:04:08.330 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:08 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:04:08.330 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:08 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:04:08.330 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:08 smithi099 ceph-mon[29691]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:04:08.330 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:08 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:04:08.330 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:08 smithi099 ceph-mon[29691]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:04:08.330 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:08 smithi099 ceph-mon[29691]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:04:08.331 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:08 smithi099 ceph-mon[29691]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:04:08.331 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:08 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:04:08.331 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:08 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:04:08.331 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:08 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:04:08.331 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:08 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:04:08.331 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:08 smithi099 ceph-mon[29691]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:04:08.331 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:08 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:04:08.331 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:08 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:04:08.331 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:08 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:04:08.331 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:08 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:04:08.331 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:08 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:04:08.331 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:08 smithi099 ceph-mon[29691]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:04:08.331 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:08 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:04:08.331 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:08 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:04:08.331 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:08 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:04:08.332 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:08 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:04:08.332 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:08 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:04:08.332 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:08 smithi099 ceph-mon[29691]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:04:08.332 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:08 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:04:08.332 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:08 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:04:08.332 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:08 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:04:08.332 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:08 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:04:08.332 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:08 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:04:08.333 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:08 smithi099 ceph-mon[29691]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:04:08.333 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:08 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:04:08.333 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:08 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:04:08.333 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:08 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:04:08.333 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:08 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:04:08.333 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:08 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:04:08.333 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:08 smithi099 ceph-mon[29691]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:04:08.333 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:08 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:04:08.333 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:08 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:04:08.333 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:08 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:04:08.333 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:08 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:04:08.333 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:08 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:04:08.333 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:08 smithi099 ceph-mon[29691]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:04:08.333 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:08 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:04:08.333 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:08 smithi099 ceph-mon[29691]: from='client.25136 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T14:04:08.333 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:08 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:04:08.334 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:08 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:04:08.334 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:08 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:04:08.334 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:08 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:04:08.334 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:08 smithi099 ceph-mon[29691]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:04:08.334 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:08 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:04:08.334 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:08 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:04:08.334 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:08 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:04:08.334 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:08 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:04:08.334 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:08 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:04:08.334 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:08 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:04:08.334 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:08 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:04:08.335 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:08 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:04:08.335 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:08 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:04:08.335 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:08 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:04:08.335 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:08 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:04:08.335 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:08 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:04:08.335 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:08 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:04:08.335 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:08 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:04:08.335 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:08 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:04:08.335 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:08 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:04:08.335 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:08 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:04:08.335 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:08 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:04:08.335 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:08 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:04:08.335 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:08 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:04:08.335 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:08 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:04:08.335 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:08 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:04:08.335 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:08 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:04:08.336 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:08 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:04:08.336 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:08 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:04:08.336 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:08 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:04:08.336 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:08 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:04:08.336 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:08 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:04:08.336 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:08 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:04:08.336 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:08 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:04:08.336 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:08 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:04:08.336 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:08 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:04:08.336 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:08 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:04:08.336 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:08 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:04:08.336 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:08 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:04:08.337 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:08 smithi099 ceph-mon[29691]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:04:08.337 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:08 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:04:08.337 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:08 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:04:08.337 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:08 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:04:08.337 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:08 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:04:08.337 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:08 smithi099 ceph-mon[29691]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:04:08.337 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:08 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:04:08.337 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:08 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:04:08.337 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:08 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:04:08.337 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:08 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:04:08.337 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:08 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:04:08.337 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:08 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:04:08.338 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:08 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:04:08.338 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:08 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:04:08.338 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:08 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:04:08.338 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:08 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:04:08.338 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:08 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:04:08.338 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:08 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:04:08.338 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:08 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:04:08.338 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:08 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:04:08.338 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:08 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:04:08.338 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:08 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:04:08.338 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:08 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:04:08.338 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:08 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:04:08.338 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:08 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:04:08.339 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:08 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:04:08.339 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:08 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:04:08.339 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:08 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:04:08.339 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:08 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:04:08.339 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:08 smithi099 ceph-mon[137093]: from='client.25136 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T14:04:08.339 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:08 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:04:08.339 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:08 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:04:08.339 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:08 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:04:08.339 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:08 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:04:08.339 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:08 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:04:08.339 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:08 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:04:08.339 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:08 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:04:08.339 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:08 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:04:08.339 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:08 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:04:08.339 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:08 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:04:08.339 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:08 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:04:08.339 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:08 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:04:08.340 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:08 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:04:08.340 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:08 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:04:08.340 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:08 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:04:09.005 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:09 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:04:09.005 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:09 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:04:09.005 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:09 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:04:09.005 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:09 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:04:09.005 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:09 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:04:09.005 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:09 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:04:09.005 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:09 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:04:09.005 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:09 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:04:09.006 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:09 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:04:09.006 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:09 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:04:09.006 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:09 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:04:09.006 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:09 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:04:09.006 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:09 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:04:09.006 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:09 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:04:09.006 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:09 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:04:09.006 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:09 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:04:09.006 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:09 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:04:09.006 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:09 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:04:09.006 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:09 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:04:09.006 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:09 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:04:09.006 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:09 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:04:09.006 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:09 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:04:09.007 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:09 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:04:09.007 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:09 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:04:09.007 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:09 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:04:09.007 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:09 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:04:09.007 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:09 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:04:09.007 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:09 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:04:09.007 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:09 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:04:09.007 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:09 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:04:09.007 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:09 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:04:09.007 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:09 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:04:09.007 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:09 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:04:09.007 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:09 smithi099 ceph-mon[137093]: pgmap v19: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T14:04:09.007 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:09 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:04:09.007 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:09 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:04:09.008 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:09 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:04:09.008 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:09 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:04:09.008 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:09 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:04:09.008 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:09 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:04:09.008 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:09 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:04:09.008 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:09 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:04:09.008 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:09 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:04:09.008 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:09 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:04:09.008 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:09 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:04:09.008 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:09 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:04:09.008 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:09 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:04:09.008 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:09 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:04:09.008 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:09 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:04:09.008 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:09 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:04:09.008 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:09 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:04:09.009 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:09 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:04:09.009 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:09 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:04:09.009 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:09 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:04:09.009 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:09 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:04:09.009 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:09 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:04:09.009 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:09 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:04:09.009 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:09 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:04:09.009 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:09 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:04:09.009 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:09 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:04:09.010 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:09 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:04:09.010 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:09 smithi099 ceph-mon[29691]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:04:09.010 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:09 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:04:09.010 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:09 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:04:09.010 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:09 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:04:09.010 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:09 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:04:09.010 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:09 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:04:09.010 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:09 smithi099 ceph-mon[29691]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:04:09.010 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:09 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:04:09.010 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:09 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:04:09.010 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:09 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:04:09.010 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:09 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:04:09.010 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:09 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:04:09.010 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:09 smithi099 ceph-mon[29691]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:04:09.010 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:09 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:04:09.010 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:09 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:04:09.011 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:09 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:04:09.011 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:09 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:04:09.011 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:09 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:04:09.011 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:09 smithi099 ceph-mon[29691]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:04:09.011 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:09 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:04:09.011 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:09 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:04:09.011 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:09 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:04:09.011 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:09 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:04:09.011 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:09 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:04:09.011 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:09 smithi099 ceph-mon[29691]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:04:09.011 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:09 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:04:09.011 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:09 smithi099 ceph-mon[29691]: pgmap v19: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T14:04:09.011 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:09 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:04:09.011 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:09 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:04:09.011 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:09 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:04:09.011 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:09 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:04:09.012 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:09 smithi099 ceph-mon[29691]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:04:09.012 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:09 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:04:09.012 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:09 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:04:09.012 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:09 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:04:09.012 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:09 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:04:09.012 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:09 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:04:09.012 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:09 smithi099 ceph-mon[29691]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:04:09.012 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:09 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:04:09.012 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:09 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:04:09.012 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:09 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:04:09.012 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:09 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:04:09.012 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:09 smithi099 ceph-mon[29691]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:04:09.012 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:09 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:04:09.012 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:09 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:04:09.012 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:09 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:04:09.012 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:09 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:04:09.013 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:09 smithi099 ceph-mon[29691]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:04:09.329 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:09 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:04:09.499 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:09 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:04:09.499 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:09 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:04:09.499 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:09 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:04:09.499 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:09 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:04:09.499 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:09 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:04:09.499 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:09 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:04:09.499 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:09 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:04:09.499 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:09 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:04:09.499 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:09 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:04:09.499 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:09 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:04:09.499 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:09 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:04:09.500 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:09 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:04:09.500 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:09 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:04:09.500 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:09 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:04:09.500 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:09 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:04:09.500 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:09 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:04:09.500 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:09 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:04:09.500 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:09 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:04:09.500 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:09 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:04:09.500 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:09 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:04:09.500 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:09 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:04:09.500 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:09 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:04:09.500 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:09 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:04:09.500 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:09 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:04:09.500 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:09 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:04:09.500 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:09 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:04:09.501 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:09 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:04:09.501 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:09 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:04:09.501 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:09 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:04:09.501 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:09 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:04:09.501 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:09 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:04:09.501 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:09 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:04:09.501 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:09 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:04:09.501 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:09 smithi181 ceph-mon[115276]: pgmap v19: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T14:04:09.501 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:09 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:04:09.501 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:09 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:04:09.501 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:09 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:04:09.501 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:09 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:04:09.501 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:09 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:04:09.501 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:09 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:04:09.501 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:09 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:04:09.502 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:09 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:04:09.502 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:09 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:04:09.502 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:09 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:04:09.502 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:09 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:04:09.502 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:09 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:04:09.502 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:09 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:04:09.502 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:09 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:04:09.502 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:09 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:04:09.502 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:09 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:04:09.502 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:09 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:04:09.502 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:09 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:04:09.502 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:09 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:04:09.502 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:09 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:04:09.502 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:09 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:04:10.330 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:10 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:04:10.330 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:10 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:04:10.330 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:10 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:04:10.330 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:10 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:04:10.330 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:10 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:04:10.330 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:10 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:04:10.330 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:10 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:04:10.330 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:10 smithi099 ceph-mon[29691]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:04:10.330 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:10 smithi099 ceph-mon[29691]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:04:10.330 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:10 smithi099 ceph-mon[29691]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:04:10.330 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:10 smithi099 ceph-mon[29691]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:04:10.330 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:10 smithi099 ceph-mon[29691]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:04:10.331 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:10 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:04:10.331 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:10 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:04:10.331 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:10 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "quorum_status"}]: dispatch 2024-03-30T14:04:10.331 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:10 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2024-03-30T14:04:10.331 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:10 smithi099 ceph-mon[29691]: Upgrade: It appears safe to stop mon.c 2024-03-30T14:04:10.331 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:10 smithi099 ceph-mon[29691]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:04:10.331 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:10 smithi099 ceph-mon[29691]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:04:10.331 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:10 smithi099 ceph-mon[29691]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:04:10.331 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:10 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:04:10.331 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:10 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:04:10.331 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:10 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:04:10.331 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:10 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:04:10.332 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:10 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:04:10.332 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:10 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:04:10.332 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:10 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:04:10.332 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:10 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:04:10.332 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:10 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:04:10.332 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:10 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:04:10.332 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:10 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:04:10.332 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:10 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:04:10.332 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:10 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:04:10.332 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:10 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:04:10.332 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:10 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "quorum_status"}]: dispatch 2024-03-30T14:04:10.332 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:10 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2024-03-30T14:04:10.332 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:10 smithi099 ceph-mon[137093]: Upgrade: It appears safe to stop mon.c 2024-03-30T14:04:10.332 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:10 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:04:10.332 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:10 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:04:10.333 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:10 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:04:10.499 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:10 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:04:10.499 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:10 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:04:10.499 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:10 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:04:10.499 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:10 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:04:10.499 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:10 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:04:10.499 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:10 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:04:10.499 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:10 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:04:10.499 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:10 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:04:10.499 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:10 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:04:10.499 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:10 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:04:10.499 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:10 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:04:10.500 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:10 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:04:10.500 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:10 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:04:10.500 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:10 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:04:10.500 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:10 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "quorum_status"}]: dispatch 2024-03-30T14:04:10.500 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:10 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2024-03-30T14:04:10.500 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:10 smithi181 ceph-mon[115276]: Upgrade: It appears safe to stop mon.c 2024-03-30T14:04:10.500 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:10 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:04:10.500 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:10 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:04:10.500 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:10 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:04:11.329 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:11 smithi099 ceph-mon[137093]: pgmap v20: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T14:04:11.330 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:11 smithi099 ceph-mon[29691]: pgmap v20: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T14:04:11.498 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:11 smithi181 ceph-mon[115276]: pgmap v20: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T14:04:12.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:12 smithi181 ceph-mon[115276]: Upgrade: Updating mon.c 2024-03-30T14:04:12.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:12 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:04:12.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:12 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-03-30T14:04:12.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:12 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-03-30T14:04:12.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:12 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:04:12.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:12 smithi181 ceph-mon[115276]: Deploying daemon mon.c on smithi099 2024-03-30T14:04:13.079 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:12 smithi099 ceph-mon[137093]: Upgrade: Updating mon.c 2024-03-30T14:04:13.080 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:12 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:04:13.080 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:12 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-03-30T14:04:13.080 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:12 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-03-30T14:04:13.080 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:12 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:04:13.080 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:12 smithi099 ceph-mon[137093]: Deploying daemon mon.c on smithi099 2024-03-30T14:04:13.080 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:12 smithi099 ceph-mon[29691]: Upgrade: Updating mon.c 2024-03-30T14:04:13.080 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:12 smithi099 ceph-mon[29691]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:04:13.080 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:12 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-03-30T14:04:13.080 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:12 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-03-30T14:04:13.080 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:12 smithi099 ceph-mon[29691]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:04:13.080 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:12 smithi099 ceph-mon[29691]: Deploying daemon mon.c on smithi099 2024-03-30T14:04:13.829 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:13 smithi099 ceph-mon[137093]: pgmap v21: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T14:04:13.829 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:13 smithi099 ceph-mon[29691]: pgmap v21: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T14:04:13.998 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:13 smithi181 ceph-mon[115276]: pgmap v21: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T14:04:15.080 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:14 smithi099 ceph-mon[137093]: pgmap v22: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T14:04:15.080 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:14 smithi099 ceph-mon[29691]: pgmap v22: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T14:04:15.080 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 14:04:14 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[71049]: ::ffff:172.21.15.181 - - [30/Mar/2024:14:04:14] "GET /metrics HTTP/1.1" 200 37944 "" "Prometheus/2.43.0" 2024-03-30T14:04:15.248 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:14 smithi181 ceph-mon[115276]: pgmap v22: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T14:04:15.674 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:15 smithi099 systemd[1]: Stopping Ceph mon.c for 98ebaeb8-ee99-11ee-b647-cb9ed24678a4... 2024-03-30T14:04:16.079 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:15 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mon-c[29687]: 2024-03-30T14:04:15.679+0000 7f973facf700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.c -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-03-30T14:04:16.079 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:15 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mon-c[29687]: 2024-03-30T14:04:15.679+0000 7f973facf700 -1 mon.c@1(peon) e3 *** Got Signal Terminated *** 2024-03-30T14:04:16.079 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:15 smithi099 podman[143226]: 2024-03-30 14:04:15.915101499 +0000 UTC m=+0.349276325 container died 0f1e989177183faf5f42c21b944f909c3536dc17a980b457fe8169be9f7f6a98 (image=quay.io/ceph/ceph@sha256:12a0a4f43413fd97a14a3d47a3451b2d2df50020835bb93db666209f3f77617a, name=ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mon-c, com.redhat.component=centos-stream-container, description=CentOS Stream is a continuously delivered distro that tracks just ahead of Red Hat Enterprise Linux development. This image takes the Red Hat UBI and layers on content from CentOS Stream, url=https://access.redhat.com/containers/#/registry.access.redhat.com/ubi8/images/8.6-754, GIT_COMMIT=b613db0f44179c0940781c1c7fe04e1acb7093ac, com.redhat.license_terms=https://centos.org/legal/licensing-policy/, maintainer=Guillaume Abrioux , summary=Provides a CentOS Stream container based on the Red Hat Universal Base Image, GIT_CLEAN=True, io.k8s.display-name=CentOS Stream 8, io.openshift.expose-services=, io.openshift.tags=base centos centos-stream, CEPH_POINT_RELEASE=-17.2.0, name=centos-stream, build-date=2022-05-03T08:36:31.336870, vcs-type=git, version=8, GIT_REPO=https://github.com/ceph/ceph-container.git, distribution-scope=public, vcs-ref=f1ee6e37554363ec55e0035aba1a693d3627fdeb, vendor=Red Hat, Inc., io.buildah.version=1.19.8, RELEASE=HEAD, ceph=True, io.k8s.description=The Universal Base Image is designed and engineered to be the base layer for all of your containerized applications, middleware and utilities. This base image is freely redistributable, but Red Hat only supports Red Hat technologies through subscriptions for Red Hat products. This image is maintained by Red Hat and updated regularly., com.redhat.build-host=cpt-1002.osbs.prod.upshift.rdu2.redhat.com, GIT_BRANCH=HEAD, release=754, architecture=x86_64) 2024-03-30T14:04:16.080 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 14:04:15 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[71049]: [30/Mar/2024:14:04:15] ENGINE Bus STOPPING 2024-03-30T14:04:16.080 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 14:04:15 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[71049]: [30/Mar/2024:14:04:15] ENGINE HTTP Server cherrypy._cpwsgi_server.CPWSGIServer(('::', 9283)) shut down 2024-03-30T14:04:16.080 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 14:04:15 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[71049]: [30/Mar/2024:14:04:15] ENGINE Bus STOPPED 2024-03-30T14:04:16.080 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 14:04:15 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[71049]: [30/Mar/2024:14:04:15] ENGINE Bus STARTING 2024-03-30T14:04:16.080 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 14:04:15 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[71049]: [30/Mar/2024:14:04:15] ENGINE Serving on http://:::9283 2024-03-30T14:04:16.080 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 14:04:15 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[71049]: [30/Mar/2024:14:04:15] ENGINE Bus STARTED 2024-03-30T14:04:16.557 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:16 smithi099 podman[143226]: 2024-03-30 14:04:16.26200951 +0000 UTC m=+0.696184326 container cleanup 0f1e989177183faf5f42c21b944f909c3536dc17a980b457fe8169be9f7f6a98 (image=quay.io/ceph/ceph@sha256:12a0a4f43413fd97a14a3d47a3451b2d2df50020835bb93db666209f3f77617a, name=ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mon-c, RELEASE=HEAD, GIT_CLEAN=True, com.redhat.component=centos-stream-container, io.k8s.description=The Universal Base Image is designed and engineered to be the base layer for all of your containerized applications, middleware and utilities. This base image is freely redistributable, but Red Hat only supports Red Hat technologies through subscriptions for Red Hat products. This image is maintained by Red Hat and updated regularly., summary=Provides a CentOS Stream container based on the Red Hat Universal Base Image, io.buildah.version=1.19.8, io.k8s.display-name=CentOS Stream 8, GIT_COMMIT=b613db0f44179c0940781c1c7fe04e1acb7093ac, vcs-type=git, maintainer=Guillaume Abrioux , distribution-scope=public, url=https://access.redhat.com/containers/#/registry.access.redhat.com/ubi8/images/8.6-754, ceph=True, name=centos-stream, com.redhat.license_terms=https://centos.org/legal/licensing-policy/, description=CentOS Stream is a continuously delivered distro that tracks just ahead of Red Hat Enterprise Linux development. This image takes the Red Hat UBI and layers on content from CentOS Stream, release=754, CEPH_POINT_RELEASE=-17.2.0, vcs-ref=f1ee6e37554363ec55e0035aba1a693d3627fdeb, version=8, vendor=Red Hat, Inc., com.redhat.build-host=cpt-1002.osbs.prod.upshift.rdu2.redhat.com, GIT_REPO=https://github.com/ceph/ceph-container.git, GIT_BRANCH=HEAD, io.openshift.expose-services=, io.openshift.tags=base centos centos-stream, architecture=x86_64, build-date=2022-05-03T08:36:31.336870) 2024-03-30T14:04:16.557 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:16 smithi099 bash[143226]: ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mon-c 2024-03-30T14:04:16.814 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:16 smithi099 podman[143251]: 2024-03-30 14:04:16.564291079 +0000 UTC m=+0.649266565 container remove 0f1e989177183faf5f42c21b944f909c3536dc17a980b457fe8169be9f7f6a98 (image=quay.io/ceph/ceph@sha256:12a0a4f43413fd97a14a3d47a3451b2d2df50020835bb93db666209f3f77617a, name=ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mon-c, com.redhat.component=centos-stream-container, distribution-scope=public, maintainer=Guillaume Abrioux , io.openshift.expose-services=, ceph=True, description=CentOS Stream is a continuously delivered distro that tracks just ahead of Red Hat Enterprise Linux development. This image takes the Red Hat UBI and layers on content from CentOS Stream, vcs-type=git, GIT_CLEAN=True, architecture=x86_64, release=754, RELEASE=HEAD, version=8, url=https://access.redhat.com/containers/#/registry.access.redhat.com/ubi8/images/8.6-754, name=centos-stream, io.buildah.version=1.19.8, summary=Provides a CentOS Stream container based on the Red Hat Universal Base Image, vcs-ref=f1ee6e37554363ec55e0035aba1a693d3627fdeb, GIT_COMMIT=b613db0f44179c0940781c1c7fe04e1acb7093ac, CEPH_POINT_RELEASE=-17.2.0, io.k8s.description=The Universal Base Image is designed and engineered to be the base layer for all of your containerized applications, middleware and utilities. This base image is freely redistributable, but Red Hat only supports Red Hat technologies through subscriptions for Red Hat products. This image is maintained by Red Hat and updated regularly., io.openshift.tags=base centos centos-stream, GIT_REPO=https://github.com/ceph/ceph-container.git, com.redhat.build-host=cpt-1002.osbs.prod.upshift.rdu2.redhat.com, build-date=2022-05-03T08:36:31.336870, io.k8s.display-name=CentOS Stream 8, com.redhat.license_terms=https://centos.org/legal/licensing-policy/, vendor=Red Hat, Inc., GIT_BRANCH=HEAD) 2024-03-30T14:04:16.815 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:16 smithi099 systemd[1]: ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4@mon.c.service: Deactivated successfully. 2024-03-30T14:04:16.815 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:16 smithi099 systemd[1]: Stopped Ceph mon.c for 98ebaeb8-ee99-11ee-b647-cb9ed24678a4. 2024-03-30T14:04:16.815 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:16 smithi099 systemd[1]: ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4@mon.c.service: Consumed 28.801s CPU time. 2024-03-30T14:04:17.079 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:16 smithi099 systemd[1]: Starting Ceph mon.c for 98ebaeb8-ee99-11ee-b647-cb9ed24678a4... 2024-03-30T14:04:17.392 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:17 smithi099 podman[143382]: 2024-03-30 14:04:17.042635603 +0000 UTC m=+0.017971751 image pull b0c4478f1d83795df4d538bf108aee5fac57194348fb16dcdbb3115f3e2fe95e quay.ceph.io/ceph-ci/ceph:4e50bbcdd1630c7760b708f3a5b4d38a121e66cb 2024-03-30T14:04:17.392 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:17 smithi099 podman[143382]: 2024-03-30 14:04:17.160675048 +0000 UTC m=+0.136011181 container create 731056a2fea67aba1b837e3115a42a524b21192422c27317f49443181f265527 (image=quay.ceph.io/ceph-ci/ceph:4e50bbcdd1630c7760b708f3a5b4d38a121e66cb, name=ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mon-c, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, RELEASE=squid-4e50bbc, org.label-schema.build-date=20240326, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, ceph=True, org.label-schema.schema-version=1.0, GIT_CLEAN=True, maintainer=Guillaume Abrioux ) 2024-03-30T14:04:17.392 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:17 smithi099 podman[143382]: 2024-03-30 14:04:17.372242224 +0000 UTC m=+0.347578359 container init 731056a2fea67aba1b837e3115a42a524b21192422c27317f49443181f265527 (image=quay.ceph.io/ceph-ci/ceph:4e50bbcdd1630c7760b708f3a5b4d38a121e66cb, name=ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mon-c, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, GIT_CLEAN=True, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, org.label-schema.build-date=20240326, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, maintainer=Guillaume Abrioux , RELEASE=squid-4e50bbc) 2024-03-30T14:04:17.392 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:17 smithi099 podman[143382]: 2024-03-30 14:04:17.376043066 +0000 UTC m=+0.351379200 container start 731056a2fea67aba1b837e3115a42a524b21192422c27317f49443181f265527 (image=quay.ceph.io/ceph-ci/ceph:4e50bbcdd1630c7760b708f3a5b4d38a121e66cb, name=ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mon-c, org.label-schema.build-date=20240326, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, RELEASE=squid-4e50bbc, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_BRANCH=HEAD, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image) 2024-03-30T14:04:17.720 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:17 smithi099 ceph-mon[143401]: set uid:gid to 167:167 (ceph:ceph) 2024-03-30T14:04:17.720 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:17 smithi099 ceph-mon[143401]: ceph version 19.0.0-1967-g4e50bbcd (4e50bbcdd1630c7760b708f3a5b4d38a121e66cb) squid (dev), process ceph-mon, pid 2 2024-03-30T14:04:17.720 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:17 smithi099 ceph-mon[143401]: pidfile_write: ignore empty --pid-file 2024-03-30T14:04:17.720 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:17 smithi099 ceph-mon[143401]: load: jerasure load: lrc 2024-03-30T14:04:17.720 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:17 smithi099 ceph-mon[143401]: rocksdb: RocksDB version: 7.9.2 2024-03-30T14:04:17.720 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:17 smithi099 ceph-mon[143401]: rocksdb: Git sha 0 2024-03-30T14:04:17.721 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:17 smithi099 ceph-mon[143401]: rocksdb: Compile date 2024-03-29 15:06:16 2024-03-30T14:04:17.721 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:17 smithi099 ceph-mon[143401]: rocksdb: DB SUMMARY 2024-03-30T14:04:17.721 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:17 smithi099 ceph-mon[143401]: rocksdb: DB Session ID: OCVHBQDG9RT0EVOTOXM2 2024-03-30T14:04:17.721 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:17 smithi099 ceph-mon[143401]: rocksdb: CURRENT file: CURRENT 2024-03-30T14:04:17.721 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:17 smithi099 ceph-mon[143401]: rocksdb: IDENTITY file: IDENTITY 2024-03-30T14:04:17.721 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:17 smithi099 ceph-mon[143401]: rocksdb: MANIFEST file: MANIFEST-000009 size: 6153 Bytes 2024-03-30T14:04:17.721 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:17 smithi099 ceph-mon[143401]: rocksdb: SST files in /var/lib/ceph/mon/ceph-c/store.db dir, Total Num: 1, files: 000105.sst 2024-03-30T14:04:17.721 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:17 smithi099 ceph-mon[143401]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-c/store.db: 000103.log size: 989783 ; 2024-03-30T14:04:17.721 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:17 smithi099 ceph-mon[143401]: rocksdb: Options.error_if_exists: 0 2024-03-30T14:04:17.721 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:17 smithi099 ceph-mon[143401]: rocksdb: Options.create_if_missing: 0 2024-03-30T14:04:17.721 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:17 smithi099 ceph-mon[143401]: rocksdb: Options.paranoid_checks: 1 2024-03-30T14:04:17.721 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:17 smithi099 ceph-mon[143401]: rocksdb: Options.flush_verify_memtable_count: 1 2024-03-30T14:04:17.721 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:17 smithi099 ceph-mon[143401]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-03-30T14:04:17.721 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:17 smithi099 ceph-mon[143401]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-03-30T14:04:17.721 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:17 smithi099 ceph-mon[143401]: rocksdb: Options.env: 0x558df4544c60 2024-03-30T14:04:17.722 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:17 smithi099 ceph-mon[143401]: rocksdb: Options.fs: PosixFileSystem 2024-03-30T14:04:17.722 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:17 smithi099 ceph-mon[143401]: rocksdb: Options.info_log: 0x558df5bb9ae0 2024-03-30T14:04:17.722 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:17 smithi099 ceph-mon[143401]: rocksdb: Options.max_file_opening_threads: 16 2024-03-30T14:04:17.722 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:17 smithi099 ceph-mon[143401]: rocksdb: Options.statistics: (nil) 2024-03-30T14:04:17.722 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:17 smithi099 ceph-mon[143401]: rocksdb: Options.use_fsync: 0 2024-03-30T14:04:17.722 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:17 smithi099 ceph-mon[143401]: rocksdb: Options.max_log_file_size: 0 2024-03-30T14:04:17.722 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:17 smithi099 ceph-mon[143401]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-03-30T14:04:17.722 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:17 smithi099 ceph-mon[143401]: rocksdb: Options.log_file_time_to_roll: 0 2024-03-30T14:04:17.722 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:17 smithi099 ceph-mon[143401]: rocksdb: Options.keep_log_file_num: 1000 2024-03-30T14:04:17.722 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:17 smithi099 ceph-mon[143401]: rocksdb: Options.recycle_log_file_num: 0 2024-03-30T14:04:17.722 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:17 smithi099 ceph-mon[143401]: rocksdb: Options.allow_fallocate: 1 2024-03-30T14:04:17.722 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:17 smithi099 ceph-mon[143401]: rocksdb: Options.allow_mmap_reads: 0 2024-03-30T14:04:17.722 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:17 smithi099 ceph-mon[143401]: rocksdb: Options.allow_mmap_writes: 0 2024-03-30T14:04:17.722 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:17 smithi099 ceph-mon[143401]: rocksdb: Options.use_direct_reads: 0 2024-03-30T14:04:17.723 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:17 smithi099 ceph-mon[143401]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-03-30T14:04:17.723 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:17 smithi099 ceph-mon[143401]: rocksdb: Options.create_missing_column_families: 0 2024-03-30T14:04:17.723 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:17 smithi099 ceph-mon[143401]: rocksdb: Options.db_log_dir: 2024-03-30T14:04:17.723 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:17 smithi099 ceph-mon[143401]: rocksdb: Options.wal_dir: 2024-03-30T14:04:17.724 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:17 smithi099 ceph-mon[143401]: rocksdb: Options.table_cache_numshardbits: 6 2024-03-30T14:04:17.724 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:17 smithi099 ceph-mon[143401]: rocksdb: Options.WAL_ttl_seconds: 0 2024-03-30T14:04:17.724 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:17 smithi099 ceph-mon[143401]: rocksdb: Options.WAL_size_limit_MB: 0 2024-03-30T14:04:17.724 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:17 smithi099 ceph-mon[143401]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-03-30T14:04:17.724 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:17 smithi099 ceph-mon[143401]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-03-30T14:04:17.724 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:17 smithi099 ceph-mon[143401]: rocksdb: Options.is_fd_close_on_exec: 1 2024-03-30T14:04:17.724 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:17 smithi099 ceph-mon[143401]: rocksdb: Options.advise_random_on_open: 1 2024-03-30T14:04:17.724 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:17 smithi099 ceph-mon[143401]: rocksdb: Options.db_write_buffer_size: 0 2024-03-30T14:04:17.724 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:17 smithi099 ceph-mon[143401]: rocksdb: Options.write_buffer_manager: 0x558df5b8c820 2024-03-30T14:04:17.724 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:17 smithi099 ceph-mon[143401]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-03-30T14:04:17.725 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:17 smithi099 ceph-mon[143401]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-03-30T14:04:17.725 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:17 smithi099 ceph-mon[143401]: rocksdb: Options.use_adaptive_mutex: 0 2024-03-30T14:04:17.725 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:17 smithi099 ceph-mon[143401]: rocksdb: Options.rate_limiter: (nil) 2024-03-30T14:04:17.725 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:17 smithi099 ceph-mon[143401]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-03-30T14:04:17.725 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:17 smithi099 ceph-mon[143401]: rocksdb: Options.wal_recovery_mode: 2 2024-03-30T14:04:17.725 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:17 smithi099 ceph-mon[143401]: rocksdb: Options.enable_thread_tracking: 0 2024-03-30T14:04:17.725 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:17 smithi099 ceph-mon[143401]: rocksdb: Options.enable_pipelined_write: 0 2024-03-30T14:04:17.725 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:17 smithi099 ceph-mon[143401]: rocksdb: Options.unordered_write: 0 2024-03-30T14:04:17.725 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:17 smithi099 ceph-mon[143401]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-03-30T14:04:17.725 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:17 smithi099 ceph-mon[143401]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-03-30T14:04:17.725 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:17 smithi099 ceph-mon[143401]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-03-30T14:04:17.725 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:17 smithi099 ceph-mon[143401]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-03-30T14:04:17.725 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:17 smithi099 ceph-mon[143401]: rocksdb: Options.row_cache: None 2024-03-30T14:04:17.725 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:17 smithi099 ceph-mon[143401]: rocksdb: Options.wal_filter: None 2024-03-30T14:04:17.725 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:17 smithi099 ceph-mon[143401]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-03-30T14:04:17.725 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:17 smithi099 ceph-mon[143401]: rocksdb: Options.allow_ingest_behind: 0 2024-03-30T14:04:17.726 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:17 smithi099 ceph-mon[143401]: rocksdb: Options.two_write_queues: 0 2024-03-30T14:04:17.726 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:17 smithi099 ceph-mon[143401]: rocksdb: Options.manual_wal_flush: 0 2024-03-30T14:04:17.726 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:17 smithi099 ceph-mon[143401]: rocksdb: Options.wal_compression: 0 2024-03-30T14:04:17.726 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:17 smithi099 ceph-mon[143401]: rocksdb: Options.atomic_flush: 0 2024-03-30T14:04:17.726 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:17 smithi099 ceph-mon[143401]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-03-30T14:04:17.726 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:17 smithi099 ceph-mon[143401]: rocksdb: Options.persist_stats_to_disk: 0 2024-03-30T14:04:17.726 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:17 smithi099 ceph-mon[143401]: rocksdb: Options.write_dbid_to_manifest: 0 2024-03-30T14:04:17.726 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:17 smithi099 ceph-mon[143401]: rocksdb: Options.log_readahead_size: 0 2024-03-30T14:04:17.726 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:17 smithi099 ceph-mon[143401]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-03-30T14:04:17.726 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:17 smithi099 ceph-mon[143401]: rocksdb: Options.best_efforts_recovery: 0 2024-03-30T14:04:17.726 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:17 smithi099 ceph-mon[143401]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-03-30T14:04:17.726 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:17 smithi099 ceph-mon[143401]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-03-30T14:04:17.726 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:17 smithi099 ceph-mon[143401]: rocksdb: Options.allow_data_in_errors: 0 2024-03-30T14:04:17.726 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:17 smithi099 ceph-mon[143401]: rocksdb: Options.db_host_id: __hostname__ 2024-03-30T14:04:17.726 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:17 smithi099 ceph-mon[143401]: rocksdb: Options.enforce_single_del_contracts: true 2024-03-30T14:04:17.727 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:17 smithi099 ceph-mon[143401]: rocksdb: Options.max_background_jobs: 2 2024-03-30T14:04:17.727 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:17 smithi099 ceph-mon[143401]: rocksdb: Options.max_background_compactions: -1 2024-03-30T14:04:17.727 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:17 smithi099 ceph-mon[143401]: rocksdb: Options.max_subcompactions: 1 2024-03-30T14:04:17.727 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:17 smithi099 ceph-mon[143401]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-03-30T14:04:17.727 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:17 smithi099 ceph-mon[143401]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-03-30T14:04:17.727 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:17 smithi099 ceph-mon[143401]: rocksdb: Options.delayed_write_rate : 16777216 2024-03-30T14:04:17.727 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:17 smithi099 ceph-mon[143401]: rocksdb: Options.max_total_wal_size: 0 2024-03-30T14:04:17.727 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:17 smithi099 ceph-mon[143401]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-03-30T14:04:17.727 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:17 smithi099 ceph-mon[143401]: rocksdb: Options.stats_dump_period_sec: 600 2024-03-30T14:04:17.727 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:17 smithi099 ceph-mon[143401]: rocksdb: Options.stats_persist_period_sec: 600 2024-03-30T14:04:17.727 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:17 smithi099 ceph-mon[143401]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-03-30T14:04:17.727 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:17 smithi099 ceph-mon[143401]: rocksdb: Options.max_open_files: -1 2024-03-30T14:04:17.727 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:17 smithi099 ceph-mon[143401]: rocksdb: Options.bytes_per_sync: 0 2024-03-30T14:04:17.727 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:17 smithi099 ceph-mon[143401]: rocksdb: Options.wal_bytes_per_sync: 0 2024-03-30T14:04:17.727 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:17 smithi099 ceph-mon[143401]: rocksdb: Options.strict_bytes_per_sync: 0 2024-03-30T14:04:17.727 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:17 smithi099 ceph-mon[143401]: rocksdb: Options.compaction_readahead_size: 0 2024-03-30T14:04:17.728 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:17 smithi099 ceph-mon[143401]: rocksdb: Options.max_background_flushes: -1 2024-03-30T14:04:17.728 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:17 smithi099 ceph-mon[143401]: rocksdb: Compression algorithms supported: 2024-03-30T14:04:17.728 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:17 smithi099 ceph-mon[143401]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-03-30T14:04:17.728 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:17 smithi099 ceph-mon[143401]: rocksdb: kZSTD supported: 0 2024-03-30T14:04:17.728 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:17 smithi099 ceph-mon[143401]: rocksdb: kXpressCompression supported: 0 2024-03-30T14:04:17.728 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:17 smithi099 ceph-mon[143401]: rocksdb: kLZ4HCCompression supported: 1 2024-03-30T14:04:17.728 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:17 smithi099 ceph-mon[143401]: rocksdb: kZlibCompression supported: 1 2024-03-30T14:04:17.728 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:17 smithi099 ceph-mon[143401]: rocksdb: kSnappyCompression supported: 1 2024-03-30T14:04:17.728 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:17 smithi099 ceph-mon[143401]: rocksdb: kLZ4Compression supported: 1 2024-03-30T14:04:17.728 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:17 smithi099 ceph-mon[143401]: rocksdb: kBZip2Compression supported: 0 2024-03-30T14:04:17.728 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:17 smithi099 ceph-mon[143401]: rocksdb: Fast CRC32 supported: Supported on x86 2024-03-30T14:04:17.728 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:17 smithi099 ceph-mon[143401]: rocksdb: DMutex implementation: pthread_mutex_t 2024-03-30T14:04:17.728 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:17 smithi099 ceph-mon[143401]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-c/store.db/MANIFEST-000009 2024-03-30T14:04:17.728 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:17 smithi099 ceph-mon[143401]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-03-30T14:04:17.728 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:17 smithi099 ceph-mon[143401]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-03-30T14:04:17.728 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:17 smithi099 ceph-mon[143401]: rocksdb: Options.merge_operator: 2024-03-30T14:04:17.728 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:17 smithi099 ceph-mon[143401]: rocksdb: Options.compaction_filter: None 2024-03-30T14:04:17.729 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:17 smithi099 ceph-mon[143401]: rocksdb: Options.compaction_filter_factory: None 2024-03-30T14:04:17.729 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:17 smithi099 ceph-mon[143401]: rocksdb: Options.sst_partitioner_factory: None 2024-03-30T14:04:17.729 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:17 smithi099 ceph-mon[143401]: rocksdb: Options.memtable_factory: SkipListFactory 2024-03-30T14:04:17.729 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:17 smithi099 ceph-mon[143401]: rocksdb: Options.table_factory: BlockBasedTable 2024-03-30T14:04:17.729 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:17 smithi099 ceph-mon[143401]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x558df5bb9be0) 2024-03-30T14:04:17.729 INFO:journalctl@ceph.mon.c.smithi099.stdout: cache_index_and_filter_blocks: 1 2024-03-30T14:04:17.729 INFO:journalctl@ceph.mon.c.smithi099.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-03-30T14:04:17.729 INFO:journalctl@ceph.mon.c.smithi099.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-03-30T14:04:17.729 INFO:journalctl@ceph.mon.c.smithi099.stdout: pin_top_level_index_and_filter: 1 2024-03-30T14:04:17.729 INFO:journalctl@ceph.mon.c.smithi099.stdout: index_type: 0 2024-03-30T14:04:17.729 INFO:journalctl@ceph.mon.c.smithi099.stdout: data_block_index_type: 0 2024-03-30T14:04:17.729 INFO:journalctl@ceph.mon.c.smithi099.stdout: index_shortening: 1 2024-03-30T14:04:17.729 INFO:journalctl@ceph.mon.c.smithi099.stdout: data_block_hash_table_util_ratio: 0.750000 2024-03-30T14:04:17.729 INFO:journalctl@ceph.mon.c.smithi099.stdout: checksum: 4 2024-03-30T14:04:17.729 INFO:journalctl@ceph.mon.c.smithi099.stdout: no_block_cache: 0 2024-03-30T14:04:17.729 INFO:journalctl@ceph.mon.c.smithi099.stdout: block_cache: 0x558df5bbd090 2024-03-30T14:04:17.730 INFO:journalctl@ceph.mon.c.smithi099.stdout: block_cache_name: BinnedLRUCache 2024-03-30T14:04:17.730 INFO:journalctl@ceph.mon.c.smithi099.stdout: block_cache_options: 2024-03-30T14:04:17.730 INFO:journalctl@ceph.mon.c.smithi099.stdout: capacity : 536870912 2024-03-30T14:04:17.730 INFO:journalctl@ceph.mon.c.smithi099.stdout: num_shard_bits : 4 2024-03-30T14:04:17.730 INFO:journalctl@ceph.mon.c.smithi099.stdout: strict_capacity_limit : 0 2024-03-30T14:04:17.730 INFO:journalctl@ceph.mon.c.smithi099.stdout: high_pri_pool_ratio: 0.000 2024-03-30T14:04:17.730 INFO:journalctl@ceph.mon.c.smithi099.stdout: block_cache_compressed: (nil) 2024-03-30T14:04:17.730 INFO:journalctl@ceph.mon.c.smithi099.stdout: persistent_cache: (nil) 2024-03-30T14:04:17.730 INFO:journalctl@ceph.mon.c.smithi099.stdout: block_size: 4096 2024-03-30T14:04:17.730 INFO:journalctl@ceph.mon.c.smithi099.stdout: block_size_deviation: 10 2024-03-30T14:04:17.730 INFO:journalctl@ceph.mon.c.smithi099.stdout: block_restart_interval: 16 2024-03-30T14:04:17.730 INFO:journalctl@ceph.mon.c.smithi099.stdout: index_block_restart_interval: 1 2024-03-30T14:04:17.730 INFO:journalctl@ceph.mon.c.smithi099.stdout: metadata_block_size: 4096 2024-03-30T14:04:17.730 INFO:journalctl@ceph.mon.c.smithi099.stdout: partition_filters: 0 2024-03-30T14:04:17.731 INFO:journalctl@ceph.mon.c.smithi099.stdout: use_delta_encoding: 1 2024-03-30T14:04:17.731 INFO:journalctl@ceph.mon.c.smithi099.stdout: filter_policy: bloomfilter 2024-03-30T14:04:17.731 INFO:journalctl@ceph.mon.c.smithi099.stdout: whole_key_filtering: 1 2024-03-30T14:04:17.731 INFO:journalctl@ceph.mon.c.smithi099.stdout: verify_compression: 0 2024-03-30T14:04:17.731 INFO:journalctl@ceph.mon.c.smithi099.stdout: read_amp_bytes_per_bit: 0 2024-03-30T14:04:17.731 INFO:journalctl@ceph.mon.c.smithi099.stdout: format_version: 5 2024-03-30T14:04:17.731 INFO:journalctl@ceph.mon.c.smithi099.stdout: enable_index_compression: 1 2024-03-30T14:04:17.731 INFO:journalctl@ceph.mon.c.smithi099.stdout: block_align: 0 2024-03-30T14:04:17.731 INFO:journalctl@ceph.mon.c.smithi099.stdout: max_auto_readahead_size: 262144 2024-03-30T14:04:17.731 INFO:journalctl@ceph.mon.c.smithi099.stdout: prepopulate_block_cache: 0 2024-03-30T14:04:17.731 INFO:journalctl@ceph.mon.c.smithi099.stdout: initial_auto_readahead_size: 8192 2024-03-30T14:04:17.731 INFO:journalctl@ceph.mon.c.smithi099.stdout: num_file_reads_for_auto_readahead: 2 2024-03-30T14:04:17.731 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:17 smithi099 ceph-mon[143401]: rocksdb: Options.write_buffer_size: 33554432 2024-03-30T14:04:17.731 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:17 smithi099 ceph-mon[143401]: rocksdb: Options.max_write_buffer_number: 2 2024-03-30T14:04:17.731 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:17 smithi099 ceph-mon[143401]: rocksdb: Options.compression: NoCompression 2024-03-30T14:04:17.731 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:17 smithi099 ceph-mon[143401]: rocksdb: Options.bottommost_compression: Disabled 2024-03-30T14:04:17.732 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:17 smithi099 ceph-mon[143401]: rocksdb: Options.prefix_extractor: nullptr 2024-03-30T14:04:17.732 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:17 smithi099 ceph-mon[143401]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-03-30T14:04:17.732 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:17 smithi099 ceph-mon[143401]: rocksdb: Options.num_levels: 7 2024-03-30T14:04:17.732 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:17 smithi099 ceph-mon[143401]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-03-30T14:04:17.732 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:17 smithi099 ceph-mon[143401]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-03-30T14:04:17.732 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:17 smithi099 ceph-mon[143401]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-03-30T14:04:17.732 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:17 smithi099 ceph-mon[143401]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-03-30T14:04:17.732 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:17 smithi099 ceph-mon[143401]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-03-30T14:04:17.732 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:17 smithi099 ceph-mon[143401]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-03-30T14:04:17.732 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:17 smithi099 ceph-mon[143401]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-03-30T14:04:17.732 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:17 smithi099 ceph-mon[143401]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-03-30T14:04:17.732 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:17 smithi099 ceph-mon[143401]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-03-30T14:04:17.732 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:17 smithi099 ceph-mon[143401]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-03-30T14:04:17.732 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:17 smithi099 ceph-mon[143401]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-03-30T14:04:17.732 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:17 smithi099 ceph-mon[143401]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-03-30T14:04:17.732 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:17 smithi099 ceph-mon[143401]: rocksdb: Options.compression_opts.window_bits: -14 2024-03-30T14:04:17.733 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:17 smithi099 ceph-mon[143401]: rocksdb: Options.compression_opts.level: 32767 2024-03-30T14:04:17.733 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:17 smithi099 ceph-mon[143401]: rocksdb: Options.compression_opts.strategy: 0 2024-03-30T14:04:17.733 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:17 smithi099 ceph-mon[143401]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-03-30T14:04:17.733 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:17 smithi099 ceph-mon[143401]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-03-30T14:04:17.733 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:17 smithi099 ceph-mon[143401]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-03-30T14:04:17.733 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:17 smithi099 ceph-mon[143401]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-03-30T14:04:17.733 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:17 smithi099 ceph-mon[143401]: rocksdb: Options.compression_opts.enabled: false 2024-03-30T14:04:17.733 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:17 smithi099 ceph-mon[143401]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-03-30T14:04:17.733 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:17 smithi099 ceph-mon[143401]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-03-30T14:04:17.733 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:17 smithi099 ceph-mon[143401]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-03-30T14:04:17.733 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:17 smithi099 ceph-mon[143401]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-03-30T14:04:17.733 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:17 smithi099 ceph-mon[143401]: rocksdb: Options.target_file_size_base: 67108864 2024-03-30T14:04:17.733 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:17 smithi099 ceph-mon[143401]: rocksdb: Options.target_file_size_multiplier: 1 2024-03-30T14:04:17.733 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:17 smithi099 ceph-mon[143401]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-03-30T14:04:17.733 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:17 smithi099 ceph-mon[143401]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-03-30T14:04:17.733 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:17 smithi099 ceph-mon[143401]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-03-30T14:04:17.733 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:17 smithi099 ceph-mon[143401]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-03-30T14:04:17.734 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:17 smithi099 ceph-mon[143401]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-03-30T14:04:17.734 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:17 smithi099 ceph-mon[143401]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-03-30T14:04:17.734 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:17 smithi099 ceph-mon[143401]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-03-30T14:04:17.734 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:17 smithi099 ceph-mon[143401]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-03-30T14:04:17.734 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:17 smithi099 ceph-mon[143401]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-03-30T14:04:17.734 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:17 smithi099 ceph-mon[143401]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-03-30T14:04:17.734 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:17 smithi099 ceph-mon[143401]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-03-30T14:04:17.734 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:17 smithi099 ceph-mon[143401]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-03-30T14:04:17.734 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:17 smithi099 ceph-mon[143401]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-03-30T14:04:17.734 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:17 smithi099 ceph-mon[143401]: rocksdb: Options.arena_block_size: 1048576 2024-03-30T14:04:17.734 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:17 smithi099 ceph-mon[143401]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-03-30T14:04:17.734 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:17 smithi099 ceph-mon[143401]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-03-30T14:04:17.734 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:17 smithi099 ceph-mon[143401]: rocksdb: Options.disable_auto_compactions: 0 2024-03-30T14:04:17.734 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:17 smithi099 ceph-mon[143401]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-03-30T14:04:17.734 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:17 smithi099 ceph-mon[143401]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-03-30T14:04:17.735 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:17 smithi099 ceph-mon[143401]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-03-30T14:04:17.735 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:17 smithi099 ceph-mon[143401]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-03-30T14:04:17.735 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:17 smithi099 ceph-mon[143401]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-03-30T14:04:17.735 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:17 smithi099 ceph-mon[143401]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-03-30T14:04:17.735 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:17 smithi099 ceph-mon[143401]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-03-30T14:04:17.735 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:17 smithi099 ceph-mon[143401]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-03-30T14:04:17.735 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:17 smithi099 ceph-mon[143401]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-03-30T14:04:17.735 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:17 smithi099 ceph-mon[143401]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-03-30T14:04:17.735 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:17 smithi099 ceph-mon[143401]: rocksdb: Options.table_properties_collectors: 2024-03-30T14:04:17.735 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:17 smithi099 ceph-mon[143401]: rocksdb: Options.inplace_update_support: 0 2024-03-30T14:04:17.735 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:17 smithi099 ceph-mon[143401]: rocksdb: Options.inplace_update_num_locks: 10000 2024-03-30T14:04:17.735 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:17 smithi099 ceph-mon[143401]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-03-30T14:04:17.735 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:17 smithi099 ceph-mon[143401]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-03-30T14:04:17.735 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:17 smithi099 ceph-mon[143401]: rocksdb: Options.memtable_huge_page_size: 0 2024-03-30T14:04:17.736 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:17 smithi099 ceph-mon[143401]: rocksdb: Options.bloom_locality: 0 2024-03-30T14:04:17.736 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:17 smithi099 ceph-mon[143401]: rocksdb: Options.max_successive_merges: 0 2024-03-30T14:04:17.736 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:17 smithi099 ceph-mon[143401]: rocksdb: Options.optimize_filters_for_hits: 0 2024-03-30T14:04:17.736 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:17 smithi099 ceph-mon[143401]: rocksdb: Options.paranoid_file_checks: 0 2024-03-30T14:04:17.736 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:17 smithi099 ceph-mon[143401]: rocksdb: Options.force_consistency_checks: 1 2024-03-30T14:04:17.737 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:17 smithi099 ceph-mon[143401]: rocksdb: Options.report_bg_io_stats: 0 2024-03-30T14:04:17.737 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:17 smithi099 ceph-mon[143401]: rocksdb: Options.ttl: 2592000 2024-03-30T14:04:17.737 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:17 smithi099 ceph-mon[143401]: rocksdb: Options.periodic_compaction_seconds: 0 2024-03-30T14:04:17.737 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:17 smithi099 ceph-mon[143401]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-03-30T14:04:17.737 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:17 smithi099 ceph-mon[143401]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-03-30T14:04:17.737 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:17 smithi099 ceph-mon[143401]: rocksdb: Options.enable_blob_files: false 2024-03-30T14:04:17.737 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:17 smithi099 ceph-mon[143401]: rocksdb: Options.min_blob_size: 0 2024-03-30T14:04:17.737 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:17 smithi099 ceph-mon[143401]: rocksdb: Options.blob_file_size: 268435456 2024-03-30T14:04:17.737 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:17 smithi099 ceph-mon[143401]: rocksdb: Options.blob_compression_type: NoCompression 2024-03-30T14:04:17.737 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:17 smithi099 ceph-mon[143401]: rocksdb: Options.enable_blob_garbage_collection: false 2024-03-30T14:04:17.737 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:17 smithi099 ceph-mon[143401]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-03-30T14:04:17.737 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:17 smithi099 ceph-mon[143401]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-03-30T14:04:17.737 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:17 smithi099 ceph-mon[143401]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-03-30T14:04:17.737 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:17 smithi099 ceph-mon[143401]: rocksdb: Options.blob_file_starting_level: 0 2024-03-30T14:04:17.737 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:17 smithi099 ceph-mon[143401]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-03-30T14:04:17.737 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:17 smithi099 ceph-mon[143401]: rocksdb: [table/block_based/block_based_table_reader.cc:721] At least one SST file opened without unique ID to verify: 105.sst 2024-03-30T14:04:17.738 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:17 smithi099 ceph-mon[143401]: rocksdb: [db/version_set.cc:4390] More existing levels in DB than needed. max_bytes_for_level_multiplier may not be guaranteed. 2024-03-30T14:04:17.738 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:17 smithi099 ceph-mon[143401]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-c/store.db/MANIFEST-000009 succeeded,manifest_file_number is 9, next_file_number is 107, last_sequence is 63087, log_number is 103,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2024-03-30T14:04:17.738 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:17 smithi099 ceph-mon[143401]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 103 2024-03-30T14:04:17.738 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:17 smithi099 ceph-mon[143401]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: 7956cc19-10bc-4706-9e02-f9cb6ca252d3 2024-03-30T14:04:17.738 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:17 smithi099 ceph-mon[143401]: rocksdb: EVENT_LOG_v1 {"time_micros": 1711807457405352, "job": 1, "event": "recovery_started", "wal_files": [103]} 2024-03-30T14:04:17.738 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:17 smithi099 ceph-mon[143401]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #103 mode 2 2024-03-30T14:04:17.738 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:17 smithi099 ceph-mon[143401]: rocksdb: EVENT_LOG_v1 {"time_micros": 1711807457408981, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 108, "file_size": 630528, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 63092, "largest_seqno": 63998, "table_properties": {"data_size": 626607, "index_size": 1627, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 1285, "raw_key_size": 12462, "raw_average_key_size": 24, "raw_value_size": 617869, "raw_average_value_size": 1230, "num_data_blocks": 65, "num_entries": 502, "num_filter_entries": 502, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1711807457, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "7956cc19-10bc-4706-9e02-f9cb6ca252d3", "db_session_id": "OCVHBQDG9RT0EVOTOXM2", "orig_file_number": 108, "seqno_to_time_mapping": "N/A"}} 2024-03-30T14:04:17.738 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:17 smithi099 ceph-mon[143401]: rocksdb: EVENT_LOG_v1 {"time_micros": 1711807457409071, "job": 1, "event": "recovery_finished"} 2024-03-30T14:04:17.738 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:17 smithi099 ceph-mon[143401]: rocksdb: [db/version_set.cc:5047] Creating manifest 110 2024-03-30T14:04:17.738 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:17 smithi099 ceph-mon[143401]: rocksdb: [db/version_set.cc:4390] More existing levels in DB than needed. max_bytes_for_level_multiplier may not be guaranteed. 2024-03-30T14:04:17.738 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:17 smithi099 ceph-mon[143401]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-c/store.db/000103.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-03-30T14:04:17.738 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:17 smithi099 ceph-mon[143401]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x558df5cae000 2024-03-30T14:04:17.738 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:17 smithi099 ceph-mon[143401]: rocksdb: DB pointer 0x558df5c98000 2024-03-30T14:04:17.738 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:17 smithi099 ceph-mon[143401]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-03-30T14:04:17.739 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:17 smithi099 ceph-mon[143401]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-03-30T14:04:17.739 INFO:journalctl@ceph.mon.c.smithi099.stdout: ** DB Stats ** 2024-03-30T14:04:17.739 INFO:journalctl@ceph.mon.c.smithi099.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-03-30T14:04:17.739 INFO:journalctl@ceph.mon.c.smithi099.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-03-30T14:04:17.739 INFO:journalctl@ceph.mon.c.smithi099.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-03-30T14:04:17.739 INFO:journalctl@ceph.mon.c.smithi099.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-03-30T14:04:17.739 INFO:journalctl@ceph.mon.c.smithi099.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-03-30T14:04:17.739 INFO:journalctl@ceph.mon.c.smithi099.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-03-30T14:04:17.739 INFO:journalctl@ceph.mon.c.smithi099.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-03-30T14:04:17.739 INFO:journalctl@ceph.mon.c.smithi099.stdout: 2024-03-30T14:04:17.739 INFO:journalctl@ceph.mon.c.smithi099.stdout: ** Compaction Stats [default] ** 2024-03-30T14:04:17.740 INFO:journalctl@ceph.mon.c.smithi099.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-03-30T14:04:17.740 INFO:journalctl@ceph.mon.c.smithi099.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-03-30T14:04:17.740 INFO:journalctl@ceph.mon.c.smithi099.stdout: L0 1/0 615.75 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 314.5 0.00 0.00 1 0.002 0 0 0.0 0.0 2024-03-30T14:04:17.740 INFO:journalctl@ceph.mon.c.smithi099.stdout: L6 1/0 12.46 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 2024-03-30T14:04:17.740 INFO:journalctl@ceph.mon.c.smithi099.stdout: Sum 2/0 13.06 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 314.5 0.00 0.00 1 0.002 0 0 0.0 0.0 2024-03-30T14:04:17.740 INFO:journalctl@ceph.mon.c.smithi099.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 314.5 0.00 0.00 1 0.002 0 0 0.0 0.0 2024-03-30T14:04:17.740 INFO:journalctl@ceph.mon.c.smithi099.stdout: 2024-03-30T14:04:17.740 INFO:journalctl@ceph.mon.c.smithi099.stdout: ** Compaction Stats [default] ** 2024-03-30T14:04:17.740 INFO:journalctl@ceph.mon.c.smithi099.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-03-30T14:04:17.740 INFO:journalctl@ceph.mon.c.smithi099.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-03-30T14:04:17.740 INFO:journalctl@ceph.mon.c.smithi099.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 314.5 0.00 0.00 1 0.002 0 0 0.0 0.0 2024-03-30T14:04:17.740 INFO:journalctl@ceph.mon.c.smithi099.stdout: 2024-03-30T14:04:17.740 INFO:journalctl@ceph.mon.c.smithi099.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-03-30T14:04:17.740 INFO:journalctl@ceph.mon.c.smithi099.stdout: 2024-03-30T14:04:17.740 INFO:journalctl@ceph.mon.c.smithi099.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-03-30T14:04:17.740 INFO:journalctl@ceph.mon.c.smithi099.stdout: Flush(GB): cumulative 0.001, interval 0.001 2024-03-30T14:04:17.741 INFO:journalctl@ceph.mon.c.smithi099.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-03-30T14:04:17.741 INFO:journalctl@ceph.mon.c.smithi099.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-03-30T14:04:17.741 INFO:journalctl@ceph.mon.c.smithi099.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-03-30T14:04:17.741 INFO:journalctl@ceph.mon.c.smithi099.stdout: AddFile(Keys): cumulative 0, interval 0 2024-03-30T14:04:17.741 INFO:journalctl@ceph.mon.c.smithi099.stdout: Cumulative compaction: 0.00 GB write, 93.69 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-03-30T14:04:17.741 INFO:journalctl@ceph.mon.c.smithi099.stdout: Interval compaction: 0.00 GB write, 93.69 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-03-30T14:04:17.741 INFO:journalctl@ceph.mon.c.smithi099.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-03-30T14:04:17.741 INFO:journalctl@ceph.mon.c.smithi099.stdout: Block cache BinnedLRUCache@0x558df5bbd090#2 capacity: 512.00 MB usage: 3.23 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 1e-05 secs_since: 0 2024-03-30T14:04:17.741 INFO:journalctl@ceph.mon.c.smithi099.stdout: Block cache entry stats(count,size,portion): FilterBlock(1,1.41 KB,0.000268221%) IndexBlock(1,1.83 KB,0.000348687%) Misc(1,0.00 KB,0%) 2024-03-30T14:04:17.741 INFO:journalctl@ceph.mon.c.smithi099.stdout: 2024-03-30T14:04:17.741 INFO:journalctl@ceph.mon.c.smithi099.stdout: ** File Read Latency Histogram By Level [default] ** 2024-03-30T14:04:17.741 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:17 smithi099 ceph-mon[143401]: starting mon.c rank 1 at public addrs [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] at bind addrs [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] mon_data /var/lib/ceph/mon/ceph-c fsid 98ebaeb8-ee99-11ee-b647-cb9ed24678a4 2024-03-30T14:04:17.741 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:17 smithi099 ceph-mon[143401]: mon.c@-1(???) e3 preinit fsid 98ebaeb8-ee99-11ee-b647-cb9ed24678a4 2024-03-30T14:04:17.741 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:17 smithi099 ceph-mon[143401]: mon.c@-1(???).mds e1 new map 2024-03-30T14:04:17.741 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:17 smithi099 ceph-mon[143401]: mon.c@-1(???).mds e1 print_map 2024-03-30T14:04:17.741 INFO:journalctl@ceph.mon.c.smithi099.stdout: e1 2024-03-30T14:04:17.742 INFO:journalctl@ceph.mon.c.smithi099.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-03-30T14:04:17.742 INFO:journalctl@ceph.mon.c.smithi099.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-03-30T14:04:17.742 INFO:journalctl@ceph.mon.c.smithi099.stdout: legacy client fscid: -1 2024-03-30T14:04:17.742 INFO:journalctl@ceph.mon.c.smithi099.stdout: 2024-03-30T14:04:17.742 INFO:journalctl@ceph.mon.c.smithi099.stdout: No filesystems configured 2024-03-30T14:04:17.742 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:17 smithi099 ceph-mon[143401]: mon.c@-1(???).osd e113 crush map has features 3314933000854323200, adjusting msgr requires 2024-03-30T14:04:17.742 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:17 smithi099 ceph-mon[143401]: mon.c@-1(???).osd e113 crush map has features 432629239337189376, adjusting msgr requires 2024-03-30T14:04:17.742 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:17 smithi099 ceph-mon[143401]: mon.c@-1(???).osd e113 crush map has features 432629239337189376, adjusting msgr requires 2024-03-30T14:04:17.742 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:17 smithi099 ceph-mon[143401]: mon.c@-1(???).osd e113 crush map has features 432629239337189376, adjusting msgr requires 2024-03-30T14:04:17.742 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:17 smithi099 ceph-mon[143401]: mon.c@-1(???).paxosservice(auth 1..32) refresh upgraded, format 0 -> 3 2024-03-30T14:04:17.742 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:17 smithi099 bash[143382]: 731056a2fea67aba1b837e3115a42a524b21192422c27317f49443181f265527 2024-03-30T14:04:17.742 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:17 smithi099 systemd[1]: Started Ceph mon.c for 98ebaeb8-ee99-11ee-b647-cb9ed24678a4. 2024-03-30T14:04:19.079 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:18 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-03-30T14:04:19.079 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:18 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-30T14:04:19.079 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:18 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-30T14:04:19.079 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:18 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-03-30T14:04:19.079 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:18 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-30T14:04:19.080 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:18 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-30T14:04:19.248 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:18 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-03-30T14:04:19.248 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:18 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-30T14:04:19.249 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:18 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-30T14:04:19.830 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:19 smithi099 ceph-mon[137093]: pgmap v23: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T14:04:19.830 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:19 smithi099 ceph-mon[137093]: from='client.25136 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T14:04:19.830 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:19 smithi099 ceph-mon[137093]: pgmap v24: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T14:04:19.830 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:19 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-03-30T14:04:19.831 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:19 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-30T14:04:19.831 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:19 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-30T14:04:19.831 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:19 smithi099 ceph-mon[137093]: mon.b calling monitor election 2024-03-30T14:04:19.831 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:19 smithi099 ceph-mon[137093]: mon.c calling monitor election 2024-03-30T14:04:19.831 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:19 smithi099 ceph-mon[137093]: mon.a calling monitor election 2024-03-30T14:04:19.831 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:19 smithi099 ceph-mon[137093]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-03-30T14:04:19.831 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:19 smithi099 ceph-mon[137093]: monmap epoch 4 2024-03-30T14:04:19.831 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:19 smithi099 ceph-mon[137093]: fsid 98ebaeb8-ee99-11ee-b647-cb9ed24678a4 2024-03-30T14:04:19.831 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:19 smithi099 ceph-mon[137093]: last_changed 2024-03-30T14:04:18.799675+0000 2024-03-30T14:04:19.831 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:19 smithi099 ceph-mon[137093]: created 2024-03-30T13:30:34.451427+0000 2024-03-30T14:04:19.831 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:19 smithi099 ceph-mon[137093]: min_mon_release 19 (squid) 2024-03-30T14:04:19.831 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:19 smithi099 ceph-mon[137093]: election_strategy: 1 2024-03-30T14:04:19.831 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:19 smithi099 ceph-mon[137093]: 0: [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] mon.a 2024-03-30T14:04:19.831 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:19 smithi099 ceph-mon[137093]: 1: [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] mon.c 2024-03-30T14:04:19.832 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:19 smithi099 ceph-mon[137093]: 2: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.b 2024-03-30T14:04:19.832 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:19 smithi099 ceph-mon[137093]: fsmap 2024-03-30T14:04:19.832 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:19 smithi099 ceph-mon[137093]: osdmap e113: 8 total, 8 up, 8 in 2024-03-30T14:04:19.832 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:19 smithi099 ceph-mon[137093]: mgrmap e50: y(active, since 42s), standbys: x 2024-03-30T14:04:19.832 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:19 smithi099 ceph-mon[137093]: overall HEALTH_OK 2024-03-30T14:04:19.832 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:19 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='' 2024-03-30T14:04:19.832 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:19 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:04:19.832 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:19 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:04:19.832 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:19 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:04:19.832 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:19 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:04:19.832 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:19 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:04:19.832 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:19 smithi099 ceph-mon[137093]: Reconfiguring mon.a (monmap changed)... 2024-03-30T14:04:19.832 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:19 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-03-30T14:04:19.832 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:19 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-03-30T14:04:19.832 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:19 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:04:19.833 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:19 smithi099 ceph-mon[137093]: Reconfiguring daemon mon.a on smithi099 2024-03-30T14:04:19.833 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:19 smithi099 ceph-mon[143401]: pgmap v23: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T14:04:19.833 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:19 smithi099 ceph-mon[143401]: from='client.25136 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T14:04:19.833 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:19 smithi099 ceph-mon[143401]: pgmap v24: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T14:04:19.833 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:19 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-03-30T14:04:19.833 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:19 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-30T14:04:19.833 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:19 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-30T14:04:19.833 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:19 smithi099 ceph-mon[143401]: mon.b calling monitor election 2024-03-30T14:04:19.833 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:19 smithi099 ceph-mon[143401]: mon.c calling monitor election 2024-03-30T14:04:19.833 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:19 smithi099 ceph-mon[143401]: mon.a calling monitor election 2024-03-30T14:04:19.833 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:19 smithi099 ceph-mon[143401]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-03-30T14:04:19.833 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:19 smithi099 ceph-mon[143401]: monmap epoch 4 2024-03-30T14:04:19.834 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:19 smithi099 ceph-mon[143401]: fsid 98ebaeb8-ee99-11ee-b647-cb9ed24678a4 2024-03-30T14:04:19.834 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:19 smithi099 ceph-mon[143401]: last_changed 2024-03-30T14:04:18.799675+0000 2024-03-30T14:04:19.834 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:19 smithi099 ceph-mon[143401]: created 2024-03-30T13:30:34.451427+0000 2024-03-30T14:04:19.834 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:19 smithi099 ceph-mon[143401]: min_mon_release 19 (squid) 2024-03-30T14:04:19.834 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:19 smithi099 ceph-mon[143401]: election_strategy: 1 2024-03-30T14:04:19.834 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:19 smithi099 ceph-mon[143401]: 0: [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] mon.a 2024-03-30T14:04:19.834 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:19 smithi099 ceph-mon[143401]: 1: [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] mon.c 2024-03-30T14:04:19.834 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:19 smithi099 ceph-mon[143401]: 2: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.b 2024-03-30T14:04:19.834 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:19 smithi099 ceph-mon[143401]: fsmap 2024-03-30T14:04:19.834 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:19 smithi099 ceph-mon[143401]: osdmap e113: 8 total, 8 up, 8 in 2024-03-30T14:04:19.834 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:19 smithi099 ceph-mon[143401]: mgrmap e50: y(active, since 42s), standbys: x 2024-03-30T14:04:19.834 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:19 smithi099 ceph-mon[143401]: overall HEALTH_OK 2024-03-30T14:04:19.834 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:19 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='' 2024-03-30T14:04:19.834 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:19 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:04:19.835 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:19 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:04:19.835 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:19 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:04:19.835 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:19 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:04:19.835 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:19 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:04:19.835 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:19 smithi099 ceph-mon[143401]: Reconfiguring mon.a (monmap changed)... 2024-03-30T14:04:19.835 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:19 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-03-30T14:04:19.835 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:19 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-03-30T14:04:19.835 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:19 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:04:19.835 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:19 smithi099 ceph-mon[143401]: Reconfiguring daemon mon.a on smithi099 2024-03-30T14:04:19.998 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:19 smithi181 ceph-mon[115276]: pgmap v23: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T14:04:19.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:19 smithi181 ceph-mon[115276]: from='client.25136 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T14:04:19.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:19 smithi181 ceph-mon[115276]: pgmap v24: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T14:04:19.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:19 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-03-30T14:04:19.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:19 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-30T14:04:19.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:19 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-30T14:04:19.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:19 smithi181 ceph-mon[115276]: mon.b calling monitor election 2024-03-30T14:04:19.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:19 smithi181 ceph-mon[115276]: mon.c calling monitor election 2024-03-30T14:04:19.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:19 smithi181 ceph-mon[115276]: mon.a calling monitor election 2024-03-30T14:04:19.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:19 smithi181 ceph-mon[115276]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-03-30T14:04:19.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:19 smithi181 ceph-mon[115276]: monmap epoch 4 2024-03-30T14:04:19.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:19 smithi181 ceph-mon[115276]: fsid 98ebaeb8-ee99-11ee-b647-cb9ed24678a4 2024-03-30T14:04:19.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:19 smithi181 ceph-mon[115276]: last_changed 2024-03-30T14:04:18.799675+0000 2024-03-30T14:04:19.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:19 smithi181 ceph-mon[115276]: created 2024-03-30T13:30:34.451427+0000 2024-03-30T14:04:20.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:19 smithi181 ceph-mon[115276]: min_mon_release 19 (squid) 2024-03-30T14:04:20.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:19 smithi181 ceph-mon[115276]: election_strategy: 1 2024-03-30T14:04:20.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:19 smithi181 ceph-mon[115276]: 0: [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] mon.a 2024-03-30T14:04:20.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:19 smithi181 ceph-mon[115276]: 1: [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] mon.c 2024-03-30T14:04:20.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:19 smithi181 ceph-mon[115276]: 2: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.b 2024-03-30T14:04:20.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:19 smithi181 ceph-mon[115276]: fsmap 2024-03-30T14:04:20.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:19 smithi181 ceph-mon[115276]: osdmap e113: 8 total, 8 up, 8 in 2024-03-30T14:04:20.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:19 smithi181 ceph-mon[115276]: mgrmap e50: y(active, since 42s), standbys: x 2024-03-30T14:04:20.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:19 smithi181 ceph-mon[115276]: overall HEALTH_OK 2024-03-30T14:04:20.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:19 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='' 2024-03-30T14:04:20.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:19 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:04:20.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:19 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:04:20.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:19 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:04:20.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:19 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:04:20.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:19 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:04:20.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:19 smithi181 ceph-mon[115276]: Reconfiguring mon.a (monmap changed)... 2024-03-30T14:04:20.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:19 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-03-30T14:04:20.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:19 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-03-30T14:04:20.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:19 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:04:20.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:19 smithi181 ceph-mon[115276]: Reconfiguring daemon mon.a on smithi099 2024-03-30T14:04:21.961 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:21 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:04:21.961 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:21 smithi099 ceph-mon[137093]: pgmap v25: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T14:04:21.961 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:21 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:04:21.961 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:21 smithi099 ceph-mon[137093]: Reconfiguring mgr.y (monmap changed)... 2024-03-30T14:04:21.961 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:21 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-03-30T14:04:21.961 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:21 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-03-30T14:04:21.961 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:21 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "mgr services"}]: dispatch 2024-03-30T14:04:21.961 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:21 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:04:21.961 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:21 smithi099 ceph-mon[137093]: Reconfiguring daemon mgr.y on smithi099 2024-03-30T14:04:21.961 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:21 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:04:21.961 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:21 smithi099 ceph-mon[143401]: pgmap v25: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T14:04:21.962 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:21 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:04:21.962 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:21 smithi099 ceph-mon[143401]: Reconfiguring mgr.y (monmap changed)... 2024-03-30T14:04:21.962 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:21 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-03-30T14:04:21.962 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:21 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-03-30T14:04:21.962 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:21 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "mgr services"}]: dispatch 2024-03-30T14:04:21.962 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:21 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:04:21.962 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:21 smithi099 ceph-mon[143401]: Reconfiguring daemon mgr.y on smithi099 2024-03-30T14:04:21.998 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:21 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:04:21.998 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:21 smithi181 ceph-mon[115276]: pgmap v25: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T14:04:21.998 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:21 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:04:21.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:21 smithi181 ceph-mon[115276]: Reconfiguring mgr.y (monmap changed)... 2024-03-30T14:04:21.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:21 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-03-30T14:04:21.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:21 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-03-30T14:04:21.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:21 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "mgr services"}]: dispatch 2024-03-30T14:04:21.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:21 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:04:21.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:21 smithi181 ceph-mon[115276]: Reconfiguring daemon mgr.y on smithi099 2024-03-30T14:04:22.694 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 14:04:22 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[71049]: 2024-03-30T14:04:22.417+0000 7f3c008ec700 -1 mgr.server handle_report got status from non-daemon mon.c 2024-03-30T14:04:22.995 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:22 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T14:04:22.995 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:22 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:04:22.995 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:22 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:04:22.996 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:22 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-03-30T14:04:22.996 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:22 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-03-30T14:04:22.996 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:22 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:04:22.996 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:22 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T14:04:22.996 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:22 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:04:22.996 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:22 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:04:22.996 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:22 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-03-30T14:04:22.996 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:22 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-03-30T14:04:22.996 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:22 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:04:22.998 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:22 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T14:04:22.998 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:22 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:04:22.998 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:22 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:04:22.998 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:22 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-03-30T14:04:22.998 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:22 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-03-30T14:04:22.998 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:22 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:04:23.993 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:23 smithi099 ceph-mon[137093]: Reconfiguring mon.c (monmap changed)... 2024-03-30T14:04:23.993 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:23 smithi099 ceph-mon[137093]: Reconfiguring daemon mon.c on smithi099 2024-03-30T14:04:23.993 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:23 smithi099 ceph-mon[137093]: pgmap v26: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T14:04:23.993 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:23 smithi099 ceph-mon[143401]: Reconfiguring mon.c (monmap changed)... 2024-03-30T14:04:23.993 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:23 smithi099 ceph-mon[143401]: Reconfiguring daemon mon.c on smithi099 2024-03-30T14:04:23.993 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:23 smithi099 ceph-mon[143401]: pgmap v26: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T14:04:23.998 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:23 smithi181 ceph-mon[115276]: Reconfiguring mon.c (monmap changed)... 2024-03-30T14:04:23.998 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:23 smithi181 ceph-mon[115276]: Reconfiguring daemon mon.c on smithi099 2024-03-30T14:04:23.998 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:23 smithi181 ceph-mon[115276]: pgmap v26: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T14:04:24.925 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 14:04:24 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[71049]: ::ffff:172.21.15.181 - - [30/Mar/2024:14:04:24] "GET /metrics HTTP/1.1" 200 37953 "" "Prometheus/2.43.0" 2024-03-30T14:04:25.225 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:25 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:04:25.225 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:25 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:04:25.225 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:25 smithi099 ceph-mon[143401]: Reconfiguring osd.0 (monmap changed)... 2024-03-30T14:04:25.225 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:25 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-03-30T14:04:25.225 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:25 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:04:25.225 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:25 smithi099 ceph-mon[143401]: Reconfiguring daemon osd.0 on smithi099 2024-03-30T14:04:25.225 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:25 smithi099 ceph-mon[143401]: pgmap v27: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T14:04:25.226 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:25 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:04:25.226 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:25 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:04:25.226 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:25 smithi099 ceph-mon[137093]: Reconfiguring osd.0 (monmap changed)... 2024-03-30T14:04:25.226 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:25 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-03-30T14:04:25.226 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:25 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:04:25.226 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:25 smithi099 ceph-mon[137093]: Reconfiguring daemon osd.0 on smithi099 2024-03-30T14:04:25.226 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:25 smithi099 ceph-mon[137093]: pgmap v27: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T14:04:25.226 INFO:teuthology.orchestra.run.smithi099.stdout:true 2024-03-30T14:04:25.248 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:25 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:04:25.249 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:25 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:04:25.249 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:25 smithi181 ceph-mon[115276]: Reconfiguring osd.0 (monmap changed)... 2024-03-30T14:04:25.249 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:25 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-03-30T14:04:25.249 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:25 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:04:25.249 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:25 smithi181 ceph-mon[115276]: Reconfiguring daemon osd.0 on smithi099 2024-03-30T14:04:25.249 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:25 smithi181 ceph-mon[115276]: pgmap v27: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T14:04:25.889 INFO:teuthology.orchestra.run.smithi099.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-03-30T14:04:25.890 INFO:teuthology.orchestra.run.smithi099.stdout:agent.smithi099 smithi099 running 16s ago 32m - - 2024-03-30T14:04:25.890 INFO:teuthology.orchestra.run.smithi099.stdout:agent.smithi181 smithi181 running 18s ago 32m - - 2024-03-30T14:04:25.890 INFO:teuthology.orchestra.run.smithi099.stdout:alertmanager.a smithi099 *:9093,9094 running (3m) 16s ago 26m 18.8M - 0.25.0 c8568f914cd2 08735152b67d 2024-03-30T14:04:25.890 INFO:teuthology.orchestra.run.smithi099.stdout:grafana.a smithi181 *:3000 running (2m) 18s ago 26m 79.8M - 9.4.12 2bacad6d85d8 d599aa7730d6 2024-03-30T14:04:25.890 INFO:teuthology.orchestra.run.smithi099.stdout:iscsi.foo.smithi099.qyjuvr smithi099 running (5m) 16s ago 26m 59.4M - 3.5 e1d6a67b021e 2f859af6bc2a 2024-03-30T14:04:25.890 INFO:teuthology.orchestra.run.smithi099.stdout:mgr.x smithi181 *:8443,9283,8765 running (4m) 18s ago 31m 448M - 19.0.0-1967-g4e50bbcd b0c4478f1d83 f269106f7913 2024-03-30T14:04:25.890 INFO:teuthology.orchestra.run.smithi099.stdout:mgr.y smithi099 *:8443,9283,8765 running (15m) 16s ago 33m 504M - 19.0.0-1967-g4e50bbcd b0c4478f1d83 0d464b8c1d18 2024-03-30T14:04:25.890 INFO:teuthology.orchestra.run.smithi099.stdout:mon.a smithi099 running (31s) 16s ago 33m 36.4M 2048M 19.0.0-1967-g4e50bbcd b0c4478f1d83 f19388464dfd 2024-03-30T14:04:25.890 INFO:teuthology.orchestra.run.smithi099.stdout:mon.b smithi181 running (114s) 18s ago 32m 44.1M 2048M 19.0.0-1967-g4e50bbcd b0c4478f1d83 0468ed087cdd 2024-03-30T14:04:25.890 INFO:teuthology.orchestra.run.smithi099.stdout:mon.c smithi099 starting - - - 2048M 2024-03-30T14:04:25.890 INFO:teuthology.orchestra.run.smithi099.stdout:node-exporter.a smithi099 *:9100 running (4m) 16s ago 27m 15.1M - 1.5.0 0da6a335fe13 4a3f1f6e7068 2024-03-30T14:04:25.891 INFO:teuthology.orchestra.run.smithi099.stdout:node-exporter.b smithi181 *:9100 running (4m) 18s ago 27m 15.2M - 1.5.0 0da6a335fe13 acea317b5f5d 2024-03-30T14:04:25.891 INFO:teuthology.orchestra.run.smithi099.stdout:osd.0 smithi099 running (31m) 16s ago 31m 53.8M 4096M 17.2.0 e1d6a67b021e 3158ee1b0c67 2024-03-30T14:04:25.891 INFO:teuthology.orchestra.run.smithi099.stdout:osd.1 smithi099 running (31m) 16s ago 31m 58.0M 4096M 17.2.0 e1d6a67b021e c4af0fd7071a 2024-03-30T14:04:25.891 INFO:teuthology.orchestra.run.smithi099.stdout:osd.2 smithi099 running (30m) 16s ago 30m 49.9M 4096M 17.2.0 e1d6a67b021e 8e4e805a7e20 2024-03-30T14:04:25.891 INFO:teuthology.orchestra.run.smithi099.stdout:osd.3 smithi099 running (30m) 16s ago 30m 54.0M 4096M 17.2.0 e1d6a67b021e 718812bcf065 2024-03-30T14:04:25.891 INFO:teuthology.orchestra.run.smithi099.stdout:osd.4 smithi181 running (30m) 18s ago 30m 55.4M 4096M 17.2.0 e1d6a67b021e 5e205434e973 2024-03-30T14:04:25.891 INFO:teuthology.orchestra.run.smithi099.stdout:osd.5 smithi181 running (29m) 18s ago 29m 53.0M 4096M 17.2.0 e1d6a67b021e e330c920f152 2024-03-30T14:04:25.891 INFO:teuthology.orchestra.run.smithi099.stdout:osd.6 smithi181 running (29m) 18s ago 29m 52.8M 4096M 17.2.0 e1d6a67b021e 81d889ea213d 2024-03-30T14:04:25.891 INFO:teuthology.orchestra.run.smithi099.stdout:osd.7 smithi181 running (28m) 18s ago 28m 53.2M 4096M 17.2.0 e1d6a67b021e c08b1839dd7e 2024-03-30T14:04:25.891 INFO:teuthology.orchestra.run.smithi099.stdout:prometheus.a smithi181 *:9095 running (3m) 18s ago 28m 68.1M - 2.43.0 a07b618ecd1d 004088bdf70e 2024-03-30T14:04:25.891 INFO:teuthology.orchestra.run.smithi099.stdout:rgw.foo.smithi099.fxjbmp smithi099 *:8000 running (26m) 16s ago 26m 77.4M - 17.2.0 e1d6a67b021e 400b28b3f650 2024-03-30T14:04:25.891 INFO:teuthology.orchestra.run.smithi099.stdout:rgw.foo.smithi181.wfqwti smithi181 *:8000 running (26m) 18s ago 26m 77.1M - 17.2.0 e1d6a67b021e 97e1b130f9d4 2024-03-30T14:04:26.299 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-03-30T14:04:26.299 INFO:teuthology.orchestra.run.smithi099.stdout: "mon": { 2024-03-30T14:04:26.299 INFO:teuthology.orchestra.run.smithi099.stdout: "ceph version 19.0.0-1967-g4e50bbcd (4e50bbcdd1630c7760b708f3a5b4d38a121e66cb) squid (dev)": 3 2024-03-30T14:04:26.299 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T14:04:26.300 INFO:teuthology.orchestra.run.smithi099.stdout: "mgr": { 2024-03-30T14:04:26.300 INFO:teuthology.orchestra.run.smithi099.stdout: "ceph version 19.0.0-1967-g4e50bbcd (4e50bbcdd1630c7760b708f3a5b4d38a121e66cb) squid (dev)": 2 2024-03-30T14:04:26.300 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T14:04:26.300 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": { 2024-03-30T14:04:26.300 INFO:teuthology.orchestra.run.smithi099.stdout: "ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)": 8 2024-03-30T14:04:26.300 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T14:04:26.300 INFO:teuthology.orchestra.run.smithi099.stdout: "rgw": { 2024-03-30T14:04:26.300 INFO:teuthology.orchestra.run.smithi099.stdout: "ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)": 2 2024-03-30T14:04:26.300 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T14:04:26.300 INFO:teuthology.orchestra.run.smithi099.stdout: "overall": { 2024-03-30T14:04:26.300 INFO:teuthology.orchestra.run.smithi099.stdout: "ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)": 10, 2024-03-30T14:04:26.300 INFO:teuthology.orchestra.run.smithi099.stdout: "ceph version 19.0.0-1967-g4e50bbcd (4e50bbcdd1630c7760b708f3a5b4d38a121e66cb) squid (dev)": 5 2024-03-30T14:04:26.300 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-03-30T14:04:26.300 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-03-30T14:04:26.301 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:26 smithi099 ceph-mon[137093]: from='client.64102 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T14:04:26.301 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:26 smithi099 ceph-mon[137093]: from='client.64108 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T14:04:26.301 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:26 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:04:26.301 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:26 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:04:26.301 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:26 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-03-30T14:04:26.301 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:26 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:04:26.301 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:26 smithi099 ceph-mon[143401]: from='client.64102 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T14:04:26.301 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:26 smithi099 ceph-mon[143401]: from='client.64108 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T14:04:26.301 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:26 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:04:26.301 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:26 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:04:26.301 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:26 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-03-30T14:04:26.301 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:26 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:04:26.350 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:26 smithi181 ceph-mon[115276]: from='client.64102 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T14:04:26.350 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:26 smithi181 ceph-mon[115276]: from='client.64108 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T14:04:26.350 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:26 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:04:26.350 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:26 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:04:26.350 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:26 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-03-30T14:04:26.350 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:26 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:04:26.644 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-03-30T14:04:26.644 INFO:teuthology.orchestra.run.smithi099.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph:4e50bbcdd1630c7760b708f3a5b4d38a121e66cb", 2024-03-30T14:04:26.644 INFO:teuthology.orchestra.run.smithi099.stdout: "in_progress": true, 2024-03-30T14:04:26.644 INFO:teuthology.orchestra.run.smithi099.stdout: "which": "Upgrading daemons of type(s) mon on host(s) smithi099", 2024-03-30T14:04:26.644 INFO:teuthology.orchestra.run.smithi099.stdout: "services_complete": [], 2024-03-30T14:04:26.644 INFO:teuthology.orchestra.run.smithi099.stdout: "progress": "1/2 daemons upgraded", 2024-03-30T14:04:26.644 INFO:teuthology.orchestra.run.smithi099.stdout: "message": "Currently upgrading mon daemons", 2024-03-30T14:04:26.644 INFO:teuthology.orchestra.run.smithi099.stdout: "is_paused": false 2024-03-30T14:04:26.644 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-03-30T14:04:27.248 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:27 smithi181 ceph-mon[115276]: from='client.54114 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T14:04:27.249 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:27 smithi181 ceph-mon[115276]: Reconfiguring osd.1 (monmap changed)... 2024-03-30T14:04:27.249 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:27 smithi181 ceph-mon[115276]: Reconfiguring daemon osd.1 on smithi099 2024-03-30T14:04:27.249 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:27 smithi181 ceph-mon[115276]: from='client.? 172.21.15.99:0/440348184' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:04:27.249 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:27 smithi181 ceph-mon[115276]: from='client.34175 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T14:04:27.249 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:27 smithi181 ceph-mon[115276]: pgmap v28: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T14:04:27.329 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:27 smithi099 ceph-mon[143401]: from='client.54114 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T14:04:27.329 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:27 smithi099 ceph-mon[143401]: Reconfiguring osd.1 (monmap changed)... 2024-03-30T14:04:27.329 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:27 smithi099 ceph-mon[143401]: Reconfiguring daemon osd.1 on smithi099 2024-03-30T14:04:27.329 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:27 smithi099 ceph-mon[143401]: from='client.? 172.21.15.99:0/440348184' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:04:27.330 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:27 smithi099 ceph-mon[143401]: from='client.34175 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T14:04:27.330 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:27 smithi099 ceph-mon[143401]: pgmap v28: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T14:04:27.330 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:27 smithi099 ceph-mon[137093]: from='client.54114 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T14:04:27.330 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:27 smithi099 ceph-mon[137093]: Reconfiguring osd.1 (monmap changed)... 2024-03-30T14:04:27.330 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:27 smithi099 ceph-mon[137093]: Reconfiguring daemon osd.1 on smithi099 2024-03-30T14:04:27.330 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:27 smithi099 ceph-mon[137093]: from='client.? 172.21.15.99:0/440348184' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:04:27.330 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:27 smithi099 ceph-mon[137093]: from='client.34175 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T14:04:27.330 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:27 smithi099 ceph-mon[137093]: pgmap v28: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T14:04:28.579 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:28 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:04:28.580 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:28 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:04:28.580 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:28 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:04:28.580 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:28 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:04:28.580 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:28 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:04:28.580 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:28 smithi099 ceph-mon[137093]: Reconfiguring osd.2 (monmap changed)... 2024-03-30T14:04:28.580 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:28 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-03-30T14:04:28.580 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:28 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:04:28.580 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:28 smithi099 ceph-mon[137093]: Reconfiguring daemon osd.2 on smithi099 2024-03-30T14:04:28.580 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:28 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:04:28.580 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:28 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:04:28.580 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:28 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:04:28.580 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:28 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:04:28.581 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:28 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:04:28.581 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:28 smithi099 ceph-mon[143401]: Reconfiguring osd.2 (monmap changed)... 2024-03-30T14:04:28.581 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:28 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-03-30T14:04:28.581 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:28 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:04:28.581 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:28 smithi099 ceph-mon[143401]: Reconfiguring daemon osd.2 on smithi099 2024-03-30T14:04:28.748 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:28 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:04:28.749 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:28 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:04:28.749 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:28 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:04:28.749 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:28 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:04:28.749 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:28 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:04:28.749 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:28 smithi181 ceph-mon[115276]: Reconfiguring osd.2 (monmap changed)... 2024-03-30T14:04:28.749 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:28 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-03-30T14:04:28.749 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:28 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:04:28.749 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:28 smithi181 ceph-mon[115276]: Reconfiguring daemon osd.2 on smithi099 2024-03-30T14:04:29.579 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:29 smithi099 ceph-mon[143401]: from='client.25136 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T14:04:29.579 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:29 smithi099 ceph-mon[143401]: pgmap v29: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T14:04:29.579 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:29 smithi099 ceph-mon[137093]: from='client.25136 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T14:04:29.580 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:29 smithi099 ceph-mon[137093]: pgmap v29: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T14:04:29.748 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:29 smithi181 ceph-mon[115276]: from='client.25136 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T14:04:29.748 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:29 smithi181 ceph-mon[115276]: pgmap v29: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T14:04:31.131 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:30 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:04:31.131 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:30 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:04:31.131 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:30 smithi099 ceph-mon[137093]: Reconfiguring osd.3 (monmap changed)... 2024-03-30T14:04:31.131 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:30 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-03-30T14:04:31.132 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:30 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:04:31.132 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:30 smithi099 ceph-mon[137093]: Reconfiguring daemon osd.3 on smithi099 2024-03-30T14:04:31.132 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:30 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:04:31.132 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:30 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:04:31.132 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:30 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:04:31.132 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:30 smithi099 ceph-mon[137093]: pgmap v30: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T14:04:31.132 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:30 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:04:31.132 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:30 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:04:31.132 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:30 smithi099 ceph-mon[143401]: Reconfiguring osd.3 (monmap changed)... 2024-03-30T14:04:31.132 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:30 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-03-30T14:04:31.132 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:30 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:04:31.132 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:30 smithi099 ceph-mon[143401]: Reconfiguring daemon osd.3 on smithi099 2024-03-30T14:04:31.132 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:30 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:04:31.133 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:30 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:04:31.133 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:30 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:04:31.133 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:30 smithi099 ceph-mon[143401]: pgmap v30: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T14:04:31.248 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:30 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:04:31.248 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:30 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:04:31.249 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:30 smithi181 ceph-mon[115276]: Reconfiguring osd.3 (monmap changed)... 2024-03-30T14:04:31.249 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:30 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-03-30T14:04:31.249 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:30 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:04:31.249 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:30 smithi181 ceph-mon[115276]: Reconfiguring daemon osd.3 on smithi099 2024-03-30T14:04:31.249 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:30 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:04:31.249 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:30 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:04:31.249 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:30 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:04:31.249 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:30 smithi181 ceph-mon[115276]: pgmap v30: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T14:04:33.079 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:32 smithi099 ceph-mon[137093]: pgmap v31: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T14:04:33.079 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:32 smithi099 ceph-mon[143401]: pgmap v31: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T14:04:33.248 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:32 smithi181 ceph-mon[115276]: pgmap v31: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T14:04:34.418 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:34 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:04:34.418 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:34 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:04:34.418 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:34 smithi099 ceph-mon[143401]: Reconfiguring rgw.foo.smithi099.fxjbmp (monmap changed)... 2024-03-30T14:04:34.418 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:34 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.foo.smithi099.fxjbmp", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2024-03-30T14:04:34.418 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:34 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.foo.smithi099.fxjbmp", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2024-03-30T14:04:34.418 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:34 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:04:34.419 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:34 smithi099 ceph-mon[143401]: Reconfiguring daemon rgw.foo.smithi099.fxjbmp on smithi099 2024-03-30T14:04:34.419 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:34 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:04:34.419 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:34 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:04:34.419 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:34 smithi099 ceph-mon[137093]: Reconfiguring rgw.foo.smithi099.fxjbmp (monmap changed)... 2024-03-30T14:04:34.419 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:34 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.foo.smithi099.fxjbmp", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2024-03-30T14:04:34.419 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:34 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.foo.smithi099.fxjbmp", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2024-03-30T14:04:34.419 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:34 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:04:34.419 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:34 smithi099 ceph-mon[137093]: Reconfiguring daemon rgw.foo.smithi099.fxjbmp on smithi099 2024-03-30T14:04:34.498 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:34 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:04:34.498 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:34 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:04:34.498 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:34 smithi181 ceph-mon[115276]: Reconfiguring rgw.foo.smithi099.fxjbmp (monmap changed)... 2024-03-30T14:04:34.499 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:34 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.foo.smithi099.fxjbmp", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2024-03-30T14:04:34.499 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:34 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.foo.smithi099.fxjbmp", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2024-03-30T14:04:34.499 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:34 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:04:34.499 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:34 smithi181 ceph-mon[115276]: Reconfiguring daemon rgw.foo.smithi099.fxjbmp on smithi099 2024-03-30T14:04:35.044 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 14:04:34 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[71049]: ::ffff:172.21.15.181 - - [30/Mar/2024:14:04:34] "GET /metrics HTTP/1.1" 200 37953 "" "Prometheus/2.43.0" 2024-03-30T14:04:35.315 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:35 smithi099 ceph-mon[137093]: pgmap v32: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T14:04:35.315 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:35 smithi099 ceph-mon[143401]: pgmap v32: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T14:04:35.498 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:35 smithi181 ceph-mon[115276]: pgmap v32: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T14:04:36.998 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:36 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:04:36.998 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:36 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:04:36.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:36 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:04:37.079 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:36 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:04:37.079 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:36 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:04:37.079 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:36 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:04:37.080 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:36 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:04:37.080 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:36 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:04:37.080 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:36 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:04:37.998 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:37 smithi181 ceph-mon[115276]: pgmap v33: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T14:04:37.998 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:37 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T14:04:37.998 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:37 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:04:37.998 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:37 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:04:37.998 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:37 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-03-30T14:04:37.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:37 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-03-30T14:04:37.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:37 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:04:38.079 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:37 smithi099 ceph-mon[137093]: pgmap v33: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T14:04:38.079 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:37 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T14:04:38.079 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:37 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:04:38.079 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:37 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:04:38.079 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:37 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-03-30T14:04:38.079 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:37 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-03-30T14:04:38.080 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:37 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:04:38.080 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:37 smithi099 ceph-mon[143401]: pgmap v33: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T14:04:38.080 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:37 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T14:04:38.080 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:37 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:04:38.080 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:37 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:04:38.080 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:37 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-03-30T14:04:38.080 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:37 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-03-30T14:04:38.080 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:37 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:04:38.998 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:38 smithi181 ceph-mon[115276]: Reconfiguring mon.b (monmap changed)... 2024-03-30T14:04:38.998 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:38 smithi181 ceph-mon[115276]: Reconfiguring daemon mon.b on smithi181 2024-03-30T14:04:39.079 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:38 smithi099 ceph-mon[137093]: Reconfiguring mon.b (monmap changed)... 2024-03-30T14:04:39.079 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:38 smithi099 ceph-mon[137093]: Reconfiguring daemon mon.b on smithi181 2024-03-30T14:04:39.079 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:38 smithi099 ceph-mon[143401]: Reconfiguring mon.b (monmap changed)... 2024-03-30T14:04:39.079 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:38 smithi099 ceph-mon[143401]: Reconfiguring daemon mon.b on smithi181 2024-03-30T14:04:39.998 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:39 smithi181 ceph-mon[115276]: from='client.25136 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T14:04:39.998 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:39 smithi181 ceph-mon[115276]: pgmap v34: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T14:04:39.998 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:39 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:04:39.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:39 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:04:39.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:39 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-03-30T14:04:39.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:39 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-03-30T14:04:39.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:39 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "mgr services"}]: dispatch 2024-03-30T14:04:39.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:39 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:04:40.079 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:39 smithi099 ceph-mon[137093]: from='client.25136 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T14:04:40.079 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:39 smithi099 ceph-mon[137093]: pgmap v34: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T14:04:40.079 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:39 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:04:40.079 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:39 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:04:40.079 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:39 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-03-30T14:04:40.079 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:39 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-03-30T14:04:40.079 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:39 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "mgr services"}]: dispatch 2024-03-30T14:04:40.079 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:39 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:04:40.080 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:39 smithi099 ceph-mon[143401]: from='client.25136 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T14:04:40.080 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:39 smithi099 ceph-mon[143401]: pgmap v34: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T14:04:40.080 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:39 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:04:40.080 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:39 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:04:40.080 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:39 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-03-30T14:04:40.080 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:39 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-03-30T14:04:40.080 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:39 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "mgr services"}]: dispatch 2024-03-30T14:04:40.080 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:39 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:04:40.998 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:40 smithi181 ceph-mon[115276]: Reconfiguring mgr.x (monmap changed)... 2024-03-30T14:04:40.998 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:40 smithi181 ceph-mon[115276]: Reconfiguring daemon mgr.x on smithi181 2024-03-30T14:04:40.998 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:40 smithi181 ceph-mon[115276]: pgmap v35: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T14:04:41.079 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:40 smithi099 ceph-mon[137093]: Reconfiguring mgr.x (monmap changed)... 2024-03-30T14:04:41.079 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:40 smithi099 ceph-mon[137093]: Reconfiguring daemon mgr.x on smithi181 2024-03-30T14:04:41.079 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:40 smithi099 ceph-mon[137093]: pgmap v35: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T14:04:41.080 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:40 smithi099 ceph-mon[143401]: Reconfiguring mgr.x (monmap changed)... 2024-03-30T14:04:41.080 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:40 smithi099 ceph-mon[143401]: Reconfiguring daemon mgr.x on smithi181 2024-03-30T14:04:41.080 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:40 smithi099 ceph-mon[143401]: pgmap v35: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T14:04:42.248 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:41 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:04:42.248 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:41 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:04:42.248 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:41 smithi181 ceph-mon[115276]: Reconfiguring osd.4 (monmap changed)... 2024-03-30T14:04:42.248 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:41 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-03-30T14:04:42.248 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:41 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:04:42.249 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:41 smithi181 ceph-mon[115276]: Reconfiguring daemon osd.4 on smithi181 2024-03-30T14:04:42.329 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:41 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:04:42.329 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:41 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:04:42.329 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:41 smithi099 ceph-mon[137093]: Reconfiguring osd.4 (monmap changed)... 2024-03-30T14:04:42.329 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:41 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-03-30T14:04:42.330 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:41 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:04:42.330 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:41 smithi099 ceph-mon[137093]: Reconfiguring daemon osd.4 on smithi181 2024-03-30T14:04:42.330 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:41 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:04:42.330 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:41 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:04:42.330 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:41 smithi099 ceph-mon[143401]: Reconfiguring osd.4 (monmap changed)... 2024-03-30T14:04:42.330 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:41 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-03-30T14:04:42.330 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:41 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:04:42.330 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:41 smithi099 ceph-mon[143401]: Reconfiguring daemon osd.4 on smithi181 2024-03-30T14:04:43.980 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:43 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:04:43.980 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:43 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:04:43.980 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:43 smithi181 ceph-mon[115276]: Reconfiguring osd.5 (monmap changed)... 2024-03-30T14:04:43.980 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:43 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-03-30T14:04:43.980 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:43 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:04:43.980 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:43 smithi181 ceph-mon[115276]: Reconfiguring daemon osd.5 on smithi181 2024-03-30T14:04:43.980 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:43 smithi181 ceph-mon[115276]: pgmap v36: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T14:04:44.079 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:43 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:04:44.079 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:43 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:04:44.079 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:43 smithi099 ceph-mon[137093]: Reconfiguring osd.5 (monmap changed)... 2024-03-30T14:04:44.079 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:43 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-03-30T14:04:44.079 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:43 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:04:44.079 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:43 smithi099 ceph-mon[137093]: Reconfiguring daemon osd.5 on smithi181 2024-03-30T14:04:44.080 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:43 smithi099 ceph-mon[137093]: pgmap v36: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T14:04:44.080 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:43 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:04:44.080 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:43 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:04:44.080 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:43 smithi099 ceph-mon[143401]: Reconfiguring osd.5 (monmap changed)... 2024-03-30T14:04:44.080 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:43 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-03-30T14:04:44.080 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:43 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:04:44.080 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:43 smithi099 ceph-mon[143401]: Reconfiguring daemon osd.5 on smithi181 2024-03-30T14:04:44.080 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:43 smithi099 ceph-mon[143401]: pgmap v36: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T14:04:45.079 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 14:04:44 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[71049]: ::ffff:172.21.15.181 - - [30/Mar/2024:14:04:44] "GET /metrics HTTP/1.1" 200 38014 "" "Prometheus/2.43.0" 2024-03-30T14:04:45.687 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:45 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:04:45.687 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:45 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:04:45.687 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:45 smithi181 ceph-mon[115276]: Reconfiguring osd.6 (monmap changed)... 2024-03-30T14:04:45.687 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:45 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2024-03-30T14:04:45.688 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:45 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:04:45.688 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:45 smithi181 ceph-mon[115276]: Reconfiguring daemon osd.6 on smithi181 2024-03-30T14:04:45.688 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:45 smithi181 ceph-mon[115276]: pgmap v37: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T14:04:45.829 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:45 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:04:45.829 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:45 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:04:45.829 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:45 smithi099 ceph-mon[137093]: Reconfiguring osd.6 (monmap changed)... 2024-03-30T14:04:45.829 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:45 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2024-03-30T14:04:45.829 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:45 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:04:45.830 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:45 smithi099 ceph-mon[137093]: Reconfiguring daemon osd.6 on smithi181 2024-03-30T14:04:45.830 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:45 smithi099 ceph-mon[137093]: pgmap v37: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T14:04:45.830 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:45 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:04:45.830 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:45 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:04:45.830 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:45 smithi099 ceph-mon[143401]: Reconfiguring osd.6 (monmap changed)... 2024-03-30T14:04:45.830 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:45 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2024-03-30T14:04:45.830 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:45 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:04:45.830 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:45 smithi099 ceph-mon[143401]: Reconfiguring daemon osd.6 on smithi181 2024-03-30T14:04:45.830 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:45 smithi099 ceph-mon[143401]: pgmap v37: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T14:04:47.079 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:46 smithi099 ceph-mon[137093]: pgmap v38: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T14:04:47.079 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:46 smithi099 ceph-mon[143401]: pgmap v38: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T14:04:47.123 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:46 smithi181 ceph-mon[115276]: pgmap v38: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T14:04:48.440 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:48 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:04:48.441 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:48 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:04:48.441 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:48 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:04:48.829 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:48 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:04:48.829 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:48 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:04:48.829 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:48 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:04:48.829 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:48 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:04:48.829 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:48 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:04:48.829 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:48 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:04:49.538 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:49 smithi181 ceph-mon[115276]: from='client.25136 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T14:04:49.539 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:49 smithi181 ceph-mon[115276]: pgmap v39: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T14:04:49.539 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:49 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:04:49.539 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:49 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:04:49.539 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:49 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2024-03-30T14:04:49.539 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:49 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:04:49.829 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:49 smithi099 ceph-mon[137093]: from='client.25136 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T14:04:49.829 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:49 smithi099 ceph-mon[137093]: pgmap v39: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T14:04:49.829 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:49 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:04:49.829 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:49 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:04:49.829 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:49 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2024-03-30T14:04:49.829 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:49 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:04:49.829 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:49 smithi099 ceph-mon[143401]: from='client.25136 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T14:04:49.830 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:49 smithi099 ceph-mon[143401]: pgmap v39: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T14:04:49.830 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:49 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:04:49.830 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:49 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:04:49.830 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:49 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2024-03-30T14:04:49.830 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:49 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:04:50.748 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:50 smithi181 ceph-mon[115276]: Reconfiguring osd.7 (monmap changed)... 2024-03-30T14:04:50.748 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:50 smithi181 ceph-mon[115276]: Reconfiguring daemon osd.7 on smithi181 2024-03-30T14:04:50.829 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:50 smithi099 ceph-mon[143401]: Reconfiguring osd.7 (monmap changed)... 2024-03-30T14:04:50.829 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:50 smithi099 ceph-mon[143401]: Reconfiguring daemon osd.7 on smithi181 2024-03-30T14:04:50.829 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:50 smithi099 ceph-mon[137093]: Reconfiguring osd.7 (monmap changed)... 2024-03-30T14:04:50.829 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:50 smithi099 ceph-mon[137093]: Reconfiguring daemon osd.7 on smithi181 2024-03-30T14:04:51.748 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:51 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:04:51.748 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:51 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:04:51.748 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:51 smithi181 ceph-mon[115276]: Reconfiguring rgw.foo.smithi181.wfqwti (monmap changed)... 2024-03-30T14:04:51.748 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:51 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.foo.smithi181.wfqwti", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2024-03-30T14:04:51.749 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:51 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.foo.smithi181.wfqwti", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2024-03-30T14:04:51.749 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:51 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:04:51.749 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:51 smithi181 ceph-mon[115276]: Reconfiguring daemon rgw.foo.smithi181.wfqwti on smithi181 2024-03-30T14:04:51.749 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:51 smithi181 ceph-mon[115276]: pgmap v40: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T14:04:51.830 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:51 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:04:51.830 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:51 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:04:51.830 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:51 smithi099 ceph-mon[137093]: Reconfiguring rgw.foo.smithi181.wfqwti (monmap changed)... 2024-03-30T14:04:51.830 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:51 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.foo.smithi181.wfqwti", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2024-03-30T14:04:51.830 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:51 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.foo.smithi181.wfqwti", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2024-03-30T14:04:51.830 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:51 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:04:51.830 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:51 smithi099 ceph-mon[137093]: Reconfiguring daemon rgw.foo.smithi181.wfqwti on smithi181 2024-03-30T14:04:51.830 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:51 smithi099 ceph-mon[137093]: pgmap v40: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T14:04:51.831 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:51 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:04:51.831 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:51 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:04:51.831 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:51 smithi099 ceph-mon[143401]: Reconfiguring rgw.foo.smithi181.wfqwti (monmap changed)... 2024-03-30T14:04:51.831 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:51 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.foo.smithi181.wfqwti", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2024-03-30T14:04:51.831 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:51 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.foo.smithi181.wfqwti", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2024-03-30T14:04:51.831 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:51 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:04:51.831 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:51 smithi099 ceph-mon[143401]: Reconfiguring daemon rgw.foo.smithi181.wfqwti on smithi181 2024-03-30T14:04:51.831 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:51 smithi099 ceph-mon[143401]: pgmap v40: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T14:04:52.829 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:52 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T14:04:52.829 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:52 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:04:52.829 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:52 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:04:52.830 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:52 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:04:52.830 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:52 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:04:52.830 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:52 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:04:52.830 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:52 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:04:52.830 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:52 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.a"}]: dispatch 2024-03-30T14:04:52.830 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:52 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.a"}]: dispatch 2024-03-30T14:04:52.830 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:52 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.a"}]': finished 2024-03-30T14:04:52.830 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:52 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.c"}]: dispatch 2024-03-30T14:04:52.830 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:52 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.c"}]: dispatch 2024-03-30T14:04:52.830 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:52 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.c"}]': finished 2024-03-30T14:04:52.830 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:52 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:04:52.830 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:52 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:04:52.831 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:52 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:04:52.831 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:52 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:04:52.831 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:52 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:04:52.831 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:52 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:04:52.831 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:52 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:04:52.831 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:52 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.a"}]: dispatch 2024-03-30T14:04:52.831 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:52 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.a"}]: dispatch 2024-03-30T14:04:52.831 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:52 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.c"}]: dispatch 2024-03-30T14:04:52.831 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:52 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.c"}]: dispatch 2024-03-30T14:04:52.831 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:52 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:04:52.831 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:52 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:04:52.831 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:52 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:04:52.831 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:52 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:04:52.831 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:52 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:04:52.831 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:52 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:04:52.832 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:52 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:04:52.832 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:52 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.a"}]: dispatch 2024-03-30T14:04:52.832 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:52 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.a"}]: dispatch 2024-03-30T14:04:52.832 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:52 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.c"}]: dispatch 2024-03-30T14:04:52.832 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:52 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.c"}]: dispatch 2024-03-30T14:04:52.832 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:52 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:04:52.832 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:52 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.a"}]: dispatch 2024-03-30T14:04:52.832 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:52 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.a"}]: dispatch 2024-03-30T14:04:52.832 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:52 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.c"}]: dispatch 2024-03-30T14:04:52.832 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:52 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.c"}]: dispatch 2024-03-30T14:04:52.832 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:52 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:04:52.832 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:52 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.a"}]: dispatch 2024-03-30T14:04:52.832 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:52 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.a"}]: dispatch 2024-03-30T14:04:52.832 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:52 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.c"}]: dispatch 2024-03-30T14:04:52.832 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:52 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.c"}]: dispatch 2024-03-30T14:04:52.833 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:52 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:04:52.833 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:52 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.a"}]: dispatch 2024-03-30T14:04:52.833 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:52 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.a"}]: dispatch 2024-03-30T14:04:52.833 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:52 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.c"}]: dispatch 2024-03-30T14:04:52.833 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:52 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.c"}]: dispatch 2024-03-30T14:04:52.833 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:52 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:04:52.833 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:52 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.a"}]: dispatch 2024-03-30T14:04:52.833 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:52 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.a"}]: dispatch 2024-03-30T14:04:52.833 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:52 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.c"}]: dispatch 2024-03-30T14:04:52.833 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:52 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.c"}]: dispatch 2024-03-30T14:04:52.834 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:52 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T14:04:52.834 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:52 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:04:52.834 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:52 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:04:52.834 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:52 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:04:52.834 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:52 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:04:52.834 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:52 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:04:52.834 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:52 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:04:52.834 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:52 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.a"}]: dispatch 2024-03-30T14:04:52.834 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:52 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.a"}]: dispatch 2024-03-30T14:04:52.834 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:52 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.a"}]': finished 2024-03-30T14:04:52.834 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:52 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.c"}]: dispatch 2024-03-30T14:04:52.834 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:52 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.c"}]: dispatch 2024-03-30T14:04:52.834 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:52 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.c"}]': finished 2024-03-30T14:04:52.835 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:52 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:04:52.835 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:52 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:04:52.835 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:52 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:04:52.835 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:52 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:04:52.835 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:52 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:04:52.835 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:52 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:04:52.835 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:52 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:04:52.835 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:52 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.a"}]: dispatch 2024-03-30T14:04:52.835 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:52 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.a"}]: dispatch 2024-03-30T14:04:52.835 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:52 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.c"}]: dispatch 2024-03-30T14:04:52.835 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:52 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.c"}]: dispatch 2024-03-30T14:04:52.835 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:52 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:04:52.835 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:52 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:04:52.835 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:52 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:04:52.835 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:52 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:04:52.836 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:52 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:04:52.836 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:52 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:04:52.836 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:52 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:04:52.836 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:52 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.a"}]: dispatch 2024-03-30T14:04:52.836 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:52 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.a"}]: dispatch 2024-03-30T14:04:52.836 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:52 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.c"}]: dispatch 2024-03-30T14:04:52.836 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:52 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.c"}]: dispatch 2024-03-30T14:04:52.836 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:52 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]: dispatch 2024-03-30T14:04:52.836 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:52 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]: dispatch 2024-03-30T14:04:52.837 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:52 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]': finished 2024-03-30T14:04:52.837 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:52 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-03-30T14:04:52.837 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:52 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-03-30T14:04:52.837 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:52 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon"}]': finished 2024-03-30T14:04:52.837 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:52 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]: dispatch 2024-03-30T14:04:52.837 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:52 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]: dispatch 2024-03-30T14:04:52.837 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:52 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]': finished 2024-03-30T14:04:52.837 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:52 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd"}]: dispatch 2024-03-30T14:04:52.837 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:52 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd"}]: dispatch 2024-03-30T14:04:52.837 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:52 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds"}]: dispatch 2024-03-30T14:04:52.837 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:52 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds"}]: dispatch 2024-03-30T14:04:52.837 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:52 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds"}]': finished 2024-03-30T14:04:52.837 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:52 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]: dispatch 2024-03-30T14:04:52.837 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:52 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]: dispatch 2024-03-30T14:04:52.838 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:52 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]: dispatch 2024-03-30T14:04:52.838 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:52 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]: dispatch 2024-03-30T14:04:52.838 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:52 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]': finished 2024-03-30T14:04:52.838 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:52 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-03-30T14:04:52.838 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:52 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-03-30T14:04:52.838 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:52 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"}]: dispatch 2024-03-30T14:04:52.838 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:52 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"}]: dispatch 2024-03-30T14:04:52.838 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:52 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"}]': finished 2024-03-30T14:04:52.838 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:52 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]: dispatch 2024-03-30T14:04:52.838 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:52 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]: dispatch 2024-03-30T14:04:52.838 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:52 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]: dispatch 2024-03-30T14:04:52.838 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:52 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]: dispatch 2024-03-30T14:04:52.838 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:52 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]': finished 2024-03-30T14:04:52.838 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:52 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]: dispatch 2024-03-30T14:04:52.839 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:52 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]: dispatch 2024-03-30T14:04:52.839 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:52 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]': finished 2024-03-30T14:04:52.839 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:52 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-03-30T14:04:52.839 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:52 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-03-30T14:04:52.839 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:52 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-03-30T14:04:52.839 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:52 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-03-30T14:04:52.839 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:52 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-03-30T14:04:52.839 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:52 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-03-30T14:04:52.839 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:52 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-03-30T14:04:52.839 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:52 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-03-30T14:04:52.839 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:52 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-03-30T14:04:52.839 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:52 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-03-30T14:04:52.839 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:52 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:04:52.840 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:52 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.a"}]: dispatch 2024-03-30T14:04:52.840 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:52 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.a"}]: dispatch 2024-03-30T14:04:52.840 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:52 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.c"}]: dispatch 2024-03-30T14:04:52.840 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:52 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.c"}]: dispatch 2024-03-30T14:04:52.840 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:52 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:04:52.840 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:52 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.a"}]: dispatch 2024-03-30T14:04:52.840 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:52 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.a"}]: dispatch 2024-03-30T14:04:52.840 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:52 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.c"}]: dispatch 2024-03-30T14:04:52.840 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:52 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.c"}]: dispatch 2024-03-30T14:04:52.840 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:52 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:04:52.840 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:52 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.a"}]: dispatch 2024-03-30T14:04:52.840 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:52 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.a"}]: dispatch 2024-03-30T14:04:52.840 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:52 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.c"}]: dispatch 2024-03-30T14:04:52.840 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:52 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.c"}]: dispatch 2024-03-30T14:04:52.840 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:52 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:04:52.841 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:52 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.a"}]: dispatch 2024-03-30T14:04:52.841 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:52 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.a"}]: dispatch 2024-03-30T14:04:52.841 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:52 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.c"}]: dispatch 2024-03-30T14:04:52.841 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:52 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.c"}]: dispatch 2024-03-30T14:04:52.841 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:52 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:04:52.841 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:52 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.a"}]: dispatch 2024-03-30T14:04:52.841 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:52 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.a"}]: dispatch 2024-03-30T14:04:52.841 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:52 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.c"}]: dispatch 2024-03-30T14:04:52.841 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:52 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.c"}]: dispatch 2024-03-30T14:04:52.841 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:52 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-03-30T14:04:52.841 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:52 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-03-30T14:04:52.841 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:52 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]: dispatch 2024-03-30T14:04:52.842 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:52 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' cmd=[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]: dispatch 2024-03-30T14:04:52.842 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:52 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' cmd='[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]': finished 2024-03-30T14:04:52.842 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:52 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:04:52.842 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:52 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:04:52.842 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:52 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:04:52.842 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:52 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:04:52.842 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:52 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:04:52.842 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:52 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:04:52.843 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:52 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:04:52.843 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:52 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.a"}]: dispatch 2024-03-30T14:04:52.843 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:52 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.a"}]: dispatch 2024-03-30T14:04:52.843 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:52 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.c"}]: dispatch 2024-03-30T14:04:52.843 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:52 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.c"}]: dispatch 2024-03-30T14:04:52.843 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:52 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]: dispatch 2024-03-30T14:04:52.843 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:52 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]: dispatch 2024-03-30T14:04:52.843 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:52 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]': finished 2024-03-30T14:04:52.843 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:52 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-03-30T14:04:52.843 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:52 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-03-30T14:04:52.843 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:52 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon"}]': finished 2024-03-30T14:04:52.843 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:52 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]: dispatch 2024-03-30T14:04:52.843 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:52 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]: dispatch 2024-03-30T14:04:52.843 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:52 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]': finished 2024-03-30T14:04:52.843 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:52 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd"}]: dispatch 2024-03-30T14:04:52.844 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:52 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd"}]: dispatch 2024-03-30T14:04:52.844 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:52 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds"}]: dispatch 2024-03-30T14:04:52.844 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:52 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds"}]: dispatch 2024-03-30T14:04:52.844 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:52 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds"}]': finished 2024-03-30T14:04:52.844 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:52 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]: dispatch 2024-03-30T14:04:52.844 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:52 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]: dispatch 2024-03-30T14:04:52.844 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:52 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]: dispatch 2024-03-30T14:04:52.844 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:52 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]: dispatch 2024-03-30T14:04:52.844 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:52 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]': finished 2024-03-30T14:04:52.844 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:52 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-03-30T14:04:52.844 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:52 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-03-30T14:04:52.844 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:52 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"}]: dispatch 2024-03-30T14:04:52.844 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:52 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"}]: dispatch 2024-03-30T14:04:52.844 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:52 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"}]': finished 2024-03-30T14:04:52.845 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:52 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]: dispatch 2024-03-30T14:04:52.845 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:52 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]: dispatch 2024-03-30T14:04:52.845 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:52 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]: dispatch 2024-03-30T14:04:52.845 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:52 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]: dispatch 2024-03-30T14:04:52.845 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:52 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]': finished 2024-03-30T14:04:52.845 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:52 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]: dispatch 2024-03-30T14:04:52.845 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:52 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]: dispatch 2024-03-30T14:04:52.845 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:52 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]': finished 2024-03-30T14:04:52.845 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:52 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-03-30T14:04:52.845 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:52 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-03-30T14:04:52.845 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:52 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-03-30T14:04:52.845 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:52 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-03-30T14:04:52.845 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:52 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-03-30T14:04:52.845 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:52 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-03-30T14:04:52.845 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:52 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-03-30T14:04:52.846 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:52 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-03-30T14:04:52.846 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:52 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-03-30T14:04:52.846 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:52 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-03-30T14:04:52.846 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:52 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-03-30T14:04:52.846 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:52 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-03-30T14:04:52.846 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:52 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]: dispatch 2024-03-30T14:04:52.846 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:52 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' cmd=[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]: dispatch 2024-03-30T14:04:52.846 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:52 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' cmd='[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]': finished 2024-03-30T14:04:52.846 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:52 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:04:52.846 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:52 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:04:52.846 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:52 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:04:52.846 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:52 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:04:52.846 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:52 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:04:52.846 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:52 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:04:52.998 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:52 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T14:04:52.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:52 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:04:52.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:52 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:04:52.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:52 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:04:52.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:52 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:04:52.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:52 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:04:52.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:52 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:04:52.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:52 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.a"}]: dispatch 2024-03-30T14:04:52.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:52 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.a"}]: dispatch 2024-03-30T14:04:52.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:52 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.a"}]': finished 2024-03-30T14:04:52.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:52 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.c"}]: dispatch 2024-03-30T14:04:52.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:52 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.c"}]: dispatch 2024-03-30T14:04:52.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:52 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.c"}]': finished 2024-03-30T14:04:52.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:52 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:04:52.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:52 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:04:53.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:52 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:04:53.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:52 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:04:53.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:52 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:04:53.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:52 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:04:53.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:52 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:04:53.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:52 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.a"}]: dispatch 2024-03-30T14:04:53.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:52 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.a"}]: dispatch 2024-03-30T14:04:53.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:52 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.c"}]: dispatch 2024-03-30T14:04:53.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:52 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.c"}]: dispatch 2024-03-30T14:04:53.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:52 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:04:53.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:52 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:04:53.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:52 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:04:53.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:52 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:04:53.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:52 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:04:53.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:52 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:04:53.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:52 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:04:53.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:52 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.a"}]: dispatch 2024-03-30T14:04:53.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:52 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.a"}]: dispatch 2024-03-30T14:04:53.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:52 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.c"}]: dispatch 2024-03-30T14:04:53.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:52 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.c"}]: dispatch 2024-03-30T14:04:53.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:52 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:04:53.002 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:52 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.a"}]: dispatch 2024-03-30T14:04:53.002 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:52 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.a"}]: dispatch 2024-03-30T14:04:53.002 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:52 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.c"}]: dispatch 2024-03-30T14:04:53.002 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:52 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.c"}]: dispatch 2024-03-30T14:04:53.002 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:52 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:04:53.002 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:52 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.a"}]: dispatch 2024-03-30T14:04:53.002 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:52 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.a"}]: dispatch 2024-03-30T14:04:53.002 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:52 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.c"}]: dispatch 2024-03-30T14:04:53.002 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:52 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.c"}]: dispatch 2024-03-30T14:04:53.002 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:52 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:04:53.002 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:52 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.a"}]: dispatch 2024-03-30T14:04:53.002 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:52 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.a"}]: dispatch 2024-03-30T14:04:53.002 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:52 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.c"}]: dispatch 2024-03-30T14:04:53.002 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:52 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.c"}]: dispatch 2024-03-30T14:04:53.003 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:52 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:04:53.003 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:52 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.a"}]: dispatch 2024-03-30T14:04:53.003 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:52 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.a"}]: dispatch 2024-03-30T14:04:53.003 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:52 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.c"}]: dispatch 2024-03-30T14:04:53.003 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:52 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.c"}]: dispatch 2024-03-30T14:04:53.003 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:52 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:04:53.003 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:52 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.a"}]: dispatch 2024-03-30T14:04:53.003 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:52 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.a"}]: dispatch 2024-03-30T14:04:53.003 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:52 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.c"}]: dispatch 2024-03-30T14:04:53.003 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:52 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.c"}]: dispatch 2024-03-30T14:04:53.003 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:52 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]: dispatch 2024-03-30T14:04:53.003 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:52 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]: dispatch 2024-03-30T14:04:53.003 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:52 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]': finished 2024-03-30T14:04:53.003 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:52 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-03-30T14:04:53.003 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:52 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-03-30T14:04:53.004 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:52 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon"}]': finished 2024-03-30T14:04:53.004 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:52 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]: dispatch 2024-03-30T14:04:53.004 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:52 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]: dispatch 2024-03-30T14:04:53.004 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:52 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]': finished 2024-03-30T14:04:53.004 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:52 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd"}]: dispatch 2024-03-30T14:04:53.004 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:52 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd"}]: dispatch 2024-03-30T14:04:53.004 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:52 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds"}]: dispatch 2024-03-30T14:04:53.004 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:52 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds"}]: dispatch 2024-03-30T14:04:53.004 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:52 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds"}]': finished 2024-03-30T14:04:53.004 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:52 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]: dispatch 2024-03-30T14:04:53.004 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:52 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]: dispatch 2024-03-30T14:04:53.004 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:52 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]: dispatch 2024-03-30T14:04:53.004 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:52 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]: dispatch 2024-03-30T14:04:53.004 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:52 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]': finished 2024-03-30T14:04:53.004 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:52 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-03-30T14:04:53.004 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:52 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-03-30T14:04:53.005 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:52 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"}]: dispatch 2024-03-30T14:04:53.005 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:52 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"}]: dispatch 2024-03-30T14:04:53.005 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:52 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"}]': finished 2024-03-30T14:04:53.005 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:52 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]: dispatch 2024-03-30T14:04:53.005 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:52 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]: dispatch 2024-03-30T14:04:53.005 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:52 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]: dispatch 2024-03-30T14:04:53.005 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:52 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]: dispatch 2024-03-30T14:04:53.005 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:52 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]': finished 2024-03-30T14:04:53.005 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:52 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]: dispatch 2024-03-30T14:04:53.005 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:52 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]: dispatch 2024-03-30T14:04:53.005 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:52 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]': finished 2024-03-30T14:04:53.005 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:52 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-03-30T14:04:53.005 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:52 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-03-30T14:04:53.005 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:52 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-03-30T14:04:53.005 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:52 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-03-30T14:04:53.006 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:52 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-03-30T14:04:53.006 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:52 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-03-30T14:04:53.006 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:52 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-03-30T14:04:53.006 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:52 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-03-30T14:04:53.006 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:52 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-03-30T14:04:53.006 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:52 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-03-30T14:04:53.006 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:52 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-03-30T14:04:53.006 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:52 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-03-30T14:04:53.006 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:52 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]: dispatch 2024-03-30T14:04:53.006 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:52 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' cmd=[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]: dispatch 2024-03-30T14:04:53.006 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:52 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' cmd='[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]': finished 2024-03-30T14:04:53.006 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:52 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:04:53.006 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:52 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:04:53.006 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:52 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:04:53.006 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:52 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:04:53.007 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:52 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:04:53.007 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:52 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:04:53.772 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:53 smithi099 ceph-mon[137093]: Upgrade: Setting container_image for all mon 2024-03-30T14:04:53.773 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:53 smithi099 ceph-mon[137093]: Upgrade: Setting container_image for all crash 2024-03-30T14:04:53.773 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:53 smithi099 ceph-mon[137093]: Upgrade: Setting container_image for all mds 2024-03-30T14:04:53.773 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:53 smithi099 ceph-mon[137093]: Upgrade: Setting container_image for all rbd-mirror 2024-03-30T14:04:53.773 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:53 smithi099 ceph-mon[137093]: Upgrade: Setting container_image for all cephfs-mirror 2024-03-30T14:04:53.773 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:53 smithi099 ceph-mon[137093]: Upgrade: Setting container_image for all ceph-exporter 2024-03-30T14:04:53.773 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:53 smithi099 ceph-mon[137093]: Upgrade: Setting container_image for all nfs 2024-03-30T14:04:53.773 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:53 smithi099 ceph-mon[137093]: Upgrade: Setting container_image for all nvmeof 2024-03-30T14:04:53.773 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:53 smithi099 ceph-mon[137093]: Upgrade: Setting container_image for all node-exporter 2024-03-30T14:04:53.773 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:53 smithi099 ceph-mon[137093]: Upgrade: Setting container_image for all prometheus 2024-03-30T14:04:53.773 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:53 smithi099 ceph-mon[137093]: Upgrade: Setting container_image for all alertmanager 2024-03-30T14:04:53.773 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:53 smithi099 ceph-mon[137093]: Upgrade: Setting container_image for all grafana 2024-03-30T14:04:53.773 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:53 smithi099 ceph-mon[137093]: Upgrade: Setting container_image for all loki 2024-03-30T14:04:53.773 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:53 smithi099 ceph-mon[137093]: Upgrade: Setting container_image for all promtail 2024-03-30T14:04:53.773 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:53 smithi099 ceph-mon[137093]: Upgrade: Finalizing container_image settings 2024-03-30T14:04:53.774 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:53 smithi099 ceph-mon[137093]: Upgrade: Complete! 2024-03-30T14:04:53.774 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:53 smithi099 ceph-mon[137093]: pgmap v41: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T14:04:53.774 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:53 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:04:53.774 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:53 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:04:53.774 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:53 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:04:53.774 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:53 smithi099 ceph-mon[143401]: Upgrade: Setting container_image for all mon 2024-03-30T14:04:53.774 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:53 smithi099 ceph-mon[143401]: Upgrade: Setting container_image for all crash 2024-03-30T14:04:53.774 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:53 smithi099 ceph-mon[143401]: Upgrade: Setting container_image for all mds 2024-03-30T14:04:53.774 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:53 smithi099 ceph-mon[143401]: Upgrade: Setting container_image for all rbd-mirror 2024-03-30T14:04:53.774 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:53 smithi099 ceph-mon[143401]: Upgrade: Setting container_image for all cephfs-mirror 2024-03-30T14:04:53.774 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:53 smithi099 ceph-mon[143401]: Upgrade: Setting container_image for all ceph-exporter 2024-03-30T14:04:53.774 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:53 smithi099 ceph-mon[143401]: Upgrade: Setting container_image for all nfs 2024-03-30T14:04:53.774 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:53 smithi099 ceph-mon[143401]: Upgrade: Setting container_image for all nvmeof 2024-03-30T14:04:53.775 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:53 smithi099 ceph-mon[143401]: Upgrade: Setting container_image for all node-exporter 2024-03-30T14:04:53.775 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:53 smithi099 ceph-mon[143401]: Upgrade: Setting container_image for all prometheus 2024-03-30T14:04:53.775 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:53 smithi099 ceph-mon[143401]: Upgrade: Setting container_image for all alertmanager 2024-03-30T14:04:53.775 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:53 smithi099 ceph-mon[143401]: Upgrade: Setting container_image for all grafana 2024-03-30T14:04:53.775 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:53 smithi099 ceph-mon[143401]: Upgrade: Setting container_image for all loki 2024-03-30T14:04:53.775 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:53 smithi099 ceph-mon[143401]: Upgrade: Setting container_image for all promtail 2024-03-30T14:04:53.775 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:53 smithi099 ceph-mon[143401]: Upgrade: Finalizing container_image settings 2024-03-30T14:04:53.775 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:53 smithi099 ceph-mon[143401]: Upgrade: Complete! 2024-03-30T14:04:53.775 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:53 smithi099 ceph-mon[143401]: pgmap v41: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T14:04:53.775 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:53 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:04:53.775 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:53 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:04:53.775 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:53 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:04:53.998 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:53 smithi181 ceph-mon[115276]: Upgrade: Setting container_image for all mon 2024-03-30T14:04:53.998 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:53 smithi181 ceph-mon[115276]: Upgrade: Setting container_image for all crash 2024-03-30T14:04:53.998 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:53 smithi181 ceph-mon[115276]: Upgrade: Setting container_image for all mds 2024-03-30T14:04:53.998 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:53 smithi181 ceph-mon[115276]: Upgrade: Setting container_image for all rbd-mirror 2024-03-30T14:04:53.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:53 smithi181 ceph-mon[115276]: Upgrade: Setting container_image for all cephfs-mirror 2024-03-30T14:04:53.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:53 smithi181 ceph-mon[115276]: Upgrade: Setting container_image for all ceph-exporter 2024-03-30T14:04:53.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:53 smithi181 ceph-mon[115276]: Upgrade: Setting container_image for all nfs 2024-03-30T14:04:53.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:53 smithi181 ceph-mon[115276]: Upgrade: Setting container_image for all nvmeof 2024-03-30T14:04:53.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:53 smithi181 ceph-mon[115276]: Upgrade: Setting container_image for all node-exporter 2024-03-30T14:04:53.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:53 smithi181 ceph-mon[115276]: Upgrade: Setting container_image for all prometheus 2024-03-30T14:04:53.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:53 smithi181 ceph-mon[115276]: Upgrade: Setting container_image for all alertmanager 2024-03-30T14:04:53.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:53 smithi181 ceph-mon[115276]: Upgrade: Setting container_image for all grafana 2024-03-30T14:04:53.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:53 smithi181 ceph-mon[115276]: Upgrade: Setting container_image for all loki 2024-03-30T14:04:53.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:53 smithi181 ceph-mon[115276]: Upgrade: Setting container_image for all promtail 2024-03-30T14:04:53.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:53 smithi181 ceph-mon[115276]: Upgrade: Finalizing container_image settings 2024-03-30T14:04:53.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:53 smithi181 ceph-mon[115276]: Upgrade: Complete! 2024-03-30T14:04:53.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:53 smithi181 ceph-mon[115276]: pgmap v41: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T14:04:53.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:53 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:04:53.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:53 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:04:53.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:53 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:04:55.079 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:54 smithi099 ceph-mon[137093]: pgmap v42: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T14:04:55.079 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:54 smithi099 ceph-mon[143401]: pgmap v42: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T14:04:55.080 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 14:04:54 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[71049]: ::ffff:172.21.15.181 - - [30/Mar/2024:14:04:54] "GET /metrics HTTP/1.1" 200 38017 "" "Prometheus/2.43.0" 2024-03-30T14:04:55.248 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:54 smithi181 ceph-mon[115276]: pgmap v42: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T14:04:57.079 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:56 smithi099 ceph-mon[137093]: pgmap v43: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T14:04:57.079 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:56 smithi099 ceph-mon[143401]: pgmap v43: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T14:04:57.248 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:56 smithi181 ceph-mon[115276]: pgmap v43: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T14:04:57.586 DEBUG:teuthology.orchestra.run.smithi099:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 98ebaeb8-ee99-11ee-b647-cb9ed24678a4 -e sha1=4e50bbcdd1630c7760b708f3a5b4d38a121e66cb -- bash -c 'ceph orch ps' 2024-03-30T14:04:57.829 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:57 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:04:57.829 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:57 smithi099 ceph-mon[137093]: from='client.64132 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T14:04:57.829 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:57 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:04:57.829 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:57 smithi099 ceph-mon[143401]: from='client.64132 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T14:04:58.248 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:57 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:04:58.248 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:57 smithi181 ceph-mon[115276]: from='client.64132 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T14:04:58.902 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:58 smithi099 ceph-mon[137093]: from='client.25136 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T14:04:58.903 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:58 smithi099 ceph-mon[137093]: pgmap v44: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T14:04:58.903 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:58 smithi099 ceph-mon[143401]: from='client.25136 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T14:04:58.903 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:58 smithi099 ceph-mon[143401]: pgmap v44: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T14:04:59.248 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:58 smithi181 ceph-mon[115276]: from='client.25136 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T14:04:59.248 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:58 smithi181 ceph-mon[115276]: pgmap v44: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T14:04:59.636 INFO:teuthology.orchestra.run.smithi099.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-03-30T14:04:59.637 INFO:teuthology.orchestra.run.smithi099.stdout:agent.smithi099 smithi099 running 6s ago 33m - - 2024-03-30T14:04:59.637 INFO:teuthology.orchestra.run.smithi099.stdout:agent.smithi181 smithi181 running 12s ago 33m - - 2024-03-30T14:04:59.637 INFO:teuthology.orchestra.run.smithi099.stdout:alertmanager.a smithi099 *:9093,9094 running (3m) 6s ago 27m 25.6M - 0.25.0 c8568f914cd2 08735152b67d 2024-03-30T14:04:59.637 INFO:teuthology.orchestra.run.smithi099.stdout:grafana.a smithi181 *:3000 running (3m) 12s ago 27m 78.6M - 9.4.12 2bacad6d85d8 d599aa7730d6 2024-03-30T14:04:59.637 INFO:teuthology.orchestra.run.smithi099.stdout:iscsi.foo.smithi099.qyjuvr smithi099 running (6m) 6s ago 26m 59.5M - 3.5 e1d6a67b021e 2f859af6bc2a 2024-03-30T14:04:59.637 INFO:teuthology.orchestra.run.smithi099.stdout:mgr.x smithi181 *:8443,9283,8765 running (5m) 12s ago 32m 449M - 19.0.0-1967-g4e50bbcd b0c4478f1d83 f269106f7913 2024-03-30T14:04:59.637 INFO:teuthology.orchestra.run.smithi099.stdout:mgr.y smithi099 *:8443,9283,8765 running (16m) 6s ago 34m 510M - 19.0.0-1967-g4e50bbcd b0c4478f1d83 0d464b8c1d18 2024-03-30T14:04:59.637 INFO:teuthology.orchestra.run.smithi099.stdout:mon.a smithi099 running (65s) 6s ago 34m 43.2M 2048M 19.0.0-1967-g4e50bbcd b0c4478f1d83 f19388464dfd 2024-03-30T14:04:59.637 INFO:teuthology.orchestra.run.smithi099.stdout:mon.b smithi181 running (2m) 12s ago 32m 43.9M 2048M 19.0.0-1967-g4e50bbcd b0c4478f1d83 0468ed087cdd 2024-03-30T14:04:59.637 INFO:teuthology.orchestra.run.smithi099.stdout:mon.c smithi099 running (42s) 6s ago 32m 35.3M 2048M 19.0.0-1967-g4e50bbcd b0c4478f1d83 731056a2fea6 2024-03-30T14:04:59.637 INFO:teuthology.orchestra.run.smithi099.stdout:node-exporter.a smithi099 *:9100 running (4m) 6s ago 28m 16.6M - 1.5.0 0da6a335fe13 4a3f1f6e7068 2024-03-30T14:04:59.637 INFO:teuthology.orchestra.run.smithi099.stdout:node-exporter.b smithi181 *:9100 running (4m) 12s ago 28m 15.6M - 1.5.0 0da6a335fe13 acea317b5f5d 2024-03-30T14:04:59.637 INFO:teuthology.orchestra.run.smithi099.stdout:osd.0 smithi099 running (32m) 6s ago 32m 53.9M 4096M 17.2.0 e1d6a67b021e 3158ee1b0c67 2024-03-30T14:04:59.638 INFO:teuthology.orchestra.run.smithi099.stdout:osd.1 smithi099 running (31m) 6s ago 31m 58.3M 4096M 17.2.0 e1d6a67b021e c4af0fd7071a 2024-03-30T14:04:59.638 INFO:teuthology.orchestra.run.smithi099.stdout:osd.2 smithi099 running (31m) 6s ago 31m 49.9M 4096M 17.2.0 e1d6a67b021e 8e4e805a7e20 2024-03-30T14:04:59.638 INFO:teuthology.orchestra.run.smithi099.stdout:osd.3 smithi099 running (30m) 6s ago 30m 54.0M 4096M 17.2.0 e1d6a67b021e 718812bcf065 2024-03-30T14:04:59.638 INFO:teuthology.orchestra.run.smithi099.stdout:osd.4 smithi181 running (30m) 12s ago 30m 55.5M 4096M 17.2.0 e1d6a67b021e 5e205434e973 2024-03-30T14:04:59.638 INFO:teuthology.orchestra.run.smithi099.stdout:osd.5 smithi181 running (30m) 12s ago 30m 53.0M 4096M 17.2.0 e1d6a67b021e e330c920f152 2024-03-30T14:04:59.638 INFO:teuthology.orchestra.run.smithi099.stdout:osd.6 smithi181 running (29m) 12s ago 29m 52.8M 4096M 17.2.0 e1d6a67b021e 81d889ea213d 2024-03-30T14:04:59.638 INFO:teuthology.orchestra.run.smithi099.stdout:osd.7 smithi181 running (29m) 12s ago 29m 53.3M 4096M 17.2.0 e1d6a67b021e c08b1839dd7e 2024-03-30T14:04:59.638 INFO:teuthology.orchestra.run.smithi099.stdout:prometheus.a smithi181 *:9095 running (4m) 12s ago 28m 70.3M - 2.43.0 a07b618ecd1d 004088bdf70e 2024-03-30T14:04:59.638 INFO:teuthology.orchestra.run.smithi099.stdout:rgw.foo.smithi099.fxjbmp smithi099 *:8000 running (26m) 6s ago 26m 77.7M - 17.2.0 e1d6a67b021e 400b28b3f650 2024-03-30T14:04:59.638 INFO:teuthology.orchestra.run.smithi099.stdout:rgw.foo.smithi181.wfqwti smithi181 *:8000 running (26m) 12s ago 26m 77.4M - 17.2.0 e1d6a67b021e 97e1b130f9d4 2024-03-30T14:04:59.984 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:04:59 smithi099 ceph-mon[137093]: from='client.54138 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T14:04:59.984 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:04:59 smithi099 ceph-mon[143401]: from='client.54138 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T14:05:00.248 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:04:59 smithi181 ceph-mon[115276]: from='client.54138 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T14:05:00.392 DEBUG:teuthology.orchestra.run.smithi099:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 98ebaeb8-ee99-11ee-b647-cb9ed24678a4 -e sha1=4e50bbcdd1630c7760b708f3a5b4d38a121e66cb -- bash -c 'ceph versions | jq -e '"'"'.mon | length == 1'"'"'' 2024-03-30T14:05:00.998 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:00 smithi181 ceph-mon[115276]: pgmap v45: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T14:05:01.021 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:00 smithi099 ceph-mon[137093]: pgmap v45: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T14:05:01.021 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:00 smithi099 ceph-mon[143401]: pgmap v45: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T14:05:02.546 INFO:teuthology.orchestra.run.smithi099.stdout:true 2024-03-30T14:05:02.829 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:02 smithi099 ceph-mon[137093]: from='client.? 172.21.15.99:0/1007356386' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:05:02.829 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:02 smithi099 ceph-mon[143401]: from='client.? 172.21.15.99:0/1007356386' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:05:02.998 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:02 smithi181 ceph-mon[115276]: from='client.? 172.21.15.99:0/1007356386' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:05:03.264 DEBUG:teuthology.orchestra.run.smithi099:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 98ebaeb8-ee99-11ee-b647-cb9ed24678a4 -e sha1=4e50bbcdd1630c7760b708f3a5b4d38a121e66cb -- bash -c 'ceph versions | jq -e '"'"'.mon | keys'"'"' | grep $sha1' 2024-03-30T14:05:03.829 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:03 smithi099 ceph-mon[137093]: pgmap v46: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T14:05:03.829 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:03 smithi099 ceph-mon[143401]: pgmap v46: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T14:05:03.998 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:03 smithi181 ceph-mon[115276]: pgmap v46: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T14:05:05.028 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:04 smithi181 ceph-mon[115276]: pgmap v47: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T14:05:05.079 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:04 smithi099 ceph-mon[137093]: pgmap v47: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T14:05:05.079 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:04 smithi099 ceph-mon[143401]: pgmap v47: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T14:05:05.079 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 14:05:04 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[71049]: ::ffff:172.21.15.181 - - [30/Mar/2024:14:05:04] "GET /metrics HTTP/1.1" 200 38017 "" "Prometheus/2.43.0" 2024-03-30T14:05:05.233 INFO:teuthology.orchestra.run.smithi099.stdout: "ceph version 19.0.0-1967-g4e50bbcd (4e50bbcdd1630c7760b708f3a5b4d38a121e66cb) squid (dev)" 2024-03-30T14:05:05.924 DEBUG:teuthology.orchestra.run.smithi099:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 98ebaeb8-ee99-11ee-b647-cb9ed24678a4 -e sha1=4e50bbcdd1630c7760b708f3a5b4d38a121e66cb -- bash -c 'ceph orch upgrade check quay.ceph.io/ceph-ci/ceph:$sha1 | jq -e '"'"'.up_to_date | length == 5'"'"'' 2024-03-30T14:05:05.998 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:05 smithi181 ceph-mon[115276]: from='client.? 172.21.15.99:0/2545170258' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:05:06.079 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:05 smithi099 ceph-mon[137093]: from='client.? 172.21.15.99:0/2545170258' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:05:06.079 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:05 smithi099 ceph-mon[143401]: from='client.? 172.21.15.99:0/2545170258' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:05:07.079 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:06 smithi099 ceph-mon[143401]: pgmap v48: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T14:05:07.079 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:06 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T14:05:07.079 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:06 smithi099 ceph-mon[137093]: pgmap v48: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T14:05:07.079 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:06 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T14:05:07.147 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:06 smithi181 ceph-mon[115276]: pgmap v48: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T14:05:07.147 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:06 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T14:05:08.759 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:08 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:05:08.759 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:08 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:05:08.759 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:08 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:05:08.760 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:08 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:05:08.760 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:08 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:05:08.760 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:08 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:05:08.998 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:08 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:05:08.998 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:08 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:05:08.998 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:08 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:05:09.690 INFO:teuthology.orchestra.run.smithi099.stdout:true 2024-03-30T14:05:09.829 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:09 smithi099 ceph-mon[137093]: from='client.25136 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T14:05:09.829 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:09 smithi099 ceph-mon[137093]: from='client.54156 -' entity='client.admin' cmd=[{"prefix": "orch upgrade check", "image": "quay.ceph.io/ceph-ci/ceph:4e50bbcdd1630c7760b708f3a5b4d38a121e66cb", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T14:05:09.829 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:09 smithi099 ceph-mon[137093]: pgmap v49: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T14:05:09.829 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:09 smithi099 ceph-mon[143401]: from='client.25136 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T14:05:09.829 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:09 smithi099 ceph-mon[143401]: from='client.54156 -' entity='client.admin' cmd=[{"prefix": "orch upgrade check", "image": "quay.ceph.io/ceph-ci/ceph:4e50bbcdd1630c7760b708f3a5b4d38a121e66cb", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T14:05:09.829 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:09 smithi099 ceph-mon[143401]: pgmap v49: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T14:05:09.998 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:09 smithi181 ceph-mon[115276]: from='client.25136 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T14:05:09.998 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:09 smithi181 ceph-mon[115276]: from='client.54156 -' entity='client.admin' cmd=[{"prefix": "orch upgrade check", "image": "quay.ceph.io/ceph-ci/ceph:4e50bbcdd1630c7760b708f3a5b4d38a121e66cb", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T14:05:09.998 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:09 smithi181 ceph-mon[115276]: pgmap v49: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T14:05:10.453 DEBUG:teuthology.orchestra.run.smithi099:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 98ebaeb8-ee99-11ee-b647-cb9ed24678a4 -e sha1=4e50bbcdd1630c7760b708f3a5b4d38a121e66cb -- bash -c 'ceph orch upgrade status' 2024-03-30T14:05:11.079 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:10 smithi099 ceph-mon[143401]: pgmap v50: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T14:05:11.079 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:10 smithi099 ceph-mon[137093]: pgmap v50: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T14:05:11.248 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:10 smithi181 ceph-mon[115276]: pgmap v50: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T14:05:12.829 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:12 smithi099 ceph-mon[143401]: pgmap v51: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T14:05:12.829 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:12 smithi099 ceph-mon[137093]: pgmap v51: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T14:05:13.248 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:12 smithi181 ceph-mon[115276]: pgmap v51: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T14:05:13.443 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-03-30T14:05:13.443 INFO:teuthology.orchestra.run.smithi099.stdout: "target_image": null, 2024-03-30T14:05:13.443 INFO:teuthology.orchestra.run.smithi099.stdout: "in_progress": false, 2024-03-30T14:05:13.443 INFO:teuthology.orchestra.run.smithi099.stdout: "which": "", 2024-03-30T14:05:13.444 INFO:teuthology.orchestra.run.smithi099.stdout: "services_complete": [], 2024-03-30T14:05:13.444 INFO:teuthology.orchestra.run.smithi099.stdout: "progress": null, 2024-03-30T14:05:13.444 INFO:teuthology.orchestra.run.smithi099.stdout: "message": "", 2024-03-30T14:05:13.444 INFO:teuthology.orchestra.run.smithi099.stdout: "is_paused": false 2024-03-30T14:05:13.444 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-03-30T14:05:14.006 DEBUG:teuthology.orchestra.run.smithi099:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 98ebaeb8-ee99-11ee-b647-cb9ed24678a4 -e sha1=4e50bbcdd1630c7760b708f3a5b4d38a121e66cb -- bash -c 'ceph health detail' 2024-03-30T14:05:14.498 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:14 smithi181 ceph-mon[115276]: from='client.54162 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T14:05:14.498 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:14 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:05:14.498 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:14 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:05:14.498 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:14 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:05:14.533 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:14 smithi099 ceph-mon[137093]: from='client.54162 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T14:05:14.533 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:14 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:05:14.533 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:14 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:05:14.533 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:14 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:05:14.534 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:14 smithi099 ceph-mon[143401]: from='client.54162 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T14:05:14.534 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:14 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:05:14.534 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:14 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:05:14.534 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:14 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:05:15.045 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 14:05:14 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[71049]: ::ffff:172.21.15.181 - - [30/Mar/2024:14:05:14] "GET /metrics HTTP/1.1" 200 38012 "" "Prometheus/2.43.0" 2024-03-30T14:05:15.329 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:15 smithi099 ceph-mon[143401]: pgmap v52: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T14:05:15.329 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:15 smithi099 ceph-mon[137093]: pgmap v52: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T14:05:15.748 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:15 smithi181 ceph-mon[115276]: pgmap v52: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T14:05:16.829 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:16 smithi099 ceph-mon[137093]: pgmap v53: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T14:05:16.829 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:16 smithi099 ceph-mon[143401]: pgmap v53: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T14:05:17.074 INFO:teuthology.orchestra.run.smithi099.stdout:HEALTH_OK 2024-03-30T14:05:17.248 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:16 smithi181 ceph-mon[115276]: pgmap v53: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T14:05:17.633 DEBUG:teuthology.orchestra.run.smithi099:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 98ebaeb8-ee99-11ee-b647-cb9ed24678a4 -e sha1=4e50bbcdd1630c7760b708f3a5b4d38a121e66cb -- bash -c 'ceph orch upgrade start --image quay.ceph.io/ceph-ci/ceph:$sha1 --daemon-types osd --limit 2' 2024-03-30T14:05:18.058 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:17 smithi099 ceph-mon[137093]: from='client.? 172.21.15.99:0/752355700' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-03-30T14:05:18.058 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:17 smithi099 ceph-mon[143401]: from='client.? 172.21.15.99:0/752355700' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-03-30T14:05:18.248 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:17 smithi181 ceph-mon[115276]: from='client.? 172.21.15.99:0/752355700' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-03-30T14:05:18.939 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:18 smithi099 ceph-mon[137093]: from='client.25136 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T14:05:18.939 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:18 smithi099 ceph-mon[137093]: pgmap v54: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T14:05:18.939 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:18 smithi099 ceph-mon[143401]: from='client.25136 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T14:05:18.939 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:18 smithi099 ceph-mon[143401]: pgmap v54: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T14:05:19.149 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:18 smithi181 ceph-mon[115276]: from='client.25136 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T14:05:19.149 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:18 smithi181 ceph-mon[115276]: pgmap v54: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T14:05:19.998 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:19 smithi181 ceph-mon[115276]: from='client.64174 -' entity='client.admin' cmd=[{"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:4e50bbcdd1630c7760b708f3a5b4d38a121e66cb", "daemon_types": "osd", "limit": 2, "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T14:05:20.079 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:19 smithi099 ceph-mon[137093]: from='client.64174 -' entity='client.admin' cmd=[{"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:4e50bbcdd1630c7760b708f3a5b4d38a121e66cb", "daemon_types": "osd", "limit": 2, "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T14:05:20.079 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:19 smithi099 ceph-mon[143401]: from='client.64174 -' entity='client.admin' cmd=[{"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:4e50bbcdd1630c7760b708f3a5b4d38a121e66cb", "daemon_types": "osd", "limit": 2, "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T14:05:21.079 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:20 smithi099 ceph-mon[137093]: pgmap v55: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 767 B/s rd, 0 op/s 2024-03-30T14:05:21.079 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:20 smithi099 ceph-mon[143401]: pgmap v55: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 767 B/s rd, 0 op/s 2024-03-30T14:05:21.248 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:20 smithi181 ceph-mon[115276]: pgmap v55: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 767 B/s rd, 0 op/s 2024-03-30T14:05:21.283 INFO:teuthology.orchestra.run.smithi099.stdout:Initiating upgrade to quay.ceph.io/ceph-ci/ceph:4e50bbcdd1630c7760b708f3a5b4d38a121e66cb 2024-03-30T14:05:22.095 DEBUG:teuthology.orchestra.run.smithi099:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 98ebaeb8-ee99-11ee-b647-cb9ed24678a4 -e sha1=4e50bbcdd1630c7760b708f3a5b4d38a121e66cb -- bash -c 'while ceph orch upgrade status | jq '"'"'.in_progress'"'"' | grep true && ! ceph orch upgrade status | jq '"'"'.message'"'"' | grep Error ; do ceph orch ps ; ceph versions ; ceph orch upgrade status ; sleep 30 ; done' 2024-03-30T14:05:22.329 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:22 smithi099 ceph-mon[137093]: Upgrade: Started with target quay.ceph.io/ceph-ci/ceph:4e50bbcdd1630c7760b708f3a5b4d38a121e66cb 2024-03-30T14:05:22.329 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:22 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:05:22.329 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:22 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:05:22.329 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:22 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:05:22.329 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:22 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:05:22.329 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:22 smithi099 ceph-mon[137093]: Upgrade: First pull of quay.ceph.io/ceph-ci/ceph:4e50bbcdd1630c7760b708f3a5b4d38a121e66cb 2024-03-30T14:05:22.329 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:22 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T14:05:22.330 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:22 smithi099 ceph-mon[143401]: Upgrade: Started with target quay.ceph.io/ceph-ci/ceph:4e50bbcdd1630c7760b708f3a5b4d38a121e66cb 2024-03-30T14:05:22.330 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:22 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:05:22.330 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:22 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:05:22.330 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:22 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:05:22.330 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:22 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:05:22.330 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:22 smithi099 ceph-mon[143401]: Upgrade: First pull of quay.ceph.io/ceph-ci/ceph:4e50bbcdd1630c7760b708f3a5b4d38a121e66cb 2024-03-30T14:05:22.330 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:22 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T14:05:22.748 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:22 smithi181 ceph-mon[115276]: Upgrade: Started with target quay.ceph.io/ceph-ci/ceph:4e50bbcdd1630c7760b708f3a5b4d38a121e66cb 2024-03-30T14:05:22.748 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:22 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:05:22.748 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:22 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:05:22.748 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:22 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:05:22.748 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:22 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:05:22.748 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:22 smithi181 ceph-mon[115276]: Upgrade: First pull of quay.ceph.io/ceph-ci/ceph:4e50bbcdd1630c7760b708f3a5b4d38a121e66cb 2024-03-30T14:05:22.748 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:22 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T14:05:23.553 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:23 smithi099 ceph-mon[137093]: pgmap v56: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T14:05:23.553 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:23 smithi099 ceph-mon[143401]: pgmap v56: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T14:05:23.748 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:23 smithi181 ceph-mon[115276]: pgmap v56: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T14:05:24.428 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:24 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:05:24.428 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:24 smithi099 ceph-mon[143401]: Upgrade: Target is version 19.0.0-1967-g4e50bbcd (squid) 2024-03-30T14:05:24.428 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:24 smithi099 ceph-mon[143401]: Upgrade: Target container is quay.ceph.io/ceph-ci/ceph:4e50bbcdd1630c7760b708f3a5b4d38a121e66cb, digests ['quay.ceph.io/ceph-ci/ceph@sha256:8f3809717761e681477c3ef1d8d2c03114aee2c597cd7380b93b8c10f47fcb5d'] 2024-03-30T14:05:24.428 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:24 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:05:24.428 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:24 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:05:24.428 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:24 smithi099 ceph-mon[143401]: Upgrade: Setting container_image for all mgr 2024-03-30T14:05:24.429 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:24 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:05:24.429 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:24 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:05:24.429 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:24 smithi099 ceph-mon[143401]: Upgrade: Setting container_image for all mon 2024-03-30T14:05:24.429 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:24 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:05:24.429 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:24 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:05:24.429 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:24 smithi099 ceph-mon[143401]: Upgrade: Setting container_image for all crash 2024-03-30T14:05:24.429 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:24 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:05:24.429 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:24 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "osd ok-to-stop", "ids": ["0"], "max": 16}]: dispatch 2024-03-30T14:05:24.429 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:24 smithi099 ceph-mon[143401]: from='mon.2 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["0"], "max": 16}]: dispatch 2024-03-30T14:05:24.429 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:24 smithi099 ceph-mon[143401]: Upgrade: osd.0 is safe to restart 2024-03-30T14:05:24.429 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:24 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:05:24.429 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:24 smithi099 ceph-mon[137093]: Upgrade: Target is version 19.0.0-1967-g4e50bbcd (squid) 2024-03-30T14:05:24.430 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:24 smithi099 ceph-mon[137093]: Upgrade: Target container is quay.ceph.io/ceph-ci/ceph:4e50bbcdd1630c7760b708f3a5b4d38a121e66cb, digests ['quay.ceph.io/ceph-ci/ceph@sha256:8f3809717761e681477c3ef1d8d2c03114aee2c597cd7380b93b8c10f47fcb5d'] 2024-03-30T14:05:24.430 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:24 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:05:24.430 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:24 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:05:24.430 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:24 smithi099 ceph-mon[137093]: Upgrade: Setting container_image for all mgr 2024-03-30T14:05:24.430 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:24 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:05:24.430 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:24 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:05:24.430 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:24 smithi099 ceph-mon[137093]: Upgrade: Setting container_image for all mon 2024-03-30T14:05:24.430 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:24 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:05:24.430 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:24 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:05:24.430 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:24 smithi099 ceph-mon[137093]: Upgrade: Setting container_image for all crash 2024-03-30T14:05:24.430 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:24 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:05:24.430 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:24 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "osd ok-to-stop", "ids": ["0"], "max": 16}]: dispatch 2024-03-30T14:05:24.430 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:24 smithi099 ceph-mon[137093]: from='mon.2 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["0"], "max": 16}]: dispatch 2024-03-30T14:05:24.431 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:24 smithi099 ceph-mon[137093]: Upgrade: osd.0 is safe to restart 2024-03-30T14:05:24.608 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:24 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:05:24.608 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:24 smithi181 ceph-mon[115276]: Upgrade: Target is version 19.0.0-1967-g4e50bbcd (squid) 2024-03-30T14:05:24.608 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:24 smithi181 ceph-mon[115276]: Upgrade: Target container is quay.ceph.io/ceph-ci/ceph:4e50bbcdd1630c7760b708f3a5b4d38a121e66cb, digests ['quay.ceph.io/ceph-ci/ceph@sha256:8f3809717761e681477c3ef1d8d2c03114aee2c597cd7380b93b8c10f47fcb5d'] 2024-03-30T14:05:24.608 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:24 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:05:24.608 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:24 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:05:24.608 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:24 smithi181 ceph-mon[115276]: Upgrade: Setting container_image for all mgr 2024-03-30T14:05:24.608 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:24 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:05:24.608 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:24 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:05:24.608 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:24 smithi181 ceph-mon[115276]: Upgrade: Setting container_image for all mon 2024-03-30T14:05:24.608 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:24 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:05:24.609 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:24 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:05:24.609 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:24 smithi181 ceph-mon[115276]: Upgrade: Setting container_image for all crash 2024-03-30T14:05:24.609 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:24 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:05:24.609 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:24 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "osd ok-to-stop", "ids": ["0"], "max": 16}]: dispatch 2024-03-30T14:05:24.609 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:24 smithi181 ceph-mon[115276]: from='mon.2 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["0"], "max": 16}]: dispatch 2024-03-30T14:05:24.609 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:24 smithi181 ceph-mon[115276]: Upgrade: osd.0 is safe to restart 2024-03-30T14:05:25.079 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 14:05:24 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[71049]: ::ffff:172.21.15.181 - - [30/Mar/2024:14:05:24] "GET /metrics HTTP/1.1" 200 38018 "" "Prometheus/2.43.0" 2024-03-30T14:05:25.579 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:25 smithi099 ceph-mon[137093]: pgmap v57: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 767 B/s rd, 0 op/s 2024-03-30T14:05:25.579 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:25 smithi099 ceph-mon[143401]: pgmap v57: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 767 B/s rd, 0 op/s 2024-03-30T14:05:25.748 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:25 smithi181 ceph-mon[115276]: pgmap v57: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 767 B/s rd, 0 op/s 2024-03-30T14:05:26.535 INFO:teuthology.orchestra.run.smithi099.stdout:true 2024-03-30T14:05:27.197 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:27 smithi181 ceph-mon[115276]: Upgrade: Updating osd.0 2024-03-30T14:05:27.197 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:27 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:05:27.197 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:27 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-03-30T14:05:27.198 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:27 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:05:27.198 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:27 smithi181 ceph-mon[115276]: Deploying daemon osd.0 on smithi099 2024-03-30T14:05:27.198 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:27 smithi181 ceph-mon[115276]: from='client.64180 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T14:05:27.198 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:27 smithi181 ceph-mon[115276]: pgmap v58: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 767 B/s rd, 0 op/s 2024-03-30T14:05:27.205 INFO:teuthology.orchestra.run.smithi099.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-03-30T14:05:27.205 INFO:teuthology.orchestra.run.smithi099.stdout:agent.smithi099 smithi099 running 13s ago 33m - - 2024-03-30T14:05:27.205 INFO:teuthology.orchestra.run.smithi099.stdout:agent.smithi181 smithi181 running 19s ago 33m - - 2024-03-30T14:05:27.205 INFO:teuthology.orchestra.run.smithi099.stdout:alertmanager.a smithi099 *:9093,9094 running (4m) 13s ago 28m 27.7M - 0.25.0 c8568f914cd2 08735152b67d 2024-03-30T14:05:27.205 INFO:teuthology.orchestra.run.smithi099.stdout:grafana.a smithi181 *:3000 running (3m) 19s ago 27m 78.9M - 9.4.12 2bacad6d85d8 d599aa7730d6 2024-03-30T14:05:27.205 INFO:teuthology.orchestra.run.smithi099.stdout:iscsi.foo.smithi099.qyjuvr smithi099 running (6m) 13s ago 27m 59.5M - 3.5 e1d6a67b021e 2f859af6bc2a 2024-03-30T14:05:27.205 INFO:teuthology.orchestra.run.smithi099.stdout:mgr.x smithi181 *:8443,9283,8765 running (5m) 19s ago 32m 449M - 19.0.0-1967-g4e50bbcd b0c4478f1d83 f269106f7913 2024-03-30T14:05:27.205 INFO:teuthology.orchestra.run.smithi099.stdout:mgr.y smithi099 *:8443,9283,8765 running (16m) 13s ago 34m 511M - 19.0.0-1967-g4e50bbcd b0c4478f1d83 0d464b8c1d18 2024-03-30T14:05:27.206 INFO:teuthology.orchestra.run.smithi099.stdout:mon.a smithi099 running (92s) 13s ago 34m 44.9M 2048M 19.0.0-1967-g4e50bbcd b0c4478f1d83 f19388464dfd 2024-03-30T14:05:27.206 INFO:teuthology.orchestra.run.smithi099.stdout:mon.b smithi181 running (2m) 19s ago 33m 46.6M 2048M 19.0.0-1967-g4e50bbcd b0c4478f1d83 0468ed087cdd 2024-03-30T14:05:27.206 INFO:teuthology.orchestra.run.smithi099.stdout:mon.c smithi099 running (70s) 13s ago 33m 36.4M 2048M 19.0.0-1967-g4e50bbcd b0c4478f1d83 731056a2fea6 2024-03-30T14:05:27.206 INFO:teuthology.orchestra.run.smithi099.stdout:node-exporter.a smithi099 *:9100 running (5m) 13s ago 29m 16.8M - 1.5.0 0da6a335fe13 4a3f1f6e7068 2024-03-30T14:05:27.206 INFO:teuthology.orchestra.run.smithi099.stdout:node-exporter.b smithi181 *:9100 running (5m) 19s ago 28m 15.8M - 1.5.0 0da6a335fe13 acea317b5f5d 2024-03-30T14:05:27.206 INFO:teuthology.orchestra.run.smithi099.stdout:osd.0 smithi099 running (32m) 13s ago 32m 53.9M 4096M 17.2.0 e1d6a67b021e 3158ee1b0c67 2024-03-30T14:05:27.206 INFO:teuthology.orchestra.run.smithi099.stdout:osd.1 smithi099 running (32m) 13s ago 32m 58.2M 4096M 17.2.0 e1d6a67b021e c4af0fd7071a 2024-03-30T14:05:27.206 INFO:teuthology.orchestra.run.smithi099.stdout:osd.2 smithi099 running (31m) 13s ago 31m 49.9M 4096M 17.2.0 e1d6a67b021e 8e4e805a7e20 2024-03-30T14:05:27.206 INFO:teuthology.orchestra.run.smithi099.stdout:osd.3 smithi099 running (31m) 13s ago 31m 54.0M 4096M 17.2.0 e1d6a67b021e 718812bcf065 2024-03-30T14:05:27.206 INFO:teuthology.orchestra.run.smithi099.stdout:osd.4 smithi181 running (31m) 19s ago 31m 55.5M 4096M 17.2.0 e1d6a67b021e 5e205434e973 2024-03-30T14:05:27.206 INFO:teuthology.orchestra.run.smithi099.stdout:osd.5 smithi181 running (30m) 19s ago 30m 53.0M 4096M 17.2.0 e1d6a67b021e e330c920f152 2024-03-30T14:05:27.206 INFO:teuthology.orchestra.run.smithi099.stdout:osd.6 smithi181 running (30m) 19s ago 30m 52.9M 4096M 17.2.0 e1d6a67b021e 81d889ea213d 2024-03-30T14:05:27.206 INFO:teuthology.orchestra.run.smithi099.stdout:osd.7 smithi181 running (29m) 19s ago 29m 53.3M 4096M 17.2.0 e1d6a67b021e c08b1839dd7e 2024-03-30T14:05:27.206 INFO:teuthology.orchestra.run.smithi099.stdout:prometheus.a smithi181 *:9095 running (4m) 19s ago 29m 70.3M - 2.43.0 a07b618ecd1d 004088bdf70e 2024-03-30T14:05:27.206 INFO:teuthology.orchestra.run.smithi099.stdout:rgw.foo.smithi099.fxjbmp smithi099 *:8000 running (27m) 13s ago 27m 77.7M - 17.2.0 e1d6a67b021e 400b28b3f650 2024-03-30T14:05:27.207 INFO:teuthology.orchestra.run.smithi099.stdout:rgw.foo.smithi181.wfqwti smithi181 *:8000 running (27m) 19s ago 27m 77.4M - 17.2.0 e1d6a67b021e 97e1b130f9d4 2024-03-30T14:05:27.207 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:27 smithi099 ceph-mon[137093]: Upgrade: Updating osd.0 2024-03-30T14:05:27.207 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:27 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:05:27.207 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:27 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-03-30T14:05:27.207 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:27 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:05:27.207 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:27 smithi099 ceph-mon[137093]: Deploying daemon osd.0 on smithi099 2024-03-30T14:05:27.207 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:27 smithi099 ceph-mon[137093]: from='client.64180 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T14:05:27.207 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:27 smithi099 ceph-mon[137093]: pgmap v58: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 767 B/s rd, 0 op/s 2024-03-30T14:05:27.207 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:27 smithi099 ceph-mon[143401]: Upgrade: Updating osd.0 2024-03-30T14:05:27.208 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:27 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:05:27.208 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:27 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-03-30T14:05:27.208 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:27 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:05:27.208 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:27 smithi099 ceph-mon[143401]: Deploying daemon osd.0 on smithi099 2024-03-30T14:05:27.208 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:27 smithi099 ceph-mon[143401]: from='client.64180 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T14:05:27.208 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:27 smithi099 ceph-mon[143401]: pgmap v58: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 767 B/s rd, 0 op/s 2024-03-30T14:05:27.603 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-03-30T14:05:27.604 INFO:teuthology.orchestra.run.smithi099.stdout: "mon": { 2024-03-30T14:05:27.604 INFO:teuthology.orchestra.run.smithi099.stdout: "ceph version 19.0.0-1967-g4e50bbcd (4e50bbcdd1630c7760b708f3a5b4d38a121e66cb) squid (dev)": 3 2024-03-30T14:05:27.604 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T14:05:27.604 INFO:teuthology.orchestra.run.smithi099.stdout: "mgr": { 2024-03-30T14:05:27.604 INFO:teuthology.orchestra.run.smithi099.stdout: "ceph version 19.0.0-1967-g4e50bbcd (4e50bbcdd1630c7760b708f3a5b4d38a121e66cb) squid (dev)": 2 2024-03-30T14:05:27.604 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T14:05:27.604 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": { 2024-03-30T14:05:27.604 INFO:teuthology.orchestra.run.smithi099.stdout: "ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)": 8 2024-03-30T14:05:27.604 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T14:05:27.604 INFO:teuthology.orchestra.run.smithi099.stdout: "rgw": { 2024-03-30T14:05:27.604 INFO:teuthology.orchestra.run.smithi099.stdout: "ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)": 2 2024-03-30T14:05:27.604 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T14:05:27.604 INFO:teuthology.orchestra.run.smithi099.stdout: "overall": { 2024-03-30T14:05:27.605 INFO:teuthology.orchestra.run.smithi099.stdout: "ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)": 10, 2024-03-30T14:05:27.605 INFO:teuthology.orchestra.run.smithi099.stdout: "ceph version 19.0.0-1967-g4e50bbcd (4e50bbcdd1630c7760b708f3a5b4d38a121e66cb) squid (dev)": 5 2024-03-30T14:05:27.605 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-03-30T14:05:27.605 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-03-30T14:05:27.951 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-03-30T14:05:27.951 INFO:teuthology.orchestra.run.smithi099.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph:4e50bbcdd1630c7760b708f3a5b4d38a121e66cb", 2024-03-30T14:05:27.952 INFO:teuthology.orchestra.run.smithi099.stdout: "in_progress": true, 2024-03-30T14:05:27.952 INFO:teuthology.orchestra.run.smithi099.stdout: "which": "Upgrading daemons of type(s) osd. Upgrade limited to 2 daemons (2 remaining).", 2024-03-30T14:05:27.952 INFO:teuthology.orchestra.run.smithi099.stdout: "services_complete": [], 2024-03-30T14:05:27.952 INFO:teuthology.orchestra.run.smithi099.stdout: "progress": "0/8 daemons upgraded", 2024-03-30T14:05:27.952 INFO:teuthology.orchestra.run.smithi099.stdout: "message": "Currently upgrading osd daemons", 2024-03-30T14:05:27.952 INFO:teuthology.orchestra.run.smithi099.stdout: "is_paused": false 2024-03-30T14:05:27.952 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-03-30T14:05:28.180 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:28 smithi099 ceph-mon[137093]: from='client.64186 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T14:05:28.181 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:28 smithi099 ceph-mon[137093]: from='client.54192 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T14:05:28.181 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:28 smithi099 ceph-mon[137093]: from='client.? 172.21.15.99:0/3712972743' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:05:28.181 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:28 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:05:28.181 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:28 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:05:28.181 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:28 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:05:28.181 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:28 smithi099 ceph-mon[143401]: from='client.64186 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T14:05:28.181 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:28 smithi099 ceph-mon[143401]: from='client.54192 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T14:05:28.181 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:28 smithi099 ceph-mon[143401]: from='client.? 172.21.15.99:0/3712972743' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:05:28.181 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:28 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:05:28.181 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:28 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:05:28.182 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:28 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:05:28.498 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:28 smithi181 ceph-mon[115276]: from='client.64186 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T14:05:28.498 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:28 smithi181 ceph-mon[115276]: from='client.54192 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T14:05:28.498 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:28 smithi181 ceph-mon[115276]: from='client.? 172.21.15.99:0/3712972743' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:05:28.498 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:28 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:05:28.498 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:28 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:05:28.499 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:28 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:05:29.266 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:29 smithi099 ceph-mon[137093]: from='client.25136 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T14:05:29.266 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:29 smithi099 ceph-mon[137093]: from='client.34238 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T14:05:29.266 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:29 smithi099 ceph-mon[137093]: pgmap v59: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T14:05:29.266 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:29 smithi099 ceph-mon[143401]: from='client.25136 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T14:05:29.266 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:29 smithi099 ceph-mon[143401]: from='client.34238 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T14:05:29.266 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:29 smithi099 ceph-mon[143401]: pgmap v59: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T14:05:29.498 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:29 smithi181 ceph-mon[115276]: from='client.25136 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T14:05:29.498 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:29 smithi181 ceph-mon[115276]: from='client.34238 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T14:05:29.498 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:29 smithi181 ceph-mon[115276]: pgmap v59: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T14:05:29.522 INFO:journalctl@ceph.osd.0.smithi099.stdout:Mar 30 14:05:29 smithi099 systemd[1]: Stopping Ceph osd.0 for 98ebaeb8-ee99-11ee-b647-cb9ed24678a4... 2024-03-30T14:05:29.829 INFO:journalctl@ceph.osd.0.smithi099.stdout:Mar 30 14:05:29 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-0[33076]: 2024-03-30T14:05:29.564+0000 7f26e6230700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.0 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-03-30T14:05:29.829 INFO:journalctl@ceph.osd.0.smithi099.stdout:Mar 30 14:05:29 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-0[33076]: 2024-03-30T14:05:29.564+0000 7f26e6230700 -1 osd.0 113 *** Got signal Terminated *** 2024-03-30T14:05:29.829 INFO:journalctl@ceph.osd.0.smithi099.stdout:Mar 30 14:05:29 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-0[33076]: 2024-03-30T14:05:29.564+0000 7f26e6230700 -1 osd.0 113 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-03-30T14:05:30.498 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:30 smithi181 ceph-mon[115276]: osd.0 marked itself down and dead 2024-03-30T14:05:30.548 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:30 smithi099 ceph-mon[137093]: osd.0 marked itself down and dead 2024-03-30T14:05:30.548 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:30 smithi099 ceph-mon[143401]: osd.0 marked itself down and dead 2024-03-30T14:05:30.829 INFO:journalctl@ceph.osd.0.smithi099.stdout:Mar 30 14:05:30 smithi099 podman[147875]: 2024-03-30 14:05:30.55541175 +0000 UTC m=+1.107454318 container died 3158ee1b0c67bd0014790d089bad2ac8d60ba1f8812e5cce5c9830e52f532e1f (image=quay.io/ceph/ceph@sha256:12a0a4f43413fd97a14a3d47a3451b2d2df50020835bb93db666209f3f77617a, name=ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-0, ceph=True, io.k8s.description=The Universal Base Image is designed and engineered to be the base layer for all of your containerized applications, middleware and utilities. This base image is freely redistributable, but Red Hat only supports Red Hat technologies through subscriptions for Red Hat products. This image is maintained by Red Hat and updated regularly., build-date=2022-05-03T08:36:31.336870, distribution-scope=public, release=754, com.redhat.component=centos-stream-container, vendor=Red Hat, Inc., vcs-type=git, GIT_COMMIT=b613db0f44179c0940781c1c7fe04e1acb7093ac, summary=Provides a CentOS Stream container based on the Red Hat Universal Base Image, io.openshift.tags=base centos centos-stream, com.redhat.license_terms=https://centos.org/legal/licensing-policy/, architecture=x86_64, vcs-ref=f1ee6e37554363ec55e0035aba1a693d3627fdeb, name=centos-stream, io.openshift.expose-services=, com.redhat.build-host=cpt-1002.osbs.prod.upshift.rdu2.redhat.com, description=CentOS Stream is a continuously delivered distro that tracks just ahead of Red Hat Enterprise Linux development. This image takes the Red Hat UBI and layers on content from CentOS Stream, maintainer=Guillaume Abrioux , io.k8s.display-name=CentOS Stream 8, GIT_CLEAN=True, url=https://access.redhat.com/containers/#/registry.access.redhat.com/ubi8/images/8.6-754, GIT_REPO=https://github.com/ceph/ceph-container.git, version=8, RELEASE=HEAD, GIT_BRANCH=HEAD, io.buildah.version=1.19.8, CEPH_POINT_RELEASE=-17.2.0) 2024-03-30T14:05:31.217 INFO:journalctl@ceph.osd.0.smithi099.stdout:Mar 30 14:05:30 smithi099 podman[147875]: 2024-03-30 14:05:30.947804549 +0000 UTC m=+1.499847106 container cleanup 3158ee1b0c67bd0014790d089bad2ac8d60ba1f8812e5cce5c9830e52f532e1f (image=quay.io/ceph/ceph@sha256:12a0a4f43413fd97a14a3d47a3451b2d2df50020835bb93db666209f3f77617a, name=ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-0, io.buildah.version=1.19.8, maintainer=Guillaume Abrioux , GIT_REPO=https://github.com/ceph/ceph-container.git, com.redhat.build-host=cpt-1002.osbs.prod.upshift.rdu2.redhat.com, distribution-scope=public, io.openshift.expose-services=, release=754, description=CentOS Stream is a continuously delivered distro that tracks just ahead of Red Hat Enterprise Linux development. This image takes the Red Hat UBI and layers on content from CentOS Stream, summary=Provides a CentOS Stream container based on the Red Hat Universal Base Image, name=centos-stream, io.openshift.tags=base centos centos-stream, url=https://access.redhat.com/containers/#/registry.access.redhat.com/ubi8/images/8.6-754, ceph=True, com.redhat.license_terms=https://centos.org/legal/licensing-policy/, CEPH_POINT_RELEASE=-17.2.0, RELEASE=HEAD, architecture=x86_64, io.k8s.display-name=CentOS Stream 8, GIT_COMMIT=b613db0f44179c0940781c1c7fe04e1acb7093ac, vendor=Red Hat, Inc., io.k8s.description=The Universal Base Image is designed and engineered to be the base layer for all of your containerized applications, middleware and utilities. This base image is freely redistributable, but Red Hat only supports Red Hat technologies through subscriptions for Red Hat products. This image is maintained by Red Hat and updated regularly., version=8, build-date=2022-05-03T08:36:31.336870, GIT_CLEAN=True, vcs-type=git, GIT_BRANCH=HEAD, vcs-ref=f1ee6e37554363ec55e0035aba1a693d3627fdeb, com.redhat.component=centos-stream-container) 2024-03-30T14:05:31.217 INFO:journalctl@ceph.osd.0.smithi099.stdout:Mar 30 14:05:30 smithi099 bash[147875]: ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-0 2024-03-30T14:05:31.218 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:31 smithi099 ceph-mon[137093]: Health check failed: 1 osds down (OSD_DOWN) 2024-03-30T14:05:31.218 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:31 smithi099 ceph-mon[137093]: failed to encode map e114 with expected crc 2024-03-30T14:05:31.218 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:31 smithi099 ceph-mon[137093]: failed to encode map e114 with expected crc 2024-03-30T14:05:31.218 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:31 smithi099 ceph-mon[137093]: failed to encode map e114 with expected crc 2024-03-30T14:05:31.218 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:31 smithi099 ceph-mon[137093]: osdmap e114: 8 total, 7 up, 8 in 2024-03-30T14:05:31.218 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:31 smithi099 ceph-mon[137093]: failed to encode map e114 with expected crc 2024-03-30T14:05:31.218 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:31 smithi099 ceph-mon[137093]: failed to encode map e114 with expected crc 2024-03-30T14:05:31.218 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:31 smithi099 ceph-mon[137093]: pgmap v61: 161 pgs: 21 stale+active+clean, 140 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-03-30T14:05:31.218 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:31 smithi099 ceph-mon[143401]: Health check failed: 1 osds down (OSD_DOWN) 2024-03-30T14:05:31.218 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:31 smithi099 ceph-mon[143401]: failed to encode map e114 with expected crc 2024-03-30T14:05:31.218 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:31 smithi099 ceph-mon[143401]: failed to encode map e114 with expected crc 2024-03-30T14:05:31.219 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:31 smithi099 ceph-mon[143401]: failed to encode map e114 with expected crc 2024-03-30T14:05:31.219 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:31 smithi099 ceph-mon[143401]: osdmap e114: 8 total, 7 up, 8 in 2024-03-30T14:05:31.219 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:31 smithi099 ceph-mon[143401]: failed to encode map e114 with expected crc 2024-03-30T14:05:31.219 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:31 smithi099 ceph-mon[143401]: failed to encode map e114 with expected crc 2024-03-30T14:05:31.219 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:31 smithi099 ceph-mon[143401]: pgmap v61: 161 pgs: 21 stale+active+clean, 140 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-03-30T14:05:31.498 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:31 smithi181 ceph-mon[115276]: Health check failed: 1 osds down (OSD_DOWN) 2024-03-30T14:05:31.498 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:31 smithi181 ceph-mon[115276]: failed to encode map e114 with expected crc 2024-03-30T14:05:31.498 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:31 smithi181 ceph-mon[115276]: failed to encode map e114 with expected crc 2024-03-30T14:05:31.498 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:31 smithi181 ceph-mon[115276]: failed to encode map e114 with expected crc 2024-03-30T14:05:31.498 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:31 smithi181 ceph-mon[115276]: osdmap e114: 8 total, 7 up, 8 in 2024-03-30T14:05:31.498 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:31 smithi181 ceph-mon[115276]: failed to encode map e114 with expected crc 2024-03-30T14:05:31.498 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:31 smithi181 ceph-mon[115276]: failed to encode map e114 with expected crc 2024-03-30T14:05:31.498 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:31 smithi181 ceph-mon[115276]: pgmap v61: 161 pgs: 21 stale+active+clean, 140 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-03-30T14:05:31.517 INFO:journalctl@ceph.osd.0.smithi099.stdout:Mar 30 14:05:31 smithi099 podman[147893]: 2024-03-30 14:05:31.224088591 +0000 UTC m=+0.668588229 container remove 3158ee1b0c67bd0014790d089bad2ac8d60ba1f8812e5cce5c9830e52f532e1f (image=quay.io/ceph/ceph@sha256:12a0a4f43413fd97a14a3d47a3451b2d2df50020835bb93db666209f3f77617a, name=ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-0, release=754, architecture=x86_64, GIT_BRANCH=HEAD, summary=Provides a CentOS Stream container based on the Red Hat Universal Base Image, vcs-type=git, GIT_CLEAN=True, io.k8s.display-name=CentOS Stream 8, RELEASE=HEAD, io.openshift.tags=base centos centos-stream, io.k8s.description=The Universal Base Image is designed and engineered to be the base layer for all of your containerized applications, middleware and utilities. This base image is freely redistributable, but Red Hat only supports Red Hat technologies through subscriptions for Red Hat products. This image is maintained by Red Hat and updated regularly., name=centos-stream, distribution-scope=public, vendor=Red Hat, Inc., maintainer=Guillaume Abrioux , version=8, build-date=2022-05-03T08:36:31.336870, io.openshift.expose-services=, GIT_COMMIT=b613db0f44179c0940781c1c7fe04e1acb7093ac, description=CentOS Stream is a continuously delivered distro that tracks just ahead of Red Hat Enterprise Linux development. This image takes the Red Hat UBI and layers on content from CentOS Stream, com.redhat.build-host=cpt-1002.osbs.prod.upshift.rdu2.redhat.com, com.redhat.component=centos-stream-container, CEPH_POINT_RELEASE=-17.2.0, io.buildah.version=1.19.8, url=https://access.redhat.com/containers/#/registry.access.redhat.com/ubi8/images/8.6-754, com.redhat.license_terms=https://centos.org/legal/licensing-policy/, GIT_REPO=https://github.com/ceph/ceph-container.git, vcs-ref=f1ee6e37554363ec55e0035aba1a693d3627fdeb, ceph=True) 2024-03-30T14:05:31.812 INFO:journalctl@ceph.osd.0.smithi099.stdout:Mar 30 14:05:31 smithi099 podman[147983]: 2024-03-30 14:05:31.524930703 +0000 UTC m=+0.108922587 container create 2882b0d693a1df98556edc448d1795c616b670c769c88e60b57200d73bc98ec1 (image=quay.ceph.io/ceph-ci/ceph:4e50bbcdd1630c7760b708f3a5b4d38a121e66cb, name=ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-0-deactivate, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240326, RELEASE=squid-4e50bbc, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD) 2024-03-30T14:05:31.812 INFO:journalctl@ceph.osd.0.smithi099.stdout:Mar 30 14:05:31 smithi099 podman[147983]: 2024-03-30 14:05:31.433573635 +0000 UTC m=+0.017565524 image pull b0c4478f1d83795df4d538bf108aee5fac57194348fb16dcdbb3115f3e2fe95e quay.ceph.io/ceph-ci/ceph:4e50bbcdd1630c7760b708f3a5b4d38a121e66cb 2024-03-30T14:05:31.812 INFO:journalctl@ceph.osd.0.smithi099.stdout:Mar 30 14:05:31 smithi099 podman[147983]: 2024-03-30 14:05:31.727323148 +0000 UTC m=+0.311315040 container init 2882b0d693a1df98556edc448d1795c616b670c769c88e60b57200d73bc98ec1 (image=quay.ceph.io/ceph-ci/ceph:4e50bbcdd1630c7760b708f3a5b4d38a121e66cb, name=ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-0-deactivate, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240326, org.label-schema.license=GPLv2, RELEASE=squid-4e50bbc, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, ceph=True, GIT_CLEAN=True, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0) 2024-03-30T14:05:31.812 INFO:journalctl@ceph.osd.0.smithi099.stdout:Mar 30 14:05:31 smithi099 podman[147983]: 2024-03-30 14:05:31.73089754 +0000 UTC m=+0.314889426 container start 2882b0d693a1df98556edc448d1795c616b670c769c88e60b57200d73bc98ec1 (image=quay.ceph.io/ceph-ci/ceph:4e50bbcdd1630c7760b708f3a5b4d38a121e66cb, name=ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-0-deactivate, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240326, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , RELEASE=squid-4e50bbc, ceph=True, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-03-30T14:05:31.812 INFO:journalctl@ceph.osd.0.smithi099.stdout:Mar 30 14:05:31 smithi099 podman[147983]: 2024-03-30 14:05:31.818947866 +0000 UTC m=+0.402939757 container attach 2882b0d693a1df98556edc448d1795c616b670c769c88e60b57200d73bc98ec1 (image=quay.ceph.io/ceph-ci/ceph:4e50bbcdd1630c7760b708f3a5b4d38a121e66cb, name=ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-0-deactivate, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240326, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, RELEASE=squid-4e50bbc, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, ceph=True, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image) 2024-03-30T14:05:32.068 INFO:journalctl@ceph.osd.0.smithi099.stdout:Mar 30 14:05:32 smithi099 podman[147983]: 2024-03-30 14:05:32.066498375 +0000 UTC m=+0.650490268 container died 2882b0d693a1df98556edc448d1795c616b670c769c88e60b57200d73bc98ec1 (image=quay.ceph.io/ceph-ci/ceph:4e50bbcdd1630c7760b708f3a5b4d38a121e66cb, name=ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-0-deactivate, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, RELEASE=squid-4e50bbc, CEPH_POINT_RELEASE=, ceph=True, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240326, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0) 2024-03-30T14:05:32.329 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:32 smithi099 ceph-mon[137093]: failed to encode map e115 with expected crc 2024-03-30T14:05:32.329 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:32 smithi099 ceph-mon[137093]: failed to encode map e115 with expected crc 2024-03-30T14:05:32.329 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:32 smithi099 ceph-mon[137093]: osdmap e115: 8 total, 7 up, 8 in 2024-03-30T14:05:32.329 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:32 smithi099 ceph-mon[137093]: failed to encode map e115 with expected crc 2024-03-30T14:05:32.329 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:32 smithi099 ceph-mon[137093]: failed to encode map e115 with expected crc 2024-03-30T14:05:32.329 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:32 smithi099 ceph-mon[137093]: failed to encode map e115 with expected crc 2024-03-30T14:05:32.329 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:32 smithi099 ceph-mon[137093]: failed to encode map e115 with expected crc 2024-03-30T14:05:32.329 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:32 smithi099 ceph-mon[137093]: failed to encode map e115 with expected crc 2024-03-30T14:05:32.329 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:32 smithi099 ceph-mon[137093]: failed to encode map e115 with expected crc 2024-03-30T14:05:32.330 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:32 smithi099 ceph-mon[143401]: failed to encode map e115 with expected crc 2024-03-30T14:05:32.330 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:32 smithi099 ceph-mon[143401]: failed to encode map e115 with expected crc 2024-03-30T14:05:32.330 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:32 smithi099 ceph-mon[143401]: osdmap e115: 8 total, 7 up, 8 in 2024-03-30T14:05:32.330 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:32 smithi099 ceph-mon[143401]: failed to encode map e115 with expected crc 2024-03-30T14:05:32.330 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:32 smithi099 ceph-mon[143401]: failed to encode map e115 with expected crc 2024-03-30T14:05:32.330 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:32 smithi099 ceph-mon[143401]: failed to encode map e115 with expected crc 2024-03-30T14:05:32.330 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:32 smithi099 ceph-mon[143401]: failed to encode map e115 with expected crc 2024-03-30T14:05:32.330 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:32 smithi099 ceph-mon[143401]: failed to encode map e115 with expected crc 2024-03-30T14:05:32.330 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:32 smithi099 ceph-mon[143401]: failed to encode map e115 with expected crc 2024-03-30T14:05:32.498 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:32 smithi181 ceph-mon[115276]: failed to encode map e115 with expected crc 2024-03-30T14:05:32.498 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:32 smithi181 ceph-mon[115276]: failed to encode map e115 with expected crc 2024-03-30T14:05:32.498 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:32 smithi181 ceph-mon[115276]: osdmap e115: 8 total, 7 up, 8 in 2024-03-30T14:05:32.498 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:32 smithi181 ceph-mon[115276]: failed to encode map e115 with expected crc 2024-03-30T14:05:32.498 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:32 smithi181 ceph-mon[115276]: failed to encode map e115 with expected crc 2024-03-30T14:05:32.498 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:32 smithi181 ceph-mon[115276]: failed to encode map e115 with expected crc 2024-03-30T14:05:32.498 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:32 smithi181 ceph-mon[115276]: failed to encode map e115 with expected crc 2024-03-30T14:05:32.499 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:32 smithi181 ceph-mon[115276]: failed to encode map e115 with expected crc 2024-03-30T14:05:32.499 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:32 smithi181 ceph-mon[115276]: failed to encode map e115 with expected crc 2024-03-30T14:05:33.079 INFO:journalctl@ceph.osd.0.smithi099.stdout:Mar 30 14:05:32 smithi099 podman[148023]: 2024-03-30 14:05:32.68320466 +0000 UTC m=+0.645216545 container remove 2882b0d693a1df98556edc448d1795c616b670c769c88e60b57200d73bc98ec1 (image=quay.ceph.io/ceph-ci/ceph:4e50bbcdd1630c7760b708f3a5b4d38a121e66cb, name=ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-0-deactivate, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.build-date=20240326, io.buildah.version=1.33.5, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , GIT_CLEAN=True, RELEASE=squid-4e50bbc, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-03-30T14:05:33.079 INFO:journalctl@ceph.osd.0.smithi099.stdout:Mar 30 14:05:32 smithi099 systemd[1]: ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4@osd.0.service: Deactivated successfully. 2024-03-30T14:05:33.079 INFO:journalctl@ceph.osd.0.smithi099.stdout:Mar 30 14:05:32 smithi099 systemd[1]: Stopped Ceph osd.0 for 98ebaeb8-ee99-11ee-b647-cb9ed24678a4. 2024-03-30T14:05:33.079 INFO:journalctl@ceph.osd.0.smithi099.stdout:Mar 30 14:05:32 smithi099 systemd[1]: ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4@osd.0.service: Consumed 14.228s CPU time. 2024-03-30T14:05:33.079 INFO:journalctl@ceph.osd.0.smithi099.stdout:Mar 30 14:05:32 smithi099 systemd[1]: Starting Ceph osd.0 for 98ebaeb8-ee99-11ee-b647-cb9ed24678a4... 2024-03-30T14:05:33.393 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:33 smithi099 ceph-mon[137093]: pgmap v63: 161 pgs: 18 active+undersized+degraded, 40 active+undersized, 103 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 511 B/s rd, 0 op/s; 65/627 objects degraded (10.367%) 2024-03-30T14:05:33.394 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:33 smithi099 ceph-mon[143401]: pgmap v63: 161 pgs: 18 active+undersized+degraded, 40 active+undersized, 103 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 511 B/s rd, 0 op/s; 65/627 objects degraded (10.367%) 2024-03-30T14:05:33.498 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:33 smithi181 ceph-mon[115276]: pgmap v63: 161 pgs: 18 active+undersized+degraded, 40 active+undersized, 103 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 511 B/s rd, 0 op/s; 65/627 objects degraded (10.367%) 2024-03-30T14:05:34.000 INFO:journalctl@ceph.osd.0.smithi099.stdout:Mar 30 14:05:33 smithi099 podman[148171]: 2024-03-30 14:05:33.592339569 +0000 UTC m=+0.018144547 image pull b0c4478f1d83795df4d538bf108aee5fac57194348fb16dcdbb3115f3e2fe95e quay.ceph.io/ceph-ci/ceph:4e50bbcdd1630c7760b708f3a5b4d38a121e66cb 2024-03-30T14:05:34.001 INFO:journalctl@ceph.osd.0.smithi099.stdout:Mar 30 14:05:33 smithi099 podman[148171]: 2024-03-30 14:05:33.696882287 +0000 UTC m=+0.122687252 container create f312bdffb372445327a5a0ce4d5325e4e7ac1be0c9af7266c68284e74c5e05df (image=quay.ceph.io/ceph-ci/ceph:4e50bbcdd1630c7760b708f3a5b4d38a121e66cb, name=ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-0-activate, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, RELEASE=squid-4e50bbc, org.label-schema.build-date=20240326) 2024-03-30T14:05:34.001 INFO:journalctl@ceph.osd.0.smithi099.stdout:Mar 30 14:05:33 smithi099 podman[148171]: 2024-03-30 14:05:33.924656102 +0000 UTC m=+0.350461068 container init f312bdffb372445327a5a0ce4d5325e4e7ac1be0c9af7266c68284e74c5e05df (image=quay.ceph.io/ceph-ci/ceph:4e50bbcdd1630c7760b708f3a5b4d38a121e66cb, name=ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-0-activate, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, RELEASE=squid-4e50bbc, org.label-schema.build-date=20240326, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, GIT_CLEAN=True, GIT_BRANCH=HEAD) 2024-03-30T14:05:34.001 INFO:journalctl@ceph.osd.0.smithi099.stdout:Mar 30 14:05:33 smithi099 podman[148171]: 2024-03-30 14:05:33.927990859 +0000 UTC m=+0.353795839 container start f312bdffb372445327a5a0ce4d5325e4e7ac1be0c9af7266c68284e74c5e05df (image=quay.ceph.io/ceph-ci/ceph:4e50bbcdd1630c7760b708f3a5b4d38a121e66cb, name=ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-0-activate, org.label-schema.schema-version=1.0, RELEASE=squid-4e50bbc, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.build-date=20240326, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, ceph=True) 2024-03-30T14:05:34.001 INFO:journalctl@ceph.osd.0.smithi099.stdout:Mar 30 14:05:34 smithi099 podman[148171]: 2024-03-30 14:05:34.007641581 +0000 UTC m=+0.433446556 container attach f312bdffb372445327a5a0ce4d5325e4e7ac1be0c9af7266c68284e74c5e05df (image=quay.ceph.io/ceph-ci/ceph:4e50bbcdd1630c7760b708f3a5b4d38a121e66cb, name=ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-0-activate, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.vendor=CentOS, RELEASE=squid-4e50bbc, org.label-schema.build-date=20240326, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0) 2024-03-30T14:05:34.329 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:34 smithi099 ceph-mon[137093]: Health check failed: Degraded data redundancy: 65/627 objects degraded (10.367%), 18 pgs degraded (PG_DEGRADED) 2024-03-30T14:05:34.329 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:34 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:05:34.329 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:34 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:05:34.329 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:34 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:05:34.329 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:34 smithi099 ceph-mon[143401]: Health check failed: Degraded data redundancy: 65/627 objects degraded (10.367%), 18 pgs degraded (PG_DEGRADED) 2024-03-30T14:05:34.329 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:34 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:05:34.329 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:34 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:05:34.329 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:34 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:05:34.498 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:34 smithi181 ceph-mon[115276]: Health check failed: Degraded data redundancy: 65/627 objects degraded (10.367%), 18 pgs degraded (PG_DEGRADED) 2024-03-30T14:05:34.498 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:34 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:05:34.498 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:34 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:05:34.498 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:34 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:05:34.678 INFO:journalctl@ceph.osd.0.smithi099.stdout:Mar 30 14:05:34 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-0-activate[148187]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-03-30T14:05:34.678 INFO:journalctl@ceph.osd.0.smithi099.stdout:Mar 30 14:05:34 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-0-activate[148187]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-0 --no-mon-config --dev /dev/mapper/vg_nvme-lv_4 2024-03-30T14:05:34.678 INFO:journalctl@ceph.osd.0.smithi099.stdout:Mar 30 14:05:34 smithi099 bash[148171]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-03-30T14:05:34.679 INFO:journalctl@ceph.osd.0.smithi099.stdout:Mar 30 14:05:34 smithi099 bash[148171]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-0 --no-mon-config --dev /dev/mapper/vg_nvme-lv_4 2024-03-30T14:05:34.679 INFO:journalctl@ceph.osd.0.smithi099.stdout:Mar 30 14:05:34 smithi099 bash[148171]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_4 2024-03-30T14:05:34.679 INFO:journalctl@ceph.osd.0.smithi099.stdout:Mar 30 14:05:34 smithi099 bash[148171]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-3 2024-03-30T14:05:34.679 INFO:journalctl@ceph.osd.0.smithi099.stdout:Mar 30 14:05:34 smithi099 bash[148171]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-0/block 2024-03-30T14:05:34.679 INFO:journalctl@ceph.osd.0.smithi099.stdout:Mar 30 14:05:34 smithi099 bash[148171]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-03-30T14:05:34.679 INFO:journalctl@ceph.osd.0.smithi099.stdout:Mar 30 14:05:34 smithi099 bash[148171]: --> ceph-volume raw activate successful for osd ID: 0 2024-03-30T14:05:34.679 INFO:journalctl@ceph.osd.0.smithi099.stdout:Mar 30 14:05:34 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-0-activate[148187]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_4 2024-03-30T14:05:34.679 INFO:journalctl@ceph.osd.0.smithi099.stdout:Mar 30 14:05:34 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-0-activate[148187]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-3 2024-03-30T14:05:34.679 INFO:journalctl@ceph.osd.0.smithi099.stdout:Mar 30 14:05:34 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-0-activate[148187]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-0/block 2024-03-30T14:05:34.679 INFO:journalctl@ceph.osd.0.smithi099.stdout:Mar 30 14:05:34 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-0-activate[148187]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-03-30T14:05:34.679 INFO:journalctl@ceph.osd.0.smithi099.stdout:Mar 30 14:05:34 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-0-activate[148187]: --> ceph-volume raw activate successful for osd ID: 0 2024-03-30T14:05:34.679 INFO:journalctl@ceph.osd.0.smithi099.stdout:Mar 30 14:05:34 smithi099 podman[148171]: 2024-03-30 14:05:34.399470443 +0000 UTC m=+0.825275403 container died f312bdffb372445327a5a0ce4d5325e4e7ac1be0c9af7266c68284e74c5e05df (image=quay.ceph.io/ceph-ci/ceph:4e50bbcdd1630c7760b708f3a5b4d38a121e66cb, name=ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-0-activate, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240326, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, RELEASE=squid-4e50bbc, ceph=True) 2024-03-30T14:05:34.971 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 14:05:34 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[71049]: ::ffff:172.21.15.181 - - [30/Mar/2024:14:05:34] "GET /metrics HTTP/1.1" 200 38018 "" "Prometheus/2.43.0" 2024-03-30T14:05:35.329 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:35 smithi099 ceph-mon[137093]: pgmap v64: 161 pgs: 18 active+undersized+degraded, 40 active+undersized, 103 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 511 B/s rd, 0 op/s; 65/627 objects degraded (10.367%) 2024-03-30T14:05:35.329 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:35 smithi099 ceph-mon[143401]: pgmap v64: 161 pgs: 18 active+undersized+degraded, 40 active+undersized, 103 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 511 B/s rd, 0 op/s; 65/627 objects degraded (10.367%) 2024-03-30T14:05:35.329 INFO:journalctl@ceph.osd.0.smithi099.stdout:Mar 30 14:05:34 smithi099 podman[148323]: 2024-03-30 14:05:34.978336091 +0000 UTC m=+0.573933545 container remove f312bdffb372445327a5a0ce4d5325e4e7ac1be0c9af7266c68284e74c5e05df (image=quay.ceph.io/ceph-ci/ceph:4e50bbcdd1630c7760b708f3a5b4d38a121e66cb, name=ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-0-activate, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, RELEASE=squid-4e50bbc, org.label-schema.build-date=20240326, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS) 2024-03-30T14:05:35.329 INFO:journalctl@ceph.osd.0.smithi099.stdout:Mar 30 14:05:35 smithi099 podman[148389]: 2024-03-30 14:05:35.093878696 +0000 UTC m=+0.018500772 image pull b0c4478f1d83795df4d538bf108aee5fac57194348fb16dcdbb3115f3e2fe95e quay.ceph.io/ceph-ci/ceph:4e50bbcdd1630c7760b708f3a5b4d38a121e66cb 2024-03-30T14:05:35.329 INFO:journalctl@ceph.osd.0.smithi099.stdout:Mar 30 14:05:35 smithi099 podman[148389]: 2024-03-30 14:05:35.22077465 +0000 UTC m=+0.145396723 container create d97d48cb3314924ffef1baf7f781dee8c324f566cda9181c75dcc0fcb889b8e6 (image=quay.ceph.io/ceph-ci/ceph:4e50bbcdd1630c7760b708f3a5b4d38a121e66cb, name=ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-0, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, ceph=True, org.label-schema.build-date=20240326, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-4e50bbc, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux ) 2024-03-30T14:05:35.498 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:35 smithi181 ceph-mon[115276]: pgmap v64: 161 pgs: 18 active+undersized+degraded, 40 active+undersized, 103 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 511 B/s rd, 0 op/s; 65/627 objects degraded (10.367%) 2024-03-30T14:05:35.786 INFO:journalctl@ceph.osd.0.smithi099.stdout:Mar 30 14:05:35 smithi099 podman[148389]: 2024-03-30 14:05:35.473247902 +0000 UTC m=+0.397869975 container init d97d48cb3314924ffef1baf7f781dee8c324f566cda9181c75dcc0fcb889b8e6 (image=quay.ceph.io/ceph-ci/ceph:4e50bbcdd1630c7760b708f3a5b4d38a121e66cb, name=ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-0, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-4e50bbc, org.label-schema.build-date=20240326, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, ceph=True) 2024-03-30T14:05:35.786 INFO:journalctl@ceph.osd.0.smithi099.stdout:Mar 30 14:05:35 smithi099 podman[148389]: 2024-03-30 14:05:35.476231194 +0000 UTC m=+0.400853276 container start d97d48cb3314924ffef1baf7f781dee8c324f566cda9181c75dcc0fcb889b8e6 (image=quay.ceph.io/ceph-ci/ceph:4e50bbcdd1630c7760b708f3a5b4d38a121e66cb, name=ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-0, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, ceph=True, RELEASE=squid-4e50bbc, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240326, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, CEPH_POINT_RELEASE=, GIT_CLEAN=True) 2024-03-30T14:05:35.786 INFO:journalctl@ceph.osd.0.smithi099.stdout:Mar 30 14:05:35 smithi099 ceph-osd[148408]: -- 172.21.15.99:0/1954267119 <== mon.1 v2:172.21.15.99:3301/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55a55233f680 con 0x55a552309000 2024-03-30T14:05:35.786 INFO:journalctl@ceph.osd.0.smithi099.stdout:Mar 30 14:05:35 smithi099 bash[148389]: d97d48cb3314924ffef1baf7f781dee8c324f566cda9181c75dcc0fcb889b8e6 2024-03-30T14:05:35.786 INFO:journalctl@ceph.osd.0.smithi099.stdout:Mar 30 14:05:35 smithi099 systemd[1]: Started Ceph osd.0 for 98ebaeb8-ee99-11ee-b647-cb9ed24678a4. 2024-03-30T14:05:36.052 INFO:journalctl@ceph.osd.0.smithi099.stdout:Mar 30 14:05:36 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-0[148404]: 2024-03-30T14:05:36.020+0000 7fc38f93f7c0 -1 Falling back to public interface 2024-03-30T14:05:36.998 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:36 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:05:36.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:36 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:05:36.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:36 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:05:36.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:36 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:05:36.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:36 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:05:36.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:36 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:05:36.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:36 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:05:36.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:36 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:05:36.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:36 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:05:36.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:36 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:05:36.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:36 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:05:36.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:36 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:05:36.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:36 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:05:37.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:36 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:05:37.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:36 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:05:37.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:36 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:05:37.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:36 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:05:37.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:36 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:05:37.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:36 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:05:37.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:36 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:05:37.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:36 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:05:37.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:36 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:05:37.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:36 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:05:37.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:36 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:05:37.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:36 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:05:37.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:36 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:05:37.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:36 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:05:37.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:36 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:05:37.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:36 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:05:37.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:36 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:05:37.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:36 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:05:37.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:36 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:05:37.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:36 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:05:37.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:36 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:05:37.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:36 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:05:37.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:36 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:05:37.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:36 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:05:37.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:36 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:05:37.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:36 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:05:37.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:36 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:05:37.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:36 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:05:37.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:36 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:05:37.079 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:36 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:05:37.079 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:36 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:05:37.079 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:36 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:05:37.079 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:36 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:05:37.080 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:36 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:05:37.080 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:36 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:05:37.080 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:36 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:05:37.080 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:36 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:05:37.080 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:36 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:05:37.080 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:36 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:05:37.080 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:36 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:05:37.080 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:36 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:05:37.080 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:36 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:05:37.080 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:36 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:05:37.080 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:36 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:05:37.080 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:36 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:05:37.080 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:36 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:05:37.080 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:36 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:05:37.081 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:36 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:05:37.081 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:36 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:05:37.081 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:36 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:05:37.081 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:36 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:05:37.081 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:36 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:05:37.081 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:36 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:05:37.081 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:36 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:05:37.081 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:36 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:05:37.081 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:36 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:05:37.081 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:36 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:05:37.081 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:36 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:05:37.081 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:36 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:05:37.081 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:36 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:05:37.082 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:36 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:05:37.082 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:36 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:05:37.082 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:36 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:05:37.082 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:36 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:05:37.082 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:36 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:05:37.082 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:36 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:05:37.082 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:36 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:05:37.082 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:36 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:05:37.082 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:36 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:05:37.082 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:36 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:05:37.082 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:36 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:05:37.082 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:36 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:05:37.082 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:36 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:05:37.083 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:36 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:05:37.083 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:36 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:05:37.083 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:36 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:05:37.083 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:36 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:05:37.083 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:36 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:05:37.083 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:36 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:05:37.083 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:36 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:05:37.083 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:36 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:05:37.083 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:36 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:05:37.083 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:36 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:05:37.083 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:36 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:05:37.083 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:36 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:05:37.083 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:36 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:05:37.083 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:36 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:05:37.083 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:36 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:05:37.083 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:36 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:05:37.084 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:36 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:05:37.084 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:36 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:05:37.084 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:36 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:05:37.084 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:36 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:05:37.084 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:36 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:05:37.084 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:36 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:05:37.084 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:36 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:05:37.084 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:36 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:05:37.084 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:36 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:05:37.084 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:36 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:05:37.084 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:36 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:05:37.084 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:36 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:05:37.085 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:36 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:05:37.085 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:36 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:05:37.085 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:36 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:05:37.085 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:36 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:05:37.085 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:36 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:05:37.085 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:36 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:05:37.085 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:36 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:05:37.085 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:36 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:05:37.085 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:36 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:05:37.085 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:36 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:05:37.085 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:36 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:05:37.085 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:36 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:05:37.694 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:37 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:05:37.694 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:37 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:05:37.694 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:37 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:05:37.694 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:37 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:05:37.694 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:37 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:05:37.694 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:37 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:05:37.694 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:37 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:05:37.694 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:37 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:05:37.694 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:37 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:05:37.694 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:37 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:05:37.695 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:37 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:05:37.695 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:37 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:05:37.695 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:37 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:05:37.695 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:37 smithi099 ceph-mon[137093]: pgmap v65: 161 pgs: 18 active+undersized+degraded, 40 active+undersized, 103 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 65/627 objects degraded (10.367%) 2024-03-30T14:05:37.695 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:37 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:05:37.695 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:37 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T14:05:37.695 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:37 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:05:37.695 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:37 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:05:37.695 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:37 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:05:37.695 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:37 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:05:37.695 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:37 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:05:37.695 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:37 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:05:37.695 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:37 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:05:37.695 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:37 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:05:37.696 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:37 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:05:37.696 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:37 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:05:37.696 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:37 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:05:37.696 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:37 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:05:37.696 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:37 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:05:37.696 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:37 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:05:37.696 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:37 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:05:37.696 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:37 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:05:37.696 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:37 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:05:37.696 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:37 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:05:37.696 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:37 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:05:37.696 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:37 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:05:37.696 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:37 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:05:37.696 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:37 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:05:37.696 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:37 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:05:37.697 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:37 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:05:37.697 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:37 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:05:37.697 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:37 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:05:37.697 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:37 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:05:37.697 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:37 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:05:37.697 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:37 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:05:37.697 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:37 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:05:37.697 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:37 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:05:37.697 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:37 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:05:37.697 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:37 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:05:37.697 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:37 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:05:37.697 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:37 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:05:37.697 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:37 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:05:37.697 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:37 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:05:37.698 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:37 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:05:37.698 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:37 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:05:37.698 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:37 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:05:37.698 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:37 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:05:37.698 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:37 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:05:37.698 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:37 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:05:37.698 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:37 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:05:37.698 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:37 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:05:37.698 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:37 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:05:37.699 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:37 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:05:37.699 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:37 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:05:37.699 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:37 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:05:37.699 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:37 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:05:37.699 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:37 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:05:37.699 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:37 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:05:37.699 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:37 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:05:37.699 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:37 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:05:37.699 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:37 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:05:37.699 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:37 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:05:37.699 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:37 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:05:37.699 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:37 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:05:37.699 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:37 smithi099 ceph-mon[143401]: pgmap v65: 161 pgs: 18 active+undersized+degraded, 40 active+undersized, 103 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 65/627 objects degraded (10.367%) 2024-03-30T14:05:37.700 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:37 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:05:37.700 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:37 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T14:05:37.700 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:37 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:05:37.700 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:37 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:05:37.700 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:37 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:05:37.700 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:37 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:05:37.700 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:37 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:05:37.700 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:37 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:05:37.700 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:37 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:05:37.700 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:37 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:05:37.700 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:37 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:05:37.700 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:37 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:05:37.700 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:37 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:05:37.700 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:37 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:05:37.701 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:37 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:05:37.701 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:37 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:05:37.701 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:37 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:05:37.701 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:37 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:05:37.701 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:37 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:05:37.701 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:37 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:05:37.701 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:37 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:05:37.701 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:37 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:05:37.701 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:37 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:05:37.701 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:37 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:05:37.701 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:37 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:05:37.701 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:37 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:05:37.701 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:37 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:05:37.701 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:37 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:05:37.701 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:37 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:05:37.701 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:37 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:05:37.702 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:37 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:05:37.702 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:37 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:05:37.702 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:37 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:05:37.702 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:37 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:05:37.702 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:37 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:05:37.702 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:37 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:05:37.702 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:37 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:05:37.702 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:37 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:05:37.702 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:37 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:05:37.702 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:37 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:05:37.702 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:37 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:05:37.702 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:37 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:05:37.702 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:37 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:05:37.702 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:37 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:05:37.702 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:37 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:05:37.703 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:37 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:05:37.703 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:37 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:05:37.998 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:37 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:05:37.998 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:37 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:05:37.998 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:37 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:05:37.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:37 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:05:37.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:37 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:05:37.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:37 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:05:37.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:37 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:05:37.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:37 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:05:37.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:37 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:05:37.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:37 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:05:37.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:37 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:05:37.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:37 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:05:37.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:37 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:05:37.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:37 smithi181 ceph-mon[115276]: pgmap v65: 161 pgs: 18 active+undersized+degraded, 40 active+undersized, 103 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 65/627 objects degraded (10.367%) 2024-03-30T14:05:37.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:37 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:05:38.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:37 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T14:05:38.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:37 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:05:38.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:37 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:05:38.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:37 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:05:38.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:37 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:05:38.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:37 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:05:38.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:37 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:05:38.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:37 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:05:38.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:37 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:05:38.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:37 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:05:38.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:37 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:05:38.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:37 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:05:38.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:37 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:05:38.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:37 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:05:38.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:37 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:05:38.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:37 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:05:38.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:37 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:05:38.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:37 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:05:38.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:37 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:05:38.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:37 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:05:38.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:37 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:05:38.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:37 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:05:38.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:37 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:05:38.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:37 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:05:38.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:37 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:05:38.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:37 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:05:38.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:37 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:05:38.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:37 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:05:38.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:37 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:05:38.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:37 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:05:38.002 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:37 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:05:38.002 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:37 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:05:38.002 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:37 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:05:38.002 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:37 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:05:38.002 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:37 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:05:38.002 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:37 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:05:38.002 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:37 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:05:38.002 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:37 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:05:38.002 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:37 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:05:38.002 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:37 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:05:38.002 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:37 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:05:38.002 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:37 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:05:38.002 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:37 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:05:38.002 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:37 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:05:38.002 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:37 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:05:38.003 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:37 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:05:38.829 INFO:journalctl@ceph.osd.0.smithi099.stdout:Mar 30 14:05:38 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-0[148404]: 2024-03-30T14:05:38.753+0000 7fc38f93f7c0 -1 osd.0 0 read_superblock omap replica is missing. 2024-03-30T14:05:38.829 INFO:journalctl@ceph.osd.0.smithi099.stdout:Mar 30 14:05:38 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-0[148404]: 2024-03-30T14:05:38.794+0000 7fc38f93f7c0 -1 osd.0 113 log_to_monitors true 2024-03-30T14:05:38.829 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:38 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:05:38.829 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:38 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:05:38.830 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:38 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:05:38.830 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:38 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:05:38.830 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:38 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:05:38.830 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:38 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:05:38.830 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:38 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:05:38.830 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:38 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:05:38.830 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:38 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:05:38.830 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:38 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:05:38.830 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:38 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:05:38.830 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:38 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:05:38.830 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:38 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:05:38.830 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:38 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:05:38.830 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:38 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:05:38.831 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:38 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:05:38.831 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:38 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:05:38.831 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:38 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:05:38.831 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:38 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:05:38.831 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:38 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:05:38.831 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:38 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:05:38.831 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:38 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:05:38.831 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:38 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:05:38.831 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:38 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:05:38.831 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:38 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:05:38.831 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:38 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:05:38.831 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:38 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:05:38.831 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:38 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:05:38.831 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:38 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:05:38.832 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:38 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:05:38.832 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:38 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:05:38.832 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:38 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:05:38.832 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:38 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:05:38.832 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:38 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:05:38.832 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:38 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:05:38.832 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:38 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:05:38.832 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:38 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:05:38.832 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:38 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:05:38.832 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:38 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:05:38.832 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:38 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:05:38.832 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:38 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:05:38.833 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:38 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:05:38.833 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:38 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:05:38.833 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:38 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:05:38.833 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:38 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:05:38.833 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:38 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:05:38.833 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:38 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:05:38.833 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:38 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:05:38.833 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:38 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:05:38.833 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:38 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:05:38.833 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:38 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:05:38.833 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:38 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:05:38.833 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:38 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:05:38.833 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:38 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:05:38.833 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:38 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:05:38.834 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:38 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:05:38.834 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:38 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:05:38.834 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:38 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:05:38.834 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:38 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:05:38.834 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:38 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:05:38.834 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:38 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:05:38.834 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:38 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:05:38.834 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:38 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:05:38.834 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:38 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:05:38.834 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:38 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:05:38.835 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:38 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:05:38.835 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:38 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:05:38.835 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:38 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:05:38.835 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:38 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:05:38.835 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:38 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:05:38.835 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:38 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:05:38.835 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:38 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:05:38.835 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:38 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:05:38.835 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:38 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:05:38.835 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:38 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:05:38.835 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:38 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:05:38.835 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:38 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:05:38.835 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:38 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:05:38.835 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:38 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:05:38.836 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:38 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:05:38.836 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:38 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:05:38.836 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:38 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:05:38.836 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:38 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:05:38.836 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:38 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:05:38.836 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:38 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:05:38.836 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:38 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:05:38.836 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:38 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:05:38.836 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:38 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:05:38.836 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:38 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:05:38.837 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:38 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:05:38.837 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:38 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:05:38.837 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:38 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:05:38.837 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:38 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:05:38.837 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:38 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:05:38.837 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:38 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:05:38.837 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:38 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:05:38.837 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:38 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:05:38.837 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:38 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:05:38.837 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:38 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:05:38.837 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:38 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:05:38.837 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:38 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:05:38.837 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:38 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:05:38.838 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:38 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:05:38.838 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:38 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:05:38.838 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:38 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:05:38.838 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:38 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:05:38.838 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:38 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:05:38.838 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:38 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:05:38.838 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:38 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:05:38.838 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:38 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:05:38.998 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:38 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:05:38.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:38 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:05:38.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:38 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:05:38.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:38 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:05:38.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:38 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:05:38.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:38 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:05:38.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:38 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:05:38.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:38 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:05:38.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:38 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:05:38.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:38 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:05:38.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:38 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:05:38.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:38 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:05:38.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:38 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:05:39.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:38 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:05:39.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:38 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:05:39.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:38 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:05:39.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:38 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:05:39.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:38 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:05:39.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:38 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:05:39.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:38 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:05:39.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:38 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:05:39.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:38 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:05:39.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:38 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:05:39.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:38 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:05:39.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:38 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:05:39.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:38 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:05:39.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:38 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:05:39.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:38 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:05:39.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:38 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:05:39.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:38 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:05:39.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:38 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:05:39.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:38 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:05:39.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:38 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:05:39.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:38 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:05:39.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:38 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:05:39.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:38 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:05:39.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:38 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:05:39.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:38 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:05:39.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:38 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:05:39.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:38 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:05:39.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:38 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:05:39.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:38 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:05:39.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:38 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:05:39.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:38 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:05:39.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:38 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:05:39.002 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:38 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:05:39.002 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:38 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:05:39.002 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:38 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:05:39.002 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:38 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:05:39.002 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:38 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:05:39.002 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:38 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:05:39.002 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:38 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:05:39.002 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:38 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:05:39.002 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:38 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:05:39.002 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:38 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:05:39.891 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:39 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:05:39.891 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:39 smithi099 ceph-mon[143401]: from='client.25136 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T14:05:39.891 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:39 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:05:39.891 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:39 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:05:39.891 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:39 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:05:39.891 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:39 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:05:39.891 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:39 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:05:39.891 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:39 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:05:39.891 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:39 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:05:39.891 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:39 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:05:39.892 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:39 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:05:39.892 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:39 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:05:39.892 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:39 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:05:39.892 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:39 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:05:39.892 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:39 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:05:39.892 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:39 smithi099 ceph-mon[143401]: pgmap v66: 161 pgs: 18 active+undersized+degraded, 40 active+undersized, 103 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 474 B/s rd, 0 op/s; 65/627 objects degraded (10.367%) 2024-03-30T14:05:39.892 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:39 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:05:39.892 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:39 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:05:39.892 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:39 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:05:39.892 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:39 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:05:39.892 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:39 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:05:39.892 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:39 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:05:39.892 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:39 smithi099 ceph-mon[143401]: from='osd.0 [v2:172.21.15.99:6802/3330964300,v1:172.21.15.99:6803/3330964300]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-03-30T14:05:39.893 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:39 smithi099 ceph-mon[143401]: from='osd.0 ' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-03-30T14:05:39.893 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:39 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:05:39.893 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:39 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:05:39.893 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:39 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:05:39.893 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:39 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:05:39.893 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:39 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:05:39.893 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:39 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:05:39.894 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:39 smithi099 ceph-mon[137093]: from='client.25136 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T14:05:39.894 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:39 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:05:39.894 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:39 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:05:39.894 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:39 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:05:39.894 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:39 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:05:39.894 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:39 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:05:39.894 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:39 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:05:39.894 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:39 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:05:39.894 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:39 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:05:39.894 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:39 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:05:39.894 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:39 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:05:39.894 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:39 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:05:39.895 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:39 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:05:39.895 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:39 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:05:39.895 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:39 smithi099 ceph-mon[137093]: pgmap v66: 161 pgs: 18 active+undersized+degraded, 40 active+undersized, 103 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 474 B/s rd, 0 op/s; 65/627 objects degraded (10.367%) 2024-03-30T14:05:39.895 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:39 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:05:39.895 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:39 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:05:39.895 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:39 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:05:39.895 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:39 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:05:39.895 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:39 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:05:39.895 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:39 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:05:39.895 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:39 smithi099 ceph-mon[137093]: from='osd.0 [v2:172.21.15.99:6802/3330964300,v1:172.21.15.99:6803/3330964300]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-03-30T14:05:39.895 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:39 smithi099 ceph-mon[137093]: from='osd.0 ' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-03-30T14:05:39.895 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:39 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:05:39.895 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:39 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:05:39.895 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:39 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:05:39.896 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:39 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:05:39.896 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:39 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:05:39.896 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:39 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:05:39.896 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:39 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:05:39.896 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:39 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:05:39.896 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:39 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:05:39.896 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:39 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:05:39.896 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:39 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:05:39.896 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:39 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:05:39.896 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:39 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:05:39.896 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:39 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:05:39.896 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:39 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:05:39.896 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:39 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:05:39.896 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:39 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:05:39.896 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:39 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:05:39.897 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:39 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:05:39.897 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:39 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:05:39.897 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:39 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:05:39.897 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:39 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:05:39.897 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:39 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:05:39.897 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:39 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:05:39.897 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:39 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:05:39.897 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:39 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:05:39.897 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:39 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:05:39.897 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:39 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:05:39.897 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:39 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:05:39.897 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:39 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:05:39.897 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:39 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:05:39.897 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:39 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:05:39.897 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:39 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:05:39.898 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:39 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:05:39.898 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:39 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:05:39.898 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:39 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:05:39.898 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:39 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:05:39.898 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:39 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:05:39.898 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:39 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:05:39.898 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:39 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:05:39.898 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:39 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:05:39.899 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:39 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:05:39.899 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:39 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:05:39.899 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:39 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:05:39.899 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:39 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:05:39.899 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:39 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:05:39.899 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:39 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:05:39.899 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:39 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:05:39.899 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:39 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:05:39.899 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:39 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:05:39.899 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:39 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:05:39.900 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:39 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:05:39.900 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:39 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:05:39.900 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:39 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:05:39.900 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:39 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:05:39.900 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:39 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:05:39.900 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:39 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:05:39.900 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:39 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:05:39.900 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:39 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:05:39.900 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:39 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:05:39.900 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:39 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:05:39.900 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:39 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:05:39.901 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:39 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:05:39.901 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:39 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:05:39.901 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:39 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:05:39.901 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:39 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:05:39.901 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:39 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:05:39.901 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:39 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:05:39.901 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:39 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:05:39.901 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:39 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:05:39.901 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:39 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:05:39.901 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:39 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:05:39.901 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:39 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:05:39.901 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:39 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:05:39.901 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:39 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:05:39.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:39 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:05:39.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:39 smithi181 ceph-mon[115276]: from='client.25136 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T14:05:39.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:39 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:05:39.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:39 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:05:39.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:39 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:05:39.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:39 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:05:39.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:39 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:05:39.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:39 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:05:39.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:39 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:05:39.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:39 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:05:39.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:39 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:05:39.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:39 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:05:39.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:39 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:05:39.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:39 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:05:39.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:39 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:05:40.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:39 smithi181 ceph-mon[115276]: pgmap v66: 161 pgs: 18 active+undersized+degraded, 40 active+undersized, 103 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 474 B/s rd, 0 op/s; 65/627 objects degraded (10.367%) 2024-03-30T14:05:40.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:39 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:05:40.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:39 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:05:40.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:39 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:05:40.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:39 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:05:40.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:39 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:05:40.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:39 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:05:40.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:39 smithi181 ceph-mon[115276]: from='osd.0 [v2:172.21.15.99:6802/3330964300,v1:172.21.15.99:6803/3330964300]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-03-30T14:05:40.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:39 smithi181 ceph-mon[115276]: from='osd.0 ' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-03-30T14:05:40.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:39 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:05:40.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:39 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:05:40.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:39 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:05:40.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:39 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:05:40.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:39 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:05:40.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:39 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:05:40.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:39 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:05:40.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:39 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:05:40.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:39 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:05:40.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:39 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:05:40.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:39 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:05:40.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:39 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:05:40.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:39 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:05:40.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:39 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:05:40.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:39 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:05:40.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:39 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:05:40.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:39 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:05:40.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:39 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:05:40.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:39 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:05:40.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:39 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:05:40.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:39 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:05:40.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:39 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:05:40.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:39 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:05:40.002 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:39 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:05:40.002 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:39 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:05:40.002 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:39 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:05:40.002 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:39 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:05:40.002 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:39 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:05:40.002 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:39 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:05:40.002 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:39 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:05:40.002 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:39 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:05:40.002 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:39 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:05:40.002 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:39 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:05:40.002 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:39 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:05:40.002 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:39 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:05:40.002 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:39 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:05:40.002 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:39 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:05:40.002 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:39 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:05:40.002 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:39 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:05:40.003 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:39 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:05:40.579 INFO:journalctl@ceph.osd.0.smithi099.stdout:Mar 30 14:05:40 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-0[148404]: 2024-03-30T14:05:40.218+0000 7fc37cd8f700 -1 osd.0 113 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-03-30T14:05:40.934 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:40 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:05:40.934 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:40 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:05:40.934 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:40 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:05:40.934 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:40 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:05:40.934 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:40 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:05:40.934 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:40 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:05:40.934 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:40 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:05:40.934 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:40 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:05:40.935 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:40 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:05:40.935 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:40 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:05:40.935 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:40 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:05:40.935 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:40 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:05:40.935 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:40 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:05:40.935 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:40 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:05:40.935 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:40 smithi099 ceph-mon[143401]: from='osd.0 ' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-03-30T14:05:40.935 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:40 smithi099 ceph-mon[143401]: failed to encode map e116 with expected crc 2024-03-30T14:05:40.935 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:40 smithi099 ceph-mon[143401]: osdmap e116: 8 total, 7 up, 8 in 2024-03-30T14:05:40.935 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:40 smithi099 ceph-mon[143401]: from='osd.0 [v2:172.21.15.99:6802/3330964300,v1:172.21.15.99:6803/3330964300]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi099", "root=default"]}]: dispatch 2024-03-30T14:05:40.935 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:40 smithi099 ceph-mon[143401]: from='osd.0 ' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi099", "root=default"]}]: dispatch 2024-03-30T14:05:40.935 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:40 smithi099 ceph-mon[143401]: failed to encode map e116 with expected crc 2024-03-30T14:05:40.935 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:40 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:05:40.935 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:40 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:05:40.935 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:40 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:05:40.935 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:40 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:05:40.936 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:40 smithi099 ceph-mon[143401]: failed to encode map e116 with expected crc 2024-03-30T14:05:40.936 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:40 smithi099 ceph-mon[143401]: failed to encode map e116 with expected crc 2024-03-30T14:05:40.936 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:40 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:05:40.936 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:40 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:05:40.936 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:40 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:05:40.936 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:40 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:05:40.936 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:40 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:05:40.936 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:40 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:05:40.936 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:40 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:05:40.936 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:40 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:05:40.936 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:40 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:05:40.936 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:40 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:05:40.937 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:40 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:05:40.937 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:40 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:05:40.937 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:40 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:05:40.937 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:40 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:05:40.937 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:40 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:05:40.937 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:40 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:05:40.937 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:40 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:05:40.937 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:40 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:05:40.937 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:40 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:05:40.937 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:40 smithi099 ceph-mon[137093]: from='osd.0 ' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-03-30T14:05:40.937 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:40 smithi099 ceph-mon[137093]: failed to encode map e116 with expected crc 2024-03-30T14:05:40.937 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:40 smithi099 ceph-mon[137093]: osdmap e116: 8 total, 7 up, 8 in 2024-03-30T14:05:40.937 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:40 smithi099 ceph-mon[137093]: from='osd.0 [v2:172.21.15.99:6802/3330964300,v1:172.21.15.99:6803/3330964300]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi099", "root=default"]}]: dispatch 2024-03-30T14:05:40.937 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:40 smithi099 ceph-mon[137093]: from='osd.0 ' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi099", "root=default"]}]: dispatch 2024-03-30T14:05:40.937 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:40 smithi099 ceph-mon[137093]: failed to encode map e116 with expected crc 2024-03-30T14:05:40.937 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:40 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:05:40.938 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:40 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:05:40.938 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:40 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:05:40.938 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:40 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:05:40.938 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:40 smithi099 ceph-mon[137093]: failed to encode map e116 with expected crc 2024-03-30T14:05:40.938 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:40 smithi099 ceph-mon[137093]: failed to encode map e116 with expected crc 2024-03-30T14:05:40.938 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:40 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:05:40.938 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:40 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:05:40.938 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:40 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:05:40.938 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:40 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:05:40.938 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:40 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:05:40.939 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:40 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:05:40.939 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:40 smithi099 ceph-mon[143401]: from='osd.0 ' entity='osd.0' 2024-03-30T14:05:40.939 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:40 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:05:40.939 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:40 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:05:40.939 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:40 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:05:40.939 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:40 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:05:40.939 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:40 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:05:40.939 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:40 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:05:40.939 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:40 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:05:40.939 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:40 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:05:40.939 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:40 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:05:40.939 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:40 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:05:40.939 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:40 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:05:40.939 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:40 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:05:40.939 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:40 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:05:40.940 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:40 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:05:40.940 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:40 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:05:40.940 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:40 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:05:40.940 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:40 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:05:40.940 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:40 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:05:40.940 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:40 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:05:40.940 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:40 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:05:40.940 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:40 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:05:40.940 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:40 smithi099 ceph-mon[137093]: from='osd.0 ' entity='osd.0' 2024-03-30T14:05:40.940 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:40 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:05:40.940 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:40 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:05:40.940 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:40 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:05:40.940 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:40 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:05:40.940 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:40 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:05:40.941 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:40 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:05:40.941 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:40 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:05:40.941 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:40 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:05:40.941 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:40 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:05:40.941 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:40 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:05:40.941 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:40 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:05:40.941 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:40 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:05:40.941 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:40 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:05:40.941 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:40 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:05:40.941 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:40 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:05:40.941 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:40 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:05:40.941 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:40 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:05:40.941 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:40 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:05:40.941 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:40 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:05:40.941 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:40 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:05:40.998 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:40 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:05:40.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:40 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:05:40.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:40 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:05:40.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:40 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:05:40.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:40 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:05:40.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:40 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:05:40.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:40 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:05:40.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:40 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:05:40.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:40 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:05:40.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:40 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:05:40.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:40 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:05:40.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:40 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:05:41.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:40 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:05:41.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:40 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:05:41.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:40 smithi181 ceph-mon[115276]: from='osd.0 ' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-03-30T14:05:41.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:40 smithi181 ceph-mon[115276]: failed to encode map e116 with expected crc 2024-03-30T14:05:41.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:40 smithi181 ceph-mon[115276]: osdmap e116: 8 total, 7 up, 8 in 2024-03-30T14:05:41.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:40 smithi181 ceph-mon[115276]: from='osd.0 [v2:172.21.15.99:6802/3330964300,v1:172.21.15.99:6803/3330964300]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi099", "root=default"]}]: dispatch 2024-03-30T14:05:41.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:40 smithi181 ceph-mon[115276]: from='osd.0 ' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi099", "root=default"]}]: dispatch 2024-03-30T14:05:41.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:40 smithi181 ceph-mon[115276]: failed to encode map e116 with expected crc 2024-03-30T14:05:41.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:40 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:05:41.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:40 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:05:41.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:40 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:05:41.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:40 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:05:41.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:40 smithi181 ceph-mon[115276]: failed to encode map e116 with expected crc 2024-03-30T14:05:41.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:40 smithi181 ceph-mon[115276]: failed to encode map e116 with expected crc 2024-03-30T14:05:41.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:40 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:05:41.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:40 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:05:41.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:40 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:05:41.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:40 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:05:41.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:40 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:05:41.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:40 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:05:41.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:40 smithi181 ceph-mon[115276]: from='osd.0 ' entity='osd.0' 2024-03-30T14:05:41.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:40 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:05:41.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:40 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:05:41.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:40 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:05:41.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:40 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:05:41.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:40 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:05:41.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:40 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:05:41.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:40 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:05:41.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:40 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:05:41.002 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:40 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:05:41.002 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:40 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:05:41.002 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:40 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:05:41.002 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:40 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:05:41.002 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:40 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:05:41.002 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:40 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:05:41.002 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:40 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:05:41.002 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:40 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:05:41.002 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:40 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:05:41.002 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:40 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:05:41.002 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:40 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:05:41.002 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:40 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:05:41.829 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:41 smithi099 ceph-mon[143401]: failed to encode map e116 with expected crc 2024-03-30T14:05:41.829 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:41 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:05:41.829 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:41 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:05:41.829 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:41 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:05:41.830 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:41 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:05:41.830 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:41 smithi099 ceph-mon[143401]: failed to encode map e116 with expected crc 2024-03-30T14:05:41.830 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:41 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:05:41.830 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:41 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:05:41.830 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:41 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:05:41.830 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:41 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:05:41.830 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:41 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:05:41.830 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:41 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:05:41.830 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:41 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:05:41.830 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:41 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:05:41.830 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:41 smithi099 ceph-mon[143401]: pgmap v68: 161 pgs: 18 active+undersized+degraded, 40 active+undersized, 103 active+clean; 585 KiB data, 114 MiB used, 715 GiB / 715 GiB avail; 426 B/s rd, 0 op/s; 65/627 objects degraded (10.367%) 2024-03-30T14:05:41.830 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:41 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:05:41.830 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:41 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:05:41.830 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:41 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:05:41.831 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:41 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:05:41.831 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:41 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:05:41.831 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:41 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:05:41.831 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:41 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:05:41.831 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:41 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:05:41.831 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:41 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:05:41.831 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:41 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:05:41.831 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:41 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:05:41.831 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:41 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:05:41.831 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:41 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:05:41.831 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:41 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:05:41.831 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:41 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:05:41.832 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:41 smithi099 ceph-mon[137093]: failed to encode map e116 with expected crc 2024-03-30T14:05:41.832 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:41 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:05:41.832 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:41 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:05:41.832 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:41 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:05:41.832 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:41 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:05:41.832 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:41 smithi099 ceph-mon[137093]: failed to encode map e116 with expected crc 2024-03-30T14:05:41.832 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:41 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:05:41.832 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:41 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:05:41.832 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:41 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:05:41.832 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:41 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:05:41.832 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:41 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:05:41.832 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:41 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:05:41.832 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:41 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:05:41.833 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:41 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:05:41.833 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:41 smithi099 ceph-mon[137093]: pgmap v68: 161 pgs: 18 active+undersized+degraded, 40 active+undersized, 103 active+clean; 585 KiB data, 114 MiB used, 715 GiB / 715 GiB avail; 426 B/s rd, 0 op/s; 65/627 objects degraded (10.367%) 2024-03-30T14:05:41.833 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:41 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:05:41.833 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:41 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:05:41.833 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:41 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:05:41.833 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:41 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:05:41.833 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:41 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:05:41.833 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:41 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:05:41.833 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:41 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:05:41.833 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:41 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:05:41.833 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:41 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:05:41.833 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:41 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:05:41.833 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:41 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:05:41.833 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:41 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:05:41.834 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:41 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:05:41.834 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:41 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:05:41.834 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:41 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:05:41.834 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:41 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:05:41.834 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:41 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:05:41.834 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:41 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:05:41.834 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:41 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:05:41.834 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:41 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:05:41.834 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:41 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:05:41.834 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:41 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:05:41.834 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:41 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:05:41.834 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:41 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:05:41.834 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:41 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:05:41.834 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:41 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:05:41.835 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:41 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:05:41.835 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:41 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:05:41.835 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:41 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:05:41.835 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:41 smithi099 ceph-mon[137093]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-03-30T14:05:41.835 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:41 smithi099 ceph-mon[137093]: failed to encode map e117 with expected crc 2024-03-30T14:05:41.835 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:41 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-03-30T14:05:41.835 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:41 smithi099 ceph-mon[137093]: osd.0 [v2:172.21.15.99:6802/3330964300,v1:172.21.15.99:6803/3330964300] boot 2024-03-30T14:05:41.835 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:41 smithi099 ceph-mon[137093]: osdmap e117: 8 total, 8 up, 8 in 2024-03-30T14:05:41.835 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:41 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:05:41.835 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:41 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:05:41.835 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:41 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:05:41.835 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:41 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:05:41.835 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:41 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:05:41.835 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:41 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:05:41.835 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:41 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:05:41.836 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:41 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:05:41.836 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:41 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:05:41.836 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:41 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:05:41.836 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:41 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:05:41.836 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:41 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:05:41.836 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:41 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:05:41.836 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:41 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:05:41.836 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:41 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:05:41.836 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:41 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:05:41.836 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:41 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:05:41.837 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:41 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:05:41.837 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:41 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:05:41.837 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:41 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:05:41.837 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:41 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:05:41.837 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:41 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:05:41.837 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:41 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:05:41.837 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:41 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:05:41.837 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:41 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:05:41.837 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:41 smithi099 ceph-mon[143401]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-03-30T14:05:41.837 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:41 smithi099 ceph-mon[143401]: failed to encode map e117 with expected crc 2024-03-30T14:05:41.837 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:41 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-03-30T14:05:41.837 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:41 smithi099 ceph-mon[143401]: osd.0 [v2:172.21.15.99:6802/3330964300,v1:172.21.15.99:6803/3330964300] boot 2024-03-30T14:05:41.837 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:41 smithi099 ceph-mon[143401]: osdmap e117: 8 total, 8 up, 8 in 2024-03-30T14:05:41.837 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:41 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:05:41.838 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:41 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:05:41.838 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:41 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:05:41.838 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:41 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:05:41.838 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:41 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:05:41.838 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:41 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:05:41.838 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:41 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:05:41.838 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:41 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:05:41.838 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:41 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:05:41.838 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:41 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:05:41.838 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:41 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:05:41.838 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:41 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:05:41.838 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:41 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:05:41.839 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:41 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:05:41.839 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:41 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:05:41.839 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:41 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:05:41.839 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:41 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:05:41.839 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:41 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:05:41.839 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:41 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:05:41.839 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:41 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:05:41.839 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:41 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:05:41.839 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:41 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:05:41.839 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:41 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:05:41.839 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:41 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:05:41.839 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:41 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:05:41.840 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:41 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:05:41.840 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:41 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:05:41.840 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:41 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:05:41.840 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:41 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:05:41.840 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:41 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:05:41.840 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:41 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:05:41.998 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:41 smithi181 ceph-mon[115276]: failed to encode map e116 with expected crc 2024-03-30T14:05:41.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:41 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:05:41.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:41 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:05:41.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:41 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:05:41.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:41 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:05:41.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:41 smithi181 ceph-mon[115276]: failed to encode map e116 with expected crc 2024-03-30T14:05:41.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:41 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:05:41.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:41 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:05:41.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:41 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:05:41.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:41 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:05:41.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:41 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:05:41.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:41 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:05:41.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:41 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:05:42.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:41 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:05:42.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:41 smithi181 ceph-mon[115276]: pgmap v68: 161 pgs: 18 active+undersized+degraded, 40 active+undersized, 103 active+clean; 585 KiB data, 114 MiB used, 715 GiB / 715 GiB avail; 426 B/s rd, 0 op/s; 65/627 objects degraded (10.367%) 2024-03-30T14:05:42.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:41 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:05:42.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:41 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:05:42.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:41 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:05:42.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:41 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:05:42.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:41 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:05:42.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:41 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:05:42.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:41 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:05:42.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:41 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:05:42.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:41 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:05:42.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:41 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:05:42.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:41 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:05:42.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:41 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:05:42.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:41 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:05:42.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:41 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:05:42.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:41 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:05:42.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:41 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:05:42.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:41 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:05:42.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:41 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:05:42.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:41 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:05:42.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:41 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:05:42.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:41 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:05:42.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:41 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:05:42.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:41 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:05:42.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:41 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:05:42.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:41 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:05:42.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:41 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:05:42.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:41 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:05:42.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:41 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:05:42.002 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:41 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:05:42.002 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:41 smithi181 ceph-mon[115276]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-03-30T14:05:42.002 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:41 smithi181 ceph-mon[115276]: failed to encode map e117 with expected crc 2024-03-30T14:05:42.002 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:41 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-03-30T14:05:42.002 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:41 smithi181 ceph-mon[115276]: osd.0 [v2:172.21.15.99:6802/3330964300,v1:172.21.15.99:6803/3330964300] boot 2024-03-30T14:05:42.002 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:41 smithi181 ceph-mon[115276]: osdmap e117: 8 total, 8 up, 8 in 2024-03-30T14:05:42.002 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:41 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:05:42.002 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:41 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:05:42.002 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:41 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:05:42.002 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:41 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:05:42.002 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:41 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:05:42.002 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:41 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:05:42.002 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:41 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:05:42.003 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:41 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:05:42.003 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:41 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:05:42.003 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:41 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:05:42.003 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:41 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:05:42.003 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:41 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:05:42.003 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:41 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:05:42.003 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:41 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:05:42.003 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:41 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:05:42.003 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:41 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:05:42.003 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:41 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:05:42.003 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:41 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:05:42.003 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:41 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:05:42.003 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:41 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:05:42.003 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:41 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:05:42.724 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:42 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:05:42.724 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:42 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:05:42.724 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:42 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:05:42.724 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:42 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:05:42.724 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:42 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:05:42.724 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:42 smithi099 ceph-mon[137093]: failed to encode map e117 with expected crc 2024-03-30T14:05:42.724 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:42 smithi099 ceph-mon[137093]: failed to encode map e117 with expected crc 2024-03-30T14:05:42.724 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:42 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:05:42.724 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:42 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:05:42.724 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:42 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:05:42.724 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:42 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:05:42.724 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:42 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:05:42.725 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:42 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:05:42.725 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:42 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:05:42.725 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:42 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:05:42.725 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:42 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:05:42.725 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:42 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:05:42.725 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:42 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:05:42.725 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:42 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:05:42.725 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:42 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:05:42.725 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:42 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:05:42.725 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:42 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:05:42.725 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:42 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:05:42.725 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:42 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:05:42.725 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:42 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:05:42.725 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:42 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:05:42.726 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:42 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:05:42.726 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:42 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:05:42.726 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:42 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:05:42.726 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:42 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:05:42.726 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:42 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:05:42.726 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:42 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:05:42.726 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:42 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:05:42.726 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:42 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:05:42.726 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:42 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:05:42.726 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:42 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:05:42.727 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:42 smithi099 ceph-mon[143401]: failed to encode map e117 with expected crc 2024-03-30T14:05:42.727 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:42 smithi099 ceph-mon[143401]: failed to encode map e117 with expected crc 2024-03-30T14:05:42.727 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:42 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:05:42.727 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:42 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:05:42.727 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:42 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:05:42.727 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:42 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:05:42.727 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:42 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:05:42.727 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:42 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:05:42.727 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:42 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:05:42.727 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:42 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:05:42.727 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:42 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:05:42.727 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:42 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:05:42.727 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:42 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:05:42.727 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:42 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:05:42.728 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:42 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:05:42.728 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:42 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:05:42.728 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:42 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:05:42.728 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:42 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:05:42.728 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:42 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:05:42.728 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:42 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:05:42.728 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:42 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:05:42.728 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:42 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:05:42.728 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:42 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:05:42.728 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:42 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:05:42.728 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:42 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:05:42.728 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:42 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:05:42.729 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:42 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:05:42.729 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:42 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:05:42.729 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:42 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:05:42.729 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:42 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:05:42.729 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:42 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:05:42.729 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:42 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:05:42.729 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:42 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:05:42.729 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:42 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:05:42.729 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:42 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:05:42.729 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:42 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:05:42.729 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:42 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:05:42.729 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:42 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:05:42.729 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:42 smithi099 ceph-mon[137093]: osdmap e118: 8 total, 8 up, 8 in 2024-03-30T14:05:42.729 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:42 smithi099 ceph-mon[137093]: failed to encode map e118 with expected crc 2024-03-30T14:05:42.729 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:42 smithi099 ceph-mon[137093]: failed to encode map e118 with expected crc 2024-03-30T14:05:42.730 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:42 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:05:42.730 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:42 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:05:42.730 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:42 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:05:42.730 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:42 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:05:42.730 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:42 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:05:42.730 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:42 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:05:42.730 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:42 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:05:42.730 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:42 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:05:42.730 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:42 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:05:42.730 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:42 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:05:42.730 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:42 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:05:42.730 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:42 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:05:42.730 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:42 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:05:42.730 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:42 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:05:42.730 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:42 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:05:42.731 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:42 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:05:42.731 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:42 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:05:42.731 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:42 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:05:42.731 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:42 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:05:42.731 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:42 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:05:42.731 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:42 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:05:42.731 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:42 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:05:42.731 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:42 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:05:42.731 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:42 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:05:42.731 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:42 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:05:42.731 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:42 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:05:42.732 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:42 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:05:42.732 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:42 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:05:42.732 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:42 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:05:42.732 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:42 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:05:42.732 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:42 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:05:42.732 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:42 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:05:42.732 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:42 smithi099 ceph-mon[143401]: osdmap e118: 8 total, 8 up, 8 in 2024-03-30T14:05:42.732 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:42 smithi099 ceph-mon[143401]: failed to encode map e118 with expected crc 2024-03-30T14:05:42.732 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:42 smithi099 ceph-mon[143401]: failed to encode map e118 with expected crc 2024-03-30T14:05:42.732 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:42 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:05:42.732 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:42 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:05:42.732 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:42 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:05:42.732 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:42 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:05:42.732 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:42 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:05:42.732 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:42 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:05:42.732 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:42 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:05:42.733 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:42 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:05:42.733 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:42 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:05:42.733 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:42 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:05:42.733 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:42 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:05:42.733 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:42 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:05:42.733 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:42 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:05:42.733 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:42 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:05:42.733 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:42 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:05:42.733 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:42 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:05:42.733 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:42 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:05:42.733 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:42 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:05:42.733 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:42 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:05:42.733 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:42 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:05:42.998 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:42 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:05:42.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:42 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:05:42.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:42 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:05:42.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:42 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:05:42.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:42 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:05:42.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:42 smithi181 ceph-mon[115276]: failed to encode map e117 with expected crc 2024-03-30T14:05:42.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:42 smithi181 ceph-mon[115276]: failed to encode map e117 with expected crc 2024-03-30T14:05:42.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:42 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:05:42.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:42 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:05:42.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:42 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:05:42.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:42 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:05:42.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:42 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:05:42.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:42 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:05:42.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:42 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:05:42.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:42 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:05:42.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:42 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:05:42.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:42 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:05:43.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:42 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:05:43.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:42 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:05:43.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:42 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:05:43.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:42 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:05:43.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:42 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:05:43.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:42 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:05:43.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:42 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:05:43.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:42 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:05:43.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:42 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:05:43.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:42 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:05:43.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:42 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:05:43.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:42 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:05:43.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:42 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:05:43.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:42 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:05:43.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:42 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:05:43.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:42 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:05:43.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:42 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:05:43.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:42 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:05:43.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:42 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:05:43.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:42 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:05:43.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:42 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:05:43.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:42 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:05:43.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:42 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:05:43.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:42 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:05:43.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:42 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:05:43.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:42 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:05:43.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:42 smithi181 ceph-mon[115276]: osdmap e118: 8 total, 8 up, 8 in 2024-03-30T14:05:43.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:42 smithi181 ceph-mon[115276]: failed to encode map e118 with expected crc 2024-03-30T14:05:43.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:42 smithi181 ceph-mon[115276]: failed to encode map e118 with expected crc 2024-03-30T14:05:43.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:42 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:05:43.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:42 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:05:43.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:42 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:05:43.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:42 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:05:43.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:42 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:05:43.002 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:42 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:05:43.002 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:42 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:05:43.002 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:42 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:05:43.002 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:42 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:05:43.002 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:42 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:05:43.002 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:42 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:05:43.002 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:42 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:05:43.002 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:42 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:05:43.002 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:42 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:05:43.002 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:42 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:05:43.002 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:42 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:05:43.002 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:42 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:05:43.003 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:42 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:05:43.003 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:42 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:05:43.003 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:42 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:05:43.830 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:43 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:05:43.830 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:43 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:05:43.830 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:43 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:05:43.830 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:43 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:05:43.830 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:43 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:05:43.830 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:43 smithi099 ceph-mon[137093]: failed to encode map e118 with expected crc 2024-03-30T14:05:43.830 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:43 smithi099 ceph-mon[137093]: failed to encode map e118 with expected crc 2024-03-30T14:05:43.830 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:43 smithi099 ceph-mon[137093]: failed to encode map e118 with expected crc 2024-03-30T14:05:43.830 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:43 smithi099 ceph-mon[137093]: failed to encode map e118 with expected crc 2024-03-30T14:05:43.830 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:43 smithi099 ceph-mon[137093]: failed to encode map e118 with expected crc 2024-03-30T14:05:43.830 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:43 smithi099 ceph-mon[137093]: failed to encode map e118 with expected crc 2024-03-30T14:05:43.831 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:43 smithi099 ceph-mon[137093]: failed to encode map e118 with expected crc 2024-03-30T14:05:43.831 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:43 smithi099 ceph-mon[137093]: failed to encode map e118 with expected crc 2024-03-30T14:05:43.831 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:43 smithi099 ceph-mon[137093]: failed to encode map e118 with expected crc 2024-03-30T14:05:43.831 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:43 smithi099 ceph-mon[137093]: failed to encode map e118 with expected crc 2024-03-30T14:05:43.831 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:43 smithi099 ceph-mon[137093]: failed to encode map e118 with expected crc 2024-03-30T14:05:43.831 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:43 smithi099 ceph-mon[137093]: failed to encode map e118 with expected crc 2024-03-30T14:05:43.831 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:43 smithi099 ceph-mon[137093]: failed to encode map e118 with expected crc 2024-03-30T14:05:43.831 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:43 smithi099 ceph-mon[137093]: failed to encode map e118 with expected crc 2024-03-30T14:05:43.831 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:43 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:05:43.831 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:43 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:05:43.831 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:43 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:05:43.831 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:43 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:05:43.831 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:43 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:05:43.831 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:43 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:05:43.831 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:43 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:05:43.831 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:43 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:05:43.832 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:43 smithi099 ceph-mon[137093]: pgmap v71: 161 pgs: 7 active+undersized+degraded, 14 active+undersized, 140 active+clean; 585 KiB data, 115 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 1 op/s; 28/627 objects degraded (4.466%) 2024-03-30T14:05:43.832 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:43 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:05:43.832 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:43 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:05:43.832 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:43 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:05:43.832 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:43 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:05:43.832 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:43 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:05:43.832 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:43 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:05:43.832 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:43 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:05:43.832 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:43 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:05:43.833 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:43 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:05:43.833 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:43 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:05:43.833 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:43 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:05:43.833 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:43 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:05:43.833 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:43 smithi099 ceph-mon[143401]: failed to encode map e118 with expected crc 2024-03-30T14:05:43.833 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:43 smithi099 ceph-mon[143401]: failed to encode map e118 with expected crc 2024-03-30T14:05:43.833 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:43 smithi099 ceph-mon[143401]: failed to encode map e118 with expected crc 2024-03-30T14:05:43.833 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:43 smithi099 ceph-mon[143401]: failed to encode map e118 with expected crc 2024-03-30T14:05:43.833 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:43 smithi099 ceph-mon[143401]: failed to encode map e118 with expected crc 2024-03-30T14:05:43.833 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:43 smithi099 ceph-mon[143401]: failed to encode map e118 with expected crc 2024-03-30T14:05:43.833 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:43 smithi099 ceph-mon[143401]: failed to encode map e118 with expected crc 2024-03-30T14:05:43.833 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:43 smithi099 ceph-mon[143401]: failed to encode map e118 with expected crc 2024-03-30T14:05:43.833 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:43 smithi099 ceph-mon[143401]: failed to encode map e118 with expected crc 2024-03-30T14:05:43.833 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:43 smithi099 ceph-mon[143401]: failed to encode map e118 with expected crc 2024-03-30T14:05:43.834 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:43 smithi099 ceph-mon[143401]: failed to encode map e118 with expected crc 2024-03-30T14:05:43.834 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:43 smithi099 ceph-mon[143401]: failed to encode map e118 with expected crc 2024-03-30T14:05:43.834 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:43 smithi099 ceph-mon[143401]: failed to encode map e118 with expected crc 2024-03-30T14:05:43.834 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:43 smithi099 ceph-mon[143401]: failed to encode map e118 with expected crc 2024-03-30T14:05:43.834 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:43 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:05:43.834 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:43 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:05:43.834 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:43 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:05:43.834 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:43 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:05:43.834 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:43 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:05:43.834 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:43 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:05:43.834 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:43 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:05:43.834 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:43 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:05:43.834 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:43 smithi099 ceph-mon[143401]: pgmap v71: 161 pgs: 7 active+undersized+degraded, 14 active+undersized, 140 active+clean; 585 KiB data, 115 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 1 op/s; 28/627 objects degraded (4.466%) 2024-03-30T14:05:43.834 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:43 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:05:43.834 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:43 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:05:43.835 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:43 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:05:43.835 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:43 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:05:43.835 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:43 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:05:43.835 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:43 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:05:43.835 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:43 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:05:43.835 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:43 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:05:43.835 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:43 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:05:43.835 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:43 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:05:43.835 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:43 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:05:43.836 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:43 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:05:43.836 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:43 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:05:43.836 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:43 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:05:43.836 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:43 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:05:43.836 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:43 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:05:43.836 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:43 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:05:43.836 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:43 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:05:43.836 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:43 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:05:43.836 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:43 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:05:43.836 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:43 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:05:43.836 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:43 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:05:43.836 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:43 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:05:43.836 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:43 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:05:43.837 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:43 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:05:43.837 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:43 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:05:43.837 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:43 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:05:43.837 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:43 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:05:43.837 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:43 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:05:43.837 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:43 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:05:43.837 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:43 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:05:43.837 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:43 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:05:43.837 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:43 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:05:43.837 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:43 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:05:43.837 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:43 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:05:43.837 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:43 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:05:43.838 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:43 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:05:43.838 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:43 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:05:43.838 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:43 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:05:43.838 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:43 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:05:43.838 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:43 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:05:43.838 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:43 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:05:43.838 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:43 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:05:43.838 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:43 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:05:43.838 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:43 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:05:43.838 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:43 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:05:43.838 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:43 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:05:43.839 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:43 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:05:43.839 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:43 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:05:43.839 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:43 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:05:43.839 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:43 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:05:43.839 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:43 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:05:43.839 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:43 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:05:43.839 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:43 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:05:43.839 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:43 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:05:43.839 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:43 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:05:43.839 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:43 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:05:43.839 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:43 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:05:43.839 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:43 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:05:43.839 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:43 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:05:43.839 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:43 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:05:43.840 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:43 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:05:43.840 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:43 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:05:43.840 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:43 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:05:43.840 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:43 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:05:43.840 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:43 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:05:43.840 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:43 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:05:43.840 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:43 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:05:43.840 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:43 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:05:43.840 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:43 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:05:43.841 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:43 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:05:43.841 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:43 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:05:43.841 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:43 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:05:43.841 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:43 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:05:43.841 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:43 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:05:43.841 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:43 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:05:43.841 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:43 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:05:43.998 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:43 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:05:43.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:43 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:05:43.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:43 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:05:43.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:43 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:05:43.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:43 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:05:43.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:43 smithi181 ceph-mon[115276]: failed to encode map e118 with expected crc 2024-03-30T14:05:43.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:43 smithi181 ceph-mon[115276]: failed to encode map e118 with expected crc 2024-03-30T14:05:43.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:43 smithi181 ceph-mon[115276]: failed to encode map e118 with expected crc 2024-03-30T14:05:43.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:43 smithi181 ceph-mon[115276]: failed to encode map e118 with expected crc 2024-03-30T14:05:43.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:43 smithi181 ceph-mon[115276]: failed to encode map e118 with expected crc 2024-03-30T14:05:43.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:43 smithi181 ceph-mon[115276]: failed to encode map e118 with expected crc 2024-03-30T14:05:43.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:43 smithi181 ceph-mon[115276]: failed to encode map e118 with expected crc 2024-03-30T14:05:43.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:43 smithi181 ceph-mon[115276]: failed to encode map e118 with expected crc 2024-03-30T14:05:44.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:43 smithi181 ceph-mon[115276]: failed to encode map e118 with expected crc 2024-03-30T14:05:44.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:43 smithi181 ceph-mon[115276]: failed to encode map e118 with expected crc 2024-03-30T14:05:44.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:43 smithi181 ceph-mon[115276]: failed to encode map e118 with expected crc 2024-03-30T14:05:44.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:43 smithi181 ceph-mon[115276]: failed to encode map e118 with expected crc 2024-03-30T14:05:44.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:43 smithi181 ceph-mon[115276]: failed to encode map e118 with expected crc 2024-03-30T14:05:44.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:43 smithi181 ceph-mon[115276]: failed to encode map e118 with expected crc 2024-03-30T14:05:44.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:43 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:05:44.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:43 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:05:44.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:43 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:05:44.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:43 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:05:44.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:43 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:05:44.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:43 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:05:44.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:43 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:05:44.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:43 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:05:44.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:43 smithi181 ceph-mon[115276]: pgmap v71: 161 pgs: 7 active+undersized+degraded, 14 active+undersized, 140 active+clean; 585 KiB data, 115 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 1 op/s; 28/627 objects degraded (4.466%) 2024-03-30T14:05:44.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:43 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:05:44.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:43 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:05:44.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:43 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:05:44.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:43 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:05:44.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:43 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:05:44.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:43 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:05:44.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:43 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:05:44.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:43 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:05:44.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:43 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:05:44.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:43 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:05:44.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:43 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:05:44.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:43 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:05:44.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:43 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:05:44.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:43 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:05:44.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:43 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:05:44.002 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:43 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:05:44.002 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:43 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:05:44.002 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:43 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:05:44.002 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:43 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:05:44.002 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:43 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:05:44.002 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:43 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:05:44.002 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:43 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:05:44.002 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:43 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:05:44.002 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:43 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:05:44.002 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:43 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:05:44.002 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:43 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:05:44.002 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:43 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:05:44.002 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:43 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:05:44.002 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:43 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:05:44.003 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:43 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:05:44.003 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:43 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:05:44.003 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:43 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:05:44.003 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:43 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:05:44.003 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:43 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:05:44.003 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:43 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:05:44.003 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:43 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:05:44.003 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:43 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:05:44.003 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:43 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:05:44.003 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:43 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:05:44.003 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:43 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:05:44.003 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:43 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:05:44.003 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:43 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:05:44.722 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:44 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:05:44.722 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:44 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:05:44.722 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:44 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:05:44.722 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:44 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:05:44.722 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:44 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:05:44.722 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:44 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:05:44.723 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:44 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:05:44.723 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:44 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:05:44.723 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:44 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:05:44.723 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:44 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:05:44.723 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:44 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:05:44.723 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:44 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:05:44.723 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:44 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:05:44.723 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:44 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:05:44.723 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:44 smithi099 ceph-mon[137093]: Health check update: Degraded data redundancy: 28/627 objects degraded (4.466%), 7 pgs degraded (PG_DEGRADED) 2024-03-30T14:05:44.723 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:44 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:05:44.723 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:44 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:05:44.723 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:44 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:05:44.723 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:44 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:05:44.723 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:44 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:05:44.723 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:44 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:05:44.724 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:44 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:05:44.724 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:44 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:05:44.724 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:44 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:05:44.724 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:44 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:05:44.724 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:44 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:05:44.724 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:44 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:05:44.724 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:44 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:05:44.724 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:44 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:05:44.724 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:44 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:05:44.724 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:44 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:05:44.725 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:44 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:05:44.725 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:44 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:05:44.725 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:44 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:05:44.725 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:44 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:05:44.725 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:44 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:05:44.725 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:44 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:05:44.725 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:44 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:05:44.725 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:44 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:05:44.725 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:44 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:05:44.725 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:44 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:05:44.725 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:44 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:05:44.725 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:44 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:05:44.725 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:44 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:05:44.725 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:44 smithi099 ceph-mon[143401]: Health check update: Degraded data redundancy: 28/627 objects degraded (4.466%), 7 pgs degraded (PG_DEGRADED) 2024-03-30T14:05:44.725 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:44 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:05:44.726 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:44 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:05:44.726 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:44 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:05:44.726 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:44 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:05:44.726 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:44 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:05:44.726 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:44 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:05:44.726 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:44 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:05:44.726 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:44 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:05:44.726 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:44 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:05:44.726 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:44 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:05:44.726 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:44 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:05:44.726 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:44 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:05:44.726 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:44 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:05:44.726 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:44 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:05:44.726 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:44 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:05:44.727 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:44 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:05:44.727 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:44 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:05:44.727 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:44 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:05:44.727 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:44 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:05:44.727 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:44 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:05:44.727 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:44 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:05:44.727 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:44 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:05:44.727 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:44 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:05:44.727 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:44 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:05:44.727 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:44 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:05:44.727 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:44 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:05:44.728 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:44 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:05:44.728 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:44 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:05:44.728 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:44 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:05:44.728 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:44 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:05:44.728 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:44 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:05:44.728 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:44 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:05:44.728 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:44 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:05:44.728 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:44 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:05:44.728 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:44 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:05:44.728 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:44 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:05:44.728 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:44 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:05:44.728 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:44 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:05:44.728 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:44 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:05:44.728 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:44 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:05:44.729 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:44 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:05:44.729 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:44 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:05:44.729 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:44 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:05:44.729 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:44 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:05:44.729 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:44 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:05:44.729 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:44 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:05:44.729 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:44 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:05:44.729 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:44 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:05:44.729 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:44 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:05:44.729 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:44 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:05:44.729 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:44 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:05:44.729 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:44 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:05:44.729 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:44 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:05:44.730 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:44 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:05:44.730 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:44 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:05:44.730 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:44 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:05:44.730 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:44 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:05:44.730 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:44 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:05:44.730 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:44 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:05:44.730 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:44 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:05:44.730 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:44 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:05:44.730 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:44 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:05:44.730 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:44 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:05:44.730 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:44 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:05:44.730 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:44 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:05:44.730 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:44 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:05:44.730 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:44 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:05:44.731 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:44 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:05:44.731 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:44 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:05:44.731 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:44 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:05:44.731 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:44 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:05:44.731 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:44 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:05:44.731 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:44 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:05:44.731 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:44 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:05:44.731 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:44 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:05:44.998 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:44 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:05:44.998 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:44 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:05:44.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:44 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:05:44.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:44 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:05:44.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:44 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:05:44.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:44 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:05:44.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:44 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:05:44.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:44 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:05:44.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:44 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:05:44.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:44 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:05:44.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:44 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:05:44.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:44 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:05:44.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:44 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:05:44.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:44 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:05:44.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:44 smithi181 ceph-mon[115276]: Health check update: Degraded data redundancy: 28/627 objects degraded (4.466%), 7 pgs degraded (PG_DEGRADED) 2024-03-30T14:05:44.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:44 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:05:44.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:44 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:05:44.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:44 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:05:45.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:44 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:05:45.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:44 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:05:45.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:44 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:05:45.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:44 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:05:45.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:44 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:05:45.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:44 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:05:45.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:44 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:05:45.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:44 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:05:45.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:44 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:05:45.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:44 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:05:45.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:44 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:05:45.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:44 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:05:45.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:44 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:05:45.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:44 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:05:45.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:44 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:05:45.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:44 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:05:45.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:44 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:05:45.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:44 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:05:45.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:44 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:05:45.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:44 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:05:45.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:44 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:05:45.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:44 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:05:45.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:44 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:05:45.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:44 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:05:45.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:44 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:05:45.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:44 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:05:45.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:44 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:05:45.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:44 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:05:45.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:44 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:05:45.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:44 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:05:45.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:44 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:05:45.002 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:44 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:05:45.002 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:44 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:05:45.002 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:44 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:05:45.002 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:44 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:05:45.002 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:44 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:05:45.002 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:44 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:05:45.002 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:44 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:05:45.002 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:44 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:05:45.002 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:44 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:05:45.002 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:44 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:05:45.002 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:44 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:05:45.078 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 14:05:44 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[71049]: ::ffff:172.21.15.181 - - [30/Mar/2024:14:05:44] "GET /metrics HTTP/1.1" 200 38152 "" "Prometheus/2.43.0" 2024-03-30T14:05:45.749 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:45 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:05:45.749 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:45 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:05:45.749 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:45 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:05:45.749 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:45 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:05:45.749 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:45 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:05:45.749 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:45 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:05:45.749 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:45 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:05:45.749 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:45 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:05:45.749 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:45 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:05:45.749 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:45 smithi181 ceph-mon[115276]: pgmap v72: 161 pgs: 7 active+undersized+degraded, 14 active+undersized, 140 active+clean; 585 KiB data, 115 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s; 28/627 objects degraded (4.466%) 2024-03-30T14:05:45.749 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:45 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:05:45.749 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:45 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:05:45.750 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:45 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:05:45.750 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:45 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:05:45.750 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:45 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:05:45.750 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:45 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:05:45.750 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:45 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:05:45.750 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:45 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:05:45.750 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:45 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:05:45.750 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:45 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:05:45.750 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:45 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:05:45.750 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:45 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:05:45.750 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:45 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:05:45.750 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:45 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:05:45.750 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:45 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:05:45.751 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:45 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:05:45.751 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:45 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:05:45.751 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:45 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:05:45.751 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:45 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:05:45.751 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:45 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:05:45.751 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:45 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:05:45.751 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:45 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:05:45.751 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:45 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:05:45.751 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:45 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:05:45.751 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:45 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:05:45.751 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:45 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:05:45.751 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:45 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:05:45.751 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:45 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:05:45.751 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:45 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:05:45.751 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:45 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:05:45.752 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:45 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:05:45.752 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:45 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:05:45.752 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:45 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:05:45.752 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:45 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:05:45.752 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:45 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:05:45.752 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:45 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:05:45.752 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:45 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:05:45.752 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:45 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:05:45.752 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:45 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:05:45.752 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:45 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:05:45.752 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:45 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:05:45.752 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:45 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:05:45.752 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:45 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:05:45.752 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:45 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:05:45.752 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:45 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:05:45.753 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:45 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:05:45.753 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:45 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:05:45.753 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:45 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:05:45.753 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:45 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:05:45.753 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:45 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:05:45.753 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:45 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:05:45.753 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:45 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:05:45.753 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:45 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:05:45.753 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:45 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:05:45.753 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:45 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:05:45.903 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:45 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:05:45.903 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:45 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:05:45.903 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:45 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:05:45.903 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:45 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:05:45.903 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:45 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:05:45.904 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:45 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:05:45.904 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:45 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:05:45.904 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:45 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:05:45.904 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:45 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:05:45.904 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:45 smithi099 ceph-mon[137093]: pgmap v72: 161 pgs: 7 active+undersized+degraded, 14 active+undersized, 140 active+clean; 585 KiB data, 115 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s; 28/627 objects degraded (4.466%) 2024-03-30T14:05:45.904 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:45 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:05:45.904 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:45 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:05:45.904 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:45 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:05:45.904 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:45 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:05:45.904 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:45 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:05:45.904 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:45 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:05:45.904 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:45 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:05:45.904 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:45 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:05:45.905 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:45 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:05:45.905 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:45 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:05:45.905 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:45 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:05:45.905 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:45 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:05:45.905 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:45 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:05:45.905 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:45 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:05:45.905 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:45 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:05:45.905 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:45 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:05:45.905 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:45 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:05:45.905 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:45 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:05:45.905 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:45 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:05:45.905 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:45 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:05:45.906 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:45 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:05:45.906 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:45 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:05:45.906 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:45 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:05:45.906 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:45 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:05:45.906 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:45 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:05:45.906 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:45 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:05:45.906 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:45 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:05:45.906 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:45 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:05:45.906 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:45 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:05:45.906 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:45 smithi099 ceph-mon[143401]: pgmap v72: 161 pgs: 7 active+undersized+degraded, 14 active+undersized, 140 active+clean; 585 KiB data, 115 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s; 28/627 objects degraded (4.466%) 2024-03-30T14:05:45.907 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:45 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:05:45.907 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:45 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:05:45.907 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:45 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:05:45.907 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:45 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:05:45.907 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:45 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:05:45.907 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:45 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:05:45.907 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:45 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:05:45.907 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:45 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:05:45.907 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:45 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:05:45.907 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:45 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:05:45.907 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:45 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:05:45.907 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:45 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:05:45.907 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:45 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:05:45.907 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:45 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:05:45.907 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:45 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:05:45.908 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:45 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:05:45.908 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:45 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:05:45.908 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:45 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:05:45.908 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:45 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:05:45.908 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:45 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:05:45.908 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:45 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:05:45.908 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:45 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:05:45.908 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:45 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:05:45.908 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:45 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:05:45.908 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:45 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:05:45.909 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:45 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:05:45.909 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:45 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:05:45.909 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:45 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:05:45.909 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:45 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:05:45.909 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:45 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:05:45.909 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:45 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:05:45.909 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:45 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:05:45.909 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:45 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:05:45.909 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:45 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:05:45.909 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:45 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:05:45.909 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:45 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:05:45.909 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:45 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:05:45.909 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:45 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:05:45.909 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:45 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:05:45.909 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:45 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:05:45.910 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:45 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:05:45.910 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:45 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:05:45.910 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:45 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:05:45.910 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:45 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:05:45.910 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:45 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:05:45.910 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:45 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:05:45.910 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:45 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:05:45.910 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:45 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:05:45.910 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:45 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:05:45.910 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:45 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:05:45.910 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:45 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:05:45.910 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:45 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:05:45.911 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:45 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:05:45.911 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:45 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:05:45.911 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:45 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:05:45.911 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:45 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:05:45.911 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:45 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:05:45.911 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:45 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:05:45.911 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:45 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:05:45.911 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:45 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:05:45.911 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:45 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:05:45.911 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:45 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:05:45.911 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:45 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:05:45.911 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:45 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:05:45.911 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:45 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:05:45.911 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:45 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:05:45.911 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:45 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:05:45.912 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:45 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:05:45.912 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:45 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:05:45.912 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:45 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:05:45.912 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:45 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:05:45.912 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:45 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:05:45.912 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:45 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:05:45.912 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:45 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:05:45.912 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:45 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:05:45.912 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:45 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:05:45.912 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:45 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:05:45.912 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:45 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:05:45.912 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:45 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:05:45.912 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:45 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:05:45.913 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:45 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:05:45.913 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:45 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:05:45.913 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:45 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:05:45.913 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:45 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:05:45.913 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:45 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:05:45.913 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:45 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:05:45.913 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:45 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:05:45.913 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:45 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:05:45.913 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:45 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:05:45.913 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:45 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:05:46.829 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:46 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:05:46.829 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:46 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:05:46.829 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:46 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:05:46.829 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:46 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:05:46.829 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:46 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:05:46.830 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:46 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:05:46.830 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:46 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:05:46.830 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:46 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:05:46.830 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:46 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:05:46.830 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:46 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:05:46.830 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:46 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:05:46.830 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:46 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:05:46.830 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:46 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:05:46.830 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:46 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:05:46.830 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:46 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:05:46.830 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:46 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:05:46.830 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:46 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:05:46.830 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:46 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:05:46.830 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:46 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:05:46.831 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:46 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:05:46.831 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:46 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:05:46.831 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:46 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:05:46.831 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:46 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:05:46.831 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:46 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:05:46.831 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:46 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:05:46.831 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:46 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:05:46.831 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:46 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:05:46.831 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:46 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:05:46.831 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:46 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:05:46.831 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:46 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:05:46.831 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:46 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:05:46.832 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:46 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:05:46.832 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:46 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:05:46.832 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:46 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:05:46.832 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:46 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:05:46.832 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:46 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:05:46.832 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:46 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:05:46.832 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:46 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:05:46.832 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:46 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:05:46.832 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:46 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:05:46.832 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:46 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:05:46.832 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:46 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:05:46.832 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:46 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:05:46.832 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:46 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:05:46.832 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:46 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:05:46.832 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:46 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:05:46.833 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:46 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:05:46.833 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:46 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:05:46.833 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:46 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:05:46.833 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:46 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:05:46.833 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:46 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:05:46.833 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:46 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:05:46.833 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:46 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:05:46.833 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:46 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:05:46.833 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:46 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:05:46.833 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:46 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:05:46.833 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:46 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:05:46.833 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:46 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:05:46.833 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:46 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:05:46.833 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:46 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:05:46.833 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:46 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:05:46.834 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:46 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:05:46.834 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:46 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:05:46.834 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:46 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:05:46.834 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:46 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:05:46.834 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:46 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:05:46.834 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:46 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:05:46.834 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:46 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:05:46.834 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:46 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:05:46.834 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:46 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:05:46.834 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:46 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:05:46.835 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:46 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:05:46.835 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:46 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:05:46.835 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:46 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:05:46.835 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:46 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:05:46.835 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:46 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:05:46.835 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:46 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:05:46.835 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:46 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:05:46.835 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:46 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:05:46.835 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:46 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:05:46.835 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:46 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:05:46.835 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:46 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:05:46.835 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:46 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:05:46.835 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:46 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:05:46.835 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:46 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:05:46.835 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:46 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:05:46.836 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:46 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:05:46.836 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:46 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:05:46.836 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:46 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:05:46.836 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:46 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:05:46.836 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:46 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:05:46.836 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:46 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:05:46.836 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:46 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:05:46.836 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:46 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:05:46.836 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:46 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:05:46.836 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:46 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:05:46.836 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:46 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:05:46.836 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:46 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:05:46.837 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:46 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:05:46.837 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:46 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:05:46.837 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:46 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:05:46.837 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:46 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:05:46.837 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:46 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:05:46.837 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:46 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:05:46.837 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:46 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:05:46.837 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:46 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:05:46.837 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:46 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:05:46.837 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:46 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:05:46.837 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:46 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:05:46.837 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:46 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:05:46.837 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:46 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:05:46.838 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:46 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:05:46.998 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:46 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:05:46.998 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:46 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:05:46.998 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:46 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:05:46.998 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:46 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:05:46.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:46 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:05:46.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:46 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:05:46.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:46 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:05:46.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:46 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:05:46.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:46 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:05:46.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:46 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:05:46.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:46 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:05:46.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:46 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:05:46.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:46 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:05:46.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:46 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:05:46.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:46 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:05:46.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:46 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:05:46.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:46 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:05:46.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:46 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:05:46.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:46 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:05:47.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:46 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:05:47.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:46 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:05:47.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:46 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:05:47.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:46 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:05:47.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:46 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:05:47.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:46 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:05:47.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:46 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:05:47.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:46 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:05:47.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:46 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:05:47.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:46 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:05:47.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:46 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:05:47.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:46 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:05:47.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:46 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:05:47.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:46 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:05:47.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:46 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:05:47.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:46 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:05:47.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:46 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:05:47.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:46 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:05:47.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:46 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:05:47.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:46 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:05:47.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:46 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:05:47.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:46 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:05:47.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:46 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:05:47.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:46 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:05:47.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:46 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:05:47.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:46 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:05:47.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:46 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:05:47.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:46 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:05:47.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:46 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:05:47.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:46 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:05:47.002 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:46 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:05:47.002 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:46 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:05:47.002 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:46 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:05:47.002 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:46 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:05:47.002 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:46 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:05:47.002 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:46 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:05:47.002 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:46 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:05:47.829 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:47 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:05:47.829 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:47 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:05:47.830 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:47 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:05:47.830 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:47 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:05:47.830 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:47 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:05:47.830 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:47 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:05:47.830 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:47 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:05:47.830 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:47 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:05:47.830 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:47 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:05:47.830 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:47 smithi099 ceph-mon[137093]: pgmap v73: 161 pgs: 161 active+clean; 585 KiB data, 119 MiB used, 715 GiB / 715 GiB avail; 733 B/s rd, 0 op/s 2024-03-30T14:05:47.830 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:47 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:05:47.830 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:47 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:05:47.830 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:47 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:05:47.830 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:47 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:05:47.830 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:47 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:05:47.830 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:47 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:05:47.831 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:47 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:05:47.831 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:47 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:05:47.831 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:47 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:05:47.831 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:47 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:05:47.831 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:47 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:05:47.831 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:47 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:05:47.831 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:47 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:05:47.831 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:47 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:05:47.831 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:47 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:05:47.831 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:47 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:05:47.831 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:47 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:05:47.831 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:47 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:05:47.831 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:47 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:05:47.831 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:47 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:05:47.832 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:47 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:05:47.832 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:47 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:05:47.832 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:47 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:05:47.832 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:47 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:05:47.832 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:47 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:05:47.832 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:47 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:05:47.832 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:47 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:05:47.832 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:47 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:05:47.832 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:47 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:05:47.832 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:47 smithi099 ceph-mon[143401]: pgmap v73: 161 pgs: 161 active+clean; 585 KiB data, 119 MiB used, 715 GiB / 715 GiB avail; 733 B/s rd, 0 op/s 2024-03-30T14:05:47.832 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:47 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:05:47.832 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:47 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:05:47.832 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:47 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:05:47.833 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:47 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:05:47.833 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:47 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:05:47.833 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:47 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:05:47.833 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:47 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:05:47.833 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:47 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:05:47.833 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:47 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:05:47.833 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:47 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:05:47.833 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:47 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:05:47.833 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:47 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:05:47.833 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:47 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:05:47.833 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:47 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:05:47.833 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:47 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:05:47.833 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:47 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:05:47.833 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:47 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:05:47.833 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:47 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:05:47.834 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:47 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:05:47.834 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:47 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:05:47.834 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:47 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:05:47.834 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:47 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:05:47.834 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:47 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:05:47.834 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:47 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:05:47.834 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:47 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:05:47.834 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:47 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:05:47.834 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:47 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:05:47.835 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:47 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:05:47.835 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:47 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:05:47.835 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:47 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:05:47.835 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:47 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:05:47.835 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:47 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:05:47.835 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:47 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:05:47.835 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:47 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:05:47.835 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:47 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:05:47.835 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:47 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:05:47.835 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:47 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:05:47.835 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:47 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:05:47.835 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:47 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:05:47.835 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:47 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:05:47.835 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:47 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:05:47.835 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:47 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:05:47.836 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:47 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:05:47.836 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:47 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:05:47.836 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:47 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:05:47.836 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:47 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:05:47.836 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:47 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:05:47.836 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:47 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:05:47.836 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:47 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:05:47.836 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:47 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:05:47.836 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:47 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:05:47.836 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:47 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:05:47.836 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:47 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:05:47.836 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:47 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:05:47.837 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:47 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:05:47.837 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:47 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:05:47.837 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:47 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:05:47.837 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:47 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:05:47.837 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:47 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:05:47.837 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:47 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:05:47.837 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:47 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:05:47.837 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:47 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:05:47.837 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:47 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:05:47.837 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:47 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:05:47.837 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:47 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:05:47.837 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:47 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:05:47.837 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:47 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:05:47.838 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:47 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:05:47.838 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:47 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:05:47.838 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:47 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:05:47.998 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:47 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:05:47.998 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:47 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:05:47.998 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:47 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:05:47.998 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:47 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:05:47.998 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:47 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:05:47.998 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:47 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:05:47.998 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:47 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:05:47.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:47 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:05:47.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:47 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:05:47.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:47 smithi181 ceph-mon[115276]: pgmap v73: 161 pgs: 161 active+clean; 585 KiB data, 119 MiB used, 715 GiB / 715 GiB avail; 733 B/s rd, 0 op/s 2024-03-30T14:05:47.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:47 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:05:47.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:47 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:05:47.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:47 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:05:47.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:47 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:05:47.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:47 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:05:47.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:47 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:05:47.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:47 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:05:47.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:47 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:05:47.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:47 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:05:48.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:47 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:05:48.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:47 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:05:48.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:47 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:05:48.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:47 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:05:48.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:47 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:05:48.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:47 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:05:48.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:47 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:05:48.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:47 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:05:48.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:47 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:05:48.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:47 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:05:48.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:47 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:05:48.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:47 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:05:48.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:47 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:05:48.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:47 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:05:48.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:47 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:05:48.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:47 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:05:48.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:47 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:05:48.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:47 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:05:48.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:47 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:05:48.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:47 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:05:48.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:47 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:05:48.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:47 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:05:48.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:47 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:05:48.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:47 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:05:48.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:47 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:05:48.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:47 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:05:48.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:47 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:05:48.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:47 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:05:48.002 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:47 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:05:48.002 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:47 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:05:48.002 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:47 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:05:48.002 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:47 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:05:48.002 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:47 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:05:48.002 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:47 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:05:48.002 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:47 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:05:48.002 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:47 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:05:48.998 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:48 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:05:48.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:48 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:05:48.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:48 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:05:48.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:48 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:05:48.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:48 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:05:48.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:48 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:05:48.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:48 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:05:48.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:48 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:05:48.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:48 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:05:48.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:48 smithi181 ceph-mon[115276]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 28/627 objects degraded (4.466%), 7 pgs degraded) 2024-03-30T14:05:48.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:48 smithi181 ceph-mon[115276]: Cluster is now healthy 2024-03-30T14:05:48.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:48 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:05:48.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:48 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:05:48.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:48 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:05:48.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:48 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:05:48.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:48 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:05:49.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:48 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:05:49.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:48 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:05:49.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:48 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:05:49.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:48 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:05:49.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:48 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:05:49.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:48 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:05:49.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:48 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:05:49.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:48 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:05:49.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:48 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:05:49.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:48 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:05:49.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:48 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:05:49.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:48 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:05:49.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:48 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:05:49.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:48 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:05:49.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:48 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:05:49.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:48 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:05:49.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:48 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:05:49.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:48 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:05:49.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:48 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:05:49.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:48 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:05:49.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:48 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:05:49.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:48 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:05:49.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:48 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:05:49.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:48 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:05:49.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:48 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:05:49.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:48 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:05:49.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:48 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:05:49.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:48 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:05:49.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:48 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:05:49.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:48 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:05:49.002 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:48 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:05:49.002 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:48 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:05:49.002 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:48 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:05:49.002 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:48 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:05:49.002 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:48 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:05:49.002 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:48 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:05:49.002 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:48 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:05:49.002 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:48 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:05:49.002 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:48 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:05:49.002 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:48 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:05:49.002 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:48 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:05:49.002 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:48 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:05:49.002 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:48 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:05:49.003 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:48 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:05:49.003 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:48 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:05:49.003 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:48 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:05:49.003 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:48 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:05:49.003 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:48 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:05:49.003 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:48 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:05:49.003 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:48 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:05:49.003 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:48 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:05:49.003 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:48 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:05:49.003 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:48 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:05:49.072 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:48 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:05:49.073 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:48 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:05:49.073 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:48 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:05:49.073 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:48 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:05:49.073 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:48 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:05:49.073 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:48 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:05:49.073 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:48 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:05:49.073 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:48 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:05:49.073 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:48 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:05:49.073 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:48 smithi099 ceph-mon[137093]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 28/627 objects degraded (4.466%), 7 pgs degraded) 2024-03-30T14:05:49.073 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:48 smithi099 ceph-mon[137093]: Cluster is now healthy 2024-03-30T14:05:49.073 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:48 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:05:49.073 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:48 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:05:49.074 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:48 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:05:49.074 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:48 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:05:49.074 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:48 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:05:49.074 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:48 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:05:49.074 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:48 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:05:49.074 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:48 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:05:49.074 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:48 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:05:49.074 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:48 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:05:49.074 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:48 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:05:49.074 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:48 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:05:49.074 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:48 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:05:49.074 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:48 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:05:49.074 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:48 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:05:49.074 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:48 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:05:49.075 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:48 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:05:49.075 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:48 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:05:49.075 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:48 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:05:49.075 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:48 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:05:49.075 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:48 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:05:49.075 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:48 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:05:49.075 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:48 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:05:49.075 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:48 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:05:49.075 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:48 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:05:49.075 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:48 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:05:49.075 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:48 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:05:49.076 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:48 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:05:49.076 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:48 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:05:49.076 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:48 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:05:49.076 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:48 smithi099 ceph-mon[143401]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 28/627 objects degraded (4.466%), 7 pgs degraded) 2024-03-30T14:05:49.076 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:48 smithi099 ceph-mon[143401]: Cluster is now healthy 2024-03-30T14:05:49.076 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:48 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:05:49.076 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:48 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:05:49.076 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:48 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:05:49.076 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:48 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:05:49.076 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:48 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:05:49.076 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:48 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:05:49.076 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:48 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:05:49.076 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:48 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:05:49.076 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:48 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:05:49.076 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:48 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:05:49.077 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:48 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:05:49.077 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:48 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:05:49.077 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:48 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:05:49.077 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:48 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:05:49.077 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:48 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:05:49.077 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:48 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:05:49.077 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:48 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:05:49.077 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:48 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:05:49.077 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:48 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:05:49.077 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:48 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:05:49.077 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:48 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:05:49.078 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:48 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:05:49.078 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:48 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:05:49.078 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:48 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:05:49.078 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:48 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:05:49.078 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:48 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:05:49.078 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:48 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:05:49.078 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:48 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:05:49.078 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:48 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:05:49.078 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:48 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:05:49.078 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:48 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:05:49.078 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:48 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:05:49.078 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:48 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:05:49.078 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:48 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:05:49.079 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:48 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:05:49.079 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:48 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:05:49.079 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:48 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:05:49.079 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:48 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:05:49.079 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:48 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:05:49.079 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:48 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:05:49.079 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:48 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:05:49.079 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:48 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:05:49.079 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:48 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:05:49.079 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:48 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:05:49.079 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:48 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:05:49.079 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:48 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:05:49.079 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:48 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:05:49.079 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:48 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:05:49.079 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:48 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:05:49.080 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:48 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:05:49.080 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:48 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:05:49.080 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:48 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:05:49.080 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:48 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:05:49.080 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:48 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:05:49.080 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:48 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:05:49.080 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:48 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:05:49.080 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:48 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:05:49.080 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:48 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:05:49.080 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:48 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:05:49.081 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:48 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:05:49.081 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:48 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:05:49.081 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:48 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:05:49.081 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:48 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:05:49.081 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:48 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:05:49.081 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:48 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:05:49.081 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:48 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:05:49.081 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:48 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:05:49.081 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:48 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:05:49.081 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:48 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:05:49.081 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:48 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:05:49.081 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:48 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:05:49.081 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:48 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:05:49.081 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:48 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:05:49.082 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:48 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:05:49.082 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:48 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:05:49.082 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:48 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:05:49.082 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:48 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:05:49.082 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:48 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:05:49.082 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:48 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:05:49.082 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:48 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:05:49.082 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:48 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:05:49.082 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:48 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:05:49.082 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:48 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:05:49.082 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:48 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:05:49.082 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:48 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:05:49.082 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:48 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:05:49.082 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:48 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:05:49.083 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:48 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:05:49.083 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:48 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:05:49.083 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:48 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:05:49.083 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:48 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:05:49.083 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:48 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:05:49.083 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:48 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:05:49.083 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:48 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:05:49.083 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:48 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:05:49.942 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:49 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:05:49.942 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:49 smithi099 ceph-mon[143401]: from='client.25136 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T14:05:49.942 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:49 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:05:49.942 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:49 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:05:49.942 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:49 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:05:49.942 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:49 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:05:49.942 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:49 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:05:49.942 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:49 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:05:49.942 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:49 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:05:49.942 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:49 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:05:49.943 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:49 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:05:49.943 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:49 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:05:49.943 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:49 smithi099 ceph-mon[143401]: pgmap v74: 161 pgs: 161 active+clean; 585 KiB data, 119 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T14:05:49.943 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:49 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:05:49.943 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:49 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:05:49.943 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:49 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:05:49.943 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:49 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:05:49.943 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:49 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:05:49.943 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:49 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:05:49.943 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:49 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:05:49.943 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:49 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:05:49.943 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:49 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:05:49.943 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:49 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:05:49.943 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:49 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:05:49.943 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:49 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:05:49.943 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:49 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:05:49.943 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:49 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:05:49.944 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:49 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:05:49.944 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:49 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:05:49.944 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:49 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:05:49.944 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:49 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:05:49.944 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:49 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:05:49.944 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:49 smithi099 ceph-mon[137093]: from='client.25136 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T14:05:49.944 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:49 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:05:49.944 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:49 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:05:49.944 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:49 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:05:49.944 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:49 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:05:49.944 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:49 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:05:49.944 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:49 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:05:49.945 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:49 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:05:49.945 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:49 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:05:49.945 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:49 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:05:49.945 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:49 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:05:49.945 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:49 smithi099 ceph-mon[137093]: pgmap v74: 161 pgs: 161 active+clean; 585 KiB data, 119 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T14:05:49.945 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:49 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:05:49.945 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:49 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:05:49.945 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:49 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:05:49.945 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:49 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:05:49.945 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:49 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:05:49.945 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:49 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:05:49.945 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:49 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:05:49.945 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:49 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:05:49.945 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:49 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:05:49.945 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:49 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:05:49.945 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:49 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:05:49.946 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:49 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:05:49.946 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:49 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:05:49.946 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:49 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:05:49.946 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:49 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:05:49.946 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:49 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:05:49.946 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:49 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:05:49.946 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:49 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:05:49.946 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:49 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:05:49.946 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:49 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:05:49.946 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:49 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:05:49.946 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:49 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:05:49.947 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:49 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:05:49.947 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:49 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:05:49.947 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:49 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:05:49.947 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:49 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:05:49.947 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:49 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:05:49.947 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:49 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:05:49.947 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:49 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:05:49.947 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:49 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:05:49.947 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:49 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:05:49.947 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:49 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:05:49.947 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:49 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:05:49.947 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:49 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:05:49.947 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:49 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:05:49.947 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:49 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:05:49.947 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:49 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:05:49.947 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:49 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:05:49.947 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:49 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:05:49.948 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:49 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:05:49.948 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:49 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:05:49.948 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:49 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:05:49.948 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:49 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:05:49.948 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:49 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:05:49.948 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:49 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:05:49.948 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:49 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:05:49.948 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:49 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:05:49.948 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:49 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:05:49.948 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:49 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:05:49.948 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:49 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:05:49.948 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:49 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:05:49.948 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:49 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:05:49.948 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:49 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:05:49.948 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:49 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:05:49.949 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:49 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:05:49.949 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:49 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:05:49.949 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:49 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:05:49.949 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:49 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:05:49.949 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:49 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:05:49.949 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:49 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:05:49.949 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:49 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:05:49.949 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:49 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:05:49.949 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:49 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:05:49.949 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:49 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:05:49.949 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:49 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:05:49.949 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:49 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:05:49.950 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:49 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:05:49.950 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:49 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:05:49.950 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:49 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:05:49.950 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:49 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:05:49.950 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:49 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:05:49.950 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:49 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:05:49.950 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:49 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:05:49.950 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:49 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:05:49.950 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:49 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:05:49.950 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:49 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:05:49.950 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:49 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:05:49.950 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:49 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:05:49.950 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:49 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:05:49.950 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:49 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:05:49.950 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:49 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:05:49.950 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:49 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:05:49.951 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:49 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:05:49.951 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:49 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:05:49.951 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:49 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:05:49.951 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:49 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:05:49.951 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:49 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:05:49.951 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:49 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:05:49.951 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:49 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:05:49.951 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:49 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:05:49.951 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:49 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:05:49.951 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:49 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:05:49.998 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:49 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:05:49.998 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:49 smithi181 ceph-mon[115276]: from='client.25136 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T14:05:49.998 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:49 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:05:49.998 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:49 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:05:49.998 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:49 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:05:49.998 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:49 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:05:49.998 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:49 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:05:49.998 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:49 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:05:49.998 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:49 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:05:49.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:49 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:05:49.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:49 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:05:49.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:49 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:05:49.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:49 smithi181 ceph-mon[115276]: pgmap v74: 161 pgs: 161 active+clean; 585 KiB data, 119 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T14:05:49.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:49 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:05:49.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:49 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:05:49.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:49 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:05:49.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:49 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:05:49.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:49 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:05:49.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:49 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:05:49.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:49 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:05:49.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:49 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:05:49.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:49 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:05:49.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:49 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:05:50.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:49 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:05:50.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:49 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:05:50.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:49 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:05:50.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:49 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:05:50.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:49 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:05:50.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:49 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:05:50.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:49 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:05:50.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:49 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:05:50.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:49 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:05:50.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:49 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:05:50.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:49 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:05:50.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:49 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:05:50.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:49 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:05:50.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:49 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:05:50.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:49 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:05:50.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:49 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:05:50.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:49 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:05:50.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:49 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:05:50.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:49 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:05:50.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:49 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:05:50.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:49 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:05:50.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:49 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:05:50.002 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:49 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:05:50.002 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:49 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:05:50.002 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:49 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:05:50.002 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:49 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:05:50.002 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:49 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:05:50.002 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:49 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:05:50.002 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:49 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:05:50.002 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:49 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:05:50.002 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:49 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:05:50.002 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:49 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:05:50.002 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:49 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:05:50.002 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:49 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:05:50.002 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:49 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:05:50.002 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:49 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:05:50.003 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:49 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:05:50.003 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:49 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:05:50.003 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:49 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:05:50.003 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:49 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:05:50.003 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:49 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:05:50.003 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:49 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:05:50.003 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:49 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:05:50.003 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:49 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:05:50.003 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:49 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:05:50.896 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:50 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:05:50.896 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:50 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:05:50.897 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:50 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:05:50.897 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:50 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:05:50.897 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:50 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:05:50.897 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:50 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:05:50.897 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:50 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:05:50.897 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:50 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:05:50.897 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:50 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:05:50.897 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:50 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:05:50.897 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:50 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:05:50.897 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:50 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:05:50.897 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:50 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:05:50.897 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:50 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:05:50.897 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:50 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:05:50.897 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:50 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:05:50.897 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:50 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:05:50.898 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:50 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:05:50.898 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:50 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:05:50.898 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:50 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:05:50.898 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:50 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:05:50.898 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:50 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:05:50.898 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:50 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:05:50.898 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:50 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:05:50.898 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:50 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:05:50.898 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:50 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:05:50.898 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:50 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:05:50.898 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:50 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:05:50.898 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:50 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:05:50.898 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:50 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:05:50.898 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:50 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:05:50.899 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:50 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:05:50.899 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:50 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:05:50.899 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:50 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:05:50.899 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:50 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:05:50.899 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:50 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:05:50.899 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:50 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:05:50.899 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:50 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:05:50.899 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:50 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:05:50.899 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:50 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:05:50.899 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:50 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:05:50.900 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:50 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:05:50.900 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:50 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:05:50.900 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:50 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:05:50.900 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:50 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:05:50.900 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:50 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:05:50.900 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:50 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:05:50.900 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:50 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:05:50.900 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:50 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:05:50.900 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:50 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:05:50.900 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:50 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:05:50.900 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:50 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:05:50.900 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:50 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:05:50.900 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:50 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:05:50.901 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:50 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:05:50.901 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:50 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:05:50.901 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:50 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:05:50.901 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:50 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:05:50.901 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:50 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:05:50.901 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:50 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:05:50.901 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:50 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:05:50.901 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:50 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:05:50.902 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:50 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:05:50.902 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:50 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:05:50.902 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:50 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:05:50.902 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:50 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:05:50.902 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:50 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:05:50.902 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:50 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:05:50.902 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:50 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:05:50.902 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:50 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:05:50.902 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:50 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:05:50.902 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:50 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:05:50.902 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:50 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:05:50.902 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:50 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:05:50.902 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:50 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:05:50.903 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:50 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:05:50.903 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:50 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:05:50.903 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:50 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:05:50.903 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:50 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:05:50.903 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:50 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:05:50.903 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:50 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:05:50.903 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:50 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:05:50.903 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:50 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:05:50.903 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:50 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:05:50.903 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:50 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:05:50.903 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:50 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:05:50.903 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:50 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:05:50.903 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:50 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:05:50.904 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:50 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:05:50.904 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:50 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:05:50.904 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:50 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:05:50.904 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:50 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:05:50.904 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:50 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:05:50.904 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:50 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:05:50.904 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:50 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:05:50.904 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:50 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:05:50.904 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:50 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:05:50.904 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:50 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:05:50.904 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:50 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:05:50.904 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:50 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:05:50.904 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:50 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:05:50.904 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:50 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:05:50.998 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:50 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:05:50.998 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:50 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:05:50.998 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:50 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:05:50.998 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:50 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:05:50.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:50 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:05:50.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:50 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:05:50.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:50 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:05:50.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:50 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:05:50.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:50 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:05:50.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:50 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:05:50.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:50 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:05:50.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:50 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:05:50.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:50 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:05:50.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:50 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:05:50.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:50 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:05:50.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:50 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:05:50.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:50 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:05:51.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:50 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:05:51.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:50 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:05:51.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:50 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:05:51.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:50 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:05:51.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:50 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:05:51.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:50 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:05:51.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:50 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:05:51.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:50 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:05:51.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:50 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:05:51.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:50 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:05:51.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:50 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:05:51.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:50 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:05:51.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:50 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:05:51.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:50 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:05:51.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:50 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:05:51.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:50 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:05:51.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:50 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:05:51.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:50 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:05:51.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:50 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:05:51.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:50 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:05:51.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:50 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:05:51.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:50 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:05:51.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:50 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:05:51.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:50 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:05:51.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:50 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:05:51.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:50 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:05:51.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:50 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:05:51.002 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:50 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:05:51.002 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:50 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:05:51.002 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:50 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:05:51.002 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:50 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:05:51.002 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:50 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:05:51.002 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:50 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:05:51.002 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:50 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:05:51.998 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:51 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:05:51.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:51 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:05:51.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:51 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:05:51.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:51 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:05:51.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:51 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:05:51.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:51 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:05:51.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:51 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:05:51.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:51 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:05:51.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:51 smithi181 ceph-mon[115276]: pgmap v75: 161 pgs: 161 active+clean; 585 KiB data, 119 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-03-30T14:05:51.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:51 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:05:51.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:51 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:05:51.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:51 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:05:51.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:51 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:05:52.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:51 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:05:52.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:51 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:05:52.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:51 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:05:52.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:51 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:05:52.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:51 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:05:52.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:51 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:05:52.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:51 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:05:52.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:51 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:05:52.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:51 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:05:52.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:51 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:05:52.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:51 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:05:52.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:51 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:05:52.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:51 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:05:52.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:51 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-03-30T14:05:52.033 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:51 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:05:52.033 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:51 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:05:52.033 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:51 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:05:52.033 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:51 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:05:52.033 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:51 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:05:52.033 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:51 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:05:52.033 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:51 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:05:52.033 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:51 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:05:52.034 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:51 smithi099 ceph-mon[137093]: pgmap v75: 161 pgs: 161 active+clean; 585 KiB data, 119 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-03-30T14:05:52.034 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:51 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:05:52.034 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:51 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:05:52.034 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:51 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:05:52.034 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:51 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:05:52.034 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:51 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:05:52.034 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:51 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:05:52.034 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:51 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:05:52.034 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:51 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:05:52.034 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:51 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:05:52.034 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:51 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:05:52.034 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:51 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:05:52.034 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:51 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:05:52.034 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:51 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:05:52.035 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:51 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:05:52.035 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:51 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:05:52.035 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:51 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:05:52.035 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:51 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:05:52.035 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:51 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-03-30T14:05:52.035 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:51 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:05:52.035 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:51 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:05:52.035 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:51 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:05:52.035 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:51 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:05:52.035 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:51 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:05:52.035 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:51 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:05:52.035 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:51 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:05:52.036 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:51 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:05:52.036 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:51 smithi099 ceph-mon[143401]: pgmap v75: 161 pgs: 161 active+clean; 585 KiB data, 119 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-03-30T14:05:52.036 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:51 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:05:52.036 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:51 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:05:52.036 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:51 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:05:52.036 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:51 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:05:52.036 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:51 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:05:52.036 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:51 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:05:52.036 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:51 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:05:52.036 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:51 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:05:52.036 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:51 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:05:52.036 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:51 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:05:52.036 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:51 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:05:52.036 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:51 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:05:52.036 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:51 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:05:52.037 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:51 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:05:52.037 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:51 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:05:52.037 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:51 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:05:52.037 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:51 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:05:52.037 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:51 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-03-30T14:05:52.981 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:52 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:05:52.981 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:52 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:05:52.981 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:52 smithi099 ceph-mon[137093]: from='mon.2 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-03-30T14:05:52.981 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:52 smithi099 ceph-mon[137093]: Upgrade: osd.1 is safe to restart 2024-03-30T14:05:52.981 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:52 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:05:52.981 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:52 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T14:05:52.981 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:52 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:05:52.981 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:52 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:05:52.981 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:52 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:05:52.981 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:52 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:05:52.982 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:52 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:05:52.982 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:52 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:05:52.982 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:52 smithi099 ceph-mon[143401]: from='mon.2 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-03-30T14:05:52.982 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:52 smithi099 ceph-mon[143401]: Upgrade: osd.1 is safe to restart 2024-03-30T14:05:52.982 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:52 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:05:52.982 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:52 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T14:05:52.982 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:52 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:05:52.982 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:52 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:05:52.982 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:52 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:05:52.982 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:52 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:05:52.998 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:52 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:05:52.998 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:52 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:05:52.998 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:52 smithi181 ceph-mon[115276]: from='mon.2 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-03-30T14:05:52.998 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:52 smithi181 ceph-mon[115276]: Upgrade: osd.1 is safe to restart 2024-03-30T14:05:52.998 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:52 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:05:52.998 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:52 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T14:05:52.998 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:52 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:05:52.998 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:52 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:05:52.998 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:52 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:05:52.998 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:52 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:05:53.998 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:53 smithi181 ceph-mon[115276]: pgmap v76: 161 pgs: 161 active+clean; 585 KiB data, 119 MiB used, 715 GiB / 715 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-03-30T14:05:54.078 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:53 smithi099 ceph-mon[137093]: pgmap v76: 161 pgs: 161 active+clean; 585 KiB data, 119 MiB used, 715 GiB / 715 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-03-30T14:05:54.079 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:53 smithi099 ceph-mon[143401]: pgmap v76: 161 pgs: 161 active+clean; 585 KiB data, 119 MiB used, 715 GiB / 715 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-03-30T14:05:55.079 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:54 smithi099 ceph-mon[137093]: Upgrade: Updating osd.1 2024-03-30T14:05:55.079 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:54 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:05:55.080 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:54 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-03-30T14:05:55.080 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:54 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:05:55.080 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:54 smithi099 ceph-mon[137093]: Deploying daemon osd.1 on smithi099 2024-03-30T14:05:55.080 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:54 smithi099 ceph-mon[137093]: pgmap v77: 161 pgs: 161 active+clean; 585 KiB data, 119 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T14:05:55.081 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 14:05:54 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[71049]: ::ffff:172.21.15.181 - - [30/Mar/2024:14:05:54] "GET /metrics HTTP/1.1" 200 38170 "" "Prometheus/2.43.0" 2024-03-30T14:05:55.081 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:54 smithi099 ceph-mon[143401]: Upgrade: Updating osd.1 2024-03-30T14:05:55.081 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:54 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:05:55.081 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:54 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-03-30T14:05:55.081 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:54 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:05:55.081 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:54 smithi099 ceph-mon[143401]: Deploying daemon osd.1 on smithi099 2024-03-30T14:05:55.081 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:54 smithi099 ceph-mon[143401]: pgmap v77: 161 pgs: 161 active+clean; 585 KiB data, 119 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T14:05:55.248 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:54 smithi181 ceph-mon[115276]: Upgrade: Updating osd.1 2024-03-30T14:05:55.248 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:54 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:05:55.248 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:54 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-03-30T14:05:55.248 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:54 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:05:55.248 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:54 smithi181 ceph-mon[115276]: Deploying daemon osd.1 on smithi099 2024-03-30T14:05:55.248 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:54 smithi181 ceph-mon[115276]: pgmap v77: 161 pgs: 161 active+clean; 585 KiB data, 119 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T14:05:56.940 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:56 smithi099 ceph-mon[137093]: pgmap v78: 161 pgs: 161 active+clean; 585 KiB data, 119 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T14:05:56.940 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:56 smithi099 ceph-mon[143401]: pgmap v78: 161 pgs: 161 active+clean; 585 KiB data, 119 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T14:05:57.248 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:56 smithi181 ceph-mon[115276]: pgmap v78: 161 pgs: 161 active+clean; 585 KiB data, 119 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T14:05:58.305 INFO:teuthology.orchestra.run.smithi099.stdout:true 2024-03-30T14:05:59.018 INFO:teuthology.orchestra.run.smithi099.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-03-30T14:05:59.018 INFO:teuthology.orchestra.run.smithi099.stdout:agent.smithi099 smithi099 running 6s ago 34m - - 2024-03-30T14:05:59.018 INFO:teuthology.orchestra.run.smithi099.stdout:agent.smithi181 smithi181 running 11s ago 34m - - 2024-03-30T14:05:59.018 INFO:teuthology.orchestra.run.smithi099.stdout:alertmanager.a smithi099 *:9093,9094 running (4m) 6s ago 28m 26.9M - 0.25.0 c8568f914cd2 08735152b67d 2024-03-30T14:05:59.018 INFO:teuthology.orchestra.run.smithi099.stdout:grafana.a smithi181 *:3000 running (4m) 11s ago 28m 79.4M - 9.4.12 2bacad6d85d8 d599aa7730d6 2024-03-30T14:05:59.018 INFO:teuthology.orchestra.run.smithi099.stdout:iscsi.foo.smithi099.qyjuvr smithi099 running (7m) 6s ago 27m 59.5M - 3.5 e1d6a67b021e 2f859af6bc2a 2024-03-30T14:05:59.018 INFO:teuthology.orchestra.run.smithi099.stdout:mgr.x smithi181 *:8443,9283,8765 running (6m) 11s ago 33m 449M - 19.0.0-1967-g4e50bbcd b0c4478f1d83 f269106f7913 2024-03-30T14:05:59.018 INFO:teuthology.orchestra.run.smithi099.stdout:mgr.y smithi099 *:8443,9283,8765 running (17m) 6s ago 35m 516M - 19.0.0-1967-g4e50bbcd b0c4478f1d83 0d464b8c1d18 2024-03-30T14:05:59.019 INFO:teuthology.orchestra.run.smithi099.stdout:mon.a smithi099 running (2m) 6s ago 35m 48.2M 2048M 19.0.0-1967-g4e50bbcd b0c4478f1d83 f19388464dfd 2024-03-30T14:05:59.019 INFO:teuthology.orchestra.run.smithi099.stdout:mon.b smithi181 running (3m) 11s ago 33m 47.5M 2048M 19.0.0-1967-g4e50bbcd b0c4478f1d83 0468ed087cdd 2024-03-30T14:05:59.019 INFO:teuthology.orchestra.run.smithi099.stdout:mon.c smithi099 running (101s) 6s ago 33m 41.1M 2048M 19.0.0-1967-g4e50bbcd b0c4478f1d83 731056a2fea6 2024-03-30T14:05:59.019 INFO:teuthology.orchestra.run.smithi099.stdout:node-exporter.a smithi099 *:9100 running (5m) 6s ago 29m 16.9M - 1.5.0 0da6a335fe13 4a3f1f6e7068 2024-03-30T14:05:59.019 INFO:teuthology.orchestra.run.smithi099.stdout:node-exporter.b smithi181 *:9100 running (5m) 11s ago 29m 15.7M - 1.5.0 0da6a335fe13 acea317b5f5d 2024-03-30T14:05:59.019 INFO:teuthology.orchestra.run.smithi099.stdout:osd.0 smithi099 running (23s) 6s ago 33m 50.3M 4096M 19.0.0-1967-g4e50bbcd b0c4478f1d83 d97d48cb3314 2024-03-30T14:05:59.019 INFO:teuthology.orchestra.run.smithi099.stdout:osd.1 smithi099 running (32m) 6s ago 32m 58.8M 4096M 17.2.0 e1d6a67b021e c4af0fd7071a 2024-03-30T14:05:59.019 INFO:teuthology.orchestra.run.smithi099.stdout:osd.2 smithi099 running (32m) 6s ago 32m 50.5M 4096M 17.2.0 e1d6a67b021e 8e4e805a7e20 2024-03-30T14:05:59.019 INFO:teuthology.orchestra.run.smithi099.stdout:osd.3 smithi099 running (31m) 6s ago 31m 56.2M 4096M 17.2.0 e1d6a67b021e 718812bcf065 2024-03-30T14:05:59.019 INFO:teuthology.orchestra.run.smithi099.stdout:osd.4 smithi181 running (31m) 11s ago 31m 55.5M 4096M 17.2.0 e1d6a67b021e 5e205434e973 2024-03-30T14:05:59.019 INFO:teuthology.orchestra.run.smithi099.stdout:osd.5 smithi181 running (31m) 11s ago 31m 53.0M 4096M 17.2.0 e1d6a67b021e e330c920f152 2024-03-30T14:05:59.019 INFO:teuthology.orchestra.run.smithi099.stdout:osd.6 smithi181 running (30m) 11s ago 30m 53.0M 4096M 17.2.0 e1d6a67b021e 81d889ea213d 2024-03-30T14:05:59.019 INFO:teuthology.orchestra.run.smithi099.stdout:osd.7 smithi181 running (30m) 11s ago 30m 53.3M 4096M 17.2.0 e1d6a67b021e c08b1839dd7e 2024-03-30T14:05:59.019 INFO:teuthology.orchestra.run.smithi099.stdout:prometheus.a smithi181 *:9095 running (5m) 11s ago 29m 70.3M - 2.43.0 a07b618ecd1d 004088bdf70e 2024-03-30T14:05:59.020 INFO:teuthology.orchestra.run.smithi099.stdout:rgw.foo.smithi099.fxjbmp smithi099 *:8000 running (27m) 6s ago 27m 77.9M - 17.2.0 e1d6a67b021e 400b28b3f650 2024-03-30T14:05:59.020 INFO:teuthology.orchestra.run.smithi099.stdout:rgw.foo.smithi181.wfqwti smithi181 *:8000 running (27m) 11s ago 27m 77.5M - 17.2.0 e1d6a67b021e 97e1b130f9d4 2024-03-30T14:05:59.020 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:58 smithi099 ceph-mon[137093]: from='client.25136 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T14:05:59.020 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:58 smithi099 ceph-mon[137093]: from='client.64216 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T14:05:59.020 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:58 smithi099 ceph-mon[137093]: from='client.54222 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T14:05:59.020 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:58 smithi099 ceph-mon[137093]: pgmap v79: 161 pgs: 161 active+clean; 585 KiB data, 119 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T14:05:59.020 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:58 smithi099 ceph-mon[143401]: from='client.25136 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T14:05:59.020 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:58 smithi099 ceph-mon[143401]: from='client.64216 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T14:05:59.021 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:58 smithi099 ceph-mon[143401]: from='client.54222 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T14:05:59.021 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:58 smithi099 ceph-mon[143401]: pgmap v79: 161 pgs: 161 active+clean; 585 KiB data, 119 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T14:05:59.021 INFO:journalctl@ceph.osd.1.smithi099.stdout:Mar 30 14:05:58 smithi099 systemd[1]: Stopping Ceph osd.1 for 98ebaeb8-ee99-11ee-b647-cb9ed24678a4... 2024-03-30T14:05:59.248 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:58 smithi181 ceph-mon[115276]: from='client.25136 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T14:05:59.248 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:58 smithi181 ceph-mon[115276]: from='client.64216 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T14:05:59.248 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:58 smithi181 ceph-mon[115276]: from='client.54222 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T14:05:59.248 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:58 smithi181 ceph-mon[115276]: pgmap v79: 161 pgs: 161 active+clean; 585 KiB data, 119 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T14:05:59.328 INFO:journalctl@ceph.osd.1.smithi099.stdout:Mar 30 14:05:59 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-1[35953]: 2024-03-30T14:05:59.161+0000 7ff8bd7d2700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.1 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-03-30T14:05:59.329 INFO:journalctl@ceph.osd.1.smithi099.stdout:Mar 30 14:05:59 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-1[35953]: 2024-03-30T14:05:59.161+0000 7ff8bd7d2700 -1 osd.1 118 *** Got signal Terminated *** 2024-03-30T14:05:59.329 INFO:journalctl@ceph.osd.1.smithi099.stdout:Mar 30 14:05:59 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-1[35953]: 2024-03-30T14:05:59.161+0000 7ff8bd7d2700 -1 osd.1 118 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-03-30T14:05:59.420 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-03-30T14:05:59.420 INFO:teuthology.orchestra.run.smithi099.stdout: "mon": { 2024-03-30T14:05:59.420 INFO:teuthology.orchestra.run.smithi099.stdout: "ceph version 19.0.0-1967-g4e50bbcd (4e50bbcdd1630c7760b708f3a5b4d38a121e66cb) squid (dev)": 3 2024-03-30T14:05:59.421 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T14:05:59.421 INFO:teuthology.orchestra.run.smithi099.stdout: "mgr": { 2024-03-30T14:05:59.421 INFO:teuthology.orchestra.run.smithi099.stdout: "ceph version 19.0.0-1967-g4e50bbcd (4e50bbcdd1630c7760b708f3a5b4d38a121e66cb) squid (dev)": 2 2024-03-30T14:05:59.421 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T14:05:59.421 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": { 2024-03-30T14:05:59.421 INFO:teuthology.orchestra.run.smithi099.stdout: "ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)": 7, 2024-03-30T14:05:59.421 INFO:teuthology.orchestra.run.smithi099.stdout: "ceph version 19.0.0-1967-g4e50bbcd (4e50bbcdd1630c7760b708f3a5b4d38a121e66cb) squid (dev)": 1 2024-03-30T14:05:59.421 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T14:05:59.421 INFO:teuthology.orchestra.run.smithi099.stdout: "rgw": { 2024-03-30T14:05:59.421 INFO:teuthology.orchestra.run.smithi099.stdout: "ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)": 2 2024-03-30T14:05:59.421 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T14:05:59.421 INFO:teuthology.orchestra.run.smithi099.stdout: "overall": { 2024-03-30T14:05:59.421 INFO:teuthology.orchestra.run.smithi099.stdout: "ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)": 9, 2024-03-30T14:05:59.421 INFO:teuthology.orchestra.run.smithi099.stdout: "ceph version 19.0.0-1967-g4e50bbcd (4e50bbcdd1630c7760b708f3a5b4d38a121e66cb) squid (dev)": 6 2024-03-30T14:05:59.421 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-03-30T14:05:59.421 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-03-30T14:05:59.751 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-03-30T14:05:59.751 INFO:teuthology.orchestra.run.smithi099.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph:4e50bbcdd1630c7760b708f3a5b4d38a121e66cb", 2024-03-30T14:05:59.751 INFO:teuthology.orchestra.run.smithi099.stdout: "in_progress": true, 2024-03-30T14:05:59.751 INFO:teuthology.orchestra.run.smithi099.stdout: "which": "Upgrading daemons of type(s) osd. Upgrade limited to 2 daemons (1 remaining).", 2024-03-30T14:05:59.751 INFO:teuthology.orchestra.run.smithi099.stdout: "services_complete": [], 2024-03-30T14:05:59.751 INFO:teuthology.orchestra.run.smithi099.stdout: "progress": "1/8 daemons upgraded", 2024-03-30T14:05:59.751 INFO:teuthology.orchestra.run.smithi099.stdout: "message": "Currently upgrading osd daemons", 2024-03-30T14:05:59.751 INFO:teuthology.orchestra.run.smithi099.stdout: "is_paused": false 2024-03-30T14:05:59.752 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-03-30T14:06:00.077 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:59 smithi099 ceph-mon[137093]: from='client.64228 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T14:06:00.078 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:59 smithi099 ceph-mon[137093]: osd.1 marked itself down and dead 2024-03-30T14:06:00.078 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:05:59 smithi099 ceph-mon[137093]: from='client.? 172.21.15.99:0/4130391587' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:06:00.078 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:59 smithi099 ceph-mon[143401]: from='client.64228 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T14:06:00.078 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:59 smithi099 ceph-mon[143401]: osd.1 marked itself down and dead 2024-03-30T14:06:00.078 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:05:59 smithi099 ceph-mon[143401]: from='client.? 172.21.15.99:0/4130391587' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:06:00.248 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:59 smithi181 ceph-mon[115276]: from='client.64228 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T14:06:00.248 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:59 smithi181 ceph-mon[115276]: osd.1 marked itself down and dead 2024-03-30T14:06:00.248 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:05:59 smithi181 ceph-mon[115276]: from='client.? 172.21.15.99:0/4130391587' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:06:00.329 INFO:journalctl@ceph.osd.1.smithi099.stdout:Mar 30 14:06:00 smithi099 podman[155369]: 2024-03-30 14:06:00.128181001 +0000 UTC m=+1.096279729 container died c4af0fd7071a7e8ccdc0babf532235e443c80415d415c67ef030beb1c243f0bc (image=quay.io/ceph/ceph@sha256:12a0a4f43413fd97a14a3d47a3451b2d2df50020835bb93db666209f3f77617a, name=ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-1, architecture=x86_64, vcs-ref=f1ee6e37554363ec55e0035aba1a693d3627fdeb, io.openshift.expose-services=, vcs-type=git, io.openshift.tags=base centos centos-stream, maintainer=Guillaume Abrioux , summary=Provides a CentOS Stream container based on the Red Hat Universal Base Image, version=8, build-date=2022-05-03T08:36:31.336870, ceph=True, release=754, GIT_CLEAN=True, RELEASE=HEAD, com.redhat.build-host=cpt-1002.osbs.prod.upshift.rdu2.redhat.com, url=https://access.redhat.com/containers/#/registry.access.redhat.com/ubi8/images/8.6-754, io.k8s.description=The Universal Base Image is designed and engineered to be the base layer for all of your containerized applications, middleware and utilities. This base image is freely redistributable, but Red Hat only supports Red Hat technologies through subscriptions for Red Hat products. This image is maintained by Red Hat and updated regularly., io.buildah.version=1.19.8, io.k8s.display-name=CentOS Stream 8, name=centos-stream, com.redhat.component=centos-stream-container, GIT_BRANCH=HEAD, com.redhat.license_terms=https://centos.org/legal/licensing-policy/, CEPH_POINT_RELEASE=-17.2.0, GIT_COMMIT=b613db0f44179c0940781c1c7fe04e1acb7093ac, description=CentOS Stream is a continuously delivered distro that tracks just ahead of Red Hat Enterprise Linux development. This image takes the Red Hat UBI and layers on content from CentOS Stream, vendor=Red Hat, Inc., distribution-scope=public, GIT_REPO=https://github.com/ceph/ceph-container.git) 2024-03-30T14:06:00.795 INFO:journalctl@ceph.osd.1.smithi099.stdout:Mar 30 14:06:00 smithi099 podman[155369]: 2024-03-30 14:06:00.626086973 +0000 UTC m=+1.594185710 container cleanup c4af0fd7071a7e8ccdc0babf532235e443c80415d415c67ef030beb1c243f0bc (image=quay.io/ceph/ceph@sha256:12a0a4f43413fd97a14a3d47a3451b2d2df50020835bb93db666209f3f77617a, name=ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-1, io.buildah.version=1.19.8, io.openshift.tags=base centos centos-stream, build-date=2022-05-03T08:36:31.336870, summary=Provides a CentOS Stream container based on the Red Hat Universal Base Image, vendor=Red Hat, Inc., url=https://access.redhat.com/containers/#/registry.access.redhat.com/ubi8/images/8.6-754, vcs-type=git, GIT_CLEAN=True, RELEASE=HEAD, architecture=x86_64, description=CentOS Stream is a continuously delivered distro that tracks just ahead of Red Hat Enterprise Linux development. This image takes the Red Hat UBI and layers on content from CentOS Stream, com.redhat.license_terms=https://centos.org/legal/licensing-policy/, distribution-scope=public, GIT_COMMIT=b613db0f44179c0940781c1c7fe04e1acb7093ac, io.k8s.display-name=CentOS Stream 8, com.redhat.component=centos-stream-container, maintainer=Guillaume Abrioux , ceph=True, GIT_REPO=https://github.com/ceph/ceph-container.git, com.redhat.build-host=cpt-1002.osbs.prod.upshift.rdu2.redhat.com, GIT_BRANCH=HEAD, release=754, CEPH_POINT_RELEASE=-17.2.0, version=8, name=centos-stream, io.openshift.expose-services=, io.k8s.description=The Universal Base Image is designed and engineered to be the base layer for all of your containerized applications, middleware and utilities. This base image is freely redistributable, but Red Hat only supports Red Hat technologies through subscriptions for Red Hat products. This image is maintained by Red Hat and updated regularly., vcs-ref=f1ee6e37554363ec55e0035aba1a693d3627fdeb) 2024-03-30T14:06:00.795 INFO:journalctl@ceph.osd.1.smithi099.stdout:Mar 30 14:06:00 smithi099 bash[155369]: ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-1 2024-03-30T14:06:00.998 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:00 smithi181 ceph-mon[115276]: from='client.64240 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T14:06:00.998 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:00 smithi181 ceph-mon[115276]: Health check failed: 1 osds down (OSD_DOWN) 2024-03-30T14:06:00.998 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:00 smithi181 ceph-mon[115276]: failed to encode map e119 with expected crc 2024-03-30T14:06:00.998 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:00 smithi181 ceph-mon[115276]: failed to encode map e119 with expected crc 2024-03-30T14:06:00.998 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:00 smithi181 ceph-mon[115276]: osdmap e119: 8 total, 7 up, 8 in 2024-03-30T14:06:00.998 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:00 smithi181 ceph-mon[115276]: failed to encode map e119 with expected crc 2024-03-30T14:06:00.998 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:00 smithi181 ceph-mon[115276]: failed to encode map e119 with expected crc 2024-03-30T14:06:00.998 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:00 smithi181 ceph-mon[115276]: failed to encode map e119 with expected crc 2024-03-30T14:06:00.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:00 smithi181 ceph-mon[115276]: failed to encode map e119 with expected crc 2024-03-30T14:06:00.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:00 smithi181 ceph-mon[115276]: failed to encode map e119 with expected crc 2024-03-30T14:06:00.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:00 smithi181 ceph-mon[115276]: pgmap v81: 161 pgs: 6 peering, 20 stale+active+clean, 135 active+clean; 585 KiB data, 119 MiB used, 715 GiB / 715 GiB avail; 511 B/s rd, 0 op/s 2024-03-30T14:06:01.079 INFO:journalctl@ceph.osd.1.smithi099.stdout:Mar 30 14:06:00 smithi099 podman[155434]: 2024-03-30 14:06:00.91141731 +0000 UTC m=+0.775446398 container remove c4af0fd7071a7e8ccdc0babf532235e443c80415d415c67ef030beb1c243f0bc (image=quay.io/ceph/ceph@sha256:12a0a4f43413fd97a14a3d47a3451b2d2df50020835bb93db666209f3f77617a, name=ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-1, com.redhat.license_terms=https://centos.org/legal/licensing-policy/, com.redhat.build-host=cpt-1002.osbs.prod.upshift.rdu2.redhat.com, name=centos-stream, release=754, GIT_CLEAN=True, GIT_REPO=https://github.com/ceph/ceph-container.git, CEPH_POINT_RELEASE=-17.2.0, distribution-scope=public, io.openshift.expose-services=, summary=Provides a CentOS Stream container based on the Red Hat Universal Base Image, io.buildah.version=1.19.8, maintainer=Guillaume Abrioux , build-date=2022-05-03T08:36:31.336870, vcs-ref=f1ee6e37554363ec55e0035aba1a693d3627fdeb, GIT_COMMIT=b613db0f44179c0940781c1c7fe04e1acb7093ac, RELEASE=HEAD, vendor=Red Hat, Inc., com.redhat.component=centos-stream-container, ceph=True, url=https://access.redhat.com/containers/#/registry.access.redhat.com/ubi8/images/8.6-754, io.k8s.display-name=CentOS Stream 8, architecture=x86_64, description=CentOS Stream is a continuously delivered distro that tracks just ahead of Red Hat Enterprise Linux development. This image takes the Red Hat UBI and layers on content from CentOS Stream, version=8, io.openshift.tags=base centos centos-stream, GIT_BRANCH=HEAD, io.k8s.description=The Universal Base Image is designed and engineered to be the base layer for all of your containerized applications, middleware and utilities. This base image is freely redistributable, but Red Hat only supports Red Hat technologies through subscriptions for Red Hat products. This image is maintained by Red Hat and updated regularly., vcs-type=git) 2024-03-30T14:06:01.079 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:00 smithi099 ceph-mon[143401]: from='client.64240 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T14:06:01.079 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:00 smithi099 ceph-mon[143401]: Health check failed: 1 osds down (OSD_DOWN) 2024-03-30T14:06:01.079 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:00 smithi099 ceph-mon[143401]: failed to encode map e119 with expected crc 2024-03-30T14:06:01.079 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:00 smithi099 ceph-mon[143401]: failed to encode map e119 with expected crc 2024-03-30T14:06:01.079 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:00 smithi099 ceph-mon[143401]: osdmap e119: 8 total, 7 up, 8 in 2024-03-30T14:06:01.079 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:00 smithi099 ceph-mon[143401]: failed to encode map e119 with expected crc 2024-03-30T14:06:01.079 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:00 smithi099 ceph-mon[143401]: failed to encode map e119 with expected crc 2024-03-30T14:06:01.080 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:00 smithi099 ceph-mon[143401]: failed to encode map e119 with expected crc 2024-03-30T14:06:01.080 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:00 smithi099 ceph-mon[143401]: failed to encode map e119 with expected crc 2024-03-30T14:06:01.080 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:00 smithi099 ceph-mon[143401]: failed to encode map e119 with expected crc 2024-03-30T14:06:01.080 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:00 smithi099 ceph-mon[143401]: pgmap v81: 161 pgs: 6 peering, 20 stale+active+clean, 135 active+clean; 585 KiB data, 119 MiB used, 715 GiB / 715 GiB avail; 511 B/s rd, 0 op/s 2024-03-30T14:06:01.080 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:00 smithi099 ceph-mon[137093]: from='client.64240 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T14:06:01.080 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:00 smithi099 ceph-mon[137093]: Health check failed: 1 osds down (OSD_DOWN) 2024-03-30T14:06:01.080 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:00 smithi099 ceph-mon[137093]: failed to encode map e119 with expected crc 2024-03-30T14:06:01.080 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:00 smithi099 ceph-mon[137093]: failed to encode map e119 with expected crc 2024-03-30T14:06:01.080 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:00 smithi099 ceph-mon[137093]: osdmap e119: 8 total, 7 up, 8 in 2024-03-30T14:06:01.080 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:00 smithi099 ceph-mon[137093]: failed to encode map e119 with expected crc 2024-03-30T14:06:01.080 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:00 smithi099 ceph-mon[137093]: failed to encode map e119 with expected crc 2024-03-30T14:06:01.080 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:00 smithi099 ceph-mon[137093]: failed to encode map e119 with expected crc 2024-03-30T14:06:01.080 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:00 smithi099 ceph-mon[137093]: failed to encode map e119 with expected crc 2024-03-30T14:06:01.081 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:00 smithi099 ceph-mon[137093]: failed to encode map e119 with expected crc 2024-03-30T14:06:01.081 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:00 smithi099 ceph-mon[137093]: pgmap v81: 161 pgs: 6 peering, 20 stale+active+clean, 135 active+clean; 585 KiB data, 119 MiB used, 715 GiB / 715 GiB avail; 511 B/s rd, 0 op/s 2024-03-30T14:06:01.557 INFO:journalctl@ceph.osd.1.smithi099.stdout:Mar 30 14:06:01 smithi099 podman[155538]: 2024-03-30 14:06:01.151733358 +0000 UTC m=+0.017439910 image pull b0c4478f1d83795df4d538bf108aee5fac57194348fb16dcdbb3115f3e2fe95e quay.ceph.io/ceph-ci/ceph:4e50bbcdd1630c7760b708f3a5b4d38a121e66cb 2024-03-30T14:06:01.557 INFO:journalctl@ceph.osd.1.smithi099.stdout:Mar 30 14:06:01 smithi099 podman[155538]: 2024-03-30 14:06:01.253973363 +0000 UTC m=+0.119679915 container create c2feaba988cb7218fe5d049557df9da1128064c9b41cc624c5732a4dc5591eec (image=quay.ceph.io/ceph-ci/ceph:4e50bbcdd1630c7760b708f3a5b4d38a121e66cb, name=ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-1-deactivate, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, RELEASE=squid-4e50bbc, org.label-schema.build-date=20240326) 2024-03-30T14:06:01.557 INFO:journalctl@ceph.osd.1.smithi099.stdout:Mar 30 14:06:01 smithi099 podman[155538]: 2024-03-30 14:06:01.489674314 +0000 UTC m=+0.355380868 container init c2feaba988cb7218fe5d049557df9da1128064c9b41cc624c5732a4dc5591eec (image=quay.ceph.io/ceph-ci/ceph:4e50bbcdd1630c7760b708f3a5b4d38a121e66cb, name=ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-1-deactivate, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.build-date=20240326, org.label-schema.schema-version=1.0, RELEASE=squid-4e50bbc, ceph=True, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0) 2024-03-30T14:06:01.557 INFO:journalctl@ceph.osd.1.smithi099.stdout:Mar 30 14:06:01 smithi099 podman[155538]: 2024-03-30 14:06:01.492755017 +0000 UTC m=+0.358461575 container start c2feaba988cb7218fe5d049557df9da1128064c9b41cc624c5732a4dc5591eec (image=quay.ceph.io/ceph-ci/ceph:4e50bbcdd1630c7760b708f3a5b4d38a121e66cb, name=ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-1-deactivate, CEPH_POINT_RELEASE=, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , ceph=True, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, GIT_CLEAN=True, RELEASE=squid-4e50bbc, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240326, org.label-schema.vendor=CentOS) 2024-03-30T14:06:01.557 INFO:journalctl@ceph.osd.1.smithi099.stdout:Mar 30 14:06:01 smithi099 podman[155538]: 2024-03-30 14:06:01.564529533 +0000 UTC m=+0.430236097 container attach c2feaba988cb7218fe5d049557df9da1128064c9b41cc624c5732a4dc5591eec (image=quay.ceph.io/ceph-ci/ceph:4e50bbcdd1630c7760b708f3a5b4d38a121e66cb, name=ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-1-deactivate, org.label-schema.vendor=CentOS, RELEASE=squid-4e50bbc, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240326, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_CLEAN=True) 2024-03-30T14:06:01.829 INFO:journalctl@ceph.osd.1.smithi099.stdout:Mar 30 14:06:01 smithi099 podman[155538]: 2024-03-30 14:06:01.784402711 +0000 UTC m=+0.650109265 container died c2feaba988cb7218fe5d049557df9da1128064c9b41cc624c5732a4dc5591eec (image=quay.ceph.io/ceph-ci/ceph:4e50bbcdd1630c7760b708f3a5b4d38a121e66cb, name=ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-1-deactivate, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_CLEAN=True, ceph=True, GIT_BRANCH=HEAD, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, RELEASE=squid-4e50bbc, io.buildah.version=1.33.5, org.label-schema.build-date=20240326, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image) 2024-03-30T14:06:01.829 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:01 smithi099 ceph-mon[137093]: Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY) 2024-03-30T14:06:01.829 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:01 smithi099 ceph-mon[137093]: failed to encode map e120 with expected crc 2024-03-30T14:06:01.829 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:01 smithi099 ceph-mon[137093]: failed to encode map e120 with expected crc 2024-03-30T14:06:01.829 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:01 smithi099 ceph-mon[137093]: failed to encode map e120 with expected crc 2024-03-30T14:06:01.829 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:01 smithi099 ceph-mon[137093]: failed to encode map e120 with expected crc 2024-03-30T14:06:01.830 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:01 smithi099 ceph-mon[137093]: failed to encode map e120 with expected crc 2024-03-30T14:06:01.830 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:01 smithi099 ceph-mon[137093]: failed to encode map e120 with expected crc 2024-03-30T14:06:01.830 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:01 smithi099 ceph-mon[137093]: failed to encode map e120 with expected crc 2024-03-30T14:06:01.830 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:01 smithi099 ceph-mon[137093]: osdmap e120: 8 total, 7 up, 8 in 2024-03-30T14:06:01.830 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:01 smithi099 ceph-mon[137093]: failed to encode map e120 with expected crc 2024-03-30T14:06:01.830 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:01 smithi099 ceph-mon[137093]: failed to encode map e120 with expected crc 2024-03-30T14:06:01.830 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:01 smithi099 ceph-mon[137093]: failed to encode map e120 with expected crc 2024-03-30T14:06:01.830 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:01 smithi099 ceph-mon[137093]: failed to encode map e120 with expected crc 2024-03-30T14:06:01.830 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:01 smithi099 ceph-mon[137093]: failed to encode map e120 with expected crc 2024-03-30T14:06:01.830 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:01 smithi099 ceph-mon[143401]: Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY) 2024-03-30T14:06:01.830 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:01 smithi099 ceph-mon[143401]: failed to encode map e120 with expected crc 2024-03-30T14:06:01.830 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:01 smithi099 ceph-mon[143401]: failed to encode map e120 with expected crc 2024-03-30T14:06:01.831 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:01 smithi099 ceph-mon[143401]: failed to encode map e120 with expected crc 2024-03-30T14:06:01.831 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:01 smithi099 ceph-mon[143401]: failed to encode map e120 with expected crc 2024-03-30T14:06:01.831 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:01 smithi099 ceph-mon[143401]: failed to encode map e120 with expected crc 2024-03-30T14:06:01.831 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:01 smithi099 ceph-mon[143401]: failed to encode map e120 with expected crc 2024-03-30T14:06:01.831 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:01 smithi099 ceph-mon[143401]: failed to encode map e120 with expected crc 2024-03-30T14:06:01.831 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:01 smithi099 ceph-mon[143401]: osdmap e120: 8 total, 7 up, 8 in 2024-03-30T14:06:01.831 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:01 smithi099 ceph-mon[143401]: failed to encode map e120 with expected crc 2024-03-30T14:06:01.831 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:01 smithi099 ceph-mon[143401]: failed to encode map e120 with expected crc 2024-03-30T14:06:01.831 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:01 smithi099 ceph-mon[143401]: failed to encode map e120 with expected crc 2024-03-30T14:06:01.831 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:01 smithi099 ceph-mon[143401]: failed to encode map e120 with expected crc 2024-03-30T14:06:01.831 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:01 smithi099 ceph-mon[143401]: failed to encode map e120 with expected crc 2024-03-30T14:06:02.248 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:01 smithi181 ceph-mon[115276]: Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY) 2024-03-30T14:06:02.248 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:01 smithi181 ceph-mon[115276]: failed to encode map e120 with expected crc 2024-03-30T14:06:02.248 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:01 smithi181 ceph-mon[115276]: failed to encode map e120 with expected crc 2024-03-30T14:06:02.248 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:01 smithi181 ceph-mon[115276]: failed to encode map e120 with expected crc 2024-03-30T14:06:02.248 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:01 smithi181 ceph-mon[115276]: failed to encode map e120 with expected crc 2024-03-30T14:06:02.248 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:01 smithi181 ceph-mon[115276]: failed to encode map e120 with expected crc 2024-03-30T14:06:02.249 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:01 smithi181 ceph-mon[115276]: failed to encode map e120 with expected crc 2024-03-30T14:06:02.249 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:01 smithi181 ceph-mon[115276]: failed to encode map e120 with expected crc 2024-03-30T14:06:02.249 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:01 smithi181 ceph-mon[115276]: osdmap e120: 8 total, 7 up, 8 in 2024-03-30T14:06:02.249 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:01 smithi181 ceph-mon[115276]: failed to encode map e120 with expected crc 2024-03-30T14:06:02.249 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:01 smithi181 ceph-mon[115276]: failed to encode map e120 with expected crc 2024-03-30T14:06:02.249 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:01 smithi181 ceph-mon[115276]: failed to encode map e120 with expected crc 2024-03-30T14:06:02.249 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:01 smithi181 ceph-mon[115276]: failed to encode map e120 with expected crc 2024-03-30T14:06:02.249 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:01 smithi181 ceph-mon[115276]: failed to encode map e120 with expected crc 2024-03-30T14:06:02.803 INFO:journalctl@ceph.osd.1.smithi099.stdout:Mar 30 14:06:02 smithi099 podman[155564]: 2024-03-30 14:06:02.476992923 +0000 UTC m=+0.687843906 container remove c2feaba988cb7218fe5d049557df9da1128064c9b41cc624c5732a4dc5591eec (image=quay.ceph.io/ceph-ci/ceph:4e50bbcdd1630c7760b708f3a5b4d38a121e66cb, name=ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-1-deactivate, org.label-schema.license=GPLv2, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, org.label-schema.build-date=20240326, RELEASE=squid-4e50bbc, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=) 2024-03-30T14:06:02.804 INFO:journalctl@ceph.osd.1.smithi099.stdout:Mar 30 14:06:02 smithi099 systemd[1]: ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4@osd.1.service: Deactivated successfully. 2024-03-30T14:06:02.804 INFO:journalctl@ceph.osd.1.smithi099.stdout:Mar 30 14:06:02 smithi099 systemd[1]: Stopped Ceph osd.1 for 98ebaeb8-ee99-11ee-b647-cb9ed24678a4. 2024-03-30T14:06:02.804 INFO:journalctl@ceph.osd.1.smithi099.stdout:Mar 30 14:06:02 smithi099 systemd[1]: ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4@osd.1.service: Consumed 14.742s CPU time. 2024-03-30T14:06:02.804 INFO:journalctl@ceph.osd.1.smithi099.stdout:Mar 30 14:06:02 smithi099 systemd[1]: Starting Ceph osd.1 for 98ebaeb8-ee99-11ee-b647-cb9ed24678a4... 2024-03-30T14:06:03.079 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:02 smithi099 ceph-mon[137093]: pgmap v83: 161 pgs: 20 active+undersized+degraded, 6 peering, 37 active+undersized, 98 active+clean; 585 KiB data, 120 MiB used, 715 GiB / 715 GiB avail; 79/627 objects degraded (12.600%) 2024-03-30T14:06:03.079 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:02 smithi099 ceph-mon[143401]: pgmap v83: 161 pgs: 20 active+undersized+degraded, 6 peering, 37 active+undersized, 98 active+clean; 585 KiB data, 120 MiB used, 715 GiB / 715 GiB avail; 79/627 objects degraded (12.600%) 2024-03-30T14:06:03.079 INFO:journalctl@ceph.osd.1.smithi099.stdout:Mar 30 14:06:02 smithi099 podman[155668]: 2024-03-30 14:06:02.817530436 +0000 UTC m=+0.021038474 image pull b0c4478f1d83795df4d538bf108aee5fac57194348fb16dcdbb3115f3e2fe95e quay.ceph.io/ceph-ci/ceph:4e50bbcdd1630c7760b708f3a5b4d38a121e66cb 2024-03-30T14:06:03.079 INFO:journalctl@ceph.osd.1.smithi099.stdout:Mar 30 14:06:02 smithi099 podman[155668]: 2024-03-30 14:06:02.919766251 +0000 UTC m=+0.123274319 container create d65ce498fc3dc4d4810b780ad310b0ac84efb7d25dc98a5e535324aeb1ce1f46 (image=quay.ceph.io/ceph-ci/ceph:4e50bbcdd1630c7760b708f3a5b4d38a121e66cb, name=ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-1-activate, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=squid-4e50bbc, io.buildah.version=1.33.5, GIT_CLEAN=True, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.build-date=20240326, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-03-30T14:06:03.248 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:02 smithi181 ceph-mon[115276]: pgmap v83: 161 pgs: 20 active+undersized+degraded, 6 peering, 37 active+undersized, 98 active+clean; 585 KiB data, 120 MiB used, 715 GiB / 715 GiB avail; 79/627 objects degraded (12.600%) 2024-03-30T14:06:03.579 INFO:journalctl@ceph.osd.1.smithi099.stdout:Mar 30 14:06:03 smithi099 podman[155668]: 2024-03-30 14:06:03.147739345 +0000 UTC m=+0.351247386 container init d65ce498fc3dc4d4810b780ad310b0ac84efb7d25dc98a5e535324aeb1ce1f46 (image=quay.ceph.io/ceph-ci/ceph:4e50bbcdd1630c7760b708f3a5b4d38a121e66cb, name=ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-1-activate, org.label-schema.build-date=20240326, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , RELEASE=squid-4e50bbc, org.label-schema.vendor=CentOS, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, GIT_BRANCH=HEAD, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, io.buildah.version=1.33.5) 2024-03-30T14:06:03.579 INFO:journalctl@ceph.osd.1.smithi099.stdout:Mar 30 14:06:03 smithi099 podman[155668]: 2024-03-30 14:06:03.151296839 +0000 UTC m=+0.354804876 container start d65ce498fc3dc4d4810b780ad310b0ac84efb7d25dc98a5e535324aeb1ce1f46 (image=quay.ceph.io/ceph-ci/ceph:4e50bbcdd1630c7760b708f3a5b4d38a121e66cb, name=ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-1-activate, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240326, GIT_CLEAN=True, RELEASE=squid-4e50bbc, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux ) 2024-03-30T14:06:03.579 INFO:journalctl@ceph.osd.1.smithi099.stdout:Mar 30 14:06:03 smithi099 podman[155668]: 2024-03-30 14:06:03.23033956 +0000 UTC m=+0.433847603 container attach d65ce498fc3dc4d4810b780ad310b0ac84efb7d25dc98a5e535324aeb1ce1f46 (image=quay.ceph.io/ceph-ci/ceph:4e50bbcdd1630c7760b708f3a5b4d38a121e66cb, name=ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-1-activate, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, GIT_BRANCH=HEAD, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240326, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=squid-4e50bbc) 2024-03-30T14:06:04.035 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:03 smithi099 ceph-mon[137093]: Health check failed: Degraded data redundancy: 79/627 objects degraded (12.600%), 20 pgs degraded (PG_DEGRADED) 2024-03-30T14:06:04.035 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:03 smithi099 ceph-mon[143401]: Health check failed: Degraded data redundancy: 79/627 objects degraded (12.600%), 20 pgs degraded (PG_DEGRADED) 2024-03-30T14:06:04.035 INFO:journalctl@ceph.osd.1.smithi099.stdout:Mar 30 14:06:03 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-1-activate[155683]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-03-30T14:06:04.035 INFO:journalctl@ceph.osd.1.smithi099.stdout:Mar 30 14:06:03 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-1-activate[155683]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-1 --no-mon-config --dev /dev/mapper/vg_nvme-lv_3 2024-03-30T14:06:04.035 INFO:journalctl@ceph.osd.1.smithi099.stdout:Mar 30 14:06:03 smithi099 bash[155668]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-03-30T14:06:04.036 INFO:journalctl@ceph.osd.1.smithi099.stdout:Mar 30 14:06:03 smithi099 bash[155668]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-1 --no-mon-config --dev /dev/mapper/vg_nvme-lv_3 2024-03-30T14:06:04.036 INFO:journalctl@ceph.osd.1.smithi099.stdout:Mar 30 14:06:03 smithi099 bash[155668]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_3 2024-03-30T14:06:04.036 INFO:journalctl@ceph.osd.1.smithi099.stdout:Mar 30 14:06:03 smithi099 bash[155668]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-2 2024-03-30T14:06:04.036 INFO:journalctl@ceph.osd.1.smithi099.stdout:Mar 30 14:06:03 smithi099 bash[155668]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-1/block 2024-03-30T14:06:04.036 INFO:journalctl@ceph.osd.1.smithi099.stdout:Mar 30 14:06:03 smithi099 bash[155668]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-03-30T14:06:04.036 INFO:journalctl@ceph.osd.1.smithi099.stdout:Mar 30 14:06:03 smithi099 bash[155668]: --> ceph-volume raw activate successful for osd ID: 1 2024-03-30T14:06:04.036 INFO:journalctl@ceph.osd.1.smithi099.stdout:Mar 30 14:06:03 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-1-activate[155683]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_3 2024-03-30T14:06:04.036 INFO:journalctl@ceph.osd.1.smithi099.stdout:Mar 30 14:06:03 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-1-activate[155683]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-2 2024-03-30T14:06:04.036 INFO:journalctl@ceph.osd.1.smithi099.stdout:Mar 30 14:06:03 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-1-activate[155683]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-1/block 2024-03-30T14:06:04.036 INFO:journalctl@ceph.osd.1.smithi099.stdout:Mar 30 14:06:03 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-1-activate[155683]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-03-30T14:06:04.036 INFO:journalctl@ceph.osd.1.smithi099.stdout:Mar 30 14:06:03 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-1-activate[155683]: --> ceph-volume raw activate successful for osd ID: 1 2024-03-30T14:06:04.036 INFO:journalctl@ceph.osd.1.smithi099.stdout:Mar 30 14:06:03 smithi099 podman[155668]: 2024-03-30 14:06:03.615243946 +0000 UTC m=+0.818751984 container died d65ce498fc3dc4d4810b780ad310b0ac84efb7d25dc98a5e535324aeb1ce1f46 (image=quay.ceph.io/ceph-ci/ceph:4e50bbcdd1630c7760b708f3a5b4d38a121e66cb, name=ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-1-activate, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240326, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_CLEAN=True, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , RELEASE=squid-4e50bbc, io.buildah.version=1.33.5, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, GIT_BRANCH=HEAD, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image) 2024-03-30T14:06:04.248 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:03 smithi181 ceph-mon[115276]: Health check failed: Degraded data redundancy: 79/627 objects degraded (12.600%), 20 pgs degraded (PG_DEGRADED) 2024-03-30T14:06:04.716 INFO:journalctl@ceph.osd.1.smithi099.stdout:Mar 30 14:06:04 smithi099 podman[155819]: 2024-03-30 14:06:04.41736998 +0000 UTC m=+0.797031798 container remove d65ce498fc3dc4d4810b780ad310b0ac84efb7d25dc98a5e535324aeb1ce1f46 (image=quay.ceph.io/ceph-ci/ceph:4e50bbcdd1630c7760b708f3a5b4d38a121e66cb, name=ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-1-activate, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240326, maintainer=Guillaume Abrioux , GIT_CLEAN=True, ceph=True, io.buildah.version=1.33.5, RELEASE=squid-4e50bbc, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0) 2024-03-30T14:06:04.716 INFO:journalctl@ceph.osd.1.smithi099.stdout:Mar 30 14:06:04 smithi099 podman[155884]: 2024-03-30 14:06:04.62661207 +0000 UTC m=+0.109951585 container create a843295ce83b8cc69fab77d5b26f3d9b6d05835c183c2dec6ed48cf4c670cb70 (image=quay.ceph.io/ceph-ci/ceph:4e50bbcdd1630c7760b708f3a5b4d38a121e66cb, name=ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-1, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, org.label-schema.license=GPLv2, GIT_CLEAN=True, RELEASE=squid-4e50bbc, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240326, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image) 2024-03-30T14:06:04.716 INFO:journalctl@ceph.osd.1.smithi099.stdout:Mar 30 14:06:04 smithi099 podman[155884]: 2024-03-30 14:06:04.53427637 +0000 UTC m=+0.017615886 image pull b0c4478f1d83795df4d538bf108aee5fac57194348fb16dcdbb3115f3e2fe95e quay.ceph.io/ceph-ci/ceph:4e50bbcdd1630c7760b708f3a5b4d38a121e66cb 2024-03-30T14:06:05.078 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:04 smithi099 ceph-mon[137093]: pgmap v84: 161 pgs: 20 active+undersized+degraded, 6 peering, 37 active+undersized, 98 active+clean; 585 KiB data, 120 MiB used, 715 GiB / 715 GiB avail; 79/627 objects degraded (12.600%) 2024-03-30T14:06:05.079 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:04 smithi099 ceph-mon[143401]: pgmap v84: 161 pgs: 20 active+undersized+degraded, 6 peering, 37 active+undersized, 98 active+clean; 585 KiB data, 120 MiB used, 715 GiB / 715 GiB avail; 79/627 objects degraded (12.600%) 2024-03-30T14:06:05.079 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 14:06:04 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[71049]: ::ffff:172.21.15.181 - - [30/Mar/2024:14:06:04] "GET /metrics HTTP/1.1" 200 38170 "" "Prometheus/2.43.0" 2024-03-30T14:06:05.079 INFO:journalctl@ceph.osd.1.smithi099.stdout:Mar 30 14:06:04 smithi099 podman[155884]: 2024-03-30 14:06:04.862302235 +0000 UTC m=+0.345641763 container init a843295ce83b8cc69fab77d5b26f3d9b6d05835c183c2dec6ed48cf4c670cb70 (image=quay.ceph.io/ceph-ci/ceph:4e50bbcdd1630c7760b708f3a5b4d38a121e66cb, name=ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-1, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, org.label-schema.build-date=20240326, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_CLEAN=True, RELEASE=squid-4e50bbc, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, org.label-schema.schema-version=1.0) 2024-03-30T14:06:05.079 INFO:journalctl@ceph.osd.1.smithi099.stdout:Mar 30 14:06:04 smithi099 podman[155884]: 2024-03-30 14:06:04.865346493 +0000 UTC m=+0.348686010 container start a843295ce83b8cc69fab77d5b26f3d9b6d05835c183c2dec6ed48cf4c670cb70 (image=quay.ceph.io/ceph-ci/ceph:4e50bbcdd1630c7760b708f3a5b4d38a121e66cb, name=ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-1, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.build-date=20240326, RELEASE=squid-4e50bbc, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_BRANCH=HEAD) 2024-03-30T14:06:05.079 INFO:journalctl@ceph.osd.1.smithi099.stdout:Mar 30 14:06:04 smithi099 ceph-osd[155903]: -- 172.21.15.99:0/247364902 <== mon.0 v2:172.21.15.99:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x556d03c19680 con 0x556d03be3000 2024-03-30T14:06:05.080 INFO:journalctl@ceph.osd.1.smithi099.stdout:Mar 30 14:06:04 smithi099 bash[155884]: a843295ce83b8cc69fab77d5b26f3d9b6d05835c183c2dec6ed48cf4c670cb70 2024-03-30T14:06:05.080 INFO:journalctl@ceph.osd.1.smithi099.stdout:Mar 30 14:06:04 smithi099 systemd[1]: Started Ceph osd.1 for 98ebaeb8-ee99-11ee-b647-cb9ed24678a4. 2024-03-30T14:06:05.083 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:04 smithi181 ceph-mon[115276]: pgmap v84: 161 pgs: 20 active+undersized+degraded, 6 peering, 37 active+undersized, 98 active+clean; 585 KiB data, 120 MiB used, 715 GiB / 715 GiB avail; 79/627 objects degraded (12.600%) 2024-03-30T14:06:05.828 INFO:journalctl@ceph.osd.1.smithi099.stdout:Mar 30 14:06:05 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-1[155899]: 2024-03-30T14:06:05.401+0000 7f97bf59b7c0 -1 Falling back to public interface 2024-03-30T14:06:06.145 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:06 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:06:06.145 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:06 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:06:06.145 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:06 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:06:06.145 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:06 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:06:06.145 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:06 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:06:06.145 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:06 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:06:06.145 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:06 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:06:06.146 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:06 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:06:06.146 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:06 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:06:06.146 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:06 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:06:06.146 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:06 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:06:06.146 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:06 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:06:06.146 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:06 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:06:06.146 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:06 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:06:06.146 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:06 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:06:06.146 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:06 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:06:06.146 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:06 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:06:06.146 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:06 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:06:06.146 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:06 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:06:06.146 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:06 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:06:06.146 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:06 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:06:06.147 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:06 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:06:06.147 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:06 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:06:06.147 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:06 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:06:06.147 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:06 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:06:06.147 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:06 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:06:06.147 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:06 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:06:06.147 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:06 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:06:06.147 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:06 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:06:06.147 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:06 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:06:06.147 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:06 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:06:06.148 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:06 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:06:06.148 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:06 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:06:06.148 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:06 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:06:06.148 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:06 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:06:06.148 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:06 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:06:06.148 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:06 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:06:06.148 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:06 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:06:06.148 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:06 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:06:06.148 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:06 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:06:06.148 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:06 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:06:06.148 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:06 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:06:06.148 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:06 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:06:06.149 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:06 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:06:06.149 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:06 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:06:06.149 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:06 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:06:06.149 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:06 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:06:06.149 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:06 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:06:06.149 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:06 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:06:06.149 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:06 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:06:06.149 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:06 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:06:06.149 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:06 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:06:06.149 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:06 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:06:06.149 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:06 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:06:06.149 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:06 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:06:06.149 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:06 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:06:06.150 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:06 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:06:06.150 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:06 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:06:06.150 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:06 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:06:06.150 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:06 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:06:06.150 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:06 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:06:06.150 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:06 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:06:06.150 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:06 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:06:06.150 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:06 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:06:06.329 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:06 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:06:06.329 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:06 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:06:06.329 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:06 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:06:06.330 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:06 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:06:06.330 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:06 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:06:06.330 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:06 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:06:06.330 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:06 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:06:06.330 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:06 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:06:06.330 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:06 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:06:06.330 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:06 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:06:06.330 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:06 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:06:06.330 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:06 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:06:06.330 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:06 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:06:06.330 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:06 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:06:06.330 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:06 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:06:06.330 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:06 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:06:06.331 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:06 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:06:06.331 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:06 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:06:06.331 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:06 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:06:06.331 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:06 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:06:06.331 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:06 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:06:06.331 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:06 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:06:06.331 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:06 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:06:06.331 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:06 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:06:06.331 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:06 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:06:06.331 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:06 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:06:06.331 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:06 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:06:06.331 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:06 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:06:06.331 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:06 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:06:06.332 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:06 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:06:06.332 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:06 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:06:06.332 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:06 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:06:06.332 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:06 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:06:06.332 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:06 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:06:06.332 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:06 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:06:06.332 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:06 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:06:06.332 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:06 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:06:06.332 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:06 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:06:06.332 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:06 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:06:06.332 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:06 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:06:06.332 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:06 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:06:06.332 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:06 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:06:06.332 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:06 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:06:06.332 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:06 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:06:06.333 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:06 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:06:06.333 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:06 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:06:06.333 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:06 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:06:06.333 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:06 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:06:06.333 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:06 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:06:06.333 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:06 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:06:06.333 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:06 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:06:06.333 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:06 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:06:06.333 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:06 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:06:06.333 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:06 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:06:06.333 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:06 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:06:06.333 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:06 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:06:06.333 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:06 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:06:06.333 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:06 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:06:06.333 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:06 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:06:06.334 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:06 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:06:06.334 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:06 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:06:06.334 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:06 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:06:06.334 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:06 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:06:06.334 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:06 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:06:06.334 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:06 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:06:06.334 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:06 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:06:06.334 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:06 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:06:06.334 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:06 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:06:06.334 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:06 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:06:06.334 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:06 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:06:06.335 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:06 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:06:06.335 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:06 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:06:06.335 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:06 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:06:06.335 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:06 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:06:06.335 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:06 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:06:06.335 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:06 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:06:06.335 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:06 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:06:06.335 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:06 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:06:06.335 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:06 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:06:06.335 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:06 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:06:06.335 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:06 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:06:06.335 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:06 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:06:06.335 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:06 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:06:06.335 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:06 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:06:06.335 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:06 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:06:06.336 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:06 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:06:06.336 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:06 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:06:06.336 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:06 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:06:06.336 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:06 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:06:06.336 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:06 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:06:06.336 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:06 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:06:06.336 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:06 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:06:06.336 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:06 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:06:06.336 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:06 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:06:06.336 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:06 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:06:06.337 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:06 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:06:06.337 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:06 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:06:06.337 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:06 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:06:06.337 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:06 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:06:06.337 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:06 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:06:06.337 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:06 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:06:06.337 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:06 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:06:06.337 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:06 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:06:06.337 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:06 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:06:06.337 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:06 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:06:06.337 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:06 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:06:06.337 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:06 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:06:06.337 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:06 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:06:06.337 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:06 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:06:06.338 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:06 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:06:06.338 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:06 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:06:06.338 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:06 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:06:06.338 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:06 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:06:06.338 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:06 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:06:06.338 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:06 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:06:06.338 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:06 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:06:06.338 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:06 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:06:06.338 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:06 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:06:06.338 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:06 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:06:06.338 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:06 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:06:06.338 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:06 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:06:06.338 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:06 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:06:06.338 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:06 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:06:06.338 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:06 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:06:06.339 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:06 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:06:06.339 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:06 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:06:06.339 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:06 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:06:06.339 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:06 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:06:07.079 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:07 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:06:07.079 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:07 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:06:07.080 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:07 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:06:07.080 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:07 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:06:07.080 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:07 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:06:07.080 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:07 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:06:07.080 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:07 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:06:07.080 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:07 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:06:07.080 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:07 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:06:07.080 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:07 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:06:07.080 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:07 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:06:07.080 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:07 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:06:07.080 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:07 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:06:07.080 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:07 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:06:07.080 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:07 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:06:07.080 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:07 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:06:07.081 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:07 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:06:07.081 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:07 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:06:07.081 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:07 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:06:07.081 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:07 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:06:07.081 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:07 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:06:07.081 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:07 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:06:07.081 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:07 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:06:07.081 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:07 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:06:07.081 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:07 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:06:07.081 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:07 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:06:07.081 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:07 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:06:07.081 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:07 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:06:07.081 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:07 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:06:07.081 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:07 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:06:07.082 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:07 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:06:07.082 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:07 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:06:07.082 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:07 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:06:07.082 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:07 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:06:07.082 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:07 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:06:07.082 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:07 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:06:07.082 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:07 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:06:07.082 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:07 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:06:07.082 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:07 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:06:07.083 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:07 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:06:07.083 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:07 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:06:07.083 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:07 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:06:07.083 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:07 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:06:07.083 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:07 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:06:07.083 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:07 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:06:07.083 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:07 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:06:07.083 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:07 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:06:07.083 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:07 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:06:07.083 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:07 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:06:07.083 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:07 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:06:07.083 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:07 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:06:07.083 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:07 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:06:07.083 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:07 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:06:07.083 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:07 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:06:07.084 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:07 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:06:07.084 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:07 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:06:07.084 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:07 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:06:07.084 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:07 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:06:07.084 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:07 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:06:07.084 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:07 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:06:07.084 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:07 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:06:07.084 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:07 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:06:07.084 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:07 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:06:07.084 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:07 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:06:07.084 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:07 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:06:07.084 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:07 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:06:07.084 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:07 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:06:07.084 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:07 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:06:07.084 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:07 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:06:07.085 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:07 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:06:07.085 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:07 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:06:07.085 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:07 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:06:07.085 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:07 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:06:07.085 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:07 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:06:07.085 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:07 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:06:07.085 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:07 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:06:07.085 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:07 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:06:07.085 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:07 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:06:07.085 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:07 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:06:07.085 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:07 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:06:07.085 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:07 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:06:07.085 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:07 smithi099 ceph-mon[143401]: pgmap v85: 161 pgs: 22 active+undersized+degraded, 41 active+undersized, 98 active+clean; 585 KiB data, 120 MiB used, 715 GiB / 715 GiB avail; 86/627 objects degraded (13.716%) 2024-03-30T14:06:07.085 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:07 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:06:07.085 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:07 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:06:07.085 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:07 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:06:07.086 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:07 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:06:07.086 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:07 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:06:07.086 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:07 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:06:07.086 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:07 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T14:06:07.086 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:07 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:06:07.086 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:07 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:06:07.086 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:07 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:06:07.086 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:07 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:06:07.086 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:07 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:06:07.086 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:07 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:06:07.086 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:07 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:06:07.087 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:07 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:06:07.087 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:07 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:06:07.087 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:07 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:06:07.087 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:07 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:06:07.087 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:07 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:06:07.087 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:07 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:06:07.087 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:07 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:06:07.087 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:07 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:06:07.087 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:07 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:06:07.087 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:07 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:06:07.087 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:07 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:06:07.087 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:07 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:06:07.087 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:07 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:06:07.087 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:07 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:06:07.087 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:07 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:06:07.087 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:07 smithi099 ceph-mon[137093]: pgmap v85: 161 pgs: 22 active+undersized+degraded, 41 active+undersized, 98 active+clean; 585 KiB data, 120 MiB used, 715 GiB / 715 GiB avail; 86/627 objects degraded (13.716%) 2024-03-30T14:06:07.088 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:07 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:06:07.088 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:07 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:06:07.088 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:07 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:06:07.088 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:07 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:06:07.088 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:07 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:06:07.088 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:07 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:06:07.088 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:07 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T14:06:07.088 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:07 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:06:07.088 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:07 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:06:07.088 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:07 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:06:07.088 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:07 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:06:07.088 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:07 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:06:07.089 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:07 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:06:07.089 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:07 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:06:07.089 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:07 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:06:07.089 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:07 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:06:07.294 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:07 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:06:07.294 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:07 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:06:07.294 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:07 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:06:07.294 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:07 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:06:07.294 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:07 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:06:07.294 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:07 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:06:07.294 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:07 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:06:07.294 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:07 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:06:07.294 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:07 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:06:07.294 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:07 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:06:07.295 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:07 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:06:07.295 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:07 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:06:07.295 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:07 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:06:07.295 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:07 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:06:07.295 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:07 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:06:07.295 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:07 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:06:07.295 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:07 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:06:07.295 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:07 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:06:07.295 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:07 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:06:07.295 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:07 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:06:07.295 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:07 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:06:07.295 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:07 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:06:07.295 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:07 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:06:07.295 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:07 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:06:07.295 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:07 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:06:07.296 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:07 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:06:07.296 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:07 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:06:07.296 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:07 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:06:07.296 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:07 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:06:07.296 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:07 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:06:07.296 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:07 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:06:07.296 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:07 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:06:07.296 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:07 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:06:07.296 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:07 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:06:07.297 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:07 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:06:07.297 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:07 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:06:07.297 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:07 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:06:07.297 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:07 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:06:07.297 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:07 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:06:07.297 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:07 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:06:07.297 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:07 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:06:07.297 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:07 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:06:07.297 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:07 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:06:07.297 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:07 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:06:07.297 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:07 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:06:07.297 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:07 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:06:07.297 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:07 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:06:07.297 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:07 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:06:07.297 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:07 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:06:07.297 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:07 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:06:07.298 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:07 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:06:07.298 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:07 smithi181 ceph-mon[115276]: pgmap v85: 161 pgs: 22 active+undersized+degraded, 41 active+undersized, 98 active+clean; 585 KiB data, 120 MiB used, 715 GiB / 715 GiB avail; 86/627 objects degraded (13.716%) 2024-03-30T14:06:07.298 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:07 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:06:07.298 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:07 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:06:07.298 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:07 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:06:07.298 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:07 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:06:07.298 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:07 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:06:07.298 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:07 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:06:07.298 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:07 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T14:06:07.298 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:07 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:06:07.298 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:07 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:06:07.298 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:07 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:06:07.298 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:07 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:06:07.299 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:07 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:06:08.080 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:08 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:06:08.080 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:08 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:06:08.080 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:08 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:06:08.080 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:08 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:06:08.080 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:08 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:06:08.080 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:08 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:06:08.080 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:08 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:06:08.080 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:08 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:06:08.080 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:08 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:06:08.080 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:08 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:06:08.080 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:08 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:06:08.080 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:08 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:06:08.080 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:08 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:06:08.081 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:08 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:06:08.081 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:08 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:06:08.081 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:08 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:06:08.081 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:08 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:06:08.081 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:08 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:06:08.081 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:08 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:06:08.081 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:08 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:06:08.081 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:08 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:06:08.081 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:08 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:06:08.081 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:08 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:06:08.081 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:08 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:06:08.081 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:08 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:06:08.081 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:08 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:06:08.081 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:08 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:06:08.081 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:08 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:06:08.081 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:08 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:06:08.082 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:08 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:06:08.082 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:08 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:06:08.082 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:08 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:06:08.082 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:08 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:06:08.082 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:08 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:06:08.082 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:08 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:06:08.082 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:08 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:06:08.082 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:08 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:06:08.082 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:08 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:06:08.082 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:08 smithi099 ceph-mon[143401]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg peering) 2024-03-30T14:06:08.082 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:08 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:06:08.082 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:08 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:06:08.082 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:08 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:06:08.082 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:08 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:06:08.083 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:08 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:06:08.083 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:08 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:06:08.083 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:08 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:06:08.083 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:08 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:06:08.083 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:08 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:06:08.083 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:08 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:06:08.083 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:08 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:06:08.083 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:08 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:06:08.083 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:08 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:06:08.083 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:08 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:06:08.083 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:08 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:06:08.083 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:08 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:06:08.083 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:08 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:06:08.083 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:08 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:06:08.084 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:08 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:06:08.084 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:08 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:06:08.084 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:08 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:06:08.084 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:08 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:06:08.084 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:08 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:06:08.084 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:08 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:06:08.084 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:08 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:06:08.084 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:08 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:06:08.084 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:08 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:06:08.084 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:08 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:06:08.084 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:08 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:06:08.085 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:08 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:06:08.085 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:08 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:06:08.085 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:08 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:06:08.085 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:08 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:06:08.085 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:08 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:06:08.085 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:08 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:06:08.085 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:08 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:06:08.085 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:08 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:06:08.085 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:08 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:06:08.085 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:08 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:06:08.085 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:08 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:06:08.085 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:08 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:06:08.085 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:08 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:06:08.085 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:08 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:06:08.085 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:08 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:06:08.085 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:08 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:06:08.086 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:08 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:06:08.086 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:08 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:06:08.086 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:08 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:06:08.086 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:08 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:06:08.086 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:08 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:06:08.086 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:08 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:06:08.086 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:08 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:06:08.086 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:08 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:06:08.086 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:08 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:06:08.086 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:08 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:06:08.086 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:08 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:06:08.086 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:08 smithi099 ceph-mon[137093]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg peering) 2024-03-30T14:06:08.086 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:08 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:06:08.086 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:08 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:06:08.086 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:08 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:06:08.087 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:08 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:06:08.087 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:08 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:06:08.087 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:08 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:06:08.087 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:08 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:06:08.087 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:08 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:06:08.087 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:08 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:06:08.087 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:08 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:06:08.087 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:08 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:06:08.087 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:08 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:06:08.087 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:08 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:06:08.087 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:08 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:06:08.087 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:08 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:06:08.087 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:08 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:06:08.087 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:08 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:06:08.087 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:08 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:06:08.248 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:08 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:06:08.249 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:08 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:06:08.249 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:08 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:06:08.249 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:08 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:06:08.249 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:08 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:06:08.249 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:08 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:06:08.249 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:08 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:06:08.249 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:08 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:06:08.249 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:08 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:06:08.249 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:08 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:06:08.249 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:08 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:06:08.249 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:08 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:06:08.249 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:08 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:06:08.249 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:08 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:06:08.249 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:08 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:06:08.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:08 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:06:08.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:08 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:06:08.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:08 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:06:08.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:08 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:06:08.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:08 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:06:08.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:08 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:06:08.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:08 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:06:08.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:08 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:06:08.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:08 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:06:08.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:08 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:06:08.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:08 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:06:08.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:08 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:06:08.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:08 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:06:08.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:08 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:06:08.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:08 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:06:08.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:08 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:06:08.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:08 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:06:08.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:08 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:06:08.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:08 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:06:08.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:08 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:06:08.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:08 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:06:08.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:08 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:06:08.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:08 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:06:08.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:08 smithi181 ceph-mon[115276]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg peering) 2024-03-30T14:06:08.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:08 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:06:08.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:08 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:06:08.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:08 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:06:08.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:08 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:06:08.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:08 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:06:08.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:08 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:06:08.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:08 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:06:08.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:08 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:06:08.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:08 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:06:08.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:08 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:06:08.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:08 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:06:08.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:08 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:06:08.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:08 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:06:08.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:08 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:06:08.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:08 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:06:08.253 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:08 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:06:08.253 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:08 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:06:08.253 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:08 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:06:08.434 INFO:journalctl@ceph.osd.1.smithi099.stdout:Mar 30 14:06:08 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-1[155899]: 2024-03-30T14:06:08.141+0000 7f97bf59b7c0 -1 osd.1 0 read_superblock omap replica is missing. 2024-03-30T14:06:08.434 INFO:journalctl@ceph.osd.1.smithi099.stdout:Mar 30 14:06:08 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-1[155899]: 2024-03-30T14:06:08.171+0000 7f97bf59b7c0 -1 osd.1 118 log_to_monitors true 2024-03-30T14:06:09.267 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:09 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:06:09.267 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:09 smithi099 ceph-mon[137093]: from='client.25136 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T14:06:09.268 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:09 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:06:09.268 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:09 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:06:09.268 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:09 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:06:09.268 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:09 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:06:09.268 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:09 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:06:09.268 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:09 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:06:09.268 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:09 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:06:09.268 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:09 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:06:09.268 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:09 smithi099 ceph-mon[137093]: from='osd.1 [v2:172.21.15.99:6810/1926246251,v1:172.21.15.99:6811/1926246251]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-03-30T14:06:09.268 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:09 smithi099 ceph-mon[137093]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-03-30T14:06:09.268 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:09 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:06:09.269 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:09 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:06:09.269 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:09 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:06:09.269 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:09 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:06:09.269 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:09 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:06:09.269 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:09 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:06:09.269 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:09 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:06:09.269 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:09 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:06:09.269 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:09 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:06:09.269 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:09 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:06:09.269 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:09 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:06:09.269 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:09 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:06:09.269 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:09 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:06:09.269 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:09 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:06:09.269 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:09 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:06:09.269 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:09 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:06:09.270 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:09 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:06:09.270 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:09 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:06:09.270 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:09 smithi099 ceph-mon[143401]: from='client.25136 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T14:06:09.270 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:09 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:06:09.270 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:09 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:06:09.270 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:09 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:06:09.270 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:09 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:06:09.270 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:09 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:06:09.270 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:09 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:06:09.270 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:09 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:06:09.270 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:09 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:06:09.270 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:09 smithi099 ceph-mon[143401]: from='osd.1 [v2:172.21.15.99:6810/1926246251,v1:172.21.15.99:6811/1926246251]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-03-30T14:06:09.271 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:09 smithi099 ceph-mon[143401]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-03-30T14:06:09.271 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:09 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:06:09.271 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:09 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:06:09.271 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:09 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:06:09.271 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:09 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:06:09.271 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:09 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:06:09.271 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:09 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:06:09.271 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:09 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:06:09.271 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:09 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:06:09.271 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:09 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:06:09.271 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:09 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:06:09.271 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:09 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:06:09.271 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:09 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:06:09.271 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:09 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:06:09.271 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:09 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:06:09.272 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:09 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:06:09.272 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:09 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:06:09.272 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:09 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:06:09.272 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:09 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:06:09.272 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:09 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:06:09.272 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:09 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:06:09.272 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:09 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:06:09.272 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:09 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:06:09.272 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:09 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:06:09.272 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:09 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:06:09.272 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:09 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:06:09.272 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:09 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:06:09.273 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:09 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:06:09.273 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:09 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:06:09.273 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:09 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:06:09.273 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:09 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:06:09.273 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:09 smithi099 ceph-mon[137093]: pgmap v86: 161 pgs: 22 active+undersized+degraded, 41 active+undersized, 98 active+clean; 585 KiB data, 120 MiB used, 715 GiB / 715 GiB avail; 86/627 objects degraded (13.716%) 2024-03-30T14:06:09.273 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:09 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:06:09.273 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:09 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:06:09.273 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:09 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:06:09.273 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:09 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:06:09.273 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:09 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:06:09.273 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:09 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:06:09.273 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:09 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:06:09.273 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:09 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:06:09.274 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:09 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:06:09.274 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:09 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:06:09.274 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:09 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:06:09.274 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:09 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:06:09.274 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:09 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:06:09.274 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:09 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:06:09.274 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:09 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:06:09.274 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:09 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:06:09.274 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:09 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:06:09.275 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:09 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:06:09.275 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:09 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:06:09.275 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:09 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:06:09.275 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:09 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:06:09.275 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:09 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:06:09.275 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:09 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:06:09.275 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:09 smithi099 ceph-mon[143401]: pgmap v86: 161 pgs: 22 active+undersized+degraded, 41 active+undersized, 98 active+clean; 585 KiB data, 120 MiB used, 715 GiB / 715 GiB avail; 86/627 objects degraded (13.716%) 2024-03-30T14:06:09.275 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:09 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:06:09.275 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:09 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:06:09.275 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:09 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:06:09.275 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:09 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:06:09.275 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:09 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:06:09.275 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:09 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:06:09.275 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:09 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:06:09.275 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:09 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:06:09.275 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:09 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:06:09.276 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:09 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:06:09.498 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:09 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:06:09.498 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:09 smithi181 ceph-mon[115276]: from='client.25136 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T14:06:09.499 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:09 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:06:09.499 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:09 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:06:09.499 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:09 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:06:09.499 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:09 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:06:09.499 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:09 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:06:09.499 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:09 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:06:09.499 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:09 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:06:09.499 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:09 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:06:09.499 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:09 smithi181 ceph-mon[115276]: from='osd.1 [v2:172.21.15.99:6810/1926246251,v1:172.21.15.99:6811/1926246251]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-03-30T14:06:09.499 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:09 smithi181 ceph-mon[115276]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-03-30T14:06:09.499 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:09 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:06:09.499 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:09 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:06:09.500 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:09 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:06:09.500 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:09 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:06:09.500 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:09 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:06:09.500 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:09 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:06:09.500 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:09 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:06:09.500 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:09 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:06:09.500 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:09 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:06:09.500 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:09 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:06:09.500 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:09 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:06:09.500 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:09 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:06:09.500 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:09 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:06:09.500 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:09 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:06:09.500 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:09 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:06:09.500 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:09 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:06:09.501 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:09 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:06:09.501 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:09 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:06:09.501 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:09 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:06:09.501 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:09 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:06:09.501 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:09 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:06:09.501 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:09 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:06:09.501 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:09 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:06:09.501 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:09 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:06:09.501 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:09 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:06:09.501 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:09 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:06:09.501 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:09 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:06:09.502 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:09 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:06:09.502 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:09 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:06:09.502 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:09 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:06:09.502 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:09 smithi181 ceph-mon[115276]: pgmap v86: 161 pgs: 22 active+undersized+degraded, 41 active+undersized, 98 active+clean; 585 KiB data, 120 MiB used, 715 GiB / 715 GiB avail; 86/627 objects degraded (13.716%) 2024-03-30T14:06:09.502 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:09 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:06:09.502 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:09 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:06:09.502 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:09 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:06:09.502 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:09 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:06:09.502 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:09 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:06:09.502 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:09 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:06:09.502 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:09 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:06:09.502 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:09 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:06:09.502 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:09 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:06:09.503 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:09 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:06:09.935 INFO:journalctl@ceph.osd.1.smithi099.stdout:Mar 30 14:06:09 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-1[155899]: 2024-03-30T14:06:09.602+0000 7f97ac9eb700 -1 osd.1 118 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-03-30T14:06:10.329 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:10 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:06:10.329 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:10 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:06:10.329 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:10 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:06:10.329 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:10 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:06:10.329 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:10 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:06:10.329 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:10 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:06:10.330 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:10 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:06:10.330 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:10 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:06:10.330 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:10 smithi099 ceph-mon[143401]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-03-30T14:06:10.330 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:10 smithi099 ceph-mon[143401]: failed to encode map e121 with expected crc 2024-03-30T14:06:10.330 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:10 smithi099 ceph-mon[143401]: failed to encode map e121 with expected crc 2024-03-30T14:06:10.330 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:10 smithi099 ceph-mon[143401]: osdmap e121: 8 total, 7 up, 8 in 2024-03-30T14:06:10.330 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:10 smithi099 ceph-mon[143401]: from='osd.1 [v2:172.21.15.99:6810/1926246251,v1:172.21.15.99:6811/1926246251]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi099", "root=default"]}]: dispatch 2024-03-30T14:06:10.330 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:10 smithi099 ceph-mon[143401]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi099", "root=default"]}]: dispatch 2024-03-30T14:06:10.330 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:10 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:06:10.330 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:10 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:06:10.330 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:10 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:06:10.330 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:10 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:06:10.331 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:10 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:06:10.331 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:10 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:06:10.331 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:10 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:06:10.331 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:10 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:06:10.331 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:10 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:06:10.331 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:10 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:06:10.331 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:10 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:06:10.331 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:10 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:06:10.331 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:10 smithi099 ceph-mon[143401]: from='osd.1 ' entity='osd.1' 2024-03-30T14:06:10.331 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:10 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:06:10.331 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:10 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:06:10.331 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:10 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:06:10.332 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:10 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:06:10.332 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:10 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:06:10.332 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:10 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:06:10.332 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:10 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:06:10.332 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:10 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:06:10.332 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:10 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:06:10.332 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:10 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:06:10.332 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:10 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:06:10.332 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:10 smithi099 ceph-mon[137093]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-03-30T14:06:10.332 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:10 smithi099 ceph-mon[137093]: failed to encode map e121 with expected crc 2024-03-30T14:06:10.332 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:10 smithi099 ceph-mon[137093]: failed to encode map e121 with expected crc 2024-03-30T14:06:10.333 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:10 smithi099 ceph-mon[137093]: osdmap e121: 8 total, 7 up, 8 in 2024-03-30T14:06:10.333 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:10 smithi099 ceph-mon[137093]: from='osd.1 [v2:172.21.15.99:6810/1926246251,v1:172.21.15.99:6811/1926246251]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi099", "root=default"]}]: dispatch 2024-03-30T14:06:10.333 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:10 smithi099 ceph-mon[137093]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi099", "root=default"]}]: dispatch 2024-03-30T14:06:10.333 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:10 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:06:10.333 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:10 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:06:10.333 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:10 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:06:10.333 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:10 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:06:10.333 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:10 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:06:10.333 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:10 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:06:10.333 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:10 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:06:10.333 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:10 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:06:10.333 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:10 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:06:10.333 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:10 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:06:10.333 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:10 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:06:10.333 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:10 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:06:10.334 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:10 smithi099 ceph-mon[137093]: from='osd.1 ' entity='osd.1' 2024-03-30T14:06:10.334 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:10 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:06:10.334 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:10 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:06:10.334 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:10 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:06:10.334 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:10 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:06:10.334 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:10 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:06:10.334 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:10 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:06:10.334 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:10 smithi099 ceph-mon[143401]: Health check update: Degraded data redundancy: 86/627 objects degraded (13.716%), 22 pgs degraded (PG_DEGRADED) 2024-03-30T14:06:10.334 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:10 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:06:10.334 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:10 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:06:10.335 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:10 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:06:10.335 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:10 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:06:10.335 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:10 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:06:10.335 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:10 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:06:10.335 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:10 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:06:10.335 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:10 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:06:10.335 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:10 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:06:10.335 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:10 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:06:10.335 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:10 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:06:10.335 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:10 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:06:10.335 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:10 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:06:10.335 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:10 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:06:10.335 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:10 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:06:10.336 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:10 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:06:10.336 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:10 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:06:10.336 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:10 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:06:10.336 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:10 smithi099 ceph-mon[137093]: Health check update: Degraded data redundancy: 86/627 objects degraded (13.716%), 22 pgs degraded (PG_DEGRADED) 2024-03-30T14:06:10.336 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:10 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:06:10.336 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:10 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:06:10.336 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:10 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:06:10.336 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:10 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:06:10.336 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:10 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:06:10.336 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:10 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:06:10.336 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:10 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:06:10.336 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:10 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:06:10.336 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:10 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:06:10.336 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:10 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:06:10.336 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:10 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:06:10.337 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:10 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:06:10.337 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:10 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:06:10.337 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:10 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:06:10.337 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:10 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:06:10.498 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:10 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:06:10.499 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:10 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:06:10.499 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:10 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:06:10.499 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:10 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:06:10.499 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:10 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:06:10.499 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:10 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:06:10.499 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:10 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:06:10.499 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:10 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:06:10.499 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:10 smithi181 ceph-mon[115276]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-03-30T14:06:10.499 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:10 smithi181 ceph-mon[115276]: failed to encode map e121 with expected crc 2024-03-30T14:06:10.499 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:10 smithi181 ceph-mon[115276]: failed to encode map e121 with expected crc 2024-03-30T14:06:10.499 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:10 smithi181 ceph-mon[115276]: osdmap e121: 8 total, 7 up, 8 in 2024-03-30T14:06:10.499 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:10 smithi181 ceph-mon[115276]: from='osd.1 [v2:172.21.15.99:6810/1926246251,v1:172.21.15.99:6811/1926246251]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi099", "root=default"]}]: dispatch 2024-03-30T14:06:10.499 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:10 smithi181 ceph-mon[115276]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi099", "root=default"]}]: dispatch 2024-03-30T14:06:10.500 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:10 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:06:10.500 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:10 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:06:10.500 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:10 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:06:10.500 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:10 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:06:10.500 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:10 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:06:10.500 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:10 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:06:10.500 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:10 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:06:10.500 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:10 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:06:10.500 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:10 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:06:10.500 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:10 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:06:10.500 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:10 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:06:10.501 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:10 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:06:10.501 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:10 smithi181 ceph-mon[115276]: from='osd.1 ' entity='osd.1' 2024-03-30T14:06:10.501 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:10 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:06:10.501 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:10 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:06:10.501 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:10 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:06:10.501 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:10 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:06:10.501 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:10 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:06:10.501 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:10 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:06:10.501 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:10 smithi181 ceph-mon[115276]: Health check update: Degraded data redundancy: 86/627 objects degraded (13.716%), 22 pgs degraded (PG_DEGRADED) 2024-03-30T14:06:10.501 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:10 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:06:10.501 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:10 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:06:10.501 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:10 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:06:10.501 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:10 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:06:10.501 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:10 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:06:10.502 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:10 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:06:10.502 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:10 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:06:10.502 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:10 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:06:10.502 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:10 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:06:10.502 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:10 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:06:10.502 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:10 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:06:10.502 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:10 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:06:10.502 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:10 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:06:10.502 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:10 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:06:10.502 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:10 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:06:11.096 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:11 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:06:11.096 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:11 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:06:11.096 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:11 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:06:11.096 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:11 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:06:11.096 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:11 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:06:11.096 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:11 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:06:11.096 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:11 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:06:11.096 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:11 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:06:11.096 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:11 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:06:11.097 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:11 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:06:11.097 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:11 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:06:11.097 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:11 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:06:11.097 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:11 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:06:11.097 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:11 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:06:11.097 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:11 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:06:11.097 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:11 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:06:11.097 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:11 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:06:11.097 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:11 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:06:11.097 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:11 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:06:11.097 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:11 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:06:11.097 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:11 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:06:11.097 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:11 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:06:11.097 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:11 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:06:11.098 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:11 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:06:11.098 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:11 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:06:11.098 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:11 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:06:11.098 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:11 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:06:11.098 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:11 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:06:11.098 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:11 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:06:11.098 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:11 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:06:11.098 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:11 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:06:11.098 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:11 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:06:11.098 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:11 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:06:11.098 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:11 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:06:11.098 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:11 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:06:11.098 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:11 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:06:11.098 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:11 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:06:11.099 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:11 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:06:11.099 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:11 smithi099 ceph-mon[137093]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-03-30T14:06:11.099 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:11 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:06:11.099 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:11 smithi099 ceph-mon[137093]: failed to encode map e122 with expected crc 2024-03-30T14:06:11.099 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:11 smithi099 ceph-mon[137093]: failed to encode map e122 with expected crc 2024-03-30T14:06:11.099 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:11 smithi099 ceph-mon[137093]: osd.1 [v2:172.21.15.99:6810/1926246251,v1:172.21.15.99:6811/1926246251] boot 2024-03-30T14:06:11.099 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:11 smithi099 ceph-mon[137093]: osdmap e122: 8 total, 8 up, 8 in 2024-03-30T14:06:11.099 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:11 smithi099 ceph-mon[137093]: failed to encode map e122 with expected crc 2024-03-30T14:06:11.099 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:11 smithi099 ceph-mon[137093]: failed to encode map e122 with expected crc 2024-03-30T14:06:11.099 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:11 smithi099 ceph-mon[137093]: failed to encode map e122 with expected crc 2024-03-30T14:06:11.099 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:11 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-03-30T14:06:11.099 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:11 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:06:11.099 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:11 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:06:11.100 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:11 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:06:11.100 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:11 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:06:11.100 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:11 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:06:11.100 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:11 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:06:11.100 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:11 smithi099 ceph-mon[137093]: pgmap v89: 161 pgs: 22 active+undersized+degraded, 41 active+undersized, 98 active+clean; 585 KiB data, 135 MiB used, 715 GiB / 715 GiB avail; 638 B/s rd, 0 op/s; 86/627 objects degraded (13.716%) 2024-03-30T14:06:11.100 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:11 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:06:11.100 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:11 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:06:11.100 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:11 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:06:11.100 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:11 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:06:11.100 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:11 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:06:11.100 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:11 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:06:11.100 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:11 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:06:11.101 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:11 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:06:11.101 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:11 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:06:11.101 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:11 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:06:11.101 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:11 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:06:11.101 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:11 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:06:11.101 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:11 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:06:11.101 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:11 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:06:11.101 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:11 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:06:11.101 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:11 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:06:11.101 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:11 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:06:11.101 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:11 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:06:11.102 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:11 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:06:11.102 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:11 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:06:11.102 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:11 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:06:11.102 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:11 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:06:11.102 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:11 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:06:11.102 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:11 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:06:11.102 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:11 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:06:11.102 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:11 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:06:11.102 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:11 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:06:11.102 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:11 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:06:11.102 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:11 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:06:11.102 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:11 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:06:11.102 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:11 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:06:11.103 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:11 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:06:11.103 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:11 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:06:11.103 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:11 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:06:11.103 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:11 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:06:11.103 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:11 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:06:11.103 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:11 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:06:11.103 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:11 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:06:11.103 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:11 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:06:11.103 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:11 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:06:11.103 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:11 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:06:11.103 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:11 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:06:11.104 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:11 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:06:11.104 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:11 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:06:11.104 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:11 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:06:11.104 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:11 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:06:11.104 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:11 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:06:11.104 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:11 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:06:11.104 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:11 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:06:11.104 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:11 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:06:11.104 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:11 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:06:11.104 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:11 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:06:11.105 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:11 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:06:11.105 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:11 smithi099 ceph-mon[143401]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-03-30T14:06:11.105 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:11 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:06:11.105 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:11 smithi099 ceph-mon[143401]: failed to encode map e122 with expected crc 2024-03-30T14:06:11.105 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:11 smithi099 ceph-mon[143401]: failed to encode map e122 with expected crc 2024-03-30T14:06:11.105 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:11 smithi099 ceph-mon[143401]: osd.1 [v2:172.21.15.99:6810/1926246251,v1:172.21.15.99:6811/1926246251] boot 2024-03-30T14:06:11.105 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:11 smithi099 ceph-mon[143401]: osdmap e122: 8 total, 8 up, 8 in 2024-03-30T14:06:11.105 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:11 smithi099 ceph-mon[143401]: failed to encode map e122 with expected crc 2024-03-30T14:06:11.105 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:11 smithi099 ceph-mon[143401]: failed to encode map e122 with expected crc 2024-03-30T14:06:11.105 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:11 smithi099 ceph-mon[143401]: failed to encode map e122 with expected crc 2024-03-30T14:06:11.105 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:11 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-03-30T14:06:11.105 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:11 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:06:11.105 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:11 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:06:11.105 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:11 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:06:11.105 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:11 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:06:11.105 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:11 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:06:11.105 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:11 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:06:11.106 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:11 smithi099 ceph-mon[143401]: pgmap v89: 161 pgs: 22 active+undersized+degraded, 41 active+undersized, 98 active+clean; 585 KiB data, 135 MiB used, 715 GiB / 715 GiB avail; 638 B/s rd, 0 op/s; 86/627 objects degraded (13.716%) 2024-03-30T14:06:11.106 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:11 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:06:11.106 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:11 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:06:11.106 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:11 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:06:11.106 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:11 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:06:11.106 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:11 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:06:11.106 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:11 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:06:11.106 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:11 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:06:11.106 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:11 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:06:11.106 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:11 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:06:11.106 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:11 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:06:11.106 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:11 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:06:11.106 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:11 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:06:11.106 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:11 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:06:11.107 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:11 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:06:11.107 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:11 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:06:11.498 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:11 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:06:11.499 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:11 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:06:11.499 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:11 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:06:11.499 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:11 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:06:11.499 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:11 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:06:11.499 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:11 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:06:11.499 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:11 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:06:11.499 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:11 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:06:11.499 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:11 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:06:11.499 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:11 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:06:11.499 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:11 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:06:11.499 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:11 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:06:11.499 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:11 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:06:11.499 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:11 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:06:11.500 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:11 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:06:11.500 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:11 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:06:11.500 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:11 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:06:11.500 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:11 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:06:11.500 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:11 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:06:11.500 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:11 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:06:11.500 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:11 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:06:11.500 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:11 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:06:11.500 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:11 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:06:11.500 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:11 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:06:11.500 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:11 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:06:11.500 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:11 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:06:11.500 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:11 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:06:11.500 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:11 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:06:11.500 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:11 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:06:11.501 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:11 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:06:11.501 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:11 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:06:11.501 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:11 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:06:11.501 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:11 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:06:11.501 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:11 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:06:11.501 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:11 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:06:11.501 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:11 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:06:11.501 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:11 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:06:11.501 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:11 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:06:11.501 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:11 smithi181 ceph-mon[115276]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-03-30T14:06:11.501 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:11 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:06:11.501 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:11 smithi181 ceph-mon[115276]: failed to encode map e122 with expected crc 2024-03-30T14:06:11.501 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:11 smithi181 ceph-mon[115276]: failed to encode map e122 with expected crc 2024-03-30T14:06:11.501 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:11 smithi181 ceph-mon[115276]: osd.1 [v2:172.21.15.99:6810/1926246251,v1:172.21.15.99:6811/1926246251] boot 2024-03-30T14:06:11.501 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:11 smithi181 ceph-mon[115276]: osdmap e122: 8 total, 8 up, 8 in 2024-03-30T14:06:11.502 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:11 smithi181 ceph-mon[115276]: failed to encode map e122 with expected crc 2024-03-30T14:06:11.502 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:11 smithi181 ceph-mon[115276]: failed to encode map e122 with expected crc 2024-03-30T14:06:11.502 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:11 smithi181 ceph-mon[115276]: failed to encode map e122 with expected crc 2024-03-30T14:06:11.502 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:11 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-03-30T14:06:11.502 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:11 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:06:11.502 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:11 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:06:11.502 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:11 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:06:11.502 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:11 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:06:11.502 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:11 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:06:11.502 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:11 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:06:11.502 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:11 smithi181 ceph-mon[115276]: pgmap v89: 161 pgs: 22 active+undersized+degraded, 41 active+undersized, 98 active+clean; 585 KiB data, 135 MiB used, 715 GiB / 715 GiB avail; 638 B/s rd, 0 op/s; 86/627 objects degraded (13.716%) 2024-03-30T14:06:11.502 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:11 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:06:11.502 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:11 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:06:11.503 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:11 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:06:11.503 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:11 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:06:11.503 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:11 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:06:11.503 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:11 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:06:11.503 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:11 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:06:11.503 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:11 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:06:11.503 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:11 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:06:11.503 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:11 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:06:11.503 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:11 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:06:11.503 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:11 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:06:11.503 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:11 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:06:11.503 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:11 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:06:11.503 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:11 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:06:12.330 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:12 smithi099 ceph-mon[143401]: failed to encode map e122 with expected crc 2024-03-30T14:06:12.330 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:12 smithi099 ceph-mon[143401]: failed to encode map e122 with expected crc 2024-03-30T14:06:12.330 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:12 smithi099 ceph-mon[143401]: failed to encode map e122 with expected crc 2024-03-30T14:06:12.330 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:12 smithi099 ceph-mon[143401]: failed to encode map e122 with expected crc 2024-03-30T14:06:12.330 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:12 smithi099 ceph-mon[143401]: failed to encode map e122 with expected crc 2024-03-30T14:06:12.330 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:12 smithi099 ceph-mon[143401]: failed to encode map e122 with expected crc 2024-03-30T14:06:12.330 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:12 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:06:12.330 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:12 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:06:12.330 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:12 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:06:12.330 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:12 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:06:12.330 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:12 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:06:12.330 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:12 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:06:12.331 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:12 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:06:12.331 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:12 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:06:12.331 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:12 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:06:12.331 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:12 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:06:12.331 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:12 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:06:12.331 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:12 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:06:12.331 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:12 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:06:12.331 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:12 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:06:12.331 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:12 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:06:12.331 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:12 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:06:12.331 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:12 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:06:12.331 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:12 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:06:12.331 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:12 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:06:12.331 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:12 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:06:12.331 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:12 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:06:12.332 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:12 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:06:12.332 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:12 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:06:12.332 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:12 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:06:12.332 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:12 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:06:12.332 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:12 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:06:12.332 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:12 smithi099 ceph-mon[137093]: failed to encode map e122 with expected crc 2024-03-30T14:06:12.332 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:12 smithi099 ceph-mon[137093]: failed to encode map e122 with expected crc 2024-03-30T14:06:12.332 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:12 smithi099 ceph-mon[137093]: failed to encode map e122 with expected crc 2024-03-30T14:06:12.332 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:12 smithi099 ceph-mon[137093]: failed to encode map e122 with expected crc 2024-03-30T14:06:12.332 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:12 smithi099 ceph-mon[137093]: failed to encode map e122 with expected crc 2024-03-30T14:06:12.332 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:12 smithi099 ceph-mon[137093]: failed to encode map e122 with expected crc 2024-03-30T14:06:12.332 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:12 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:06:12.332 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:12 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:06:12.333 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:12 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:06:12.333 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:12 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:06:12.333 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:12 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:06:12.333 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:12 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:06:12.333 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:12 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:06:12.333 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:12 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:06:12.333 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:12 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:06:12.333 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:12 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:06:12.333 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:12 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:06:12.333 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:12 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:06:12.333 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:12 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:06:12.333 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:12 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:06:12.333 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:12 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:06:12.333 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:12 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:06:12.333 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:12 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:06:12.334 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:12 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:06:12.334 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:12 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:06:12.334 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:12 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:06:12.334 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:12 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:06:12.334 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:12 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:06:12.334 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:12 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:06:12.334 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:12 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:06:12.334 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:12 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:06:12.334 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:12 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:06:12.334 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:12 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:06:12.334 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:12 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:06:12.334 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:12 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:06:12.334 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:12 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:06:12.335 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:12 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:06:12.335 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:12 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:06:12.335 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:12 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:06:12.335 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:12 smithi099 ceph-mon[143401]: failed to encode map e123 with expected crc 2024-03-30T14:06:12.335 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:12 smithi099 ceph-mon[143401]: osdmap e123: 8 total, 8 up, 8 in 2024-03-30T14:06:12.335 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:12 smithi099 ceph-mon[143401]: failed to encode map e123 with expected crc 2024-03-30T14:06:12.335 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:12 smithi099 ceph-mon[143401]: failed to encode map e123 with expected crc 2024-03-30T14:06:12.335 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:12 smithi099 ceph-mon[143401]: failed to encode map e123 with expected crc 2024-03-30T14:06:12.335 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:12 smithi099 ceph-mon[143401]: failed to encode map e123 with expected crc 2024-03-30T14:06:12.335 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:12 smithi099 ceph-mon[143401]: failed to encode map e123 with expected crc 2024-03-30T14:06:12.335 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:12 smithi099 ceph-mon[143401]: failed to encode map e123 with expected crc 2024-03-30T14:06:12.335 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:12 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:06:12.335 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:12 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:06:12.335 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:12 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:06:12.335 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:12 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:06:12.335 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:12 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:06:12.336 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:12 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:06:12.336 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:12 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:06:12.336 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:12 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:06:12.336 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:12 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:06:12.336 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:12 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:06:12.336 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:12 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:06:12.336 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:12 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:06:12.336 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:12 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:06:12.336 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:12 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:06:12.336 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:12 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:06:12.336 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:12 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:06:12.336 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:12 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:06:12.336 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:12 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:06:12.337 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:12 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:06:12.337 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:12 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:06:12.337 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:12 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:06:12.337 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:12 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:06:12.337 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:12 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:06:12.337 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:12 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:06:12.337 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:12 smithi099 ceph-mon[137093]: failed to encode map e123 with expected crc 2024-03-30T14:06:12.337 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:12 smithi099 ceph-mon[137093]: osdmap e123: 8 total, 8 up, 8 in 2024-03-30T14:06:12.337 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:12 smithi099 ceph-mon[137093]: failed to encode map e123 with expected crc 2024-03-30T14:06:12.337 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:12 smithi099 ceph-mon[137093]: failed to encode map e123 with expected crc 2024-03-30T14:06:12.337 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:12 smithi099 ceph-mon[137093]: failed to encode map e123 with expected crc 2024-03-30T14:06:12.337 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:12 smithi099 ceph-mon[137093]: failed to encode map e123 with expected crc 2024-03-30T14:06:12.337 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:12 smithi099 ceph-mon[137093]: failed to encode map e123 with expected crc 2024-03-30T14:06:12.337 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:12 smithi099 ceph-mon[137093]: failed to encode map e123 with expected crc 2024-03-30T14:06:12.337 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:12 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:06:12.338 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:12 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:06:12.338 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:12 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:06:12.338 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:12 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:06:12.338 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:12 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:06:12.338 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:12 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:06:12.338 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:12 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:06:12.338 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:12 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:06:12.338 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:12 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:06:12.338 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:12 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:06:12.338 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:12 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:06:12.338 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:12 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:06:12.338 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:12 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:06:12.338 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:12 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:06:12.338 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:12 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:06:12.338 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:12 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:06:12.339 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:12 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:06:12.498 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:12 smithi181 ceph-mon[115276]: failed to encode map e122 with expected crc 2024-03-30T14:06:12.498 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:12 smithi181 ceph-mon[115276]: failed to encode map e122 with expected crc 2024-03-30T14:06:12.498 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:12 smithi181 ceph-mon[115276]: failed to encode map e122 with expected crc 2024-03-30T14:06:12.498 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:12 smithi181 ceph-mon[115276]: failed to encode map e122 with expected crc 2024-03-30T14:06:12.499 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:12 smithi181 ceph-mon[115276]: failed to encode map e122 with expected crc 2024-03-30T14:06:12.499 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:12 smithi181 ceph-mon[115276]: failed to encode map e122 with expected crc 2024-03-30T14:06:12.499 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:12 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:06:12.499 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:12 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:06:12.499 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:12 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:06:12.499 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:12 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:06:12.499 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:12 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:06:12.499 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:12 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:06:12.499 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:12 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:06:12.499 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:12 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:06:12.499 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:12 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:06:12.499 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:12 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:06:12.499 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:12 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:06:12.499 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:12 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:06:12.499 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:12 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:06:12.499 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:12 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:06:12.499 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:12 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:06:12.500 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:12 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:06:12.500 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:12 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:06:12.500 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:12 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:06:12.500 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:12 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:06:12.500 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:12 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:06:12.500 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:12 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:06:12.500 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:12 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:06:12.500 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:12 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:06:12.500 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:12 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:06:12.500 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:12 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:06:12.500 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:12 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:06:12.500 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:12 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:06:12.500 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:12 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:06:12.500 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:12 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:06:12.500 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:12 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:06:12.500 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:12 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:06:12.501 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:12 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:06:12.501 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:12 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:06:12.501 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:12 smithi181 ceph-mon[115276]: failed to encode map e123 with expected crc 2024-03-30T14:06:12.501 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:12 smithi181 ceph-mon[115276]: osdmap e123: 8 total, 8 up, 8 in 2024-03-30T14:06:12.501 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:12 smithi181 ceph-mon[115276]: failed to encode map e123 with expected crc 2024-03-30T14:06:12.501 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:12 smithi181 ceph-mon[115276]: failed to encode map e123 with expected crc 2024-03-30T14:06:12.501 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:12 smithi181 ceph-mon[115276]: failed to encode map e123 with expected crc 2024-03-30T14:06:12.501 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:12 smithi181 ceph-mon[115276]: failed to encode map e123 with expected crc 2024-03-30T14:06:12.501 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:12 smithi181 ceph-mon[115276]: failed to encode map e123 with expected crc 2024-03-30T14:06:12.501 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:12 smithi181 ceph-mon[115276]: failed to encode map e123 with expected crc 2024-03-30T14:06:12.501 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:12 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:06:12.501 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:12 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:06:12.501 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:12 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:06:12.502 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:12 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:06:12.502 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:12 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:06:12.502 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:12 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:06:12.502 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:12 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:06:12.502 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:12 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:06:12.502 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:12 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:06:12.502 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:12 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:06:12.502 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:12 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:06:12.502 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:12 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:06:12.502 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:12 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:06:12.502 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:12 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:06:12.502 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:12 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:06:12.502 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:12 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:06:12.503 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:12 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:06:13.079 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:13 smithi099 ceph-mon[137093]: failed to encode map e123 with expected crc 2024-03-30T14:06:13.079 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:13 smithi099 ceph-mon[137093]: failed to encode map e123 with expected crc 2024-03-30T14:06:13.079 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:13 smithi099 ceph-mon[137093]: failed to encode map e123 with expected crc 2024-03-30T14:06:13.079 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:13 smithi099 ceph-mon[137093]: failed to encode map e123 with expected crc 2024-03-30T14:06:13.079 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:13 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:06:13.079 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:13 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:06:13.079 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:13 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:06:13.079 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:13 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:06:13.080 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:13 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:06:13.080 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:13 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:06:13.080 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:13 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:06:13.080 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:13 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:06:13.080 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:13 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:06:13.080 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:13 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:06:13.080 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:13 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:06:13.080 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:13 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:06:13.080 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:13 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:06:13.080 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:13 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:06:13.080 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:13 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:06:13.080 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:13 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:06:13.080 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:13 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:06:13.080 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:13 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:06:13.081 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:13 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:06:13.081 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:13 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:06:13.081 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:13 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:06:13.081 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:13 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:06:13.081 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:13 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:06:13.081 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:13 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:06:13.081 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:13 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:06:13.081 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:13 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:06:13.081 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:13 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:06:13.081 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:13 smithi099 ceph-mon[143401]: failed to encode map e123 with expected crc 2024-03-30T14:06:13.082 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:13 smithi099 ceph-mon[143401]: failed to encode map e123 with expected crc 2024-03-30T14:06:13.082 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:13 smithi099 ceph-mon[143401]: failed to encode map e123 with expected crc 2024-03-30T14:06:13.082 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:13 smithi099 ceph-mon[143401]: failed to encode map e123 with expected crc 2024-03-30T14:06:13.082 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:13 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:06:13.082 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:13 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:06:13.082 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:13 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:06:13.082 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:13 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:06:13.082 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:13 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:06:13.082 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:13 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:06:13.082 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:13 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:06:13.082 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:13 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:06:13.082 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:13 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:06:13.083 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:13 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:06:13.083 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:13 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:06:13.083 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:13 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:06:13.083 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:13 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:06:13.083 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:13 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:06:13.083 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:13 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:06:13.083 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:13 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:06:13.083 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:13 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:06:13.083 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:13 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:06:13.083 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:13 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:06:13.083 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:13 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:06:13.083 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:13 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:06:13.083 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:13 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:06:13.083 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:13 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:06:13.083 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:13 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:06:13.084 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:13 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:06:13.084 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:13 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:06:13.084 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:13 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:06:13.084 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:13 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:06:13.084 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:13 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:06:13.084 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:13 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:06:13.084 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:13 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:06:13.084 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:13 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:06:13.084 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:13 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:06:13.084 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:13 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:06:13.084 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:13 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:06:13.084 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:13 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:06:13.084 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:13 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:06:13.084 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:13 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:06:13.085 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:13 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:06:13.085 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:13 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:06:13.085 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:13 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:06:13.085 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:13 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:06:13.085 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:13 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:06:13.085 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:13 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:06:13.085 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:13 smithi099 ceph-mon[143401]: pgmap v91: 161 pgs: 8 active+undersized+degraded, 18 active+undersized, 135 active+clean; 585 KiB data, 136 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 1 op/s; 37/627 objects degraded (5.901%) 2024-03-30T14:06:13.085 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:13 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:06:13.085 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:13 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:06:13.085 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:13 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:06:13.085 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:13 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:06:13.085 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:13 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:06:13.085 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:13 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:06:13.085 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:13 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:06:13.085 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:13 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:06:13.085 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:13 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:06:13.086 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:13 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:06:13.086 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:13 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:06:13.086 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:13 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:06:13.086 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:13 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:06:13.086 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:13 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:06:13.086 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:13 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:06:13.086 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:13 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:06:13.086 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:13 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:06:13.086 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:13 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:06:13.086 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:13 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:06:13.086 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:13 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:06:13.086 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:13 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:06:13.087 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:13 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:06:13.087 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:13 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:06:13.087 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:13 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:06:13.087 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:13 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:06:13.087 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:13 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:06:13.087 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:13 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:06:13.087 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:13 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:06:13.087 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:13 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:06:13.087 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:13 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:06:13.087 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:13 smithi099 ceph-mon[137093]: pgmap v91: 161 pgs: 8 active+undersized+degraded, 18 active+undersized, 135 active+clean; 585 KiB data, 136 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 1 op/s; 37/627 objects degraded (5.901%) 2024-03-30T14:06:13.087 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:13 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:06:13.087 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:13 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:06:13.087 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:13 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:06:13.087 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:13 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:06:13.088 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:13 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:06:13.088 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:13 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:06:13.088 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:13 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:06:13.088 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:13 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:06:13.088 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:13 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:06:13.088 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:13 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:06:13.088 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:13 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:06:13.088 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:13 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:06:13.088 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:13 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:06:13.088 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:13 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:06:13.088 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:13 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:06:13.089 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:13 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:06:13.089 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:13 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:06:13.089 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:13 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:06:13.089 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:13 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]: dispatch 2024-03-30T14:06:13.089 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:13 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]: dispatch 2024-03-30T14:06:13.089 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:13 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]': finished 2024-03-30T14:06:13.089 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:13 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-03-30T14:06:13.089 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:13 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-03-30T14:06:13.089 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:13 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon"}]': finished 2024-03-30T14:06:13.089 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:13 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]: dispatch 2024-03-30T14:06:13.089 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:13 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]: dispatch 2024-03-30T14:06:13.089 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:13 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]': finished 2024-03-30T14:06:13.089 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:13 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd"}]: dispatch 2024-03-30T14:06:13.089 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:13 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd"}]: dispatch 2024-03-30T14:06:13.090 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:13 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds"}]: dispatch 2024-03-30T14:06:13.090 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:13 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds"}]: dispatch 2024-03-30T14:06:13.090 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:13 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]: dispatch 2024-03-30T14:06:13.090 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:13 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]: dispatch 2024-03-30T14:06:13.090 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:13 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]: dispatch 2024-03-30T14:06:13.090 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:13 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]: dispatch 2024-03-30T14:06:13.090 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:13 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-03-30T14:06:13.090 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:13 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-03-30T14:06:13.090 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:13 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:06:13.091 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:13 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:06:13.091 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:13 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:06:13.091 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:13 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:06:13.091 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:13 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:06:13.091 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:13 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]: dispatch 2024-03-30T14:06:13.091 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:13 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]: dispatch 2024-03-30T14:06:13.091 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:13 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]': finished 2024-03-30T14:06:13.091 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:13 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-03-30T14:06:13.091 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:13 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-03-30T14:06:13.091 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:13 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon"}]': finished 2024-03-30T14:06:13.091 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:13 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]: dispatch 2024-03-30T14:06:13.091 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:13 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]: dispatch 2024-03-30T14:06:13.091 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:13 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]': finished 2024-03-30T14:06:13.091 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:13 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd"}]: dispatch 2024-03-30T14:06:13.091 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:13 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd"}]: dispatch 2024-03-30T14:06:13.092 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:13 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds"}]: dispatch 2024-03-30T14:06:13.092 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:13 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds"}]: dispatch 2024-03-30T14:06:13.092 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:13 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]: dispatch 2024-03-30T14:06:13.092 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:13 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]: dispatch 2024-03-30T14:06:13.092 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:13 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]: dispatch 2024-03-30T14:06:13.092 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:13 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]: dispatch 2024-03-30T14:06:13.092 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:13 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-03-30T14:06:13.092 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:13 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-03-30T14:06:13.092 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:13 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"}]: dispatch 2024-03-30T14:06:13.092 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:13 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"}]: dispatch 2024-03-30T14:06:13.093 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:13 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]: dispatch 2024-03-30T14:06:13.093 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:13 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]: dispatch 2024-03-30T14:06:13.093 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:13 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]: dispatch 2024-03-30T14:06:13.093 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:13 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]: dispatch 2024-03-30T14:06:13.093 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:13 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]: dispatch 2024-03-30T14:06:13.093 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:13 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]: dispatch 2024-03-30T14:06:13.093 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:13 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]': finished 2024-03-30T14:06:13.093 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:13 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-03-30T14:06:13.093 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:13 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-03-30T14:06:13.093 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:13 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-03-30T14:06:13.093 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:13 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-03-30T14:06:13.093 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:13 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-03-30T14:06:13.093 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:13 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-03-30T14:06:13.093 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:13 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-03-30T14:06:13.093 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:13 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-03-30T14:06:13.093 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:13 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-03-30T14:06:13.094 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:13 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-03-30T14:06:13.094 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:13 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-03-30T14:06:13.094 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:13 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-03-30T14:06:13.094 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:13 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]: dispatch 2024-03-30T14:06:13.094 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:13 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' cmd=[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]: dispatch 2024-03-30T14:06:13.094 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:13 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' cmd='[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]': finished 2024-03-30T14:06:13.094 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:13 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:06:13.094 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:13 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:06:13.094 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:13 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:06:13.097 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:13 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"}]: dispatch 2024-03-30T14:06:13.097 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:13 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"}]: dispatch 2024-03-30T14:06:13.097 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:13 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]: dispatch 2024-03-30T14:06:13.097 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:13 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]: dispatch 2024-03-30T14:06:13.097 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:13 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]: dispatch 2024-03-30T14:06:13.097 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:13 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]: dispatch 2024-03-30T14:06:13.097 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:13 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]: dispatch 2024-03-30T14:06:13.098 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:13 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]: dispatch 2024-03-30T14:06:13.098 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:13 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]': finished 2024-03-30T14:06:13.098 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:13 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-03-30T14:06:13.098 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:13 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-03-30T14:06:13.098 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:13 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-03-30T14:06:13.098 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:13 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-03-30T14:06:13.098 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:13 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-03-30T14:06:13.098 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:13 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-03-30T14:06:13.098 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:13 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-03-30T14:06:13.098 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:13 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-03-30T14:06:13.098 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:13 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-03-30T14:06:13.098 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:13 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-03-30T14:06:13.098 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:13 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-03-30T14:06:13.098 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:13 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-03-30T14:06:13.098 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:13 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]: dispatch 2024-03-30T14:06:13.099 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:13 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' cmd=[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]: dispatch 2024-03-30T14:06:13.099 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:13 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' cmd='[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]': finished 2024-03-30T14:06:13.099 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:13 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:06:13.099 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:13 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:06:13.099 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:13 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:06:13.498 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:13 smithi181 ceph-mon[115276]: failed to encode map e123 with expected crc 2024-03-30T14:06:13.498 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:13 smithi181 ceph-mon[115276]: failed to encode map e123 with expected crc 2024-03-30T14:06:13.498 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:13 smithi181 ceph-mon[115276]: failed to encode map e123 with expected crc 2024-03-30T14:06:13.498 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:13 smithi181 ceph-mon[115276]: failed to encode map e123 with expected crc 2024-03-30T14:06:13.499 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:13 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:06:13.499 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:13 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:06:13.499 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:13 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:06:13.499 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:13 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:06:13.499 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:13 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:06:13.499 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:13 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:06:13.499 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:13 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:06:13.499 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:13 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:06:13.499 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:13 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:06:13.499 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:13 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:06:13.499 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:13 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:06:13.499 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:13 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:06:13.499 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:13 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:06:13.499 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:13 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:06:13.499 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:13 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:06:13.500 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:13 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:06:13.500 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:13 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:06:13.500 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:13 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:06:13.500 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:13 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:06:13.500 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:13 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:06:13.500 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:13 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:06:13.500 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:13 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:06:13.500 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:13 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:06:13.500 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:13 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:06:13.500 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:13 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:06:13.500 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:13 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:06:13.500 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:13 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:06:13.500 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:13 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:06:13.500 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:13 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:06:13.501 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:13 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:06:13.501 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:13 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:06:13.501 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:13 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:06:13.501 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:13 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:06:13.501 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:13 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:06:13.501 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:13 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:06:13.501 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:13 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:06:13.501 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:13 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:06:13.501 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:13 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:06:13.501 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:13 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:06:13.501 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:13 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:06:13.501 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:13 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:06:13.501 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:13 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:06:13.502 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:13 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:06:13.502 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:13 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:06:13.502 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:13 smithi181 ceph-mon[115276]: pgmap v91: 161 pgs: 8 active+undersized+degraded, 18 active+undersized, 135 active+clean; 585 KiB data, 136 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 1 op/s; 37/627 objects degraded (5.901%) 2024-03-30T14:06:13.502 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:13 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:06:13.502 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:13 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:06:13.502 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:13 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:06:13.502 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:13 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:06:13.502 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:13 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:06:13.502 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:13 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:06:13.502 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:13 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:06:13.502 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:13 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:06:13.502 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:13 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:06:13.502 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:13 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:06:13.502 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:13 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:06:13.503 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:13 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:06:13.503 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:13 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:06:13.503 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:13 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:06:13.504 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:13 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:06:13.504 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:13 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:06:13.504 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:13 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:06:13.504 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:13 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:06:13.504 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:13 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]: dispatch 2024-03-30T14:06:13.504 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:13 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]: dispatch 2024-03-30T14:06:13.504 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:13 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]': finished 2024-03-30T14:06:13.504 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:13 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-03-30T14:06:13.504 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:13 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-03-30T14:06:13.504 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:13 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon"}]': finished 2024-03-30T14:06:13.504 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:13 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]: dispatch 2024-03-30T14:06:13.504 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:13 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]: dispatch 2024-03-30T14:06:13.504 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:13 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]': finished 2024-03-30T14:06:13.504 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:13 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd"}]: dispatch 2024-03-30T14:06:13.505 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:13 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd"}]: dispatch 2024-03-30T14:06:13.505 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:13 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds"}]: dispatch 2024-03-30T14:06:13.505 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:13 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds"}]: dispatch 2024-03-30T14:06:13.505 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:13 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]: dispatch 2024-03-30T14:06:13.505 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:13 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]: dispatch 2024-03-30T14:06:13.505 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:13 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]: dispatch 2024-03-30T14:06:13.505 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:13 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]: dispatch 2024-03-30T14:06:13.505 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:13 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-03-30T14:06:13.505 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:13 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-03-30T14:06:13.505 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:13 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"}]: dispatch 2024-03-30T14:06:13.505 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:13 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"}]: dispatch 2024-03-30T14:06:13.505 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:13 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]: dispatch 2024-03-30T14:06:13.505 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:13 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]: dispatch 2024-03-30T14:06:13.505 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:13 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]: dispatch 2024-03-30T14:06:13.506 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:13 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]: dispatch 2024-03-30T14:06:13.506 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:13 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]: dispatch 2024-03-30T14:06:13.506 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:13 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]: dispatch 2024-03-30T14:06:13.506 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:13 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]': finished 2024-03-30T14:06:13.506 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:13 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-03-30T14:06:13.506 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:13 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-03-30T14:06:13.506 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:13 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-03-30T14:06:13.506 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:13 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-03-30T14:06:13.506 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:13 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-03-30T14:06:13.506 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:13 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-03-30T14:06:13.506 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:13 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-03-30T14:06:13.506 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:13 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-03-30T14:06:13.506 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:13 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-03-30T14:06:13.506 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:13 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-03-30T14:06:13.507 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:13 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-03-30T14:06:13.507 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:13 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-03-30T14:06:13.507 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:13 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]: dispatch 2024-03-30T14:06:13.507 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:13 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' cmd=[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]: dispatch 2024-03-30T14:06:13.507 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:13 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' cmd='[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]': finished 2024-03-30T14:06:13.507 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:13 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:06:13.507 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:13 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:06:13.507 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:13 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:06:14.329 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:14 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:06:14.329 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:14 smithi099 ceph-mon[137093]: Upgrade: Setting container_image for all nvmeof 2024-03-30T14:06:14.329 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:14 smithi099 ceph-mon[137093]: Upgrade: Finalizing container_image settings 2024-03-30T14:06:14.329 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:14 smithi099 ceph-mon[137093]: Upgrade: Complete! 2024-03-30T14:06:14.329 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:14 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:06:14.329 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:14 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:06:14.329 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:14 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:06:14.329 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:14 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:06:14.329 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:14 smithi099 ceph-mon[143401]: Upgrade: Setting container_image for all nvmeof 2024-03-30T14:06:14.330 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:14 smithi099 ceph-mon[143401]: Upgrade: Finalizing container_image settings 2024-03-30T14:06:14.330 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:14 smithi099 ceph-mon[143401]: Upgrade: Complete! 2024-03-30T14:06:14.330 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:14 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:06:14.330 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:14 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:06:14.330 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:14 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:06:14.497 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:14 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:06:14.498 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:14 smithi181 ceph-mon[115276]: Upgrade: Setting container_image for all nvmeof 2024-03-30T14:06:14.498 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:14 smithi181 ceph-mon[115276]: Upgrade: Finalizing container_image settings 2024-03-30T14:06:14.498 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:14 smithi181 ceph-mon[115276]: Upgrade: Complete! 2024-03-30T14:06:14.498 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:14 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:06:14.498 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:14 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:06:14.498 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:14 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:06:15.020 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 14:06:14 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[71049]: ::ffff:172.21.15.181 - - [30/Mar/2024:14:06:14] "GET /metrics HTTP/1.1" 200 38242 "" "Prometheus/2.43.0" 2024-03-30T14:06:15.328 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:15 smithi099 ceph-mon[137093]: Health check update: Degraded data redundancy: 37/627 objects degraded (5.901%), 8 pgs degraded (PG_DEGRADED) 2024-03-30T14:06:15.329 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:15 smithi099 ceph-mon[137093]: pgmap v92: 161 pgs: 1 active+undersized+degraded, 4 active+undersized, 156 active+clean; 585 KiB data, 136 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s; 6/627 objects degraded (0.957%) 2024-03-30T14:06:15.329 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:15 smithi099 ceph-mon[143401]: Health check update: Degraded data redundancy: 37/627 objects degraded (5.901%), 8 pgs degraded (PG_DEGRADED) 2024-03-30T14:06:15.329 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:15 smithi099 ceph-mon[143401]: pgmap v92: 161 pgs: 1 active+undersized+degraded, 4 active+undersized, 156 active+clean; 585 KiB data, 136 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s; 6/627 objects degraded (0.957%) 2024-03-30T14:06:15.497 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:15 smithi181 ceph-mon[115276]: Health check update: Degraded data redundancy: 37/627 objects degraded (5.901%), 8 pgs degraded (PG_DEGRADED) 2024-03-30T14:06:15.498 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:15 smithi181 ceph-mon[115276]: pgmap v92: 161 pgs: 1 active+undersized+degraded, 4 active+undersized, 156 active+clean; 585 KiB data, 136 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s; 6/627 objects degraded (0.957%) 2024-03-30T14:06:17.079 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:16 smithi099 ceph-mon[143401]: pgmap v93: 161 pgs: 161 active+clean; 585 KiB data, 136 MiB used, 715 GiB / 715 GiB avail; 670 B/s rd, 0 op/s 2024-03-30T14:06:17.079 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:16 smithi099 ceph-mon[143401]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 6/627 objects degraded (0.957%), 1 pg degraded) 2024-03-30T14:06:17.079 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:16 smithi099 ceph-mon[143401]: Cluster is now healthy 2024-03-30T14:06:17.079 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:16 smithi099 ceph-mon[137093]: pgmap v93: 161 pgs: 161 active+clean; 585 KiB data, 136 MiB used, 715 GiB / 715 GiB avail; 670 B/s rd, 0 op/s 2024-03-30T14:06:17.079 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:16 smithi099 ceph-mon[137093]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 6/627 objects degraded (0.957%), 1 pg degraded) 2024-03-30T14:06:17.079 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:16 smithi099 ceph-mon[137093]: Cluster is now healthy 2024-03-30T14:06:17.248 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:16 smithi181 ceph-mon[115276]: pgmap v93: 161 pgs: 161 active+clean; 585 KiB data, 136 MiB used, 715 GiB / 715 GiB avail; 670 B/s rd, 0 op/s 2024-03-30T14:06:17.248 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:16 smithi181 ceph-mon[115276]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 6/627 objects degraded (0.957%), 1 pg degraded) 2024-03-30T14:06:17.248 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:16 smithi181 ceph-mon[115276]: Cluster is now healthy 2024-03-30T14:06:18.071 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:17 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:06:18.072 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:17 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:06:18.248 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:17 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:06:19.748 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:19 smithi181 ceph-mon[115276]: from='client.25136 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T14:06:19.748 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:19 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:06:19.748 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:19 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:06:19.748 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:19 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:06:19.748 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:19 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:06:19.748 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:19 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:06:19.748 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:19 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:06:19.748 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:19 smithi181 ceph-mon[115276]: pgmap v94: 161 pgs: 161 active+clean; 585 KiB data, 136 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T14:06:19.829 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:19 smithi099 ceph-mon[143401]: from='client.25136 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T14:06:19.829 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:19 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:06:19.829 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:19 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:06:19.829 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:19 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:06:19.829 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:19 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:06:19.829 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:19 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:06:19.829 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:19 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:06:19.829 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:19 smithi099 ceph-mon[143401]: pgmap v94: 161 pgs: 161 active+clean; 585 KiB data, 136 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T14:06:19.829 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:19 smithi099 ceph-mon[137093]: from='client.25136 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T14:06:19.829 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:19 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:06:19.829 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:19 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:06:19.830 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:19 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:06:19.830 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:19 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:06:19.830 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:19 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:06:19.830 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:19 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:06:19.830 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:19 smithi099 ceph-mon[137093]: pgmap v94: 161 pgs: 161 active+clean; 585 KiB data, 136 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T14:06:21.079 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:20 smithi099 ceph-mon[137093]: pgmap v95: 161 pgs: 161 active+clean; 585 KiB data, 136 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-03-30T14:06:21.079 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:20 smithi099 ceph-mon[143401]: pgmap v95: 161 pgs: 161 active+clean; 585 KiB data, 136 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-03-30T14:06:21.248 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:20 smithi181 ceph-mon[115276]: pgmap v95: 161 pgs: 161 active+clean; 585 KiB data, 136 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-03-30T14:06:23.079 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:22 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:06:23.079 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:22 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T14:06:23.079 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:22 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:06:23.079 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:22 smithi099 ceph-mon[137093]: pgmap v96: 161 pgs: 161 active+clean; 585 KiB data, 136 MiB used, 715 GiB / 715 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-03-30T14:06:23.079 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:22 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:06:23.079 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:22 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T14:06:23.079 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:22 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:06:23.079 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:22 smithi099 ceph-mon[143401]: pgmap v96: 161 pgs: 161 active+clean; 585 KiB data, 136 MiB used, 715 GiB / 715 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-03-30T14:06:23.248 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:22 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:06:23.248 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:22 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T14:06:23.248 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:22 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:06:23.248 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:22 smithi181 ceph-mon[115276]: pgmap v96: 161 pgs: 161 active+clean; 585 KiB data, 136 MiB used, 715 GiB / 715 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-03-30T14:06:25.078 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:24 smithi099 ceph-mon[137093]: pgmap v97: 161 pgs: 161 active+clean; 585 KiB data, 136 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T14:06:25.079 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:24 smithi099 ceph-mon[143401]: pgmap v97: 161 pgs: 161 active+clean; 585 KiB data, 136 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T14:06:25.079 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 14:06:24 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[71049]: ::ffff:172.21.15.181 - - [30/Mar/2024:14:06:24] "GET /metrics HTTP/1.1" 200 38243 "" "Prometheus/2.43.0" 2024-03-30T14:06:25.128 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:24 smithi181 ceph-mon[115276]: pgmap v97: 161 pgs: 161 active+clean; 585 KiB data, 136 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T14:06:26.998 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:26 smithi181 ceph-mon[115276]: pgmap v98: 161 pgs: 161 active+clean; 585 KiB data, 136 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T14:06:27.078 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:26 smithi099 ceph-mon[137093]: pgmap v98: 161 pgs: 161 active+clean; 585 KiB data, 136 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T14:06:27.079 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:26 smithi099 ceph-mon[143401]: pgmap v98: 161 pgs: 161 active+clean; 585 KiB data, 136 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T14:06:29.483 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:29 smithi099 ceph-mon[137093]: from='client.25136 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T14:06:29.484 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:29 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:06:29.484 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:29 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:06:29.484 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:29 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:06:29.484 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:29 smithi099 ceph-mon[137093]: pgmap v99: 161 pgs: 161 active+clean; 585 KiB data, 136 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T14:06:29.484 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:29 smithi099 ceph-mon[143401]: from='client.25136 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T14:06:29.484 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:29 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:06:29.484 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:29 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:06:29.484 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:29 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:06:29.484 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:29 smithi099 ceph-mon[143401]: pgmap v99: 161 pgs: 161 active+clean; 585 KiB data, 136 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T14:06:29.498 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:29 smithi181 ceph-mon[115276]: from='client.25136 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T14:06:29.498 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:29 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:06:29.498 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:29 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:06:29.498 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:29 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:06:29.498 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:29 smithi181 ceph-mon[115276]: pgmap v99: 161 pgs: 161 active+clean; 585 KiB data, 136 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T14:06:30.857 DEBUG:teuthology.orchestra.run.smithi099:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 98ebaeb8-ee99-11ee-b647-cb9ed24678a4 -e sha1=4e50bbcdd1630c7760b708f3a5b4d38a121e66cb -- bash -c 'ceph orch ps' 2024-03-30T14:06:31.079 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:30 smithi099 ceph-mon[137093]: from='client.54252 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T14:06:31.079 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:30 smithi099 ceph-mon[137093]: pgmap v100: 161 pgs: 161 active+clean; 585 KiB data, 136 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T14:06:31.079 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:30 smithi099 ceph-mon[143401]: from='client.54252 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T14:06:31.079 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:30 smithi099 ceph-mon[143401]: pgmap v100: 161 pgs: 161 active+clean; 585 KiB data, 136 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T14:06:31.248 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:30 smithi181 ceph-mon[115276]: from='client.54252 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T14:06:31.248 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:30 smithi181 ceph-mon[115276]: pgmap v100: 161 pgs: 161 active+clean; 585 KiB data, 136 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T14:06:32.839 INFO:teuthology.orchestra.run.smithi099.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-03-30T14:06:32.839 INFO:teuthology.orchestra.run.smithi099.stdout:agent.smithi099 smithi099 running 14s ago 34m - - 2024-03-30T14:06:32.839 INFO:teuthology.orchestra.run.smithi099.stdout:agent.smithi181 smithi181 running 4s ago 34m - - 2024-03-30T14:06:32.839 INFO:teuthology.orchestra.run.smithi099.stdout:alertmanager.a smithi099 *:9093,9094 running (5m) 14s ago 29m 26.9M - 0.25.0 c8568f914cd2 08735152b67d 2024-03-30T14:06:32.839 INFO:teuthology.orchestra.run.smithi099.stdout:grafana.a smithi181 *:3000 running (4m) 4s ago 28m 79.4M - 9.4.12 2bacad6d85d8 d599aa7730d6 2024-03-30T14:06:32.839 INFO:teuthology.orchestra.run.smithi099.stdout:iscsi.foo.smithi099.qyjuvr smithi099 running (7m) 14s ago 28m 59.5M - 3.5 e1d6a67b021e 2f859af6bc2a 2024-03-30T14:06:32.839 INFO:teuthology.orchestra.run.smithi099.stdout:mgr.x smithi181 *:8443,9283,8765 running (7m) 4s ago 34m 450M - 19.0.0-1967-g4e50bbcd b0c4478f1d83 f269106f7913 2024-03-30T14:06:32.839 INFO:teuthology.orchestra.run.smithi099.stdout:mgr.y smithi099 *:8443,9283,8765 running (17m) 14s ago 35m 518M - 19.0.0-1967-g4e50bbcd b0c4478f1d83 0d464b8c1d18 2024-03-30T14:06:32.839 INFO:teuthology.orchestra.run.smithi099.stdout:mon.a smithi099 running (2m) 14s ago 35m 48.1M 2048M 19.0.0-1967-g4e50bbcd b0c4478f1d83 f19388464dfd 2024-03-30T14:06:32.839 INFO:teuthology.orchestra.run.smithi099.stdout:mon.b smithi181 running (4m) 4s ago 34m 49.7M 2048M 19.0.0-1967-g4e50bbcd b0c4478f1d83 0468ed087cdd 2024-03-30T14:06:32.840 INFO:teuthology.orchestra.run.smithi099.stdout:mon.c smithi099 running (2m) 14s ago 34m 40.6M 2048M 19.0.0-1967-g4e50bbcd b0c4478f1d83 731056a2fea6 2024-03-30T14:06:32.840 INFO:teuthology.orchestra.run.smithi099.stdout:node-exporter.a smithi099 *:9100 running (6m) 14s ago 30m 16.2M - 1.5.0 0da6a335fe13 4a3f1f6e7068 2024-03-30T14:06:32.840 INFO:teuthology.orchestra.run.smithi099.stdout:node-exporter.b smithi181 *:9100 running (6m) 4s ago 30m 15.4M - 1.5.0 0da6a335fe13 acea317b5f5d 2024-03-30T14:06:32.840 INFO:teuthology.orchestra.run.smithi099.stdout:osd.0 smithi099 running (57s) 14s ago 33m 51.8M 4096M 19.0.0-1967-g4e50bbcd b0c4478f1d83 d97d48cb3314 2024-03-30T14:06:32.840 INFO:teuthology.orchestra.run.smithi099.stdout:osd.1 smithi099 running (28s) 14s ago 33m 54.2M 4096M 19.0.0-1967-g4e50bbcd b0c4478f1d83 a843295ce83b 2024-03-30T14:06:32.840 INFO:teuthology.orchestra.run.smithi099.stdout:osd.2 smithi099 running (32m) 14s ago 32m 51.8M 4096M 17.2.0 e1d6a67b021e 8e4e805a7e20 2024-03-30T14:06:32.840 INFO:teuthology.orchestra.run.smithi099.stdout:osd.3 smithi099 running (32m) 14s ago 32m 57.2M 4096M 17.2.0 e1d6a67b021e 718812bcf065 2024-03-30T14:06:32.840 INFO:teuthology.orchestra.run.smithi099.stdout:osd.4 smithi181 running (32m) 4s ago 32m 57.1M 4096M 17.2.0 e1d6a67b021e 5e205434e973 2024-03-30T14:06:32.840 INFO:teuthology.orchestra.run.smithi099.stdout:osd.5 smithi181 running (31m) 4s ago 31m 54.7M 4096M 17.2.0 e1d6a67b021e e330c920f152 2024-03-30T14:06:32.840 INFO:teuthology.orchestra.run.smithi099.stdout:osd.6 smithi181 running (31m) 4s ago 31m 53.8M 4096M 17.2.0 e1d6a67b021e 81d889ea213d 2024-03-30T14:06:32.840 INFO:teuthology.orchestra.run.smithi099.stdout:osd.7 smithi181 running (30m) 4s ago 30m 55.6M 4096M 17.2.0 e1d6a67b021e c08b1839dd7e 2024-03-30T14:06:32.840 INFO:teuthology.orchestra.run.smithi099.stdout:prometheus.a smithi181 *:9095 running (5m) 4s ago 30m 70.3M - 2.43.0 a07b618ecd1d 004088bdf70e 2024-03-30T14:06:32.840 INFO:teuthology.orchestra.run.smithi099.stdout:rgw.foo.smithi099.fxjbmp smithi099 *:8000 running (28m) 14s ago 28m 78.0M - 17.2.0 e1d6a67b021e 400b28b3f650 2024-03-30T14:06:32.840 INFO:teuthology.orchestra.run.smithi099.stdout:rgw.foo.smithi181.wfqwti smithi181 *:8000 running (28m) 4s ago 28m 77.7M - 17.2.0 e1d6a67b021e 97e1b130f9d4 2024-03-30T14:06:33.078 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:32 smithi099 ceph-mon[137093]: pgmap v101: 161 pgs: 161 active+clean; 585 KiB data, 136 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T14:06:33.079 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:32 smithi099 ceph-mon[143401]: pgmap v101: 161 pgs: 161 active+clean; 585 KiB data, 136 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T14:06:33.248 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:32 smithi181 ceph-mon[115276]: pgmap v101: 161 pgs: 161 active+clean; 585 KiB data, 136 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T14:06:33.553 DEBUG:teuthology.orchestra.run.smithi099:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 98ebaeb8-ee99-11ee-b647-cb9ed24678a4 -e sha1=4e50bbcdd1630c7760b708f3a5b4d38a121e66cb -- bash -c 'ceph versions | jq -e '"'"'.osd | length == 2'"'"'' 2024-03-30T14:06:34.079 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:33 smithi099 ceph-mon[137093]: from='client.54258 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T14:06:34.079 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:33 smithi099 ceph-mon[143401]: from='client.54258 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T14:06:34.248 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:33 smithi181 ceph-mon[115276]: from='client.54258 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T14:06:34.906 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:34 smithi099 ceph-mon[137093]: pgmap v102: 161 pgs: 161 active+clean; 585 KiB data, 136 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T14:06:34.907 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:34 smithi099 ceph-mon[143401]: pgmap v102: 161 pgs: 161 active+clean; 585 KiB data, 136 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T14:06:34.907 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 14:06:34 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[71049]: ::ffff:172.21.15.181 - - [30/Mar/2024:14:06:34] "GET /metrics HTTP/1.1" 200 38243 "" "Prometheus/2.43.0" 2024-03-30T14:06:35.247 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:34 smithi181 ceph-mon[115276]: pgmap v102: 161 pgs: 161 active+clean; 585 KiB data, 136 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T14:06:36.743 INFO:teuthology.orchestra.run.smithi099.stdout:true 2024-03-30T14:06:37.047 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:36 smithi099 ceph-mon[137093]: from='client.? 172.21.15.99:0/751690349' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:06:37.047 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:36 smithi099 ceph-mon[137093]: pgmap v103: 161 pgs: 161 active+clean; 585 KiB data, 136 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T14:06:37.047 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:36 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T14:06:37.047 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:36 smithi099 ceph-mon[143401]: from='client.? 172.21.15.99:0/751690349' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:06:37.047 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:36 smithi099 ceph-mon[143401]: pgmap v103: 161 pgs: 161 active+clean; 585 KiB data, 136 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T14:06:37.047 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:36 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T14:06:37.247 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:36 smithi181 ceph-mon[115276]: from='client.? 172.21.15.99:0/751690349' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:06:37.248 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:36 smithi181 ceph-mon[115276]: pgmap v103: 161 pgs: 161 active+clean; 585 KiB data, 136 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T14:06:37.248 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:36 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T14:06:37.606 DEBUG:teuthology.orchestra.run.smithi099:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 98ebaeb8-ee99-11ee-b647-cb9ed24678a4 -e sha1=4e50bbcdd1630c7760b708f3a5b4d38a121e66cb -- bash -c 'ceph orch upgrade check quay.ceph.io/ceph-ci/ceph:$sha1 | jq -e '"'"'.up_to_date | length == 7'"'"'' 2024-03-30T14:06:38.829 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:38 smithi099 ceph-mon[143401]: from='client.25136 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T14:06:38.829 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:38 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:06:38.829 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:38 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:06:38.829 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:38 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:06:38.829 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:38 smithi099 ceph-mon[137093]: from='client.25136 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T14:06:38.829 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:38 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:06:38.829 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:38 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:06:38.830 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:38 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:06:39.247 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:38 smithi181 ceph-mon[115276]: from='client.25136 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T14:06:39.248 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:38 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:06:39.248 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:38 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:06:39.248 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:38 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:06:39.824 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:39 smithi099 ceph-mon[137093]: pgmap v104: 161 pgs: 161 active+clean; 585 KiB data, 136 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T14:06:39.824 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:39 smithi099 ceph-mon[143401]: pgmap v104: 161 pgs: 161 active+clean; 585 KiB data, 136 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T14:06:40.247 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:39 smithi181 ceph-mon[115276]: pgmap v104: 161 pgs: 161 active+clean; 585 KiB data, 136 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T14:06:41.068 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:40 smithi099 ceph-mon[137093]: from='client.64270 -' entity='client.admin' cmd=[{"prefix": "orch upgrade check", "image": "quay.ceph.io/ceph-ci/ceph:4e50bbcdd1630c7760b708f3a5b4d38a121e66cb", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T14:06:41.068 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:40 smithi099 ceph-mon[143401]: from='client.64270 -' entity='client.admin' cmd=[{"prefix": "orch upgrade check", "image": "quay.ceph.io/ceph-ci/ceph:4e50bbcdd1630c7760b708f3a5b4d38a121e66cb", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T14:06:41.247 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:40 smithi181 ceph-mon[115276]: from='client.64270 -' entity='client.admin' cmd=[{"prefix": "orch upgrade check", "image": "quay.ceph.io/ceph-ci/ceph:4e50bbcdd1630c7760b708f3a5b4d38a121e66cb", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T14:06:41.767 INFO:teuthology.orchestra.run.smithi099.stdout:true 2024-03-30T14:06:42.075 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:41 smithi099 ceph-mon[137093]: pgmap v105: 161 pgs: 161 active+clean; 585 KiB data, 136 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T14:06:42.075 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:41 smithi099 ceph-mon[143401]: pgmap v105: 161 pgs: 161 active+clean; 585 KiB data, 136 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T14:06:42.247 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:41 smithi181 ceph-mon[115276]: pgmap v105: 161 pgs: 161 active+clean; 585 KiB data, 136 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T14:06:42.392 DEBUG:teuthology.orchestra.run.smithi099:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 98ebaeb8-ee99-11ee-b647-cb9ed24678a4 -e sha1=4e50bbcdd1630c7760b708f3a5b4d38a121e66cb -- bash -c 'ceph orch upgrade status' 2024-03-30T14:06:43.922 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:43 smithi099 ceph-mon[137093]: pgmap v106: 161 pgs: 161 active+clean; 585 KiB data, 136 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T14:06:43.922 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:43 smithi099 ceph-mon[143401]: pgmap v106: 161 pgs: 161 active+clean; 585 KiB data, 136 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T14:06:44.248 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:43 smithi181 ceph-mon[115276]: pgmap v106: 161 pgs: 161 active+clean; 585 KiB data, 136 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T14:06:44.364 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-03-30T14:06:44.364 INFO:teuthology.orchestra.run.smithi099.stdout: "target_image": null, 2024-03-30T14:06:44.364 INFO:teuthology.orchestra.run.smithi099.stdout: "in_progress": false, 2024-03-30T14:06:44.364 INFO:teuthology.orchestra.run.smithi099.stdout: "which": "", 2024-03-30T14:06:44.364 INFO:teuthology.orchestra.run.smithi099.stdout: "services_complete": [], 2024-03-30T14:06:44.364 INFO:teuthology.orchestra.run.smithi099.stdout: "progress": null, 2024-03-30T14:06:44.364 INFO:teuthology.orchestra.run.smithi099.stdout: "message": "", 2024-03-30T14:06:44.364 INFO:teuthology.orchestra.run.smithi099.stdout: "is_paused": false 2024-03-30T14:06:44.364 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-03-30T14:06:45.078 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 14:06:44 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[71049]: ::ffff:172.21.15.181 - - [30/Mar/2024:14:06:44] "GET /metrics HTTP/1.1" 200 38243 "" "Prometheus/2.43.0" 2024-03-30T14:06:45.143 DEBUG:teuthology.orchestra.run.smithi099:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 98ebaeb8-ee99-11ee-b647-cb9ed24678a4 -e sha1=4e50bbcdd1630c7760b708f3a5b4d38a121e66cb -- bash -c 'ceph health detail' 2024-03-30T14:06:45.998 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:45 smithi181 ceph-mon[115276]: from='client.54276 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T14:06:46.078 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:45 smithi099 ceph-mon[143401]: from='client.54276 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T14:06:46.079 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:45 smithi099 ceph-mon[137093]: from='client.54276 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T14:06:46.748 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:46 smithi181 ceph-mon[115276]: pgmap v107: 161 pgs: 161 active+clean; 585 KiB data, 136 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T14:06:46.765 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:46 smithi099 ceph-mon[137093]: pgmap v107: 161 pgs: 161 active+clean; 585 KiB data, 136 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T14:06:46.765 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:46 smithi099 ceph-mon[143401]: pgmap v107: 161 pgs: 161 active+clean; 585 KiB data, 136 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T14:06:47.270 INFO:teuthology.orchestra.run.smithi099.stdout:HEALTH_OK 2024-03-30T14:06:47.843 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:47 smithi181 ceph-mon[115276]: from='client.? 172.21.15.99:0/4035490206' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-03-30T14:06:47.949 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:47 smithi099 ceph-mon[137093]: from='client.? 172.21.15.99:0/4035490206' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-03-30T14:06:47.949 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:47 smithi099 ceph-mon[143401]: from='client.? 172.21.15.99:0/4035490206' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-03-30T14:06:47.972 DEBUG:teuthology.orchestra.run.smithi099:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 98ebaeb8-ee99-11ee-b647-cb9ed24678a4 -e sha1=4e50bbcdd1630c7760b708f3a5b4d38a121e66cb -- bash -c 'ceph orch upgrade start --image quay.ceph.io/ceph-ci/ceph:$sha1 --daemon-types crash,osd --limit 1' 2024-03-30T14:06:48.828 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:48 smithi099 ceph-mon[137093]: pgmap v108: 161 pgs: 161 active+clean; 585 KiB data, 136 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T14:06:48.829 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:48 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:06:48.829 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:48 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:06:48.829 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:48 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:06:48.829 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:48 smithi099 ceph-mon[143401]: pgmap v108: 161 pgs: 161 active+clean; 585 KiB data, 136 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T14:06:48.829 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:48 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:06:48.829 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:48 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:06:48.829 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:48 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:06:48.998 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:48 smithi181 ceph-mon[115276]: pgmap v108: 161 pgs: 161 active+clean; 585 KiB data, 136 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T14:06:48.998 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:48 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:06:48.998 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:48 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:06:48.998 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:48 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:06:49.742 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:49 smithi099 ceph-mon[137093]: from='client.25136 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T14:06:49.998 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:49 smithi181 ceph-mon[115276]: from='client.25136 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T14:06:50.078 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:49 smithi099 ceph-mon[143401]: from='client.25136 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T14:06:50.815 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:50 smithi099 ceph-mon[137093]: pgmap v109: 161 pgs: 161 active+clean; 585 KiB data, 136 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T14:06:50.815 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:50 smithi099 ceph-mon[137093]: from='client.64288 -' entity='client.admin' cmd=[{"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:4e50bbcdd1630c7760b708f3a5b4d38a121e66cb", "daemon_types": "crash,osd", "limit": 1, "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T14:06:50.815 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:50 smithi099 ceph-mon[143401]: pgmap v109: 161 pgs: 161 active+clean; 585 KiB data, 136 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T14:06:50.815 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:50 smithi099 ceph-mon[143401]: from='client.64288 -' entity='client.admin' cmd=[{"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:4e50bbcdd1630c7760b708f3a5b4d38a121e66cb", "daemon_types": "crash,osd", "limit": 1, "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T14:06:51.247 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:50 smithi181 ceph-mon[115276]: pgmap v109: 161 pgs: 161 active+clean; 585 KiB data, 136 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T14:06:51.248 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:50 smithi181 ceph-mon[115276]: from='client.64288 -' entity='client.admin' cmd=[{"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:4e50bbcdd1630c7760b708f3a5b4d38a121e66cb", "daemon_types": "crash,osd", "limit": 1, "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T14:06:51.508 INFO:teuthology.orchestra.run.smithi099.stdout:Initiating upgrade to quay.ceph.io/ceph-ci/ceph:4e50bbcdd1630c7760b708f3a5b4d38a121e66cb 2024-03-30T14:06:52.146 DEBUG:teuthology.orchestra.run.smithi099:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 98ebaeb8-ee99-11ee-b647-cb9ed24678a4 -e sha1=4e50bbcdd1630c7760b708f3a5b4d38a121e66cb -- bash -c 'while ceph orch upgrade status | jq '"'"'.in_progress'"'"' | grep true && ! ceph orch upgrade status | jq '"'"'.message'"'"' | grep Error ; do ceph orch ps ; ceph versions ; ceph orch upgrade status ; sleep 30 ; done' 2024-03-30T14:06:52.829 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:52 smithi099 ceph-mon[143401]: pgmap v110: 161 pgs: 161 active+clean; 585 KiB data, 136 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T14:06:52.829 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:52 smithi099 ceph-mon[143401]: Upgrade: Started with target quay.ceph.io/ceph-ci/ceph:4e50bbcdd1630c7760b708f3a5b4d38a121e66cb 2024-03-30T14:06:52.829 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:52 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:06:52.829 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:52 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:06:52.829 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:52 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:06:52.829 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:52 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:06:52.829 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:52 smithi099 ceph-mon[143401]: Upgrade: First pull of quay.ceph.io/ceph-ci/ceph:4e50bbcdd1630c7760b708f3a5b4d38a121e66cb 2024-03-30T14:06:52.829 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:52 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T14:06:52.829 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:52 smithi099 ceph-mon[137093]: pgmap v110: 161 pgs: 161 active+clean; 585 KiB data, 136 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T14:06:52.830 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:52 smithi099 ceph-mon[137093]: Upgrade: Started with target quay.ceph.io/ceph-ci/ceph:4e50bbcdd1630c7760b708f3a5b4d38a121e66cb 2024-03-30T14:06:52.830 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:52 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:06:52.830 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:52 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:06:52.830 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:52 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:06:52.830 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:52 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:06:52.830 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:52 smithi099 ceph-mon[137093]: Upgrade: First pull of quay.ceph.io/ceph-ci/ceph:4e50bbcdd1630c7760b708f3a5b4d38a121e66cb 2024-03-30T14:06:52.830 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:52 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T14:06:52.998 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:52 smithi181 ceph-mon[115276]: pgmap v110: 161 pgs: 161 active+clean; 585 KiB data, 136 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T14:06:52.998 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:52 smithi181 ceph-mon[115276]: Upgrade: Started with target quay.ceph.io/ceph-ci/ceph:4e50bbcdd1630c7760b708f3a5b4d38a121e66cb 2024-03-30T14:06:52.998 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:52 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:06:52.998 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:52 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:06:52.998 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:52 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:06:52.998 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:52 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:06:52.998 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:52 smithi181 ceph-mon[115276]: Upgrade: First pull of quay.ceph.io/ceph-ci/ceph:4e50bbcdd1630c7760b708f3a5b4d38a121e66cb 2024-03-30T14:06:52.998 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:52 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T14:06:54.354 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:54 smithi099 ceph-mon[137093]: pgmap v111: 161 pgs: 161 active+clean; 585 KiB data, 136 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T14:06:54.354 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:54 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:06:54.354 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:54 smithi099 ceph-mon[137093]: Upgrade: Target is version 19.0.0-1967-g4e50bbcd (squid) 2024-03-30T14:06:54.354 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:54 smithi099 ceph-mon[137093]: Upgrade: Target container is quay.ceph.io/ceph-ci/ceph:4e50bbcdd1630c7760b708f3a5b4d38a121e66cb, digests ['quay.ceph.io/ceph-ci/ceph@sha256:8f3809717761e681477c3ef1d8d2c03114aee2c597cd7380b93b8c10f47fcb5d'] 2024-03-30T14:06:54.354 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:54 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:06:54.354 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:54 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:06:54.354 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:54 smithi099 ceph-mon[137093]: Upgrade: Setting container_image for all mgr 2024-03-30T14:06:54.355 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:54 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:06:54.355 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:54 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:06:54.355 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:54 smithi099 ceph-mon[137093]: Upgrade: Setting container_image for all mon 2024-03-30T14:06:54.355 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:54 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:06:54.355 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:54 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:06:54.355 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:54 smithi099 ceph-mon[137093]: Upgrade: Setting container_image for all crash 2024-03-30T14:06:54.355 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:54 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:06:54.355 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:54 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-03-30T14:06:54.355 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:54 smithi099 ceph-mon[137093]: from='mon.2 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-03-30T14:06:54.355 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:54 smithi099 ceph-mon[137093]: Upgrade: osd.2 is safe to restart 2024-03-30T14:06:54.355 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:54 smithi099 ceph-mon[143401]: pgmap v111: 161 pgs: 161 active+clean; 585 KiB data, 136 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T14:06:54.356 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:54 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:06:54.356 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:54 smithi099 ceph-mon[143401]: Upgrade: Target is version 19.0.0-1967-g4e50bbcd (squid) 2024-03-30T14:06:54.356 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:54 smithi099 ceph-mon[143401]: Upgrade: Target container is quay.ceph.io/ceph-ci/ceph:4e50bbcdd1630c7760b708f3a5b4d38a121e66cb, digests ['quay.ceph.io/ceph-ci/ceph@sha256:8f3809717761e681477c3ef1d8d2c03114aee2c597cd7380b93b8c10f47fcb5d'] 2024-03-30T14:06:54.356 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:54 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:06:54.356 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:54 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:06:54.356 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:54 smithi099 ceph-mon[143401]: Upgrade: Setting container_image for all mgr 2024-03-30T14:06:54.356 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:54 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:06:54.356 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:54 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:06:54.356 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:54 smithi099 ceph-mon[143401]: Upgrade: Setting container_image for all mon 2024-03-30T14:06:54.356 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:54 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:06:54.356 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:54 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:06:54.356 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:54 smithi099 ceph-mon[143401]: Upgrade: Setting container_image for all crash 2024-03-30T14:06:54.356 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:54 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:06:54.356 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:54 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-03-30T14:06:54.357 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:54 smithi099 ceph-mon[143401]: from='mon.2 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-03-30T14:06:54.357 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:54 smithi099 ceph-mon[143401]: Upgrade: osd.2 is safe to restart 2024-03-30T14:06:54.498 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:54 smithi181 ceph-mon[115276]: pgmap v111: 161 pgs: 161 active+clean; 585 KiB data, 136 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T14:06:54.498 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:54 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:06:54.498 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:54 smithi181 ceph-mon[115276]: Upgrade: Target is version 19.0.0-1967-g4e50bbcd (squid) 2024-03-30T14:06:54.498 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:54 smithi181 ceph-mon[115276]: Upgrade: Target container is quay.ceph.io/ceph-ci/ceph:4e50bbcdd1630c7760b708f3a5b4d38a121e66cb, digests ['quay.ceph.io/ceph-ci/ceph@sha256:8f3809717761e681477c3ef1d8d2c03114aee2c597cd7380b93b8c10f47fcb5d'] 2024-03-30T14:06:54.498 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:54 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:06:54.498 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:54 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:06:54.498 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:54 smithi181 ceph-mon[115276]: Upgrade: Setting container_image for all mgr 2024-03-30T14:06:54.498 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:54 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:06:54.499 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:54 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:06:54.499 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:54 smithi181 ceph-mon[115276]: Upgrade: Setting container_image for all mon 2024-03-30T14:06:54.499 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:54 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:06:54.499 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:54 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:06:54.499 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:54 smithi181 ceph-mon[115276]: Upgrade: Setting container_image for all crash 2024-03-30T14:06:54.499 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:54 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:06:54.499 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:54 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-03-30T14:06:54.499 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:54 smithi181 ceph-mon[115276]: from='mon.2 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-03-30T14:06:54.499 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:54 smithi181 ceph-mon[115276]: Upgrade: osd.2 is safe to restart 2024-03-30T14:06:55.024 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 14:06:54 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[71049]: ::ffff:172.21.15.181 - - [30/Mar/2024:14:06:54] "GET /metrics HTTP/1.1" 200 38244 "" "Prometheus/2.43.0" 2024-03-30T14:06:56.579 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:56 smithi099 ceph-mon[143401]: pgmap v112: 161 pgs: 161 active+clean; 585 KiB data, 136 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T14:06:56.579 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:56 smithi099 ceph-mon[143401]: Upgrade: Updating osd.2 2024-03-30T14:06:56.579 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:56 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:06:56.579 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:56 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-03-30T14:06:56.579 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:56 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:06:56.579 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:56 smithi099 ceph-mon[143401]: Deploying daemon osd.2 on smithi099 2024-03-30T14:06:56.579 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:56 smithi099 ceph-mon[137093]: pgmap v112: 161 pgs: 161 active+clean; 585 KiB data, 136 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T14:06:56.579 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:56 smithi099 ceph-mon[137093]: Upgrade: Updating osd.2 2024-03-30T14:06:56.579 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:56 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:06:56.580 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:56 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-03-30T14:06:56.580 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:56 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:06:56.580 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:56 smithi099 ceph-mon[137093]: Deploying daemon osd.2 on smithi099 2024-03-30T14:06:56.748 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:56 smithi181 ceph-mon[115276]: pgmap v112: 161 pgs: 161 active+clean; 585 KiB data, 136 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T14:06:56.748 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:56 smithi181 ceph-mon[115276]: Upgrade: Updating osd.2 2024-03-30T14:06:56.748 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:56 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:06:56.748 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:56 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-03-30T14:06:56.748 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:56 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:06:56.748 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:56 smithi181 ceph-mon[115276]: Deploying daemon osd.2 on smithi099 2024-03-30T14:06:57.191 INFO:teuthology.orchestra.run.smithi099.stdout:true 2024-03-30T14:06:57.861 INFO:teuthology.orchestra.run.smithi099.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-03-30T14:06:57.861 INFO:teuthology.orchestra.run.smithi099.stdout:agent.smithi099 smithi099 running 19s ago 35m - - 2024-03-30T14:06:57.861 INFO:teuthology.orchestra.run.smithi099.stdout:agent.smithi181 smithi181 running 9s ago 35m - - 2024-03-30T14:06:57.861 INFO:teuthology.orchestra.run.smithi099.stdout:alertmanager.a smithi099 *:9093,9094 running (5m) 19s ago 29m 26.9M - 0.25.0 c8568f914cd2 08735152b67d 2024-03-30T14:06:57.861 INFO:teuthology.orchestra.run.smithi099.stdout:grafana.a smithi181 *:3000 running (5m) 9s ago 29m 79.4M - 9.4.12 2bacad6d85d8 d599aa7730d6 2024-03-30T14:06:57.861 INFO:teuthology.orchestra.run.smithi099.stdout:iscsi.foo.smithi099.qyjuvr smithi099 running (8m) 19s ago 28m 59.5M - 3.5 e1d6a67b021e 2f859af6bc2a 2024-03-30T14:06:57.861 INFO:teuthology.orchestra.run.smithi099.stdout:mgr.x smithi181 *:8443,9283,8765 running (7m) 9s ago 34m 450M - 19.0.0-1967-g4e50bbcd b0c4478f1d83 f269106f7913 2024-03-30T14:06:57.861 INFO:teuthology.orchestra.run.smithi099.stdout:mgr.y smithi099 *:8443,9283,8765 running (18m) 19s ago 36m 519M - 19.0.0-1967-g4e50bbcd b0c4478f1d83 0d464b8c1d18 2024-03-30T14:06:57.861 INFO:teuthology.orchestra.run.smithi099.stdout:mon.a smithi099 running (3m) 19s ago 36m 48.6M 2048M 19.0.0-1967-g4e50bbcd b0c4478f1d83 f19388464dfd 2024-03-30T14:06:57.862 INFO:teuthology.orchestra.run.smithi099.stdout:mon.b smithi181 running (4m) 9s ago 34m 51.6M 2048M 19.0.0-1967-g4e50bbcd b0c4478f1d83 0468ed087cdd 2024-03-30T14:06:57.862 INFO:teuthology.orchestra.run.smithi099.stdout:mon.c smithi099 running (2m) 19s ago 34m 40.5M 2048M 19.0.0-1967-g4e50bbcd b0c4478f1d83 731056a2fea6 2024-03-30T14:06:57.862 INFO:teuthology.orchestra.run.smithi099.stdout:node-exporter.a smithi099 *:9100 running (6m) 19s ago 30m 16.4M - 1.5.0 0da6a335fe13 4a3f1f6e7068 2024-03-30T14:06:57.862 INFO:teuthology.orchestra.run.smithi099.stdout:node-exporter.b smithi181 *:9100 running (6m) 9s ago 30m 15.4M - 1.5.0 0da6a335fe13 acea317b5f5d 2024-03-30T14:06:57.862 INFO:teuthology.orchestra.run.smithi099.stdout:osd.0 smithi099 running (82s) 19s ago 34m 51.9M 4096M 19.0.0-1967-g4e50bbcd b0c4478f1d83 d97d48cb3314 2024-03-30T14:06:57.862 INFO:teuthology.orchestra.run.smithi099.stdout:osd.1 smithi099 running (53s) 19s ago 33m 54.5M 4096M 19.0.0-1967-g4e50bbcd b0c4478f1d83 a843295ce83b 2024-03-30T14:06:57.862 INFO:teuthology.orchestra.run.smithi099.stdout:osd.2 smithi099 running (33m) 19s ago 33m 51.8M 4096M 17.2.0 e1d6a67b021e 8e4e805a7e20 2024-03-30T14:06:57.862 INFO:teuthology.orchestra.run.smithi099.stdout:osd.3 smithi099 running (32m) 19s ago 32m 57.2M 4096M 17.2.0 e1d6a67b021e 718812bcf065 2024-03-30T14:06:57.862 INFO:teuthology.orchestra.run.smithi099.stdout:osd.4 smithi181 running (32m) 9s ago 32m 57.1M 4096M 17.2.0 e1d6a67b021e 5e205434e973 2024-03-30T14:06:57.862 INFO:teuthology.orchestra.run.smithi099.stdout:osd.5 smithi181 running (32m) 9s ago 32m 54.3M 4096M 17.2.0 e1d6a67b021e e330c920f152 2024-03-30T14:06:57.862 INFO:teuthology.orchestra.run.smithi099.stdout:osd.6 smithi181 running (31m) 9s ago 31m 54.8M 4096M 17.2.0 e1d6a67b021e 81d889ea213d 2024-03-30T14:06:57.862 INFO:teuthology.orchestra.run.smithi099.stdout:osd.7 smithi181 running (31m) 9s ago 31m 56.5M 4096M 17.2.0 e1d6a67b021e c08b1839dd7e 2024-03-30T14:06:57.862 INFO:teuthology.orchestra.run.smithi099.stdout:prometheus.a smithi181 *:9095 running (6m) 9s ago 30m 70.3M - 2.43.0 a07b618ecd1d 004088bdf70e 2024-03-30T14:06:57.863 INFO:teuthology.orchestra.run.smithi099.stdout:rgw.foo.smithi099.fxjbmp smithi099 *:8000 running (28m) 19s ago 28m 78.1M - 17.2.0 e1d6a67b021e 400b28b3f650 2024-03-30T14:06:57.863 INFO:teuthology.orchestra.run.smithi099.stdout:rgw.foo.smithi181.wfqwti smithi181 *:8000 running (28m) 9s ago 28m 77.8M - 17.2.0 e1d6a67b021e 97e1b130f9d4 2024-03-30T14:06:58.270 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-03-30T14:06:58.270 INFO:teuthology.orchestra.run.smithi099.stdout: "mon": { 2024-03-30T14:06:58.270 INFO:teuthology.orchestra.run.smithi099.stdout: "ceph version 19.0.0-1967-g4e50bbcd (4e50bbcdd1630c7760b708f3a5b4d38a121e66cb) squid (dev)": 3 2024-03-30T14:06:58.270 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T14:06:58.270 INFO:teuthology.orchestra.run.smithi099.stdout: "mgr": { 2024-03-30T14:06:58.270 INFO:teuthology.orchestra.run.smithi099.stdout: "ceph version 19.0.0-1967-g4e50bbcd (4e50bbcdd1630c7760b708f3a5b4d38a121e66cb) squid (dev)": 2 2024-03-30T14:06:58.270 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T14:06:58.270 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": { 2024-03-30T14:06:58.270 INFO:teuthology.orchestra.run.smithi099.stdout: "ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)": 6, 2024-03-30T14:06:58.270 INFO:teuthology.orchestra.run.smithi099.stdout: "ceph version 19.0.0-1967-g4e50bbcd (4e50bbcdd1630c7760b708f3a5b4d38a121e66cb) squid (dev)": 2 2024-03-30T14:06:58.271 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T14:06:58.271 INFO:teuthology.orchestra.run.smithi099.stdout: "rgw": { 2024-03-30T14:06:58.271 INFO:teuthology.orchestra.run.smithi099.stdout: "ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)": 2 2024-03-30T14:06:58.271 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T14:06:58.271 INFO:teuthology.orchestra.run.smithi099.stdout: "overall": { 2024-03-30T14:06:58.271 INFO:teuthology.orchestra.run.smithi099.stdout: "ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)": 8, 2024-03-30T14:06:58.271 INFO:teuthology.orchestra.run.smithi099.stdout: "ceph version 19.0.0-1967-g4e50bbcd (4e50bbcdd1630c7760b708f3a5b4d38a121e66cb) squid (dev)": 7 2024-03-30T14:06:58.271 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-03-30T14:06:58.271 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-03-30T14:06:58.523 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:58 smithi099 ceph-mon[137093]: pgmap v113: 161 pgs: 161 active+clean; 585 KiB data, 136 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T14:06:58.523 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:58 smithi099 ceph-mon[137093]: from='client.54294 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T14:06:58.523 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:58 smithi099 ceph-mon[137093]: from='client.64300 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T14:06:58.524 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:58 smithi099 ceph-mon[137093]: from='client.? 172.21.15.99:0/240955221' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:06:58.524 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:58 smithi099 ceph-mon[143401]: pgmap v113: 161 pgs: 161 active+clean; 585 KiB data, 136 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T14:06:58.524 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:58 smithi099 ceph-mon[143401]: from='client.54294 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T14:06:58.524 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:58 smithi099 ceph-mon[143401]: from='client.64300 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T14:06:58.524 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:58 smithi099 ceph-mon[143401]: from='client.? 172.21.15.99:0/240955221' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:06:58.613 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-03-30T14:06:58.613 INFO:teuthology.orchestra.run.smithi099.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph:4e50bbcdd1630c7760b708f3a5b4d38a121e66cb", 2024-03-30T14:06:58.613 INFO:teuthology.orchestra.run.smithi099.stdout: "in_progress": true, 2024-03-30T14:06:58.614 INFO:teuthology.orchestra.run.smithi099.stdout: "which": "Upgrading daemons of type(s) crash,osd. Upgrade limited to 1 daemons (1 remaining).", 2024-03-30T14:06:58.614 INFO:teuthology.orchestra.run.smithi099.stdout: "services_complete": [], 2024-03-30T14:06:58.614 INFO:teuthology.orchestra.run.smithi099.stdout: "progress": "2/8 daemons upgraded", 2024-03-30T14:06:58.614 INFO:teuthology.orchestra.run.smithi099.stdout: "message": "Currently upgrading osd daemons", 2024-03-30T14:06:58.614 INFO:teuthology.orchestra.run.smithi099.stdout: "is_paused": false 2024-03-30T14:06:58.614 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-03-30T14:06:58.747 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:58 smithi181 ceph-mon[115276]: pgmap v113: 161 pgs: 161 active+clean; 585 KiB data, 136 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T14:06:58.748 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:58 smithi181 ceph-mon[115276]: from='client.54294 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T14:06:58.748 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:58 smithi181 ceph-mon[115276]: from='client.64300 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T14:06:58.748 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:58 smithi181 ceph-mon[115276]: from='client.? 172.21.15.99:0/240955221' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:06:59.631 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:59 smithi099 ceph-mon[137093]: from='client.64306 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T14:06:59.631 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:59 smithi099 ceph-mon[137093]: from='client.25136 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T14:06:59.631 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:59 smithi099 ceph-mon[137093]: from='client.54318 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T14:06:59.631 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:59 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:06:59.631 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:59 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:06:59.631 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:06:59 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:06:59.631 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:59 smithi099 ceph-mon[143401]: from='client.64306 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T14:06:59.631 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:59 smithi099 ceph-mon[143401]: from='client.25136 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T14:06:59.631 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:59 smithi099 ceph-mon[143401]: from='client.54318 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T14:06:59.631 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:59 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:06:59.632 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:59 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:06:59.632 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:06:59 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:06:59.747 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:59 smithi181 ceph-mon[115276]: from='client.64306 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T14:06:59.748 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:59 smithi181 ceph-mon[115276]: from='client.25136 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T14:06:59.748 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:59 smithi181 ceph-mon[115276]: from='client.54318 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T14:06:59.748 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:59 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:06:59.748 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:59 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:06:59.748 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:06:59 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:07:00.009 INFO:journalctl@ceph.osd.2.smithi099.stdout:Mar 30 14:06:59 smithi099 systemd[1]: Stopping Ceph osd.2 for 98ebaeb8-ee99-11ee-b647-cb9ed24678a4... 2024-03-30T14:07:00.329 INFO:journalctl@ceph.osd.2.smithi099.stdout:Mar 30 14:07:00 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-2[38881]: 2024-03-30T14:07:00.015+0000 7fba24036700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.2 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-03-30T14:07:00.329 INFO:journalctl@ceph.osd.2.smithi099.stdout:Mar 30 14:07:00 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-2[38881]: 2024-03-30T14:07:00.015+0000 7fba24036700 -1 osd.2 123 *** Got signal Terminated *** 2024-03-30T14:07:00.329 INFO:journalctl@ceph.osd.2.smithi099.stdout:Mar 30 14:07:00 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-2[38881]: 2024-03-30T14:07:00.015+0000 7fba24036700 -1 osd.2 123 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-03-30T14:07:00.726 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:00 smithi099 ceph-mon[137093]: pgmap v114: 161 pgs: 161 active+clean; 585 KiB data, 136 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T14:07:00.726 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:00 smithi099 ceph-mon[137093]: osd.2 marked itself down and dead 2024-03-30T14:07:00.726 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:00 smithi099 ceph-mon[143401]: pgmap v114: 161 pgs: 161 active+clean; 585 KiB data, 136 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T14:07:00.726 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:00 smithi099 ceph-mon[143401]: osd.2 marked itself down and dead 2024-03-30T14:07:00.747 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:00 smithi181 ceph-mon[115276]: pgmap v114: 161 pgs: 161 active+clean; 585 KiB data, 136 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T14:07:00.748 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:00 smithi181 ceph-mon[115276]: osd.2 marked itself down and dead 2024-03-30T14:07:01.328 INFO:journalctl@ceph.osd.2.smithi099.stdout:Mar 30 14:07:01 smithi099 podman[161945]: 2024-03-30 14:07:01.004069691 +0000 UTC m=+1.115923997 container died 8e4e805a7e203ea09c33597c041d50767964cfd868578e8467569105e2ccf2d5 (image=quay.io/ceph/ceph@sha256:12a0a4f43413fd97a14a3d47a3451b2d2df50020835bb93db666209f3f77617a, name=ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-2, vcs-ref=f1ee6e37554363ec55e0035aba1a693d3627fdeb, release=754, RELEASE=HEAD, GIT_REPO=https://github.com/ceph/ceph-container.git, io.buildah.version=1.19.8, GIT_CLEAN=True, version=8, name=centos-stream, io.openshift.tags=base centos centos-stream, summary=Provides a CentOS Stream container based on the Red Hat Universal Base Image, vcs-type=git, GIT_COMMIT=b613db0f44179c0940781c1c7fe04e1acb7093ac, com.redhat.component=centos-stream-container, architecture=x86_64, io.k8s.description=The Universal Base Image is designed and engineered to be the base layer for all of your containerized applications, middleware and utilities. This base image is freely redistributable, but Red Hat only supports Red Hat technologies through subscriptions for Red Hat products. This image is maintained by Red Hat and updated regularly., GIT_BRANCH=HEAD, io.k8s.display-name=CentOS Stream 8, CEPH_POINT_RELEASE=-17.2.0, com.redhat.license_terms=https://centos.org/legal/licensing-policy/, maintainer=Guillaume Abrioux , description=CentOS Stream is a continuously delivered distro that tracks just ahead of Red Hat Enterprise Linux development. This image takes the Red Hat UBI and layers on content from CentOS Stream, vendor=Red Hat, Inc., url=https://access.redhat.com/containers/#/registry.access.redhat.com/ubi8/images/8.6-754, com.redhat.build-host=cpt-1002.osbs.prod.upshift.rdu2.redhat.com, io.openshift.expose-services=, ceph=True, distribution-scope=public, build-date=2022-05-03T08:36:31.336870) 2024-03-30T14:07:01.747 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:01 smithi181 ceph-mon[115276]: Health check failed: 1 osds down (OSD_DOWN) 2024-03-30T14:07:01.748 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:01 smithi181 ceph-mon[115276]: failed to encode map e124 with expected crc 2024-03-30T14:07:01.748 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:01 smithi181 ceph-mon[115276]: failed to encode map e124 with expected crc 2024-03-30T14:07:01.748 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:01 smithi181 ceph-mon[115276]: osdmap e124: 8 total, 7 up, 8 in 2024-03-30T14:07:01.748 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:01 smithi181 ceph-mon[115276]: failed to encode map e124 with expected crc 2024-03-30T14:07:01.748 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:01 smithi181 ceph-mon[115276]: failed to encode map e124 with expected crc 2024-03-30T14:07:01.748 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:01 smithi181 ceph-mon[115276]: failed to encode map e124 with expected crc 2024-03-30T14:07:01.748 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:01 smithi181 ceph-mon[115276]: failed to encode map e124 with expected crc 2024-03-30T14:07:01.828 INFO:journalctl@ceph.osd.2.smithi099.stdout:Mar 30 14:07:01 smithi099 podman[161945]: 2024-03-30 14:07:01.624006447 +0000 UTC m=+1.735860751 container cleanup 8e4e805a7e203ea09c33597c041d50767964cfd868578e8467569105e2ccf2d5 (image=quay.io/ceph/ceph@sha256:12a0a4f43413fd97a14a3d47a3451b2d2df50020835bb93db666209f3f77617a, name=ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-2, summary=Provides a CentOS Stream container based on the Red Hat Universal Base Image, io.k8s.display-name=CentOS Stream 8, com.redhat.build-host=cpt-1002.osbs.prod.upshift.rdu2.redhat.com, io.openshift.expose-services=, maintainer=Guillaume Abrioux , com.redhat.license_terms=https://centos.org/legal/licensing-policy/, vcs-ref=f1ee6e37554363ec55e0035aba1a693d3627fdeb, vendor=Red Hat, Inc., build-date=2022-05-03T08:36:31.336870, GIT_COMMIT=b613db0f44179c0940781c1c7fe04e1acb7093ac, io.k8s.description=The Universal Base Image is designed and engineered to be the base layer for all of your containerized applications, middleware and utilities. This base image is freely redistributable, but Red Hat only supports Red Hat technologies through subscriptions for Red Hat products. This image is maintained by Red Hat and updated regularly., name=centos-stream, vcs-type=git, description=CentOS Stream is a continuously delivered distro that tracks just ahead of Red Hat Enterprise Linux development. This image takes the Red Hat UBI and layers on content from CentOS Stream, distribution-scope=public, CEPH_POINT_RELEASE=-17.2.0, url=https://access.redhat.com/containers/#/registry.access.redhat.com/ubi8/images/8.6-754, io.buildah.version=1.19.8, GIT_REPO=https://github.com/ceph/ceph-container.git, ceph=True, GIT_CLEAN=True, com.redhat.component=centos-stream-container, architecture=x86_64, release=754, io.openshift.tags=base centos centos-stream, GIT_BRANCH=HEAD, RELEASE=HEAD, version=8) 2024-03-30T14:07:01.828 INFO:journalctl@ceph.osd.2.smithi099.stdout:Mar 30 14:07:01 smithi099 bash[161945]: ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-2 2024-03-30T14:07:01.829 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:01 smithi099 ceph-mon[143401]: Health check failed: 1 osds down (OSD_DOWN) 2024-03-30T14:07:01.829 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:01 smithi099 ceph-mon[143401]: failed to encode map e124 with expected crc 2024-03-30T14:07:01.829 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:01 smithi099 ceph-mon[143401]: failed to encode map e124 with expected crc 2024-03-30T14:07:01.829 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:01 smithi099 ceph-mon[143401]: osdmap e124: 8 total, 7 up, 8 in 2024-03-30T14:07:01.829 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:01 smithi099 ceph-mon[143401]: failed to encode map e124 with expected crc 2024-03-30T14:07:01.829 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:01 smithi099 ceph-mon[143401]: failed to encode map e124 with expected crc 2024-03-30T14:07:01.829 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:01 smithi099 ceph-mon[143401]: failed to encode map e124 with expected crc 2024-03-30T14:07:01.829 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:01 smithi099 ceph-mon[143401]: failed to encode map e124 with expected crc 2024-03-30T14:07:01.829 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:01 smithi099 ceph-mon[137093]: Health check failed: 1 osds down (OSD_DOWN) 2024-03-30T14:07:01.829 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:01 smithi099 ceph-mon[137093]: failed to encode map e124 with expected crc 2024-03-30T14:07:01.830 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:01 smithi099 ceph-mon[137093]: failed to encode map e124 with expected crc 2024-03-30T14:07:01.830 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:01 smithi099 ceph-mon[137093]: osdmap e124: 8 total, 7 up, 8 in 2024-03-30T14:07:01.830 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:01 smithi099 ceph-mon[137093]: failed to encode map e124 with expected crc 2024-03-30T14:07:01.830 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:01 smithi099 ceph-mon[137093]: failed to encode map e124 with expected crc 2024-03-30T14:07:01.830 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:01 smithi099 ceph-mon[137093]: failed to encode map e124 with expected crc 2024-03-30T14:07:01.830 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:01 smithi099 ceph-mon[137093]: failed to encode map e124 with expected crc 2024-03-30T14:07:02.291 INFO:journalctl@ceph.osd.2.smithi099.stdout:Mar 30 14:07:01 smithi099 podman[161963]: 2024-03-30 14:07:01.858741752 +0000 UTC m=+0.852082903 container remove 8e4e805a7e203ea09c33597c041d50767964cfd868578e8467569105e2ccf2d5 (image=quay.io/ceph/ceph@sha256:12a0a4f43413fd97a14a3d47a3451b2d2df50020835bb93db666209f3f77617a, name=ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-2, release=754, ceph=True, description=CentOS Stream is a continuously delivered distro that tracks just ahead of Red Hat Enterprise Linux development. This image takes the Red Hat UBI and layers on content from CentOS Stream, io.k8s.description=The Universal Base Image is designed and engineered to be the base layer for all of your containerized applications, middleware and utilities. This base image is freely redistributable, but Red Hat only supports Red Hat technologies through subscriptions for Red Hat products. This image is maintained by Red Hat and updated regularly., GIT_REPO=https://github.com/ceph/ceph-container.git, version=8, RELEASE=HEAD, CEPH_POINT_RELEASE=-17.2.0, vendor=Red Hat, Inc., summary=Provides a CentOS Stream container based on the Red Hat Universal Base Image, com.redhat.license_terms=https://centos.org/legal/licensing-policy/, io.openshift.tags=base centos centos-stream, GIT_BRANCH=HEAD, io.openshift.expose-services=, url=https://access.redhat.com/containers/#/registry.access.redhat.com/ubi8/images/8.6-754, com.redhat.component=centos-stream-container, architecture=x86_64, com.redhat.build-host=cpt-1002.osbs.prod.upshift.rdu2.redhat.com, maintainer=Guillaume Abrioux , build-date=2022-05-03T08:36:31.336870, distribution-scope=public, GIT_CLEAN=True, vcs-ref=f1ee6e37554363ec55e0035aba1a693d3627fdeb, GIT_COMMIT=b613db0f44179c0940781c1c7fe04e1acb7093ac, name=centos-stream, io.buildah.version=1.19.8, vcs-type=git, io.k8s.display-name=CentOS Stream 8) 2024-03-30T14:07:02.578 INFO:journalctl@ceph.osd.2.smithi099.stdout:Mar 30 14:07:02 smithi099 podman[162068]: 2024-03-30 14:07:02.201170298 +0000 UTC m=+0.017541657 image pull b0c4478f1d83795df4d538bf108aee5fac57194348fb16dcdbb3115f3e2fe95e quay.ceph.io/ceph-ci/ceph:4e50bbcdd1630c7760b708f3a5b4d38a121e66cb 2024-03-30T14:07:02.578 INFO:journalctl@ceph.osd.2.smithi099.stdout:Mar 30 14:07:02 smithi099 podman[162068]: 2024-03-30 14:07:02.343322745 +0000 UTC m=+0.159694091 container create dd3ed43ce22ace1b4c6c333bb143b50299bf343b249f6f6158a7e1a0c94bfd8f (image=quay.ceph.io/ceph-ci/ceph:4e50bbcdd1630c7760b708f3a5b4d38a121e66cb, name=ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-2-deactivate, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240326, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, RELEASE=squid-4e50bbc, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD) 2024-03-30T14:07:02.579 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:02 smithi099 ceph-mon[137093]: pgmap v116: 161 pgs: 12 stale+active+clean, 149 active+clean; 585 KiB data, 136 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-03-30T14:07:02.579 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:02 smithi099 ceph-mon[137093]: failed to encode map e125 with expected crc 2024-03-30T14:07:02.579 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:02 smithi099 ceph-mon[137093]: failed to encode map e125 with expected crc 2024-03-30T14:07:02.579 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:02 smithi099 ceph-mon[137093]: osdmap e125: 8 total, 7 up, 8 in 2024-03-30T14:07:02.579 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:02 smithi099 ceph-mon[137093]: failed to encode map e125 with expected crc 2024-03-30T14:07:02.579 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:02 smithi099 ceph-mon[137093]: failed to encode map e125 with expected crc 2024-03-30T14:07:02.579 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:02 smithi099 ceph-mon[137093]: failed to encode map e125 with expected crc 2024-03-30T14:07:02.579 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:02 smithi099 ceph-mon[137093]: failed to encode map e125 with expected crc 2024-03-30T14:07:02.579 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:02 smithi099 ceph-mon[137093]: failed to encode map e125 with expected crc 2024-03-30T14:07:02.579 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:02 smithi099 ceph-mon[137093]: failed to encode map e125 with expected crc 2024-03-30T14:07:02.579 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:02 smithi099 ceph-mon[137093]: failed to encode map e125 with expected crc 2024-03-30T14:07:02.580 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:02 smithi099 ceph-mon[137093]: failed to encode map e125 with expected crc 2024-03-30T14:07:02.580 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:02 smithi099 ceph-mon[137093]: failed to encode map e125 with expected crc 2024-03-30T14:07:02.580 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:02 smithi099 ceph-mon[143401]: pgmap v116: 161 pgs: 12 stale+active+clean, 149 active+clean; 585 KiB data, 136 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-03-30T14:07:02.580 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:02 smithi099 ceph-mon[143401]: failed to encode map e125 with expected crc 2024-03-30T14:07:02.580 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:02 smithi099 ceph-mon[143401]: failed to encode map e125 with expected crc 2024-03-30T14:07:02.580 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:02 smithi099 ceph-mon[143401]: osdmap e125: 8 total, 7 up, 8 in 2024-03-30T14:07:02.580 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:02 smithi099 ceph-mon[143401]: failed to encode map e125 with expected crc 2024-03-30T14:07:02.580 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:02 smithi099 ceph-mon[143401]: failed to encode map e125 with expected crc 2024-03-30T14:07:02.580 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:02 smithi099 ceph-mon[143401]: failed to encode map e125 with expected crc 2024-03-30T14:07:02.580 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:02 smithi099 ceph-mon[143401]: failed to encode map e125 with expected crc 2024-03-30T14:07:02.580 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:02 smithi099 ceph-mon[143401]: failed to encode map e125 with expected crc 2024-03-30T14:07:02.580 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:02 smithi099 ceph-mon[143401]: failed to encode map e125 with expected crc 2024-03-30T14:07:02.581 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:02 smithi099 ceph-mon[143401]: failed to encode map e125 with expected crc 2024-03-30T14:07:02.581 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:02 smithi099 ceph-mon[143401]: failed to encode map e125 with expected crc 2024-03-30T14:07:02.581 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:02 smithi099 ceph-mon[143401]: failed to encode map e125 with expected crc 2024-03-30T14:07:02.747 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:02 smithi181 ceph-mon[115276]: pgmap v116: 161 pgs: 12 stale+active+clean, 149 active+clean; 585 KiB data, 136 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-03-30T14:07:02.748 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:02 smithi181 ceph-mon[115276]: failed to encode map e125 with expected crc 2024-03-30T14:07:02.748 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:02 smithi181 ceph-mon[115276]: failed to encode map e125 with expected crc 2024-03-30T14:07:02.748 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:02 smithi181 ceph-mon[115276]: osdmap e125: 8 total, 7 up, 8 in 2024-03-30T14:07:02.748 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:02 smithi181 ceph-mon[115276]: failed to encode map e125 with expected crc 2024-03-30T14:07:02.748 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:02 smithi181 ceph-mon[115276]: failed to encode map e125 with expected crc 2024-03-30T14:07:02.748 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:02 smithi181 ceph-mon[115276]: failed to encode map e125 with expected crc 2024-03-30T14:07:02.748 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:02 smithi181 ceph-mon[115276]: failed to encode map e125 with expected crc 2024-03-30T14:07:02.748 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:02 smithi181 ceph-mon[115276]: failed to encode map e125 with expected crc 2024-03-30T14:07:02.748 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:02 smithi181 ceph-mon[115276]: failed to encode map e125 with expected crc 2024-03-30T14:07:02.748 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:02 smithi181 ceph-mon[115276]: failed to encode map e125 with expected crc 2024-03-30T14:07:02.748 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:02 smithi181 ceph-mon[115276]: failed to encode map e125 with expected crc 2024-03-30T14:07:02.748 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:02 smithi181 ceph-mon[115276]: failed to encode map e125 with expected crc 2024-03-30T14:07:02.892 INFO:journalctl@ceph.osd.2.smithi099.stdout:Mar 30 14:07:02 smithi099 podman[162068]: 2024-03-30 14:07:02.607349831 +0000 UTC m=+0.423721190 container init dd3ed43ce22ace1b4c6c333bb143b50299bf343b249f6f6158a7e1a0c94bfd8f (image=quay.ceph.io/ceph-ci/ceph:4e50bbcdd1630c7760b708f3a5b4d38a121e66cb, name=ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-2-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240326, GIT_CLEAN=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, RELEASE=squid-4e50bbc, GIT_BRANCH=HEAD, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0) 2024-03-30T14:07:02.892 INFO:journalctl@ceph.osd.2.smithi099.stdout:Mar 30 14:07:02 smithi099 podman[162068]: 2024-03-30 14:07:02.611143546 +0000 UTC m=+0.427514897 container start dd3ed43ce22ace1b4c6c333bb143b50299bf343b249f6f6158a7e1a0c94bfd8f (image=quay.ceph.io/ceph-ci/ceph:4e50bbcdd1630c7760b708f3a5b4d38a121e66cb, name=ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-2-deactivate, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, GIT_CLEAN=True, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, ceph=True, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, RELEASE=squid-4e50bbc, org.label-schema.build-date=20240326) 2024-03-30T14:07:02.892 INFO:journalctl@ceph.osd.2.smithi099.stdout:Mar 30 14:07:02 smithi099 podman[162068]: 2024-03-30 14:07:02.712942224 +0000 UTC m=+0.529313574 container attach dd3ed43ce22ace1b4c6c333bb143b50299bf343b249f6f6158a7e1a0c94bfd8f (image=quay.ceph.io/ceph-ci/ceph:4e50bbcdd1630c7760b708f3a5b4d38a121e66cb, name=ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-2-deactivate, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, ceph=True, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , RELEASE=squid-4e50bbc, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240326, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS) 2024-03-30T14:07:03.175 INFO:journalctl@ceph.osd.2.smithi099.stdout:Mar 30 14:07:02 smithi099 podman[162068]: 2024-03-30 14:07:02.899373001 +0000 UTC m=+0.715744360 container died dd3ed43ce22ace1b4c6c333bb143b50299bf343b249f6f6158a7e1a0c94bfd8f (image=quay.ceph.io/ceph-ci/ceph:4e50bbcdd1630c7760b708f3a5b4d38a121e66cb, name=ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-2-deactivate, GIT_BRANCH=HEAD, ceph=True, maintainer=Guillaume Abrioux , RELEASE=squid-4e50bbc, GIT_CLEAN=True, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240326, org.label-schema.license=GPLv2, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0) 2024-03-30T14:07:03.828 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:03 smithi099 ceph-mon[137093]: Health check failed: Degraded data redundancy: 31/627 objects degraded (4.944%), 9 pgs degraded (PG_DEGRADED) 2024-03-30T14:07:03.829 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:03 smithi099 ceph-mon[143401]: Health check failed: Degraded data redundancy: 31/627 objects degraded (4.944%), 9 pgs degraded (PG_DEGRADED) 2024-03-30T14:07:03.829 INFO:journalctl@ceph.osd.2.smithi099.stdout:Mar 30 14:07:03 smithi099 podman[162094]: 2024-03-30 14:07:03.483538196 +0000 UTC m=+0.578734857 container remove dd3ed43ce22ace1b4c6c333bb143b50299bf343b249f6f6158a7e1a0c94bfd8f (image=quay.ceph.io/ceph-ci/ceph:4e50bbcdd1630c7760b708f3a5b4d38a121e66cb, name=ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-2-deactivate, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, RELEASE=squid-4e50bbc, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.build-date=20240326, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, ceph=True, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=) 2024-03-30T14:07:03.829 INFO:journalctl@ceph.osd.2.smithi099.stdout:Mar 30 14:07:03 smithi099 systemd[1]: ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4@osd.2.service: Deactivated successfully. 2024-03-30T14:07:03.829 INFO:journalctl@ceph.osd.2.smithi099.stdout:Mar 30 14:07:03 smithi099 systemd[1]: Stopped Ceph osd.2 for 98ebaeb8-ee99-11ee-b647-cb9ed24678a4. 2024-03-30T14:07:03.829 INFO:journalctl@ceph.osd.2.smithi099.stdout:Mar 30 14:07:03 smithi099 systemd[1]: ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4@osd.2.service: Consumed 12.404s CPU time. 2024-03-30T14:07:03.829 INFO:journalctl@ceph.osd.2.smithi099.stdout:Mar 30 14:07:03 smithi099 systemd[1]: Starting Ceph osd.2 for 98ebaeb8-ee99-11ee-b647-cb9ed24678a4... 2024-03-30T14:07:03.997 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:03 smithi181 ceph-mon[115276]: Health check failed: Degraded data redundancy: 31/627 objects degraded (4.944%), 9 pgs degraded (PG_DEGRADED) 2024-03-30T14:07:04.221 INFO:journalctl@ceph.osd.2.smithi099.stdout:Mar 30 14:07:03 smithi099 podman[162199]: 2024-03-30 14:07:03.826202725 +0000 UTC m=+0.018073591 image pull b0c4478f1d83795df4d538bf108aee5fac57194348fb16dcdbb3115f3e2fe95e quay.ceph.io/ceph-ci/ceph:4e50bbcdd1630c7760b708f3a5b4d38a121e66cb 2024-03-30T14:07:04.222 INFO:journalctl@ceph.osd.2.smithi099.stdout:Mar 30 14:07:03 smithi099 podman[162199]: 2024-03-30 14:07:03.968474515 +0000 UTC m=+0.160345366 container create 3bee88a2f80fce5a23d8ab440097654ed93a61d12ce21c9ffb6780ee86fea06b (image=quay.ceph.io/ceph-ci/ceph:4e50bbcdd1630c7760b708f3a5b4d38a121e66cb, name=ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-2-activate, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, ceph=True, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240326, io.buildah.version=1.33.5, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=squid-4e50bbc, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-03-30T14:07:04.511 INFO:journalctl@ceph.osd.2.smithi099.stdout:Mar 30 14:07:04 smithi099 podman[162199]: 2024-03-30 14:07:04.229360176 +0000 UTC m=+0.421231042 container init 3bee88a2f80fce5a23d8ab440097654ed93a61d12ce21c9ffb6780ee86fea06b (image=quay.ceph.io/ceph-ci/ceph:4e50bbcdd1630c7760b708f3a5b4d38a121e66cb, name=ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-2-activate, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240326, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_CLEAN=True, RELEASE=squid-4e50bbc, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, GIT_BRANCH=HEAD, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5) 2024-03-30T14:07:04.511 INFO:journalctl@ceph.osd.2.smithi099.stdout:Mar 30 14:07:04 smithi099 podman[162199]: 2024-03-30 14:07:04.233981482 +0000 UTC m=+0.425852342 container start 3bee88a2f80fce5a23d8ab440097654ed93a61d12ce21c9ffb6780ee86fea06b (image=quay.ceph.io/ceph-ci/ceph:4e50bbcdd1630c7760b708f3a5b4d38a121e66cb, name=ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-2-activate, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, GIT_CLEAN=True, RELEASE=squid-4e50bbc, org.label-schema.license=GPLv2, org.label-schema.build-date=20240326, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0) 2024-03-30T14:07:04.511 INFO:journalctl@ceph.osd.2.smithi099.stdout:Mar 30 14:07:04 smithi099 podman[162199]: 2024-03-30 14:07:04.312702494 +0000 UTC m=+0.504573361 container attach 3bee88a2f80fce5a23d8ab440097654ed93a61d12ce21c9ffb6780ee86fea06b (image=quay.ceph.io/ceph-ci/ceph:4e50bbcdd1630c7760b708f3a5b4d38a121e66cb, name=ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-2-activate, org.label-schema.schema-version=1.0, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240326, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, RELEASE=squid-4e50bbc) 2024-03-30T14:07:04.790 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:04 smithi099 ceph-mon[137093]: pgmap v118: 161 pgs: 9 active+undersized+degraded, 4 stale+active+clean, 22 active+undersized, 126 active+clean; 585 KiB data, 136 MiB used, 715 GiB / 715 GiB avail; 31/627 objects degraded (4.944%) 2024-03-30T14:07:04.791 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:04 smithi099 ceph-mon[143401]: pgmap v118: 161 pgs: 9 active+undersized+degraded, 4 stale+active+clean, 22 active+undersized, 126 active+clean; 585 KiB data, 136 MiB used, 715 GiB / 715 GiB avail; 31/627 objects degraded (4.944%) 2024-03-30T14:07:04.791 INFO:journalctl@ceph.osd.2.smithi099.stdout:Mar 30 14:07:04 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-2-activate[162214]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-03-30T14:07:04.791 INFO:journalctl@ceph.osd.2.smithi099.stdout:Mar 30 14:07:04 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-2-activate[162214]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-2 --no-mon-config --dev /dev/mapper/vg_nvme-lv_2 2024-03-30T14:07:04.791 INFO:journalctl@ceph.osd.2.smithi099.stdout:Mar 30 14:07:04 smithi099 bash[162199]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-03-30T14:07:04.791 INFO:journalctl@ceph.osd.2.smithi099.stdout:Mar 30 14:07:04 smithi099 bash[162199]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-2 --no-mon-config --dev /dev/mapper/vg_nvme-lv_2 2024-03-30T14:07:04.791 INFO:journalctl@ceph.osd.2.smithi099.stdout:Mar 30 14:07:04 smithi099 bash[162199]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_2 2024-03-30T14:07:04.791 INFO:journalctl@ceph.osd.2.smithi099.stdout:Mar 30 14:07:04 smithi099 bash[162199]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-1 2024-03-30T14:07:04.791 INFO:journalctl@ceph.osd.2.smithi099.stdout:Mar 30 14:07:04 smithi099 bash[162199]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-2/block 2024-03-30T14:07:04.791 INFO:journalctl@ceph.osd.2.smithi099.stdout:Mar 30 14:07:04 smithi099 bash[162199]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-03-30T14:07:04.791 INFO:journalctl@ceph.osd.2.smithi099.stdout:Mar 30 14:07:04 smithi099 bash[162199]: --> ceph-volume raw activate successful for osd ID: 2 2024-03-30T14:07:04.791 INFO:journalctl@ceph.osd.2.smithi099.stdout:Mar 30 14:07:04 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-2-activate[162214]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_2 2024-03-30T14:07:04.791 INFO:journalctl@ceph.osd.2.smithi099.stdout:Mar 30 14:07:04 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-2-activate[162214]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-1 2024-03-30T14:07:04.792 INFO:journalctl@ceph.osd.2.smithi099.stdout:Mar 30 14:07:04 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-2-activate[162214]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-2/block 2024-03-30T14:07:04.792 INFO:journalctl@ceph.osd.2.smithi099.stdout:Mar 30 14:07:04 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-2-activate[162214]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-03-30T14:07:04.792 INFO:journalctl@ceph.osd.2.smithi099.stdout:Mar 30 14:07:04 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-2-activate[162214]: --> ceph-volume raw activate successful for osd ID: 2 2024-03-30T14:07:04.792 INFO:journalctl@ceph.osd.2.smithi099.stdout:Mar 30 14:07:04 smithi099 podman[162199]: 2024-03-30 14:07:04.694895345 +0000 UTC m=+0.886766200 container died 3bee88a2f80fce5a23d8ab440097654ed93a61d12ce21c9ffb6780ee86fea06b (image=quay.ceph.io/ceph-ci/ceph:4e50bbcdd1630c7760b708f3a5b4d38a121e66cb, name=ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-2-activate, io.buildah.version=1.33.5, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, RELEASE=squid-4e50bbc, org.label-schema.vendor=CentOS, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, ceph=True, org.label-schema.build-date=20240326, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2) 2024-03-30T14:07:04.975 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:04 smithi181 ceph-mon[115276]: pgmap v118: 161 pgs: 9 active+undersized+degraded, 4 stale+active+clean, 22 active+undersized, 126 active+clean; 585 KiB data, 136 MiB used, 715 GiB / 715 GiB avail; 31/627 objects degraded (4.944%) 2024-03-30T14:07:05.078 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 14:07:04 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[71049]: ::ffff:172.21.15.181 - - [30/Mar/2024:14:07:04] "GET /metrics HTTP/1.1" 200 38244 "" "Prometheus/2.43.0" 2024-03-30T14:07:05.724 INFO:journalctl@ceph.osd.2.smithi099.stdout:Mar 30 14:07:05 smithi099 podman[162339]: 2024-03-30 14:07:05.385938094 +0000 UTC m=+0.683234928 container remove 3bee88a2f80fce5a23d8ab440097654ed93a61d12ce21c9ffb6780ee86fea06b (image=quay.ceph.io/ceph-ci/ceph:4e50bbcdd1630c7760b708f3a5b4d38a121e66cb, name=ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-2-activate, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, RELEASE=squid-4e50bbc, org.label-schema.build-date=20240326, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, GIT_CLEAN=True, GIT_BRANCH=HEAD, ceph=True, CEPH_POINT_RELEASE=) 2024-03-30T14:07:05.724 INFO:journalctl@ceph.osd.2.smithi099.stdout:Mar 30 14:07:05 smithi099 podman[162404]: 2024-03-30 14:07:05.499115717 +0000 UTC m=+0.017449457 image pull b0c4478f1d83795df4d538bf108aee5fac57194348fb16dcdbb3115f3e2fe95e quay.ceph.io/ceph-ci/ceph:4e50bbcdd1630c7760b708f3a5b4d38a121e66cb 2024-03-30T14:07:05.724 INFO:journalctl@ceph.osd.2.smithi099.stdout:Mar 30 14:07:05 smithi099 podman[162404]: 2024-03-30 14:07:05.611880379 +0000 UTC m=+0.130214103 container create 18304adfb0d0edef64069dc48eab168266787b192b69bb46639f7964f6ee38fe (image=quay.ceph.io/ceph-ci/ceph:4e50bbcdd1630c7760b708f3a5b4d38a121e66cb, name=ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.build-date=20240326, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=squid-4e50bbc, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0) 2024-03-30T14:07:06.107 INFO:journalctl@ceph.osd.2.smithi099.stdout:Mar 30 14:07:05 smithi099 podman[162404]: 2024-03-30 14:07:05.839942001 +0000 UTC m=+0.358275734 container init 18304adfb0d0edef64069dc48eab168266787b192b69bb46639f7964f6ee38fe (image=quay.ceph.io/ceph-ci/ceph:4e50bbcdd1630c7760b708f3a5b4d38a121e66cb, name=ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-2, io.buildah.version=1.33.5, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, RELEASE=squid-4e50bbc, GIT_BRANCH=HEAD, org.label-schema.build-date=20240326, org.label-schema.schema-version=1.0) 2024-03-30T14:07:06.107 INFO:journalctl@ceph.osd.2.smithi099.stdout:Mar 30 14:07:05 smithi099 podman[162404]: 2024-03-30 14:07:05.843275763 +0000 UTC m=+0.361609487 container start 18304adfb0d0edef64069dc48eab168266787b192b69bb46639f7964f6ee38fe (image=quay.ceph.io/ceph-ci/ceph:4e50bbcdd1630c7760b708f3a5b4d38a121e66cb, name=ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-2, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240326, org.label-schema.schema-version=1.0, ceph=True, RELEASE=squid-4e50bbc, CEPH_POINT_RELEASE=) 2024-03-30T14:07:06.107 INFO:journalctl@ceph.osd.2.smithi099.stdout:Mar 30 14:07:05 smithi099 ceph-osd[162423]: -- 172.21.15.99:0/4130582940 <== mon.0 v2:172.21.15.99:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55f18bfc9680 con 0x55f18bf92c00 2024-03-30T14:07:06.107 INFO:journalctl@ceph.osd.2.smithi099.stdout:Mar 30 14:07:05 smithi099 bash[162404]: 18304adfb0d0edef64069dc48eab168266787b192b69bb46639f7964f6ee38fe 2024-03-30T14:07:06.107 INFO:journalctl@ceph.osd.2.smithi099.stdout:Mar 30 14:07:05 smithi099 systemd[1]: Started Ceph osd.2 for 98ebaeb8-ee99-11ee-b647-cb9ed24678a4. 2024-03-30T14:07:06.670 INFO:journalctl@ceph.osd.2.smithi099.stdout:Mar 30 14:07:06 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-2[162419]: 2024-03-30T14:07:06.382+0000 7fd794d087c0 -1 Falling back to public interface 2024-03-30T14:07:06.670 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:06 smithi099 ceph-mon[143401]: pgmap v119: 161 pgs: 11 active+undersized+degraded, 2 stale+active+clean, 27 active+undersized, 121 active+clean; 585 KiB data, 141 MiB used, 715 GiB / 715 GiB avail; 50/627 objects degraded (7.974%) 2024-03-30T14:07:06.670 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:06 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:07:06.671 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:06 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:07:06.671 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:06 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:07:06.671 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:06 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:07:06.671 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:06 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:07:06.671 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:06 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:07:06.671 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:06 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:07:06.671 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:06 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:07:06.671 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:06 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:07:06.671 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:06 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:07:06.671 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:06 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:07:06.672 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:06 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:07:06.672 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:06 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:07:06.672 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:06 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:07:06.672 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:06 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:07:06.672 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:06 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:07:06.672 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:06 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:07:06.672 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:06 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:07:06.672 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:06 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:07:06.672 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:06 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:07:06.673 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:06 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:07:06.673 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:06 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:07:06.673 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:06 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:07:06.673 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:06 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:07:06.673 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:06 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:07:06.673 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:06 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:07:06.673 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:06 smithi099 ceph-mon[137093]: pgmap v119: 161 pgs: 11 active+undersized+degraded, 2 stale+active+clean, 27 active+undersized, 121 active+clean; 585 KiB data, 141 MiB used, 715 GiB / 715 GiB avail; 50/627 objects degraded (7.974%) 2024-03-30T14:07:06.673 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:06 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:07:06.673 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:06 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:07:06.673 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:06 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:07:06.674 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:06 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:07:06.674 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:06 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:07:06.674 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:06 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:07:06.674 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:06 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:07:06.674 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:06 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:07:06.674 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:06 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:07:06.674 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:06 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:07:06.674 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:06 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:07:06.674 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:06 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:07:06.675 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:06 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:07:06.675 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:06 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:07:06.675 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:06 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:07:06.675 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:06 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:07:06.675 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:06 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:07:06.675 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:06 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:07:06.675 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:06 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:07:06.675 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:06 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:07:06.675 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:06 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:07:06.675 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:06 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:07:06.676 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:06 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:07:06.676 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:06 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:07:06.676 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:06 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:07:06.676 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:06 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:07:06.998 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:06 smithi181 ceph-mon[115276]: pgmap v119: 161 pgs: 11 active+undersized+degraded, 2 stale+active+clean, 27 active+undersized, 121 active+clean; 585 KiB data, 141 MiB used, 715 GiB / 715 GiB avail; 50/627 objects degraded (7.974%) 2024-03-30T14:07:06.998 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:06 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:07:06.998 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:06 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:07:06.998 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:06 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:07:06.998 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:06 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:07:06.998 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:06 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:07:06.998 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:06 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:07:06.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:06 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:07:06.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:06 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:07:06.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:06 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:07:06.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:06 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:07:06.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:06 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:07:06.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:06 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:07:06.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:06 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:07:06.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:06 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:07:06.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:06 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:07:06.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:06 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:07:06.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:06 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:07:06.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:06 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:07:06.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:06 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:07:06.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:06 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:07:06.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:06 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:07:07.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:06 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:07:07.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:06 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:07:07.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:06 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:07:07.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:06 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:07:07.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:06 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:07:07.829 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:07 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:07:07.829 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:07 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:07:07.829 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:07 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:07:07.829 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:07 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:07:07.829 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:07 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:07:07.829 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:07 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:07:07.829 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:07 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:07:07.829 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:07 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:07:07.829 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:07 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:07:07.829 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:07 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:07:07.829 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:07 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:07:07.829 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:07 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:07:07.830 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:07 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:07:07.830 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:07 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:07:07.830 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:07 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:07:07.830 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:07 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:07:07.830 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:07 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:07:07.830 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:07 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:07:07.830 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:07 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:07:07.830 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:07 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:07:07.830 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:07 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:07:07.830 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:07 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:07:07.830 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:07 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:07:07.830 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:07 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T14:07:07.830 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:07 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:07:07.830 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:07 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:07:07.830 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:07 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:07:07.831 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:07 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:07:07.831 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:07 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:07:07.831 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:07 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:07:07.831 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:07 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:07:07.831 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:07 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:07:07.831 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:07 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:07:07.831 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:07 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:07:07.831 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:07 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:07:07.831 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:07 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:07:07.831 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:07 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:07:07.831 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:07 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:07:07.832 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:07 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:07:07.832 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:07 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:07:07.832 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:07 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:07:07.832 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:07 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:07:07.832 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:07 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:07:07.832 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:07 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:07:07.832 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:07 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:07:07.832 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:07 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:07:07.832 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:07 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:07:07.832 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:07 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:07:07.832 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:07 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:07:07.832 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:07 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:07:07.832 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:07 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:07:07.832 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:07 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:07:07.832 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:07 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:07:07.832 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:07 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T14:07:07.833 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:07 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:07:07.833 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:07 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:07:07.833 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:07 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:07:07.833 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:07 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:07:07.833 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:07 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:07:07.833 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:07 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:07:07.833 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:07 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:07:07.833 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:07 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:07:07.833 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:07 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:07:07.833 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:07 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:07:07.833 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:07 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:07:07.834 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:07 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:07:07.834 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:07 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:07:07.834 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:07 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:07:07.834 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:07 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:07:07.834 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:07 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:07:07.834 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:07 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:07:07.834 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:07 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:07:07.834 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:07 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:07:07.834 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:07 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:07:07.834 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:07 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:07:07.834 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:07 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:07:07.834 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:07 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:07:07.834 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:07 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:07:07.834 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:07 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:07:07.835 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:07 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:07:07.835 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:07 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:07:07.835 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:07 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:07:07.835 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:07 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:07:07.835 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:07 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:07:07.835 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:07 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:07:07.835 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:07 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:07:07.835 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:07 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:07:07.835 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:07 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:07:07.835 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:07 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:07:07.835 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:07 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:07:07.835 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:07 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:07:07.835 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:07 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:07:07.835 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:07 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:07:07.836 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:07 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:07:07.836 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:07 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:07:07.836 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:07 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:07:07.836 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:07 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:07:07.836 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:07 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:07:07.836 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:07 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:07:07.836 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:07 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:07:07.836 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:07 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:07:07.836 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:07 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:07:07.836 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:07 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:07:07.836 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:07 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:07:07.836 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:07 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:07:07.836 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:07 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:07:07.836 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:07 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:07:07.837 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:07 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:07:07.892 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:07 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:07:07.892 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:07 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:07:07.892 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:07 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:07:07.892 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:07 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:07:07.892 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:07 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:07:07.892 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:07 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:07:07.893 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:07 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:07:07.893 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:07 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:07:07.893 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:07 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:07:07.893 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:07 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:07:07.893 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:07 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:07:07.893 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:07 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:07:07.893 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:07 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:07:07.893 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:07 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:07:07.893 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:07 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:07:07.893 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:07 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:07:07.893 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:07 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:07:07.893 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:07 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:07:07.893 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:07 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:07:07.893 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:07 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:07:07.893 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:07 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:07:07.894 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:07 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:07:07.894 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:07 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:07:07.894 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:07 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T14:07:07.894 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:07 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:07:07.894 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:07 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:07:07.894 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:07 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:07:07.894 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:07 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:07:07.894 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:07 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:07:07.894 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:07 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:07:07.894 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:07 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:07:07.894 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:07 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:07:07.894 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:07 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:07:07.894 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:07 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:07:07.894 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:07 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:07:07.895 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:07 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:07:07.895 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:07 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:07:07.895 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:07 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:07:07.895 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:07 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:07:07.895 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:07 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:07:07.895 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:07 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:07:07.895 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:07 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:07:07.895 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:07 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:07:07.895 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:07 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:07:07.895 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:07 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:07:07.895 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:07 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:07:07.895 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:07 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:07:07.895 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:07 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:07:07.895 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:07 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:07:07.895 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:07 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:07:07.896 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:07 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:07:07.896 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:07 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:07:07.896 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:07 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:07:07.896 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:07 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:07:08.730 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:08 smithi181 ceph-mon[115276]: pgmap v120: 161 pgs: 12 active+undersized+degraded, 33 active+undersized, 116 active+clean; 585 KiB data, 141 MiB used, 715 GiB / 715 GiB avail; 55/627 objects degraded (8.772%) 2024-03-30T14:07:08.730 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:08 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:07:08.730 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:08 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:07:08.730 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:08 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:07:08.730 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:08 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:07:08.730 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:08 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:07:08.730 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:08 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:07:08.730 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:08 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:07:08.730 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:08 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:07:08.730 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:08 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:07:08.731 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:08 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:07:08.731 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:08 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:07:08.731 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:08 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:07:08.731 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:08 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:07:08.731 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:08 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:07:08.731 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:08 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:07:08.731 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:08 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:07:08.731 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:08 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:07:08.731 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:08 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:07:08.731 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:08 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:07:08.731 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:08 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:07:08.731 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:08 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:07:08.731 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:08 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:07:08.731 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:08 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:07:08.731 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:08 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:07:08.732 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:08 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:07:08.732 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:08 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:07:08.732 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:08 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:07:08.732 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:08 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:07:08.732 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:08 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:07:08.732 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:08 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:07:08.732 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:08 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:07:08.732 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:08 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:07:08.732 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:08 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:07:08.732 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:08 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:07:08.732 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:08 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:07:08.732 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:08 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:07:08.732 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:08 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:07:08.732 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:08 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:07:08.732 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:08 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:07:08.733 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:08 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:07:08.733 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:08 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:07:08.733 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:08 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:07:08.733 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:08 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:07:08.733 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:08 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:07:08.733 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:08 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:07:08.733 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:08 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:07:08.733 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:08 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:07:08.733 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:08 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:07:08.733 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:08 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:07:08.733 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:08 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:07:08.733 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:08 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:07:08.733 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:08 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:07:08.733 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:08 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:07:08.733 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:08 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:07:08.733 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:08 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:07:08.734 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:08 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:07:08.734 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:08 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:07:08.734 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:08 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:07:08.734 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:08 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:07:08.734 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:08 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:07:08.734 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:08 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:07:08.734 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:08 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:07:08.829 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:08 smithi099 ceph-mon[137093]: pgmap v120: 161 pgs: 12 active+undersized+degraded, 33 active+undersized, 116 active+clean; 585 KiB data, 141 MiB used, 715 GiB / 715 GiB avail; 55/627 objects degraded (8.772%) 2024-03-30T14:07:08.829 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:08 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:07:08.829 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:08 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:07:08.829 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:08 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:07:08.829 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:08 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:07:08.829 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:08 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:07:08.829 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:08 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:07:08.829 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:08 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:07:08.829 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:08 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:07:08.830 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:08 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:07:08.830 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:08 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:07:08.830 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:08 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:07:08.830 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:08 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:07:08.830 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:08 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:07:08.830 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:08 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:07:08.830 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:08 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:07:08.830 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:08 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:07:08.830 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:08 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:07:08.830 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:08 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:07:08.830 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:08 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:07:08.830 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:08 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:07:08.830 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:08 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:07:08.830 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:08 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:07:08.830 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:08 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:07:08.831 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:08 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:07:08.831 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:08 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:07:08.831 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:08 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:07:08.831 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:08 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:07:08.831 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:08 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:07:08.831 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:08 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:07:08.831 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:08 smithi099 ceph-mon[143401]: pgmap v120: 161 pgs: 12 active+undersized+degraded, 33 active+undersized, 116 active+clean; 585 KiB data, 141 MiB used, 715 GiB / 715 GiB avail; 55/627 objects degraded (8.772%) 2024-03-30T14:07:08.831 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:08 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:07:08.831 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:08 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:07:08.831 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:08 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:07:08.831 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:08 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:07:08.831 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:08 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:07:08.832 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:08 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:07:08.832 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:08 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:07:08.832 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:08 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:07:08.832 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:08 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:07:08.832 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:08 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:07:08.832 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:08 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:07:08.832 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:08 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:07:08.832 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:08 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:07:08.832 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:08 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:07:08.832 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:08 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:07:08.832 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:08 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:07:08.832 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:08 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:07:08.832 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:08 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:07:08.832 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:08 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:07:08.832 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:08 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:07:08.833 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:08 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:07:08.833 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:08 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:07:08.833 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:08 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:07:08.833 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:08 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:07:08.833 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:08 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:07:08.833 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:08 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:07:08.833 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:08 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:07:08.833 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:08 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:07:08.833 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:08 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:07:08.833 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:08 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:07:08.833 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:08 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:07:08.834 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:08 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:07:08.834 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:08 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:07:08.834 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:08 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:07:08.834 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:08 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:07:08.834 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:08 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:07:08.834 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:08 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:07:08.834 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:08 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:07:08.834 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:08 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:07:08.834 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:08 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:07:08.834 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:08 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:07:08.834 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:08 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:07:08.834 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:08 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:07:08.834 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:08 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:07:08.835 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:08 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:07:08.835 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:08 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:07:08.835 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:08 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:07:08.835 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:08 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:07:08.835 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:08 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:07:08.835 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:08 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:07:08.835 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:08 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:07:08.835 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:08 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:07:08.835 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:08 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:07:08.835 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:08 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:07:08.835 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:08 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:07:08.835 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:08 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:07:08.835 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:08 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:07:08.835 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:08 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:07:08.835 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:08 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:07:08.836 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:08 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:07:08.836 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:08 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:07:08.836 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:08 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:07:08.836 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:08 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:07:08.836 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:08 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:07:08.836 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:08 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:07:08.836 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:08 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:07:08.836 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:08 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:07:08.836 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:08 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:07:08.837 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:08 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:07:08.837 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:08 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:07:08.837 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:08 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:07:08.837 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:08 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:07:08.837 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:08 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:07:08.837 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:08 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:07:08.837 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:08 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:07:08.837 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:08 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:07:08.837 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:08 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:07:08.837 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:08 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:07:08.837 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:08 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:07:08.837 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:08 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:07:08.837 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:08 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:07:08.837 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:08 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:07:08.837 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:08 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:07:08.837 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:08 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:07:08.838 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:08 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:07:08.838 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:08 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:07:08.838 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:08 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:07:08.838 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:08 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:07:08.838 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:08 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:07:08.838 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:08 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:07:08.838 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:08 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:07:08.838 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:08 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:07:08.838 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:08 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:07:08.838 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:08 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:07:08.838 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:08 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:07:09.328 INFO:journalctl@ceph.osd.2.smithi099.stdout:Mar 30 14:07:09 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-2[162419]: 2024-03-30T14:07:09.100+0000 7fd794d087c0 -1 osd.2 0 read_superblock omap replica is missing. 2024-03-30T14:07:09.328 INFO:journalctl@ceph.osd.2.smithi099.stdout:Mar 30 14:07:09 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-2[162419]: 2024-03-30T14:07:09.123+0000 7fd794d087c0 -1 osd.2 123 log_to_monitors true 2024-03-30T14:07:09.721 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:09 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:07:09.721 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:09 smithi099 ceph-mon[137093]: from='client.25136 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T14:07:09.721 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:09 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:07:09.721 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:09 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:07:09.721 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:09 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:07:09.721 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:09 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:07:09.721 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:09 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:07:09.721 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:09 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:07:09.721 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:09 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:07:09.721 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:09 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:07:09.721 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:09 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:07:09.722 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:09 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:07:09.722 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:09 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:07:09.722 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:09 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:07:09.722 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:09 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:07:09.722 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:09 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:07:09.722 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:09 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:07:09.722 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:09 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:07:09.722 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:09 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:07:09.722 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:09 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:07:09.722 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:09 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:07:09.722 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:09 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:07:09.722 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:09 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:07:09.722 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:09 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:07:09.722 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:09 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:07:09.723 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:09 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:07:09.723 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:09 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:07:09.723 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:09 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:07:09.723 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:09 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:07:09.723 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:09 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:07:09.723 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:09 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:07:09.723 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:09 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:07:09.723 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:09 smithi099 ceph-mon[143401]: from='client.25136 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T14:07:09.723 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:09 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:07:09.723 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:09 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:07:09.723 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:09 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:07:09.724 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:09 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:07:09.724 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:09 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:07:09.724 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:09 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:07:09.724 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:09 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:07:09.724 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:09 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:07:09.724 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:09 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:07:09.724 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:09 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:07:09.724 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:09 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:07:09.724 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:09 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:07:09.724 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:09 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:07:09.724 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:09 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:07:09.724 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:09 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:07:09.724 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:09 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:07:09.724 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:09 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:07:09.725 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:09 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:07:09.725 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:09 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:07:09.725 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:09 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:07:09.725 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:09 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:07:09.725 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:09 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:07:09.725 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:09 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:07:09.725 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:09 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:07:09.725 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:09 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:07:09.725 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:09 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:07:09.725 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:09 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:07:09.725 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:09 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:07:09.725 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:09 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:07:09.726 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:09 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:07:09.726 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:09 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:07:09.726 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:09 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:07:09.726 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:09 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:07:09.726 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:09 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:07:09.726 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:09 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:07:09.726 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:09 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:07:09.726 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:09 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:07:09.726 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:09 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:07:09.726 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:09 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:07:09.727 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:09 smithi099 ceph-mon[137093]: from='osd.2 [v2:172.21.15.99:6818/401933829,v1:172.21.15.99:6819/401933829]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-03-30T14:07:09.727 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:09 smithi099 ceph-mon[137093]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-03-30T14:07:09.727 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:09 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:07:09.727 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:09 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:07:09.727 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:09 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:07:09.727 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:09 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:07:09.727 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:09 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:07:09.727 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:09 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:07:09.727 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:09 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:07:09.727 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:09 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:07:09.727 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:09 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:07:09.727 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:09 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:07:09.727 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:09 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:07:09.727 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:09 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:07:09.727 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:09 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:07:09.728 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:09 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:07:09.728 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:09 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:07:09.728 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:09 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:07:09.728 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:09 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:07:09.728 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:09 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:07:09.728 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:09 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:07:09.728 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:09 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:07:09.728 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:09 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:07:09.728 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:09 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:07:09.728 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:09 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:07:09.728 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:09 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:07:09.729 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:09 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:07:09.729 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:09 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:07:09.729 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:09 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:07:09.729 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:09 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:07:09.729 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:09 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:07:09.729 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:09 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:07:09.729 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:09 smithi099 ceph-mon[143401]: from='osd.2 [v2:172.21.15.99:6818/401933829,v1:172.21.15.99:6819/401933829]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-03-30T14:07:09.729 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:09 smithi099 ceph-mon[143401]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-03-30T14:07:09.729 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:09 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:07:09.729 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:09 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:07:09.729 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:09 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:07:09.729 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:09 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:07:09.729 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:09 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:07:09.729 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:09 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:07:09.730 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:09 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:07:09.730 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:09 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:07:09.730 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:09 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:07:09.730 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:09 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:07:09.730 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:09 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:07:09.730 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:09 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:07:09.730 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:09 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:07:09.730 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:09 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:07:09.730 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:09 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:07:09.730 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:09 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:07:09.730 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:09 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:07:09.730 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:09 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:07:09.730 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:09 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:07:09.730 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:09 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:07:09.998 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:09 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:07:09.998 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:09 smithi181 ceph-mon[115276]: from='client.25136 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T14:07:09.998 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:09 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:07:09.998 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:09 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:07:09.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:09 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:07:09.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:09 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:07:09.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:09 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:07:09.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:09 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:07:09.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:09 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:07:09.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:09 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:07:09.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:09 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:07:09.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:09 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:07:09.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:09 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:07:09.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:09 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:07:09.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:09 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:07:09.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:09 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:07:09.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:09 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:07:09.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:09 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:07:09.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:09 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:07:09.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:09 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:07:10.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:09 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:07:10.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:09 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:07:10.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:09 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:07:10.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:09 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:07:10.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:09 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:07:10.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:09 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:07:10.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:09 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:07:10.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:09 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:07:10.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:09 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:07:10.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:09 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:07:10.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:09 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:07:10.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:09 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:07:10.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:09 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:07:10.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:09 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:07:10.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:09 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:07:10.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:09 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:07:10.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:09 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:07:10.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:09 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:07:10.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:09 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:07:10.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:09 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:07:10.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:09 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:07:10.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:09 smithi181 ceph-mon[115276]: from='osd.2 [v2:172.21.15.99:6818/401933829,v1:172.21.15.99:6819/401933829]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-03-30T14:07:10.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:09 smithi181 ceph-mon[115276]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-03-30T14:07:10.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:09 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:07:10.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:09 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:07:10.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:09 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:07:10.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:09 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:07:10.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:09 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:07:10.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:09 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:07:10.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:09 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:07:10.002 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:09 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:07:10.002 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:09 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:07:10.002 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:09 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:07:10.002 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:09 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:07:10.002 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:09 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:07:10.002 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:09 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:07:10.002 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:09 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:07:10.002 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:09 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:07:10.002 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:09 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:07:10.002 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:09 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:07:10.002 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:09 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:07:10.002 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:09 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:07:10.002 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:09 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:07:10.328 INFO:journalctl@ceph.osd.2.smithi099.stdout:Mar 30 14:07:10 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-2[162419]: 2024-03-30T14:07:10.132+0000 7fd786160700 -1 osd.2 123 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-03-30T14:07:10.829 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:10 smithi099 ceph-mon[137093]: pgmap v121: 161 pgs: 12 active+undersized+degraded, 33 active+undersized, 116 active+clean; 585 KiB data, 141 MiB used, 715 GiB / 715 GiB avail; 55/627 objects degraded (8.772%) 2024-03-30T14:07:10.829 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:10 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:07:10.829 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:10 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:07:10.829 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:10 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:07:10.829 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:10 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:07:10.829 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:10 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:07:10.829 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:10 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:07:10.829 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:10 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:07:10.829 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:10 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:07:10.829 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:10 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:07:10.830 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:10 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:07:10.830 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:10 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:07:10.830 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:10 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:07:10.830 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:10 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:07:10.830 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:10 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:07:10.830 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:10 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:07:10.830 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:10 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:07:10.830 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:10 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:07:10.830 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:10 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:07:10.830 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:10 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:07:10.830 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:10 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:07:10.830 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:10 smithi099 ceph-mon[137093]: Health check update: Degraded data redundancy: 55/627 objects degraded (8.772%), 12 pgs degraded (PG_DEGRADED) 2024-03-30T14:07:10.830 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:10 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:07:10.830 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:10 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:07:10.831 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:10 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:07:10.831 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:10 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:07:10.831 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:10 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:07:10.831 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:10 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:07:10.831 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:10 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:07:10.831 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:10 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:07:10.831 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:10 smithi099 ceph-mon[143401]: pgmap v121: 161 pgs: 12 active+undersized+degraded, 33 active+undersized, 116 active+clean; 585 KiB data, 141 MiB used, 715 GiB / 715 GiB avail; 55/627 objects degraded (8.772%) 2024-03-30T14:07:10.831 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:10 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:07:10.831 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:10 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:07:10.831 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:10 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:07:10.831 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:10 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:07:10.831 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:10 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:07:10.832 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:10 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:07:10.832 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:10 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:07:10.832 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:10 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:07:10.832 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:10 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:07:10.832 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:10 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:07:10.832 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:10 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:07:10.832 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:10 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:07:10.832 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:10 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:07:10.832 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:10 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:07:10.832 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:10 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:07:10.832 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:10 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:07:10.832 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:10 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:07:10.832 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:10 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:07:10.832 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:10 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:07:10.832 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:10 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:07:10.833 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:10 smithi099 ceph-mon[143401]: Health check update: Degraded data redundancy: 55/627 objects degraded (8.772%), 12 pgs degraded (PG_DEGRADED) 2024-03-30T14:07:10.833 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:10 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:07:10.833 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:10 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:07:10.833 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:10 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:07:10.833 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:10 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:07:10.833 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:10 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:07:10.833 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:10 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:07:10.833 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:10 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:07:10.833 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:10 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:07:10.833 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:10 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:07:10.833 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:10 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:07:10.834 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:10 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:07:10.834 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:10 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:07:10.834 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:10 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:07:10.834 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:10 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:07:10.834 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:10 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:07:10.834 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:10 smithi099 ceph-mon[137093]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-03-30T14:07:10.834 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:10 smithi099 ceph-mon[137093]: failed to encode map e126 with expected crc 2024-03-30T14:07:10.834 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:10 smithi099 ceph-mon[137093]: osdmap e126: 8 total, 7 up, 8 in 2024-03-30T14:07:10.834 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:10 smithi099 ceph-mon[137093]: from='osd.2 [v2:172.21.15.99:6818/401933829,v1:172.21.15.99:6819/401933829]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi099", "root=default"]}]: dispatch 2024-03-30T14:07:10.834 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:10 smithi099 ceph-mon[137093]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi099", "root=default"]}]: dispatch 2024-03-30T14:07:10.834 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:10 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:07:10.834 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:10 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:07:10.834 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:10 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:07:10.834 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:10 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:07:10.835 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:10 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:07:10.835 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:10 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:07:10.835 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:10 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:07:10.835 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:10 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:07:10.835 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:10 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:07:10.835 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:10 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:07:10.835 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:10 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:07:10.835 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:10 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:07:10.835 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:10 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:07:10.835 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:10 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:07:10.835 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:10 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:07:10.835 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:10 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:07:10.835 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:10 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:07:10.835 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:10 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:07:10.836 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:10 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:07:10.836 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:10 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:07:10.836 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:10 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:07:10.836 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:10 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:07:10.836 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:10 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:07:10.836 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:10 smithi099 ceph-mon[143401]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-03-30T14:07:10.836 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:10 smithi099 ceph-mon[143401]: failed to encode map e126 with expected crc 2024-03-30T14:07:10.836 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:10 smithi099 ceph-mon[143401]: osdmap e126: 8 total, 7 up, 8 in 2024-03-30T14:07:10.836 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:10 smithi099 ceph-mon[143401]: from='osd.2 [v2:172.21.15.99:6818/401933829,v1:172.21.15.99:6819/401933829]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi099", "root=default"]}]: dispatch 2024-03-30T14:07:10.836 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:10 smithi099 ceph-mon[143401]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi099", "root=default"]}]: dispatch 2024-03-30T14:07:10.836 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:10 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:07:10.836 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:10 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:07:10.836 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:10 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:07:10.836 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:10 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:07:10.837 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:10 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:07:10.837 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:10 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:07:10.837 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:10 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:07:10.837 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:10 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:07:10.837 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:10 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:07:10.837 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:10 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:07:10.837 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:10 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:07:10.837 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:10 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:07:10.837 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:10 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:07:10.837 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:10 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:07:10.837 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:10 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:07:10.837 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:10 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:07:10.998 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:10 smithi181 ceph-mon[115276]: pgmap v121: 161 pgs: 12 active+undersized+degraded, 33 active+undersized, 116 active+clean; 585 KiB data, 141 MiB used, 715 GiB / 715 GiB avail; 55/627 objects degraded (8.772%) 2024-03-30T14:07:10.998 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:10 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:07:10.998 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:10 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:07:10.998 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:10 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:07:10.998 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:10 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:07:10.998 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:10 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:07:10.998 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:10 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:07:10.998 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:10 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:07:10.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:10 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:07:10.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:10 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:07:10.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:10 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:07:10.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:10 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:07:10.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:10 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:07:10.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:10 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:07:10.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:10 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:07:10.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:10 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:07:10.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:10 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:07:10.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:10 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:07:10.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:10 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:07:10.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:10 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:07:10.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:10 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:07:10.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:10 smithi181 ceph-mon[115276]: Health check update: Degraded data redundancy: 55/627 objects degraded (8.772%), 12 pgs degraded (PG_DEGRADED) 2024-03-30T14:07:10.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:10 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:07:11.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:10 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:07:11.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:10 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:07:11.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:10 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:07:11.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:10 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:07:11.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:10 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:07:11.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:10 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:07:11.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:10 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:07:11.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:10 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:07:11.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:10 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:07:11.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:10 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:07:11.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:10 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:07:11.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:10 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:07:11.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:10 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:07:11.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:10 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:07:11.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:10 smithi181 ceph-mon[115276]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-03-30T14:07:11.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:10 smithi181 ceph-mon[115276]: failed to encode map e126 with expected crc 2024-03-30T14:07:11.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:10 smithi181 ceph-mon[115276]: osdmap e126: 8 total, 7 up, 8 in 2024-03-30T14:07:11.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:10 smithi181 ceph-mon[115276]: from='osd.2 [v2:172.21.15.99:6818/401933829,v1:172.21.15.99:6819/401933829]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi099", "root=default"]}]: dispatch 2024-03-30T14:07:11.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:10 smithi181 ceph-mon[115276]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi099", "root=default"]}]: dispatch 2024-03-30T14:07:11.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:10 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:07:11.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:10 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:07:11.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:10 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:07:11.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:10 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:07:11.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:10 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:07:11.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:10 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:07:11.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:10 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:07:11.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:10 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:07:11.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:10 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:07:11.002 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:10 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:07:11.002 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:10 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:07:11.002 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:10 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:07:11.002 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:10 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:07:11.002 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:10 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:07:11.002 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:10 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:07:11.002 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:10 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:07:11.829 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:11 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:07:11.829 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:11 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:07:11.829 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:11 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:07:11.829 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:11 smithi099 ceph-mon[143401]: failed to encode map e126 with expected crc 2024-03-30T14:07:11.829 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:11 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:07:11.829 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:11 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:07:11.829 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:11 smithi099 ceph-mon[143401]: failed to encode map e126 with expected crc 2024-03-30T14:07:11.829 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:11 smithi099 ceph-mon[143401]: failed to encode map e126 with expected crc 2024-03-30T14:07:11.829 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:11 smithi099 ceph-mon[143401]: failed to encode map e126 with expected crc 2024-03-30T14:07:11.830 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:11 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:07:11.830 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:11 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:07:11.830 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:11 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:07:11.830 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:11 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:07:11.830 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:11 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:07:11.830 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:11 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:07:11.830 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:11 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:07:11.830 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:11 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:07:11.830 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:11 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:07:11.830 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:11 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:07:11.830 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:11 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:07:11.830 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:11 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:07:11.830 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:11 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:07:11.830 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:11 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:07:11.831 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:11 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:07:11.831 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:11 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:07:11.831 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:11 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:07:11.831 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:11 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:07:11.831 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:11 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:07:11.831 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:11 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:07:11.831 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:11 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:07:11.831 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:11 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:07:11.831 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:11 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:07:11.831 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:11 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:07:11.831 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:11 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:07:11.831 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:11 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:07:11.832 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:11 smithi099 ceph-mon[137093]: failed to encode map e126 with expected crc 2024-03-30T14:07:11.832 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:11 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:07:11.832 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:11 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:07:11.832 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:11 smithi099 ceph-mon[137093]: failed to encode map e126 with expected crc 2024-03-30T14:07:11.832 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:11 smithi099 ceph-mon[137093]: failed to encode map e126 with expected crc 2024-03-30T14:07:11.832 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:11 smithi099 ceph-mon[137093]: failed to encode map e126 with expected crc 2024-03-30T14:07:11.832 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:11 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:07:11.832 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:11 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:07:11.832 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:11 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:07:11.832 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:11 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:07:11.832 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:11 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:07:11.832 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:11 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:07:11.832 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:11 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:07:11.832 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:11 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:07:11.832 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:11 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:07:11.832 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:11 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:07:11.832 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:11 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:07:11.833 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:11 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:07:11.833 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:11 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:07:11.833 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:11 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:07:11.833 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:11 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:07:11.833 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:11 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:07:11.833 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:11 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:07:11.833 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:11 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:07:11.833 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:11 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:07:11.833 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:11 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:07:11.833 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:11 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:07:11.833 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:11 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:07:11.833 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:11 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:07:11.834 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:11 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:07:11.834 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:11 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:07:11.834 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:11 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:07:11.834 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:11 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:07:11.834 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:11 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:07:11.834 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:11 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:07:11.834 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:11 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:07:11.834 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:11 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:07:11.834 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:11 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:07:11.834 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:11 smithi099 ceph-mon[143401]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-03-30T14:07:11.834 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:11 smithi099 ceph-mon[143401]: osd.2 [v2:172.21.15.99:6818/401933829,v1:172.21.15.99:6819/401933829] boot 2024-03-30T14:07:11.834 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:11 smithi099 ceph-mon[143401]: osdmap e127: 8 total, 8 up, 8 in 2024-03-30T14:07:11.835 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:11 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-03-30T14:07:11.835 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:11 smithi099 ceph-mon[143401]: failed to encode map e127 with expected crc 2024-03-30T14:07:11.835 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:11 smithi099 ceph-mon[143401]: failed to encode map e127 with expected crc 2024-03-30T14:07:11.835 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:11 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:07:11.835 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:11 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:07:11.835 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:11 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:07:11.835 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:11 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:07:11.835 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:11 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:07:11.835 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:11 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:07:11.835 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:11 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:07:11.835 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:11 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:07:11.835 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:11 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:07:11.835 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:11 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:07:11.835 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:11 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:07:11.835 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:11 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:07:11.836 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:11 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:07:11.836 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:11 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:07:11.836 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:11 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:07:11.836 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:11 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:07:11.836 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:11 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:07:11.836 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:11 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:07:11.836 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:11 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:07:11.836 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:11 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:07:11.836 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:11 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:07:11.836 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:11 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:07:11.836 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:11 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:07:11.836 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:11 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:07:11.836 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:11 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:07:11.837 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:11 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:07:11.837 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:11 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:07:11.837 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:11 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:07:11.837 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:11 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:07:11.837 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:11 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:07:11.837 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:11 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:07:11.837 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:11 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:07:11.837 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:11 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:07:11.837 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:11 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:07:11.837 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:11 smithi099 ceph-mon[137093]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-03-30T14:07:11.837 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:11 smithi099 ceph-mon[137093]: osd.2 [v2:172.21.15.99:6818/401933829,v1:172.21.15.99:6819/401933829] boot 2024-03-30T14:07:11.837 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:11 smithi099 ceph-mon[137093]: osdmap e127: 8 total, 8 up, 8 in 2024-03-30T14:07:11.837 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:11 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-03-30T14:07:11.838 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:11 smithi099 ceph-mon[137093]: failed to encode map e127 with expected crc 2024-03-30T14:07:11.838 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:11 smithi099 ceph-mon[137093]: failed to encode map e127 with expected crc 2024-03-30T14:07:11.838 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:11 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:07:11.838 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:11 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:07:11.838 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:11 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:07:11.838 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:11 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:07:11.838 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:11 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:07:11.838 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:11 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:07:11.838 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:11 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:07:11.838 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:11 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:07:11.838 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:11 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:07:11.838 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:11 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:07:11.838 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:11 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:07:11.838 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:11 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:07:11.839 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:11 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:07:11.839 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:11 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:07:11.839 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:11 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:07:11.839 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:11 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:07:11.839 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:11 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:07:11.839 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:11 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:07:11.839 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:11 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:07:11.839 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:11 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:07:11.839 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:11 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:07:11.839 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:11 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:07:11.839 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:11 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:07:11.839 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:11 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:07:11.839 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:11 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:07:11.998 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:11 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:07:11.998 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:11 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:07:11.998 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:11 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:07:11.998 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:11 smithi181 ceph-mon[115276]: failed to encode map e126 with expected crc 2024-03-30T14:07:11.998 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:11 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:07:11.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:11 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:07:11.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:11 smithi181 ceph-mon[115276]: failed to encode map e126 with expected crc 2024-03-30T14:07:11.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:11 smithi181 ceph-mon[115276]: failed to encode map e126 with expected crc 2024-03-30T14:07:11.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:11 smithi181 ceph-mon[115276]: failed to encode map e126 with expected crc 2024-03-30T14:07:11.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:11 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:07:11.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:11 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:07:11.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:11 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:07:11.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:11 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:07:11.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:11 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:07:11.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:11 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:07:11.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:11 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:07:11.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:11 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:07:11.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:11 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:07:11.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:11 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:07:11.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:11 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:07:12.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:11 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:07:12.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:11 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:07:12.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:11 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:07:12.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:11 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:07:12.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:11 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:07:12.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:11 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:07:12.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:11 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:07:12.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:11 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:07:12.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:11 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:07:12.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:11 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:07:12.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:11 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:07:12.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:11 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:07:12.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:11 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:07:12.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:11 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:07:12.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:11 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:07:12.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:11 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:07:12.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:11 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:07:12.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:11 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:07:12.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:11 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:07:12.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:11 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:07:12.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:11 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:07:12.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:11 smithi181 ceph-mon[115276]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-03-30T14:07:12.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:11 smithi181 ceph-mon[115276]: osd.2 [v2:172.21.15.99:6818/401933829,v1:172.21.15.99:6819/401933829] boot 2024-03-30T14:07:12.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:11 smithi181 ceph-mon[115276]: osdmap e127: 8 total, 8 up, 8 in 2024-03-30T14:07:12.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:11 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-03-30T14:07:12.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:11 smithi181 ceph-mon[115276]: failed to encode map e127 with expected crc 2024-03-30T14:07:12.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:11 smithi181 ceph-mon[115276]: failed to encode map e127 with expected crc 2024-03-30T14:07:12.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:11 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:07:12.002 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:11 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:07:12.002 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:11 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:07:12.002 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:11 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:07:12.002 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:11 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:07:12.002 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:11 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:07:12.002 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:11 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:07:12.002 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:11 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:07:12.002 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:11 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:07:12.002 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:11 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:07:12.002 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:11 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:07:12.002 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:11 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:07:12.002 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:11 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:07:12.002 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:11 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:07:12.003 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:11 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:07:12.003 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:11 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:07:12.003 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:11 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:07:12.003 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:11 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:07:12.003 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:11 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:07:12.003 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:11 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:07:12.003 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:11 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:07:12.003 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:11 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:07:12.003 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:11 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:07:12.003 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:11 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:07:12.003 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:11 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:07:12.829 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:12 smithi099 ceph-mon[137093]: pgmap v123: 161 pgs: 12 active+undersized+degraded, 33 active+undersized, 116 active+clean; 585 KiB data, 156 MiB used, 715 GiB / 715 GiB avail; 55/627 objects degraded (8.772%) 2024-03-30T14:07:12.829 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:12 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:07:12.829 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:12 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:07:12.829 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:12 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:07:12.829 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:12 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:07:12.829 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:12 smithi099 ceph-mon[137093]: failed to encode map e127 with expected crc 2024-03-30T14:07:12.829 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:12 smithi099 ceph-mon[137093]: failed to encode map e127 with expected crc 2024-03-30T14:07:12.829 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:12 smithi099 ceph-mon[137093]: failed to encode map e127 with expected crc 2024-03-30T14:07:12.829 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:12 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:07:12.829 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:12 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:07:12.830 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:12 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:07:12.830 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:12 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:07:12.830 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:12 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:07:12.830 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:12 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:07:12.830 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:12 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:07:12.830 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:12 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:07:12.830 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:12 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:07:12.830 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:12 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:07:12.830 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:12 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:07:12.830 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:12 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:07:12.830 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:12 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:07:12.830 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:12 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:07:12.830 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:12 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:07:12.830 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:12 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:07:12.831 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:12 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:07:12.831 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:12 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:07:12.831 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:12 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:07:12.831 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:12 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:07:12.831 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:12 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:07:12.831 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:12 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:07:12.831 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:12 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:07:12.831 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:12 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:07:12.831 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:12 smithi099 ceph-mon[143401]: pgmap v123: 161 pgs: 12 active+undersized+degraded, 33 active+undersized, 116 active+clean; 585 KiB data, 156 MiB used, 715 GiB / 715 GiB avail; 55/627 objects degraded (8.772%) 2024-03-30T14:07:12.831 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:12 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:07:12.831 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:12 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:07:12.832 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:12 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:07:12.832 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:12 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:07:12.832 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:12 smithi099 ceph-mon[143401]: failed to encode map e127 with expected crc 2024-03-30T14:07:12.832 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:12 smithi099 ceph-mon[143401]: failed to encode map e127 with expected crc 2024-03-30T14:07:12.832 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:12 smithi099 ceph-mon[143401]: failed to encode map e127 with expected crc 2024-03-30T14:07:12.832 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:12 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:07:12.832 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:12 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:07:12.832 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:12 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:07:12.832 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:12 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:07:12.832 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:12 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:07:12.832 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:12 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:07:12.832 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:12 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:07:12.832 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:12 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:07:12.832 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:12 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:07:12.832 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:12 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:07:12.833 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:12 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:07:12.833 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:12 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:07:12.833 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:12 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:07:12.833 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:12 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:07:12.833 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:12 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:07:12.833 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:12 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:07:12.833 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:12 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:07:12.833 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:12 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:07:12.833 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:12 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:07:12.833 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:12 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:07:12.833 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:12 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:07:12.833 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:12 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:07:12.833 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:12 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:07:12.833 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:12 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:07:12.834 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:12 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:07:12.834 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:12 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:07:12.834 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:12 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:07:12.834 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:12 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:07:12.834 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:12 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:07:12.834 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:12 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:07:12.834 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:12 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:07:12.834 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:12 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:07:12.834 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:12 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:07:12.834 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:12 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:07:12.834 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:12 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:07:12.834 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:12 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:07:12.835 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:12 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:07:12.835 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:12 smithi099 ceph-mon[137093]: failed to encode map e128 with expected crc 2024-03-30T14:07:12.835 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:12 smithi099 ceph-mon[137093]: osdmap e128: 8 total, 8 up, 8 in 2024-03-30T14:07:12.835 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:12 smithi099 ceph-mon[137093]: failed to encode map e128 with expected crc 2024-03-30T14:07:12.835 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:12 smithi099 ceph-mon[137093]: failed to encode map e128 with expected crc 2024-03-30T14:07:12.835 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:12 smithi099 ceph-mon[137093]: failed to encode map e128 with expected crc 2024-03-30T14:07:12.835 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:12 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:07:12.835 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:12 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:07:12.835 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:12 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:07:12.835 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:12 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:07:12.835 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:12 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:07:12.835 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:12 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:07:12.835 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:12 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:07:12.835 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:12 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:07:12.835 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:12 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:07:12.836 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:12 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:07:12.836 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:12 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:07:12.836 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:12 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:07:12.836 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:12 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:07:12.836 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:12 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:07:12.836 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:12 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:07:12.836 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:12 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:07:12.836 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:12 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:07:12.836 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:12 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:07:12.836 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:12 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:07:12.836 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:12 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:07:12.837 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:12 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:07:12.837 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:12 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:07:12.837 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:12 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:07:12.837 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:12 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:07:12.837 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:12 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:07:12.837 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:12 smithi099 ceph-mon[143401]: failed to encode map e128 with expected crc 2024-03-30T14:07:12.837 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:12 smithi099 ceph-mon[143401]: osdmap e128: 8 total, 8 up, 8 in 2024-03-30T14:07:12.837 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:12 smithi099 ceph-mon[143401]: failed to encode map e128 with expected crc 2024-03-30T14:07:12.837 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:12 smithi099 ceph-mon[143401]: failed to encode map e128 with expected crc 2024-03-30T14:07:12.837 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:12 smithi099 ceph-mon[143401]: failed to encode map e128 with expected crc 2024-03-30T14:07:12.837 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:12 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:07:12.837 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:12 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:07:12.837 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:12 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:07:12.837 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:12 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:07:12.837 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:12 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:07:12.838 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:12 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:07:12.838 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:12 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:07:12.838 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:12 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:07:12.838 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:12 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:07:12.838 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:12 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:07:12.838 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:12 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:07:12.838 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:12 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:07:12.838 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:12 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:07:12.838 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:12 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:07:12.838 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:12 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:07:12.839 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:12 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:07:12.839 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:12 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:07:12.839 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:12 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:07:12.839 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:12 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:07:12.839 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:12 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:07:12.839 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:12 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:07:12.839 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:12 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:07:12.839 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:12 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:07:12.839 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:12 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:07:12.839 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:12 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:07:12.839 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:12 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:07:12.839 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:12 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:07:12.839 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:12 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:07:12.840 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:12 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:07:12.840 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:12 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:07:12.840 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:12 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:07:12.840 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:12 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:07:12.840 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:12 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:07:12.840 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:12 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:07:12.840 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:12 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:07:12.840 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:12 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:07:12.840 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:12 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:07:12.840 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:12 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:07:12.998 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:12 smithi181 ceph-mon[115276]: pgmap v123: 161 pgs: 12 active+undersized+degraded, 33 active+undersized, 116 active+clean; 585 KiB data, 156 MiB used, 715 GiB / 715 GiB avail; 55/627 objects degraded (8.772%) 2024-03-30T14:07:12.998 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:12 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:07:12.998 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:12 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:07:12.998 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:12 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:07:12.998 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:12 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:07:12.998 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:12 smithi181 ceph-mon[115276]: failed to encode map e127 with expected crc 2024-03-30T14:07:12.998 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:12 smithi181 ceph-mon[115276]: failed to encode map e127 with expected crc 2024-03-30T14:07:12.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:12 smithi181 ceph-mon[115276]: failed to encode map e127 with expected crc 2024-03-30T14:07:12.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:12 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:07:12.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:12 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:07:12.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:12 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:07:12.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:12 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:07:12.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:12 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:07:12.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:12 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:07:12.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:12 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:07:12.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:12 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:07:12.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:12 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:07:12.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:12 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:07:12.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:12 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:07:12.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:12 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:07:12.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:12 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:07:12.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:12 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:07:13.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:12 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:07:13.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:12 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:07:13.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:12 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:07:13.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:12 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:07:13.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:12 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:07:13.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:12 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:07:13.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:12 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:07:13.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:12 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:07:13.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:12 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:07:13.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:12 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:07:13.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:12 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:07:13.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:12 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:07:13.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:12 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:07:13.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:12 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:07:13.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:12 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:07:13.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:12 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:07:13.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:12 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:07:13.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:12 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:07:13.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:12 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:07:13.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:12 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:07:13.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:12 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:07:13.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:12 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:07:13.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:12 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:07:13.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:12 smithi181 ceph-mon[115276]: failed to encode map e128 with expected crc 2024-03-30T14:07:13.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:12 smithi181 ceph-mon[115276]: osdmap e128: 8 total, 8 up, 8 in 2024-03-30T14:07:13.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:12 smithi181 ceph-mon[115276]: failed to encode map e128 with expected crc 2024-03-30T14:07:13.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:12 smithi181 ceph-mon[115276]: failed to encode map e128 with expected crc 2024-03-30T14:07:13.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:12 smithi181 ceph-mon[115276]: failed to encode map e128 with expected crc 2024-03-30T14:07:13.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:12 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:07:13.002 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:12 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:07:13.002 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:12 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:07:13.002 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:12 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:07:13.002 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:12 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:07:13.002 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:12 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:07:13.002 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:12 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:07:13.002 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:12 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:07:13.002 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:12 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:07:13.002 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:12 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:07:13.002 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:12 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:07:13.002 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:12 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:07:13.002 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:12 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:07:13.002 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:12 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:07:13.002 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:12 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:07:13.003 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:12 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:07:13.003 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:12 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:07:13.003 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:12 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:07:13.003 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:12 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:07:13.003 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:12 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:07:13.003 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:12 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:07:13.003 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:12 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:07:13.003 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:12 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:07:13.003 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:12 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:07:13.003 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:12 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:07:13.621 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:13 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:07:13.621 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:13 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:07:13.621 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:13 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:07:13.622 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:13 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:07:13.622 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:13 smithi099 ceph-mon[137093]: failed to encode map e128 with expected crc 2024-03-30T14:07:13.622 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:13 smithi099 ceph-mon[137093]: failed to encode map e128 with expected crc 2024-03-30T14:07:13.622 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:13 smithi099 ceph-mon[137093]: failed to encode map e128 with expected crc 2024-03-30T14:07:13.622 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:13 smithi099 ceph-mon[137093]: failed to encode map e128 with expected crc 2024-03-30T14:07:13.622 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:13 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:07:13.622 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:13 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:07:13.622 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:13 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:07:13.622 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:13 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:07:13.622 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:13 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:07:13.622 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:13 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:07:13.622 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:13 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:07:13.622 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:13 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:07:13.623 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:13 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:07:13.623 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:13 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:07:13.623 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:13 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:07:13.623 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:13 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:07:13.623 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:13 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:07:13.623 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:13 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:07:13.623 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:13 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:07:13.623 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:13 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:07:13.623 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:13 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:07:13.623 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:13 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:07:13.623 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:13 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:07:13.623 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:13 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:07:13.623 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:13 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:07:13.623 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:13 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:07:13.623 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:13 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:07:13.623 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:13 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:07:13.624 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:13 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:07:13.624 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:13 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:07:13.624 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:13 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:07:13.624 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:13 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:07:13.624 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:13 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:07:13.624 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:13 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:07:13.624 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:13 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:07:13.624 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:13 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:07:13.624 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:13 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:07:13.624 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:13 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:07:13.624 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:13 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:07:13.624 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:13 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:07:13.624 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:13 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:07:13.625 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:13 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:07:13.625 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:13 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:07:13.625 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:13 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:07:13.625 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:13 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:07:13.625 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:13 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:07:13.625 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:13 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:07:13.625 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:13 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:07:13.625 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:13 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:07:13.625 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:13 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:07:13.625 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:13 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:07:13.625 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:13 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:07:13.625 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:13 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:07:13.625 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:13 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:07:13.625 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:13 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:07:13.625 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:13 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:07:13.626 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:13 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:07:13.626 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:13 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:07:13.626 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:13 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:07:13.626 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:13 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:07:13.626 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:13 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:07:13.626 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:13 smithi099 ceph-mon[143401]: failed to encode map e128 with expected crc 2024-03-30T14:07:13.626 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:13 smithi099 ceph-mon[143401]: failed to encode map e128 with expected crc 2024-03-30T14:07:13.626 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:13 smithi099 ceph-mon[143401]: failed to encode map e128 with expected crc 2024-03-30T14:07:13.626 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:13 smithi099 ceph-mon[143401]: failed to encode map e128 with expected crc 2024-03-30T14:07:13.626 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:13 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:07:13.627 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:13 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:07:13.627 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:13 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:07:13.627 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:13 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:07:13.627 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:13 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:07:13.627 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:13 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:07:13.627 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:13 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:07:13.627 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:13 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:07:13.627 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:13 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:07:13.627 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:13 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:07:13.627 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:13 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:07:13.627 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:13 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:07:13.627 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:13 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:07:13.627 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:13 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:07:13.627 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:13 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:07:13.627 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:13 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:07:13.627 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:13 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:07:13.627 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:13 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:07:13.628 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:13 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:07:13.628 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:13 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:07:13.628 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:13 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:07:13.628 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:13 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:07:13.628 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:13 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:07:13.628 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:13 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:07:13.628 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:13 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:07:13.628 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:13 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:07:13.628 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:13 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:07:13.628 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:13 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:07:13.628 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:13 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:07:13.628 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:13 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:07:13.628 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:13 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:07:13.629 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:13 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:07:13.629 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:13 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:07:13.629 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:13 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:07:13.629 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:13 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:07:13.629 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:13 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:07:13.629 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:13 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:07:13.629 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:13 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:07:13.629 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:13 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:07:13.629 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:13 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:07:13.629 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:13 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:07:13.629 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:13 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:07:13.629 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:13 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:07:13.629 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:13 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:07:13.630 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:13 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:07:13.630 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:13 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:07:13.630 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:13 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:07:13.630 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:13 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:07:13.630 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:13 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:07:13.630 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:13 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:07:13.630 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:13 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:07:13.630 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:13 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:07:13.630 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:13 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:07:13.630 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:13 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:07:13.630 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:13 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:07:13.630 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:13 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:07:13.630 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:13 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:07:13.630 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:13 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:07:13.630 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:13 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:07:13.631 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:13 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:07:13.631 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:13 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:07:13.631 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:13 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:07:13.631 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:13 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:07:13.631 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:13 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:07:13.631 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:13 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:07:13.631 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:13 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:07:13.631 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:13 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:07:13.631 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:13 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:07:13.631 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:13 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:07:13.631 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:13 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:07:13.631 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:13 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:07:13.998 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:13 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:07:13.998 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:13 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:07:13.998 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:13 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:07:13.998 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:13 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:07:13.998 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:13 smithi181 ceph-mon[115276]: failed to encode map e128 with expected crc 2024-03-30T14:07:13.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:13 smithi181 ceph-mon[115276]: failed to encode map e128 with expected crc 2024-03-30T14:07:13.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:13 smithi181 ceph-mon[115276]: failed to encode map e128 with expected crc 2024-03-30T14:07:13.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:13 smithi181 ceph-mon[115276]: failed to encode map e128 with expected crc 2024-03-30T14:07:13.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:13 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:07:13.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:13 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:07:13.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:13 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:07:13.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:13 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:07:13.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:13 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:07:13.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:13 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:07:13.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:13 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:07:13.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:13 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:07:13.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:13 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:07:13.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:13 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:07:13.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:13 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:07:13.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:13 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:07:13.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:13 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:07:13.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:13 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:07:14.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:13 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:07:14.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:13 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:07:14.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:13 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:07:14.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:13 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:07:14.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:13 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:07:14.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:13 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:07:14.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:13 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:07:14.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:13 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:07:14.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:13 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:07:14.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:13 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:07:14.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:13 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:07:14.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:13 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:07:14.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:13 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:07:14.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:13 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:07:14.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:13 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:07:14.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:13 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:07:14.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:13 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:07:14.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:13 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:07:14.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:13 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:07:14.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:13 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:07:14.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:13 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:07:14.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:13 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:07:14.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:13 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:07:14.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:13 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:07:14.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:13 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:07:14.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:13 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:07:14.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:13 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:07:14.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:13 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:07:14.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:13 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:07:14.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:13 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:07:14.002 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:13 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:07:14.002 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:13 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:07:14.002 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:13 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:07:14.002 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:13 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:07:14.002 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:13 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:07:14.002 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:13 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:07:14.002 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:13 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:07:14.002 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:13 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:07:14.002 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:13 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:07:14.002 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:13 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:07:14.002 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:13 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:07:14.002 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:13 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:07:14.002 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:13 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:07:14.002 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:13 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:07:14.003 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:13 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:07:14.003 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:13 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:07:14.003 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:13 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:07:14.003 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:13 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:07:14.791 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:14 smithi099 ceph-mon[137093]: pgmap v126: 161 pgs: 5 active+undersized+degraded, 17 active+undersized, 139 active+clean; 585 KiB data, 157 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 1 op/s; 27/627 objects degraded (4.306%) 2024-03-30T14:07:14.791 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:14 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:07:14.791 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:14 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:07:14.791 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:14 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:07:14.791 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:14 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:07:14.791 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:14 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:07:14.791 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:14 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:07:14.791 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:14 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:07:14.792 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:14 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:07:14.792 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:14 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:07:14.792 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:14 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:07:14.792 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:14 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:07:14.792 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:14 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:07:14.792 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:14 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:07:14.792 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:14 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:07:14.792 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:14 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:07:14.792 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:14 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:07:14.792 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:14 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:07:14.792 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:14 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:07:14.793 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:14 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:07:14.793 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:14 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:07:14.793 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:14 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:07:14.793 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:14 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:07:14.793 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:14 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:07:14.793 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:14 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:07:14.793 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:14 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:07:14.793 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:14 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:07:14.793 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:14 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:07:14.793 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:14 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:07:14.793 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:14 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:07:14.794 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:14 smithi099 ceph-mon[143401]: pgmap v126: 161 pgs: 5 active+undersized+degraded, 17 active+undersized, 139 active+clean; 585 KiB data, 157 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 1 op/s; 27/627 objects degraded (4.306%) 2024-03-30T14:07:14.794 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:14 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:07:14.794 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:14 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:07:14.794 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:14 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:07:14.794 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:14 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:07:14.794 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:14 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:07:14.794 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:14 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:07:14.794 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:14 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:07:14.794 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:14 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:07:14.794 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:14 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:07:14.794 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:14 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:07:14.794 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:14 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:07:14.795 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:14 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:07:14.795 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:14 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:07:14.795 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:14 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:07:14.795 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:14 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:07:14.795 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:14 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:07:14.795 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:14 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:07:14.795 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:14 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:07:14.795 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:14 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:07:14.795 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:14 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:07:14.795 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:14 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:07:14.795 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:14 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:07:14.795 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:14 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:07:14.795 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:14 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:07:14.795 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:14 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:07:14.795 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:14 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:07:14.796 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:14 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:07:14.796 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:14 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:07:14.796 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:14 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:07:14.796 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:14 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:07:14.796 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:14 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:07:14.796 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:14 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:07:14.796 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:14 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:07:14.796 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:14 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:07:14.796 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:14 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:07:14.796 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:14 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:07:14.796 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:14 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:07:14.797 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:14 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:07:14.797 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:14 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:07:14.797 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:14 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:07:14.797 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:14 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:07:14.797 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:14 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:07:14.797 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:14 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:07:14.797 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:14 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:07:14.797 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:14 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:07:14.797 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:14 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:07:14.797 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:14 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:07:14.797 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:14 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:07:14.797 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:14 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:07:14.797 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:14 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:07:14.797 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:14 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:07:14.797 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:14 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:07:14.798 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:14 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:07:14.798 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:14 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:07:14.798 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:14 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:07:14.798 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:14 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:07:14.798 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:14 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:07:14.798 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:14 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:07:14.798 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:14 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:07:14.798 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:14 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:07:14.798 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:14 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:07:14.798 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:14 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:07:14.798 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:14 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:07:14.798 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:14 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:07:14.798 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:14 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:07:14.799 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:14 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:07:14.799 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:14 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:07:14.799 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:14 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:07:14.799 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:14 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:07:14.799 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:14 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:07:14.799 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:14 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:07:14.799 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:14 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:07:14.799 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:14 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:07:14.799 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:14 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:07:14.799 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:14 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:07:14.799 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:14 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:07:14.799 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:14 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:07:14.799 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:14 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:07:14.799 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:14 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:07:14.799 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:14 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:07:14.800 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:14 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:07:14.800 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:14 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:07:14.800 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:14 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:07:14.998 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:14 smithi181 ceph-mon[115276]: pgmap v126: 161 pgs: 5 active+undersized+degraded, 17 active+undersized, 139 active+clean; 585 KiB data, 157 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 1 op/s; 27/627 objects degraded (4.306%) 2024-03-30T14:07:14.998 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:14 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:07:14.998 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:14 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:07:14.998 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:14 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:07:14.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:14 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:07:14.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:14 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:07:14.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:14 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:07:14.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:14 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:07:14.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:14 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:07:14.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:14 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:07:14.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:14 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:07:14.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:14 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:07:14.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:14 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:07:14.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:14 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:07:14.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:14 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:07:14.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:14 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:07:14.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:14 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:07:14.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:14 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:07:15.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:14 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:07:15.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:14 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:07:15.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:14 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:07:15.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:14 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:07:15.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:14 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:07:15.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:14 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:07:15.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:14 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:07:15.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:14 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:07:15.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:14 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:07:15.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:14 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:07:15.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:14 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:07:15.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:14 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:07:15.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:14 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:07:15.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:14 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:07:15.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:14 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:07:15.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:14 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:07:15.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:14 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:07:15.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:14 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:07:15.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:14 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:07:15.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:14 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:07:15.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:14 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:07:15.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:14 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:07:15.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:14 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:07:15.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:14 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:07:15.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:14 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:07:15.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:14 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:07:15.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:14 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:07:15.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:14 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:07:15.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:14 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:07:15.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:14 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:07:15.002 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:14 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:07:15.002 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:14 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:07:15.002 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:14 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:07:15.002 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:14 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:07:15.002 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:14 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:07:15.002 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:14 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:07:15.002 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:14 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:07:15.002 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:14 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:07:15.002 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:14 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:07:15.078 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 14:07:14 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[71049]: ::ffff:172.21.15.181 - - [30/Mar/2024:14:07:14] "GET /metrics HTTP/1.1" 200 38247 "" "Prometheus/2.43.0" 2024-03-30T14:07:15.829 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:15 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:07:15.829 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:15 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:07:15.829 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:15 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:07:15.829 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:15 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:07:15.829 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:15 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:07:15.829 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:15 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:07:15.829 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:15 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:07:15.829 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:15 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:07:15.829 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:15 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:07:15.829 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:15 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:07:15.829 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:15 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:07:15.830 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:15 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:07:15.830 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:15 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:07:15.830 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:15 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:07:15.830 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:15 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:07:15.830 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:15 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:07:15.830 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:15 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:07:15.830 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:15 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:07:15.830 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:15 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:07:15.830 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:15 smithi099 ceph-mon[143401]: Health check update: Degraded data redundancy: 27/627 objects degraded (4.306%), 5 pgs degraded (PG_DEGRADED) 2024-03-30T14:07:15.830 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:15 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:07:15.830 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:15 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:07:15.830 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:15 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:07:15.831 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:15 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:07:15.831 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:15 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:07:15.831 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:15 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:07:15.831 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:15 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:07:15.831 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:15 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:07:15.831 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:15 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:07:15.831 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:15 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:07:15.831 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:15 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:07:15.831 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:15 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:07:15.831 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:15 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:07:15.831 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:15 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:07:15.831 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:15 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:07:15.832 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:15 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:07:15.832 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:15 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:07:15.832 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:15 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:07:15.832 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:15 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:07:15.832 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:15 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:07:15.832 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:15 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:07:15.832 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:15 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:07:15.832 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:15 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:07:15.832 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:15 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:07:15.832 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:15 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:07:15.832 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:15 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:07:15.832 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:15 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:07:15.832 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:15 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:07:15.833 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:15 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:07:15.833 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:15 smithi099 ceph-mon[137093]: Health check update: Degraded data redundancy: 27/627 objects degraded (4.306%), 5 pgs degraded (PG_DEGRADED) 2024-03-30T14:07:15.833 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:15 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:07:15.833 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:15 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:07:15.833 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:15 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:07:15.833 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:15 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:07:15.833 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:15 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:07:15.833 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:15 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:07:15.833 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:15 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:07:15.833 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:15 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:07:15.833 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:15 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:07:15.833 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:15 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:07:15.834 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:15 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:07:15.834 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:15 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:07:15.834 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:15 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:07:15.834 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:15 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:07:15.834 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:15 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:07:15.834 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:15 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:07:15.834 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:15 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:07:15.834 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:15 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:07:15.834 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:15 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:07:15.834 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:15 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:07:15.835 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:15 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:07:15.835 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:15 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:07:15.835 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:15 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:07:15.835 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:15 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:07:15.835 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:15 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:07:15.835 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:15 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:07:15.835 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:15 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:07:15.835 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:15 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:07:15.835 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:15 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:07:15.835 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:15 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:07:15.835 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:15 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:07:15.835 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:15 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:07:15.835 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:15 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:07:15.835 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:15 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:07:15.835 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:15 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:07:15.836 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:15 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:07:15.836 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:15 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:07:15.836 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:15 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:07:15.836 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:15 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:07:15.836 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:15 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:07:15.836 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:15 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:07:15.836 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:15 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:07:15.836 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:15 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:07:15.836 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:15 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:07:15.836 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:15 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:07:15.837 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:15 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:07:15.837 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:15 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:07:15.837 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:15 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:07:15.837 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:15 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:07:15.837 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:15 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:07:15.837 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:15 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:07:15.837 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:15 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:07:15.837 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:15 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:07:15.837 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:15 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:07:15.837 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:15 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:07:15.837 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:15 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:07:15.837 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:15 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:07:15.837 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:15 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:07:15.837 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:15 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:07:15.837 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:15 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:07:15.838 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:15 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:07:15.838 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:15 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:07:15.838 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:15 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:07:15.838 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:15 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:07:15.838 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:15 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:07:15.838 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:15 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:07:15.838 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:15 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:07:15.838 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:15 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:07:15.838 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:15 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:07:15.838 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:15 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:07:15.838 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:15 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:07:15.839 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:15 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:07:15.839 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:15 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:07:15.839 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:15 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:07:15.839 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:15 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:07:15.839 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:15 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:07:15.839 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:15 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:07:15.839 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:15 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:07:15.839 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:15 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:07:15.839 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:15 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:07:15.998 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:15 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:07:15.998 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:15 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:07:15.998 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:15 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:07:15.998 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:15 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:07:15.998 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:15 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:07:15.998 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:15 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:07:15.998 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:15 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:07:15.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:15 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:07:15.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:15 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:07:15.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:15 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:07:15.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:15 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:07:15.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:15 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:07:15.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:15 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:07:15.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:15 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:07:15.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:15 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:07:15.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:15 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:07:15.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:15 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:07:16.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:15 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:07:16.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:15 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:07:16.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:15 smithi181 ceph-mon[115276]: Health check update: Degraded data redundancy: 27/627 objects degraded (4.306%), 5 pgs degraded (PG_DEGRADED) 2024-03-30T14:07:16.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:15 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:07:16.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:15 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:07:16.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:15 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:07:16.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:15 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:07:16.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:15 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:07:16.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:15 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:07:16.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:15 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:07:16.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:15 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:07:16.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:15 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:07:16.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:15 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:07:16.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:15 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:07:16.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:15 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:07:16.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:15 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:07:16.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:15 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:07:16.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:15 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:07:16.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:15 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:07:16.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:15 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:07:16.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:15 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:07:16.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:15 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:07:16.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:15 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:07:16.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:15 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:07:16.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:15 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:07:16.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:15 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:07:16.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:15 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:07:16.002 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:15 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:07:16.002 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:15 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:07:16.002 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:15 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:07:16.002 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:15 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:07:16.002 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:15 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:07:16.002 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:15 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:07:16.002 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:15 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:07:16.002 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:15 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:07:16.002 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:15 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:07:16.002 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:15 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:07:16.002 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:15 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:07:16.002 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:15 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:07:16.002 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:15 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:07:16.002 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:15 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:07:16.002 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:15 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:07:16.003 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:15 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:07:16.003 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:15 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:07:16.003 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:15 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:07:16.003 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:15 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:07:16.003 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:15 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:07:16.003 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:15 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:07:16.829 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:16 smithi099 ceph-mon[143401]: pgmap v127: 161 pgs: 3 active+undersized+degraded, 14 active+undersized, 144 active+clean; 585 KiB data, 157 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s; 8/627 objects degraded (1.276%) 2024-03-30T14:07:16.829 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:16 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:07:16.829 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:16 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:07:16.829 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:16 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:07:16.829 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:16 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:07:16.829 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:16 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:07:16.829 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:16 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:07:16.829 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:16 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:07:16.829 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:16 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:07:16.829 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:16 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:07:16.830 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:16 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:07:16.830 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:16 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:07:16.830 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:16 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:07:16.830 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:16 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:07:16.830 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:16 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:07:16.830 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:16 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:07:16.830 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:16 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:07:16.830 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:16 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:07:16.830 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:16 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:07:16.830 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:16 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:07:16.830 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:16 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:07:16.830 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:16 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:07:16.830 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:16 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:07:16.830 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:16 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:07:16.831 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:16 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:07:16.831 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:16 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:07:16.831 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:16 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:07:16.831 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:16 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:07:16.831 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:16 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:07:16.831 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:16 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:07:16.831 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:16 smithi099 ceph-mon[137093]: pgmap v127: 161 pgs: 3 active+undersized+degraded, 14 active+undersized, 144 active+clean; 585 KiB data, 157 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s; 8/627 objects degraded (1.276%) 2024-03-30T14:07:16.831 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:16 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:07:16.831 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:16 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:07:16.831 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:16 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:07:16.832 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:16 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:07:16.832 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:16 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:07:16.832 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:16 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:07:16.832 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:16 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:07:16.832 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:16 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:07:16.832 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:16 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:07:16.832 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:16 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:07:16.832 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:16 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:07:16.832 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:16 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:07:16.832 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:16 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:07:16.832 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:16 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:07:16.832 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:16 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:07:16.832 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:16 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:07:16.832 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:16 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:07:16.833 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:16 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:07:16.833 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:16 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:07:16.833 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:16 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:07:16.833 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:16 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:07:16.833 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:16 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:07:16.833 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:16 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:07:16.833 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:16 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:07:16.833 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:16 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:07:16.833 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:16 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:07:16.833 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:16 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:07:16.833 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:16 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:07:16.833 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:16 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:07:16.834 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:16 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:07:16.834 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:16 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:07:16.834 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:16 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:07:16.834 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:16 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:07:16.834 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:16 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:07:16.834 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:16 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:07:16.834 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:16 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:07:16.834 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:16 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:07:16.834 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:16 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:07:16.834 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:16 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:07:16.834 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:16 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:07:16.834 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:16 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:07:16.835 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:16 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:07:16.835 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:16 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:07:16.835 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:16 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:07:16.835 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:16 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:07:16.835 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:16 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:07:16.835 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:16 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:07:16.835 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:16 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:07:16.835 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:16 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:07:16.835 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:16 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:07:16.835 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:16 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:07:16.835 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:16 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:07:16.835 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:16 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:07:16.835 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:16 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:07:16.835 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:16 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:07:16.835 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:16 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:07:16.836 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:16 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:07:16.836 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:16 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:07:16.836 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:16 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:07:16.836 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:16 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:07:16.836 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:16 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:07:16.836 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:16 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:07:16.836 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:16 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:07:16.836 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:16 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:07:16.836 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:16 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:07:16.836 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:16 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:07:16.836 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:16 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:07:16.837 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:16 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:07:16.837 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:16 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:07:16.837 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:16 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:07:16.837 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:16 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:07:16.837 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:16 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:07:16.837 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:16 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:07:16.837 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:16 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:07:16.837 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:16 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:07:16.837 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:16 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:07:16.837 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:16 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:07:16.837 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:16 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:07:16.837 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:16 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:07:16.837 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:16 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:07:16.837 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:16 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:07:16.837 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:16 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:07:16.838 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:16 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:07:16.838 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:16 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:07:16.838 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:16 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:07:16.838 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:16 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:07:16.838 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:16 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:07:16.838 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:16 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:07:16.838 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:16 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:07:16.838 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:16 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:07:16.838 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:16 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:07:16.838 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:16 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:07:16.838 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:16 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:07:16.839 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:16 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:07:16.839 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:16 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:07:16.839 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:16 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:07:16.839 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:16 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:07:16.839 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:16 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:07:16.839 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:16 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:07:16.839 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:16 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:07:16.839 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:16 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:07:16.839 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:16 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:07:16.839 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:16 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:07:16.998 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:16 smithi181 ceph-mon[115276]: pgmap v127: 161 pgs: 3 active+undersized+degraded, 14 active+undersized, 144 active+clean; 585 KiB data, 157 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s; 8/627 objects degraded (1.276%) 2024-03-30T14:07:16.998 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:16 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:07:16.998 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:16 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:07:16.998 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:16 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:07:16.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:16 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:07:16.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:16 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:07:16.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:16 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:07:16.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:16 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:07:16.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:16 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:07:16.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:16 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:07:16.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:16 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:07:16.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:16 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:07:16.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:16 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:07:16.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:16 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:07:16.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:16 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:07:16.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:16 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:07:16.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:16 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:07:16.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:16 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:07:17.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:16 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:07:17.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:16 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:07:17.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:16 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:07:17.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:16 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:07:17.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:16 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:07:17.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:16 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:07:17.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:16 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:07:17.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:16 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:07:17.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:16 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:07:17.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:16 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:07:17.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:16 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:07:17.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:16 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:07:17.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:16 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:07:17.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:16 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:07:17.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:16 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:07:17.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:16 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:07:17.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:16 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:07:17.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:16 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:07:17.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:16 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:07:17.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:16 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:07:17.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:16 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:07:17.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:16 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:07:17.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:16 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:07:17.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:16 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:07:17.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:16 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:07:17.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:16 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:07:17.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:16 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:07:17.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:16 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:07:17.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:16 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:07:17.002 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:16 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:07:17.002 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:16 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:07:17.002 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:16 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:07:17.002 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:16 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:07:17.002 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:16 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:07:17.002 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:16 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:07:17.002 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:16 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:07:17.002 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:16 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:07:17.002 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:16 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:07:17.002 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:16 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:07:17.002 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:16 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:07:17.002 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:16 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:07:17.002 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:16 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:07:17.002 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:16 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:07:17.003 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:16 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:07:17.003 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:16 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:07:17.003 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:16 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:07:17.003 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:16 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:07:17.003 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:16 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:07:17.003 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:16 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:07:17.815 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:17 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:07:17.815 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:17 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:07:17.815 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:17 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:07:17.815 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:17 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:07:17.815 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:17 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:07:17.815 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:17 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:07:17.815 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:17 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:07:17.815 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:17 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:07:17.815 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:17 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:07:17.816 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:17 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:07:17.816 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:17 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:07:17.816 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:17 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:07:17.816 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:17 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:07:17.816 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:17 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:07:17.816 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:17 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:07:17.816 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:17 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:07:17.816 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:17 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:07:17.816 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:17 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:07:17.816 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:17 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:07:17.816 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:17 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:07:17.816 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:17 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:07:17.816 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:17 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:07:17.817 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:17 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:07:17.817 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:17 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:07:17.817 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:17 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:07:17.817 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:17 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:07:17.817 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:17 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:07:17.817 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:17 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:07:17.817 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:17 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:07:17.817 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:17 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:07:17.817 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:17 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:07:17.817 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:17 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:07:17.818 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:17 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:07:17.818 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:17 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:07:17.818 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:17 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:07:17.818 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:17 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:07:17.818 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:17 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:07:17.818 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:17 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:07:17.818 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:17 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:07:17.818 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:17 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:07:17.818 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:17 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:07:17.818 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:17 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:07:17.818 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:17 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:07:17.818 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:17 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:07:17.819 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:17 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:07:17.819 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:17 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:07:17.819 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:17 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:07:17.819 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:17 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:07:17.819 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:17 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:07:17.819 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:17 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:07:17.819 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:17 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:07:17.819 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:17 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:07:17.819 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:17 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:07:17.819 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:17 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:07:17.819 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:17 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:07:17.819 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:17 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:07:17.819 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:17 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:07:17.820 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:17 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:07:17.820 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:17 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:07:17.820 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:17 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:07:17.820 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:17 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:07:17.820 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:17 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:07:17.820 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:17 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:07:17.820 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:17 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:07:17.820 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:17 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:07:17.820 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:17 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:07:17.821 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:17 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:07:17.821 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:17 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:07:17.821 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:17 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:07:17.821 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:17 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:07:17.821 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:17 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:07:17.821 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:17 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:07:17.821 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:17 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:07:17.821 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:17 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:07:17.821 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:17 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:07:17.821 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:17 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:07:17.821 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:17 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:07:17.821 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:17 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:07:17.821 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:17 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:07:17.821 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:17 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:07:17.822 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:17 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:07:17.822 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:17 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:07:17.822 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:17 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:07:17.822 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:17 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:07:17.822 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:17 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:07:17.822 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:17 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:07:17.822 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:17 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:07:17.822 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:17 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:07:17.822 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:17 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:07:17.822 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:17 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:07:17.822 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:17 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:07:17.822 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:17 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:07:17.823 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:17 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:07:17.823 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:17 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:07:17.823 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:17 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:07:17.823 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:17 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:07:17.823 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:17 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:07:17.823 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:17 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:07:17.823 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:17 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:07:17.823 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:17 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:07:17.823 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:17 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:07:17.823 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:17 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:07:17.823 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:17 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:07:17.824 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:17 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:07:17.824 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:17 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:07:17.824 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:17 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:07:17.824 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:17 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:07:17.824 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:17 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:07:17.824 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:17 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:07:17.824 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:17 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:07:17.824 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:17 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:07:17.824 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:17 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:07:17.824 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:17 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:07:17.824 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:17 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:07:17.824 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:17 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:07:17.825 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:17 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:07:17.825 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:17 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:07:17.825 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:17 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:07:17.825 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:17 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:07:17.825 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:17 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:07:17.825 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:17 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:07:17.825 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:17 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:07:17.825 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:17 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:07:17.825 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:17 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:07:17.825 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:17 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:07:17.825 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:17 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:07:17.825 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:17 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:07:17.825 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:17 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:07:17.825 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:17 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:07:17.826 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:17 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:07:17.826 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:17 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:07:17.826 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:17 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:07:17.826 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:17 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:07:17.826 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:17 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:07:17.826 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:17 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:07:17.826 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:17 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:07:17.826 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:17 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:07:17.826 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:17 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:07:17.826 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:17 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:07:17.826 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:17 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:07:17.827 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:17 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:07:17.827 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:17 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:07:17.827 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:17 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:07:17.827 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:17 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:07:17.998 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:17 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:07:17.998 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:17 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:07:17.998 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:17 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:07:17.998 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:17 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:07:17.998 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:17 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:07:17.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:17 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:07:17.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:17 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:07:17.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:17 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:07:17.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:17 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:07:17.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:17 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:07:17.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:17 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:07:17.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:17 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:07:17.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:17 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:07:17.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:17 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:07:17.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:17 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:07:17.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:17 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:07:17.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:17 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:07:17.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:17 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:07:17.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:17 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:07:18.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:17 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:07:18.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:17 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:07:18.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:17 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:07:18.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:17 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:07:18.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:17 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:07:18.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:17 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:07:18.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:17 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:07:18.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:17 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:07:18.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:17 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:07:18.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:17 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:07:18.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:17 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:07:18.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:17 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:07:18.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:17 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:07:18.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:17 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:07:18.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:17 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:07:18.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:17 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:07:18.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:17 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:07:18.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:17 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:07:18.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:17 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:07:18.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:17 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:07:18.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:17 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:07:18.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:17 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:07:18.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:17 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:07:18.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:17 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:07:18.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:17 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:07:18.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:17 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:07:18.002 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:17 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:07:18.002 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:17 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:07:18.002 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:17 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:07:18.002 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:17 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:07:18.002 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:17 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:07:18.002 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:17 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:07:18.002 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:17 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:07:18.002 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:17 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:07:18.002 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:17 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:07:18.002 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:17 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:07:18.002 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:17 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:07:18.002 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:17 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:07:18.002 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:17 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:07:18.003 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:17 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:07:18.003 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:17 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:07:18.003 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:17 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:07:18.003 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:17 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:07:18.003 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:17 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:07:18.003 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:17 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:07:18.003 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:17 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:07:18.003 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:17 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:07:18.003 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:17 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:07:18.003 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:17 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:07:18.003 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:17 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:07:18.003 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:17 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:07:18.003 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:17 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:07:18.003 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:17 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:07:18.547 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:18 smithi181 ceph-mon[115276]: pgmap v128: 161 pgs: 161 active+clean; 585 KiB data, 157 MiB used, 715 GiB / 715 GiB avail; 768 B/s rd, 0 op/s 2024-03-30T14:07:18.547 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:18 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:07:18.547 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:18 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:07:18.547 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:18 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:07:18.547 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:18 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:07:18.547 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:18 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:07:18.547 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:18 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:07:18.547 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:18 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:07:18.548 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:18 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:07:18.548 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:18 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:07:18.548 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:18 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:07:18.548 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:18 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:07:18.548 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:18 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:07:18.548 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:18 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:07:18.548 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:18 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:07:18.548 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:18 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:07:18.548 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:18 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:07:18.548 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:18 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:07:18.548 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:18 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:07:18.548 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:18 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:07:18.548 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:18 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:07:18.548 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:18 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:07:18.548 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:18 smithi181 ceph-mon[115276]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 8/627 objects degraded (1.276%), 3 pgs degraded) 2024-03-30T14:07:18.549 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:18 smithi181 ceph-mon[115276]: Cluster is now healthy 2024-03-30T14:07:18.549 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:18 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:07:18.549 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:18 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:07:18.549 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:18 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:07:18.549 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:18 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:07:18.549 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:18 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:07:18.549 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:18 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:07:18.549 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:18 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:07:18.549 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:18 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:07:18.550 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:18 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:07:18.550 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:18 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:07:18.550 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:18 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:07:18.550 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:18 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:07:18.550 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:18 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:07:18.550 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:18 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:07:18.550 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:18 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:07:18.550 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:18 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:07:18.550 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:18 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:07:18.550 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:18 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:07:18.550 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:18 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:07:18.550 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:18 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:07:18.550 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:18 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:07:18.551 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:18 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:07:18.551 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:18 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:07:18.551 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:18 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:07:18.551 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:18 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:07:18.551 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:18 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:07:18.551 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:18 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:07:18.551 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:18 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:07:18.551 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:18 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:07:18.551 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:18 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:07:18.551 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:18 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:07:18.551 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:18 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:07:18.551 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:18 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:07:18.551 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:18 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:07:18.551 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:18 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:07:18.551 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:18 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:07:18.552 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:18 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:07:18.552 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:18 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:07:18.552 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:18 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:07:18.552 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:18 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:07:18.822 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:18 smithi099 ceph-mon[137093]: pgmap v128: 161 pgs: 161 active+clean; 585 KiB data, 157 MiB used, 715 GiB / 715 GiB avail; 768 B/s rd, 0 op/s 2024-03-30T14:07:18.822 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:18 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:07:18.823 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:18 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:07:18.823 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:18 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:07:18.823 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:18 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:07:18.823 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:18 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:07:18.823 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:18 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:07:18.823 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:18 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:07:18.823 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:18 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:07:18.823 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:18 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:07:18.823 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:18 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:07:18.823 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:18 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:07:18.823 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:18 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:07:18.823 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:18 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:07:18.823 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:18 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:07:18.823 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:18 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:07:18.824 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:18 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:07:18.824 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:18 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:07:18.824 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:18 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:07:18.824 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:18 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:07:18.824 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:18 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:07:18.824 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:18 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:07:18.824 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:18 smithi099 ceph-mon[137093]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 8/627 objects degraded (1.276%), 3 pgs degraded) 2024-03-30T14:07:18.824 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:18 smithi099 ceph-mon[137093]: Cluster is now healthy 2024-03-30T14:07:18.824 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:18 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:07:18.824 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:18 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:07:18.824 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:18 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:07:18.824 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:18 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:07:18.824 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:18 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:07:18.824 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:18 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:07:18.825 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:18 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:07:18.825 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:18 smithi099 ceph-mon[143401]: pgmap v128: 161 pgs: 161 active+clean; 585 KiB data, 157 MiB used, 715 GiB / 715 GiB avail; 768 B/s rd, 0 op/s 2024-03-30T14:07:18.825 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:18 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:07:18.825 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:18 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:07:18.825 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:18 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:07:18.825 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:18 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:07:18.825 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:18 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:07:18.826 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:18 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:07:18.826 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:18 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:07:18.826 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:18 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:07:18.826 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:18 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:07:18.826 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:18 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:07:18.826 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:18 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:07:18.826 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:18 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:07:18.826 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:18 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:07:18.826 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:18 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:07:18.826 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:18 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:07:18.826 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:18 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:07:18.826 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:18 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:07:18.826 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:18 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:07:18.826 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:18 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:07:18.826 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:18 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:07:18.827 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:18 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:07:18.827 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:18 smithi099 ceph-mon[143401]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 8/627 objects degraded (1.276%), 3 pgs degraded) 2024-03-30T14:07:18.827 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:18 smithi099 ceph-mon[143401]: Cluster is now healthy 2024-03-30T14:07:18.827 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:18 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:07:18.827 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:18 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:07:18.827 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:18 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:07:18.827 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:18 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:07:18.827 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:18 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:07:18.827 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:18 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:07:18.827 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:18 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:07:18.827 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:18 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:07:18.827 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:18 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:07:18.827 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:18 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:07:18.827 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:18 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:07:18.827 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:18 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:07:18.827 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:18 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:07:18.828 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:18 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:07:18.828 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:18 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:07:18.828 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:18 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:07:18.828 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:18 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:07:18.828 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:18 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:07:18.828 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:18 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:07:18.828 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:18 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:07:18.828 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:18 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:07:18.828 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:18 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:07:18.828 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:18 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:07:18.828 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:18 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:07:18.828 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:18 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:07:18.828 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:18 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:07:18.828 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:18 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:07:18.828 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:18 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:07:18.828 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:18 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:07:18.829 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:18 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:07:18.829 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:18 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:07:18.829 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:18 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:07:18.829 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:18 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:07:18.829 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:18 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:07:18.829 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:18 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:07:18.829 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:18 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:07:18.829 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:18 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:07:18.829 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:18 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:07:18.829 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:18 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:07:18.829 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:18 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:07:18.829 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:18 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:07:18.830 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:18 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:07:18.830 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:18 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:07:18.830 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:18 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:07:18.830 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:18 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:07:18.830 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:18 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:07:18.830 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:18 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:07:18.830 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:18 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:07:18.830 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:18 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:07:18.830 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:18 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:07:18.830 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:18 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:07:18.830 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:18 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:07:18.830 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:18 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:07:18.830 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:18 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:07:18.831 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:18 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:07:18.831 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:18 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:07:18.831 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:18 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:07:18.831 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:18 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:07:18.831 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:18 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:07:18.831 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:18 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:07:18.831 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:18 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:07:18.831 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:18 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:07:18.831 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:18 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:07:18.831 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:18 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:07:18.831 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:18 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:07:18.831 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:18 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:07:18.831 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:18 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:07:18.831 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:18 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:07:18.831 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:18 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:07:18.831 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:18 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:07:18.832 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:18 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:07:18.832 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:18 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:07:18.832 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:18 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:07:19.829 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:19 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:07:19.829 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:19 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:07:19.829 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:19 smithi099 ceph-mon[137093]: from='client.25136 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T14:07:19.829 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:19 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:07:19.829 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:19 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:07:19.830 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:19 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:07:19.830 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:19 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:07:19.830 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:19 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:07:19.830 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:19 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:07:19.830 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:19 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:07:19.830 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:19 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:07:19.830 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:19 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:07:19.830 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:19 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:07:19.830 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:19 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:07:19.830 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:19 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:07:19.830 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:19 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:07:19.830 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:19 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:07:19.830 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:19 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:07:19.831 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:19 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:07:19.831 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:19 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:07:19.831 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:19 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:07:19.831 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:19 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:07:19.831 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:19 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:07:19.831 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:19 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:07:19.831 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:19 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:07:19.831 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:19 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:07:19.831 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:19 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:07:19.831 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:19 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:07:19.831 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:19 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:07:19.831 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:19 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:07:19.831 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:19 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:07:19.832 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:19 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:07:19.832 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:19 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:07:19.832 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:19 smithi099 ceph-mon[143401]: from='client.25136 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T14:07:19.832 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:19 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:07:19.832 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:19 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:07:19.832 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:19 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:07:19.832 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:19 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:07:19.832 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:19 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:07:19.832 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:19 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:07:19.832 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:19 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:07:19.832 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:19 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:07:19.832 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:19 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:07:19.832 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:19 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:07:19.832 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:19 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:07:19.832 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:19 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:07:19.833 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:19 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:07:19.833 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:19 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:07:19.833 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:19 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:07:19.833 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:19 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:07:19.833 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:19 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:07:19.833 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:19 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:07:19.833 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:19 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:07:19.833 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:19 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:07:19.833 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:19 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:07:19.833 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:19 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:07:19.833 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:19 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:07:19.833 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:19 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:07:19.833 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:19 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:07:19.833 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:19 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:07:19.833 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:19 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:07:19.833 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:19 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:07:19.834 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:19 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:07:19.834 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:19 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:07:19.834 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:19 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:07:19.834 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:19 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:07:19.834 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:19 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:07:19.834 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:19 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:07:19.834 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:19 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:07:19.834 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:19 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:07:19.835 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:19 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:07:19.835 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:19 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:07:19.835 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:19 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:07:19.835 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:19 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:07:19.835 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:19 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:07:19.835 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:19 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]: dispatch 2024-03-30T14:07:19.835 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:19 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]: dispatch 2024-03-30T14:07:19.835 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:19 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]': finished 2024-03-30T14:07:19.835 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:19 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-03-30T14:07:19.835 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:19 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-03-30T14:07:19.835 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:19 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon"}]': finished 2024-03-30T14:07:19.835 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:19 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]: dispatch 2024-03-30T14:07:19.835 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:19 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]: dispatch 2024-03-30T14:07:19.835 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:19 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]': finished 2024-03-30T14:07:19.835 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:19 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd"}]: dispatch 2024-03-30T14:07:19.836 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:19 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd"}]: dispatch 2024-03-30T14:07:19.836 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:19 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds"}]: dispatch 2024-03-30T14:07:19.836 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:19 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds"}]: dispatch 2024-03-30T14:07:19.836 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:19 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]: dispatch 2024-03-30T14:07:19.837 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:19 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:07:19.837 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:19 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:07:19.837 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:19 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:07:19.837 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:19 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:07:19.837 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:19 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:07:19.837 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:19 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:07:19.837 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:19 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:07:19.837 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:19 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:07:19.837 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:19 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:07:19.837 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:19 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:07:19.837 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:19 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:07:19.838 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:19 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:07:19.838 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:19 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:07:19.838 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:19 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]: dispatch 2024-03-30T14:07:19.838 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:19 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]: dispatch 2024-03-30T14:07:19.838 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:19 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]': finished 2024-03-30T14:07:19.838 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:19 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-03-30T14:07:19.838 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:19 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-03-30T14:07:19.838 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:19 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon"}]': finished 2024-03-30T14:07:19.838 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:19 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]: dispatch 2024-03-30T14:07:19.838 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:19 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]: dispatch 2024-03-30T14:07:19.838 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:19 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]': finished 2024-03-30T14:07:19.838 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:19 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd"}]: dispatch 2024-03-30T14:07:19.838 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:19 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd"}]: dispatch 2024-03-30T14:07:19.838 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:19 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds"}]: dispatch 2024-03-30T14:07:19.839 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:19 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds"}]: dispatch 2024-03-30T14:07:19.839 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:19 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]: dispatch 2024-03-30T14:07:19.839 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:19 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]: dispatch 2024-03-30T14:07:19.839 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:19 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]: dispatch 2024-03-30T14:07:19.839 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:19 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]: dispatch 2024-03-30T14:07:19.839 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:19 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-03-30T14:07:19.839 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:19 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-03-30T14:07:19.839 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:19 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"}]: dispatch 2024-03-30T14:07:19.839 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:19 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"}]: dispatch 2024-03-30T14:07:19.839 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:19 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]: dispatch 2024-03-30T14:07:19.839 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:19 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]: dispatch 2024-03-30T14:07:19.840 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:19 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]: dispatch 2024-03-30T14:07:19.840 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:19 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]: dispatch 2024-03-30T14:07:19.840 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:19 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]: dispatch 2024-03-30T14:07:19.840 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:19 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]: dispatch 2024-03-30T14:07:19.840 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:19 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]': finished 2024-03-30T14:07:19.840 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:19 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-03-30T14:07:19.840 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:19 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-03-30T14:07:19.840 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:19 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-03-30T14:07:19.840 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:19 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-03-30T14:07:19.840 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:19 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-03-30T14:07:19.840 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:19 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-03-30T14:07:19.840 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:19 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-03-30T14:07:19.840 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:19 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-03-30T14:07:19.840 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:19 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-03-30T14:07:19.841 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:19 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-03-30T14:07:19.841 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:19 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]: dispatch 2024-03-30T14:07:19.841 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:19 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]: dispatch 2024-03-30T14:07:19.841 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:19 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]: dispatch 2024-03-30T14:07:19.841 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:19 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-03-30T14:07:19.841 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:19 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-03-30T14:07:19.842 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:19 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"}]: dispatch 2024-03-30T14:07:19.842 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:19 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"}]: dispatch 2024-03-30T14:07:19.842 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:19 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]: dispatch 2024-03-30T14:07:19.842 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:19 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]: dispatch 2024-03-30T14:07:19.842 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:19 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]: dispatch 2024-03-30T14:07:19.842 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:19 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]: dispatch 2024-03-30T14:07:19.842 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:19 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]: dispatch 2024-03-30T14:07:19.843 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:19 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]: dispatch 2024-03-30T14:07:19.843 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:19 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]': finished 2024-03-30T14:07:19.843 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:19 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-03-30T14:07:19.843 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:19 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-03-30T14:07:19.843 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:19 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-03-30T14:07:19.843 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:19 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-03-30T14:07:19.843 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:19 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-03-30T14:07:19.843 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:19 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-03-30T14:07:19.843 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:19 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-03-30T14:07:19.843 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:19 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-03-30T14:07:19.843 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:19 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-03-30T14:07:19.843 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:19 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-03-30T14:07:19.843 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:19 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-03-30T14:07:19.844 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:19 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-03-30T14:07:19.844 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:19 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]: dispatch 2024-03-30T14:07:19.844 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:19 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' cmd=[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]: dispatch 2024-03-30T14:07:19.844 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:19 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' cmd='[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]': finished 2024-03-30T14:07:19.844 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:19 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:07:19.844 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:19 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:07:19.844 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:19 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:07:19.844 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:19 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:07:19.844 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:19 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:07:19.844 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:19 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:07:19.844 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:19 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-03-30T14:07:19.845 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:19 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-03-30T14:07:19.845 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:19 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]: dispatch 2024-03-30T14:07:19.845 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:19 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' cmd=[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]: dispatch 2024-03-30T14:07:19.845 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:19 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' cmd='[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]': finished 2024-03-30T14:07:19.845 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:19 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:07:19.845 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:19 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:07:19.845 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:19 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:07:19.845 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:19 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:07:19.845 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:19 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:07:19.845 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:19 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:07:19.899 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:19 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:07:19.899 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:19 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:07:19.899 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:19 smithi181 ceph-mon[115276]: from='client.25136 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T14:07:19.900 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:19 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:07:19.900 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:19 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:07:19.900 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:19 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:07:19.900 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:19 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:07:19.900 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:19 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:07:19.900 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:19 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:07:19.900 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:19 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:07:19.900 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:19 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:07:19.900 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:19 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:07:19.900 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:19 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:07:19.900 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:19 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:07:19.900 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:19 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:07:19.900 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:19 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:07:19.900 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:19 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:07:19.901 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:19 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:07:19.901 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:19 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:07:19.901 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:19 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:07:19.901 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:19 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:07:19.901 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:19 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:07:19.901 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:19 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:07:19.901 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:19 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:07:19.901 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:19 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:07:19.901 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:19 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:07:19.901 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:19 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:07:19.901 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:19 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:07:19.901 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:19 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:07:19.901 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:19 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:07:19.901 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:19 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:07:19.902 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:19 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:07:19.902 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:19 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:07:19.902 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:19 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:07:19.902 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:19 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:07:19.902 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:19 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:07:19.902 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:19 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:07:19.902 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:19 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:07:19.902 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:19 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:07:19.903 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:19 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:07:19.903 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:19 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:07:19.903 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:19 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:07:19.903 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:19 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:07:19.903 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:19 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:07:19.903 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:19 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]: dispatch 2024-03-30T14:07:19.903 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:19 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]: dispatch 2024-03-30T14:07:19.903 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:19 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]': finished 2024-03-30T14:07:19.903 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:19 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-03-30T14:07:19.903 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:19 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-03-30T14:07:19.903 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:19 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon"}]': finished 2024-03-30T14:07:19.903 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:19 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]: dispatch 2024-03-30T14:07:19.903 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:19 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]: dispatch 2024-03-30T14:07:19.903 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:19 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]': finished 2024-03-30T14:07:19.903 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:19 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd"}]: dispatch 2024-03-30T14:07:19.904 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:19 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd"}]: dispatch 2024-03-30T14:07:19.904 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:19 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds"}]: dispatch 2024-03-30T14:07:19.904 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:19 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds"}]: dispatch 2024-03-30T14:07:19.904 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:19 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]: dispatch 2024-03-30T14:07:19.904 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:19 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]: dispatch 2024-03-30T14:07:19.904 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:19 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]: dispatch 2024-03-30T14:07:19.904 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:19 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]: dispatch 2024-03-30T14:07:19.904 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:19 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-03-30T14:07:19.904 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:19 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-03-30T14:07:19.904 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:19 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"}]: dispatch 2024-03-30T14:07:19.904 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:19 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"}]: dispatch 2024-03-30T14:07:19.904 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:19 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]: dispatch 2024-03-30T14:07:19.904 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:19 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]: dispatch 2024-03-30T14:07:19.904 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:19 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]: dispatch 2024-03-30T14:07:19.904 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:19 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]: dispatch 2024-03-30T14:07:19.904 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:19 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]: dispatch 2024-03-30T14:07:19.905 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:19 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]: dispatch 2024-03-30T14:07:19.905 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:19 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]': finished 2024-03-30T14:07:19.905 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:19 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-03-30T14:07:19.905 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:19 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-03-30T14:07:19.905 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:19 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-03-30T14:07:19.905 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:19 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-03-30T14:07:19.905 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:19 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-03-30T14:07:19.905 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:19 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-03-30T14:07:19.905 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:19 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-03-30T14:07:19.905 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:19 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-03-30T14:07:19.905 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:19 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-03-30T14:07:19.905 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:19 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-03-30T14:07:19.905 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:19 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-03-30T14:07:19.905 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:19 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-03-30T14:07:19.905 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:19 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]: dispatch 2024-03-30T14:07:19.906 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:19 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' cmd=[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]: dispatch 2024-03-30T14:07:19.906 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:19 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' cmd='[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]': finished 2024-03-30T14:07:19.906 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:19 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:07:19.906 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:19 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:07:19.906 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:19 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:07:19.906 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:19 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:07:19.906 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:19 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:07:19.906 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:19 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:07:20.997 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:20 smithi181 ceph-mon[115276]: pgmap v129: 161 pgs: 161 active+clean; 585 KiB data, 157 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T14:07:20.997 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:20 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:07:20.997 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:20 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:07:20.998 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:20 smithi181 ceph-mon[115276]: Upgrade: Setting container_image for all nvmeof 2024-03-30T14:07:20.998 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:20 smithi181 ceph-mon[115276]: Upgrade: Finalizing container_image settings 2024-03-30T14:07:20.998 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:20 smithi181 ceph-mon[115276]: Upgrade: Complete! 2024-03-30T14:07:21.078 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:20 smithi099 ceph-mon[143401]: pgmap v129: 161 pgs: 161 active+clean; 585 KiB data, 157 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T14:07:21.078 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:20 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:07:21.078 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:20 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:07:21.078 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:20 smithi099 ceph-mon[143401]: Upgrade: Setting container_image for all nvmeof 2024-03-30T14:07:21.079 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:20 smithi099 ceph-mon[143401]: Upgrade: Finalizing container_image settings 2024-03-30T14:07:21.079 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:20 smithi099 ceph-mon[143401]: Upgrade: Complete! 2024-03-30T14:07:21.079 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:20 smithi099 ceph-mon[137093]: pgmap v129: 161 pgs: 161 active+clean; 585 KiB data, 157 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T14:07:21.079 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:20 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:07:21.079 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:20 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:07:21.079 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:20 smithi099 ceph-mon[137093]: Upgrade: Setting container_image for all nvmeof 2024-03-30T14:07:21.079 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:20 smithi099 ceph-mon[137093]: Upgrade: Finalizing container_image settings 2024-03-30T14:07:21.079 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:20 smithi099 ceph-mon[137093]: Upgrade: Complete! 2024-03-30T14:07:22.888 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:22 smithi099 ceph-mon[137093]: pgmap v130: 161 pgs: 161 active+clean; 585 KiB data, 157 MiB used, 715 GiB / 715 GiB avail; 1.0 KiB/s rd, 1 op/s 2024-03-30T14:07:22.888 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:22 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:07:22.888 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:22 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T14:07:22.888 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:22 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:07:22.888 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:22 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:07:22.888 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:22 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:07:22.888 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:22 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:07:22.889 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:22 smithi099 ceph-mon[143401]: pgmap v130: 161 pgs: 161 active+clean; 585 KiB data, 157 MiB used, 715 GiB / 715 GiB avail; 1.0 KiB/s rd, 1 op/s 2024-03-30T14:07:22.889 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:22 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:07:22.889 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:22 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T14:07:22.889 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:22 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:07:22.889 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:22 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:07:22.889 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:22 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:07:22.889 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:22 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:07:22.997 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:22 smithi181 ceph-mon[115276]: pgmap v130: 161 pgs: 161 active+clean; 585 KiB data, 157 MiB used, 715 GiB / 715 GiB avail; 1.0 KiB/s rd, 1 op/s 2024-03-30T14:07:22.998 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:22 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:07:22.998 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:22 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T14:07:22.998 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:22 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:07:22.998 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:22 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:07:22.998 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:22 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:07:22.998 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:22 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:07:24.247 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:23 smithi181 ceph-mon[115276]: pgmap v131: 161 pgs: 161 active+clean; 585 KiB data, 157 MiB used, 715 GiB / 715 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-03-30T14:07:24.248 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:23 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:07:24.248 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:23 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:07:24.248 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:23 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:07:24.328 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:23 smithi099 ceph-mon[137093]: pgmap v131: 161 pgs: 161 active+clean; 585 KiB data, 157 MiB used, 715 GiB / 715 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-03-30T14:07:24.328 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:23 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:07:24.329 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:23 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:07:24.329 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:23 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:07:24.329 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:23 smithi099 ceph-mon[143401]: pgmap v131: 161 pgs: 161 active+clean; 585 KiB data, 157 MiB used, 715 GiB / 715 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-03-30T14:07:24.329 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:23 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:07:24.329 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:23 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:07:24.329 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:23 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:07:25.078 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 14:07:24 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[71049]: ::ffff:172.21.15.181 - - [30/Mar/2024:14:07:24] "GET /metrics HTTP/1.1" 200 38256 "" "Prometheus/2.43.0" 2024-03-30T14:07:26.229 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:25 smithi181 ceph-mon[115276]: pgmap v132: 161 pgs: 161 active+clean; 585 KiB data, 157 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T14:07:26.328 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:25 smithi099 ceph-mon[137093]: pgmap v132: 161 pgs: 161 active+clean; 585 KiB data, 157 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T14:07:26.329 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:25 smithi099 ceph-mon[143401]: pgmap v132: 161 pgs: 161 active+clean; 585 KiB data, 157 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T14:07:28.247 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:27 smithi181 ceph-mon[115276]: pgmap v133: 161 pgs: 161 active+clean; 585 KiB data, 157 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T14:07:28.328 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:27 smithi099 ceph-mon[137093]: pgmap v133: 161 pgs: 161 active+clean; 585 KiB data, 157 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T14:07:28.329 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:27 smithi099 ceph-mon[143401]: pgmap v133: 161 pgs: 161 active+clean; 585 KiB data, 157 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T14:07:29.669 DEBUG:teuthology.orchestra.run.smithi099:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 98ebaeb8-ee99-11ee-b647-cb9ed24678a4 -e sha1=4e50bbcdd1630c7760b708f3a5b4d38a121e66cb -- bash -c 'ceph orch ps' 2024-03-30T14:07:29.747 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:29 smithi181 ceph-mon[115276]: from='client.25136 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T14:07:29.747 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:29 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:07:29.748 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:29 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:07:29.748 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:29 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:07:29.828 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:29 smithi099 ceph-mon[143401]: from='client.25136 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T14:07:29.828 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:29 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:07:29.829 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:29 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:07:29.829 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:29 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:07:29.829 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:29 smithi099 ceph-mon[137093]: from='client.25136 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T14:07:29.829 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:29 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:07:29.829 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:29 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:07:29.829 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:29 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:07:30.578 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:30 smithi099 ceph-mon[137093]: pgmap v134: 161 pgs: 161 active+clean; 585 KiB data, 157 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T14:07:30.579 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:30 smithi099 ceph-mon[137093]: from='client.64330 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T14:07:30.579 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:30 smithi099 ceph-mon[143401]: pgmap v134: 161 pgs: 161 active+clean; 585 KiB data, 157 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T14:07:30.579 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:30 smithi099 ceph-mon[143401]: from='client.64330 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T14:07:30.997 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:30 smithi181 ceph-mon[115276]: pgmap v134: 161 pgs: 161 active+clean; 585 KiB data, 157 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T14:07:30.998 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:30 smithi181 ceph-mon[115276]: from='client.64330 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T14:07:31.655 INFO:teuthology.orchestra.run.smithi099.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-03-30T14:07:31.659 INFO:teuthology.orchestra.run.smithi099.stdout:agent.smithi099 smithi099 running 8s ago 35m - - 2024-03-30T14:07:31.659 INFO:teuthology.orchestra.run.smithi099.stdout:agent.smithi181 smithi181 running 3s ago 35m - - 2024-03-30T14:07:31.659 INFO:teuthology.orchestra.run.smithi099.stdout:alertmanager.a smithi099 *:9093,9094 running (6m) 8s ago 30m 26.9M - 0.25.0 c8568f914cd2 08735152b67d 2024-03-30T14:07:31.659 INFO:teuthology.orchestra.run.smithi099.stdout:grafana.a smithi181 *:3000 running (5m) 3s ago 29m 77.4M - 9.4.12 2bacad6d85d8 d599aa7730d6 2024-03-30T14:07:31.659 INFO:teuthology.orchestra.run.smithi099.stdout:iscsi.foo.smithi099.qyjuvr smithi099 running (8m) 8s ago 29m 59.5M - 3.5 e1d6a67b021e 2f859af6bc2a 2024-03-30T14:07:31.659 INFO:teuthology.orchestra.run.smithi099.stdout:mgr.x smithi181 *:8443,9283,8765 running (8m) 3s ago 35m 450M - 19.0.0-1967-g4e50bbcd b0c4478f1d83 f269106f7913 2024-03-30T14:07:31.659 INFO:teuthology.orchestra.run.smithi099.stdout:mgr.y smithi099 *:8443,9283,8765 running (18m) 8s ago 36m 522M - 19.0.0-1967-g4e50bbcd b0c4478f1d83 0d464b8c1d18 2024-03-30T14:07:31.659 INFO:teuthology.orchestra.run.smithi099.stdout:mon.a smithi099 running (3m) 8s ago 36m 56.2M 2048M 19.0.0-1967-g4e50bbcd b0c4478f1d83 f19388464dfd 2024-03-30T14:07:31.660 INFO:teuthology.orchestra.run.smithi099.stdout:mon.b smithi181 running (5m) 3s ago 35m 52.9M 2048M 19.0.0-1967-g4e50bbcd b0c4478f1d83 0468ed087cdd 2024-03-30T14:07:31.660 INFO:teuthology.orchestra.run.smithi099.stdout:mon.c smithi099 running (3m) 8s ago 35m 44.5M 2048M 19.0.0-1967-g4e50bbcd b0c4478f1d83 731056a2fea6 2024-03-30T14:07:31.660 INFO:teuthology.orchestra.run.smithi099.stdout:node-exporter.a smithi099 *:9100 running (7m) 8s ago 31m 16.2M - 1.5.0 0da6a335fe13 4a3f1f6e7068 2024-03-30T14:07:31.660 INFO:teuthology.orchestra.run.smithi099.stdout:node-exporter.b smithi181 *:9100 running (7m) 3s ago 31m 15.4M - 1.5.0 0da6a335fe13 acea317b5f5d 2024-03-30T14:07:31.660 INFO:teuthology.orchestra.run.smithi099.stdout:osd.0 smithi099 running (116s) 8s ago 34m 51.9M 4096M 19.0.0-1967-g4e50bbcd b0c4478f1d83 d97d48cb3314 2024-03-30T14:07:31.660 INFO:teuthology.orchestra.run.smithi099.stdout:osd.1 smithi099 running (87s) 8s ago 34m 54.4M 4096M 19.0.0-1967-g4e50bbcd b0c4478f1d83 a843295ce83b 2024-03-30T14:07:31.660 INFO:teuthology.orchestra.run.smithi099.stdout:osd.2 smithi099 running (26s) 8s ago 33m 43.3M 4096M 19.0.0-1967-g4e50bbcd b0c4478f1d83 18304adfb0d0 2024-03-30T14:07:31.660 INFO:teuthology.orchestra.run.smithi099.stdout:osd.3 smithi099 running (33m) 8s ago 33m 58.7M 4096M 17.2.0 e1d6a67b021e 718812bcf065 2024-03-30T14:07:31.660 INFO:teuthology.orchestra.run.smithi099.stdout:osd.4 smithi181 running (33m) 3s ago 33m 57.8M 4096M 17.2.0 e1d6a67b021e 5e205434e973 2024-03-30T14:07:31.660 INFO:teuthology.orchestra.run.smithi099.stdout:osd.5 smithi181 running (32m) 3s ago 32m 55.1M 4096M 17.2.0 e1d6a67b021e e330c920f152 2024-03-30T14:07:31.660 INFO:teuthology.orchestra.run.smithi099.stdout:osd.6 smithi181 running (32m) 3s ago 32m 55.2M 4096M 17.2.0 e1d6a67b021e 81d889ea213d 2024-03-30T14:07:31.660 INFO:teuthology.orchestra.run.smithi099.stdout:osd.7 smithi181 running (31m) 3s ago 31m 57.2M 4096M 17.2.0 e1d6a67b021e c08b1839dd7e 2024-03-30T14:07:31.660 INFO:teuthology.orchestra.run.smithi099.stdout:prometheus.a smithi181 *:9095 running (6m) 3s ago 31m 70.3M - 2.43.0 a07b618ecd1d 004088bdf70e 2024-03-30T14:07:31.661 INFO:teuthology.orchestra.run.smithi099.stdout:rgw.foo.smithi099.fxjbmp smithi099 *:8000 running (29m) 8s ago 29m 78.3M - 17.2.0 e1d6a67b021e 400b28b3f650 2024-03-30T14:07:31.661 INFO:teuthology.orchestra.run.smithi099.stdout:rgw.foo.smithi181.wfqwti smithi181 *:8000 running (29m) 3s ago 29m 77.9M - 17.2.0 e1d6a67b021e 97e1b130f9d4 2024-03-30T14:07:32.345 DEBUG:teuthology.orchestra.run.smithi099:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 98ebaeb8-ee99-11ee-b647-cb9ed24678a4 -e sha1=4e50bbcdd1630c7760b708f3a5b4d38a121e66cb -- bash -c 'ceph versions | jq -e '"'"'.osd | length == 2'"'"'' 2024-03-30T14:07:32.792 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:32 smithi099 ceph-mon[137093]: pgmap v135: 161 pgs: 161 active+clean; 585 KiB data, 157 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T14:07:32.792 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:32 smithi099 ceph-mon[137093]: from='client.54336 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T14:07:32.792 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:32 smithi099 ceph-mon[143401]: pgmap v135: 161 pgs: 161 active+clean; 585 KiB data, 157 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T14:07:32.793 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:32 smithi099 ceph-mon[143401]: from='client.54336 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T14:07:32.997 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:32 smithi181 ceph-mon[115276]: pgmap v135: 161 pgs: 161 active+clean; 585 KiB data, 157 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T14:07:32.998 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:32 smithi181 ceph-mon[115276]: from='client.54336 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T14:07:34.537 INFO:teuthology.orchestra.run.smithi099.stdout:true 2024-03-30T14:07:34.791 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:34 smithi099 ceph-mon[137093]: pgmap v136: 161 pgs: 161 active+clean; 585 KiB data, 157 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T14:07:34.791 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:34 smithi099 ceph-mon[143401]: pgmap v136: 161 pgs: 161 active+clean; 585 KiB data, 157 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T14:07:34.997 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:34 smithi181 ceph-mon[115276]: pgmap v136: 161 pgs: 161 active+clean; 585 KiB data, 157 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T14:07:35.060 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 14:07:34 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[71049]: ::ffff:172.21.15.181 - - [30/Mar/2024:14:07:34] "GET /metrics HTTP/1.1" 200 38256 "" "Prometheus/2.43.0" 2024-03-30T14:07:35.084 DEBUG:teuthology.orchestra.run.smithi099:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 98ebaeb8-ee99-11ee-b647-cb9ed24678a4 -e sha1=4e50bbcdd1630c7760b708f3a5b4d38a121e66cb -- bash -c 'ceph orch upgrade check quay.ceph.io/ceph-ci/ceph:$sha1 | jq -e '"'"'.up_to_date | length == 8'"'"'' 2024-03-30T14:07:35.680 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:35 smithi099 ceph-mon[137093]: from='client.? 172.21.15.99:0/1604641577' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:07:35.680 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:35 smithi099 ceph-mon[143401]: from='client.? 172.21.15.99:0/1604641577' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:07:35.997 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:35 smithi181 ceph-mon[115276]: from='client.? 172.21.15.99:0/1604641577' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:07:36.717 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:36 smithi099 ceph-mon[137093]: pgmap v137: 161 pgs: 161 active+clean; 585 KiB data, 157 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T14:07:36.717 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:36 smithi099 ceph-mon[143401]: pgmap v137: 161 pgs: 161 active+clean; 585 KiB data, 157 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T14:07:36.997 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:36 smithi181 ceph-mon[115276]: pgmap v137: 161 pgs: 161 active+clean; 585 KiB data, 157 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T14:07:37.828 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:37 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T14:07:37.829 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:37 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T14:07:37.997 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:37 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T14:07:38.578 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:38 smithi099 ceph-mon[143401]: pgmap v138: 161 pgs: 161 active+clean; 585 KiB data, 157 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T14:07:38.579 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:38 smithi099 ceph-mon[143401]: from='client.64348 -' entity='client.admin' cmd=[{"prefix": "orch upgrade check", "image": "quay.ceph.io/ceph-ci/ceph:4e50bbcdd1630c7760b708f3a5b4d38a121e66cb", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T14:07:38.579 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:38 smithi099 ceph-mon[137093]: pgmap v138: 161 pgs: 161 active+clean; 585 KiB data, 157 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T14:07:38.579 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:38 smithi099 ceph-mon[137093]: from='client.64348 -' entity='client.admin' cmd=[{"prefix": "orch upgrade check", "image": "quay.ceph.io/ceph-ci/ceph:4e50bbcdd1630c7760b708f3a5b4d38a121e66cb", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T14:07:38.706 INFO:teuthology.orchestra.run.smithi099.stdout:true 2024-03-30T14:07:38.747 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:38 smithi181 ceph-mon[115276]: pgmap v138: 161 pgs: 161 active+clean; 585 KiB data, 157 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T14:07:38.747 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:38 smithi181 ceph-mon[115276]: from='client.64348 -' entity='client.admin' cmd=[{"prefix": "orch upgrade check", "image": "quay.ceph.io/ceph-ci/ceph:4e50bbcdd1630c7760b708f3a5b4d38a121e66cb", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T14:07:39.357 DEBUG:teuthology.orchestra.run.smithi099:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 98ebaeb8-ee99-11ee-b647-cb9ed24678a4 -e sha1=4e50bbcdd1630c7760b708f3a5b4d38a121e66cb -- bash -c 'ceph orch upgrade status' 2024-03-30T14:07:39.664 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:39 smithi099 ceph-mon[137093]: from='client.25136 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T14:07:39.664 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:39 smithi099 ceph-mon[143401]: from='client.25136 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T14:07:39.997 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:39 smithi181 ceph-mon[115276]: from='client.25136 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T14:07:40.700 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:40 smithi099 ceph-mon[137093]: pgmap v139: 161 pgs: 161 active+clean; 585 KiB data, 157 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T14:07:40.700 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:40 smithi099 ceph-mon[143401]: pgmap v139: 161 pgs: 161 active+clean; 585 KiB data, 157 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T14:07:40.997 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:40 smithi181 ceph-mon[115276]: pgmap v139: 161 pgs: 161 active+clean; 585 KiB data, 157 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T14:07:42.095 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-03-30T14:07:42.095 INFO:teuthology.orchestra.run.smithi099.stdout: "target_image": null, 2024-03-30T14:07:42.096 INFO:teuthology.orchestra.run.smithi099.stdout: "in_progress": false, 2024-03-30T14:07:42.096 INFO:teuthology.orchestra.run.smithi099.stdout: "which": "", 2024-03-30T14:07:42.096 INFO:teuthology.orchestra.run.smithi099.stdout: "services_complete": [], 2024-03-30T14:07:42.096 INFO:teuthology.orchestra.run.smithi099.stdout: "progress": null, 2024-03-30T14:07:42.096 INFO:teuthology.orchestra.run.smithi099.stdout: "message": "", 2024-03-30T14:07:42.096 INFO:teuthology.orchestra.run.smithi099.stdout: "is_paused": false 2024-03-30T14:07:42.096 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-03-30T14:07:42.828 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:42 smithi099 ceph-mon[137093]: pgmap v140: 161 pgs: 161 active+clean; 585 KiB data, 157 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T14:07:42.829 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:42 smithi099 ceph-mon[143401]: pgmap v140: 161 pgs: 161 active+clean; 585 KiB data, 157 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T14:07:42.997 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:42 smithi181 ceph-mon[115276]: pgmap v140: 161 pgs: 161 active+clean; 585 KiB data, 157 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T14:07:43.408 DEBUG:teuthology.orchestra.run.smithi099:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 98ebaeb8-ee99-11ee-b647-cb9ed24678a4 -e sha1=4e50bbcdd1630c7760b708f3a5b4d38a121e66cb -- bash -c 'ceph health detail' 2024-03-30T14:07:43.828 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:43 smithi099 ceph-mon[143401]: from='client.54354 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T14:07:43.828 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:43 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:07:43.828 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:43 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:07:43.829 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:43 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:07:43.829 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:43 smithi099 ceph-mon[137093]: from='client.54354 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T14:07:43.829 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:43 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:07:43.829 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:43 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:07:43.829 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:43 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:07:43.997 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:43 smithi181 ceph-mon[115276]: from='client.54354 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T14:07:43.997 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:43 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:07:43.998 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:43 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:07:43.998 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:43 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:07:44.828 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:44 smithi099 ceph-mon[137093]: pgmap v141: 161 pgs: 161 active+clean; 585 KiB data, 157 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T14:07:44.829 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:44 smithi099 ceph-mon[143401]: pgmap v141: 161 pgs: 161 active+clean; 585 KiB data, 157 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T14:07:44.829 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 14:07:44 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[71049]: ::ffff:172.21.15.181 - - [30/Mar/2024:14:07:44] "GET /metrics HTTP/1.1" 200 38254 "" "Prometheus/2.43.0" 2024-03-30T14:07:44.997 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:44 smithi181 ceph-mon[115276]: pgmap v141: 161 pgs: 161 active+clean; 585 KiB data, 157 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T14:07:46.240 INFO:teuthology.orchestra.run.smithi099.stdout:HEALTH_OK 2024-03-30T14:07:46.747 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:46 smithi181 ceph-mon[115276]: pgmap v142: 161 pgs: 161 active+clean; 585 KiB data, 157 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T14:07:46.747 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:46 smithi181 ceph-mon[115276]: from='client.? 172.21.15.99:0/726035758' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-03-30T14:07:46.829 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:46 smithi099 ceph-mon[137093]: pgmap v142: 161 pgs: 161 active+clean; 585 KiB data, 157 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T14:07:46.829 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:46 smithi099 ceph-mon[137093]: from='client.? 172.21.15.99:0/726035758' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-03-30T14:07:46.829 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:46 smithi099 ceph-mon[143401]: pgmap v142: 161 pgs: 161 active+clean; 585 KiB data, 157 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T14:07:46.829 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:46 smithi099 ceph-mon[143401]: from='client.? 172.21.15.99:0/726035758' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-03-30T14:07:46.919 DEBUG:teuthology.orchestra.run.smithi099:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 98ebaeb8-ee99-11ee-b647-cb9ed24678a4 -e sha1=4e50bbcdd1630c7760b708f3a5b4d38a121e66cb -- bash -c 'ceph orch upgrade start --image quay.ceph.io/ceph-ci/ceph:$sha1 --daemon-types crash,osd' 2024-03-30T14:07:48.638 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:48 smithi181 ceph-mon[115276]: pgmap v143: 161 pgs: 161 active+clean; 585 KiB data, 157 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T14:07:48.828 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:48 smithi099 ceph-mon[137093]: pgmap v143: 161 pgs: 161 active+clean; 585 KiB data, 157 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T14:07:48.829 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:48 smithi099 ceph-mon[143401]: pgmap v143: 161 pgs: 161 active+clean; 585 KiB data, 157 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T14:07:49.844 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:49 smithi099 ceph-mon[137093]: from='client.25136 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T14:07:49.844 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:49 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:07:49.844 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:49 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:07:49.844 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:49 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:07:49.845 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:49 smithi099 ceph-mon[143401]: from='client.25136 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T14:07:49.845 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:49 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:07:49.845 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:49 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:07:49.845 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:49 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:07:49.997 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:49 smithi181 ceph-mon[115276]: from='client.25136 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T14:07:49.997 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:49 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:07:49.997 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:49 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:07:49.997 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:49 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:07:50.747 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:50 smithi181 ceph-mon[115276]: pgmap v144: 161 pgs: 161 active+clean; 585 KiB data, 157 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T14:07:50.748 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:50 smithi181 ceph-mon[115276]: from='client.54366 -' entity='client.admin' cmd=[{"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:4e50bbcdd1630c7760b708f3a5b4d38a121e66cb", "daemon_types": "crash,osd", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T14:07:50.845 INFO:teuthology.orchestra.run.smithi099.stdout:Initiating upgrade to quay.ceph.io/ceph-ci/ceph:4e50bbcdd1630c7760b708f3a5b4d38a121e66cb 2024-03-30T14:07:50.858 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:50 smithi099 ceph-mon[137093]: pgmap v144: 161 pgs: 161 active+clean; 585 KiB data, 157 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T14:07:50.858 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:50 smithi099 ceph-mon[137093]: from='client.54366 -' entity='client.admin' cmd=[{"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:4e50bbcdd1630c7760b708f3a5b4d38a121e66cb", "daemon_types": "crash,osd", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T14:07:50.858 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:50 smithi099 ceph-mon[143401]: pgmap v144: 161 pgs: 161 active+clean; 585 KiB data, 157 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T14:07:50.858 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:50 smithi099 ceph-mon[143401]: from='client.54366 -' entity='client.admin' cmd=[{"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:4e50bbcdd1630c7760b708f3a5b4d38a121e66cb", "daemon_types": "crash,osd", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T14:07:51.537 DEBUG:teuthology.orchestra.run.smithi099:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 98ebaeb8-ee99-11ee-b647-cb9ed24678a4 -e sha1=4e50bbcdd1630c7760b708f3a5b4d38a121e66cb -- bash -c 'while ceph orch upgrade status | jq '"'"'.in_progress'"'"' | grep true && ! ceph orch upgrade status | jq '"'"'.message'"'"' | grep Error ; do ceph orch ps ; ceph versions ; ceph orch upgrade status ; sleep 30 ; done' 2024-03-30T14:07:52.078 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:51 smithi099 ceph-mon[137093]: pgmap v145: 161 pgs: 161 active+clean; 585 KiB data, 157 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T14:07:52.079 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:51 smithi099 ceph-mon[137093]: Upgrade: Started with target quay.ceph.io/ceph-ci/ceph:4e50bbcdd1630c7760b708f3a5b4d38a121e66cb 2024-03-30T14:07:52.079 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:51 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:07:52.079 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:51 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:07:52.079 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:51 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:07:52.079 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:51 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:07:52.079 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:51 smithi099 ceph-mon[137093]: Upgrade: First pull of quay.ceph.io/ceph-ci/ceph:4e50bbcdd1630c7760b708f3a5b4d38a121e66cb 2024-03-30T14:07:52.079 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:51 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T14:07:52.079 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:51 smithi099 ceph-mon[143401]: pgmap v145: 161 pgs: 161 active+clean; 585 KiB data, 157 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T14:07:52.079 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:51 smithi099 ceph-mon[143401]: Upgrade: Started with target quay.ceph.io/ceph-ci/ceph:4e50bbcdd1630c7760b708f3a5b4d38a121e66cb 2024-03-30T14:07:52.079 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:51 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:07:52.079 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:51 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:07:52.080 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:51 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:07:52.080 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:51 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:07:52.080 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:51 smithi099 ceph-mon[143401]: Upgrade: First pull of quay.ceph.io/ceph-ci/ceph:4e50bbcdd1630c7760b708f3a5b4d38a121e66cb 2024-03-30T14:07:52.080 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:51 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T14:07:52.247 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:51 smithi181 ceph-mon[115276]: pgmap v145: 161 pgs: 161 active+clean; 585 KiB data, 157 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T14:07:52.248 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:51 smithi181 ceph-mon[115276]: Upgrade: Started with target quay.ceph.io/ceph-ci/ceph:4e50bbcdd1630c7760b708f3a5b4d38a121e66cb 2024-03-30T14:07:52.248 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:51 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:07:52.248 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:51 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:07:52.248 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:51 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:07:52.248 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:51 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:07:52.248 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:51 smithi181 ceph-mon[115276]: Upgrade: First pull of quay.ceph.io/ceph-ci/ceph:4e50bbcdd1630c7760b708f3a5b4d38a121e66cb 2024-03-30T14:07:52.248 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:51 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T14:07:53.940 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:53 smithi099 ceph-mon[143401]: pgmap v146: 161 pgs: 161 active+clean; 585 KiB data, 157 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T14:07:53.940 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:53 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:07:53.940 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:53 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:07:53.941 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:53 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:07:53.941 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:53 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:07:53.941 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:53 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:07:53.941 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:53 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:07:53.941 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:53 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:07:53.941 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:53 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:07:53.941 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:53 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-03-30T14:07:53.941 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:53 smithi099 ceph-mon[137093]: pgmap v146: 161 pgs: 161 active+clean; 585 KiB data, 157 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T14:07:53.941 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:53 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:07:53.941 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:53 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:07:53.941 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:53 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:07:53.942 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:53 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:07:53.942 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:53 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:07:53.942 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:53 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:07:53.942 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:53 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:07:53.942 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:53 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:07:53.942 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:53 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-03-30T14:07:54.205 INFO:teuthology.orchestra.run.smithi099.stdout:true 2024-03-30T14:07:54.247 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:53 smithi181 ceph-mon[115276]: pgmap v146: 161 pgs: 161 active+clean; 585 KiB data, 157 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T14:07:54.247 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:53 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:07:54.247 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:53 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:07:54.247 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:53 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:07:54.248 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:53 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:07:54.248 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:53 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:07:54.248 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:53 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:07:54.248 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:53 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:07:54.248 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:53 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:07:54.248 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:53 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-03-30T14:07:54.884 INFO:teuthology.orchestra.run.smithi099.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-03-30T14:07:54.884 INFO:teuthology.orchestra.run.smithi099.stdout:agent.smithi099 smithi099 running 11s ago 36m - - 2024-03-30T14:07:54.884 INFO:teuthology.orchestra.run.smithi099.stdout:agent.smithi181 smithi181 running 6s ago 36m - - 2024-03-30T14:07:54.884 INFO:teuthology.orchestra.run.smithi099.stdout:alertmanager.a smithi099 *:9093,9094 running (6m) 11s ago 30m 26.9M - 0.25.0 c8568f914cd2 08735152b67d 2024-03-30T14:07:54.885 INFO:teuthology.orchestra.run.smithi099.stdout:grafana.a smithi181 *:3000 running (6m) 6s ago 30m 78.7M - 9.4.12 2bacad6d85d8 d599aa7730d6 2024-03-30T14:07:54.885 INFO:teuthology.orchestra.run.smithi099.stdout:iscsi.foo.smithi099.qyjuvr smithi099 running (9m) 11s ago 29m 59.5M - 3.5 e1d6a67b021e 2f859af6bc2a 2024-03-30T14:07:54.885 INFO:teuthology.orchestra.run.smithi099.stdout:mgr.x smithi181 *:8443,9283,8765 running (8m) 6s ago 35m 450M - 19.0.0-1967-g4e50bbcd b0c4478f1d83 f269106f7913 2024-03-30T14:07:54.885 INFO:teuthology.orchestra.run.smithi099.stdout:mgr.y smithi099 *:8443,9283,8765 running (19m) 11s ago 36m 523M - 19.0.0-1967-g4e50bbcd b0c4478f1d83 0d464b8c1d18 2024-03-30T14:07:54.885 INFO:teuthology.orchestra.run.smithi099.stdout:mon.a smithi099 running (4m) 11s ago 37m 54.3M 2048M 19.0.0-1967-g4e50bbcd b0c4478f1d83 f19388464dfd 2024-03-30T14:07:54.885 INFO:teuthology.orchestra.run.smithi099.stdout:mon.b smithi181 running (5m) 6s ago 35m 53.8M 2048M 19.0.0-1967-g4e50bbcd b0c4478f1d83 0468ed087cdd 2024-03-30T14:07:54.885 INFO:teuthology.orchestra.run.smithi099.stdout:mon.c smithi099 running (3m) 11s ago 35m 45.0M 2048M 19.0.0-1967-g4e50bbcd b0c4478f1d83 731056a2fea6 2024-03-30T14:07:54.885 INFO:teuthology.orchestra.run.smithi099.stdout:node-exporter.a smithi099 *:9100 running (7m) 11s ago 31m 16.2M - 1.5.0 0da6a335fe13 4a3f1f6e7068 2024-03-30T14:07:54.885 INFO:teuthology.orchestra.run.smithi099.stdout:node-exporter.b smithi181 *:9100 running (7m) 6s ago 31m 16.0M - 1.5.0 0da6a335fe13 acea317b5f5d 2024-03-30T14:07:54.885 INFO:teuthology.orchestra.run.smithi099.stdout:osd.0 smithi099 running (2m) 11s ago 35m 52.0M 4096M 19.0.0-1967-g4e50bbcd b0c4478f1d83 d97d48cb3314 2024-03-30T14:07:54.885 INFO:teuthology.orchestra.run.smithi099.stdout:osd.1 smithi099 running (110s) 11s ago 34m 54.5M 4096M 19.0.0-1967-g4e50bbcd b0c4478f1d83 a843295ce83b 2024-03-30T14:07:54.885 INFO:teuthology.orchestra.run.smithi099.stdout:osd.2 smithi099 running (49s) 11s ago 34m 43.7M 4096M 19.0.0-1967-g4e50bbcd b0c4478f1d83 18304adfb0d0 2024-03-30T14:07:54.885 INFO:teuthology.orchestra.run.smithi099.stdout:osd.3 smithi099 running (33m) 11s ago 33m 58.7M 4096M 17.2.0 e1d6a67b021e 718812bcf065 2024-03-30T14:07:54.885 INFO:teuthology.orchestra.run.smithi099.stdout:osd.4 smithi181 running (33m) 6s ago 33m 58.6M 4096M 17.2.0 e1d6a67b021e 5e205434e973 2024-03-30T14:07:54.885 INFO:teuthology.orchestra.run.smithi099.stdout:osd.5 smithi181 running (33m) 6s ago 33m 55.8M 4096M 17.2.0 e1d6a67b021e e330c920f152 2024-03-30T14:07:54.885 INFO:teuthology.orchestra.run.smithi099.stdout:osd.6 smithi181 running (32m) 6s ago 32m 54.6M 4096M 17.2.0 e1d6a67b021e 81d889ea213d 2024-03-30T14:07:54.885 INFO:teuthology.orchestra.run.smithi099.stdout:osd.7 smithi181 running (32m) 6s ago 32m 58.1M 4096M 17.2.0 e1d6a67b021e c08b1839dd7e 2024-03-30T14:07:54.886 INFO:teuthology.orchestra.run.smithi099.stdout:prometheus.a smithi181 *:9095 running (7m) 6s ago 31m 70.4M - 2.43.0 a07b618ecd1d 004088bdf70e 2024-03-30T14:07:54.886 INFO:teuthology.orchestra.run.smithi099.stdout:rgw.foo.smithi099.fxjbmp smithi099 *:8000 running (29m) 11s ago 29m 78.3M - 17.2.0 e1d6a67b021e 400b28b3f650 2024-03-30T14:07:54.886 INFO:teuthology.orchestra.run.smithi099.stdout:rgw.foo.smithi181.wfqwti smithi181 *:8000 running (29m) 6s ago 29m 78.0M - 17.2.0 e1d6a67b021e 97e1b130f9d4 2024-03-30T14:07:55.078 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 14:07:54 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[71049]: ::ffff:172.21.15.181 - - [30/Mar/2024:14:07:54] "GET /metrics HTTP/1.1" 200 38253 "" "Prometheus/2.43.0" 2024-03-30T14:07:55.078 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:54 smithi099 ceph-mon[137093]: Upgrade: Target is version 19.0.0-1967-g4e50bbcd (squid) 2024-03-30T14:07:55.079 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:54 smithi099 ceph-mon[137093]: Upgrade: Target container is quay.ceph.io/ceph-ci/ceph:4e50bbcdd1630c7760b708f3a5b4d38a121e66cb, digests ['quay.ceph.io/ceph-ci/ceph@sha256:8f3809717761e681477c3ef1d8d2c03114aee2c597cd7380b93b8c10f47fcb5d'] 2024-03-30T14:07:55.079 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:54 smithi099 ceph-mon[137093]: Upgrade: Setting container_image for all mgr 2024-03-30T14:07:55.079 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:54 smithi099 ceph-mon[137093]: Upgrade: Setting container_image for all mon 2024-03-30T14:07:55.079 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:54 smithi099 ceph-mon[137093]: Upgrade: Setting container_image for all crash 2024-03-30T14:07:55.079 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:54 smithi099 ceph-mon[137093]: from='mon.2 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-03-30T14:07:55.079 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:54 smithi099 ceph-mon[137093]: Upgrade: osd.3 is safe to restart 2024-03-30T14:07:55.079 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:54 smithi099 ceph-mon[137093]: from='client.64372 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T14:07:55.079 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:54 smithi099 ceph-mon[137093]: from='client.64378 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T14:07:55.079 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:54 smithi099 ceph-mon[143401]: Upgrade: Target is version 19.0.0-1967-g4e50bbcd (squid) 2024-03-30T14:07:55.079 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:54 smithi099 ceph-mon[143401]: Upgrade: Target container is quay.ceph.io/ceph-ci/ceph:4e50bbcdd1630c7760b708f3a5b4d38a121e66cb, digests ['quay.ceph.io/ceph-ci/ceph@sha256:8f3809717761e681477c3ef1d8d2c03114aee2c597cd7380b93b8c10f47fcb5d'] 2024-03-30T14:07:55.079 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:54 smithi099 ceph-mon[143401]: Upgrade: Setting container_image for all mgr 2024-03-30T14:07:55.079 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:54 smithi099 ceph-mon[143401]: Upgrade: Setting container_image for all mon 2024-03-30T14:07:55.079 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:54 smithi099 ceph-mon[143401]: Upgrade: Setting container_image for all crash 2024-03-30T14:07:55.080 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:54 smithi099 ceph-mon[143401]: from='mon.2 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-03-30T14:07:55.080 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:54 smithi099 ceph-mon[143401]: Upgrade: osd.3 is safe to restart 2024-03-30T14:07:55.080 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:54 smithi099 ceph-mon[143401]: from='client.64372 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T14:07:55.080 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:54 smithi099 ceph-mon[143401]: from='client.64378 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T14:07:55.248 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:54 smithi181 ceph-mon[115276]: Upgrade: Target is version 19.0.0-1967-g4e50bbcd (squid) 2024-03-30T14:07:55.248 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:54 smithi181 ceph-mon[115276]: Upgrade: Target container is quay.ceph.io/ceph-ci/ceph:4e50bbcdd1630c7760b708f3a5b4d38a121e66cb, digests ['quay.ceph.io/ceph-ci/ceph@sha256:8f3809717761e681477c3ef1d8d2c03114aee2c597cd7380b93b8c10f47fcb5d'] 2024-03-30T14:07:55.248 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:54 smithi181 ceph-mon[115276]: Upgrade: Setting container_image for all mgr 2024-03-30T14:07:55.248 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:54 smithi181 ceph-mon[115276]: Upgrade: Setting container_image for all mon 2024-03-30T14:07:55.248 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:54 smithi181 ceph-mon[115276]: Upgrade: Setting container_image for all crash 2024-03-30T14:07:55.248 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:54 smithi181 ceph-mon[115276]: from='mon.2 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-03-30T14:07:55.248 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:54 smithi181 ceph-mon[115276]: Upgrade: osd.3 is safe to restart 2024-03-30T14:07:55.248 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:54 smithi181 ceph-mon[115276]: from='client.64372 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T14:07:55.248 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:54 smithi181 ceph-mon[115276]: from='client.64378 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T14:07:55.283 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-03-30T14:07:55.284 INFO:teuthology.orchestra.run.smithi099.stdout: "mon": { 2024-03-30T14:07:55.284 INFO:teuthology.orchestra.run.smithi099.stdout: "ceph version 19.0.0-1967-g4e50bbcd (4e50bbcdd1630c7760b708f3a5b4d38a121e66cb) squid (dev)": 3 2024-03-30T14:07:55.284 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T14:07:55.284 INFO:teuthology.orchestra.run.smithi099.stdout: "mgr": { 2024-03-30T14:07:55.284 INFO:teuthology.orchestra.run.smithi099.stdout: "ceph version 19.0.0-1967-g4e50bbcd (4e50bbcdd1630c7760b708f3a5b4d38a121e66cb) squid (dev)": 2 2024-03-30T14:07:55.284 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T14:07:55.284 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": { 2024-03-30T14:07:55.284 INFO:teuthology.orchestra.run.smithi099.stdout: "ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)": 5, 2024-03-30T14:07:55.284 INFO:teuthology.orchestra.run.smithi099.stdout: "ceph version 19.0.0-1967-g4e50bbcd (4e50bbcdd1630c7760b708f3a5b4d38a121e66cb) squid (dev)": 3 2024-03-30T14:07:55.284 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T14:07:55.284 INFO:teuthology.orchestra.run.smithi099.stdout: "rgw": { 2024-03-30T14:07:55.284 INFO:teuthology.orchestra.run.smithi099.stdout: "ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)": 2 2024-03-30T14:07:55.284 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T14:07:55.285 INFO:teuthology.orchestra.run.smithi099.stdout: "overall": { 2024-03-30T14:07:55.285 INFO:teuthology.orchestra.run.smithi099.stdout: "ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)": 7, 2024-03-30T14:07:55.285 INFO:teuthology.orchestra.run.smithi099.stdout: "ceph version 19.0.0-1967-g4e50bbcd (4e50bbcdd1630c7760b708f3a5b4d38a121e66cb) squid (dev)": 8 2024-03-30T14:07:55.285 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-03-30T14:07:55.285 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-03-30T14:07:55.624 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-03-30T14:07:55.624 INFO:teuthology.orchestra.run.smithi099.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph:4e50bbcdd1630c7760b708f3a5b4d38a121e66cb", 2024-03-30T14:07:55.624 INFO:teuthology.orchestra.run.smithi099.stdout: "in_progress": true, 2024-03-30T14:07:55.625 INFO:teuthology.orchestra.run.smithi099.stdout: "which": "Upgrading daemons of type(s) crash,osd", 2024-03-30T14:07:55.625 INFO:teuthology.orchestra.run.smithi099.stdout: "services_complete": [], 2024-03-30T14:07:55.625 INFO:teuthology.orchestra.run.smithi099.stdout: "progress": "3/8 daemons upgraded", 2024-03-30T14:07:55.625 INFO:teuthology.orchestra.run.smithi099.stdout: "message": "Currently upgrading osd daemons", 2024-03-30T14:07:55.625 INFO:teuthology.orchestra.run.smithi099.stdout: "is_paused": false 2024-03-30T14:07:55.625 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-03-30T14:07:56.140 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:55 smithi099 ceph-mon[143401]: pgmap v147: 161 pgs: 161 active+clean; 585 KiB data, 157 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T14:07:56.140 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:55 smithi099 ceph-mon[143401]: from='client.64384 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T14:07:56.140 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:55 smithi099 ceph-mon[143401]: from='client.? 172.21.15.99:0/4094575755' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:07:56.140 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:55 smithi099 ceph-mon[143401]: Upgrade: Updating osd.3 2024-03-30T14:07:56.140 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:55 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:07:56.140 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:55 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-03-30T14:07:56.140 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:55 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:07:56.140 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:55 smithi099 ceph-mon[143401]: Deploying daemon osd.3 on smithi099 2024-03-30T14:07:56.141 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:55 smithi099 ceph-mon[143401]: from='client.54396 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T14:07:56.141 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:55 smithi099 ceph-mon[137093]: pgmap v147: 161 pgs: 161 active+clean; 585 KiB data, 157 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T14:07:56.141 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:55 smithi099 ceph-mon[137093]: from='client.64384 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T14:07:56.141 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:55 smithi099 ceph-mon[137093]: from='client.? 172.21.15.99:0/4094575755' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:07:56.141 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:55 smithi099 ceph-mon[137093]: Upgrade: Updating osd.3 2024-03-30T14:07:56.141 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:55 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:07:56.141 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:55 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-03-30T14:07:56.141 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:55 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:07:56.141 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:55 smithi099 ceph-mon[137093]: Deploying daemon osd.3 on smithi099 2024-03-30T14:07:56.141 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:55 smithi099 ceph-mon[137093]: from='client.54396 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T14:07:56.247 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:55 smithi181 ceph-mon[115276]: pgmap v147: 161 pgs: 161 active+clean; 585 KiB data, 157 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T14:07:56.247 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:55 smithi181 ceph-mon[115276]: from='client.64384 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T14:07:56.248 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:55 smithi181 ceph-mon[115276]: from='client.? 172.21.15.99:0/4094575755' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:07:56.248 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:55 smithi181 ceph-mon[115276]: Upgrade: Updating osd.3 2024-03-30T14:07:56.248 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:55 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:07:56.248 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:55 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-03-30T14:07:56.248 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:55 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:07:56.248 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:55 smithi181 ceph-mon[115276]: Deploying daemon osd.3 on smithi099 2024-03-30T14:07:56.248 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:55 smithi181 ceph-mon[115276]: from='client.54396 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T14:07:58.120 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:57 smithi099 ceph-mon[137093]: pgmap v148: 161 pgs: 161 active+clean; 585 KiB data, 157 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T14:07:58.121 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:57 smithi099 ceph-mon[143401]: pgmap v148: 161 pgs: 161 active+clean; 585 KiB data, 157 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T14:07:58.247 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:57 smithi181 ceph-mon[115276]: pgmap v148: 161 pgs: 161 active+clean; 585 KiB data, 157 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T14:07:58.985 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:58 smithi099 ceph-mon[137093]: from='client.25136 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T14:07:58.985 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:58 smithi099 ceph-mon[143401]: from='client.25136 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T14:07:58.985 INFO:journalctl@ceph.osd.3.smithi099.stdout:Mar 30 14:07:58 smithi099 systemd[1]: Stopping Ceph osd.3 for 98ebaeb8-ee99-11ee-b647-cb9ed24678a4... 2024-03-30T14:07:59.247 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:58 smithi181 ceph-mon[115276]: from='client.25136 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T14:07:59.328 INFO:journalctl@ceph.osd.3.smithi099.stdout:Mar 30 14:07:58 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-3[41935]: 2024-03-30T14:07:58.990+0000 7f7f4462e700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.3 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-03-30T14:07:59.328 INFO:journalctl@ceph.osd.3.smithi099.stdout:Mar 30 14:07:58 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-3[41935]: 2024-03-30T14:07:58.990+0000 7f7f4462e700 -1 osd.3 128 *** Got signal Terminated *** 2024-03-30T14:07:59.328 INFO:journalctl@ceph.osd.3.smithi099.stdout:Mar 30 14:07:58 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-3[41935]: 2024-03-30T14:07:58.990+0000 7f7f4462e700 -1 osd.3 128 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-03-30T14:08:00.247 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:59 smithi181 ceph-mon[115276]: pgmap v149: 161 pgs: 161 active+clean; 585 KiB data, 157 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T14:08:00.247 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:07:59 smithi181 ceph-mon[115276]: osd.3 marked itself down and dead 2024-03-30T14:08:00.328 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:59 smithi099 ceph-mon[137093]: pgmap v149: 161 pgs: 161 active+clean; 585 KiB data, 157 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T14:08:00.328 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:07:59 smithi099 ceph-mon[137093]: osd.3 marked itself down and dead 2024-03-30T14:08:00.329 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:59 smithi099 ceph-mon[143401]: pgmap v149: 161 pgs: 161 active+clean; 585 KiB data, 157 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T14:08:00.329 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:07:59 smithi099 ceph-mon[143401]: osd.3 marked itself down and dead 2024-03-30T14:08:00.660 INFO:journalctl@ceph.osd.3.smithi099.stdout:Mar 30 14:08:00 smithi099 podman[170547]: 2024-03-30 14:08:00.390080852 +0000 UTC m=+1.504438922 container died 718812bcf0655daef5d99fcb44cbab650a4ac86f72b0170d4c79f5c0f5f1aff5 (image=quay.io/ceph/ceph@sha256:12a0a4f43413fd97a14a3d47a3451b2d2df50020835bb93db666209f3f77617a, name=ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-3, com.redhat.component=centos-stream-container, RELEASE=HEAD, vcs-ref=f1ee6e37554363ec55e0035aba1a693d3627fdeb, maintainer=Guillaume Abrioux , GIT_CLEAN=True, distribution-scope=public, io.buildah.version=1.19.8, release=754, io.k8s.display-name=CentOS Stream 8, architecture=x86_64, build-date=2022-05-03T08:36:31.336870, io.k8s.description=The Universal Base Image is designed and engineered to be the base layer for all of your containerized applications, middleware and utilities. This base image is freely redistributable, but Red Hat only supports Red Hat technologies through subscriptions for Red Hat products. This image is maintained by Red Hat and updated regularly., GIT_COMMIT=b613db0f44179c0940781c1c7fe04e1acb7093ac, com.redhat.build-host=cpt-1002.osbs.prod.upshift.rdu2.redhat.com, version=8, ceph=True, GIT_BRANCH=HEAD, com.redhat.license_terms=https://centos.org/legal/licensing-policy/, vcs-type=git, io.openshift.expose-services=, url=https://access.redhat.com/containers/#/registry.access.redhat.com/ubi8/images/8.6-754, CEPH_POINT_RELEASE=-17.2.0, description=CentOS Stream is a continuously delivered distro that tracks just ahead of Red Hat Enterprise Linux development. This image takes the Red Hat UBI and layers on content from CentOS Stream, name=centos-stream, summary=Provides a CentOS Stream container based on the Red Hat Universal Base Image, vendor=Red Hat, Inc., GIT_REPO=https://github.com/ceph/ceph-container.git, io.openshift.tags=base centos centos-stream) 2024-03-30T14:08:00.997 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:00 smithi181 ceph-mon[115276]: Health check failed: 1 osds down (OSD_DOWN) 2024-03-30T14:08:00.997 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:00 smithi181 ceph-mon[115276]: failed to encode map e129 with expected crc 2024-03-30T14:08:00.997 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:00 smithi181 ceph-mon[115276]: failed to encode map e129 with expected crc 2024-03-30T14:08:00.998 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:00 smithi181 ceph-mon[115276]: failed to encode map e129 with expected crc 2024-03-30T14:08:00.998 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:00 smithi181 ceph-mon[115276]: failed to encode map e129 with expected crc 2024-03-30T14:08:00.998 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:00 smithi181 ceph-mon[115276]: failed to encode map e129 with expected crc 2024-03-30T14:08:00.998 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:00 smithi181 ceph-mon[115276]: failed to encode map e129 with expected crc 2024-03-30T14:08:00.998 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:00 smithi181 ceph-mon[115276]: osdmap e129: 8 total, 7 up, 8 in 2024-03-30T14:08:00.998 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:00 smithi181 ceph-mon[115276]: failed to encode map e129 with expected crc 2024-03-30T14:08:00.998 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:00 smithi181 ceph-mon[115276]: failed to encode map e129 with expected crc 2024-03-30T14:08:00.998 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:00 smithi181 ceph-mon[115276]: failed to encode map e129 with expected crc 2024-03-30T14:08:01.078 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:00 smithi099 ceph-mon[143401]: Health check failed: 1 osds down (OSD_DOWN) 2024-03-30T14:08:01.078 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:00 smithi099 ceph-mon[143401]: failed to encode map e129 with expected crc 2024-03-30T14:08:01.079 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:00 smithi099 ceph-mon[143401]: failed to encode map e129 with expected crc 2024-03-30T14:08:01.079 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:00 smithi099 ceph-mon[143401]: failed to encode map e129 with expected crc 2024-03-30T14:08:01.079 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:00 smithi099 ceph-mon[143401]: failed to encode map e129 with expected crc 2024-03-30T14:08:01.079 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:00 smithi099 ceph-mon[143401]: failed to encode map e129 with expected crc 2024-03-30T14:08:01.079 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:00 smithi099 ceph-mon[143401]: failed to encode map e129 with expected crc 2024-03-30T14:08:01.079 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:00 smithi099 ceph-mon[143401]: osdmap e129: 8 total, 7 up, 8 in 2024-03-30T14:08:01.079 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:00 smithi099 ceph-mon[143401]: failed to encode map e129 with expected crc 2024-03-30T14:08:01.079 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:00 smithi099 ceph-mon[143401]: failed to encode map e129 with expected crc 2024-03-30T14:08:01.079 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:00 smithi099 ceph-mon[143401]: failed to encode map e129 with expected crc 2024-03-30T14:08:01.079 INFO:journalctl@ceph.osd.3.smithi099.stdout:Mar 30 14:08:00 smithi099 podman[170547]: 2024-03-30 14:08:00.875313971 +0000 UTC m=+1.989672033 container cleanup 718812bcf0655daef5d99fcb44cbab650a4ac86f72b0170d4c79f5c0f5f1aff5 (image=quay.io/ceph/ceph@sha256:12a0a4f43413fd97a14a3d47a3451b2d2df50020835bb93db666209f3f77617a, name=ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-3, com.redhat.build-host=cpt-1002.osbs.prod.upshift.rdu2.redhat.com, RELEASE=HEAD, build-date=2022-05-03T08:36:31.336870, io.k8s.description=The Universal Base Image is designed and engineered to be the base layer for all of your containerized applications, middleware and utilities. This base image is freely redistributable, but Red Hat only supports Red Hat technologies through subscriptions for Red Hat products. This image is maintained by Red Hat and updated regularly., CEPH_POINT_RELEASE=-17.2.0, ceph=True, url=https://access.redhat.com/containers/#/registry.access.redhat.com/ubi8/images/8.6-754, io.k8s.display-name=CentOS Stream 8, GIT_BRANCH=HEAD, summary=Provides a CentOS Stream container based on the Red Hat Universal Base Image, vcs-ref=f1ee6e37554363ec55e0035aba1a693d3627fdeb, io.openshift.tags=base centos centos-stream, GIT_CLEAN=True, release=754, vcs-type=git, GIT_COMMIT=b613db0f44179c0940781c1c7fe04e1acb7093ac, version=8, vendor=Red Hat, Inc., com.redhat.license_terms=https://centos.org/legal/licensing-policy/, name=centos-stream, io.openshift.expose-services=, architecture=x86_64, io.buildah.version=1.19.8, maintainer=Guillaume Abrioux , distribution-scope=public, com.redhat.component=centos-stream-container, GIT_REPO=https://github.com/ceph/ceph-container.git, description=CentOS Stream is a continuously delivered distro that tracks just ahead of Red Hat Enterprise Linux development. This image takes the Red Hat UBI and layers on content from CentOS Stream) 2024-03-30T14:08:01.079 INFO:journalctl@ceph.osd.3.smithi099.stdout:Mar 30 14:08:00 smithi099 bash[170547]: ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-3 2024-03-30T14:08:01.080 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:00 smithi099 ceph-mon[137093]: Health check failed: 1 osds down (OSD_DOWN) 2024-03-30T14:08:01.080 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:00 smithi099 ceph-mon[137093]: failed to encode map e129 with expected crc 2024-03-30T14:08:01.080 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:00 smithi099 ceph-mon[137093]: failed to encode map e129 with expected crc 2024-03-30T14:08:01.080 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:00 smithi099 ceph-mon[137093]: failed to encode map e129 with expected crc 2024-03-30T14:08:01.080 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:00 smithi099 ceph-mon[137093]: failed to encode map e129 with expected crc 2024-03-30T14:08:01.080 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:00 smithi099 ceph-mon[137093]: failed to encode map e129 with expected crc 2024-03-30T14:08:01.080 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:00 smithi099 ceph-mon[137093]: failed to encode map e129 with expected crc 2024-03-30T14:08:01.080 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:00 smithi099 ceph-mon[137093]: osdmap e129: 8 total, 7 up, 8 in 2024-03-30T14:08:01.080 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:00 smithi099 ceph-mon[137093]: failed to encode map e129 with expected crc 2024-03-30T14:08:01.080 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:00 smithi099 ceph-mon[137093]: failed to encode map e129 with expected crc 2024-03-30T14:08:01.080 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:00 smithi099 ceph-mon[137093]: failed to encode map e129 with expected crc 2024-03-30T14:08:01.456 INFO:journalctl@ceph.osd.3.smithi099.stdout:Mar 30 14:08:01 smithi099 podman[170566]: 2024-03-30 14:08:01.16869063 +0000 UTC m=+0.781960407 container remove 718812bcf0655daef5d99fcb44cbab650a4ac86f72b0170d4c79f5c0f5f1aff5 (image=quay.io/ceph/ceph@sha256:12a0a4f43413fd97a14a3d47a3451b2d2df50020835bb93db666209f3f77617a, name=ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-3, GIT_BRANCH=HEAD, com.redhat.build-host=cpt-1002.osbs.prod.upshift.rdu2.redhat.com, maintainer=Guillaume Abrioux , vcs-type=git, io.k8s.display-name=CentOS Stream 8, build-date=2022-05-03T08:36:31.336870, distribution-scope=public, vcs-ref=f1ee6e37554363ec55e0035aba1a693d3627fdeb, CEPH_POINT_RELEASE=-17.2.0, release=754, GIT_COMMIT=b613db0f44179c0940781c1c7fe04e1acb7093ac, summary=Provides a CentOS Stream container based on the Red Hat Universal Base Image, io.k8s.description=The Universal Base Image is designed and engineered to be the base layer for all of your containerized applications, middleware and utilities. This base image is freely redistributable, but Red Hat only supports Red Hat technologies through subscriptions for Red Hat products. This image is maintained by Red Hat and updated regularly., architecture=x86_64, vendor=Red Hat, Inc., name=centos-stream, RELEASE=HEAD, ceph=True, com.redhat.license_terms=https://centos.org/legal/licensing-policy/, description=CentOS Stream is a continuously delivered distro that tracks just ahead of Red Hat Enterprise Linux development. This image takes the Red Hat UBI and layers on content from CentOS Stream, io.openshift.tags=base centos centos-stream, io.openshift.expose-services=, com.redhat.component=centos-stream-container, version=8, GIT_CLEAN=True, io.buildah.version=1.19.8, url=https://access.redhat.com/containers/#/registry.access.redhat.com/ubi8/images/8.6-754, GIT_REPO=https://github.com/ceph/ceph-container.git) 2024-03-30T14:08:02.078 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:01 smithi099 ceph-mon[143401]: pgmap v151: 161 pgs: 6 peering, 26 stale+active+clean, 129 active+clean; 585 KiB data, 157 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-03-30T14:08:02.079 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:01 smithi099 ceph-mon[143401]: failed to encode map e130 with expected crc 2024-03-30T14:08:02.079 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:01 smithi099 ceph-mon[143401]: failed to encode map e130 with expected crc 2024-03-30T14:08:02.079 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:01 smithi099 ceph-mon[143401]: failed to encode map e130 with expected crc 2024-03-30T14:08:02.079 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:01 smithi099 ceph-mon[143401]: failed to encode map e130 with expected crc 2024-03-30T14:08:02.079 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:01 smithi099 ceph-mon[143401]: failed to encode map e130 with expected crc 2024-03-30T14:08:02.079 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:01 smithi099 ceph-mon[143401]: osdmap e130: 8 total, 7 up, 8 in 2024-03-30T14:08:02.079 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:01 smithi099 ceph-mon[143401]: failed to encode map e130 with expected crc 2024-03-30T14:08:02.079 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:01 smithi099 ceph-mon[143401]: failed to encode map e130 with expected crc 2024-03-30T14:08:02.079 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:01 smithi099 ceph-mon[143401]: failed to encode map e130 with expected crc 2024-03-30T14:08:02.079 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:01 smithi099 ceph-mon[143401]: failed to encode map e130 with expected crc 2024-03-30T14:08:02.079 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:01 smithi099 ceph-mon[143401]: failed to encode map e130 with expected crc 2024-03-30T14:08:02.080 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:01 smithi099 ceph-mon[137093]: pgmap v151: 161 pgs: 6 peering, 26 stale+active+clean, 129 active+clean; 585 KiB data, 157 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-03-30T14:08:02.080 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:01 smithi099 ceph-mon[137093]: failed to encode map e130 with expected crc 2024-03-30T14:08:02.080 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:01 smithi099 ceph-mon[137093]: failed to encode map e130 with expected crc 2024-03-30T14:08:02.080 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:01 smithi099 ceph-mon[137093]: failed to encode map e130 with expected crc 2024-03-30T14:08:02.080 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:01 smithi099 ceph-mon[137093]: failed to encode map e130 with expected crc 2024-03-30T14:08:02.080 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:01 smithi099 ceph-mon[137093]: failed to encode map e130 with expected crc 2024-03-30T14:08:02.080 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:01 smithi099 ceph-mon[137093]: osdmap e130: 8 total, 7 up, 8 in 2024-03-30T14:08:02.080 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:01 smithi099 ceph-mon[137093]: failed to encode map e130 with expected crc 2024-03-30T14:08:02.080 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:01 smithi099 ceph-mon[137093]: failed to encode map e130 with expected crc 2024-03-30T14:08:02.081 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:01 smithi099 ceph-mon[137093]: failed to encode map e130 with expected crc 2024-03-30T14:08:02.081 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:01 smithi099 ceph-mon[137093]: failed to encode map e130 with expected crc 2024-03-30T14:08:02.081 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:01 smithi099 ceph-mon[137093]: failed to encode map e130 with expected crc 2024-03-30T14:08:02.247 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:01 smithi181 ceph-mon[115276]: pgmap v151: 161 pgs: 6 peering, 26 stale+active+clean, 129 active+clean; 585 KiB data, 157 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-03-30T14:08:02.248 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:01 smithi181 ceph-mon[115276]: failed to encode map e130 with expected crc 2024-03-30T14:08:02.248 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:01 smithi181 ceph-mon[115276]: failed to encode map e130 with expected crc 2024-03-30T14:08:02.248 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:01 smithi181 ceph-mon[115276]: failed to encode map e130 with expected crc 2024-03-30T14:08:02.248 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:01 smithi181 ceph-mon[115276]: failed to encode map e130 with expected crc 2024-03-30T14:08:02.248 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:01 smithi181 ceph-mon[115276]: failed to encode map e130 with expected crc 2024-03-30T14:08:02.248 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:01 smithi181 ceph-mon[115276]: osdmap e130: 8 total, 7 up, 8 in 2024-03-30T14:08:02.248 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:01 smithi181 ceph-mon[115276]: failed to encode map e130 with expected crc 2024-03-30T14:08:02.248 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:01 smithi181 ceph-mon[115276]: failed to encode map e130 with expected crc 2024-03-30T14:08:02.248 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:01 smithi181 ceph-mon[115276]: failed to encode map e130 with expected crc 2024-03-30T14:08:02.248 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:01 smithi181 ceph-mon[115276]: failed to encode map e130 with expected crc 2024-03-30T14:08:02.248 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:01 smithi181 ceph-mon[115276]: failed to encode map e130 with expected crc 2024-03-30T14:08:02.853 INFO:journalctl@ceph.osd.3.smithi099.stdout:Mar 30 14:08:02 smithi099 podman[170706]: 2024-03-30 14:08:02.745437342 +0000 UTC m=+0.018251174 image pull b0c4478f1d83795df4d538bf108aee5fac57194348fb16dcdbb3115f3e2fe95e quay.ceph.io/ceph-ci/ceph:4e50bbcdd1630c7760b708f3a5b4d38a121e66cb 2024-03-30T14:08:03.148 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:02 smithi099 ceph-mon[137093]: Health check failed: Degraded data redundancy: 38/627 objects degraded (6.061%), 13 pgs degraded (PG_DEGRADED) 2024-03-30T14:08:03.149 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:02 smithi099 ceph-mon[143401]: Health check failed: Degraded data redundancy: 38/627 objects degraded (6.061%), 13 pgs degraded (PG_DEGRADED) 2024-03-30T14:08:03.149 INFO:journalctl@ceph.osd.3.smithi099.stdout:Mar 30 14:08:02 smithi099 podman[170706]: 2024-03-30 14:08:02.86096772 +0000 UTC m=+0.133781552 container create cc4802d0234427e9f4bd8c4fb31b52782026444b8da9c575d55bd7127ad44dea (image=quay.ceph.io/ceph-ci/ceph:4e50bbcdd1630c7760b708f3a5b4d38a121e66cb, name=ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-3-deactivate, org.label-schema.license=GPLv2, org.label-schema.build-date=20240326, RELEASE=squid-4e50bbc, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, io.buildah.version=1.33.5, ceph=True, GIT_CLEAN=True, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-03-30T14:08:03.149 INFO:journalctl@ceph.osd.3.smithi099.stdout:Mar 30 14:08:03 smithi099 podman[170706]: 2024-03-30 14:08:03.080311762 +0000 UTC m=+0.353125597 container init cc4802d0234427e9f4bd8c4fb31b52782026444b8da9c575d55bd7127ad44dea (image=quay.ceph.io/ceph-ci/ceph:4e50bbcdd1630c7760b708f3a5b4d38a121e66cb, name=ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-3-deactivate, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=squid-4e50bbc, ceph=True, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, org.label-schema.build-date=20240326, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2) 2024-03-30T14:08:03.149 INFO:journalctl@ceph.osd.3.smithi099.stdout:Mar 30 14:08:03 smithi099 podman[170706]: 2024-03-30 14:08:03.083757489 +0000 UTC m=+0.356571330 container start cc4802d0234427e9f4bd8c4fb31b52782026444b8da9c575d55bd7127ad44dea (image=quay.ceph.io/ceph-ci/ceph:4e50bbcdd1630c7760b708f3a5b4d38a121e66cb, name=ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-3-deactivate, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, org.label-schema.build-date=20240326, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, RELEASE=squid-4e50bbc, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, CEPH_POINT_RELEASE=) 2024-03-30T14:08:03.247 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:02 smithi181 ceph-mon[115276]: Health check failed: Degraded data redundancy: 38/627 objects degraded (6.061%), 13 pgs degraded (PG_DEGRADED) 2024-03-30T14:08:03.578 INFO:journalctl@ceph.osd.3.smithi099.stdout:Mar 30 14:08:03 smithi099 podman[170706]: 2024-03-30 14:08:03.163824231 +0000 UTC m=+0.436638075 container attach cc4802d0234427e9f4bd8c4fb31b52782026444b8da9c575d55bd7127ad44dea (image=quay.ceph.io/ceph-ci/ceph:4e50bbcdd1630c7760b708f3a5b4d38a121e66cb, name=ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-3-deactivate, RELEASE=squid-4e50bbc, org.label-schema.license=GPLv2, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240326, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, ceph=True, CEPH_POINT_RELEASE=, GIT_CLEAN=True, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0) 2024-03-30T14:08:03.578 INFO:journalctl@ceph.osd.3.smithi099.stdout:Mar 30 14:08:03 smithi099 podman[170706]: 2024-03-30 14:08:03.383953944 +0000 UTC m=+0.656767776 container died cc4802d0234427e9f4bd8c4fb31b52782026444b8da9c575d55bd7127ad44dea (image=quay.ceph.io/ceph-ci/ceph:4e50bbcdd1630c7760b708f3a5b4d38a121e66cb, name=ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-3-deactivate, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240326, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, ceph=True, GIT_CLEAN=True, RELEASE=squid-4e50bbc) 2024-03-30T14:08:04.133 INFO:journalctl@ceph.osd.3.smithi099.stdout:Mar 30 14:08:04 smithi099 podman[170756]: 2024-03-30 14:08:04.043437605 +0000 UTC m=+0.654534352 container remove cc4802d0234427e9f4bd8c4fb31b52782026444b8da9c575d55bd7127ad44dea (image=quay.ceph.io/ceph-ci/ceph:4e50bbcdd1630c7760b708f3a5b4d38a121e66cb, name=ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-3-deactivate, org.label-schema.vendor=CentOS, RELEASE=squid-4e50bbc, ceph=True, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240326, GIT_CLEAN=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, maintainer=Guillaume Abrioux ) 2024-03-30T14:08:04.133 INFO:journalctl@ceph.osd.3.smithi099.stdout:Mar 30 14:08:04 smithi099 systemd[1]: ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4@osd.3.service: Deactivated successfully. 2024-03-30T14:08:04.133 INFO:journalctl@ceph.osd.3.smithi099.stdout:Mar 30 14:08:04 smithi099 systemd[1]: Stopped Ceph osd.3 for 98ebaeb8-ee99-11ee-b647-cb9ed24678a4. 2024-03-30T14:08:04.134 INFO:journalctl@ceph.osd.3.smithi099.stdout:Mar 30 14:08:04 smithi099 systemd[1]: ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4@osd.3.service: Consumed 17.982s CPU time. 2024-03-30T14:08:04.462 INFO:journalctl@ceph.osd.3.smithi099.stdout:Mar 30 14:08:04 smithi099 systemd[1]: Starting Ceph osd.3 for 98ebaeb8-ee99-11ee-b647-cb9ed24678a4... 2024-03-30T14:08:04.462 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:04 smithi099 ceph-mon[143401]: pgmap v153: 161 pgs: 13 active+undersized+degraded, 6 peering, 12 stale+active+clean, 19 active+undersized, 111 active+clean; 585 KiB data, 157 MiB used, 715 GiB / 715 GiB avail; 38/627 objects degraded (6.061%) 2024-03-30T14:08:04.463 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:04 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:04.463 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:04 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:04.463 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:04 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:04.463 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:04 smithi099 ceph-mon[137093]: pgmap v153: 161 pgs: 13 active+undersized+degraded, 6 peering, 12 stale+active+clean, 19 active+undersized, 111 active+clean; 585 KiB data, 157 MiB used, 715 GiB / 715 GiB avail; 38/627 objects degraded (6.061%) 2024-03-30T14:08:04.463 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:04 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:04.463 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:04 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:04.463 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:04 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:04.497 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:04 smithi181 ceph-mon[115276]: pgmap v153: 161 pgs: 13 active+undersized+degraded, 6 peering, 12 stale+active+clean, 19 active+undersized, 111 active+clean; 585 KiB data, 157 MiB used, 715 GiB / 715 GiB avail; 38/627 objects degraded (6.061%) 2024-03-30T14:08:04.497 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:04 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:04.497 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:04 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:04.498 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:04 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:04.747 INFO:journalctl@ceph.osd.3.smithi099.stdout:Mar 30 14:08:04 smithi099 podman[170859]: 2024-03-30 14:08:04.469378058 +0000 UTC m=+0.101758998 container create 9436b5b1c02981a5493dad70d2d25f98a88b63682fade4b27d3e246c75f8df6f (image=quay.ceph.io/ceph-ci/ceph:4e50bbcdd1630c7760b708f3a5b4d38a121e66cb, name=ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-3-activate, RELEASE=squid-4e50bbc, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.build-date=20240326, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_BRANCH=HEAD) 2024-03-30T14:08:04.747 INFO:journalctl@ceph.osd.3.smithi099.stdout:Mar 30 14:08:04 smithi099 podman[170859]: 2024-03-30 14:08:04.385396325 +0000 UTC m=+0.017777244 image pull b0c4478f1d83795df4d538bf108aee5fac57194348fb16dcdbb3115f3e2fe95e quay.ceph.io/ceph-ci/ceph:4e50bbcdd1630c7760b708f3a5b4d38a121e66cb 2024-03-30T14:08:04.748 INFO:journalctl@ceph.osd.3.smithi099.stdout:Mar 30 14:08:04 smithi099 podman[170859]: 2024-03-30 14:08:04.671877157 +0000 UTC m=+0.304258068 container init 9436b5b1c02981a5493dad70d2d25f98a88b63682fade4b27d3e246c75f8df6f (image=quay.ceph.io/ceph-ci/ceph:4e50bbcdd1630c7760b708f3a5b4d38a121e66cb, name=ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-3-activate, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, ceph=True, RELEASE=squid-4e50bbc, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240326, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image) 2024-03-30T14:08:04.748 INFO:journalctl@ceph.osd.3.smithi099.stdout:Mar 30 14:08:04 smithi099 podman[170859]: 2024-03-30 14:08:04.675052015 +0000 UTC m=+0.307432913 container start 9436b5b1c02981a5493dad70d2d25f98a88b63682fade4b27d3e246c75f8df6f (image=quay.ceph.io/ceph-ci/ceph:4e50bbcdd1630c7760b708f3a5b4d38a121e66cb, name=ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-3-activate, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, RELEASE=squid-4e50bbc, org.label-schema.build-date=20240326, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0) 2024-03-30T14:08:04.748 INFO:journalctl@ceph.osd.3.smithi099.stdout:Mar 30 14:08:04 smithi099 podman[170859]: 2024-03-30 14:08:04.755221811 +0000 UTC m=+0.387602714 container attach 9436b5b1c02981a5493dad70d2d25f98a88b63682fade4b27d3e246c75f8df6f (image=quay.ceph.io/ceph-ci/ceph:4e50bbcdd1630c7760b708f3a5b4d38a121e66cb, name=ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-3-activate, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, RELEASE=squid-4e50bbc, org.label-schema.build-date=20240326, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, GIT_CLEAN=True, CEPH_POINT_RELEASE=) 2024-03-30T14:08:05.078 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 14:08:04 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[71049]: ::ffff:172.21.15.181 - - [30/Mar/2024:14:08:04] "GET /metrics HTTP/1.1" 200 38253 "" "Prometheus/2.43.0" 2024-03-30T14:08:05.518 INFO:journalctl@ceph.osd.3.smithi099.stdout:Mar 30 14:08:05 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-3-activate[170874]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-03-30T14:08:05.519 INFO:journalctl@ceph.osd.3.smithi099.stdout:Mar 30 14:08:05 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-3-activate[170874]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-3 --no-mon-config --dev /dev/mapper/vg_nvme-lv_1 2024-03-30T14:08:05.519 INFO:journalctl@ceph.osd.3.smithi099.stdout:Mar 30 14:08:05 smithi099 bash[170859]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-03-30T14:08:05.519 INFO:journalctl@ceph.osd.3.smithi099.stdout:Mar 30 14:08:05 smithi099 bash[170859]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-3 --no-mon-config --dev /dev/mapper/vg_nvme-lv_1 2024-03-30T14:08:05.519 INFO:journalctl@ceph.osd.3.smithi099.stdout:Mar 30 14:08:05 smithi099 bash[170859]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_1 2024-03-30T14:08:05.519 INFO:journalctl@ceph.osd.3.smithi099.stdout:Mar 30 14:08:05 smithi099 bash[170859]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-0 2024-03-30T14:08:05.519 INFO:journalctl@ceph.osd.3.smithi099.stdout:Mar 30 14:08:05 smithi099 bash[170859]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-3/block 2024-03-30T14:08:05.519 INFO:journalctl@ceph.osd.3.smithi099.stdout:Mar 30 14:08:05 smithi099 bash[170859]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-03-30T14:08:05.519 INFO:journalctl@ceph.osd.3.smithi099.stdout:Mar 30 14:08:05 smithi099 bash[170859]: --> ceph-volume raw activate successful for osd ID: 3 2024-03-30T14:08:05.519 INFO:journalctl@ceph.osd.3.smithi099.stdout:Mar 30 14:08:05 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-3-activate[170874]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_1 2024-03-30T14:08:05.519 INFO:journalctl@ceph.osd.3.smithi099.stdout:Mar 30 14:08:05 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-3-activate[170874]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-0 2024-03-30T14:08:05.519 INFO:journalctl@ceph.osd.3.smithi099.stdout:Mar 30 14:08:05 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-3-activate[170874]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-3/block 2024-03-30T14:08:05.519 INFO:journalctl@ceph.osd.3.smithi099.stdout:Mar 30 14:08:05 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-3-activate[170874]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-03-30T14:08:05.519 INFO:journalctl@ceph.osd.3.smithi099.stdout:Mar 30 14:08:05 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-3-activate[170874]: --> ceph-volume raw activate successful for osd ID: 3 2024-03-30T14:08:05.520 INFO:journalctl@ceph.osd.3.smithi099.stdout:Mar 30 14:08:05 smithi099 podman[170859]: 2024-03-30 14:08:05.143776495 +0000 UTC m=+0.776157401 container died 9436b5b1c02981a5493dad70d2d25f98a88b63682fade4b27d3e246c75f8df6f (image=quay.ceph.io/ceph-ci/ceph:4e50bbcdd1630c7760b708f3a5b4d38a121e66cb, name=ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-3-activate, ceph=True, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, RELEASE=squid-4e50bbc, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, org.label-schema.build-date=20240326, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS) 2024-03-30T14:08:06.137 INFO:journalctl@ceph.osd.3.smithi099.stdout:Mar 30 14:08:05 smithi099 podman[171010]: 2024-03-30 14:08:05.859952267 +0000 UTC m=+0.710146217 container remove 9436b5b1c02981a5493dad70d2d25f98a88b63682fade4b27d3e246c75f8df6f (image=quay.ceph.io/ceph-ci/ceph:4e50bbcdd1630c7760b708f3a5b4d38a121e66cb, name=ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-3-activate, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, ceph=True, maintainer=Guillaume Abrioux , RELEASE=squid-4e50bbc, GIT_CLEAN=True, org.label-schema.build-date=20240326) 2024-03-30T14:08:06.138 INFO:journalctl@ceph.osd.3.smithi099.stdout:Mar 30 14:08:06 smithi099 podman[171075]: 2024-03-30 14:08:05.977053378 +0000 UTC m=+0.017959101 image pull b0c4478f1d83795df4d538bf108aee5fac57194348fb16dcdbb3115f3e2fe95e quay.ceph.io/ceph-ci/ceph:4e50bbcdd1630c7760b708f3a5b4d38a121e66cb 2024-03-30T14:08:06.138 INFO:journalctl@ceph.osd.3.smithi099.stdout:Mar 30 14:08:06 smithi099 podman[171075]: 2024-03-30 14:08:06.094069652 +0000 UTC m=+0.134975375 container create 9b38d79f070e439d9d9d10f214cfb49396001144320af1806b2b85d3f39f5a49 (image=quay.ceph.io/ceph-ci/ceph:4e50bbcdd1630c7760b708f3a5b4d38a121e66cb, name=ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-3, org.label-schema.license=GPLv2, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, RELEASE=squid-4e50bbc, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , ceph=True, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240326, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=) 2024-03-30T14:08:06.428 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:06 smithi181 ceph-mon[115276]: pgmap v154: 161 pgs: 19 active+undersized+degraded, 6 peering, 6 stale+active+clean, 27 active+undersized, 103 active+clean; 585 KiB data, 157 MiB used, 715 GiB / 715 GiB avail; 57/627 objects degraded (9.091%) 2024-03-30T14:08:06.464 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:06 smithi099 ceph-mon[137093]: pgmap v154: 161 pgs: 19 active+undersized+degraded, 6 peering, 6 stale+active+clean, 27 active+undersized, 103 active+clean; 585 KiB data, 157 MiB used, 715 GiB / 715 GiB avail; 57/627 objects degraded (9.091%) 2024-03-30T14:08:06.464 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:06 smithi099 ceph-mon[143401]: pgmap v154: 161 pgs: 19 active+undersized+degraded, 6 peering, 6 stale+active+clean, 27 active+undersized, 103 active+clean; 585 KiB data, 157 MiB used, 715 GiB / 715 GiB avail; 57/627 objects degraded (9.091%) 2024-03-30T14:08:06.465 INFO:journalctl@ceph.osd.3.smithi099.stdout:Mar 30 14:08:06 smithi099 podman[171075]: 2024-03-30 14:08:06.371995079 +0000 UTC m=+0.412900802 container init 9b38d79f070e439d9d9d10f214cfb49396001144320af1806b2b85d3f39f5a49 (image=quay.ceph.io/ceph-ci/ceph:4e50bbcdd1630c7760b708f3a5b4d38a121e66cb, name=ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-3, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, RELEASE=squid-4e50bbc, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, org.label-schema.build-date=20240326, org.label-schema.license=GPLv2, GIT_CLEAN=True) 2024-03-30T14:08:06.465 INFO:journalctl@ceph.osd.3.smithi099.stdout:Mar 30 14:08:06 smithi099 podman[171075]: 2024-03-30 14:08:06.374926835 +0000 UTC m=+0.415832558 container start 9b38d79f070e439d9d9d10f214cfb49396001144320af1806b2b85d3f39f5a49 (image=quay.ceph.io/ceph-ci/ceph:4e50bbcdd1630c7760b708f3a5b4d38a121e66cb, name=ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-3, RELEASE=squid-4e50bbc, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.build-date=20240326, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, ceph=True) 2024-03-30T14:08:06.465 INFO:journalctl@ceph.osd.3.smithi099.stdout:Mar 30 14:08:06 smithi099 ceph-osd[171094]: -- 172.21.15.99:0/2592866239 <== mon.0 v2:172.21.15.99:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x560b2ab51680 con 0x560b2ab1b400 2024-03-30T14:08:06.828 INFO:journalctl@ceph.osd.3.smithi099.stdout:Mar 30 14:08:06 smithi099 bash[171075]: 9b38d79f070e439d9d9d10f214cfb49396001144320af1806b2b85d3f39f5a49 2024-03-30T14:08:06.828 INFO:journalctl@ceph.osd.3.smithi099.stdout:Mar 30 14:08:06 smithi099 systemd[1]: Started Ceph osd.3 for 98ebaeb8-ee99-11ee-b647-cb9ed24678a4. 2024-03-30T14:08:07.211 INFO:journalctl@ceph.osd.3.smithi099.stdout:Mar 30 14:08:06 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-3[171090]: 2024-03-30T14:08:06.917+0000 7fba112a97c0 -1 Falling back to public interface 2024-03-30T14:08:07.563 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:07 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:07.563 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:07 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:07.563 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:07 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:08:07.563 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:07 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:08:07.563 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:07 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:07.564 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:07 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:08:07.564 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:07 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:08:07.564 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:07 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:07.564 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:07 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:08:07.564 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:07 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:08:07.564 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:07 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:07.564 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:07 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:08:07.564 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:07 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:07.564 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:07 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T14:08:07.564 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:07 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:08:07.564 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:07 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:07.564 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:07 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:08:07.564 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:07 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:08:07.564 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:07 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:07.564 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:07 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:08:07.564 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:07 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:07.565 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:07 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:08:07.565 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:07 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:08:07.565 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:07 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:07.565 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:07 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:08:07.565 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:07 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:07.565 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:07 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:08:07.565 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:07 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:08:07.565 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:07 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:07.565 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:07 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:08:07.565 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:07 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:07.565 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:07 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:08:07.565 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:07 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:08:07.565 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:07 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:07.565 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:07 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:08:07.565 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:07 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:07.565 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:07 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:08:07.566 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:07 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:08:07.566 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:07 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:07.566 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:07 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:08:07.566 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:07 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:07.566 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:07 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:08:07.566 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:07 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:08:07.566 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:07 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:07.784 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:07 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:07.785 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:07 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:07.785 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:07 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:08:07.785 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:07 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:08:07.785 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:07 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:07.785 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:07 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:08:07.785 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:07 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:08:07.785 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:07 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:07.785 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:07 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:08:07.785 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:07 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:08:07.785 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:07 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:07.785 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:07 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:08:07.785 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:07 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:07.786 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:07 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T14:08:07.786 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:07 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:08:07.786 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:07 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:07.786 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:07 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:08:07.786 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:07 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:08:07.786 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:07 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:07.786 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:07 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:08:07.786 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:07 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:07.786 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:07 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:08:07.786 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:07 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:08:07.786 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:07 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:07.786 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:07 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:08:07.786 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:07 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:07.786 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:07 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:08:07.787 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:07 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:08:07.787 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:07 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:07.787 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:07 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:08:07.787 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:07 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:07.787 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:07 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:07.787 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:07 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:08:07.787 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:07 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:08:07.787 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:07 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:07.787 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:07 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:08:07.787 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:07 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:08:07.787 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:07 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:07.787 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:07 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:08:07.788 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:07 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:08:07.788 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:07 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:07.788 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:07 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:08:07.788 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:07 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:07.788 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:07 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T14:08:07.788 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:07 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:08:07.788 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:07 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:07.788 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:07 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:08:07.788 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:07 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:08:07.788 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:07 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:07.788 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:07 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:08:07.788 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:07 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:07.788 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:07 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:08:07.788 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:07 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:08:07.788 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:07 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:07.788 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:07 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:08:07.789 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:07 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:07.789 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:07 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:08:07.789 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:07 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:08:07.789 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:07 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:07.789 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:07 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:08:07.789 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:07 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:07.789 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:07 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:08:07.789 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:07 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:08:07.789 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:07 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:07.789 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:07 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:08:07.789 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:07 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:07.789 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:07 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:08:07.789 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:07 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:08:07.789 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:07 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:07.789 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:07 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:08:07.790 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:07 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:07.790 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:07 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:08:07.790 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:07 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:08:07.790 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:07 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:07.790 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:07 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:07.790 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:07 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:08:07.790 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:07 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:08:07.790 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:07 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:07.790 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:07 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:08:07.790 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:07 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:07.790 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:07 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:08:07.790 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:07 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:08:07.791 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:07 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:07.791 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:07 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:08:07.791 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:07 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:07.791 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:07 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:08:07.791 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:07 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:08:07.791 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:07 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:08.521 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:08 smithi099 ceph-mon[137093]: pgmap v155: 161 pgs: 25 active+undersized+degraded, 41 active+undersized, 95 active+clean; 585 KiB data, 157 MiB used, 715 GiB / 715 GiB avail; 81/627 objects degraded (12.919%) 2024-03-30T14:08:08.522 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:08 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:08:08.522 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:08 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:08:08.522 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:08 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:08:08.522 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:08 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:08:08.522 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:08 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:08:08.522 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:08 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:08:08.522 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:08 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:08:08.522 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:08 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:08.522 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:08 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:08:08.522 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:08 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:08:08.522 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:08 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:08.523 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:08 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:08:08.523 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:08 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:08:08.523 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:08 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:08.523 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:08 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:08:08.523 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:08 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:08:08.523 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:08 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:08.523 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:08 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:08:08.523 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:08 smithi099 ceph-mon[143401]: pgmap v155: 161 pgs: 25 active+undersized+degraded, 41 active+undersized, 95 active+clean; 585 KiB data, 157 MiB used, 715 GiB / 715 GiB avail; 81/627 objects degraded (12.919%) 2024-03-30T14:08:08.523 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:08 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:08:08.523 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:08 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:08:08.524 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:08 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:08:08.524 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:08 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:08:08.524 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:08 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:08:08.524 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:08 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:08:08.524 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:08 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:08:08.524 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:08 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:08.524 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:08 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:08:08.524 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:08 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:08:08.524 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:08 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:08.524 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:08 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:08:08.524 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:08 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:08:08.524 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:08 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:08.524 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:08 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:08:08.524 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:08 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:08:08.525 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:08 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:08.525 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:08 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:08:08.525 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:08 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:08.525 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:08 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:08:08.525 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:08 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:08:08.525 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:08 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:08.525 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:08 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:08:08.525 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:08 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:08.525 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:08 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:08:08.525 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:08 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:08:08.525 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:08 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:08.525 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:08 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:08:08.526 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:08 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:08.526 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:08 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:08:08.526 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:08 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:08:08.526 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:08 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:08.526 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:08 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:08:08.526 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:08 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:08.526 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:08 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:08:08.526 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:08 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:08:08.526 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:08 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:08.526 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:08 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:08:08.526 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:08 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:08.629 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:08 smithi181 ceph-mon[115276]: pgmap v155: 161 pgs: 25 active+undersized+degraded, 41 active+undersized, 95 active+clean; 585 KiB data, 157 MiB used, 715 GiB / 715 GiB avail; 81/627 objects degraded (12.919%) 2024-03-30T14:08:08.629 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:08 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:08:08.629 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:08 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:08:08.629 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:08 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:08:08.629 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:08 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:08:08.629 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:08 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:08:08.629 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:08 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:08:08.629 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:08 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:08:08.630 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:08 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:08.630 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:08 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:08:08.630 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:08 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:08:08.630 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:08 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:08.630 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:08 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:08:08.630 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:08 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:08:08.630 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:08 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:08.630 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:08 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:08:08.630 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:08 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:08:08.630 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:08 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:08.630 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:08 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:08:08.631 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:08 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:08.631 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:08 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:08:08.631 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:08 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:08:08.631 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:08 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:08.631 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:08 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:08:08.631 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:08 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:08.631 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:08 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:08:08.631 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:08 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:08:08.631 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:08 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:08.631 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:08 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:08:08.631 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:08 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:08.631 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:08 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:08:08.632 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:08 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:08:08.632 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:08 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:08.632 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:08 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:08:08.632 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:08 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:08.632 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:08 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:08:08.632 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:08 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:08:08.632 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:08 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:08.632 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:08 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:08:08.632 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:08 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:08.632 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:08 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:08:08.632 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:08 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:08:08.632 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:08 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:08.824 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:08 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:08:08.825 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:08 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:08:08.825 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:08 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:08.825 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:08 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:08.825 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:08 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:08:08.825 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:08 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:08:08.825 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:08 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:08.825 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:08 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:08:08.825 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:08 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:08.825 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:08 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:08:08.825 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:08 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:08:08.825 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:08 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:08.826 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:08 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:08:08.826 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:08 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:08.826 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:08 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:08:08.826 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:08 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:08:08.826 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:08 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:08.826 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:08 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:08:08.826 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:08 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:08.826 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:08 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:08:08.826 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:08 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:08:08.826 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:08 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:08.827 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:08 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:08:08.827 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:08 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:08.827 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:08 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:08:08.827 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:08 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:08:08.827 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:08 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:09.748 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:09 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:08:09.748 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:09 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:08:09.748 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:09 smithi181 ceph-mon[115276]: from='client.25136 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T14:08:09.748 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:09 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:08:09.748 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:09 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:08:09.748 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:09 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:08:09.748 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:09 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:08:09.748 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:09 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:08:09.748 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:09 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:09.749 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:09 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:08:09.749 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:09 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:08:09.749 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:09 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:09.749 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:09 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:08:09.749 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:09 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:08:09.749 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:09 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:09.749 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:09 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:08:09.749 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:09 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:08:09.749 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:09 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:09.749 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:09 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:08:09.749 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:09 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:09.749 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:09 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:09.749 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:09 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:09.749 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:09 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:08:09.749 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:09 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:09.749 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:09 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:08:09.750 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:09 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:08:09.750 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:09 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:09.750 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:09 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:08:09.750 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:09 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:09.750 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:09 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:08:09.750 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:09 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:08:09.750 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:09 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:09.750 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:09 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:08:09.750 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:09 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:09.750 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:09 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:08:09.751 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:09 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:08:09.751 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:09 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:09.751 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:09 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:08:09.751 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:09 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:09.751 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:09 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:08:09.751 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:09 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:08:09.751 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:09 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:09.751 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:09 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:08:09.751 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:09 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:09.751 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:09 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:08:09.751 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:09 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:08:09.751 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:09 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:09.751 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:09 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:08:09.751 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:09 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:09.751 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:09 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:08:09.752 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:09 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:08:09.752 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:09 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:09.752 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:09 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:08:09.752 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:09 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:09.752 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:09 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:08:09.752 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:09 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:08:09.828 INFO:journalctl@ceph.osd.3.smithi099.stdout:Mar 30 14:08:09 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-3[171090]: 2024-03-30T14:08:09.647+0000 7fba112a97c0 -1 osd.3 0 read_superblock omap replica is missing. 2024-03-30T14:08:09.828 INFO:journalctl@ceph.osd.3.smithi099.stdout:Mar 30 14:08:09 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-3[171090]: 2024-03-30T14:08:09.677+0000 7fba112a97c0 -1 osd.3 128 log_to_monitors true 2024-03-30T14:08:09.829 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:09 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:08:09.829 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:09 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:08:09.829 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:09 smithi099 ceph-mon[137093]: from='client.25136 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T14:08:09.829 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:09 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:08:09.829 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:09 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:08:09.829 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:09 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:08:09.829 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:09 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:08:09.829 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:09 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:08:09.829 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:09 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:09.829 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:09 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:08:09.829 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:09 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:08:09.829 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:09 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:09.829 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:09 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:08:09.829 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:09 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:08:09.830 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:09 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:09.830 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:09 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:08:09.830 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:09 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:08:09.830 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:09 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:09.830 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:09 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:08:09.830 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:09 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:09.830 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:09 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:09.830 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:09 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:09.830 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:09 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:08:09.830 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:09 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:09.830 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:09 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:08:09.830 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:09 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:08:09.830 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:09 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:09.830 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:09 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:08:09.831 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:09 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:09.831 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:09 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:08:09.831 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:09 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:08:09.831 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:09 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:08:09.831 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:09 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:08:09.831 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:09 smithi099 ceph-mon[143401]: from='client.25136 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T14:08:09.831 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:09 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:08:09.831 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:09 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:08:09.831 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:09 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:08:09.831 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:09 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:08:09.831 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:09 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:08:09.831 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:09 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:09.831 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:09 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:08:09.832 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:09 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:08:09.832 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:09 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:09.832 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:09 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:08:09.832 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:09 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:08:09.832 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:09 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:09.832 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:09 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:08:09.832 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:09 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:08:09.832 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:09 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:09.832 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:09 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:08:09.832 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:09 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:09.832 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:09 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:09.832 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:09 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:09.832 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:09 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:08:09.832 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:09 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:09.832 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:09 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:08:09.832 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:09 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:08:09.833 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:09 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:09.833 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:09 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:08:09.833 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:09 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:09.833 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:09 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:08:09.833 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:09 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:08:09.833 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:09 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:09.833 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:09 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:08:09.833 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:09 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:09.833 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:09 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:08:09.833 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:09 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:08:09.833 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:09 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:09.833 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:09 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:08:09.834 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:09 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:09.834 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:09 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:08:09.834 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:09 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:08:09.834 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:09 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:09.834 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:09 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:08:09.834 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:09 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:09.834 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:09 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:08:09.834 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:09 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:08:09.834 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:09 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:09.834 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:09 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:08:09.834 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:09 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:09.834 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:09 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:08:09.834 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:09 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:08:09.834 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:09 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:09.835 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:09 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:08:09.835 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:09 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:09.835 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:09 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:08:09.835 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:09 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:08:09.835 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:09 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:09.835 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:09 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:08:09.835 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:09 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:09.835 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:09 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:08:09.835 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:09 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:08:09.835 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:09 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:09.835 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:09 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:08:09.835 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:09 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:09.835 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:09 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:08:09.835 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:09 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:08:09.836 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:09 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:09.836 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:09 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:08:09.836 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:09 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:09.836 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:09 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:08:09.836 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:09 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:08:09.836 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:09 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:09.836 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:09 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:08:09.836 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:09 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:09.836 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:09 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:08:09.836 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:09 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:08:09.836 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:09 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:09.836 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:09 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:08:09.836 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:09 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:09.836 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:09 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:08:09.836 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:09 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:08:10.792 INFO:journalctl@ceph.osd.3.smithi099.stdout:Mar 30 14:08:10 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-3[171090]: 2024-03-30T14:08:10.635+0000 7fba02701700 -1 osd.3 128 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-03-30T14:08:10.792 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:10 smithi099 ceph-mon[137093]: pgmap v156: 161 pgs: 25 active+undersized+degraded, 41 active+undersized, 95 active+clean; 585 KiB data, 157 MiB used, 715 GiB / 715 GiB avail; 0 B/s wr, 9 op/s; 81/627 objects degraded (12.919%) 2024-03-30T14:08:10.792 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:10 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:08:10.792 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:10 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:08:10.792 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:10 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:08:10.792 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:10 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:08:10.793 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:10 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:08:10.793 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:10 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:08:10.793 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:10 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:10.793 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:10 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:08:10.793 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:10 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:08:10.793 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:10 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:10.793 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:10 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:08:10.793 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:10 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:08:10.793 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:10 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:10.793 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:10 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:08:10.793 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:10 smithi099 ceph-mon[137093]: from='osd.3 [v2:172.21.15.99:6826/1372202922,v1:172.21.15.99:6827/1372202922]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-03-30T14:08:10.793 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:10 smithi099 ceph-mon[137093]: Health check update: Degraded data redundancy: 81/627 objects degraded (12.919%), 25 pgs degraded (PG_DEGRADED) 2024-03-30T14:08:10.793 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:10 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:08:10.793 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:10 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:10.793 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:10 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:08:10.794 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:10 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:08:10.794 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:10 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:10.794 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:10 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:08:10.794 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:10 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:08:10.794 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:10 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:10.794 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:10 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:08:10.794 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:10 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:08:10.794 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:10 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:10.794 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:10 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:08:10.794 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:10 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:10.795 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:10 smithi099 ceph-mon[143401]: pgmap v156: 161 pgs: 25 active+undersized+degraded, 41 active+undersized, 95 active+clean; 585 KiB data, 157 MiB used, 715 GiB / 715 GiB avail; 0 B/s wr, 9 op/s; 81/627 objects degraded (12.919%) 2024-03-30T14:08:10.795 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:10 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:08:10.795 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:10 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:08:10.795 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:10 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:08:10.795 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:10 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:08:10.795 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:10 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:08:10.795 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:10 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:08:10.795 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:10 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:10.795 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:10 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:08:10.795 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:10 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:08:10.795 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:10 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:10.795 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:10 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:08:10.795 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:10 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:08:10.795 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:10 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:10.796 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:10 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:08:10.796 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:10 smithi099 ceph-mon[143401]: from='osd.3 [v2:172.21.15.99:6826/1372202922,v1:172.21.15.99:6827/1372202922]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-03-30T14:08:10.796 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:10 smithi099 ceph-mon[143401]: Health check update: Degraded data redundancy: 81/627 objects degraded (12.919%), 25 pgs degraded (PG_DEGRADED) 2024-03-30T14:08:10.796 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:10 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:08:10.796 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:10 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:10.796 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:10 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:08:10.796 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:10 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:08:10.796 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:10 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:10.796 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:10 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:08:10.796 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:10 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:08:10.796 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:10 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:10.796 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:10 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:08:10.796 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:10 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:08:10.796 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:10 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:10.797 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:10 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:08:10.797 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:10 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:10.797 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:10 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:08:10.797 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:10 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:08:10.797 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:10 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:10.797 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:10 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:08:10.797 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:10 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:10.797 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:10 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:08:10.797 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:10 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:08:10.797 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:10 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:10.797 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:10 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:08:10.798 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:10 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:10.798 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:10 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:08:10.798 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:10 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:08:10.798 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:10 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:10.798 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:10 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:08:10.798 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:10 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:10.798 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:10 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:08:10.798 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:10 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:08:10.798 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:10 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:10.798 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:10 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:08:10.798 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:10 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:10.799 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:10 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:08:10.799 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:10 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:08:10.799 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:10 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:10.799 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:10 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:08:10.799 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:10 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:08:10.799 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:10 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:10.799 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:10 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:08:10.799 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:10 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:10.799 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:10 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:08:10.799 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:10 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:08:10.799 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:10 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:10.799 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:10 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:08:10.800 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:10 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:10.800 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:10 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:08:10.801 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:10 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:08:10.801 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:10 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:10.801 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:10 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:08:10.801 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:10 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:10.801 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:10 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:08:10.801 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:10 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:08:10.802 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:10 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:10.802 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:10 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:08:10.802 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:10 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:10.802 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:10 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:08:10.802 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:10 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:08:10.802 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:10 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:10.998 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:10 smithi181 ceph-mon[115276]: pgmap v156: 161 pgs: 25 active+undersized+degraded, 41 active+undersized, 95 active+clean; 585 KiB data, 157 MiB used, 715 GiB / 715 GiB avail; 0 B/s wr, 9 op/s; 81/627 objects degraded (12.919%) 2024-03-30T14:08:10.998 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:10 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:08:10.998 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:10 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:08:10.998 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:10 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:08:10.998 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:10 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:08:10.998 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:10 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:08:10.998 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:10 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:08:10.998 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:10 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:10.998 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:10 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:08:10.998 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:10 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:08:10.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:10 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:10.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:10 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:08:10.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:10 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:08:10.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:10 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:10.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:10 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:08:10.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:10 smithi181 ceph-mon[115276]: from='osd.3 [v2:172.21.15.99:6826/1372202922,v1:172.21.15.99:6827/1372202922]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-03-30T14:08:10.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:10 smithi181 ceph-mon[115276]: Health check update: Degraded data redundancy: 81/627 objects degraded (12.919%), 25 pgs degraded (PG_DEGRADED) 2024-03-30T14:08:10.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:10 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:08:10.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:10 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:10.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:10 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:08:10.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:10 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:08:10.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:10 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:10.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:10 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:08:10.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:10 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:08:10.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:10 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:11.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:10 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:08:11.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:10 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:08:11.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:10 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:11.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:10 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:08:11.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:10 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:11.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:10 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:08:11.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:10 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:08:11.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:10 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:11.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:10 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:08:11.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:10 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:11.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:10 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:08:11.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:10 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:08:11.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:10 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:11.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:10 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:08:11.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:10 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:11.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:10 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:08:11.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:10 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:08:11.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:10 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:11.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:10 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:08:11.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:10 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:11.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:10 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:08:11.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:10 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:08:11.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:10 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:11.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:10 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:08:11.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:10 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:11.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:10 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:08:11.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:10 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:08:11.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:10 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:11.998 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:11 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:08:11.998 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:11 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:08:11.998 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:11 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:08:11.998 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:11 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:08:11.998 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:11 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:08:11.998 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:11 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:08:11.998 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:11 smithi181 ceph-mon[115276]: from='osd.3 [v2:172.21.15.99:6826/1372202922,v1:172.21.15.99:6827/1372202922]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-03-30T14:08:11.998 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:11 smithi181 ceph-mon[115276]: failed to encode map e131 with expected crc 2024-03-30T14:08:11.998 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:11 smithi181 ceph-mon[115276]: failed to encode map e131 with expected crc 2024-03-30T14:08:11.998 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:11 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:08:11.998 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:11 smithi181 ceph-mon[115276]: osdmap e131: 8 total, 7 up, 8 in 2024-03-30T14:08:11.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:11 smithi181 ceph-mon[115276]: from='osd.3 [v2:172.21.15.99:6826/1372202922,v1:172.21.15.99:6827/1372202922]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi099", "root=default"]}]: dispatch 2024-03-30T14:08:11.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:11 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:11.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:11 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:08:11.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:11 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:08:11.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:11 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:11.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:11 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:08:11.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:11 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:08:11.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:11 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:11.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:11 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:08:11.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:11 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:08:11.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:11 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:11.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:11 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:08:11.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:11 smithi181 ceph-mon[115276]: failed to encode map e131 with expected crc 2024-03-30T14:08:11.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:11 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:08:11.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:11 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:11.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:11 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:08:12.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:11 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:08:12.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:11 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:12.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:11 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:08:12.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:11 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:12.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:11 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:08:12.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:11 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:08:12.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:11 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:12.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:11 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:08:12.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:11 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:12.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:11 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:08:12.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:11 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:08:12.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:11 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:12.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:11 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:08:12.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:11 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:12.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:11 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:08:12.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:11 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:08:12.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:11 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:12.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:11 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:08:12.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:11 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:12.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:11 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:08:12.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:11 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:08:12.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:11 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:12.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:11 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:08:12.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:11 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:12.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:11 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:08:12.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:11 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:08:12.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:11 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:12.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:11 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:08:12.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:11 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:12.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:11 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:08:12.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:11 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:08:12.002 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:11 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:12.078 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:11 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:08:12.079 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:11 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:08:12.079 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:11 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:08:12.079 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:11 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:08:12.079 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:11 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:08:12.079 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:11 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:08:12.079 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:11 smithi099 ceph-mon[137093]: from='osd.3 [v2:172.21.15.99:6826/1372202922,v1:172.21.15.99:6827/1372202922]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-03-30T14:08:12.079 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:11 smithi099 ceph-mon[137093]: failed to encode map e131 with expected crc 2024-03-30T14:08:12.079 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:11 smithi099 ceph-mon[137093]: failed to encode map e131 with expected crc 2024-03-30T14:08:12.079 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:11 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:08:12.079 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:11 smithi099 ceph-mon[137093]: osdmap e131: 8 total, 7 up, 8 in 2024-03-30T14:08:12.079 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:11 smithi099 ceph-mon[137093]: from='osd.3 [v2:172.21.15.99:6826/1372202922,v1:172.21.15.99:6827/1372202922]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi099", "root=default"]}]: dispatch 2024-03-30T14:08:12.079 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:11 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:12.079 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:11 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:08:12.079 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:11 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:08:12.079 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:11 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:12.080 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:11 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:08:12.080 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:11 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:08:12.080 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:11 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:12.080 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:11 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:08:12.080 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:11 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:08:12.080 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:11 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:12.080 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:11 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:08:12.080 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:11 smithi099 ceph-mon[137093]: failed to encode map e131 with expected crc 2024-03-30T14:08:12.080 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:11 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:08:12.080 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:11 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:12.080 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:11 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:08:12.080 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:11 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:08:12.080 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:11 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:12.080 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:11 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:08:12.081 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:11 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:08:12.081 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:11 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:08:12.081 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:11 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:08:12.081 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:11 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:08:12.081 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:11 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:08:12.081 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:11 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:08:12.081 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:11 smithi099 ceph-mon[143401]: from='osd.3 [v2:172.21.15.99:6826/1372202922,v1:172.21.15.99:6827/1372202922]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-03-30T14:08:12.081 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:11 smithi099 ceph-mon[143401]: failed to encode map e131 with expected crc 2024-03-30T14:08:12.081 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:11 smithi099 ceph-mon[143401]: failed to encode map e131 with expected crc 2024-03-30T14:08:12.081 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:11 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:08:12.081 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:11 smithi099 ceph-mon[143401]: osdmap e131: 8 total, 7 up, 8 in 2024-03-30T14:08:12.081 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:11 smithi099 ceph-mon[143401]: from='osd.3 [v2:172.21.15.99:6826/1372202922,v1:172.21.15.99:6827/1372202922]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi099", "root=default"]}]: dispatch 2024-03-30T14:08:12.081 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:11 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:12.082 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:11 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:08:12.082 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:11 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:08:12.082 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:11 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:12.082 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:11 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:08:12.082 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:11 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:08:12.082 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:11 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:12.082 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:11 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:08:12.082 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:11 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:08:12.082 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:11 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:12.082 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:11 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:08:12.082 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:11 smithi099 ceph-mon[143401]: failed to encode map e131 with expected crc 2024-03-30T14:08:12.082 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:11 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:08:12.082 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:11 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:12.082 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:11 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:08:12.082 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:11 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:08:12.082 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:11 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:12.083 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:11 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:08:12.083 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:11 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:12.083 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:11 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:08:12.083 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:11 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:08:12.083 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:11 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:12.083 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:11 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:08:12.083 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:11 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:12.083 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:11 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:08:12.083 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:11 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:08:12.083 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:11 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:12.084 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:11 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:08:12.084 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:11 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:12.084 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:11 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:08:12.084 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:11 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:08:12.084 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:11 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:12.084 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:11 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:08:12.084 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:11 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:12.084 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:11 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:08:12.084 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:11 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:08:12.084 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:11 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:12.084 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:11 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:08:12.084 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:11 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:12.084 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:11 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:08:12.084 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:11 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:08:12.084 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:11 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:12.084 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:11 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:08:12.084 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:11 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:12.085 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:11 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:08:12.085 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:11 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:08:12.085 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:11 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:12.085 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:11 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:12.085 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:11 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:08:12.085 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:11 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:08:12.085 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:11 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:12.085 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:11 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:08:12.085 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:11 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:12.085 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:11 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:08:12.085 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:11 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:08:12.085 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:11 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:12.085 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:11 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:08:12.085 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:11 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:12.085 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:11 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:08:12.086 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:11 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:08:12.086 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:11 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:12.086 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:11 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:08:12.086 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:11 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:12.086 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:11 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:08:12.086 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:11 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:08:12.086 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:11 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:12.086 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:11 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:08:12.086 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:11 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:12.086 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:11 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:08:12.086 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:11 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:08:12.086 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:11 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:12.086 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:11 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:08:12.086 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:11 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:12.087 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:11 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:08:12.087 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:11 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:08:12.087 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:11 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:12.997 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:12 smithi181 ceph-mon[115276]: pgmap v158: 161 pgs: 25 active+undersized+degraded, 41 active+undersized, 95 active+clean; 585 KiB data, 173 MiB used, 715 GiB / 715 GiB avail; 0 B/s wr, 19 op/s; 81/627 objects degraded (12.919%) 2024-03-30T14:08:12.997 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:12 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:08:12.998 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:12 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:08:12.998 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:12 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:08:12.998 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:12 smithi181 ceph-mon[115276]: failed to encode map e131 with expected crc 2024-03-30T14:08:12.998 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:12 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:08:12.998 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:12 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:08:12.998 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:12 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:08:12.998 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:12 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:08:12.998 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:12 smithi181 ceph-mon[115276]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-03-30T14:08:12.998 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:12 smithi181 ceph-mon[115276]: failed to encode map e132 with expected crc 2024-03-30T14:08:12.998 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:12 smithi181 ceph-mon[115276]: failed to encode map e132 with expected crc 2024-03-30T14:08:12.998 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:12 smithi181 ceph-mon[115276]: osd.3 [v2:172.21.15.99:6826/1372202922,v1:172.21.15.99:6827/1372202922] boot 2024-03-30T14:08:12.998 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:12 smithi181 ceph-mon[115276]: osdmap e132: 8 total, 8 up, 8 in 2024-03-30T14:08:12.998 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:12 smithi181 ceph-mon[115276]: failed to encode map e132 with expected crc 2024-03-30T14:08:12.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:12 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-03-30T14:08:12.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:12 smithi181 ceph-mon[115276]: failed to encode map e132 with expected crc 2024-03-30T14:08:12.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:12 smithi181 ceph-mon[115276]: failed to encode map e132 with expected crc 2024-03-30T14:08:12.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:12 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:08:12.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:12 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:12.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:12 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:08:12.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:12 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:08:12.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:12 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:12.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:12 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:08:12.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:12 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:08:12.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:12 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:12.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:12 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:08:12.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:12 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:08:12.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:12 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:12.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:12 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:08:13.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:12 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:08:13.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:12 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:13.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:12 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:08:13.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:12 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:08:13.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:12 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:13.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:12 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:08:13.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:12 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:13.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:12 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:08:13.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:12 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:08:13.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:12 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:13.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:12 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:08:13.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:12 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:13.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:12 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:08:13.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:12 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:08:13.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:12 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:13.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:12 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:08:13.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:12 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:13.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:12 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:08:13.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:12 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:08:13.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:12 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:13.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:12 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:08:13.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:12 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:13.002 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:12 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:08:13.002 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:12 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:08:13.002 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:12 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:13.002 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:12 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:08:13.002 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:12 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:13.002 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:12 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:08:13.002 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:12 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:08:13.002 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:12 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:13.002 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:12 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:08:13.002 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:12 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:13.002 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:12 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:08:13.002 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:12 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:08:13.002 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:12 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:13.003 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:12 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:08:13.003 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:12 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:13.003 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:12 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:08:13.003 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:12 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:08:13.003 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:12 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:13.003 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:12 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:08:13.003 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:12 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:13.003 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:12 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:08:13.003 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:12 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:08:13.003 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:12 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:13.048 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:12 smithi099 ceph-mon[143401]: pgmap v158: 161 pgs: 25 active+undersized+degraded, 41 active+undersized, 95 active+clean; 585 KiB data, 173 MiB used, 715 GiB / 715 GiB avail; 0 B/s wr, 19 op/s; 81/627 objects degraded (12.919%) 2024-03-30T14:08:13.048 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:12 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:08:13.048 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:12 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:08:13.048 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:12 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:08:13.048 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:12 smithi099 ceph-mon[143401]: failed to encode map e131 with expected crc 2024-03-30T14:08:13.048 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:12 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:08:13.048 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:12 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:08:13.048 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:12 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:08:13.048 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:12 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:08:13.048 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:12 smithi099 ceph-mon[143401]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-03-30T14:08:13.048 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:12 smithi099 ceph-mon[143401]: failed to encode map e132 with expected crc 2024-03-30T14:08:13.049 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:12 smithi099 ceph-mon[143401]: failed to encode map e132 with expected crc 2024-03-30T14:08:13.049 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:12 smithi099 ceph-mon[143401]: osd.3 [v2:172.21.15.99:6826/1372202922,v1:172.21.15.99:6827/1372202922] boot 2024-03-30T14:08:13.049 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:12 smithi099 ceph-mon[143401]: osdmap e132: 8 total, 8 up, 8 in 2024-03-30T14:08:13.049 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:12 smithi099 ceph-mon[143401]: failed to encode map e132 with expected crc 2024-03-30T14:08:13.049 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:12 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-03-30T14:08:13.049 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:12 smithi099 ceph-mon[143401]: failed to encode map e132 with expected crc 2024-03-30T14:08:13.049 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:12 smithi099 ceph-mon[143401]: failed to encode map e132 with expected crc 2024-03-30T14:08:13.049 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:12 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:08:13.049 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:12 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:13.049 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:12 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:08:13.049 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:12 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:08:13.049 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:12 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:13.049 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:12 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:08:13.049 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:12 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:08:13.049 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:12 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:13.049 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:12 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:08:13.050 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:12 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:08:13.050 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:12 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:13.050 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:12 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:08:13.050 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:12 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:08:13.050 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:12 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:13.050 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:12 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:08:13.050 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:12 smithi099 ceph-mon[137093]: pgmap v158: 161 pgs: 25 active+undersized+degraded, 41 active+undersized, 95 active+clean; 585 KiB data, 173 MiB used, 715 GiB / 715 GiB avail; 0 B/s wr, 19 op/s; 81/627 objects degraded (12.919%) 2024-03-30T14:08:13.050 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:12 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:08:13.050 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:12 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:08:13.050 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:12 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:08:13.051 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:12 smithi099 ceph-mon[137093]: failed to encode map e131 with expected crc 2024-03-30T14:08:13.051 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:12 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:08:13.051 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:12 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:08:13.051 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:12 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:08:13.051 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:12 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:08:13.051 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:12 smithi099 ceph-mon[137093]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-03-30T14:08:13.051 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:12 smithi099 ceph-mon[137093]: failed to encode map e132 with expected crc 2024-03-30T14:08:13.051 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:12 smithi099 ceph-mon[137093]: failed to encode map e132 with expected crc 2024-03-30T14:08:13.051 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:12 smithi099 ceph-mon[137093]: osd.3 [v2:172.21.15.99:6826/1372202922,v1:172.21.15.99:6827/1372202922] boot 2024-03-30T14:08:13.051 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:12 smithi099 ceph-mon[137093]: osdmap e132: 8 total, 8 up, 8 in 2024-03-30T14:08:13.051 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:12 smithi099 ceph-mon[137093]: failed to encode map e132 with expected crc 2024-03-30T14:08:13.051 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:12 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-03-30T14:08:13.051 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:12 smithi099 ceph-mon[137093]: failed to encode map e132 with expected crc 2024-03-30T14:08:13.051 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:12 smithi099 ceph-mon[137093]: failed to encode map e132 with expected crc 2024-03-30T14:08:13.051 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:12 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:08:13.052 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:12 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:13.052 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:12 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:08:13.052 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:12 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:08:13.052 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:12 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:13.052 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:12 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:08:13.052 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:12 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:08:13.052 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:12 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:13.052 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:12 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:08:13.052 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:12 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:08:13.052 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:12 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:13.052 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:12 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:08:13.052 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:12 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:08:13.052 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:12 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:13.052 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:12 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:08:13.053 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:12 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:08:13.053 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:12 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:13.053 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:12 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:08:13.053 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:12 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:13.053 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:12 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:08:13.053 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:12 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:08:13.053 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:12 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:13.053 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:12 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:08:13.053 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:12 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:13.053 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:12 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:08:13.053 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:12 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:08:13.053 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:12 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:13.053 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:12 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:08:13.054 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:12 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:13.054 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:12 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:08:13.054 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:12 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:08:13.054 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:12 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:13.054 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:12 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:08:13.054 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:12 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:13.054 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:12 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:08:13.054 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:12 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:08:13.054 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:12 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:13.054 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:12 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:08:13.054 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:12 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:13.054 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:12 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:08:13.054 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:12 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:08:13.054 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:12 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:13.055 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:12 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:08:13.055 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:12 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:13.055 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:12 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:08:13.055 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:12 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:13.055 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:12 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:08:13.055 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:12 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:13.055 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:12 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:08:13.055 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:12 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:08:13.055 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:12 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:13.055 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:12 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:08:13.055 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:12 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:13.056 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:12 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:08:13.056 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:12 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:08:13.056 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:12 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:13.056 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:12 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:08:13.056 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:12 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:13.056 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:12 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:08:13.056 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:12 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:08:13.056 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:12 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:13.056 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:12 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:08:13.056 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:12 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:13.056 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:12 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:08:13.056 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:12 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:08:13.056 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:12 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:13.056 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:12 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:08:13.056 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:12 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:13.056 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:12 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:08:13.056 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:12 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:08:13.057 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:12 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:13.057 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:12 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:08:13.057 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:12 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:13.057 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:12 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:08:13.057 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:12 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:08:13.057 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:12 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:13.057 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:12 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:08:13.057 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:12 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:13.057 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:12 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:08:13.057 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:12 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:08:13.057 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:12 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:13.057 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:12 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:08:13.058 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:12 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:13.058 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:12 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:08:13.058 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:12 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:08:13.058 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:12 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:13.058 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:12 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:08:13.058 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:12 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:08:13.058 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:12 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:13.058 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:12 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:08:13.058 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:12 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:13.058 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:12 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:08:13.058 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:12 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:08:13.058 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:12 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:13.059 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:12 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:08:13.059 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:12 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:13.059 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:12 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:08:13.059 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:12 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:08:13.059 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:12 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:13.828 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:13 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:08:13.829 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:13 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:08:13.829 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:13 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:08:13.829 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:13 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:08:13.829 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:13 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:08:13.829 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:13 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:08:13.829 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:13 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:08:13.829 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:13 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:08:13.829 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:13 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:08:13.829 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:13 smithi099 ceph-mon[143401]: failed to encode map e133 with expected crc 2024-03-30T14:08:13.829 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:13 smithi099 ceph-mon[143401]: osdmap e133: 8 total, 8 up, 8 in 2024-03-30T14:08:13.829 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:13 smithi099 ceph-mon[143401]: failed to encode map e133 with expected crc 2024-03-30T14:08:13.829 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:13 smithi099 ceph-mon[143401]: failed to encode map e133 with expected crc 2024-03-30T14:08:13.829 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:13 smithi099 ceph-mon[143401]: failed to encode map e133 with expected crc 2024-03-30T14:08:13.830 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:13 smithi099 ceph-mon[143401]: failed to encode map e133 with expected crc 2024-03-30T14:08:13.830 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:13 smithi099 ceph-mon[143401]: failed to encode map e133 with expected crc 2024-03-30T14:08:13.830 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:13 smithi099 ceph-mon[143401]: failed to encode map e133 with expected crc 2024-03-30T14:08:13.830 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:13 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:08:13.830 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:13 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:13.830 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:13 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:08:13.830 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:13 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:08:13.830 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:13 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:13.830 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:13 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:08:13.830 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:13 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:08:13.830 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:13 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:13.830 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:13 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:08:13.830 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:13 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:08:13.830 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:13 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:13.830 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:13 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:08:13.831 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:13 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:13.831 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:13 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:08:13.831 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:13 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:08:13.831 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:13 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:13.831 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:13 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:08:13.831 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:13 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:08:13.831 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:13 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:08:13.831 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:13 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:08:13.831 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:13 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:08:13.831 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:13 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:08:13.831 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:13 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:08:13.831 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:13 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:08:13.831 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:13 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:08:13.832 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:13 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:08:13.832 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:13 smithi099 ceph-mon[137093]: failed to encode map e133 with expected crc 2024-03-30T14:08:13.832 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:13 smithi099 ceph-mon[137093]: osdmap e133: 8 total, 8 up, 8 in 2024-03-30T14:08:13.832 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:13 smithi099 ceph-mon[137093]: failed to encode map e133 with expected crc 2024-03-30T14:08:13.832 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:13 smithi099 ceph-mon[137093]: failed to encode map e133 with expected crc 2024-03-30T14:08:13.832 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:13 smithi099 ceph-mon[137093]: failed to encode map e133 with expected crc 2024-03-30T14:08:13.832 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:13 smithi099 ceph-mon[137093]: failed to encode map e133 with expected crc 2024-03-30T14:08:13.832 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:13 smithi099 ceph-mon[137093]: failed to encode map e133 with expected crc 2024-03-30T14:08:13.832 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:13 smithi099 ceph-mon[137093]: failed to encode map e133 with expected crc 2024-03-30T14:08:13.832 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:13 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:08:13.832 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:13 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:13.832 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:13 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:08:13.832 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:13 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:08:13.832 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:13 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:13.832 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:13 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:08:13.832 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:13 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:08:13.833 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:13 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:13.833 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:13 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:08:13.833 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:13 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:08:13.833 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:13 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:13.833 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:13 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:08:13.833 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:13 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:13.833 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:13 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:08:13.833 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:13 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:08:13.833 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:13 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:13.833 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:13 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:08:13.833 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:13 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:13.834 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:13 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:08:13.834 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:13 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:08:13.834 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:13 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:13.834 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:13 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:08:13.834 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:13 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:13.834 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:13 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:08:13.834 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:13 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:08:13.834 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:13 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:13.834 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:13 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:08:13.834 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:13 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:13.834 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:13 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:08:13.834 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:13 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:08:13.834 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:13 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:13.834 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:13 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:08:13.834 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:13 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:13.835 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:13 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:08:13.835 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:13 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:08:13.835 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:13 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:13.835 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:13 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:08:13.835 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:13 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:13.835 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:13 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:08:13.835 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:13 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:08:13.835 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:13 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:13.835 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:13 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:08:13.835 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:13 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:13.835 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:13 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:08:13.835 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:13 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:08:13.835 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:13 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:13.835 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:13 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:08:13.835 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:13 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:13.836 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:13 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:08:13.836 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:13 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:08:13.836 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:13 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:13.836 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:13 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:13.836 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:13 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:08:13.836 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:13 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:08:13.836 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:13 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:13.836 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:13 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:08:13.836 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:13 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:13.836 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:13 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:08:13.836 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:13 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:08:13.837 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:13 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:13.837 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:13 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:08:13.837 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:13 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:13.837 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:13 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:08:13.837 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:13 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:08:13.837 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:13 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:13.837 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:13 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:08:13.837 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:13 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:13.837 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:13 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:08:13.837 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:13 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:08:13.837 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:13 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:13.837 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:13 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:08:13.837 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:13 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:13.837 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:13 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:08:13.838 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:13 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:08:13.838 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:13 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:13.838 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:13 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:08:13.838 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:13 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:13.838 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:13 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:08:13.838 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:13 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:08:13.838 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:13 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:13.838 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:13 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:08:13.838 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:13 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:13.838 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:13 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:08:13.838 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:13 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:08:13.838 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:13 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:13.998 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:13 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:08:13.998 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:13 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:08:13.998 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:13 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:08:13.998 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:13 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:08:13.998 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:13 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:08:13.998 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:13 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:08:13.998 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:13 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:08:13.998 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:13 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:08:13.998 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:13 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:08:13.998 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:13 smithi181 ceph-mon[115276]: failed to encode map e133 with expected crc 2024-03-30T14:08:13.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:13 smithi181 ceph-mon[115276]: osdmap e133: 8 total, 8 up, 8 in 2024-03-30T14:08:13.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:13 smithi181 ceph-mon[115276]: failed to encode map e133 with expected crc 2024-03-30T14:08:13.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:13 smithi181 ceph-mon[115276]: failed to encode map e133 with expected crc 2024-03-30T14:08:13.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:13 smithi181 ceph-mon[115276]: failed to encode map e133 with expected crc 2024-03-30T14:08:13.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:13 smithi181 ceph-mon[115276]: failed to encode map e133 with expected crc 2024-03-30T14:08:13.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:13 smithi181 ceph-mon[115276]: failed to encode map e133 with expected crc 2024-03-30T14:08:13.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:13 smithi181 ceph-mon[115276]: failed to encode map e133 with expected crc 2024-03-30T14:08:13.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:13 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:08:13.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:13 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:13.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:13 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:08:13.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:13 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:08:13.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:13 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:13.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:13 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:08:13.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:13 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:08:13.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:13 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:13.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:13 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:08:14.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:13 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:08:14.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:13 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:14.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:13 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:08:14.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:13 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:14.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:13 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:08:14.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:13 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:08:14.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:13 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:14.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:13 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:08:14.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:13 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:14.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:13 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:08:14.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:13 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:08:14.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:13 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:14.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:13 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:08:14.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:13 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:14.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:13 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:08:14.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:13 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:08:14.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:13 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:14.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:13 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:08:14.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:13 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:14.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:13 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:08:14.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:13 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:08:14.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:13 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:14.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:13 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:08:14.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:13 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:14.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:13 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:08:14.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:13 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:08:14.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:13 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:14.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:13 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:08:14.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:13 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:14.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:13 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:08:14.002 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:13 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:08:14.002 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:13 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:14.002 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:13 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:08:14.002 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:13 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:14.002 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:13 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:08:14.002 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:13 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:08:14.002 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:13 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:14.002 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:13 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:08:14.002 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:13 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:14.002 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:13 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:08:14.002 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:13 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:08:14.002 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:13 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:14.789 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:14 smithi099 ceph-mon[143401]: pgmap v161: 161 pgs: 1 active+recovering+degraded, 18 active+undersized+degraded, 2 active+recovery_wait+degraded, 30 active+undersized, 110 active+clean; 585 KiB data, 178 MiB used, 715 GiB / 715 GiB avail; 108 KiB/s rd, 0 B/s wr, 179 op/s; 74/627 objects degraded (11.802%); 0 B/s, 0 objects/s recovering 2024-03-30T14:08:14.790 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:14 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:08:14.790 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:14 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:08:14.790 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:14 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:08:14.790 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:14 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:08:14.790 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:14 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:08:14.790 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:14 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:08:14.790 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:14 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:08:14.790 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:14 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:08:14.790 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:14 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:08:14.790 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:14 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:08:14.790 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:14 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:14.791 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:14 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:08:14.791 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:14 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:08:14.791 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:14 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:14.791 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:14 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:08:14.791 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:14 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:08:14.791 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:14 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:14.791 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:14 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:08:14.791 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:14 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:08:14.791 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:14 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:14.791 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:14 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:08:14.791 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:14 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:14.791 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:14 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:08:14.791 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:14 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:08:14.792 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:14 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:14.792 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:14 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:08:14.792 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:14 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:14.792 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:14 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:08:14.792 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:14 smithi099 ceph-mon[137093]: pgmap v161: 161 pgs: 1 active+recovering+degraded, 18 active+undersized+degraded, 2 active+recovery_wait+degraded, 30 active+undersized, 110 active+clean; 585 KiB data, 178 MiB used, 715 GiB / 715 GiB avail; 108 KiB/s rd, 0 B/s wr, 179 op/s; 74/627 objects degraded (11.802%); 0 B/s, 0 objects/s recovering 2024-03-30T14:08:14.792 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:14 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:08:14.792 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:14 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:08:14.793 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:14 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:08:14.793 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:14 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:08:14.793 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:14 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:08:14.793 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:14 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:08:14.793 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:14 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:08:14.793 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:14 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:08:14.793 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:14 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:08:14.793 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:14 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:08:14.793 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:14 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:14.793 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:14 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:08:14.793 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:14 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:08:14.793 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:14 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:14.793 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:14 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:08:14.794 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:14 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:08:14.794 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:14 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:14.794 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:14 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:08:14.794 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:14 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:08:14.794 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:14 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:14.794 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:14 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:08:14.794 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:14 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:14.794 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:14 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:08:14.794 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:14 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:08:14.794 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:14 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:14.794 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:14 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:08:14.794 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:14 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:14.795 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:14 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:08:14.795 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:14 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:08:14.795 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:14 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:14.795 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:14 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:08:14.795 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:14 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:14.795 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:14 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:08:14.795 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:14 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:08:14.795 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:14 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:14.795 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:14 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:08:14.795 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:14 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:14.795 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:14 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:08:14.795 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:14 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:08:14.795 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:14 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:14.795 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:14 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:08:14.795 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:14 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:14.796 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:14 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:08:14.796 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:14 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:08:14.796 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:14 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:14.796 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:14 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:08:14.796 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:14 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:14.796 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:14 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:08:14.796 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:14 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:08:14.796 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:14 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:14.796 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:14 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:08:14.796 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:14 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:14.796 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:14 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:08:14.796 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:14 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:14.797 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:14 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:08:14.797 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:14 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:08:14.797 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:14 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:14.797 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:14 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:08:14.797 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:14 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:14.797 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:14 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:08:14.797 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:14 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:08:14.797 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:14 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:14.797 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:14 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:08:14.797 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:14 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:14.797 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:14 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:08:14.797 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:14 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:08:14.797 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:14 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:14.797 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:14 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:08:14.798 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:14 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:14.798 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:14 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:08:14.798 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:14 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:08:14.798 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:14 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:14.998 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:14 smithi181 ceph-mon[115276]: pgmap v161: 161 pgs: 1 active+recovering+degraded, 18 active+undersized+degraded, 2 active+recovery_wait+degraded, 30 active+undersized, 110 active+clean; 585 KiB data, 178 MiB used, 715 GiB / 715 GiB avail; 108 KiB/s rd, 0 B/s wr, 179 op/s; 74/627 objects degraded (11.802%); 0 B/s, 0 objects/s recovering 2024-03-30T14:08:14.998 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:14 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:08:14.998 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:14 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:08:14.998 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:14 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:08:14.998 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:14 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:08:14.998 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:14 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:08:14.998 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:14 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:08:14.998 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:14 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:08:14.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:14 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:08:14.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:14 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:08:14.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:14 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:08:14.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:14 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:14.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:14 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:08:14.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:14 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:08:14.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:14 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:14.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:14 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:08:14.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:14 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:08:14.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:14 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:14.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:14 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:08:14.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:14 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:08:14.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:14 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:14.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:14 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:08:15.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:14 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:15.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:14 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:08:15.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:14 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:08:15.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:14 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:15.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:14 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:08:15.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:14 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:15.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:14 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:08:15.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:14 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:08:15.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:14 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:15.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:14 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:08:15.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:14 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:15.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:14 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:08:15.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:14 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:08:15.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:14 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:15.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:14 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:08:15.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:14 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:15.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:14 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:08:15.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:14 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:08:15.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:14 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:15.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:14 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:08:15.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:14 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:15.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:14 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:08:15.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:14 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:08:15.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:14 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:15.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:14 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:08:15.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:14 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:15.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:14 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:08:15.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:14 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:08:15.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:14 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:15.078 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 14:08:14 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[71049]: ::ffff:172.21.15.181 - - [30/Mar/2024:14:08:14] "GET /metrics HTTP/1.1" 200 38247 "" "Prometheus/2.43.0" 2024-03-30T14:08:15.828 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:15 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:08:15.828 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:15 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:08:15.829 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:15 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:08:15.829 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:15 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:08:15.829 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:15 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:08:15.829 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:15 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:08:15.829 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:15 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:08:15.829 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:15 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:08:15.829 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:15 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:15.829 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:15 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:08:15.829 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:15 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:08:15.829 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:15 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:15.829 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:15 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:08:15.829 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:15 smithi099 ceph-mon[137093]: Health check update: Degraded data redundancy: 74/627 objects degraded (11.802%), 21 pgs degraded (PG_DEGRADED) 2024-03-30T14:08:15.829 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:15 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:08:15.829 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:15 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:15.829 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:15 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:08:15.830 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:15 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:08:15.830 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:15 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:15.830 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:15 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:08:15.830 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:15 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:15.830 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:15 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:08:15.830 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:15 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:08:15.830 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:15 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:15.830 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:15 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:08:15.830 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:15 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:15.830 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:15 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:08:15.830 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:15 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:08:15.830 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:15 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:15.830 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:15 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:08:15.831 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:15 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:08:15.831 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:15 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:08:15.831 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:15 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:08:15.831 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:15 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:08:15.831 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:15 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:08:15.831 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:15 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:08:15.831 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:15 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:08:15.831 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:15 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:08:15.831 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:15 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:15.831 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:15 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:08:15.831 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:15 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:08:15.832 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:15 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:15.832 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:15 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:08:15.832 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:15 smithi099 ceph-mon[143401]: Health check update: Degraded data redundancy: 74/627 objects degraded (11.802%), 21 pgs degraded (PG_DEGRADED) 2024-03-30T14:08:15.832 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:15 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:08:15.832 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:15 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:15.832 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:15 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:08:15.832 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:15 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:08:15.832 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:15 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:15.832 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:15 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:08:15.832 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:15 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:15.832 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:15 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:08:15.832 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:15 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:08:15.832 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:15 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:15.832 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:15 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:08:15.832 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:15 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:15.833 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:15 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:08:15.833 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:15 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:08:15.833 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:15 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:15.833 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:15 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:08:15.833 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:15 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:15.833 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:15 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:08:15.833 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:15 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:08:15.833 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:15 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:15.833 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:15 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:08:15.834 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:15 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:15.834 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:15 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:08:15.834 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:15 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:08:15.834 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:15 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:15.834 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:15 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:08:15.834 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:15 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:15.834 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:15 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:08:15.834 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:15 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:08:15.834 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:15 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:15.834 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:15 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:08:15.834 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:15 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:15.834 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:15 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:08:15.834 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:15 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:08:15.834 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:15 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:15.835 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:15 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:15.835 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:15 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:08:15.835 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:15 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:08:15.835 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:15 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:15.835 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:15 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:08:15.835 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:15 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:15.835 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:15 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:08:15.835 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:15 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:08:15.835 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:15 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:15.835 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:15 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:08:15.835 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:15 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:15.836 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:15 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:08:15.836 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:15 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:08:15.836 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:15 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:15.836 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:15 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:08:15.836 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:15 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:15.836 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:15 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:08:15.836 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:15 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:08:15.836 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:15 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:15.997 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:15 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:08:15.998 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:15 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:08:15.998 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:15 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:08:15.998 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:15 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:08:15.998 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:15 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:08:15.998 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:15 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:08:15.998 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:15 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:08:15.998 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:15 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:08:15.998 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:15 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:15.998 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:15 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:08:15.998 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:15 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:08:15.998 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:15 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:15.998 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:15 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:08:15.998 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:15 smithi181 ceph-mon[115276]: Health check update: Degraded data redundancy: 74/627 objects degraded (11.802%), 21 pgs degraded (PG_DEGRADED) 2024-03-30T14:08:15.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:15 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:08:15.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:15 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:15.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:15 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:08:15.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:15 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:08:15.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:15 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:15.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:15 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:08:15.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:15 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:15.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:15 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:08:15.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:15 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:08:15.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:15 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:15.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:15 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:08:15.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:15 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:15.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:15 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:08:15.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:15 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:08:15.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:15 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:16.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:15 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:08:16.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:15 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:16.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:15 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:08:16.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:15 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:08:16.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:15 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:16.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:15 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:08:16.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:15 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:16.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:15 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:08:16.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:15 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:08:16.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:15 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:16.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:15 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:08:16.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:15 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:16.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:15 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:08:16.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:15 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:08:16.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:15 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:16.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:15 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:08:16.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:15 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:16.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:15 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:08:16.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:15 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:08:16.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:15 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:16.829 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:16 smithi099 ceph-mon[143401]: pgmap v162: 161 pgs: 1 active+recovering+degraded, 14 active+undersized+degraded, 2 active+recovery_wait+degraded, 26 active+undersized, 118 active+clean; 585 KiB data, 178 MiB used, 715 GiB / 715 GiB avail; 95 KiB/s rd, 0 B/s wr, 159 op/s; 63/627 objects degraded (10.048%); 0 B/s, 1 objects/s recovering 2024-03-30T14:08:16.829 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:16 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:08:16.829 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:16 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:08:16.829 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:16 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:08:16.829 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:16 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:08:16.829 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:16 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:08:16.829 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:16 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:08:16.829 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:16 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:08:16.829 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:16 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:08:16.829 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:16 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:16.829 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:16 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:08:16.829 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:16 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:08:16.829 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:16 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:16.830 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:16 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:08:16.830 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:16 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:08:16.830 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:16 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:16.830 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:16 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:08:16.830 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:16 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:08:16.830 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:16 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:16.830 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:16 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:08:16.830 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:16 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:16.830 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:16 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:08:16.830 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:16 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:08:16.830 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:16 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:16.830 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:16 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:08:16.830 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:16 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:16.830 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:16 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:08:16.830 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:16 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:08:16.831 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:16 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:16.831 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:16 smithi099 ceph-mon[137093]: pgmap v162: 161 pgs: 1 active+recovering+degraded, 14 active+undersized+degraded, 2 active+recovery_wait+degraded, 26 active+undersized, 118 active+clean; 585 KiB data, 178 MiB used, 715 GiB / 715 GiB avail; 95 KiB/s rd, 0 B/s wr, 159 op/s; 63/627 objects degraded (10.048%); 0 B/s, 1 objects/s recovering 2024-03-30T14:08:16.831 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:16 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:08:16.831 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:16 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:08:16.831 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:16 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:08:16.831 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:16 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:08:16.831 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:16 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:08:16.831 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:16 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:08:16.831 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:16 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:08:16.831 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:16 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:08:16.831 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:16 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:16.832 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:16 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:08:16.832 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:16 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:08:16.832 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:16 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:16.832 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:16 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:08:16.832 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:16 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:08:16.832 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:16 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:16.832 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:16 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:08:16.832 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:16 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:08:16.832 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:16 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:16.832 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:16 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:08:16.832 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:16 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:16.832 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:16 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:08:16.832 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:16 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:08:16.832 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:16 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:16.832 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:16 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:08:16.832 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:16 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:16.833 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:16 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:08:16.833 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:16 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:08:16.833 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:16 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:16.833 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:16 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:08:16.833 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:16 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:16.833 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:16 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:08:16.833 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:16 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:08:16.833 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:16 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:16.833 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:16 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:08:16.834 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:16 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:16.834 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:16 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:08:16.834 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:16 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:08:16.834 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:16 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:16.834 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:16 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:08:16.834 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:16 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:16.834 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:16 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:08:16.834 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:16 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:08:16.834 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:16 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:16.834 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:16 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:08:16.834 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:16 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:16.834 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:16 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:08:16.834 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:16 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:08:16.834 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:16 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:16.834 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:16 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:08:16.835 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:16 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:16.835 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:16 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:08:16.835 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:16 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:08:16.835 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:16 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:16.835 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:16 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:08:16.835 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:16 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:16.835 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:16 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:08:16.835 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:16 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:08:16.835 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:16 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:16.835 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:16 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:08:16.835 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:16 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:16.835 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:16 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:08:16.836 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:16 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:08:16.836 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:16 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:16.836 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:16 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:08:16.836 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:16 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:16.836 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:16 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:08:16.836 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:16 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:08:16.836 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:16 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:16.836 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:16 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:08:16.836 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:16 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:16.836 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:16 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:08:16.836 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:16 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:08:16.836 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:16 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:16.836 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:16 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:08:16.836 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:16 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:16.837 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:16 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:08:16.837 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:16 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:08:16.837 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:16 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:16.837 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:16 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:08:16.837 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:16 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:16.837 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:16 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:08:16.837 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:16 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:08:16.837 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:16 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:16.837 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:16 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:08:16.837 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:16 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:16.837 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:16 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:08:16.837 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:16 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:08:16.837 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:16 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:16.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:16 smithi181 ceph-mon[115276]: pgmap v162: 161 pgs: 1 active+recovering+degraded, 14 active+undersized+degraded, 2 active+recovery_wait+degraded, 26 active+undersized, 118 active+clean; 585 KiB data, 178 MiB used, 715 GiB / 715 GiB avail; 95 KiB/s rd, 0 B/s wr, 159 op/s; 63/627 objects degraded (10.048%); 0 B/s, 1 objects/s recovering 2024-03-30T14:08:16.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:16 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:08:16.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:16 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:08:16.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:16 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:08:16.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:16 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:08:16.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:16 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:08:16.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:16 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:08:16.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:16 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:08:16.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:16 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:08:16.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:16 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:16.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:16 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:08:16.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:16 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:08:16.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:16 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:16.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:16 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:08:17.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:16 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:08:17.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:16 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:17.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:16 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:08:17.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:16 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:08:17.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:16 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:17.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:16 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:08:17.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:16 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:17.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:16 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:08:17.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:16 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:08:17.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:16 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:17.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:16 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:08:17.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:16 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:17.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:16 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:08:17.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:16 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:08:17.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:16 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:17.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:16 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:08:17.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:16 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:17.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:16 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:08:17.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:16 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:08:17.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:16 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:17.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:16 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:08:17.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:16 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:17.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:16 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:08:17.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:16 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:08:17.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:16 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:17.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:16 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:08:17.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:16 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:17.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:16 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:08:17.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:16 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:08:17.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:16 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:17.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:16 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:08:17.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:16 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:17.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:16 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:08:17.002 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:16 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:08:17.002 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:16 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:17.002 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:16 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:08:17.002 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:16 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:17.002 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:16 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:08:17.002 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:16 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:08:17.002 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:16 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:17.002 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:16 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:08:17.002 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:16 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:17.002 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:16 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:08:17.002 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:16 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:08:17.002 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:16 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:17.998 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:17 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:08:17.998 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:17 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:08:17.998 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:17 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:08:17.998 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:17 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:08:17.998 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:17 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:08:17.998 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:17 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:08:17.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:17 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:08:17.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:17 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:08:17.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:17 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:08:17.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:17 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:08:17.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:17 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:17.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:17 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:08:17.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:17 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:08:17.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:17 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:17.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:17 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:08:17.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:17 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:08:17.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:17 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:17.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:17 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:08:17.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:17 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:08:17.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:17 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:18.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:17 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:08:18.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:17 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:18.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:17 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:08:18.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:17 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:08:18.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:17 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:18.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:17 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:08:18.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:17 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:18.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:17 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:08:18.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:17 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:08:18.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:17 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:18.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:17 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:08:18.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:17 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:18.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:17 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:08:18.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:17 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:08:18.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:17 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:18.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:17 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:08:18.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:17 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:18.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:17 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:08:18.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:17 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:08:18.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:17 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:18.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:17 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:08:18.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:17 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:18.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:17 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:08:18.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:17 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:08:18.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:17 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:18.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:17 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:08:18.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:17 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:18.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:17 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:08:18.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:17 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:08:18.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:17 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:18.002 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:17 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:08:18.002 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:17 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:18.002 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:17 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:08:18.002 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:17 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:08:18.002 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:17 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:18.002 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:17 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:08:18.002 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:17 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:18.002 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:17 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:08:18.002 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:17 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:08:18.002 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:17 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:18.002 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:17 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:08:18.002 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:17 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:18.002 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:17 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:08:18.002 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:17 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:08:18.003 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:17 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:18.003 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:17 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:08:18.003 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:17 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:18.003 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:17 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:08:18.003 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:17 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:08:18.003 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:17 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:18.078 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:17 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:08:18.079 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:17 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:08:18.079 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:17 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:08:18.079 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:17 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:08:18.079 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:17 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:08:18.079 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:17 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:08:18.079 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:17 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:08:18.079 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:17 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:08:18.079 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:17 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:08:18.079 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:17 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:08:18.079 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:17 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:18.079 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:17 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:08:18.079 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:17 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:08:18.079 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:17 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:18.079 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:17 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:08:18.080 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:17 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:08:18.080 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:17 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:18.080 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:17 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:08:18.080 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:17 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:08:18.080 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:17 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:18.080 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:17 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:08:18.080 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:17 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:18.080 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:17 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:08:18.080 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:17 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:08:18.080 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:17 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:18.080 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:17 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:08:18.080 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:17 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:18.080 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:17 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:08:18.080 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:17 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:08:18.080 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:17 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:18.081 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:17 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:08:18.081 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:17 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:18.081 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:17 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:08:18.081 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:17 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:08:18.081 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:17 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:18.081 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:17 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:08:18.081 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:17 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:18.081 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:17 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:08:18.081 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:17 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:08:18.081 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:17 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:18.081 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:17 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:08:18.081 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:17 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:18.081 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:17 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:08:18.081 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:17 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:08:18.081 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:17 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:18.081 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:17 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:08:18.082 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:17 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:18.082 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:17 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:08:18.082 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:17 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:08:18.082 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:17 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:18.082 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:17 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:08:18.082 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:17 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:18.082 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:17 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:08:18.082 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:17 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:08:18.082 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:17 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:18.082 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:17 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:08:18.082 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:17 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:18.082 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:17 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:08:18.082 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:17 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:08:18.082 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:17 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:18.083 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:17 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:08:18.083 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:17 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:08:18.083 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:17 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:08:18.083 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:17 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:08:18.083 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:17 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:08:18.083 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:17 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:08:18.083 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:17 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:08:18.083 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:17 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:08:18.083 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:17 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:08:18.083 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:17 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:08:18.083 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:17 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:18.083 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:17 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:08:18.083 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:17 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:08:18.084 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:17 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:18.084 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:17 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:08:18.084 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:17 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:08:18.084 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:17 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:18.084 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:17 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:08:18.084 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:17 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:08:18.084 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:17 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:18.084 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:17 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:08:18.084 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:17 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:18.084 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:17 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:08:18.084 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:17 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:08:18.084 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:17 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:18.084 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:17 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:08:18.084 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:17 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:18.084 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:17 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:08:18.085 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:17 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:08:18.085 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:17 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:18.085 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:17 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:08:18.085 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:17 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:08:18.085 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:17 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:18.085 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:17 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:08:18.085 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:17 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:08:18.085 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:17 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:18.085 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:17 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:08:18.085 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:17 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:18.085 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:17 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:08:18.086 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:17 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:08:18.086 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:17 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:18.086 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:17 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:18.086 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:17 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:08:18.086 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:17 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:08:18.086 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:17 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:18.086 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:17 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:08:18.086 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:17 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:18.086 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:17 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:08:18.087 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:17 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:08:18.087 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:17 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:18.087 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:17 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:08:18.087 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:17 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:18.087 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:17 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:08:18.087 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:17 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:08:18.087 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:17 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:18.087 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:17 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:08:18.087 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:17 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:18.087 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:17 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:08:18.087 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:17 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:08:18.087 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:17 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:18.087 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:17 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:08:18.087 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:17 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:18.087 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:17 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:08:18.088 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:17 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:08:18.088 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:17 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:18.088 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:17 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:08:18.088 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:17 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:18.088 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:17 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:08:18.088 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:17 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:08:18.088 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:17 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:18.088 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:17 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:08:18.088 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:17 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:18.088 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:17 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:08:18.088 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:17 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:08:18.088 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:17 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:18.088 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:17 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:08:18.088 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:17 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:18.089 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:17 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:08:18.089 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:17 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:08:18.089 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:17 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:19.058 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:18 smithi099 ceph-mon[137093]: pgmap v163: 161 pgs: 1 active+recovering+degraded, 2 active+recovery_wait+degraded, 158 active+clean; 585 KiB data, 178 MiB used, 715 GiB / 715 GiB avail; 92 KiB/s rd, 0 B/s wr, 153 op/s; 13/627 objects degraded (2.073%); 0 B/s, 7 objects/s recovering 2024-03-30T14:08:19.058 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:18 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:08:19.058 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:18 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:08:19.058 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:18 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:08:19.058 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:18 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:08:19.058 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:18 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:08:19.058 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:18 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:08:19.058 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:18 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:08:19.058 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:18 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:08:19.058 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:18 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:08:19.058 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:18 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:08:19.058 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:18 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:08:19.059 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:18 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:08:19.059 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:18 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:19.059 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:18 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:08:19.059 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:18 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:08:19.059 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:18 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:19.059 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:18 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:08:19.059 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:18 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:19.059 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:18 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:08:19.059 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:18 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:08:19.059 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:18 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:19.059 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:18 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:08:19.059 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:18 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:19.059 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:18 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:08:19.059 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:18 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:08:19.059 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:18 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:19.060 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:18 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:08:19.060 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:18 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:19.060 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:18 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:08:19.060 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:18 smithi099 ceph-mon[143401]: pgmap v163: 161 pgs: 1 active+recovering+degraded, 2 active+recovery_wait+degraded, 158 active+clean; 585 KiB data, 178 MiB used, 715 GiB / 715 GiB avail; 92 KiB/s rd, 0 B/s wr, 153 op/s; 13/627 objects degraded (2.073%); 0 B/s, 7 objects/s recovering 2024-03-30T14:08:19.060 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:18 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:08:19.060 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:18 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:08:19.060 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:18 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:08:19.060 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:18 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:08:19.060 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:18 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:08:19.060 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:18 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:08:19.060 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:18 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:08:19.060 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:18 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:08:19.061 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:18 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:08:19.061 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:18 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:08:19.061 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:18 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:08:19.061 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:18 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:08:19.061 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:18 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:19.061 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:18 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:08:19.061 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:18 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:08:19.061 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:18 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:19.061 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:18 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:08:19.061 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:18 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:19.061 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:18 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:08:19.061 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:18 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:08:19.061 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:18 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:19.061 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:18 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:08:19.061 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:18 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:19.062 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:18 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:08:19.062 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:18 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:08:19.062 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:18 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:19.062 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:18 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:08:19.062 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:18 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:19.062 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:18 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:08:19.062 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:18 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:08:19.062 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:18 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:19.062 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:18 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:08:19.062 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:18 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:19.062 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:18 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:08:19.062 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:18 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:08:19.063 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:18 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:19.063 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:18 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:08:19.063 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:18 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:19.063 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:18 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:08:19.063 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:18 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:08:19.063 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:18 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:19.063 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:18 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:08:19.063 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:18 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:19.063 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:18 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:08:19.063 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:18 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:08:19.063 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:18 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:19.063 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:18 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:08:19.063 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:18 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:19.063 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:18 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:08:19.063 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:18 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:08:19.063 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:18 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:19.064 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:18 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:08:19.064 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:18 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:19.064 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:18 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:08:19.064 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:18 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:19.064 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:18 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:08:19.064 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:18 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:08:19.064 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:18 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:19.064 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:18 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:08:19.064 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:18 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:19.064 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:18 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:08:19.064 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:18 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:08:19.064 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:18 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:19.064 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:18 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:08:19.065 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:18 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:19.065 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:18 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:08:19.065 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:18 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:08:19.065 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:18 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:19.065 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:18 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:08:19.065 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:18 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:19.065 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:18 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:08:19.065 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:18 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:08:19.065 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:18 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:19.248 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:18 smithi181 ceph-mon[115276]: pgmap v163: 161 pgs: 1 active+recovering+degraded, 2 active+recovery_wait+degraded, 158 active+clean; 585 KiB data, 178 MiB used, 715 GiB / 715 GiB avail; 92 KiB/s rd, 0 B/s wr, 153 op/s; 13/627 objects degraded (2.073%); 0 B/s, 7 objects/s recovering 2024-03-30T14:08:19.248 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:18 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:08:19.248 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:18 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:08:19.248 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:18 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:08:19.248 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:18 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:08:19.248 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:18 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:08:19.248 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:18 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:08:19.248 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:18 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:08:19.248 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:18 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:08:19.248 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:18 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:08:19.248 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:18 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:08:19.248 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:18 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:08:19.249 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:18 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:08:19.249 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:18 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:19.249 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:18 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:08:19.249 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:18 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:08:19.249 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:18 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:19.249 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:18 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:08:19.249 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:18 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:19.249 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:18 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:08:19.249 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:18 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:08:19.249 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:18 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:19.249 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:18 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:08:19.249 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:18 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:19.249 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:18 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:08:19.249 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:18 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:08:19.249 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:18 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:19.249 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:18 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:08:19.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:18 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:19.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:18 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:08:19.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:18 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:08:19.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:18 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:19.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:18 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:08:19.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:18 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:19.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:18 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:08:19.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:18 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:08:19.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:18 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:19.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:18 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:08:19.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:18 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:19.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:18 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:08:19.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:18 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:08:19.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:18 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:19.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:18 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:08:19.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:18 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:19.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:18 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:08:19.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:18 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:08:19.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:18 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:19.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:18 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:08:19.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:18 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:19.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:18 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:08:19.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:18 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:08:19.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:18 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:20.078 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:19 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:08:20.079 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:19 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:08:20.079 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:19 smithi099 ceph-mon[143401]: from='client.25136 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T14:08:20.079 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:19 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:08:20.079 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:19 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:08:20.079 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:19 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:08:20.079 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:19 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:08:20.079 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:19 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:08:20.079 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:19 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:08:20.079 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:19 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:08:20.079 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:19 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:20.079 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:19 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:08:20.079 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:19 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:08:20.079 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:19 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:20.080 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:19 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:08:20.080 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:19 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:20.080 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:19 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:08:20.080 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:19 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:08:20.080 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:19 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:20.080 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:19 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:08:20.080 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:19 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:20.080 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:19 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:08:20.080 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:19 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:08:20.080 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:19 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:20.080 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:19 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:08:20.080 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:19 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:20.080 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:19 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:08:20.080 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:19 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:08:20.080 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:19 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:20.080 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:19 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:08:20.081 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:19 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:08:20.081 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:19 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:08:20.081 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:19 smithi099 ceph-mon[137093]: from='client.25136 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T14:08:20.081 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:19 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:08:20.081 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:19 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:08:20.081 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:19 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:08:20.081 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:19 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:08:20.081 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:19 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:08:20.081 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:19 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:08:20.081 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:19 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:08:20.081 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:19 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:20.081 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:19 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:08:20.082 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:19 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:08:20.082 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:19 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:20.082 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:19 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:08:20.082 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:19 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:20.082 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:19 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:08:20.082 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:19 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:08:20.082 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:19 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:20.082 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:19 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:08:20.082 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:19 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:20.082 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:19 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:08:20.082 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:19 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:08:20.082 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:19 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:20.082 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:19 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:08:20.082 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:19 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:20.083 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:19 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:08:20.083 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:19 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:08:20.083 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:19 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:20.083 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:19 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:08:20.083 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:19 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:20.083 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:19 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:08:20.083 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:19 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:08:20.083 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:19 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:20.083 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:19 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:08:20.083 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:19 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:20.083 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:19 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:08:20.084 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:19 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:08:20.084 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:19 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:20.084 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:19 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:08:20.084 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:19 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:20.084 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:19 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:08:20.084 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:19 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:08:20.084 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:19 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:20.084 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:19 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:08:20.084 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:19 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:20.084 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:19 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:08:20.084 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:19 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:08:20.084 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:19 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:20.084 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:19 smithi099 ceph-mon[143401]: Health check update: Degraded data redundancy: 13/627 objects degraded (2.073%), 3 pgs degraded (PG_DEGRADED) 2024-03-30T14:08:20.084 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:19 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:20.085 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:19 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:08:20.085 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:19 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:08:20.085 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:19 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:20.085 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:19 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:08:20.085 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:19 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:20.085 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:19 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:08:20.085 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:19 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:08:20.085 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:19 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:20.085 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:19 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:08:20.085 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:19 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:20.085 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:19 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:08:20.085 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:19 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:08:20.085 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:19 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:20.085 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:19 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:08:20.086 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:19 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:20.086 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:19 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:08:20.086 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:19 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:08:20.086 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:19 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:20.086 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:19 smithi099 ceph-mon[137093]: Health check update: Degraded data redundancy: 13/627 objects degraded (2.073%), 3 pgs degraded (PG_DEGRADED) 2024-03-30T14:08:20.167 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:19 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:08:20.167 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:19 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:08:20.167 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:19 smithi181 ceph-mon[115276]: from='client.25136 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T14:08:20.167 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:19 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:08:20.167 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:19 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:08:20.167 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:19 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:08:20.167 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:19 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:08:20.167 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:19 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:08:20.167 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:19 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:08:20.167 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:19 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:08:20.168 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:19 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:20.168 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:19 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:08:20.168 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:19 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:08:20.168 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:19 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:20.168 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:19 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:08:20.168 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:19 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:20.168 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:19 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:08:20.168 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:19 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:08:20.168 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:19 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:20.168 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:19 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:08:20.168 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:19 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:20.168 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:19 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:08:20.168 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:19 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:08:20.168 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:19 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:20.168 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:19 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:08:20.169 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:19 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:20.169 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:19 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:08:20.169 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:19 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:08:20.169 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:19 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:20.169 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:19 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:08:20.169 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:19 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:20.169 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:19 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:08:20.169 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:19 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:08:20.169 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:19 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:20.169 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:19 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:08:20.169 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:19 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:20.169 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:19 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:08:20.169 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:19 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:08:20.169 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:19 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:20.169 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:19 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:08:20.169 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:19 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:20.169 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:19 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:08:20.170 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:19 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:08:20.170 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:19 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:20.170 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:19 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:08:20.170 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:19 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:20.170 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:19 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:08:20.170 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:19 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:08:20.170 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:19 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:20.170 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:19 smithi181 ceph-mon[115276]: Health check update: Degraded data redundancy: 13/627 objects degraded (2.073%), 3 pgs degraded (PG_DEGRADED) 2024-03-30T14:08:21.078 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:20 smithi099 ceph-mon[137093]: pgmap v164: 161 pgs: 161 active+clean; 585 KiB data, 178 MiB used, 715 GiB / 715 GiB avail; 71 KiB/s rd, 0 B/s wr, 118 op/s; 0 B/s, 7 objects/s recovering 2024-03-30T14:08:21.078 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:20 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:08:21.079 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:20 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:08:21.079 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:20 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:08:21.079 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:20 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:08:21.079 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:20 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:08:21.079 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:20 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:08:21.079 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:20 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:08:21.079 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:20 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:08:21.079 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:20 smithi099 ceph-mon[137093]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 13/627 objects degraded (2.073%), 3 pgs degraded) 2024-03-30T14:08:21.079 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:20 smithi099 ceph-mon[137093]: Cluster is now healthy 2024-03-30T14:08:21.079 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:20 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:08:21.079 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:20 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:21.079 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:20 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:08:21.079 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:20 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:08:21.079 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:20 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:21.080 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:20 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:08:21.080 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:20 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:08:21.080 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:20 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:21.080 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:20 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:08:21.080 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:20 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:08:21.080 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:20 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:21.080 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:20 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:08:21.080 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:20 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:08:21.080 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:20 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:21.080 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:20 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:08:21.080 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:20 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:08:21.080 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:20 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:21.080 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:20 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:08:21.080 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:20 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:08:21.080 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:20 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:21.081 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:20 smithi099 ceph-mon[143401]: pgmap v164: 161 pgs: 161 active+clean; 585 KiB data, 178 MiB used, 715 GiB / 715 GiB avail; 71 KiB/s rd, 0 B/s wr, 118 op/s; 0 B/s, 7 objects/s recovering 2024-03-30T14:08:21.081 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:20 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:08:21.081 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:20 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:08:21.081 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:20 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:08:21.081 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:20 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:08:21.081 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:20 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:08:21.081 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:20 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:08:21.081 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:20 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:08:21.081 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:20 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:08:21.081 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:20 smithi099 ceph-mon[143401]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 13/627 objects degraded (2.073%), 3 pgs degraded) 2024-03-30T14:08:21.081 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:20 smithi099 ceph-mon[143401]: Cluster is now healthy 2024-03-30T14:08:21.082 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:20 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:08:21.082 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:20 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:21.082 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:20 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:08:21.082 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:20 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:08:21.082 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:20 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:21.082 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:20 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:08:21.082 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:20 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:08:21.082 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:20 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:21.082 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:20 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:08:21.082 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:20 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:08:21.082 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:20 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:21.082 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:20 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:08:21.082 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:20 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:08:21.082 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:20 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:21.083 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:20 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:08:21.083 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:20 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:08:21.083 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:20 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:21.083 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:20 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:08:21.083 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:20 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:08:21.083 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:20 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:21.083 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:20 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:08:21.083 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:20 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:08:21.083 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:20 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:21.084 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:20 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:08:21.084 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:20 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:08:21.084 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:20 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:21.084 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:20 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:08:21.084 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:20 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:08:21.084 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:20 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:21.084 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:20 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:08:21.084 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:20 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:08:21.084 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:20 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:21.084 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:20 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:08:21.084 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:20 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:08:21.084 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:20 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:21.084 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:20 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:08:21.084 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:20 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:08:21.084 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:20 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:21.085 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:20 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:08:21.085 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:20 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:08:21.085 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:20 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:21.085 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:20 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:08:21.085 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:20 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:08:21.085 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:20 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:21.085 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:20 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:08:21.085 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:20 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:08:21.085 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:20 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:21.085 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:20 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:08:21.085 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:20 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:08:21.085 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:20 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:21.085 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:20 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:08:21.085 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:20 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:08:21.085 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:20 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:21.086 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:20 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:08:21.086 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:20 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:08:21.086 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:20 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:21.086 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:20 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:08:21.086 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:20 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:08:21.086 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:20 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:21.086 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:20 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:08:21.086 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:20 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:08:21.086 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:20 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:21.086 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:20 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:08:21.086 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:20 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:08:21.087 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:20 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:21.087 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:20 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:08:21.087 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:20 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:08:21.087 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:20 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:21.087 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:20 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:08:21.087 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:20 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:08:21.087 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:20 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:21.087 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:20 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:08:21.087 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:20 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:08:21.087 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:20 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:21.087 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:20 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:08:21.087 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:20 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:08:21.087 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:20 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:21.087 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:20 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:08:21.088 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:20 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:08:21.088 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:20 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:21.088 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:20 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:08:21.088 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:20 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:08:21.088 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:20 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:21.088 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:20 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:08:21.088 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:20 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:08:21.088 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:20 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:21.088 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:20 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:08:21.088 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:20 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:08:21.088 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:20 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:21.088 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:20 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:08:21.088 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:20 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:08:21.088 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:20 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:21.088 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:20 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:08:21.088 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:20 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:08:21.089 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:20 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:21.089 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:20 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:08:21.089 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:20 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:08:21.089 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:20 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:21.089 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:20 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:08:21.089 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:20 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:08:21.089 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:20 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:21.089 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:20 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:08:21.089 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:20 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:08:21.089 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:20 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:21.248 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:20 smithi181 ceph-mon[115276]: pgmap v164: 161 pgs: 161 active+clean; 585 KiB data, 178 MiB used, 715 GiB / 715 GiB avail; 71 KiB/s rd, 0 B/s wr, 118 op/s; 0 B/s, 7 objects/s recovering 2024-03-30T14:08:21.248 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:20 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:08:21.248 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:20 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:08:21.248 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:20 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:08:21.248 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:20 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:08:21.248 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:20 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:08:21.248 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:20 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:08:21.248 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:20 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:08:21.248 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:20 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:08:21.248 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:20 smithi181 ceph-mon[115276]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 13/627 objects degraded (2.073%), 3 pgs degraded) 2024-03-30T14:08:21.248 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:20 smithi181 ceph-mon[115276]: Cluster is now healthy 2024-03-30T14:08:21.248 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:20 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:08:21.249 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:20 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:21.249 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:20 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:08:21.249 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:20 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:08:21.249 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:20 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:21.249 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:20 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:08:21.249 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:20 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:08:21.249 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:20 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:21.249 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:20 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:08:21.249 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:20 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:08:21.249 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:20 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:21.249 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:20 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:08:21.249 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:20 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:08:21.249 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:20 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:21.249 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:20 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:08:21.249 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:20 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:08:21.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:20 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:21.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:20 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:08:21.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:20 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:08:21.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:20 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:21.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:20 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:08:21.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:20 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:08:21.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:20 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:21.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:20 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:08:21.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:20 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:08:21.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:20 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:21.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:20 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:08:21.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:20 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:08:21.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:20 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:21.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:20 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:08:21.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:20 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:08:21.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:20 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:21.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:20 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:08:21.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:20 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:08:21.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:20 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:21.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:20 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:08:21.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:20 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:08:21.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:20 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:21.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:20 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:08:21.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:20 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:08:21.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:20 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:21.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:20 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:08:21.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:20 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:08:21.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:20 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:21.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:20 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:08:21.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:20 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:08:21.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:20 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:21.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:20 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:08:21.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:20 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:08:21.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:20 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:21.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:20 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:08:21.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:20 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:08:21.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:20 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:21.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:20 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:08:21.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:20 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:08:21.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:20 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:21.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:20 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:08:21.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:20 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:08:21.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:20 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:21.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:20 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:08:21.253 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:20 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:08:21.253 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:20 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:22.079 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:21 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:08:22.079 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:21 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:08:22.079 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:21 smithi099 ceph-mon[137093]: pgmap v165: 161 pgs: 161 active+clean; 585 KiB data, 178 MiB used, 715 GiB / 715 GiB avail; 63 KiB/s rd, 0 B/s wr, 104 op/s; 0 B/s, 6 objects/s recovering 2024-03-30T14:08:22.079 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:21 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:22.079 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:21 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:08:22.079 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:21 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:08:22.079 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:21 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:22.079 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:21 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:08:22.079 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:21 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:08:22.079 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:21 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:22.079 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:21 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:08:22.079 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:21 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:08:22.080 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:21 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:22.080 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:21 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:08:22.080 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:21 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:08:22.080 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:21 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:22.080 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:21 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:08:22.080 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:21 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:08:22.080 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:21 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:22.080 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:21 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:08:22.080 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:21 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:08:22.080 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:21 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:22.080 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:21 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:08:22.080 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:21 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:08:22.080 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:21 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:22.080 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:21 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:08:22.080 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:21 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:08:22.081 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:21 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:22.081 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:21 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:08:22.081 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:21 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:08:22.081 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:21 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:08:22.081 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:21 smithi099 ceph-mon[143401]: pgmap v165: 161 pgs: 161 active+clean; 585 KiB data, 178 MiB used, 715 GiB / 715 GiB avail; 63 KiB/s rd, 0 B/s wr, 104 op/s; 0 B/s, 6 objects/s recovering 2024-03-30T14:08:22.081 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:21 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:22.081 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:21 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:08:22.082 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:21 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:08:22.082 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:21 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:22.082 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:21 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:08:22.082 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:21 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:08:22.082 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:21 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:22.082 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:21 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:08:22.082 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:21 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:08:22.082 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:21 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:22.082 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:21 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:08:22.082 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:21 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:08:22.082 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:21 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:22.082 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:21 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:08:22.082 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:21 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:08:22.083 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:21 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:22.083 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:21 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:08:22.083 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:21 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:08:22.083 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:21 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:22.083 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:21 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:08:22.083 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:21 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:08:22.083 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:21 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:22.083 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:21 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:08:22.083 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:21 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:08:22.083 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:21 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:22.083 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:21 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:08:22.083 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:21 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:08:22.083 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:21 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:22.083 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:21 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:08:22.083 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:21 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:08:22.084 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:21 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:22.084 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:21 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:08:22.084 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:21 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:08:22.084 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:21 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:22.084 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:21 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:08:22.084 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:21 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:08:22.084 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:21 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:22.084 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:21 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:08:22.084 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:21 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:08:22.084 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:21 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:22.084 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:21 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:08:22.084 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:21 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:08:22.084 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:21 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:22.084 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:21 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:08:22.084 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:21 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:08:22.085 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:21 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:22.085 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:21 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:08:22.085 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:21 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:08:22.085 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:21 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:22.085 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:21 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:08:22.085 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:21 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:08:22.085 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:21 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:22.085 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:21 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:08:22.085 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:21 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:08:22.085 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:21 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:22.085 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:21 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:08:22.085 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:21 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:08:22.085 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:21 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:22.085 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:21 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:08:22.085 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:21 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:08:22.086 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:21 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:22.086 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:21 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:08:22.086 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:21 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:08:22.086 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:21 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:22.086 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:21 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:08:22.086 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:21 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:08:22.086 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:21 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:22.086 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:21 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:08:22.086 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:21 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:08:22.086 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:21 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:22.087 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:21 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:08:22.087 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:21 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:08:22.087 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:21 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:22.087 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:21 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:08:22.087 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:21 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:08:22.087 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:21 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:22.087 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:21 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:08:22.087 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:21 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:08:22.087 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:21 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:22.087 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:21 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:08:22.087 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:21 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:08:22.087 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:21 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:22.087 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:21 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:08:22.087 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:21 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:08:22.087 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:21 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:22.088 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:21 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:08:22.088 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:21 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:08:22.088 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:21 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:22.088 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:21 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:08:22.088 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:21 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:08:22.088 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:21 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:22.088 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:21 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:08:22.088 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:21 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:08:22.088 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:21 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:22.088 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:21 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:08:22.088 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:21 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:08:22.088 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:21 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:22.088 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:21 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:08:22.247 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:21 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:08:22.248 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:21 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:08:22.248 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:21 smithi181 ceph-mon[115276]: pgmap v165: 161 pgs: 161 active+clean; 585 KiB data, 178 MiB used, 715 GiB / 715 GiB avail; 63 KiB/s rd, 0 B/s wr, 104 op/s; 0 B/s, 6 objects/s recovering 2024-03-30T14:08:22.248 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:21 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:22.248 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:21 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:08:22.248 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:21 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:08:22.248 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:21 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:22.248 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:21 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:08:22.248 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:21 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:08:22.248 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:21 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:22.248 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:21 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:08:22.248 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:21 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:08:22.249 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:21 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:22.249 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:21 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:08:22.249 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:21 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:08:22.249 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:21 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:22.249 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:21 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:08:22.249 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:21 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:08:22.249 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:21 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:22.249 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:21 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:08:22.249 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:21 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:08:22.249 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:21 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:22.249 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:21 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:08:22.249 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:21 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:08:22.249 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:21 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:22.249 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:21 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:08:22.249 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:21 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:08:22.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:21 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:22.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:21 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:08:22.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:21 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:08:22.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:21 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:22.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:21 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:08:22.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:21 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:08:22.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:21 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:22.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:21 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:08:22.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:21 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:08:22.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:21 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:22.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:21 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:08:22.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:21 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:08:22.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:21 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:22.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:21 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:08:22.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:21 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:08:22.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:21 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:22.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:21 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:08:22.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:21 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:08:22.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:21 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:22.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:21 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:08:22.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:21 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:08:22.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:21 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:22.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:21 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:08:22.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:21 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:08:22.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:21 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:22.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:21 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:08:22.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:21 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:08:22.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:21 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:22.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:21 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:08:22.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:21 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:08:22.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:21 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:22.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:21 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:08:22.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:21 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:08:22.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:21 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:22.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:21 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:08:22.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:21 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:08:22.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:21 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:22.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:21 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:08:23.053 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:22 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:23.054 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:22 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T14:08:23.054 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:22 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:08:23.054 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:22 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:23.054 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:22 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:08:23.054 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:22 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:08:23.054 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:22 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:23.054 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:22 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:08:23.054 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:22 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:08:23.054 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:22 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:23.054 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:22 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:08:23.054 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:22 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:08:23.055 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:22 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:23.055 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:22 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:08:23.055 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:22 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:08:23.055 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:22 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:23.055 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:22 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:08:23.055 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:22 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:08:23.055 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:22 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:23.055 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:22 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:08:23.055 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:22 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:23.055 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:22 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:23.055 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:22 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:23.055 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:22 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:08:23.055 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:22 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:23.055 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:22 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:23.056 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:22 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:23.056 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:22 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-03-30T14:08:23.056 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:22 smithi181 ceph-mon[115276]: from='mon.2 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-03-30T14:08:23.056 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:22 smithi181 ceph-mon[115276]: Upgrade: osd.4 is safe to restart 2024-03-30T14:08:23.056 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:22 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:23.056 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:22 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:23.056 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:22 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:23.078 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:22 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:23.078 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:22 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T14:08:23.079 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:22 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:08:23.079 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:22 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:23.079 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:22 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:08:23.079 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:22 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:08:23.079 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:22 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:23.079 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:22 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:08:23.079 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:22 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:08:23.079 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:22 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:23.079 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:22 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:08:23.079 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:22 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:08:23.079 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:22 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:23.079 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:22 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:08:23.079 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:22 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:08:23.079 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:22 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:23.079 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:22 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:08:23.079 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:22 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:08:23.080 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:22 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:23.080 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:22 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:08:23.080 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:22 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:23.080 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:22 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:23.080 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:22 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:23.080 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:22 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:08:23.080 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:22 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:23.080 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:22 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:23.080 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:22 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:23.080 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:22 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-03-30T14:08:23.080 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:22 smithi099 ceph-mon[137093]: from='mon.2 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-03-30T14:08:23.080 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:22 smithi099 ceph-mon[137093]: Upgrade: osd.4 is safe to restart 2024-03-30T14:08:23.080 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:22 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:23.080 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:22 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:23.080 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:22 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:23.081 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:22 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:23.081 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:22 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T14:08:23.081 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:22 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:08:23.081 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:22 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:23.081 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:22 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:08:23.081 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:22 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:08:23.081 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:22 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:23.081 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:22 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:08:23.081 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:22 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:08:23.081 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:22 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:23.081 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:22 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:08:23.081 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:22 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:08:23.082 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:22 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:23.082 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:22 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:08:23.082 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:22 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:08:23.082 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:22 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:23.082 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:22 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:08:23.082 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:22 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:08:23.082 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:22 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:23.082 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:22 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:08:23.082 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:22 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:23.082 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:22 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:23.082 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:22 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:23.082 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:22 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:08:23.082 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:22 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:23.082 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:22 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:23.082 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:22 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:23.083 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:22 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-03-30T14:08:23.083 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:22 smithi099 ceph-mon[143401]: from='mon.2 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-03-30T14:08:23.083 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:22 smithi099 ceph-mon[143401]: Upgrade: osd.4 is safe to restart 2024-03-30T14:08:23.083 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:22 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:23.083 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:22 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:23.083 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:22 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:24.703 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:24 smithi181 ceph-mon[115276]: pgmap v166: 161 pgs: 161 active+clean; 585 KiB data, 178 MiB used, 715 GiB / 715 GiB avail; 56 KiB/s rd, 0 B/s wr, 93 op/s; 0 B/s, 5 objects/s recovering 2024-03-30T14:08:24.703 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:24 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:24.703 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:24 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-03-30T14:08:24.704 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:24 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:08:24.790 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:24 smithi099 ceph-mon[137093]: pgmap v166: 161 pgs: 161 active+clean; 585 KiB data, 178 MiB used, 715 GiB / 715 GiB avail; 56 KiB/s rd, 0 B/s wr, 93 op/s; 0 B/s, 5 objects/s recovering 2024-03-30T14:08:24.790 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:24 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:24.790 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:24 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-03-30T14:08:24.790 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:24 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:08:24.790 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:24 smithi099 ceph-mon[143401]: pgmap v166: 161 pgs: 161 active+clean; 585 KiB data, 178 MiB used, 715 GiB / 715 GiB avail; 56 KiB/s rd, 0 B/s wr, 93 op/s; 0 B/s, 5 objects/s recovering 2024-03-30T14:08:24.790 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:24 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:24.790 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:24 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-03-30T14:08:24.791 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:24 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:08:25.078 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 14:08:24 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[71049]: ::ffff:172.21.15.181 - - [30/Mar/2024:14:08:24] "GET /metrics HTTP/1.1" 200 38259 "" "Prometheus/2.43.0" 2024-03-30T14:08:25.396 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:25 smithi099 ceph-mon[137093]: Upgrade: Updating osd.4 2024-03-30T14:08:25.396 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:25 smithi099 ceph-mon[137093]: Deploying daemon osd.4 on smithi181 2024-03-30T14:08:25.396 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:25 smithi099 ceph-mon[143401]: Upgrade: Updating osd.4 2024-03-30T14:08:25.396 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:25 smithi099 ceph-mon[143401]: Deploying daemon osd.4 on smithi181 2024-03-30T14:08:25.693 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:25 smithi181 ceph-mon[115276]: Upgrade: Updating osd.4 2024-03-30T14:08:25.694 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:25 smithi181 ceph-mon[115276]: Deploying daemon osd.4 on smithi181 2024-03-30T14:08:25.986 INFO:teuthology.orchestra.run.smithi099.stdout:true 2024-03-30T14:08:26.654 INFO:teuthology.orchestra.run.smithi099.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-03-30T14:08:26.655 INFO:teuthology.orchestra.run.smithi099.stdout:agent.smithi099 smithi099 running 4s ago 36m - - 2024-03-30T14:08:26.655 INFO:teuthology.orchestra.run.smithi099.stdout:agent.smithi181 smithi181 running 17s ago 36m - - 2024-03-30T14:08:26.655 INFO:teuthology.orchestra.run.smithi099.stdout:alertmanager.a smithi099 *:9093,9094 running (7m) 4s ago 31m 26.9M - 0.25.0 c8568f914cd2 08735152b67d 2024-03-30T14:08:26.655 INFO:teuthology.orchestra.run.smithi099.stdout:grafana.a smithi181 *:3000 running (6m) 17s ago 30m 79.2M - 9.4.12 2bacad6d85d8 d599aa7730d6 2024-03-30T14:08:26.655 INFO:teuthology.orchestra.run.smithi099.stdout:iscsi.foo.smithi099.qyjuvr smithi099 running (9m) 4s ago 30m 59.6M - 3.5 e1d6a67b021e 2f859af6bc2a 2024-03-30T14:08:26.655 INFO:teuthology.orchestra.run.smithi099.stdout:mgr.x smithi181 *:8443,9283,8765 running (8m) 17s ago 35m 450M - 19.0.0-1967-g4e50bbcd b0c4478f1d83 f269106f7913 2024-03-30T14:08:26.655 INFO:teuthology.orchestra.run.smithi099.stdout:mgr.y smithi099 *:8443,9283,8765 running (19m) 4s ago 37m 525M - 19.0.0-1967-g4e50bbcd b0c4478f1d83 0d464b8c1d18 2024-03-30T14:08:26.655 INFO:teuthology.orchestra.run.smithi099.stdout:mon.a smithi099 running (4m) 4s ago 37m 59.2M 2048M 19.0.0-1967-g4e50bbcd b0c4478f1d83 f19388464dfd 2024-03-30T14:08:26.655 INFO:teuthology.orchestra.run.smithi099.stdout:mon.b smithi181 running (5m) 17s ago 36m 53.9M 2048M 19.0.0-1967-g4e50bbcd b0c4478f1d83 0468ed087cdd 2024-03-30T14:08:26.655 INFO:teuthology.orchestra.run.smithi099.stdout:mon.c smithi099 running (4m) 4s ago 36m 51.2M 2048M 19.0.0-1967-g4e50bbcd b0c4478f1d83 731056a2fea6 2024-03-30T14:08:26.655 INFO:teuthology.orchestra.run.smithi099.stdout:node-exporter.a smithi099 *:9100 running (8m) 4s ago 32m 16.0M - 1.5.0 0da6a335fe13 4a3f1f6e7068 2024-03-30T14:08:26.655 INFO:teuthology.orchestra.run.smithi099.stdout:node-exporter.b smithi181 *:9100 running (8m) 17s ago 31m 16.1M - 1.5.0 0da6a335fe13 acea317b5f5d 2024-03-30T14:08:26.655 INFO:teuthology.orchestra.run.smithi099.stdout:osd.0 smithi099 running (2m) 4s ago 35m 54.9M 4096M 19.0.0-1967-g4e50bbcd b0c4478f1d83 d97d48cb3314 2024-03-30T14:08:26.655 INFO:teuthology.orchestra.run.smithi099.stdout:osd.1 smithi099 running (2m) 4s ago 35m 56.9M 4096M 19.0.0-1967-g4e50bbcd b0c4478f1d83 a843295ce83b 2024-03-30T14:08:26.655 INFO:teuthology.orchestra.run.smithi099.stdout:osd.2 smithi099 running (81s) 4s ago 34m 44.7M 4096M 19.0.0-1967-g4e50bbcd b0c4478f1d83 18304adfb0d0 2024-03-30T14:08:26.656 INFO:teuthology.orchestra.run.smithi099.stdout:osd.3 smithi099 running (20s) 4s ago 34m 44.8M 4096M 19.0.0-1967-g4e50bbcd b0c4478f1d83 9b38d79f070e 2024-03-30T14:08:26.656 INFO:teuthology.orchestra.run.smithi099.stdout:osd.4 smithi181 running (34m) 17s ago 34m 58.7M 4096M 17.2.0 e1d6a67b021e 5e205434e973 2024-03-30T14:08:26.656 INFO:teuthology.orchestra.run.smithi099.stdout:osd.5 smithi181 running (33m) 17s ago 33m 55.8M 4096M 17.2.0 e1d6a67b021e e330c920f152 2024-03-30T14:08:26.656 INFO:teuthology.orchestra.run.smithi099.stdout:osd.6 smithi181 running (33m) 17s ago 33m 54.6M 4096M 17.2.0 e1d6a67b021e 81d889ea213d 2024-03-30T14:08:26.656 INFO:teuthology.orchestra.run.smithi099.stdout:osd.7 smithi181 running (32m) 17s ago 32m 58.1M 4096M 17.2.0 e1d6a67b021e c08b1839dd7e 2024-03-30T14:08:26.656 INFO:teuthology.orchestra.run.smithi099.stdout:prometheus.a smithi181 *:9095 running (7m) 17s ago 32m 70.4M - 2.43.0 a07b618ecd1d 004088bdf70e 2024-03-30T14:08:26.656 INFO:teuthology.orchestra.run.smithi099.stdout:rgw.foo.smithi099.fxjbmp smithi099 *:8000 running (30m) 4s ago 30m 78.8M - 17.2.0 e1d6a67b021e 400b28b3f650 2024-03-30T14:08:26.656 INFO:teuthology.orchestra.run.smithi099.stdout:rgw.foo.smithi181.wfqwti smithi181 *:8000 running (30m) 17s ago 30m 78.1M - 17.2.0 e1d6a67b021e 97e1b130f9d4 2024-03-30T14:08:26.656 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:26 smithi099 ceph-mon[137093]: pgmap v167: 161 pgs: 161 active+clean; 585 KiB data, 178 MiB used, 715 GiB / 715 GiB avail; 18 KiB/s rd, 0 B/s wr, 29 op/s; 0 B/s, 4 objects/s recovering 2024-03-30T14:08:26.656 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:26 smithi099 ceph-mon[143401]: pgmap v167: 161 pgs: 161 active+clean; 585 KiB data, 178 MiB used, 715 GiB / 715 GiB avail; 18 KiB/s rd, 0 B/s wr, 29 op/s; 0 B/s, 4 objects/s recovering 2024-03-30T14:08:26.681 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:26 smithi181 ceph-mon[115276]: pgmap v167: 161 pgs: 161 active+clean; 585 KiB data, 178 MiB used, 715 GiB / 715 GiB avail; 18 KiB/s rd, 0 B/s wr, 29 op/s; 0 B/s, 4 objects/s recovering 2024-03-30T14:08:27.057 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-03-30T14:08:27.058 INFO:teuthology.orchestra.run.smithi099.stdout: "mon": { 2024-03-30T14:08:27.058 INFO:teuthology.orchestra.run.smithi099.stdout: "ceph version 19.0.0-1967-g4e50bbcd (4e50bbcdd1630c7760b708f3a5b4d38a121e66cb) squid (dev)": 3 2024-03-30T14:08:27.058 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T14:08:27.058 INFO:teuthology.orchestra.run.smithi099.stdout: "mgr": { 2024-03-30T14:08:27.058 INFO:teuthology.orchestra.run.smithi099.stdout: "ceph version 19.0.0-1967-g4e50bbcd (4e50bbcdd1630c7760b708f3a5b4d38a121e66cb) squid (dev)": 2 2024-03-30T14:08:27.058 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T14:08:27.058 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": { 2024-03-30T14:08:27.058 INFO:teuthology.orchestra.run.smithi099.stdout: "ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)": 4, 2024-03-30T14:08:27.058 INFO:teuthology.orchestra.run.smithi099.stdout: "ceph version 19.0.0-1967-g4e50bbcd (4e50bbcdd1630c7760b708f3a5b4d38a121e66cb) squid (dev)": 4 2024-03-30T14:08:27.058 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T14:08:27.058 INFO:teuthology.orchestra.run.smithi099.stdout: "rgw": { 2024-03-30T14:08:27.058 INFO:teuthology.orchestra.run.smithi099.stdout: "ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)": 2 2024-03-30T14:08:27.058 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T14:08:27.059 INFO:teuthology.orchestra.run.smithi099.stdout: "overall": { 2024-03-30T14:08:27.059 INFO:teuthology.orchestra.run.smithi099.stdout: "ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)": 6, 2024-03-30T14:08:27.059 INFO:teuthology.orchestra.run.smithi099.stdout: "ceph version 19.0.0-1967-g4e50bbcd (4e50bbcdd1630c7760b708f3a5b4d38a121e66cb) squid (dev)": 9 2024-03-30T14:08:27.059 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-03-30T14:08:27.059 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-03-30T14:08:27.247 INFO:journalctl@ceph.osd.4.smithi181.stdout:Mar 30 14:08:27 smithi181 systemd[1]: Stopping Ceph osd.4 for 98ebaeb8-ee99-11ee-b647-cb9ed24678a4... 2024-03-30T14:08:27.387 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-03-30T14:08:27.387 INFO:teuthology.orchestra.run.smithi099.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph:4e50bbcdd1630c7760b708f3a5b4d38a121e66cb", 2024-03-30T14:08:27.387 INFO:teuthology.orchestra.run.smithi099.stdout: "in_progress": true, 2024-03-30T14:08:27.387 INFO:teuthology.orchestra.run.smithi099.stdout: "which": "Upgrading daemons of type(s) crash,osd", 2024-03-30T14:08:27.388 INFO:teuthology.orchestra.run.smithi099.stdout: "services_complete": [], 2024-03-30T14:08:27.388 INFO:teuthology.orchestra.run.smithi099.stdout: "progress": "4/8 daemons upgraded", 2024-03-30T14:08:27.388 INFO:teuthology.orchestra.run.smithi099.stdout: "message": "Currently upgrading osd daemons", 2024-03-30T14:08:27.388 INFO:teuthology.orchestra.run.smithi099.stdout: "is_paused": false 2024-03-30T14:08:27.388 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-03-30T14:08:27.623 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:27 smithi181 ceph-mon[115276]: from='client.64408 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T14:08:27.623 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:27 smithi181 ceph-mon[115276]: from='client.54411 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T14:08:27.623 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:27 smithi181 ceph-mon[115276]: from='client.64420 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T14:08:27.623 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:27 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:27.623 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:27 smithi181 ceph-mon[115276]: from='client.? 172.21.15.99:0/3742463538' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:27.828 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:27 smithi099 ceph-mon[137093]: from='client.64408 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T14:08:27.828 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:27 smithi099 ceph-mon[137093]: from='client.54411 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T14:08:27.828 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:27 smithi099 ceph-mon[137093]: from='client.64420 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T14:08:27.828 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:27 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:27.829 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:27 smithi099 ceph-mon[137093]: from='client.? 172.21.15.99:0/3742463538' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:27.829 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:27 smithi099 ceph-mon[143401]: from='client.64408 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T14:08:27.829 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:27 smithi099 ceph-mon[143401]: from='client.54411 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T14:08:27.829 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:27 smithi099 ceph-mon[143401]: from='client.64420 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T14:08:27.829 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:27 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:27.829 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:27 smithi099 ceph-mon[143401]: from='client.? 172.21.15.99:0/3742463538' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:28.247 INFO:journalctl@ceph.osd.4.smithi181.stdout:Mar 30 14:08:28 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-4[30503]: 2024-03-30T14:08:28.200+0000 7f4324a3d700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.4 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-03-30T14:08:28.247 INFO:journalctl@ceph.osd.4.smithi181.stdout:Mar 30 14:08:28 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-4[30503]: 2024-03-30T14:08:28.200+0000 7f4324a3d700 -1 osd.4 133 *** Got signal Terminated *** 2024-03-30T14:08:28.247 INFO:journalctl@ceph.osd.4.smithi181.stdout:Mar 30 14:08:28 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-4[30503]: 2024-03-30T14:08:28.200+0000 7f4324a3d700 -1 osd.4 133 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-03-30T14:08:28.749 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:28 smithi181 ceph-mon[115276]: pgmap v168: 161 pgs: 161 active+clean; 585 KiB data, 178 MiB used, 715 GiB / 715 GiB avail; 14 KiB/s rd, 0 B/s wr, 22 op/s; 0 B/s, 4 objects/s recovering 2024-03-30T14:08:28.749 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:28 smithi181 ceph-mon[115276]: from='client.64432 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T14:08:28.749 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:28 smithi181 ceph-mon[115276]: osd.4 marked itself down and dead 2024-03-30T14:08:28.828 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:28 smithi099 ceph-mon[137093]: pgmap v168: 161 pgs: 161 active+clean; 585 KiB data, 178 MiB used, 715 GiB / 715 GiB avail; 14 KiB/s rd, 0 B/s wr, 22 op/s; 0 B/s, 4 objects/s recovering 2024-03-30T14:08:28.828 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:28 smithi099 ceph-mon[137093]: from='client.64432 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T14:08:28.828 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:28 smithi099 ceph-mon[137093]: osd.4 marked itself down and dead 2024-03-30T14:08:28.828 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:28 smithi099 ceph-mon[143401]: pgmap v168: 161 pgs: 161 active+clean; 585 KiB data, 178 MiB used, 715 GiB / 715 GiB avail; 14 KiB/s rd, 0 B/s wr, 22 op/s; 0 B/s, 4 objects/s recovering 2024-03-30T14:08:28.829 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:28 smithi099 ceph-mon[143401]: from='client.64432 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T14:08:28.829 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:28 smithi099 ceph-mon[143401]: osd.4 marked itself down and dead 2024-03-30T14:08:29.247 INFO:journalctl@ceph.osd.4.smithi181.stdout:Mar 30 14:08:28 smithi181 podman[148870]: 2024-03-30 14:08:28.865508634 +0000 UTC m=+0.774645823 container died 5e205434e973e822194d5cd5d9eee0386ab8711f3f401b73ab687c5c6b31417e (image=quay.io/ceph/ceph@sha256:12a0a4f43413fd97a14a3d47a3451b2d2df50020835bb93db666209f3f77617a, name=ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-4, io.openshift.tags=base centos centos-stream, GIT_BRANCH=HEAD, GIT_COMMIT=b613db0f44179c0940781c1c7fe04e1acb7093ac, name=centos-stream, ceph=True, io.buildah.version=1.19.8, com.redhat.build-host=cpt-1002.osbs.prod.upshift.rdu2.redhat.com, com.redhat.license_terms=https://centos.org/legal/licensing-policy/, build-date=2022-05-03T08:36:31.336870, GIT_CLEAN=True, version=8, description=CentOS Stream is a continuously delivered distro that tracks just ahead of Red Hat Enterprise Linux development. This image takes the Red Hat UBI and layers on content from CentOS Stream, maintainer=Guillaume Abrioux , url=https://access.redhat.com/containers/#/registry.access.redhat.com/ubi8/images/8.6-754, RELEASE=HEAD, vcs-ref=f1ee6e37554363ec55e0035aba1a693d3627fdeb, release=754, io.k8s.display-name=CentOS Stream 8, summary=Provides a CentOS Stream container based on the Red Hat Universal Base Image, distribution-scope=public, io.k8s.description=The Universal Base Image is designed and engineered to be the base layer for all of your containerized applications, middleware and utilities. This base image is freely redistributable, but Red Hat only supports Red Hat technologies through subscriptions for Red Hat products. This image is maintained by Red Hat and updated regularly., io.openshift.expose-services=, vcs-type=git, vendor=Red Hat, Inc., CEPH_POINT_RELEASE=-17.2.0, architecture=x86_64, GIT_REPO=https://github.com/ceph/ceph-container.git, com.redhat.component=centos-stream-container) 2024-03-30T14:08:29.730 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:29 smithi099 ceph-mon[137093]: from='client.25136 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T14:08:29.730 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:29 smithi099 ceph-mon[137093]: Health check failed: 1 osds down (OSD_DOWN) 2024-03-30T14:08:29.731 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:29 smithi099 ceph-mon[137093]: failed to encode map e134 with expected crc 2024-03-30T14:08:29.731 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:29 smithi099 ceph-mon[137093]: failed to encode map e134 with expected crc 2024-03-30T14:08:29.731 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:29 smithi099 ceph-mon[137093]: failed to encode map e134 with expected crc 2024-03-30T14:08:29.731 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:29 smithi099 ceph-mon[137093]: osdmap e134: 8 total, 7 up, 8 in 2024-03-30T14:08:29.731 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:29 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:29.731 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:29 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:29.731 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:29 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:29.731 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:29 smithi099 ceph-mon[143401]: from='client.25136 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T14:08:29.731 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:29 smithi099 ceph-mon[143401]: Health check failed: 1 osds down (OSD_DOWN) 2024-03-30T14:08:29.731 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:29 smithi099 ceph-mon[143401]: failed to encode map e134 with expected crc 2024-03-30T14:08:29.731 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:29 smithi099 ceph-mon[143401]: failed to encode map e134 with expected crc 2024-03-30T14:08:29.731 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:29 smithi099 ceph-mon[143401]: failed to encode map e134 with expected crc 2024-03-30T14:08:29.731 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:29 smithi099 ceph-mon[143401]: osdmap e134: 8 total, 7 up, 8 in 2024-03-30T14:08:29.732 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:29 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:29.732 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:29 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:29.732 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:29 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:29.734 INFO:journalctl@ceph.osd.4.smithi181.stdout:Mar 30 14:08:29 smithi181 podman[148870]: 2024-03-30 14:08:29.350385713 +0000 UTC m=+1.259522886 container cleanup 5e205434e973e822194d5cd5d9eee0386ab8711f3f401b73ab687c5c6b31417e (image=quay.io/ceph/ceph@sha256:12a0a4f43413fd97a14a3d47a3451b2d2df50020835bb93db666209f3f77617a, name=ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-4, vcs-ref=f1ee6e37554363ec55e0035aba1a693d3627fdeb, release=754, io.openshift.tags=base centos centos-stream, ceph=True, GIT_COMMIT=b613db0f44179c0940781c1c7fe04e1acb7093ac, distribution-scope=public, com.redhat.build-host=cpt-1002.osbs.prod.upshift.rdu2.redhat.com, io.k8s.description=The Universal Base Image is designed and engineered to be the base layer for all of your containerized applications, middleware and utilities. This base image is freely redistributable, but Red Hat only supports Red Hat technologies through subscriptions for Red Hat products. This image is maintained by Red Hat and updated regularly., vcs-type=git, RELEASE=HEAD, summary=Provides a CentOS Stream container based on the Red Hat Universal Base Image, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , io.k8s.display-name=CentOS Stream 8, description=CentOS Stream is a continuously delivered distro that tracks just ahead of Red Hat Enterprise Linux development. This image takes the Red Hat UBI and layers on content from CentOS Stream, url=https://access.redhat.com/containers/#/registry.access.redhat.com/ubi8/images/8.6-754, com.redhat.component=centos-stream-container, io.buildah.version=1.19.8, io.openshift.expose-services=, vendor=Red Hat, Inc., name=centos-stream, GIT_CLEAN=True, GIT_REPO=https://github.com/ceph/ceph-container.git, architecture=x86_64, com.redhat.license_terms=https://centos.org/legal/licensing-policy/, CEPH_POINT_RELEASE=-17.2.0, version=8, build-date=2022-05-03T08:36:31.336870) 2024-03-30T14:08:29.734 INFO:journalctl@ceph.osd.4.smithi181.stdout:Mar 30 14:08:29 smithi181 bash[148870]: ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-4 2024-03-30T14:08:29.734 INFO:journalctl@ceph.osd.4.smithi181.stdout:Mar 30 14:08:29 smithi181 podman[148900]: 2024-03-30 14:08:29.585849265 +0000 UTC m=+0.715094330 container remove 5e205434e973e822194d5cd5d9eee0386ab8711f3f401b73ab687c5c6b31417e (image=quay.io/ceph/ceph@sha256:12a0a4f43413fd97a14a3d47a3451b2d2df50020835bb93db666209f3f77617a, name=ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-4, io.openshift.tags=base centos centos-stream, vcs-ref=f1ee6e37554363ec55e0035aba1a693d3627fdeb, release=754, version=8, description=CentOS Stream is a continuously delivered distro that tracks just ahead of Red Hat Enterprise Linux development. This image takes the Red Hat UBI and layers on content from CentOS Stream, ceph=True, com.redhat.build-host=cpt-1002.osbs.prod.upshift.rdu2.redhat.com, GIT_CLEAN=True, url=https://access.redhat.com/containers/#/registry.access.redhat.com/ubi8/images/8.6-754, GIT_COMMIT=b613db0f44179c0940781c1c7fe04e1acb7093ac, GIT_REPO=https://github.com/ceph/ceph-container.git, io.openshift.expose-services=, com.redhat.license_terms=https://centos.org/legal/licensing-policy/, com.redhat.component=centos-stream-container, maintainer=Guillaume Abrioux , io.buildah.version=1.19.8, CEPH_POINT_RELEASE=-17.2.0, GIT_BRANCH=HEAD, summary=Provides a CentOS Stream container based on the Red Hat Universal Base Image, architecture=x86_64, io.k8s.description=The Universal Base Image is designed and engineered to be the base layer for all of your containerized applications, middleware and utilities. This base image is freely redistributable, but Red Hat only supports Red Hat technologies through subscriptions for Red Hat products. This image is maintained by Red Hat and updated regularly., RELEASE=HEAD, build-date=2022-05-03T08:36:31.336870, io.k8s.display-name=CentOS Stream 8, vcs-type=git, name=centos-stream, distribution-scope=public, vendor=Red Hat, Inc.) 2024-03-30T14:08:29.734 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:29 smithi181 ceph-mon[115276]: from='client.25136 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T14:08:29.734 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:29 smithi181 ceph-mon[115276]: Health check failed: 1 osds down (OSD_DOWN) 2024-03-30T14:08:29.734 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:29 smithi181 ceph-mon[115276]: failed to encode map e134 with expected crc 2024-03-30T14:08:29.734 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:29 smithi181 ceph-mon[115276]: failed to encode map e134 with expected crc 2024-03-30T14:08:29.734 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:29 smithi181 ceph-mon[115276]: failed to encode map e134 with expected crc 2024-03-30T14:08:29.734 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:29 smithi181 ceph-mon[115276]: osdmap e134: 8 total, 7 up, 8 in 2024-03-30T14:08:29.734 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:29 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:29.735 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:29 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:29.735 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:29 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:29.997 INFO:journalctl@ceph.osd.4.smithi181.stdout:Mar 30 14:08:29 smithi181 podman[149043]: 2024-03-30 14:08:29.81263594 +0000 UTC m=+0.018445090 image pull b0c4478f1d83795df4d538bf108aee5fac57194348fb16dcdbb3115f3e2fe95e quay.ceph.io/ceph-ci/ceph:4e50bbcdd1630c7760b708f3a5b4d38a121e66cb 2024-03-30T14:08:29.997 INFO:journalctl@ceph.osd.4.smithi181.stdout:Mar 30 14:08:29 smithi181 podman[149043]: 2024-03-30 14:08:29.987009735 +0000 UTC m=+0.192818858 container create 7fe1622da94049b1e8fc1cdaf42b3a6cf3d9fb54629256b899460cbe34ddfe7c (image=quay.ceph.io/ceph-ci/ceph:4e50bbcdd1630c7760b708f3a5b4d38a121e66cb, name=ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-4-deactivate, GIT_CLEAN=True, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, RELEASE=squid-4e50bbc, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240326, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0) 2024-03-30T14:08:30.380 INFO:journalctl@ceph.osd.4.smithi181.stdout:Mar 30 14:08:30 smithi181 podman[149043]: 2024-03-30 14:08:30.2317024 +0000 UTC m=+0.437511539 container init 7fe1622da94049b1e8fc1cdaf42b3a6cf3d9fb54629256b899460cbe34ddfe7c (image=quay.ceph.io/ceph-ci/ceph:4e50bbcdd1630c7760b708f3a5b4d38a121e66cb, name=ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-4-deactivate, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, ceph=True, org.label-schema.build-date=20240326, GIT_CLEAN=True, org.label-schema.vendor=CentOS, RELEASE=squid-4e50bbc, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0) 2024-03-30T14:08:30.381 INFO:journalctl@ceph.osd.4.smithi181.stdout:Mar 30 14:08:30 smithi181 podman[149043]: 2024-03-30 14:08:30.235435273 +0000 UTC m=+0.441244401 container start 7fe1622da94049b1e8fc1cdaf42b3a6cf3d9fb54629256b899460cbe34ddfe7c (image=quay.ceph.io/ceph-ci/ceph:4e50bbcdd1630c7760b708f3a5b4d38a121e66cb, name=ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-4-deactivate, io.buildah.version=1.33.5, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, GIT_BRANCH=HEAD, org.label-schema.build-date=20240326, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, RELEASE=squid-4e50bbc) 2024-03-30T14:08:30.381 INFO:journalctl@ceph.osd.4.smithi181.stdout:Mar 30 14:08:30 smithi181 podman[149043]: 2024-03-30 14:08:30.331547554 +0000 UTC m=+0.537356692 container attach 7fe1622da94049b1e8fc1cdaf42b3a6cf3d9fb54629256b899460cbe34ddfe7c (image=quay.ceph.io/ceph-ci/ceph:4e50bbcdd1630c7760b708f3a5b4d38a121e66cb, name=ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-4-deactivate, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_CLEAN=True, RELEASE=squid-4e50bbc, org.label-schema.build-date=20240326, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, ceph=True, io.buildah.version=1.33.5) 2024-03-30T14:08:30.746 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:30 smithi099 ceph-mon[137093]: pgmap v170: 161 pgs: 23 stale+active+clean, 138 active+clean; 585 KiB data, 178 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-03-30T14:08:30.746 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:30 smithi099 ceph-mon[137093]: failed to encode map e135 with expected crc 2024-03-30T14:08:30.746 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:30 smithi099 ceph-mon[137093]: failed to encode map e135 with expected crc 2024-03-30T14:08:30.747 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:30 smithi099 ceph-mon[137093]: osdmap e135: 8 total, 7 up, 8 in 2024-03-30T14:08:30.747 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:30 smithi099 ceph-mon[137093]: failed to encode map e135 with expected crc 2024-03-30T14:08:30.747 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:30 smithi099 ceph-mon[137093]: failed to encode map e135 with expected crc 2024-03-30T14:08:30.747 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:30 smithi099 ceph-mon[143401]: pgmap v170: 161 pgs: 23 stale+active+clean, 138 active+clean; 585 KiB data, 178 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-03-30T14:08:30.747 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:30 smithi099 ceph-mon[143401]: failed to encode map e135 with expected crc 2024-03-30T14:08:30.747 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:30 smithi099 ceph-mon[143401]: failed to encode map e135 with expected crc 2024-03-30T14:08:30.747 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:30 smithi099 ceph-mon[143401]: osdmap e135: 8 total, 7 up, 8 in 2024-03-30T14:08:30.747 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:30 smithi099 ceph-mon[143401]: failed to encode map e135 with expected crc 2024-03-30T14:08:30.747 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:30 smithi099 ceph-mon[143401]: failed to encode map e135 with expected crc 2024-03-30T14:08:30.748 INFO:journalctl@ceph.osd.4.smithi181.stdout:Mar 30 14:08:30 smithi181 podman[149043]: 2024-03-30 14:08:30.544673066 +0000 UTC m=+0.750482206 container died 7fe1622da94049b1e8fc1cdaf42b3a6cf3d9fb54629256b899460cbe34ddfe7c (image=quay.ceph.io/ceph-ci/ceph:4e50bbcdd1630c7760b708f3a5b4d38a121e66cb, name=ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-4-deactivate, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240326, GIT_CLEAN=True, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, RELEASE=squid-4e50bbc, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image) 2024-03-30T14:08:30.748 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:30 smithi181 ceph-mon[115276]: pgmap v170: 161 pgs: 23 stale+active+clean, 138 active+clean; 585 KiB data, 178 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-03-30T14:08:30.748 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:30 smithi181 ceph-mon[115276]: failed to encode map e135 with expected crc 2024-03-30T14:08:30.748 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:30 smithi181 ceph-mon[115276]: failed to encode map e135 with expected crc 2024-03-30T14:08:30.748 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:30 smithi181 ceph-mon[115276]: osdmap e135: 8 total, 7 up, 8 in 2024-03-30T14:08:30.748 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:30 smithi181 ceph-mon[115276]: failed to encode map e135 with expected crc 2024-03-30T14:08:30.748 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:30 smithi181 ceph-mon[115276]: failed to encode map e135 with expected crc 2024-03-30T14:08:31.434 INFO:journalctl@ceph.osd.4.smithi181.stdout:Mar 30 14:08:31 smithi181 podman[149146]: 2024-03-30 14:08:31.143842801 +0000 UTC m=+0.592486675 container remove 7fe1622da94049b1e8fc1cdaf42b3a6cf3d9fb54629256b899460cbe34ddfe7c (image=quay.ceph.io/ceph-ci/ceph:4e50bbcdd1630c7760b708f3a5b4d38a121e66cb, name=ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-4-deactivate, org.label-schema.license=GPLv2, ceph=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240326, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, org.label-schema.schema-version=1.0, RELEASE=squid-4e50bbc, io.buildah.version=1.33.5, GIT_BRANCH=HEAD) 2024-03-30T14:08:31.435 INFO:journalctl@ceph.osd.4.smithi181.stdout:Mar 30 14:08:31 smithi181 systemd[1]: ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4@osd.4.service: Deactivated successfully. 2024-03-30T14:08:31.435 INFO:journalctl@ceph.osd.4.smithi181.stdout:Mar 30 14:08:31 smithi181 systemd[1]: Stopped Ceph osd.4 for 98ebaeb8-ee99-11ee-b647-cb9ed24678a4. 2024-03-30T14:08:31.435 INFO:journalctl@ceph.osd.4.smithi181.stdout:Mar 30 14:08:31 smithi181 systemd[1]: ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4@osd.4.service: Consumed 17.044s CPU time. 2024-03-30T14:08:31.435 INFO:journalctl@ceph.osd.4.smithi181.stdout:Mar 30 14:08:31 smithi181 systemd[1]: Starting Ceph osd.4 for 98ebaeb8-ee99-11ee-b647-cb9ed24678a4... 2024-03-30T14:08:31.747 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:31 smithi181 ceph-mon[115276]: Health check failed: Reduced data availability: 2 pgs inactive, 2 pgs peering (PG_AVAILABILITY) 2024-03-30T14:08:31.747 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:31 smithi181 ceph-mon[115276]: Health check failed: Degraded data redundancy: 35/627 objects degraded (5.582%), 9 pgs degraded (PG_DEGRADED) 2024-03-30T14:08:31.828 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:31 smithi099 ceph-mon[137093]: Health check failed: Reduced data availability: 2 pgs inactive, 2 pgs peering (PG_AVAILABILITY) 2024-03-30T14:08:31.828 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:31 smithi099 ceph-mon[137093]: Health check failed: Degraded data redundancy: 35/627 objects degraded (5.582%), 9 pgs degraded (PG_DEGRADED) 2024-03-30T14:08:31.828 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:31 smithi099 ceph-mon[143401]: Health check failed: Reduced data availability: 2 pgs inactive, 2 pgs peering (PG_AVAILABILITY) 2024-03-30T14:08:31.828 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:31 smithi099 ceph-mon[143401]: Health check failed: Degraded data redundancy: 35/627 objects degraded (5.582%), 9 pgs degraded (PG_DEGRADED) 2024-03-30T14:08:32.497 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:32 smithi181 ceph-mon[115276]: pgmap v172: 161 pgs: 9 active+undersized+degraded, 11 peering, 9 stale+active+clean, 16 active+undersized, 116 active+clean; 585 KiB data, 179 MiB used, 715 GiB / 715 GiB avail; 35/627 objects degraded (5.582%) 2024-03-30T14:08:32.498 INFO:journalctl@ceph.osd.4.smithi181.stdout:Mar 30 14:08:32 smithi181 podman[149348]: 2024-03-30 14:08:32.153575727 +0000 UTC m=+0.023421814 image pull b0c4478f1d83795df4d538bf108aee5fac57194348fb16dcdbb3115f3e2fe95e quay.ceph.io/ceph-ci/ceph:4e50bbcdd1630c7760b708f3a5b4d38a121e66cb 2024-03-30T14:08:32.498 INFO:journalctl@ceph.osd.4.smithi181.stdout:Mar 30 14:08:32 smithi181 podman[149348]: 2024-03-30 14:08:32.306239623 +0000 UTC m=+0.176085722 container create 98a1549853bc3f8dd110bc84d3efed16300974987ec5fef809853cbc7ac52929 (image=quay.ceph.io/ceph-ci/ceph:4e50bbcdd1630c7760b708f3a5b4d38a121e66cb, name=ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-4-activate, org.label-schema.license=GPLv2, RELEASE=squid-4e50bbc, GIT_BRANCH=HEAD, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240326, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image) 2024-03-30T14:08:32.828 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:32 smithi099 ceph-mon[137093]: pgmap v172: 161 pgs: 9 active+undersized+degraded, 11 peering, 9 stale+active+clean, 16 active+undersized, 116 active+clean; 585 KiB data, 179 MiB used, 715 GiB / 715 GiB avail; 35/627 objects degraded (5.582%) 2024-03-30T14:08:32.828 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:32 smithi099 ceph-mon[143401]: pgmap v172: 161 pgs: 9 active+undersized+degraded, 11 peering, 9 stale+active+clean, 16 active+undersized, 116 active+clean; 585 KiB data, 179 MiB used, 715 GiB / 715 GiB avail; 35/627 objects degraded (5.582%) 2024-03-30T14:08:32.961 INFO:journalctl@ceph.osd.4.smithi181.stdout:Mar 30 14:08:32 smithi181 podman[149348]: 2024-03-30 14:08:32.543044165 +0000 UTC m=+0.412890240 container init 98a1549853bc3f8dd110bc84d3efed16300974987ec5fef809853cbc7ac52929 (image=quay.ceph.io/ceph-ci/ceph:4e50bbcdd1630c7760b708f3a5b4d38a121e66cb, name=ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-4-activate, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=squid-4e50bbc, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, io.buildah.version=1.33.5, org.label-schema.build-date=20240326, GIT_BRANCH=HEAD) 2024-03-30T14:08:32.961 INFO:journalctl@ceph.osd.4.smithi181.stdout:Mar 30 14:08:32 smithi181 podman[149348]: 2024-03-30 14:08:32.547023067 +0000 UTC m=+0.416869132 container start 98a1549853bc3f8dd110bc84d3efed16300974987ec5fef809853cbc7ac52929 (image=quay.ceph.io/ceph-ci/ceph:4e50bbcdd1630c7760b708f3a5b4d38a121e66cb, name=ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-4-activate, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, maintainer=Guillaume Abrioux , ceph=True, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240326, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=squid-4e50bbc) 2024-03-30T14:08:32.961 INFO:journalctl@ceph.osd.4.smithi181.stdout:Mar 30 14:08:32 smithi181 podman[149348]: 2024-03-30 14:08:32.625608487 +0000 UTC m=+0.495454546 container attach 98a1549853bc3f8dd110bc84d3efed16300974987ec5fef809853cbc7ac52929 (image=quay.ceph.io/ceph-ci/ceph:4e50bbcdd1630c7760b708f3a5b4d38a121e66cb, name=ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-4-activate, ceph=True, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, org.label-schema.build-date=20240326, RELEASE=squid-4e50bbc, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_CLEAN=True) 2024-03-30T14:08:33.247 INFO:journalctl@ceph.osd.4.smithi181.stdout:Mar 30 14:08:33 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-4-activate[149377]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-03-30T14:08:33.247 INFO:journalctl@ceph.osd.4.smithi181.stdout:Mar 30 14:08:33 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-4-activate[149377]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-4 --no-mon-config --dev /dev/mapper/vg_nvme-lv_4 2024-03-30T14:08:33.248 INFO:journalctl@ceph.osd.4.smithi181.stdout:Mar 30 14:08:33 smithi181 bash[149348]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-03-30T14:08:33.248 INFO:journalctl@ceph.osd.4.smithi181.stdout:Mar 30 14:08:33 smithi181 bash[149348]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-4 --no-mon-config --dev /dev/mapper/vg_nvme-lv_4 2024-03-30T14:08:33.248 INFO:journalctl@ceph.osd.4.smithi181.stdout:Mar 30 14:08:33 smithi181 bash[149348]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_4 2024-03-30T14:08:33.248 INFO:journalctl@ceph.osd.4.smithi181.stdout:Mar 30 14:08:33 smithi181 bash[149348]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-3 2024-03-30T14:08:33.248 INFO:journalctl@ceph.osd.4.smithi181.stdout:Mar 30 14:08:33 smithi181 bash[149348]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-4/block 2024-03-30T14:08:33.248 INFO:journalctl@ceph.osd.4.smithi181.stdout:Mar 30 14:08:33 smithi181 bash[149348]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-03-30T14:08:33.248 INFO:journalctl@ceph.osd.4.smithi181.stdout:Mar 30 14:08:33 smithi181 bash[149348]: --> ceph-volume raw activate successful for osd ID: 4 2024-03-30T14:08:33.248 INFO:journalctl@ceph.osd.4.smithi181.stdout:Mar 30 14:08:33 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-4-activate[149377]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_4 2024-03-30T14:08:33.248 INFO:journalctl@ceph.osd.4.smithi181.stdout:Mar 30 14:08:33 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-4-activate[149377]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-3 2024-03-30T14:08:33.248 INFO:journalctl@ceph.osd.4.smithi181.stdout:Mar 30 14:08:33 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-4-activate[149377]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-4/block 2024-03-30T14:08:33.248 INFO:journalctl@ceph.osd.4.smithi181.stdout:Mar 30 14:08:33 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-4-activate[149377]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-03-30T14:08:33.248 INFO:journalctl@ceph.osd.4.smithi181.stdout:Mar 30 14:08:33 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-4-activate[149377]: --> ceph-volume raw activate successful for osd ID: 4 2024-03-30T14:08:33.248 INFO:journalctl@ceph.osd.4.smithi181.stdout:Mar 30 14:08:33 smithi181 podman[149348]: 2024-03-30 14:08:33.071000952 +0000 UTC m=+0.940847022 container died 98a1549853bc3f8dd110bc84d3efed16300974987ec5fef809853cbc7ac52929 (image=quay.ceph.io/ceph-ci/ceph:4e50bbcdd1630c7760b708f3a5b4d38a121e66cb, name=ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-4-activate, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, org.label-schema.license=GPLv2, org.label-schema.build-date=20240326, ceph=True, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, GIT_CLEAN=True, RELEASE=squid-4e50bbc, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0) 2024-03-30T14:08:34.384 INFO:journalctl@ceph.osd.4.smithi181.stdout:Mar 30 14:08:34 smithi181 podman[149564]: 2024-03-30 14:08:34.058121724 +0000 UTC m=+1.000521354 container remove 98a1549853bc3f8dd110bc84d3efed16300974987ec5fef809853cbc7ac52929 (image=quay.ceph.io/ceph-ci/ceph:4e50bbcdd1630c7760b708f3a5b4d38a121e66cb, name=ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-4-activate, maintainer=Guillaume Abrioux , RELEASE=squid-4e50bbc, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, org.label-schema.build-date=20240326, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS) 2024-03-30T14:08:34.384 INFO:journalctl@ceph.osd.4.smithi181.stdout:Mar 30 14:08:34 smithi181 podman[149679]: 2024-03-30 14:08:34.175679808 +0000 UTC m=+0.018218783 image pull b0c4478f1d83795df4d538bf108aee5fac57194348fb16dcdbb3115f3e2fe95e quay.ceph.io/ceph-ci/ceph:4e50bbcdd1630c7760b708f3a5b4d38a121e66cb 2024-03-30T14:08:34.384 INFO:journalctl@ceph.osd.4.smithi181.stdout:Mar 30 14:08:34 smithi181 podman[149679]: 2024-03-30 14:08:34.284031581 +0000 UTC m=+0.126570543 container create b9078af21e45d305d631ed1983693d3c0770435bd065d406ee512aeb37992599 (image=quay.ceph.io/ceph-ci/ceph:4e50bbcdd1630c7760b708f3a5b4d38a121e66cb, name=ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-4, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240326, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, org.label-schema.schema-version=1.0, ceph=True, RELEASE=squid-4e50bbc, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, GIT_CLEAN=True, org.label-schema.license=GPLv2) 2024-03-30T14:08:34.747 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:34 smithi181 ceph-mon[115276]: pgmap v173: 161 pgs: 22 active+undersized+degraded, 11 peering, 36 active+undersized, 92 active+clean; 585 KiB data, 183 MiB used, 715 GiB / 715 GiB avail; 93/627 objects degraded (14.833%) 2024-03-30T14:08:34.747 INFO:journalctl@ceph.osd.4.smithi181.stdout:Mar 30 14:08:34 smithi181 podman[149679]: 2024-03-30 14:08:34.486424099 +0000 UTC m=+0.328963073 container init b9078af21e45d305d631ed1983693d3c0770435bd065d406ee512aeb37992599 (image=quay.ceph.io/ceph-ci/ceph:4e50bbcdd1630c7760b708f3a5b4d38a121e66cb, name=ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-4, ceph=True, RELEASE=squid-4e50bbc, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240326, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux ) 2024-03-30T14:08:34.747 INFO:journalctl@ceph.osd.4.smithi181.stdout:Mar 30 14:08:34 smithi181 podman[149679]: 2024-03-30 14:08:34.489537735 +0000 UTC m=+0.332076698 container start b9078af21e45d305d631ed1983693d3c0770435bd065d406ee512aeb37992599 (image=quay.ceph.io/ceph-ci/ceph:4e50bbcdd1630c7760b708f3a5b4d38a121e66cb, name=ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-4, GIT_BRANCH=HEAD, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240326, ceph=True, RELEASE=squid-4e50bbc, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0) 2024-03-30T14:08:34.748 INFO:journalctl@ceph.osd.4.smithi181.stdout:Mar 30 14:08:34 smithi181 ceph-osd[149728]: -- 172.21.15.181:0/490118 <== mon.2 v2:172.21.15.181:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x56511cd0b680 con 0x56511ccd5000 2024-03-30T14:08:34.748 INFO:journalctl@ceph.osd.4.smithi181.stdout:Mar 30 14:08:34 smithi181 bash[149679]: b9078af21e45d305d631ed1983693d3c0770435bd065d406ee512aeb37992599 2024-03-30T14:08:34.748 INFO:journalctl@ceph.osd.4.smithi181.stdout:Mar 30 14:08:34 smithi181 systemd[1]: Started Ceph osd.4 for 98ebaeb8-ee99-11ee-b647-cb9ed24678a4. 2024-03-30T14:08:34.789 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:34 smithi099 ceph-mon[137093]: pgmap v173: 161 pgs: 22 active+undersized+degraded, 11 peering, 36 active+undersized, 92 active+clean; 585 KiB data, 183 MiB used, 715 GiB / 715 GiB avail; 93/627 objects degraded (14.833%) 2024-03-30T14:08:34.789 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:34 smithi099 ceph-mon[143401]: pgmap v173: 161 pgs: 22 active+undersized+degraded, 11 peering, 36 active+undersized, 92 active+clean; 585 KiB data, 183 MiB used, 715 GiB / 715 GiB avail; 93/627 objects degraded (14.833%) 2024-03-30T14:08:35.078 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 14:08:34 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[71049]: ::ffff:172.21.15.181 - - [30/Mar/2024:14:08:34] "GET /metrics HTTP/1.1" 200 38259 "" "Prometheus/2.43.0" 2024-03-30T14:08:35.123 INFO:journalctl@ceph.osd.4.smithi181.stdout:Mar 30 14:08:35 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-4[149712]: 2024-03-30T14:08:35.024+0000 7efd1bf007c0 -1 Falling back to public interface 2024-03-30T14:08:35.741 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:35 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:35.741 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:35 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:35.741 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:35 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:08:35.741 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:35 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:08:35.741 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:35 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:35.741 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:35 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:08:35.741 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:35 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:08:35.741 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:35 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:35.741 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:35 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:08:35.741 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:35 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:08:35.742 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:35 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:35.742 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:35 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:08:35.742 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:35 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:35.742 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:35 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:08:35.742 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:35 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:08:35.742 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:35 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:35.742 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:35 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:08:35.742 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:35 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:35.742 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:35 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:08:35.742 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:35 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:08:35.742 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:35 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:35.742 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:35 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:08:35.742 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:35 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:35.742 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:35 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:08:35.742 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:35 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:08:35.743 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:35 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:35.743 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:35 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:08:35.743 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:35 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:35.743 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:35 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:08:35.743 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:35 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:08:35.743 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:35 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:35.743 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:35 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:08:35.743 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:35 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:35.743 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:35 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:08:35.743 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:35 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:08:35.744 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:35 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:35.744 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:35 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:08:35.744 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:35 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:35.744 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:35 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:08:35.744 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:35 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:08:35.744 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:35 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:35.744 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:35 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:08:35.744 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:35 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:35.744 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:35 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:08:35.744 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:35 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:08:35.744 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:35 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:35.744 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:35 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:08:35.744 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:35 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:35.744 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:35 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:08:35.744 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:35 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:08:35.745 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:35 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:35.745 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:35 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:08:35.745 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:35 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:35.745 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:35 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:08:35.745 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:35 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:08:35.745 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:35 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:36.078 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:35 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:36.078 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:35 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:36.079 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:35 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:08:36.079 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:35 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:08:36.079 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:35 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:36.079 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:35 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:08:36.079 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:35 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:08:36.079 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:35 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:36.079 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:35 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:08:36.079 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:35 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:08:36.079 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:35 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:36.079 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:35 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:08:36.079 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:35 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:36.079 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:35 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:08:36.079 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:35 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:08:36.079 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:35 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:36.079 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:35 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:08:36.080 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:35 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:36.080 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:35 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:08:36.080 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:35 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:08:36.080 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:35 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:36.080 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:35 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:08:36.080 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:35 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:36.080 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:35 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:08:36.080 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:35 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:08:36.080 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:35 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:36.080 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:35 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:08:36.080 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:35 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:36.080 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:35 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:08:36.081 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:35 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:36.081 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:35 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:36.081 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:35 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:08:36.081 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:35 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:08:36.081 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:35 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:36.081 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:35 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:08:36.081 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:35 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:08:36.081 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:35 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:36.081 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:35 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:08:36.081 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:35 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:08:36.081 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:35 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:36.081 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:35 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:08:36.082 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:35 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:36.082 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:35 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:08:36.082 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:35 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:08:36.082 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:35 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:36.082 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:35 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:08:36.082 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:35 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:36.082 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:35 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:08:36.082 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:35 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:08:36.082 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:35 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:36.082 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:35 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:08:36.082 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:35 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:36.082 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:35 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:08:36.082 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:35 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:08:36.083 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:35 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:36.083 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:35 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:08:36.083 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:35 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:36.083 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:35 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:08:36.083 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:35 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:08:36.083 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:35 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:36.083 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:35 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:08:36.083 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:35 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:36.083 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:35 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:08:36.083 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:35 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:08:36.083 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:35 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:36.083 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:35 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:08:36.083 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:35 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:36.083 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:35 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:08:36.083 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:35 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:08:36.084 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:35 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:36.084 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:35 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:08:36.084 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:35 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:36.084 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:35 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:08:36.084 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:35 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:08:36.084 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:35 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:36.084 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:35 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:08:36.084 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:35 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:36.084 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:35 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:08:36.084 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:35 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:08:36.084 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:35 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:36.084 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:35 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:08:36.084 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:35 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:36.084 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:35 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:08:36.084 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:35 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:08:36.084 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:35 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:36.085 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:35 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:08:36.085 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:35 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:36.085 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:35 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:08:36.085 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:35 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:36.085 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:35 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:08:36.085 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:35 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:08:36.085 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:35 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:36.085 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:35 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:08:36.085 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:35 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:36.085 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:35 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:08:36.085 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:35 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:08:36.085 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:35 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:36.086 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:35 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:08:36.086 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:35 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:36.086 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:35 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:08:36.086 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:35 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:08:36.086 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:35 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:36.086 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:35 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:08:36.086 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:35 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:36.086 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:35 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:08:36.086 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:35 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:08:36.086 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:35 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:36.086 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:35 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:08:36.086 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:35 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:36.086 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:35 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:08:36.086 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:35 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:08:36.087 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:35 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:36.748 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:36 smithi181 ceph-mon[115276]: pgmap v174: 161 pgs: 26 active+undersized+degraded, 43 active+undersized, 92 active+clean; 585 KiB data, 183 MiB used, 715 GiB / 715 GiB avail; 106/627 objects degraded (16.906%) 2024-03-30T14:08:36.748 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:36 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:08:36.748 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:36 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:08:36.748 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:36 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:08:36.748 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:36 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:08:36.748 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:36 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:08:36.749 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:36 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:08:36.749 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:36 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:08:36.749 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:36 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:08:36.749 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:36 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:08:36.749 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:36 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:08:36.749 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:36 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:08:36.749 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:36 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:36.749 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:36 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:08:36.749 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:36 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:08:36.749 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:36 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:36.749 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:36 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:08:36.749 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:36 smithi181 ceph-mon[115276]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 2 pgs inactive, 2 pgs peering) 2024-03-30T14:08:36.749 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:36 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:08:36.749 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:36 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:36.750 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:36 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:08:36.750 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:36 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:08:36.750 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:36 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:36.750 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:36 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:08:36.750 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:36 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:08:36.750 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:36 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:36.750 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:36 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:08:36.750 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:36 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:08:36.750 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:36 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:36.750 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:36 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:08:36.750 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:36 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:36.750 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:36 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:08:36.750 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:36 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:08:36.751 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:36 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:36.751 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:36 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:08:36.751 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:36 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:36.751 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:36 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:08:36.751 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:36 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:08:36.751 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:36 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:36.751 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:36 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:08:36.751 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:36 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:36.751 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:36 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:08:36.751 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:36 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:08:36.751 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:36 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:36.751 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:36 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:08:36.752 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:36 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:36.752 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:36 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:08:36.752 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:36 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:08:36.752 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:36 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:36.752 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:36 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:08:36.752 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:36 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:36.753 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:36 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:08:36.753 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:36 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:08:36.753 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:36 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:36.753 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:36 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:08:36.753 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:36 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:36.753 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:36 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:08:36.753 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:36 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:08:36.754 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:36 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:36.754 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:36 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:08:36.754 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:36 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:36.754 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:36 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:08:36.754 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:36 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:08:36.754 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:36 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:36.755 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:36 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:08:36.755 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:36 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:36.755 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:36 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:08:36.755 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:36 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:08:36.755 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:36 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:37.078 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:36 smithi099 ceph-mon[137093]: pgmap v174: 161 pgs: 26 active+undersized+degraded, 43 active+undersized, 92 active+clean; 585 KiB data, 183 MiB used, 715 GiB / 715 GiB avail; 106/627 objects degraded (16.906%) 2024-03-30T14:08:37.079 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:36 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:08:37.079 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:36 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:08:37.079 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:36 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:08:37.080 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:36 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:08:37.080 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:36 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:08:37.080 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:36 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:08:37.080 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:36 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:08:37.080 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:36 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:08:37.080 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:36 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:08:37.080 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:36 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:08:37.080 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:36 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:08:37.080 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:36 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:37.080 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:36 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:08:37.080 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:36 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:08:37.080 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:36 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:37.080 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:36 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:08:37.080 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:36 smithi099 ceph-mon[137093]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 2 pgs inactive, 2 pgs peering) 2024-03-30T14:08:37.081 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:36 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:08:37.081 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:36 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:37.081 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:36 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:08:37.081 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:36 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:08:37.081 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:36 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:37.081 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:36 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:08:37.081 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:36 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:08:37.081 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:36 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:37.081 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:36 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:08:37.081 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:36 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:08:37.081 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:36 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:37.081 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:36 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:08:37.081 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:36 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:37.082 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:36 smithi099 ceph-mon[143401]: pgmap v174: 161 pgs: 26 active+undersized+degraded, 43 active+undersized, 92 active+clean; 585 KiB data, 183 MiB used, 715 GiB / 715 GiB avail; 106/627 objects degraded (16.906%) 2024-03-30T14:08:37.082 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:36 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:08:37.082 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:36 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:08:37.082 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:36 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:08:37.082 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:36 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:08:37.082 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:36 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:08:37.082 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:36 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:08:37.082 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:36 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:08:37.082 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:36 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:08:37.082 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:36 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:08:37.082 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:36 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:08:37.082 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:36 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:08:37.082 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:36 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:37.083 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:36 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:08:37.083 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:36 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:08:37.083 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:36 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:37.083 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:36 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:08:37.083 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:36 smithi099 ceph-mon[143401]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 2 pgs inactive, 2 pgs peering) 2024-03-30T14:08:37.083 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:36 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:08:37.083 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:36 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:37.083 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:36 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:08:37.083 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:36 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:08:37.083 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:36 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:37.083 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:36 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:08:37.083 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:36 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:08:37.083 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:36 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:37.083 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:36 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:08:37.083 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:36 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:08:37.083 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:36 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:37.084 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:36 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:08:37.084 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:36 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:37.084 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:36 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:08:37.084 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:36 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:08:37.084 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:36 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:37.084 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:36 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:08:37.084 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:36 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:37.084 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:36 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:08:37.084 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:36 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:08:37.084 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:36 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:37.085 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:36 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:08:37.085 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:36 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:37.085 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:36 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:08:37.085 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:36 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:08:37.085 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:36 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:37.085 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:36 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:08:37.085 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:36 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:37.085 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:36 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:08:37.085 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:36 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:08:37.085 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:36 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:37.085 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:36 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:08:37.085 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:36 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:37.085 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:36 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:08:37.085 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:36 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:08:37.085 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:36 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:37.086 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:36 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:08:37.086 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:36 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:37.086 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:36 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:08:37.086 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:36 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:08:37.086 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:36 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:37.086 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:36 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:08:37.086 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:36 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:37.086 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:36 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:08:37.086 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:36 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:08:37.086 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:36 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:37.086 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:36 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:08:37.086 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:36 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:37.086 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:36 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:08:37.086 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:36 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:08:37.086 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:36 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:37.087 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:36 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:08:37.087 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:36 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:08:37.087 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:36 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:37.087 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:36 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:08:37.087 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:36 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:37.087 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:36 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:08:37.087 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:36 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:08:37.087 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:36 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:37.087 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:36 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:08:37.087 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:36 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:37.087 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:36 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:08:37.088 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:36 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:08:37.088 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:36 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:37.088 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:36 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:08:37.088 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:36 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:37.088 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:36 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:08:37.088 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:36 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:08:37.088 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:36 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:37.088 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:36 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:08:37.088 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:36 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:37.088 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:36 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:08:37.088 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:36 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:08:37.088 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:36 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:37.088 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:36 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:08:37.088 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:36 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:37.088 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:36 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:08:37.088 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:36 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:08:37.089 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:36 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:37.089 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:36 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:08:37.089 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:36 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:37.089 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:36 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:08:37.089 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:36 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:08:37.089 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:36 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:37.089 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:36 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:08:37.089 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:36 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:37.089 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:36 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:08:37.089 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:36 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:08:37.089 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:36 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:37.748 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:37 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:08:37.748 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:37 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:08:37.748 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:37 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:08:37.748 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:37 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:08:37.748 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:37 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:08:37.748 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:37 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:08:37.748 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:37 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:08:37.748 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:37 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:08:37.748 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:37 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:08:37.748 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:37 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:08:37.748 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:37 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:37.749 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:37 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:08:37.749 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:37 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:08:37.749 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:37 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:37.749 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:37 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:08:37.749 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:37 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:08:37.749 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:37 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:37.749 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:37 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:37.749 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:37 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T14:08:37.749 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:37 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:08:37.749 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:37 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:08:37.749 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:37 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:37.749 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:37 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:08:37.749 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:37 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:37.749 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:37 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:08:37.750 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:37 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:08:37.750 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:37 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:37.750 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:37 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:08:37.750 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:37 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:37.750 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:37 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:08:37.750 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:37 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:08:37.750 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:37 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:37.750 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:37 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:08:37.750 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:37 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:37.750 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:37 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:08:37.750 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:37 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:08:37.750 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:37 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:37.750 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:37 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:08:37.751 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:37 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:37.751 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:37 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:08:37.751 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:37 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:08:37.751 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:37 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:37.751 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:37 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:08:37.751 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:37 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:37.751 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:37 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:08:37.751 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:37 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:08:37.751 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:37 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:37.751 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:37 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:08:37.751 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:37 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:37.751 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:37 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:08:37.751 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:37 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:08:37.751 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:37 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:37.751 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:37 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:08:37.751 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:37 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:37.752 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:37 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:08:37.752 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:37 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:08:37.752 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:37 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:37.752 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:37 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:08:37.752 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:37 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:37.752 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:37 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:08:37.752 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:37 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:08:37.752 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:37 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:37.961 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:37 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:08:37.961 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:37 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:08:37.961 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:37 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:08:37.961 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:37 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:08:37.961 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:37 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:08:37.962 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:37 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:08:37.962 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:37 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:08:37.962 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:37 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:08:37.962 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:37 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:08:37.962 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:37 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:08:37.962 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:37 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:37.963 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:37 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:08:37.963 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:37 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:08:37.963 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:37 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:37.963 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:37 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:08:37.963 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:37 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:08:37.963 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:37 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:37.963 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:37 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:37.964 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:37 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T14:08:37.964 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:37 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:08:37.964 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:37 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:08:37.964 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:37 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:37.964 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:37 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:08:37.964 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:37 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:37.964 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:37 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:08:37.964 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:37 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:08:37.964 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:37 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:37.964 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:37 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:08:37.964 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:37 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:37.965 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:37 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:08:37.965 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:37 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:08:37.965 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:37 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:08:37.965 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:37 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:08:37.965 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:37 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:08:37.965 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:37 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:08:37.965 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:37 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:08:37.966 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:37 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:08:37.966 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:37 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:08:37.966 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:37 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:08:37.966 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:37 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:08:37.966 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:37 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:08:37.966 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:37 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:37.966 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:37 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:08:37.966 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:37 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:08:37.966 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:37 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:37.966 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:37 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:08:37.966 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:37 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:08:37.967 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:37 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:37.967 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:37 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:37.967 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:37 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T14:08:37.967 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:37 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:08:37.967 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:37 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:08:37.967 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:37 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:37.967 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:37 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:08:37.967 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:37 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:37.967 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:37 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:08:37.967 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:37 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:08:37.967 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:37 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:37.967 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:37 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:08:37.967 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:37 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:37.968 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:37 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:08:37.968 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:37 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:08:37.968 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:37 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:37.968 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:37 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:08:37.968 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:37 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:37.968 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:37 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:08:37.968 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:37 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:08:37.968 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:37 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:37.968 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:37 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:08:37.968 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:37 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:37.968 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:37 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:08:37.968 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:37 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:08:37.968 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:37 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:37.968 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:37 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:08:37.968 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:37 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:37.969 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:37 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:08:37.969 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:37 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:08:37.969 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:37 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:37.969 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:37 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:08:37.969 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:37 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:37.969 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:37 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:08:37.969 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:37 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:08:37.969 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:37 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:37.969 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:37 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:08:37.969 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:37 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:37.969 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:37 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:08:37.969 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:37 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:08:37.969 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:37 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:37.969 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:37 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:08:37.970 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:37 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:37.970 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:37 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:08:37.970 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:37 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:08:37.970 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:37 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:37.970 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:37 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:37.971 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:37 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:08:37.971 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:37 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:37.971 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:37 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:08:37.971 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:37 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:08:37.971 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:37 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:37.971 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:37 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:08:37.971 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:37 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:37.971 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:37 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:08:37.971 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:37 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:08:37.971 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:37 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:37.971 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:37 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:08:37.971 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:37 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:37.971 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:37 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:08:37.971 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:37 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:08:37.972 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:37 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:37.972 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:37 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:08:37.972 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:37 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:37.972 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:37 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:08:37.972 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:37 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:08:37.972 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:37 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:37.972 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:37 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:08:37.972 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:37 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:37.972 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:37 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:08:37.972 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:37 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:08:37.972 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:37 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:37.972 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:37 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:08:37.972 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:37 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:37.972 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:37 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:08:37.972 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:37 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:08:37.972 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:37 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:38.036 INFO:journalctl@ceph.osd.4.smithi181.stdout:Mar 30 14:08:37 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-4[149712]: 2024-03-30T14:08:37.784+0000 7efd1bf007c0 -1 osd.4 0 read_superblock omap replica is missing. 2024-03-30T14:08:38.036 INFO:journalctl@ceph.osd.4.smithi181.stdout:Mar 30 14:08:37 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-4[149712]: 2024-03-30T14:08:37.815+0000 7efd1bf007c0 -1 osd.4 133 log_to_monitors true 2024-03-30T14:08:38.997 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:38 smithi181 ceph-mon[115276]: pgmap v175: 161 pgs: 26 active+undersized+degraded, 43 active+undersized, 92 active+clean; 585 KiB data, 183 MiB used, 715 GiB / 715 GiB avail; 106/627 objects degraded (16.906%) 2024-03-30T14:08:38.998 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:38 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:08:38.998 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:38 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:08:38.998 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:38 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:08:38.998 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:38 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:08:38.998 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:38 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:08:38.998 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:38 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:08:38.998 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:38 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:08:38.998 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:38 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:08:38.998 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:38 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:08:38.998 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:38 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:08:38.998 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:38 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:38.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:38 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:08:38.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:38 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:08:38.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:38 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:38.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:38 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:08:38.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:38 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:08:38.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:38 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:38.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:38 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:08:38.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:38 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:08:38.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:38 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:38.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:38 smithi181 ceph-mon[115276]: from='osd.4 [v2:172.21.15.181:6800/2605435331,v1:172.21.15.181:6801/2605435331]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-03-30T14:08:38.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:38 smithi181 ceph-mon[115276]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-03-30T14:08:38.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:38 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:08:38.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:38 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:39.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:38 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:08:39.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:38 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:08:39.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:38 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:39.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:38 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:08:39.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:38 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:39.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:38 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:08:39.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:38 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:08:39.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:38 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:39.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:38 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:08:39.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:38 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:39.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:38 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:08:39.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:38 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:08:39.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:38 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:39.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:38 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:08:39.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:38 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:39.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:38 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:08:39.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:38 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:08:39.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:38 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:39.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:38 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:08:39.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:38 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:39.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:38 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:08:39.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:38 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:08:39.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:38 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:39.078 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:38 smithi099 ceph-mon[143401]: pgmap v175: 161 pgs: 26 active+undersized+degraded, 43 active+undersized, 92 active+clean; 585 KiB data, 183 MiB used, 715 GiB / 715 GiB avail; 106/627 objects degraded (16.906%) 2024-03-30T14:08:39.079 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:38 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:08:39.079 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:38 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:08:39.079 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:38 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:08:39.079 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:38 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:08:39.079 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:38 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:08:39.079 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:38 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:08:39.079 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:38 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:08:39.079 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:38 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:08:39.079 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:38 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:08:39.079 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:38 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:08:39.079 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:38 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:39.079 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:38 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:08:39.079 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:38 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:08:39.080 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:38 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:39.080 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:38 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:08:39.080 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:38 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:08:39.080 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:38 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:39.080 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:38 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:08:39.080 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:38 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:08:39.080 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:38 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:39.080 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:38 smithi099 ceph-mon[143401]: from='osd.4 [v2:172.21.15.181:6800/2605435331,v1:172.21.15.181:6801/2605435331]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-03-30T14:08:39.080 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:38 smithi099 ceph-mon[143401]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-03-30T14:08:39.080 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:38 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:08:39.080 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:38 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:39.080 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:38 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:08:39.080 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:38 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:08:39.080 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:38 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:39.080 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:38 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:08:39.081 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:38 smithi099 ceph-mon[137093]: pgmap v175: 161 pgs: 26 active+undersized+degraded, 43 active+undersized, 92 active+clean; 585 KiB data, 183 MiB used, 715 GiB / 715 GiB avail; 106/627 objects degraded (16.906%) 2024-03-30T14:08:39.081 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:38 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:08:39.081 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:38 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:08:39.081 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:38 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:08:39.081 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:38 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:08:39.081 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:38 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:08:39.081 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:38 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:08:39.081 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:38 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:08:39.081 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:38 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:08:39.081 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:38 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:08:39.081 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:38 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:08:39.082 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:38 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:39.082 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:38 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:08:39.082 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:38 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:08:39.082 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:38 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:39.082 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:38 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:08:39.082 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:38 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:08:39.082 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:38 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:39.082 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:38 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:08:39.082 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:38 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:08:39.082 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:38 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:39.082 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:38 smithi099 ceph-mon[137093]: from='osd.4 [v2:172.21.15.181:6800/2605435331,v1:172.21.15.181:6801/2605435331]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-03-30T14:08:39.082 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:38 smithi099 ceph-mon[137093]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-03-30T14:08:39.082 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:38 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:08:39.083 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:38 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:39.083 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:38 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:08:39.083 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:38 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:08:39.083 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:38 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:39.083 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:38 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:08:39.083 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:38 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:39.083 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:38 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:08:39.083 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:38 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:08:39.083 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:38 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:39.084 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:38 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:08:39.084 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:38 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:39.084 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:38 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:08:39.084 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:38 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:08:39.084 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:38 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:39.084 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:38 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:08:39.084 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:38 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:39.084 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:38 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:08:39.084 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:38 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:08:39.084 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:38 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:39.084 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:38 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:08:39.084 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:38 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:39.084 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:38 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:08:39.084 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:38 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:08:39.084 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:38 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:39.085 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:38 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:39.085 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:38 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:08:39.085 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:38 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:08:39.085 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:38 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:39.085 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:38 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:08:39.085 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:38 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:39.085 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:38 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:08:39.085 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:38 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:08:39.085 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:38 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:39.085 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:38 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:08:39.085 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:38 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:39.085 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:38 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:08:39.085 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:38 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:08:39.085 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:38 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:39.086 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:38 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:08:39.086 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:38 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:39.086 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:38 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:08:39.086 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:38 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:08:39.086 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:38 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:39.643 INFO:journalctl@ceph.osd.4.smithi181.stdout:Mar 30 14:08:39 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-4[149712]: 2024-03-30T14:08:39.302+0000 7efd09350700 -1 osd.4 133 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-03-30T14:08:39.949 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:39 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:08:39.949 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:39 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:08:39.949 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:39 smithi181 ceph-mon[115276]: from='client.25136 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T14:08:39.949 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:39 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:08:39.949 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:39 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:08:39.949 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:39 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:08:39.949 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:39 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:08:39.949 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:39 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:08:39.949 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:39 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:39.949 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:39 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:08:39.949 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:39 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:08:39.949 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:39 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:39.949 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:39 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:08:39.950 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:39 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:08:39.950 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:39 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:39.950 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:39 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:08:39.950 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:39 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:08:39.950 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:39 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:39.950 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:39 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:08:39.950 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:39 smithi181 ceph-mon[115276]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-03-30T14:08:39.950 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:39 smithi181 ceph-mon[115276]: failed to encode map e136 with expected crc 2024-03-30T14:08:39.950 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:39 smithi181 ceph-mon[115276]: osdmap e136: 8 total, 7 up, 8 in 2024-03-30T14:08:39.950 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:39 smithi181 ceph-mon[115276]: from='osd.4 [v2:172.21.15.181:6800/2605435331,v1:172.21.15.181:6801/2605435331]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi181", "root=default"]}]: dispatch 2024-03-30T14:08:39.950 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:39 smithi181 ceph-mon[115276]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi181", "root=default"]}]: dispatch 2024-03-30T14:08:39.950 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:39 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:08:39.950 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:39 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:39.950 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:39 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:08:39.950 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:39 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:08:39.951 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:39 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:39.951 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:39 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:08:39.951 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:39 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:39.951 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:39 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:08:39.951 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:39 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:08:39.951 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:39 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:39.951 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:39 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:08:39.951 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:39 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:39.951 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:39 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:08:39.951 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:39 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:08:39.952 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:39 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:39.952 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:39 smithi181 ceph-mon[115276]: from='osd.4 ' entity='osd.4' 2024-03-30T14:08:39.952 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:39 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:08:39.952 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:39 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:39.952 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:39 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:08:39.952 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:39 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:08:39.952 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:39 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:39.952 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:39 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:08:39.952 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:39 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:39.952 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:39 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:08:39.952 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:39 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:08:39.952 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:39 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:39.952 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:39 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:08:39.952 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:39 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:39.952 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:39 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:08:39.952 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:39 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:08:39.952 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:39 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:39.953 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:39 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:08:39.953 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:39 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:39.953 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:39 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:08:39.953 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:39 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:08:39.953 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:39 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:40.077 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:39 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:08:40.077 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:39 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:08:40.077 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:39 smithi099 ceph-mon[137093]: from='client.25136 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T14:08:40.078 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:39 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:08:40.078 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:39 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:08:40.078 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:39 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:08:40.078 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:39 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:08:40.078 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:39 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:08:40.078 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:39 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:40.078 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:39 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:08:40.078 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:39 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:08:40.078 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:39 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:40.078 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:39 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:08:40.078 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:39 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:08:40.078 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:39 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:40.078 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:39 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:08:40.078 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:39 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:08:40.079 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:39 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:40.079 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:39 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:08:40.079 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:39 smithi099 ceph-mon[137093]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-03-30T14:08:40.079 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:39 smithi099 ceph-mon[137093]: failed to encode map e136 with expected crc 2024-03-30T14:08:40.079 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:39 smithi099 ceph-mon[137093]: osdmap e136: 8 total, 7 up, 8 in 2024-03-30T14:08:40.079 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:39 smithi099 ceph-mon[137093]: from='osd.4 [v2:172.21.15.181:6800/2605435331,v1:172.21.15.181:6801/2605435331]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi181", "root=default"]}]: dispatch 2024-03-30T14:08:40.079 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:39 smithi099 ceph-mon[137093]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi181", "root=default"]}]: dispatch 2024-03-30T14:08:40.079 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:39 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:08:40.079 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:39 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:40.079 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:39 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:08:40.079 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:39 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:08:40.079 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:39 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:40.080 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:39 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:08:40.080 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:39 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:08:40.080 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:39 smithi099 ceph-mon[143401]: from='client.25136 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T14:08:40.080 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:39 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:08:40.080 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:39 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:08:40.080 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:39 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:08:40.080 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:39 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:08:40.080 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:39 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:08:40.080 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:39 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:40.080 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:39 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:08:40.080 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:39 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:08:40.080 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:39 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:40.080 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:39 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:08:40.080 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:39 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:08:40.081 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:39 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:40.081 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:39 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:08:40.081 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:39 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:08:40.081 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:39 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:40.081 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:39 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:08:40.081 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:39 smithi099 ceph-mon[143401]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-03-30T14:08:40.081 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:39 smithi099 ceph-mon[143401]: failed to encode map e136 with expected crc 2024-03-30T14:08:40.081 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:39 smithi099 ceph-mon[143401]: osdmap e136: 8 total, 7 up, 8 in 2024-03-30T14:08:40.081 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:39 smithi099 ceph-mon[143401]: from='osd.4 [v2:172.21.15.181:6800/2605435331,v1:172.21.15.181:6801/2605435331]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi181", "root=default"]}]: dispatch 2024-03-30T14:08:40.081 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:39 smithi099 ceph-mon[143401]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi181", "root=default"]}]: dispatch 2024-03-30T14:08:40.081 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:39 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:08:40.081 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:39 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:40.081 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:39 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:08:40.081 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:39 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:08:40.082 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:39 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:40.082 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:39 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:08:40.082 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:39 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:40.082 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:39 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:08:40.082 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:39 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:08:40.082 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:39 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:40.082 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:39 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:08:40.083 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:39 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:40.083 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:39 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:08:40.083 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:39 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:08:40.083 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:39 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:40.083 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:39 smithi099 ceph-mon[137093]: from='osd.4 ' entity='osd.4' 2024-03-30T14:08:40.083 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:39 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:08:40.083 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:39 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:40.083 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:39 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:08:40.083 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:39 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:08:40.083 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:39 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:40.084 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:39 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:08:40.084 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:39 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:40.084 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:39 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:08:40.084 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:39 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:08:40.084 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:39 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:40.084 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:39 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:08:40.084 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:39 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:40.084 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:39 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:08:40.084 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:39 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:08:40.084 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:39 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:40.084 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:39 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:08:40.084 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:39 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:40.084 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:39 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:08:40.085 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:39 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:08:40.085 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:39 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:40.085 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:39 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:08:40.085 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:39 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:40.085 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:39 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:08:40.085 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:39 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:08:40.085 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:39 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:40.085 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:39 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:08:40.085 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:39 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:40.085 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:39 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:08:40.086 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:39 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:08:40.086 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:39 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:40.086 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:39 smithi099 ceph-mon[143401]: from='osd.4 ' entity='osd.4' 2024-03-30T14:08:40.086 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:39 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:08:40.086 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:39 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:40.086 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:39 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:08:40.086 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:39 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:08:40.086 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:39 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:40.086 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:39 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:08:40.086 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:39 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:40.086 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:39 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:08:40.086 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:39 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:08:40.086 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:39 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:40.086 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:39 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:08:40.087 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:39 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:40.087 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:39 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:08:40.087 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:39 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:08:40.087 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:39 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:40.087 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:39 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:08:40.087 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:39 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:40.087 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:39 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:08:40.087 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:39 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:08:40.087 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:39 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:40.328 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 14:08:40 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[71049]: 2024-03-30T14:08:40.083+0000 7f3c008ec700 -1 mgr.server reply reply (16) Device or resource busy unsafe to stop osd(s) at this time (15 PGs are or would become offline) 2024-03-30T14:08:40.998 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:40 smithi181 ceph-mon[115276]: pgmap v176: 161 pgs: 26 active+undersized+degraded, 43 active+undersized, 92 active+clean; 585 KiB data, 183 MiB used, 715 GiB / 715 GiB avail; 106/627 objects degraded (16.906%) 2024-03-30T14:08:40.998 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:40 smithi181 ceph-mon[115276]: failed to encode map e136 with expected crc 2024-03-30T14:08:40.998 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:40 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:08:40.998 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:40 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:08:40.998 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:40 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:08:40.998 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:40 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:08:40.998 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:40 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:08:40.998 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:40 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:08:40.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:40 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:08:40.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:40 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:08:40.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:40 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:40.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:40 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:08:40.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:40 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:08:40.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:40 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:40.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:40 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:08:40.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:40 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:08:40.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:40 smithi181 ceph-mon[115276]: Health check update: Degraded data redundancy: 106/627 objects degraded (16.906%), 26 pgs degraded (PG_DEGRADED) 2024-03-30T14:08:40.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:40 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:40.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:40 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:08:40.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:40 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:08:40.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:40 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:40.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:40 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:08:40.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:40 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:08:40.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:40 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:41.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:40 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:08:41.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:40 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:08:41.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:40 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:41.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:40 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:08:41.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:40 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:41.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:40 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:08:41.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:40 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:08:41.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:40 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:41.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:40 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:41.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:40 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:41.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:40 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:41.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:40 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:08:41.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:40 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:41.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:40 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:41.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:40 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:41.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:40 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-03-30T14:08:41.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:40 smithi181 ceph-mon[115276]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-03-30T14:08:41.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:40 smithi181 ceph-mon[115276]: osd.4 [v2:172.21.15.181:6800/2605435331,v1:172.21.15.181:6801/2605435331] boot 2024-03-30T14:08:41.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:40 smithi181 ceph-mon[115276]: osdmap e137: 8 total, 8 up, 8 in 2024-03-30T14:08:41.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:40 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-03-30T14:08:41.079 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:40 smithi099 ceph-mon[137093]: pgmap v176: 161 pgs: 26 active+undersized+degraded, 43 active+undersized, 92 active+clean; 585 KiB data, 183 MiB used, 715 GiB / 715 GiB avail; 106/627 objects degraded (16.906%) 2024-03-30T14:08:41.079 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:40 smithi099 ceph-mon[137093]: failed to encode map e136 with expected crc 2024-03-30T14:08:41.079 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:40 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:08:41.079 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:40 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:08:41.079 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:40 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:08:41.079 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:40 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:08:41.079 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:40 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:08:41.079 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:40 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:08:41.079 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:40 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:08:41.079 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:40 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:08:41.079 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:40 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:41.079 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:40 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:08:41.079 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:40 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:08:41.080 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:40 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:41.080 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:40 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:08:41.080 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:40 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:08:41.080 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:40 smithi099 ceph-mon[137093]: Health check update: Degraded data redundancy: 106/627 objects degraded (16.906%), 26 pgs degraded (PG_DEGRADED) 2024-03-30T14:08:41.080 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:40 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:41.080 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:40 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:08:41.080 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:40 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:08:41.080 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:40 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:41.080 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:40 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:08:41.080 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:40 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:08:41.080 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:40 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:41.080 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:40 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:08:41.080 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:40 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:08:41.080 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:40 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:41.081 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:40 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:08:41.081 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:40 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:41.081 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:40 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:08:41.081 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:40 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:08:41.081 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:40 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:41.081 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:40 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:41.081 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:40 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:41.081 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:40 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:41.081 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:40 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:08:41.081 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:40 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:41.081 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:40 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:41.081 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:40 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:41.081 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:40 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-03-30T14:08:41.081 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:40 smithi099 ceph-mon[137093]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-03-30T14:08:41.081 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:40 smithi099 ceph-mon[137093]: osd.4 [v2:172.21.15.181:6800/2605435331,v1:172.21.15.181:6801/2605435331] boot 2024-03-30T14:08:41.082 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:40 smithi099 ceph-mon[137093]: osdmap e137: 8 total, 8 up, 8 in 2024-03-30T14:08:41.082 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:40 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-03-30T14:08:41.082 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:40 smithi099 ceph-mon[143401]: pgmap v176: 161 pgs: 26 active+undersized+degraded, 43 active+undersized, 92 active+clean; 585 KiB data, 183 MiB used, 715 GiB / 715 GiB avail; 106/627 objects degraded (16.906%) 2024-03-30T14:08:41.082 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:40 smithi099 ceph-mon[143401]: failed to encode map e136 with expected crc 2024-03-30T14:08:41.082 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:40 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:08:41.082 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:40 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:08:41.082 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:40 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:08:41.082 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:40 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:08:41.082 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:40 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:08:41.083 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:40 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:08:41.083 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:40 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:08:41.083 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:40 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:08:41.083 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:40 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:41.083 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:40 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:08:41.083 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:40 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:08:41.083 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:40 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:41.083 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:40 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:08:41.083 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:40 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:08:41.083 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:40 smithi099 ceph-mon[143401]: Health check update: Degraded data redundancy: 106/627 objects degraded (16.906%), 26 pgs degraded (PG_DEGRADED) 2024-03-30T14:08:41.083 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:40 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:41.083 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:40 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:08:41.083 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:40 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:08:41.083 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:40 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:41.084 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:40 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:08:41.084 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:40 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:08:41.084 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:40 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:41.084 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:40 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:08:41.084 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:40 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:08:41.084 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:40 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:41.084 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:40 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:08:41.084 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:40 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:41.084 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:40 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:08:41.084 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:40 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:08:41.084 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:40 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:41.084 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:40 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:41.084 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:40 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:41.084 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:40 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:41.085 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:40 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:08:41.085 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:40 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:41.085 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:40 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:41.085 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:40 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:08:41.085 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:40 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-03-30T14:08:41.085 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:40 smithi099 ceph-mon[143401]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-03-30T14:08:41.085 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:40 smithi099 ceph-mon[143401]: osd.4 [v2:172.21.15.181:6800/2605435331,v1:172.21.15.181:6801/2605435331] boot 2024-03-30T14:08:41.085 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:40 smithi099 ceph-mon[143401]: osdmap e137: 8 total, 8 up, 8 in 2024-03-30T14:08:41.085 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:40 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-03-30T14:08:41.747 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:41 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:08:41.747 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:41 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:08:41.747 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:41 smithi181 ceph-mon[115276]: pgmap v178: 161 pgs: 26 active+undersized+degraded, 43 active+undersized, 92 active+clean; 585 KiB data, 205 MiB used, 715 GiB / 715 GiB avail; 442 B/s rd, 0 op/s; 106/627 objects degraded (16.906%) 2024-03-30T14:08:41.747 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:41 smithi181 ceph-mon[115276]: from='mon.2 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-03-30T14:08:41.747 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:41 smithi181 ceph-mon[115276]: Upgrade: unsafe to stop osd(s) at this time (15 PGs are or would become offline) 2024-03-30T14:08:41.748 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:41 smithi181 ceph-mon[115276]: failed to encode map e137 with expected crc 2024-03-30T14:08:41.748 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:41 smithi181 ceph-mon[115276]: failed to encode map e137 with expected crc 2024-03-30T14:08:41.748 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:41 smithi181 ceph-mon[115276]: failed to encode map e137 with expected crc 2024-03-30T14:08:41.748 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:41 smithi181 ceph-mon[115276]: Health check failed: 1 failed cephadm daemon(s) (CEPHADM_FAILED_DAEMON) 2024-03-30T14:08:41.748 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:41 smithi181 ceph-mon[115276]: osdmap e138: 8 total, 8 up, 8 in 2024-03-30T14:08:41.962 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:41 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:08:41.962 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:41 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:08:41.962 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:41 smithi099 ceph-mon[137093]: pgmap v178: 161 pgs: 26 active+undersized+degraded, 43 active+undersized, 92 active+clean; 585 KiB data, 205 MiB used, 715 GiB / 715 GiB avail; 442 B/s rd, 0 op/s; 106/627 objects degraded (16.906%) 2024-03-30T14:08:41.962 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:41 smithi099 ceph-mon[137093]: from='mon.2 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-03-30T14:08:41.963 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:41 smithi099 ceph-mon[137093]: Upgrade: unsafe to stop osd(s) at this time (15 PGs are or would become offline) 2024-03-30T14:08:41.963 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:41 smithi099 ceph-mon[137093]: failed to encode map e137 with expected crc 2024-03-30T14:08:41.963 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:41 smithi099 ceph-mon[137093]: failed to encode map e137 with expected crc 2024-03-30T14:08:41.963 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:41 smithi099 ceph-mon[137093]: failed to encode map e137 with expected crc 2024-03-30T14:08:41.963 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:41 smithi099 ceph-mon[137093]: Health check failed: 1 failed cephadm daemon(s) (CEPHADM_FAILED_DAEMON) 2024-03-30T14:08:41.963 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:41 smithi099 ceph-mon[137093]: osdmap e138: 8 total, 8 up, 8 in 2024-03-30T14:08:41.963 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:41 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:08:41.963 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:41 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:08:41.963 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:41 smithi099 ceph-mon[143401]: pgmap v178: 161 pgs: 26 active+undersized+degraded, 43 active+undersized, 92 active+clean; 585 KiB data, 205 MiB used, 715 GiB / 715 GiB avail; 442 B/s rd, 0 op/s; 106/627 objects degraded (16.906%) 2024-03-30T14:08:41.963 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:41 smithi099 ceph-mon[143401]: from='mon.2 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-03-30T14:08:41.963 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:41 smithi099 ceph-mon[143401]: Upgrade: unsafe to stop osd(s) at this time (15 PGs are or would become offline) 2024-03-30T14:08:41.963 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:41 smithi099 ceph-mon[143401]: failed to encode map e137 with expected crc 2024-03-30T14:08:41.964 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:41 smithi099 ceph-mon[143401]: failed to encode map e137 with expected crc 2024-03-30T14:08:41.964 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:41 smithi099 ceph-mon[143401]: failed to encode map e137 with expected crc 2024-03-30T14:08:41.964 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:41 smithi099 ceph-mon[143401]: Health check failed: 1 failed cephadm daemon(s) (CEPHADM_FAILED_DAEMON) 2024-03-30T14:08:41.964 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:41 smithi099 ceph-mon[143401]: osdmap e138: 8 total, 8 up, 8 in 2024-03-30T14:08:42.828 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:42 smithi099 ceph-mon[143401]: failed to encode map e138 with expected crc 2024-03-30T14:08:42.828 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:42 smithi099 ceph-mon[143401]: failed to encode map e138 with expected crc 2024-03-30T14:08:42.828 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:42 smithi099 ceph-mon[143401]: failed to encode map e138 with expected crc 2024-03-30T14:08:42.828 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:42 smithi099 ceph-mon[143401]: failed to encode map e138 with expected crc 2024-03-30T14:08:42.828 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:42 smithi099 ceph-mon[143401]: failed to encode map e138 with expected crc 2024-03-30T14:08:42.829 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:42 smithi099 ceph-mon[143401]: failed to encode map e138 with expected crc 2024-03-30T14:08:42.829 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:42 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:42.829 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:42 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:42.829 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:42 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:42.829 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:42 smithi099 ceph-mon[137093]: failed to encode map e138 with expected crc 2024-03-30T14:08:42.829 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:42 smithi099 ceph-mon[137093]: failed to encode map e138 with expected crc 2024-03-30T14:08:42.829 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:42 smithi099 ceph-mon[137093]: failed to encode map e138 with expected crc 2024-03-30T14:08:42.829 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:42 smithi099 ceph-mon[137093]: failed to encode map e138 with expected crc 2024-03-30T14:08:42.829 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:42 smithi099 ceph-mon[137093]: failed to encode map e138 with expected crc 2024-03-30T14:08:42.829 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:42 smithi099 ceph-mon[137093]: failed to encode map e138 with expected crc 2024-03-30T14:08:42.829 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:42 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:42.829 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:42 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:42.830 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:42 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:42.956 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:42 smithi181 ceph-mon[115276]: failed to encode map e138 with expected crc 2024-03-30T14:08:42.956 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:42 smithi181 ceph-mon[115276]: failed to encode map e138 with expected crc 2024-03-30T14:08:42.956 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:42 smithi181 ceph-mon[115276]: failed to encode map e138 with expected crc 2024-03-30T14:08:42.956 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:42 smithi181 ceph-mon[115276]: failed to encode map e138 with expected crc 2024-03-30T14:08:42.956 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:42 smithi181 ceph-mon[115276]: failed to encode map e138 with expected crc 2024-03-30T14:08:42.956 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:42 smithi181 ceph-mon[115276]: failed to encode map e138 with expected crc 2024-03-30T14:08:42.957 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:42 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:42.957 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:42 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:42.957 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:42 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:43.747 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:43 smithi181 ceph-mon[115276]: pgmap v181: 161 pgs: 4 peering, 25 active+undersized+degraded, 40 active+undersized, 92 active+clean; 585 KiB data, 205 MiB used, 715 GiB / 715 GiB avail; 976 B/s rd, 0 op/s; 102/627 objects degraded (16.268%) 2024-03-30T14:08:43.747 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:43 smithi181 ceph-mon[115276]: pgmap v182: 161 pgs: 4 peering, 25 active+undersized+degraded, 40 active+undersized, 92 active+clean; 585 KiB data, 205 MiB used, 715 GiB / 715 GiB avail; 1.3 KiB/s rd, 1 op/s; 102/627 objects degraded (16.268%) 2024-03-30T14:08:43.747 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:43 smithi181 ceph-mon[115276]: pgmap v183: 161 pgs: 4 peering, 25 active+undersized+degraded, 40 active+undersized, 92 active+clean; 585 KiB data, 205 MiB used, 715 GiB / 715 GiB avail; 1.4 KiB/s rd, 1 op/s; 102/627 objects degraded (16.268%) 2024-03-30T14:08:44.035 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:43 smithi099 ceph-mon[137093]: pgmap v181: 161 pgs: 4 peering, 25 active+undersized+degraded, 40 active+undersized, 92 active+clean; 585 KiB data, 205 MiB used, 715 GiB / 715 GiB avail; 976 B/s rd, 0 op/s; 102/627 objects degraded (16.268%) 2024-03-30T14:08:44.036 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:43 smithi099 ceph-mon[137093]: pgmap v182: 161 pgs: 4 peering, 25 active+undersized+degraded, 40 active+undersized, 92 active+clean; 585 KiB data, 205 MiB used, 715 GiB / 715 GiB avail; 1.3 KiB/s rd, 1 op/s; 102/627 objects degraded (16.268%) 2024-03-30T14:08:44.036 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:43 smithi099 ceph-mon[137093]: pgmap v183: 161 pgs: 4 peering, 25 active+undersized+degraded, 40 active+undersized, 92 active+clean; 585 KiB data, 205 MiB used, 715 GiB / 715 GiB avail; 1.4 KiB/s rd, 1 op/s; 102/627 objects degraded (16.268%) 2024-03-30T14:08:44.036 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:43 smithi099 ceph-mon[143401]: pgmap v181: 161 pgs: 4 peering, 25 active+undersized+degraded, 40 active+undersized, 92 active+clean; 585 KiB data, 205 MiB used, 715 GiB / 715 GiB avail; 976 B/s rd, 0 op/s; 102/627 objects degraded (16.268%) 2024-03-30T14:08:44.036 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:43 smithi099 ceph-mon[143401]: pgmap v182: 161 pgs: 4 peering, 25 active+undersized+degraded, 40 active+undersized, 92 active+clean; 585 KiB data, 205 MiB used, 715 GiB / 715 GiB avail; 1.3 KiB/s rd, 1 op/s; 102/627 objects degraded (16.268%) 2024-03-30T14:08:44.036 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:43 smithi099 ceph-mon[143401]: pgmap v183: 161 pgs: 4 peering, 25 active+undersized+degraded, 40 active+undersized, 92 active+clean; 585 KiB data, 205 MiB used, 715 GiB / 715 GiB avail; 1.4 KiB/s rd, 1 op/s; 102/627 objects degraded (16.268%) 2024-03-30T14:08:45.078 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 14:08:44 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[71049]: ::ffff:172.21.15.181 - - [30/Mar/2024:14:08:44] "GET /metrics HTTP/1.1" 200 38265 "" "Prometheus/2.43.0" 2024-03-30T14:08:45.828 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:45 smithi099 ceph-mon[143401]: pgmap v184: 161 pgs: 4 peering, 3 active+undersized+degraded, 7 active+undersized, 147 active+clean; 585 KiB data, 194 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s; 15/627 objects degraded (2.392%) 2024-03-30T14:08:45.828 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:45 smithi099 ceph-mon[143401]: Health check update: Degraded data redundancy: 15/627 objects degraded (2.392%), 3 pgs degraded (PG_DEGRADED) 2024-03-30T14:08:45.828 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:45 smithi099 ceph-mon[137093]: pgmap v184: 161 pgs: 4 peering, 3 active+undersized+degraded, 7 active+undersized, 147 active+clean; 585 KiB data, 194 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s; 15/627 objects degraded (2.392%) 2024-03-30T14:08:45.829 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:45 smithi099 ceph-mon[137093]: Health check update: Degraded data redundancy: 15/627 objects degraded (2.392%), 3 pgs degraded (PG_DEGRADED) 2024-03-30T14:08:45.985 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:45 smithi181 ceph-mon[115276]: pgmap v184: 161 pgs: 4 peering, 3 active+undersized+degraded, 7 active+undersized, 147 active+clean; 585 KiB data, 194 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s; 15/627 objects degraded (2.392%) 2024-03-30T14:08:45.986 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:45 smithi181 ceph-mon[115276]: Health check update: Degraded data redundancy: 15/627 objects degraded (2.392%), 3 pgs degraded (PG_DEGRADED) 2024-03-30T14:08:46.828 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:46 smithi099 ceph-mon[137093]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 15/627 objects degraded (2.392%), 3 pgs degraded) 2024-03-30T14:08:46.828 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:46 smithi099 ceph-mon[143401]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 15/627 objects degraded (2.392%), 3 pgs degraded) 2024-03-30T14:08:46.997 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:46 smithi181 ceph-mon[115276]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 15/627 objects degraded (2.392%), 3 pgs degraded) 2024-03-30T14:08:47.971 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:47 smithi099 ceph-mon[137093]: pgmap v185: 161 pgs: 161 active+clean; 585 KiB data, 194 MiB used, 715 GiB / 715 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-03-30T14:08:47.971 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:47 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:47.971 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:47 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:47.971 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:47 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:47.971 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:47 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:47.972 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:47 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:47.972 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:47 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:47.972 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:47 smithi099 ceph-mon[143401]: pgmap v185: 161 pgs: 161 active+clean; 585 KiB data, 194 MiB used, 715 GiB / 715 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-03-30T14:08:47.972 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:47 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:47.972 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:47 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:47.972 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:47 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:47.972 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:47 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:47.972 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:47 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:47.972 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:47 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:47.997 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:47 smithi181 ceph-mon[115276]: pgmap v185: 161 pgs: 161 active+clean; 585 KiB data, 194 MiB used, 715 GiB / 715 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-03-30T14:08:47.997 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:47 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:47.997 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:47 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:47.997 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:47 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:47.997 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:47 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:47.997 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:47 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:47.998 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:47 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:48.997 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:48 smithi181 ceph-mon[115276]: pgmap v186: 161 pgs: 161 active+clean; 585 KiB data, 194 MiB used, 715 GiB / 715 GiB avail; 862 B/s rd, 0 op/s 2024-03-30T14:08:48.997 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:48 smithi181 ceph-mon[115276]: Health check cleared: CEPHADM_FAILED_DAEMON (was: 1 failed cephadm daemon(s)) 2024-03-30T14:08:48.997 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:48 smithi181 ceph-mon[115276]: Cluster is now healthy 2024-03-30T14:08:49.078 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:48 smithi099 ceph-mon[143401]: pgmap v186: 161 pgs: 161 active+clean; 585 KiB data, 194 MiB used, 715 GiB / 715 GiB avail; 862 B/s rd, 0 op/s 2024-03-30T14:08:49.078 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:48 smithi099 ceph-mon[143401]: Health check cleared: CEPHADM_FAILED_DAEMON (was: 1 failed cephadm daemon(s)) 2024-03-30T14:08:49.078 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:48 smithi099 ceph-mon[143401]: Cluster is now healthy 2024-03-30T14:08:49.079 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:48 smithi099 ceph-mon[137093]: pgmap v186: 161 pgs: 161 active+clean; 585 KiB data, 194 MiB used, 715 GiB / 715 GiB avail; 862 B/s rd, 0 op/s 2024-03-30T14:08:49.079 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:48 smithi099 ceph-mon[137093]: Health check cleared: CEPHADM_FAILED_DAEMON (was: 1 failed cephadm daemon(s)) 2024-03-30T14:08:49.079 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:48 smithi099 ceph-mon[137093]: Cluster is now healthy 2024-03-30T14:08:49.997 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:49 smithi181 ceph-mon[115276]: from='client.25136 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T14:08:50.078 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:49 smithi099 ceph-mon[137093]: from='client.25136 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T14:08:50.078 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:49 smithi099 ceph-mon[143401]: from='client.25136 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T14:08:51.078 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:50 smithi099 ceph-mon[137093]: pgmap v187: 161 pgs: 161 active+clean; 585 KiB data, 194 MiB used, 715 GiB / 715 GiB avail; 710 B/s rd, 0 op/s 2024-03-30T14:08:51.078 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:50 smithi099 ceph-mon[143401]: pgmap v187: 161 pgs: 161 active+clean; 585 KiB data, 194 MiB used, 715 GiB / 715 GiB avail; 710 B/s rd, 0 op/s 2024-03-30T14:08:51.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:50 smithi181 ceph-mon[115276]: pgmap v187: 161 pgs: 161 active+clean; 585 KiB data, 194 MiB used, 715 GiB / 715 GiB avail; 710 B/s rd, 0 op/s 2024-03-30T14:08:53.078 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:52 smithi099 ceph-mon[137093]: pgmap v188: 161 pgs: 161 active+clean; 585 KiB data, 194 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-03-30T14:08:53.078 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:52 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:53.078 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:52 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T14:08:53.078 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:52 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:53.079 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:52 smithi099 ceph-mon[143401]: pgmap v188: 161 pgs: 161 active+clean; 585 KiB data, 194 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-03-30T14:08:53.079 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:52 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:53.079 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:52 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T14:08:53.079 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:52 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:53.247 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:52 smithi181 ceph-mon[115276]: pgmap v188: 161 pgs: 161 active+clean; 585 KiB data, 194 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-03-30T14:08:53.248 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:52 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:53.248 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:52 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T14:08:53.248 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:52 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:55.078 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:54 smithi099 ceph-mon[137093]: pgmap v189: 161 pgs: 161 active+clean; 585 KiB data, 194 MiB used, 715 GiB / 715 GiB avail; 953 B/s rd, 0 op/s 2024-03-30T14:08:55.078 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:54 smithi099 ceph-mon[143401]: pgmap v189: 161 pgs: 161 active+clean; 585 KiB data, 194 MiB used, 715 GiB / 715 GiB avail; 953 B/s rd, 0 op/s 2024-03-30T14:08:55.079 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 14:08:54 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[71049]: ::ffff:172.21.15.181 - - [30/Mar/2024:14:08:54] "GET /metrics HTTP/1.1" 200 38265 "" "Prometheus/2.43.0" 2024-03-30T14:08:55.247 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:54 smithi181 ceph-mon[115276]: pgmap v189: 161 pgs: 161 active+clean; 585 KiB data, 194 MiB used, 715 GiB / 715 GiB avail; 953 B/s rd, 0 op/s 2024-03-30T14:08:55.976 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:55 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-03-30T14:08:55.977 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:55 smithi181 ceph-mon[115276]: from='mon.2 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-03-30T14:08:55.977 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:55 smithi181 ceph-mon[115276]: Upgrade: osd.5 is safe to restart 2024-03-30T14:08:55.977 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:55 smithi181 ceph-mon[115276]: pgmap v190: 161 pgs: 161 active+clean; 585 KiB data, 194 MiB used, 715 GiB / 715 GiB avail; 953 B/s rd, 0 op/s 2024-03-30T14:08:56.078 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:55 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-03-30T14:08:56.078 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:55 smithi099 ceph-mon[137093]: from='mon.2 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-03-30T14:08:56.078 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:55 smithi099 ceph-mon[137093]: Upgrade: osd.5 is safe to restart 2024-03-30T14:08:56.078 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:55 smithi099 ceph-mon[137093]: pgmap v190: 161 pgs: 161 active+clean; 585 KiB data, 194 MiB used, 715 GiB / 715 GiB avail; 953 B/s rd, 0 op/s 2024-03-30T14:08:56.079 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:55 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-03-30T14:08:56.079 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:55 smithi099 ceph-mon[143401]: from='mon.2 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-03-30T14:08:56.079 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:55 smithi099 ceph-mon[143401]: Upgrade: osd.5 is safe to restart 2024-03-30T14:08:56.079 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:55 smithi099 ceph-mon[143401]: pgmap v190: 161 pgs: 161 active+clean; 585 KiB data, 194 MiB used, 715 GiB / 715 GiB avail; 953 B/s rd, 0 op/s 2024-03-30T14:08:57.767 INFO:teuthology.orchestra.run.smithi099.stdout:true 2024-03-30T14:08:57.828 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:57 smithi099 ceph-mon[143401]: Upgrade: Updating osd.5 2024-03-30T14:08:57.828 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:57 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:57.828 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:57 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-03-30T14:08:57.828 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:57 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:08:57.829 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:57 smithi099 ceph-mon[137093]: Upgrade: Updating osd.5 2024-03-30T14:08:57.829 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:57 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:57.829 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:57 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-03-30T14:08:57.829 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:57 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:08:57.997 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:57 smithi181 ceph-mon[115276]: Upgrade: Updating osd.5 2024-03-30T14:08:57.997 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:57 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:08:57.997 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:57 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-03-30T14:08:57.997 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:57 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:08:58.426 INFO:teuthology.orchestra.run.smithi099.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-03-30T14:08:58.426 INFO:teuthology.orchestra.run.smithi099.stdout:agent.smithi099 smithi099 running 15s ago 37m - - 2024-03-30T14:08:58.426 INFO:teuthology.orchestra.run.smithi099.stdout:agent.smithi181 smithi181 running 10s ago 37m - - 2024-03-30T14:08:58.426 INFO:teuthology.orchestra.run.smithi099.stdout:alertmanager.a smithi099 *:9093,9094 running (7m) 15s ago 31m 26.9M - 0.25.0 c8568f914cd2 08735152b67d 2024-03-30T14:08:58.426 INFO:teuthology.orchestra.run.smithi099.stdout:grafana.a smithi181 *:3000 running (7m) 10s ago 31m 79.7M - 9.4.12 2bacad6d85d8 d599aa7730d6 2024-03-30T14:08:58.426 INFO:teuthology.orchestra.run.smithi099.stdout:iscsi.foo.smithi099.qyjuvr smithi099 running (10m) 15s ago 30m 59.7M - 3.5 e1d6a67b021e 2f859af6bc2a 2024-03-30T14:08:58.426 INFO:teuthology.orchestra.run.smithi099.stdout:mgr.x smithi181 *:8443,9283,8765 running (9m) 10s ago 36m 451M - 19.0.0-1967-g4e50bbcd b0c4478f1d83 f269106f7913 2024-03-30T14:08:58.426 INFO:teuthology.orchestra.run.smithi099.stdout:mgr.y smithi099 *:8443,9283,8765 running (20m) 15s ago 38m 526M - 19.0.0-1967-g4e50bbcd b0c4478f1d83 0d464b8c1d18 2024-03-30T14:08:58.426 INFO:teuthology.orchestra.run.smithi099.stdout:mon.a smithi099 running (5m) 15s ago 38m 57.9M 2048M 19.0.0-1967-g4e50bbcd b0c4478f1d83 f19388464dfd 2024-03-30T14:08:58.426 INFO:teuthology.orchestra.run.smithi099.stdout:mon.b smithi181 running (6m) 10s ago 36m 58.0M 2048M 19.0.0-1967-g4e50bbcd b0c4478f1d83 0468ed087cdd 2024-03-30T14:08:58.426 INFO:teuthology.orchestra.run.smithi099.stdout:mon.c smithi099 running (4m) 15s ago 36m 48.6M 2048M 19.0.0-1967-g4e50bbcd b0c4478f1d83 731056a2fea6 2024-03-30T14:08:58.427 INFO:teuthology.orchestra.run.smithi099.stdout:node-exporter.a smithi099 *:9100 running (8m) 15s ago 32m 16.3M - 1.5.0 0da6a335fe13 4a3f1f6e7068 2024-03-30T14:08:58.427 INFO:teuthology.orchestra.run.smithi099.stdout:node-exporter.b smithi181 *:9100 running (8m) 10s ago 32m 16.5M - 1.5.0 0da6a335fe13 acea317b5f5d 2024-03-30T14:08:58.427 INFO:teuthology.orchestra.run.smithi099.stdout:osd.0 smithi099 running (3m) 15s ago 36m 55.5M 4096M 19.0.0-1967-g4e50bbcd b0c4478f1d83 d97d48cb3314 2024-03-30T14:08:58.427 INFO:teuthology.orchestra.run.smithi099.stdout:osd.1 smithi099 running (2m) 15s ago 35m 57.6M 4096M 19.0.0-1967-g4e50bbcd b0c4478f1d83 a843295ce83b 2024-03-30T14:08:58.427 INFO:teuthology.orchestra.run.smithi099.stdout:osd.2 smithi099 running (112s) 15s ago 35m 45.1M 4096M 19.0.0-1967-g4e50bbcd b0c4478f1d83 18304adfb0d0 2024-03-30T14:08:58.427 INFO:teuthology.orchestra.run.smithi099.stdout:osd.3 smithi099 running (52s) 15s ago 34m 44.7M 4096M 19.0.0-1967-g4e50bbcd b0c4478f1d83 9b38d79f070e 2024-03-30T14:08:58.427 INFO:teuthology.orchestra.run.smithi099.stdout:osd.4 smithi181 running (24s) 10s ago 34m 50.5M 4096M 19.0.0-1967-g4e50bbcd b0c4478f1d83 b9078af21e45 2024-03-30T14:08:58.427 INFO:teuthology.orchestra.run.smithi099.stdout:osd.5 smithi181 running (34m) 10s ago 34m 59.2M 4096M 17.2.0 e1d6a67b021e e330c920f152 2024-03-30T14:08:58.427 INFO:teuthology.orchestra.run.smithi099.stdout:osd.6 smithi181 running (33m) 10s ago 33m 58.2M 4096M 17.2.0 e1d6a67b021e 81d889ea213d 2024-03-30T14:08:58.427 INFO:teuthology.orchestra.run.smithi099.stdout:osd.7 smithi181 running (33m) 10s ago 33m 61.7M 4096M 17.2.0 e1d6a67b021e c08b1839dd7e 2024-03-30T14:08:58.427 INFO:teuthology.orchestra.run.smithi099.stdout:prometheus.a smithi181 *:9095 running (8m) 10s ago 32m 70.4M - 2.43.0 a07b618ecd1d 004088bdf70e 2024-03-30T14:08:58.427 INFO:teuthology.orchestra.run.smithi099.stdout:rgw.foo.smithi099.fxjbmp smithi099 *:8000 running (30m) 15s ago 30m 78.9M - 17.2.0 e1d6a67b021e 400b28b3f650 2024-03-30T14:08:58.427 INFO:teuthology.orchestra.run.smithi099.stdout:rgw.foo.smithi181.wfqwti smithi181 *:8000 running (30m) 10s ago 30m 78.7M - 17.2.0 e1d6a67b021e 97e1b130f9d4 2024-03-30T14:08:58.816 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-03-30T14:08:58.816 INFO:teuthology.orchestra.run.smithi099.stdout: "mon": { 2024-03-30T14:08:58.816 INFO:teuthology.orchestra.run.smithi099.stdout: "ceph version 19.0.0-1967-g4e50bbcd (4e50bbcdd1630c7760b708f3a5b4d38a121e66cb) squid (dev)": 3 2024-03-30T14:08:58.816 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T14:08:58.816 INFO:teuthology.orchestra.run.smithi099.stdout: "mgr": { 2024-03-30T14:08:58.816 INFO:teuthology.orchestra.run.smithi099.stdout: "ceph version 19.0.0-1967-g4e50bbcd (4e50bbcdd1630c7760b708f3a5b4d38a121e66cb) squid (dev)": 2 2024-03-30T14:08:58.816 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T14:08:58.816 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": { 2024-03-30T14:08:58.816 INFO:teuthology.orchestra.run.smithi099.stdout: "ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)": 3, 2024-03-30T14:08:58.816 INFO:teuthology.orchestra.run.smithi099.stdout: "ceph version 19.0.0-1967-g4e50bbcd (4e50bbcdd1630c7760b708f3a5b4d38a121e66cb) squid (dev)": 5 2024-03-30T14:08:58.816 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T14:08:58.817 INFO:teuthology.orchestra.run.smithi099.stdout: "rgw": { 2024-03-30T14:08:58.817 INFO:teuthology.orchestra.run.smithi099.stdout: "ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)": 2 2024-03-30T14:08:58.817 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T14:08:58.817 INFO:teuthology.orchestra.run.smithi099.stdout: "overall": { 2024-03-30T14:08:58.817 INFO:teuthology.orchestra.run.smithi099.stdout: "ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)": 5, 2024-03-30T14:08:58.817 INFO:teuthology.orchestra.run.smithi099.stdout: "ceph version 19.0.0-1967-g4e50bbcd (4e50bbcdd1630c7760b708f3a5b4d38a121e66cb) squid (dev)": 10 2024-03-30T14:08:58.817 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-03-30T14:08:58.817 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-03-30T14:08:58.991 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:58 smithi181 ceph-mon[115276]: Deploying daemon osd.5 on smithi181 2024-03-30T14:08:58.991 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:58 smithi181 ceph-mon[115276]: pgmap v191: 161 pgs: 161 active+clean; 585 KiB data, 194 MiB used, 715 GiB / 715 GiB avail; 953 B/s rd, 0 op/s 2024-03-30T14:08:58.991 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:58 smithi181 ceph-mon[115276]: from='client.54438 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T14:08:59.078 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:58 smithi099 ceph-mon[143401]: Deploying daemon osd.5 on smithi181 2024-03-30T14:08:59.078 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:58 smithi099 ceph-mon[143401]: pgmap v191: 161 pgs: 161 active+clean; 585 KiB data, 194 MiB used, 715 GiB / 715 GiB avail; 953 B/s rd, 0 op/s 2024-03-30T14:08:59.078 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:58 smithi099 ceph-mon[143401]: from='client.54438 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T14:08:59.078 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:58 smithi099 ceph-mon[137093]: Deploying daemon osd.5 on smithi181 2024-03-30T14:08:59.078 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:58 smithi099 ceph-mon[137093]: pgmap v191: 161 pgs: 161 active+clean; 585 KiB data, 194 MiB used, 715 GiB / 715 GiB avail; 953 B/s rd, 0 op/s 2024-03-30T14:08:59.078 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:58 smithi099 ceph-mon[137093]: from='client.54438 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T14:08:59.144 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-03-30T14:08:59.144 INFO:teuthology.orchestra.run.smithi099.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph:4e50bbcdd1630c7760b708f3a5b4d38a121e66cb", 2024-03-30T14:08:59.144 INFO:teuthology.orchestra.run.smithi099.stdout: "in_progress": true, 2024-03-30T14:08:59.144 INFO:teuthology.orchestra.run.smithi099.stdout: "which": "Upgrading daemons of type(s) crash,osd", 2024-03-30T14:08:59.144 INFO:teuthology.orchestra.run.smithi099.stdout: "services_complete": [], 2024-03-30T14:08:59.144 INFO:teuthology.orchestra.run.smithi099.stdout: "progress": "5/8 daemons upgraded", 2024-03-30T14:08:59.144 INFO:teuthology.orchestra.run.smithi099.stdout: "message": "Currently upgrading osd daemons", 2024-03-30T14:08:59.144 INFO:teuthology.orchestra.run.smithi099.stdout: "is_paused": false 2024-03-30T14:08:59.144 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-03-30T14:08:59.915 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:59 smithi181 ceph-mon[115276]: from='client.25136 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T14:08:59.916 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:59 smithi181 ceph-mon[115276]: from='client.54444 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T14:08:59.916 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:59 smithi181 ceph-mon[115276]: from='client.54450 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T14:08:59.916 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:08:59 smithi181 ceph-mon[115276]: from='client.? 172.21.15.99:0/2059089054' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:09:00.078 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:59 smithi099 ceph-mon[137093]: from='client.25136 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T14:09:00.078 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:59 smithi099 ceph-mon[137093]: from='client.54444 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T14:09:00.078 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:59 smithi099 ceph-mon[137093]: from='client.54450 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T14:09:00.078 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:08:59 smithi099 ceph-mon[137093]: from='client.? 172.21.15.99:0/2059089054' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:09:00.079 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:59 smithi099 ceph-mon[143401]: from='client.25136 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T14:09:00.079 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:59 smithi099 ceph-mon[143401]: from='client.54444 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T14:09:00.079 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:59 smithi099 ceph-mon[143401]: from='client.54450 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T14:09:00.079 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:08:59 smithi099 ceph-mon[143401]: from='client.? 172.21.15.99:0/2059089054' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:09:00.247 INFO:journalctl@ceph.osd.5.smithi181.stdout:Mar 30 14:09:00 smithi181 systemd[1]: Stopping Ceph osd.5 for 98ebaeb8-ee99-11ee-b647-cb9ed24678a4... 2024-03-30T14:09:00.997 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:00 smithi181 ceph-mon[115276]: from='client.64465 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T14:09:00.997 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:00 smithi181 ceph-mon[115276]: pgmap v192: 161 pgs: 161 active+clean; 585 KiB data, 194 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T14:09:00.998 INFO:journalctl@ceph.osd.5.smithi181.stdout:Mar 30 14:09:00 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-5[33388]: 2024-03-30T14:09:00.854+0000 7fdfd7b75700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.5 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-03-30T14:09:00.998 INFO:journalctl@ceph.osd.5.smithi181.stdout:Mar 30 14:09:00 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-5[33388]: 2024-03-30T14:09:00.854+0000 7fdfd7b75700 -1 osd.5 138 *** Got signal Terminated *** 2024-03-30T14:09:00.998 INFO:journalctl@ceph.osd.5.smithi181.stdout:Mar 30 14:09:00 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-5[33388]: 2024-03-30T14:09:00.854+0000 7fdfd7b75700 -1 osd.5 138 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-03-30T14:09:01.078 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:00 smithi099 ceph-mon[137093]: from='client.64465 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T14:09:01.078 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:00 smithi099 ceph-mon[137093]: pgmap v192: 161 pgs: 161 active+clean; 585 KiB data, 194 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T14:09:01.078 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:00 smithi099 ceph-mon[143401]: from='client.64465 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T14:09:01.078 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:00 smithi099 ceph-mon[143401]: pgmap v192: 161 pgs: 161 active+clean; 585 KiB data, 194 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T14:09:01.997 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:01 smithi181 ceph-mon[115276]: osd.5 marked itself down and dead 2024-03-30T14:09:01.997 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:01 smithi181 ceph-mon[115276]: pgmap v193: 161 pgs: 161 active+clean; 585 KiB data, 194 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T14:09:02.078 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:01 smithi099 ceph-mon[137093]: osd.5 marked itself down and dead 2024-03-30T14:09:02.078 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:01 smithi099 ceph-mon[137093]: pgmap v193: 161 pgs: 161 active+clean; 585 KiB data, 194 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T14:09:02.079 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:01 smithi099 ceph-mon[143401]: osd.5 marked itself down and dead 2024-03-30T14:09:02.079 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:01 smithi099 ceph-mon[143401]: pgmap v193: 161 pgs: 161 active+clean; 585 KiB data, 194 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T14:09:02.588 INFO:journalctl@ceph.osd.5.smithi181.stdout:Mar 30 14:09:02 smithi181 podman[153539]: 2024-03-30 14:09:02.284183056 +0000 UTC m=+1.550772306 container died e330c920f1522e8daa23172ce91e750efd4aceeaec031d936ffcebcb6cb5b69b (image=quay.io/ceph/ceph@sha256:12a0a4f43413fd97a14a3d47a3451b2d2df50020835bb93db666209f3f77617a, name=ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-5, description=CentOS Stream is a continuously delivered distro that tracks just ahead of Red Hat Enterprise Linux development. This image takes the Red Hat UBI and layers on content from CentOS Stream, GIT_CLEAN=True, com.redhat.component=centos-stream-container, build-date=2022-05-03T08:36:31.336870, CEPH_POINT_RELEASE=-17.2.0, GIT_COMMIT=b613db0f44179c0940781c1c7fe04e1acb7093ac, GIT_REPO=https://github.com/ceph/ceph-container.git, distribution-scope=public, vendor=Red Hat, Inc., name=centos-stream, release=754, vcs-ref=f1ee6e37554363ec55e0035aba1a693d3627fdeb, io.buildah.version=1.19.8, ceph=True, architecture=x86_64, version=8, maintainer=Guillaume Abrioux , RELEASE=HEAD, com.redhat.license_terms=https://centos.org/legal/licensing-policy/, com.redhat.build-host=cpt-1002.osbs.prod.upshift.rdu2.redhat.com, url=https://access.redhat.com/containers/#/registry.access.redhat.com/ubi8/images/8.6-754, io.k8s.display-name=CentOS Stream 8, io.k8s.description=The Universal Base Image is designed and engineered to be the base layer for all of your containerized applications, middleware and utilities. This base image is freely redistributable, but Red Hat only supports Red Hat technologies through subscriptions for Red Hat products. This image is maintained by Red Hat and updated regularly., vcs-type=git, GIT_BRANCH=HEAD, io.openshift.expose-services=, summary=Provides a CentOS Stream container based on the Red Hat Universal Base Image, io.openshift.tags=base centos centos-stream) 2024-03-30T14:09:02.925 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:02 smithi181 ceph-mon[115276]: Health check failed: 1 osds down (OSD_DOWN) 2024-03-30T14:09:02.925 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:02 smithi181 ceph-mon[115276]: failed to encode map e139 with expected crc 2024-03-30T14:09:02.925 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:02 smithi181 ceph-mon[115276]: failed to encode map e139 with expected crc 2024-03-30T14:09:02.926 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:02 smithi181 ceph-mon[115276]: failed to encode map e139 with expected crc 2024-03-30T14:09:02.926 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:02 smithi181 ceph-mon[115276]: osdmap e139: 8 total, 7 up, 8 in 2024-03-30T14:09:02.926 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:02 smithi181 ceph-mon[115276]: failed to encode map e139 with expected crc 2024-03-30T14:09:02.926 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:02 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:09:02.926 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:02 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:09:02.926 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:02 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:09:02.926 INFO:journalctl@ceph.osd.5.smithi181.stdout:Mar 30 14:09:02 smithi181 podman[153539]: 2024-03-30 14:09:02.596354223 +0000 UTC m=+1.862943462 container cleanup e330c920f1522e8daa23172ce91e750efd4aceeaec031d936ffcebcb6cb5b69b (image=quay.io/ceph/ceph@sha256:12a0a4f43413fd97a14a3d47a3451b2d2df50020835bb93db666209f3f77617a, name=ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-5, url=https://access.redhat.com/containers/#/registry.access.redhat.com/ubi8/images/8.6-754, GIT_REPO=https://github.com/ceph/ceph-container.git, release=754, GIT_COMMIT=b613db0f44179c0940781c1c7fe04e1acb7093ac, io.k8s.display-name=CentOS Stream 8, build-date=2022-05-03T08:36:31.336870, io.k8s.description=The Universal Base Image is designed and engineered to be the base layer for all of your containerized applications, middleware and utilities. This base image is freely redistributable, but Red Hat only supports Red Hat technologies through subscriptions for Red Hat products. This image is maintained by Red Hat and updated regularly., distribution-scope=public, GIT_BRANCH=HEAD, RELEASE=HEAD, io.openshift.tags=base centos centos-stream, description=CentOS Stream is a continuously delivered distro that tracks just ahead of Red Hat Enterprise Linux development. This image takes the Red Hat UBI and layers on content from CentOS Stream, com.redhat.build-host=cpt-1002.osbs.prod.upshift.rdu2.redhat.com, com.redhat.component=centos-stream-container, summary=Provides a CentOS Stream container based on the Red Hat Universal Base Image, com.redhat.license_terms=https://centos.org/legal/licensing-policy/, GIT_CLEAN=True, maintainer=Guillaume Abrioux , io.buildah.version=1.19.8, version=8, vcs-ref=f1ee6e37554363ec55e0035aba1a693d3627fdeb, io.openshift.expose-services=, vendor=Red Hat, Inc., ceph=True, name=centos-stream, CEPH_POINT_RELEASE=-17.2.0, architecture=x86_64, vcs-type=git) 2024-03-30T14:09:02.926 INFO:journalctl@ceph.osd.5.smithi181.stdout:Mar 30 14:09:02 smithi181 bash[153539]: ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-5 2024-03-30T14:09:02.926 INFO:journalctl@ceph.osd.5.smithi181.stdout:Mar 30 14:09:02 smithi181 podman[153555]: 2024-03-30 14:09:02.822977949 +0000 UTC m=+0.533984598 container remove e330c920f1522e8daa23172ce91e750efd4aceeaec031d936ffcebcb6cb5b69b (image=quay.io/ceph/ceph@sha256:12a0a4f43413fd97a14a3d47a3451b2d2df50020835bb93db666209f3f77617a, name=ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-5, io.k8s.display-name=CentOS Stream 8, url=https://access.redhat.com/containers/#/registry.access.redhat.com/ubi8/images/8.6-754, vcs-type=git, vendor=Red Hat, Inc., GIT_CLEAN=True, build-date=2022-05-03T08:36:31.336870, GIT_BRANCH=HEAD, name=centos-stream, RELEASE=HEAD, GIT_REPO=https://github.com/ceph/ceph-container.git, summary=Provides a CentOS Stream container based on the Red Hat Universal Base Image, io.openshift.tags=base centos centos-stream, description=CentOS Stream is a continuously delivered distro that tracks just ahead of Red Hat Enterprise Linux development. This image takes the Red Hat UBI and layers on content from CentOS Stream, com.redhat.component=centos-stream-container, io.buildah.version=1.19.8, distribution-scope=public, io.k8s.description=The Universal Base Image is designed and engineered to be the base layer for all of your containerized applications, middleware and utilities. This base image is freely redistributable, but Red Hat only supports Red Hat technologies through subscriptions for Red Hat products. This image is maintained by Red Hat and updated regularly., ceph=True, version=8, release=754, GIT_COMMIT=b613db0f44179c0940781c1c7fe04e1acb7093ac, vcs-ref=f1ee6e37554363ec55e0035aba1a693d3627fdeb, CEPH_POINT_RELEASE=-17.2.0, com.redhat.license_terms=https://centos.org/legal/licensing-policy/, io.openshift.expose-services=, com.redhat.build-host=cpt-1002.osbs.prod.upshift.rdu2.redhat.com, architecture=x86_64, maintainer=Guillaume Abrioux ) 2024-03-30T14:09:03.078 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:02 smithi099 ceph-mon[137093]: Health check failed: 1 osds down (OSD_DOWN) 2024-03-30T14:09:03.079 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:02 smithi099 ceph-mon[137093]: failed to encode map e139 with expected crc 2024-03-30T14:09:03.079 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:02 smithi099 ceph-mon[137093]: failed to encode map e139 with expected crc 2024-03-30T14:09:03.079 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:02 smithi099 ceph-mon[137093]: failed to encode map e139 with expected crc 2024-03-30T14:09:03.079 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:02 smithi099 ceph-mon[137093]: osdmap e139: 8 total, 7 up, 8 in 2024-03-30T14:09:03.079 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:02 smithi099 ceph-mon[137093]: failed to encode map e139 with expected crc 2024-03-30T14:09:03.079 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:02 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:09:03.079 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:02 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:09:03.079 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:02 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:09:03.079 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:02 smithi099 ceph-mon[143401]: Health check failed: 1 osds down (OSD_DOWN) 2024-03-30T14:09:03.079 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:02 smithi099 ceph-mon[143401]: failed to encode map e139 with expected crc 2024-03-30T14:09:03.079 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:02 smithi099 ceph-mon[143401]: failed to encode map e139 with expected crc 2024-03-30T14:09:03.079 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:02 smithi099 ceph-mon[143401]: failed to encode map e139 with expected crc 2024-03-30T14:09:03.080 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:02 smithi099 ceph-mon[143401]: osdmap e139: 8 total, 7 up, 8 in 2024-03-30T14:09:03.080 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:02 smithi099 ceph-mon[143401]: failed to encode map e139 with expected crc 2024-03-30T14:09:03.080 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:02 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:09:03.080 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:02 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:09:03.080 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:02 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:09:03.182 INFO:journalctl@ceph.osd.5.smithi181.stdout:Mar 30 14:09:03 smithi181 podman[153703]: 2024-03-30 14:09:03.060365481 +0000 UTC m=+0.019080195 image pull b0c4478f1d83795df4d538bf108aee5fac57194348fb16dcdbb3115f3e2fe95e quay.ceph.io/ceph-ci/ceph:4e50bbcdd1630c7760b708f3a5b4d38a121e66cb 2024-03-30T14:09:03.182 INFO:journalctl@ceph.osd.5.smithi181.stdout:Mar 30 14:09:03 smithi181 podman[153703]: 2024-03-30 14:09:03.190839978 +0000 UTC m=+0.149554668 container create c2c4bf51f0f2fd934c6083cc134eb666be698f0e8853b9baacc7945d4cde7ad1 (image=quay.ceph.io/ceph-ci/ceph:4e50bbcdd1630c7760b708f3a5b4d38a121e66cb, name=ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-5-deactivate, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, RELEASE=squid-4e50bbc, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240326, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, GIT_CLEAN=True) 2024-03-30T14:09:03.485 INFO:journalctl@ceph.osd.5.smithi181.stdout:Mar 30 14:09:03 smithi181 podman[153703]: 2024-03-30 14:09:03.410208153 +0000 UTC m=+0.368922857 container init c2c4bf51f0f2fd934c6083cc134eb666be698f0e8853b9baacc7945d4cde7ad1 (image=quay.ceph.io/ceph-ci/ceph:4e50bbcdd1630c7760b708f3a5b4d38a121e66cb, name=ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-5-deactivate, maintainer=Guillaume Abrioux , RELEASE=squid-4e50bbc, org.label-schema.vendor=CentOS, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.build-date=20240326, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, GIT_CLEAN=True) 2024-03-30T14:09:03.485 INFO:journalctl@ceph.osd.5.smithi181.stdout:Mar 30 14:09:03 smithi181 podman[153703]: 2024-03-30 14:09:03.413543338 +0000 UTC m=+0.372258029 container start c2c4bf51f0f2fd934c6083cc134eb666be698f0e8853b9baacc7945d4cde7ad1 (image=quay.ceph.io/ceph-ci/ceph:4e50bbcdd1630c7760b708f3a5b4d38a121e66cb, name=ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-5-deactivate, org.label-schema.build-date=20240326, RELEASE=squid-4e50bbc, GIT_CLEAN=True, org.label-schema.vendor=CentOS, ceph=True, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-03-30T14:09:03.485 INFO:journalctl@ceph.osd.5.smithi181.stdout:Mar 30 14:09:03 smithi181 podman[153703]: 2024-03-30 14:09:03.4932112 +0000 UTC m=+0.451925903 container attach c2c4bf51f0f2fd934c6083cc134eb666be698f0e8853b9baacc7945d4cde7ad1 (image=quay.ceph.io/ceph-ci/ceph:4e50bbcdd1630c7760b708f3a5b4d38a121e66cb, name=ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-5-deactivate, RELEASE=squid-4e50bbc, io.buildah.version=1.33.5, GIT_CLEAN=True, ceph=True, maintainer=Guillaume Abrioux , GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, org.label-schema.build-date=20240326, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD) 2024-03-30T14:09:03.747 INFO:journalctl@ceph.osd.5.smithi181.stdout:Mar 30 14:09:03 smithi181 podman[153703]: 2024-03-30 14:09:03.723677235 +0000 UTC m=+0.682391943 container died c2c4bf51f0f2fd934c6083cc134eb666be698f0e8853b9baacc7945d4cde7ad1 (image=quay.ceph.io/ceph-ci/ceph:4e50bbcdd1630c7760b708f3a5b4d38a121e66cb, name=ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-5-deactivate, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240326, io.buildah.version=1.33.5, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, RELEASE=squid-4e50bbc, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image) 2024-03-30T14:09:04.056 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:03 smithi181 ceph-mon[115276]: failed to encode map e140 with expected crc 2024-03-30T14:09:04.056 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:03 smithi181 ceph-mon[115276]: failed to encode map e140 with expected crc 2024-03-30T14:09:04.056 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:03 smithi181 ceph-mon[115276]: failed to encode map e140 with expected crc 2024-03-30T14:09:04.056 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:03 smithi181 ceph-mon[115276]: osdmap e140: 8 total, 7 up, 8 in 2024-03-30T14:09:04.056 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:03 smithi181 ceph-mon[115276]: failed to encode map e140 with expected crc 2024-03-30T14:09:04.056 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:03 smithi181 ceph-mon[115276]: failed to encode map e140 with expected crc 2024-03-30T14:09:04.056 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:03 smithi181 ceph-mon[115276]: failed to encode map e140 with expected crc 2024-03-30T14:09:04.057 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:03 smithi181 ceph-mon[115276]: pgmap v196: 161 pgs: 15 peering, 16 stale+active+clean, 130 active+clean; 585 KiB data, 194 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-03-30T14:09:04.078 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:03 smithi099 ceph-mon[137093]: failed to encode map e140 with expected crc 2024-03-30T14:09:04.078 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:03 smithi099 ceph-mon[137093]: failed to encode map e140 with expected crc 2024-03-30T14:09:04.078 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:03 smithi099 ceph-mon[137093]: failed to encode map e140 with expected crc 2024-03-30T14:09:04.078 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:03 smithi099 ceph-mon[137093]: osdmap e140: 8 total, 7 up, 8 in 2024-03-30T14:09:04.078 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:03 smithi099 ceph-mon[137093]: failed to encode map e140 with expected crc 2024-03-30T14:09:04.078 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:03 smithi099 ceph-mon[137093]: failed to encode map e140 with expected crc 2024-03-30T14:09:04.078 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:03 smithi099 ceph-mon[137093]: failed to encode map e140 with expected crc 2024-03-30T14:09:04.079 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:03 smithi099 ceph-mon[137093]: pgmap v196: 161 pgs: 15 peering, 16 stale+active+clean, 130 active+clean; 585 KiB data, 194 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-03-30T14:09:04.079 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:03 smithi099 ceph-mon[143401]: failed to encode map e140 with expected crc 2024-03-30T14:09:04.079 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:03 smithi099 ceph-mon[143401]: failed to encode map e140 with expected crc 2024-03-30T14:09:04.079 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:03 smithi099 ceph-mon[143401]: failed to encode map e140 with expected crc 2024-03-30T14:09:04.079 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:03 smithi099 ceph-mon[143401]: osdmap e140: 8 total, 7 up, 8 in 2024-03-30T14:09:04.079 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:03 smithi099 ceph-mon[143401]: failed to encode map e140 with expected crc 2024-03-30T14:09:04.079 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:03 smithi099 ceph-mon[143401]: failed to encode map e140 with expected crc 2024-03-30T14:09:04.079 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:03 smithi099 ceph-mon[143401]: failed to encode map e140 with expected crc 2024-03-30T14:09:04.079 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:03 smithi099 ceph-mon[143401]: pgmap v196: 161 pgs: 15 peering, 16 stale+active+clean, 130 active+clean; 585 KiB data, 194 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-03-30T14:09:04.648 INFO:journalctl@ceph.osd.5.smithi181.stdout:Mar 30 14:09:04 smithi181 podman[153805]: 2024-03-30 14:09:04.405742244 +0000 UTC m=+0.673121001 container remove c2c4bf51f0f2fd934c6083cc134eb666be698f0e8853b9baacc7945d4cde7ad1 (image=quay.ceph.io/ceph-ci/ceph:4e50bbcdd1630c7760b708f3a5b4d38a121e66cb, name=ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-5-deactivate, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, RELEASE=squid-4e50bbc, io.buildah.version=1.33.5, org.label-schema.build-date=20240326, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, ceph=True, GIT_CLEAN=True) 2024-03-30T14:09:04.648 INFO:journalctl@ceph.osd.5.smithi181.stdout:Mar 30 14:09:04 smithi181 systemd[1]: ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4@osd.5.service: Deactivated successfully. 2024-03-30T14:09:04.648 INFO:journalctl@ceph.osd.5.smithi181.stdout:Mar 30 14:09:04 smithi181 systemd[1]: Stopped Ceph osd.5 for 98ebaeb8-ee99-11ee-b647-cb9ed24678a4. 2024-03-30T14:09:04.648 INFO:journalctl@ceph.osd.5.smithi181.stdout:Mar 30 14:09:04 smithi181 systemd[1]: ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4@osd.5.service: Consumed 17.654s CPU time. 2024-03-30T14:09:04.648 INFO:journalctl@ceph.osd.5.smithi181.stdout:Mar 30 14:09:04 smithi181 systemd[1]: Starting Ceph osd.5 for 98ebaeb8-ee99-11ee-b647-cb9ed24678a4... 2024-03-30T14:09:05.078 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:04 smithi099 ceph-mon[137093]: Health check failed: Reduced data availability: 3 pgs inactive, 4 pgs peering (PG_AVAILABILITY) 2024-03-30T14:09:05.078 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:04 smithi099 ceph-mon[143401]: Health check failed: Reduced data availability: 3 pgs inactive, 4 pgs peering (PG_AVAILABILITY) 2024-03-30T14:09:05.078 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 14:09:04 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[71049]: ::ffff:172.21.15.181 - - [30/Mar/2024:14:09:04] "GET /metrics HTTP/1.1" 200 38265 "" "Prometheus/2.43.0" 2024-03-30T14:09:05.247 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:04 smithi181 ceph-mon[115276]: Health check failed: Reduced data availability: 3 pgs inactive, 4 pgs peering (PG_AVAILABILITY) 2024-03-30T14:09:05.538 INFO:journalctl@ceph.osd.5.smithi181.stdout:Mar 30 14:09:05 smithi181 podman[153998]: 2024-03-30 14:09:05.164877944 +0000 UTC m=+0.019214819 image pull b0c4478f1d83795df4d538bf108aee5fac57194348fb16dcdbb3115f3e2fe95e quay.ceph.io/ceph-ci/ceph:4e50bbcdd1630c7760b708f3a5b4d38a121e66cb 2024-03-30T14:09:05.538 INFO:journalctl@ceph.osd.5.smithi181.stdout:Mar 30 14:09:05 smithi181 podman[153998]: 2024-03-30 14:09:05.27691524 +0000 UTC m=+0.131252088 container create 7b9247d4c0138e06bfa3c9f27fda575f950a82d0b383380d4c7e1a033773278d (image=quay.ceph.io/ceph-ci/ceph:4e50bbcdd1630c7760b708f3a5b4d38a121e66cb, name=ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-5-activate, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240326, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, RELEASE=squid-4e50bbc, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2) 2024-03-30T14:09:05.538 INFO:journalctl@ceph.osd.5.smithi181.stdout:Mar 30 14:09:05 smithi181 podman[153998]: 2024-03-30 14:09:05.471402354 +0000 UTC m=+0.325739229 container init 7b9247d4c0138e06bfa3c9f27fda575f950a82d0b383380d4c7e1a033773278d (image=quay.ceph.io/ceph-ci/ceph:4e50bbcdd1630c7760b708f3a5b4d38a121e66cb, name=ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-5-activate, org.label-schema.build-date=20240326, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, GIT_CLEAN=True, ceph=True, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, RELEASE=squid-4e50bbc, CEPH_POINT_RELEASE=) 2024-03-30T14:09:05.538 INFO:journalctl@ceph.osd.5.smithi181.stdout:Mar 30 14:09:05 smithi181 podman[153998]: 2024-03-30 14:09:05.475013138 +0000 UTC m=+0.329349995 container start 7b9247d4c0138e06bfa3c9f27fda575f950a82d0b383380d4c7e1a033773278d (image=quay.ceph.io/ceph-ci/ceph:4e50bbcdd1630c7760b708f3a5b4d38a121e66cb, name=ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-5-activate, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, RELEASE=squid-4e50bbc, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, org.label-schema.build-date=20240326) 2024-03-30T14:09:05.538 INFO:journalctl@ceph.osd.5.smithi181.stdout:Mar 30 14:09:05 smithi181 podman[153998]: 2024-03-30 14:09:05.545951175 +0000 UTC m=+0.400288044 container attach 7b9247d4c0138e06bfa3c9f27fda575f950a82d0b383380d4c7e1a033773278d (image=quay.ceph.io/ceph-ci/ceph:4e50bbcdd1630c7760b708f3a5b4d38a121e66cb, name=ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-5-activate, org.label-schema.build-date=20240326, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, org.label-schema.schema-version=1.0, RELEASE=squid-4e50bbc, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, io.buildah.version=1.33.5, org.label-schema.license=GPLv2) 2024-03-30T14:09:06.078 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:05 smithi099 ceph-mon[137093]: pgmap v197: 161 pgs: 11 active+undersized+degraded, 15 peering, 5 stale+active+clean, 24 active+undersized, 106 active+clean; 585 KiB data, 194 MiB used, 715 GiB / 715 GiB avail; 38/627 objects degraded (6.061%) 2024-03-30T14:09:06.078 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:05 smithi099 ceph-mon[143401]: pgmap v197: 161 pgs: 11 active+undersized+degraded, 15 peering, 5 stale+active+clean, 24 active+undersized, 106 active+clean; 585 KiB data, 194 MiB used, 715 GiB / 715 GiB avail; 38/627 objects degraded (6.061%) 2024-03-30T14:09:06.247 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:05 smithi181 ceph-mon[115276]: pgmap v197: 161 pgs: 11 active+undersized+degraded, 15 peering, 5 stale+active+clean, 24 active+undersized, 106 active+clean; 585 KiB data, 194 MiB used, 715 GiB / 715 GiB avail; 38/627 objects degraded (6.061%) 2024-03-30T14:09:06.247 INFO:journalctl@ceph.osd.5.smithi181.stdout:Mar 30 14:09:05 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-5-activate[154036]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-03-30T14:09:06.247 INFO:journalctl@ceph.osd.5.smithi181.stdout:Mar 30 14:09:05 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-5-activate[154036]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-5 --no-mon-config --dev /dev/mapper/vg_nvme-lv_3 2024-03-30T14:09:06.248 INFO:journalctl@ceph.osd.5.smithi181.stdout:Mar 30 14:09:05 smithi181 bash[153998]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-03-30T14:09:06.248 INFO:journalctl@ceph.osd.5.smithi181.stdout:Mar 30 14:09:05 smithi181 bash[153998]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-5 --no-mon-config --dev /dev/mapper/vg_nvme-lv_3 2024-03-30T14:09:06.248 INFO:journalctl@ceph.osd.5.smithi181.stdout:Mar 30 14:09:05 smithi181 bash[153998]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_3 2024-03-30T14:09:06.248 INFO:journalctl@ceph.osd.5.smithi181.stdout:Mar 30 14:09:05 smithi181 bash[153998]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-2 2024-03-30T14:09:06.248 INFO:journalctl@ceph.osd.5.smithi181.stdout:Mar 30 14:09:05 smithi181 bash[153998]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-5/block 2024-03-30T14:09:06.248 INFO:journalctl@ceph.osd.5.smithi181.stdout:Mar 30 14:09:05 smithi181 bash[153998]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-03-30T14:09:06.248 INFO:journalctl@ceph.osd.5.smithi181.stdout:Mar 30 14:09:05 smithi181 bash[153998]: --> ceph-volume raw activate successful for osd ID: 5 2024-03-30T14:09:06.248 INFO:journalctl@ceph.osd.5.smithi181.stdout:Mar 30 14:09:05 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-5-activate[154036]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_3 2024-03-30T14:09:06.248 INFO:journalctl@ceph.osd.5.smithi181.stdout:Mar 30 14:09:05 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-5-activate[154036]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-2 2024-03-30T14:09:06.248 INFO:journalctl@ceph.osd.5.smithi181.stdout:Mar 30 14:09:05 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-5-activate[154036]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-5/block 2024-03-30T14:09:06.248 INFO:journalctl@ceph.osd.5.smithi181.stdout:Mar 30 14:09:05 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-5-activate[154036]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-03-30T14:09:06.248 INFO:journalctl@ceph.osd.5.smithi181.stdout:Mar 30 14:09:05 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-5-activate[154036]: --> ceph-volume raw activate successful for osd ID: 5 2024-03-30T14:09:06.248 INFO:journalctl@ceph.osd.5.smithi181.stdout:Mar 30 14:09:05 smithi181 podman[153998]: 2024-03-30 14:09:05.989937325 +0000 UTC m=+0.844274186 container died 7b9247d4c0138e06bfa3c9f27fda575f950a82d0b383380d4c7e1a033773278d (image=quay.ceph.io/ceph-ci/ceph:4e50bbcdd1630c7760b708f3a5b4d38a121e66cb, name=ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-5-activate, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, org.label-schema.build-date=20240326, GIT_CLEAN=True, RELEASE=squid-4e50bbc, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , ceph=True, GIT_BRANCH=HEAD) 2024-03-30T14:09:06.997 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:06 smithi181 ceph-mon[115276]: Health check failed: Degraded data redundancy: 38/627 objects degraded (6.061%), 11 pgs degraded (PG_DEGRADED) 2024-03-30T14:09:06.997 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:06 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:09:06.997 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:06 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T14:09:07.078 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:06 smithi099 ceph-mon[137093]: Health check failed: Degraded data redundancy: 38/627 objects degraded (6.061%), 11 pgs degraded (PG_DEGRADED) 2024-03-30T14:09:07.078 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:06 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:09:07.078 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:06 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T14:09:07.078 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:06 smithi099 ceph-mon[143401]: Health check failed: Degraded data redundancy: 38/627 objects degraded (6.061%), 11 pgs degraded (PG_DEGRADED) 2024-03-30T14:09:07.078 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:06 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:09:07.078 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:06 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T14:09:07.431 INFO:journalctl@ceph.osd.5.smithi181.stdout:Mar 30 14:09:07 smithi181 podman[154225]: 2024-03-30 14:09:07.112337098 +0000 UTC m=+1.124800996 container remove 7b9247d4c0138e06bfa3c9f27fda575f950a82d0b383380d4c7e1a033773278d (image=quay.ceph.io/ceph-ci/ceph:4e50bbcdd1630c7760b708f3a5b4d38a121e66cb, name=ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-5-activate, org.label-schema.build-date=20240326, GIT_BRANCH=HEAD, RELEASE=squid-4e50bbc, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, CEPH_POINT_RELEASE=, GIT_CLEAN=True, maintainer=Guillaume Abrioux , ceph=True) 2024-03-30T14:09:07.431 INFO:journalctl@ceph.osd.5.smithi181.stdout:Mar 30 14:09:07 smithi181 podman[154366]: 2024-03-30 14:09:07.233503116 +0000 UTC m=+0.019566025 image pull b0c4478f1d83795df4d538bf108aee5fac57194348fb16dcdbb3115f3e2fe95e quay.ceph.io/ceph-ci/ceph:4e50bbcdd1630c7760b708f3a5b4d38a121e66cb 2024-03-30T14:09:07.747 INFO:journalctl@ceph.osd.5.smithi181.stdout:Mar 30 14:09:07 smithi181 podman[154366]: 2024-03-30 14:09:07.539795746 +0000 UTC m=+0.325858651 container create bba176b8db2c4c00b7530bec9268531e98e47dc2f452a0578bdd0d453da995d9 (image=quay.ceph.io/ceph-ci/ceph:4e50bbcdd1630c7760b708f3a5b4d38a121e66cb, name=ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-5, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240326, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, ceph=True, GIT_BRANCH=HEAD, RELEASE=squid-4e50bbc, GIT_CLEAN=True) 2024-03-30T14:09:08.111 INFO:journalctl@ceph.osd.5.smithi181.stdout:Mar 30 14:09:07 smithi181 podman[154366]: 2024-03-30 14:09:07.867931169 +0000 UTC m=+0.653994073 container init bba176b8db2c4c00b7530bec9268531e98e47dc2f452a0578bdd0d453da995d9 (image=quay.ceph.io/ceph-ci/ceph:4e50bbcdd1630c7760b708f3a5b4d38a121e66cb, name=ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-5, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, RELEASE=squid-4e50bbc, io.buildah.version=1.33.5, GIT_CLEAN=True, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, ceph=True, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, org.label-schema.build-date=20240326, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD) 2024-03-30T14:09:08.111 INFO:journalctl@ceph.osd.5.smithi181.stdout:Mar 30 14:09:07 smithi181 podman[154366]: 2024-03-30 14:09:07.87107493 +0000 UTC m=+0.657137841 container start bba176b8db2c4c00b7530bec9268531e98e47dc2f452a0578bdd0d453da995d9 (image=quay.ceph.io/ceph-ci/ceph:4e50bbcdd1630c7760b708f3a5b4d38a121e66cb, name=ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-5, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_CLEAN=True, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, RELEASE=squid-4e50bbc, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, org.label-schema.build-date=20240326, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5) 2024-03-30T14:09:08.111 INFO:journalctl@ceph.osd.5.smithi181.stdout:Mar 30 14:09:07 smithi181 ceph-osd[154445]: -- 172.21.15.181:0/3219326686 <== mon.2 v2:172.21.15.181:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x564db9f2d680 con 0x564db9ef6c00 2024-03-30T14:09:08.112 INFO:journalctl@ceph.osd.5.smithi181.stdout:Mar 30 14:09:07 smithi181 bash[154366]: bba176b8db2c4c00b7530bec9268531e98e47dc2f452a0578bdd0d453da995d9 2024-03-30T14:09:08.112 INFO:journalctl@ceph.osd.5.smithi181.stdout:Mar 30 14:09:07 smithi181 systemd[1]: Started Ceph osd.5 for 98ebaeb8-ee99-11ee-b647-cb9ed24678a4. 2024-03-30T14:09:08.660 INFO:journalctl@ceph.osd.5.smithi181.stdout:Mar 30 14:09:08 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-5[154441]: 2024-03-30T14:09:08.412+0000 7f3044fe17c0 -1 Falling back to public interface 2024-03-30T14:09:08.660 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:08 smithi181 ceph-mon[115276]: pgmap v198: 161 pgs: 16 active+undersized+degraded, 15 peering, 29 active+undersized, 101 active+clean; 585 KiB data, 194 MiB used, 715 GiB / 715 GiB avail; 57/627 objects degraded (9.091%) 2024-03-30T14:09:08.660 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:08 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:09:08.660 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:08 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:09:08.660 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:08 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:09:08.660 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:08 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:09:08.660 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:08 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:09:08.660 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:08 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:09:08.661 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:08 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:09:08.661 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:08 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:09:08.661 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:08 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:09:08.661 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:08 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:09:08.661 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:08 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:09:08.661 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:08 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:09:08.661 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:08 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:09:08.661 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:08 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:09:08.661 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:08 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:09:08.661 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:08 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:09:08.661 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:08 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:09:08.661 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:08 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:09:08.661 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:08 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:09:08.661 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:08 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:09:08.661 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:08 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:09:08.661 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:08 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:09:08.662 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:08 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:09:08.662 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:08 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:09:08.662 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:08 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:09:08.662 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:08 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:09:08.662 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:08 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:09:08.662 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:08 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:09:08.662 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:08 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:09:08.828 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:08 smithi099 ceph-mon[137093]: pgmap v198: 161 pgs: 16 active+undersized+degraded, 15 peering, 29 active+undersized, 101 active+clean; 585 KiB data, 194 MiB used, 715 GiB / 715 GiB avail; 57/627 objects degraded (9.091%) 2024-03-30T14:09:08.829 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:08 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:09:08.829 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:08 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:09:08.829 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:08 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:09:08.829 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:08 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:09:08.829 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:08 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:09:08.829 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:08 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:09:08.829 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:08 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:09:08.829 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:08 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:09:08.829 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:08 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:09:08.829 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:08 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:09:08.829 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:08 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:09:08.829 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:08 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:09:08.829 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:08 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:09:08.829 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:08 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:09:08.829 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:08 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:09:08.830 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:08 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:09:08.830 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:08 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:09:08.830 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:08 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:09:08.830 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:08 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:09:08.830 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:08 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:09:08.830 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:08 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:09:08.830 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:08 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:09:08.830 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:08 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:09:08.830 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:08 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:09:08.830 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:08 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:09:08.830 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:08 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:09:08.830 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:08 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:09:08.830 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:08 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:09:08.830 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:08 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:09:08.831 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:08 smithi099 ceph-mon[143401]: pgmap v198: 161 pgs: 16 active+undersized+degraded, 15 peering, 29 active+undersized, 101 active+clean; 585 KiB data, 194 MiB used, 715 GiB / 715 GiB avail; 57/627 objects degraded (9.091%) 2024-03-30T14:09:08.831 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:08 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:09:08.831 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:08 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:09:08.831 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:08 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:09:08.831 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:08 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:09:08.831 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:08 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:09:08.831 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:08 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:09:08.831 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:08 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:09:08.831 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:08 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:09:08.831 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:08 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:09:08.831 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:08 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:09:08.831 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:08 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:09:08.831 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:08 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:09:08.831 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:08 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:09:08.832 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:08 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:09:08.832 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:08 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:09:08.832 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:08 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:09:08.832 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:08 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:09:08.832 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:08 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:09:08.832 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:08 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:09:08.832 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:08 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:09:08.832 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:08 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:09:08.832 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:08 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:09:08.832 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:08 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:09:08.832 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:08 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:09:08.832 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:08 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:09:08.832 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:08 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:09:08.832 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:08 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:09:08.832 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:08 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:09:08.832 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:08 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:09:09.829 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:09 smithi099 ceph-mon[137093]: from='client.25136 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T14:09:09.829 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:09 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:09:09.829 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:09 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:09:09.829 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:09 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:09:09.829 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:09 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:09:09.829 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:09 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:09:09.829 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:09 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:09:09.829 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:09 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:09:09.829 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:09 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:09:09.829 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:09 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:09:09.830 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:09 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:09:09.830 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:09 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:09:09.830 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:09 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:09:09.830 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:09 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:09:09.830 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:09 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:09:09.830 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:09 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:09:09.830 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:09 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:09:09.830 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:09 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:09:09.830 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:09 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:09:09.830 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:09 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:09:09.830 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:09 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:09:09.830 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:09 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:09:09.830 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:09 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:09:09.830 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:09 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:09:09.831 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:09 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:09:09.831 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:09 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:09:09.831 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:09 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:09:09.831 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:09 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:09:09.831 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:09 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:09:09.831 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:09 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:09:09.832 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:09 smithi099 ceph-mon[143401]: from='client.25136 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T14:09:09.832 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:09 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:09:09.832 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:09 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:09:09.832 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:09 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:09:09.832 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:09 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:09:09.832 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:09 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:09:09.832 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:09 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:09:09.832 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:09 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:09:09.832 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:09 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:09:09.832 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:09 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:09:09.832 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:09 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:09:09.832 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:09 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:09:09.832 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:09 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:09:09.833 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:09 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:09:09.833 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:09 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:09:09.833 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:09 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:09:09.833 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:09 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:09:09.833 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:09 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:09:09.833 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:09 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:09:09.833 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:09 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:09:09.833 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:09 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:09:09.833 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:09 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:09:09.833 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:09 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:09:09.833 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:09 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:09:09.833 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:09 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:09:09.833 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:09 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:09:09.833 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:09 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:09:09.834 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:09 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:09:09.834 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:09 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:09:09.834 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:09 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:09:09.834 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:09 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:09:09.834 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:09 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:09:09.834 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:09 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:09:09.834 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:09 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:09:09.834 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:09 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:09:09.834 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:09 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:09:09.834 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:09 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:09:09.834 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:09 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:09:09.834 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:09 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:09:09.834 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:09 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:09:09.834 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:09 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:09:09.835 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:09 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:09:09.835 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:09 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:09:09.835 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:09 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:09:09.835 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:09 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:09:09.835 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:09 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:09:09.835 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:09 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:09:09.835 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:09 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:09:09.835 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:09 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:09:09.835 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:09 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:09:09.835 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:09 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:09:09.835 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:09 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:09:09.835 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:09 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:09:09.835 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:09 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:09:09.835 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:09 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:09:09.835 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:09 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:09:09.836 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:09 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:09:09.836 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:09 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:09:09.836 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:09 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:09:09.836 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:09 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:09:09.836 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:09 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:09:09.836 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:09 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:09:09.836 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:09 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:09:09.836 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:09 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:09:09.836 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:09 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:09:09.836 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:09 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:09:09.837 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:09 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:09:09.837 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:09 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:09:09.837 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:09 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:09:09.837 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:09 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:09:09.837 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:09 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:09:09.837 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:09 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:09:09.837 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:09 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:09:09.837 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:09 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:09:09.837 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:09 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:09:09.837 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:09 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:09:09.837 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:09 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:09:09.837 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:09 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:09:09.837 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:09 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:09:09.838 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:09 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:09:09.838 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:09 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:09:09.838 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:09 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:09:09.838 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:09 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:09:09.838 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:09 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:09:09.838 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:09 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:09:09.838 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:09 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:09:09.838 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:09 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:09:09.838 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:09 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:09:09.838 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:09 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:09:09.838 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:09 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:09:09.838 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:09 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:09:09.838 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:09 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:09:09.838 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:09 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:09:09.839 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:09 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:09:09.839 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:09 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:09:09.839 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:09 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:09:09.998 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:09 smithi181 ceph-mon[115276]: from='client.25136 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T14:09:09.998 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:09 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:09:09.998 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:09 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:09:09.998 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:09 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:09:09.998 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:09 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:09:09.998 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:09 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:09:09.998 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:09 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:09:09.998 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:09 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:09:09.998 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:09 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:09:09.998 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:09 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:09:09.998 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:09 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:09:09.998 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:09 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:09:09.998 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:09 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:09:09.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:09 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:09:09.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:09 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:09:09.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:09 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:09:09.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:09 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:09:09.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:09 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:09:09.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:09 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:09:09.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:09 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:09:09.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:09 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:09:09.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:09 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:09:09.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:09 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:09:09.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:09 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:09:09.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:09 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:09:09.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:09 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:09:09.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:09 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:09:09.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:09 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:09:10.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:09 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:09:10.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:09 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:09:10.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:09 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:09:10.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:09 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:09:10.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:09 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:09:10.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:09 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:09:10.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:09 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:09:10.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:09 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:09:10.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:09 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:09:10.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:09 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:09:10.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:09 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:09:10.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:09 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:09:10.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:09 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:09:10.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:09 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:09:10.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:09 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:09:10.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:09 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:09:10.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:09 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:09:10.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:09 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:09:10.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:09 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:09:10.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:09 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:09:10.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:09 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:09:10.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:09 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:09:10.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:09 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:09:10.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:09 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:09:10.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:09 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:09:10.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:09 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:09:10.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:09 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:09:10.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:09 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:09:10.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:09 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:09:10.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:09 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:09:10.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:09 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:09:10.002 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:09 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:09:10.002 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:09 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:09:10.002 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:09 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:09:10.002 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:09 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:09:10.747 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:10 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:09:10.748 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:10 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:09:10.748 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:10 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:09:10.748 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:10 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:09:10.748 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:10 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:09:10.748 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:10 smithi181 ceph-mon[115276]: pgmap v199: 161 pgs: 21 active+undersized+degraded, 39 active+undersized, 101 active+clean; 585 KiB data, 194 MiB used, 715 GiB / 715 GiB avail; 73/627 objects degraded (11.643%) 2024-03-30T14:09:10.748 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:10 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:09:10.748 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:10 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:09:10.748 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:10 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:09:10.748 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:10 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:09:10.748 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:10 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:09:10.748 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:10 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:09:10.748 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:10 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:09:10.748 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:10 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:09:10.748 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:10 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:09:10.748 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:10 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:09:10.749 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:10 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:09:10.749 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:10 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:09:10.749 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:10 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:09:10.749 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:10 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:09:10.749 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:10 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:09:10.749 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:10 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:09:10.749 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:10 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:09:10.749 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:10 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:09:10.749 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:10 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:09:10.749 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:10 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:09:10.749 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:10 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:09:10.749 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:10 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:09:10.749 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:10 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:09:10.749 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:10 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:09:10.749 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:10 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:09:10.749 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:10 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:09:10.750 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:10 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:09:10.750 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:10 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:09:10.750 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:10 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:09:10.750 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:10 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:09:10.750 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:10 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:09:10.750 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:10 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:09:10.750 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:10 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:09:10.750 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:10 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:09:10.750 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:10 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:09:10.750 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:10 smithi181 ceph-mon[115276]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 3 pgs inactive, 4 pgs peering) 2024-03-30T14:09:10.750 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:10 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:09:10.750 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:10 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:09:10.750 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:10 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:09:10.750 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:10 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:09:10.751 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:10 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:09:10.751 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:10 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:09:10.751 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:10 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:09:10.751 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:10 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:09:10.751 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:10 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:09:10.751 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:10 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:09:10.751 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:10 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:09:10.751 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:10 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:09:10.751 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:10 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:09:10.751 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:10 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:09:10.751 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:10 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:09:10.751 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:10 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:09:10.751 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:10 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:09:10.752 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:10 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:09:10.752 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:10 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:09:10.752 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:10 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:09:10.752 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:10 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:09:10.752 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:10 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:09:10.752 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:10 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:09:10.752 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:10 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:09:10.752 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:10 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:09:10.828 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:10 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:09:10.828 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:10 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:09:10.829 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:10 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:09:10.829 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:10 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:09:10.829 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:10 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:09:10.829 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:10 smithi099 ceph-mon[143401]: pgmap v199: 161 pgs: 21 active+undersized+degraded, 39 active+undersized, 101 active+clean; 585 KiB data, 194 MiB used, 715 GiB / 715 GiB avail; 73/627 objects degraded (11.643%) 2024-03-30T14:09:10.829 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:10 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:09:10.829 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:10 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:09:10.829 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:10 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:09:10.829 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:10 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:09:10.829 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:10 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:09:10.829 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:10 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:09:10.829 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:10 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:09:10.829 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:10 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:09:10.829 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:10 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:09:10.829 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:10 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:09:10.829 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:10 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:09:10.830 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:10 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:09:10.830 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:10 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:09:10.830 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:10 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:09:10.830 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:10 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:09:10.830 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:10 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:09:10.830 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:10 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:09:10.830 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:10 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:09:10.830 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:10 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:09:10.830 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:10 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:09:10.830 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:10 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:09:10.830 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:10 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:09:10.830 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:10 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:09:10.830 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:10 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:09:10.831 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:10 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:09:10.831 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:10 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:09:10.831 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:10 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:09:10.831 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:10 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:09:10.831 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:10 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:09:10.831 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:10 smithi099 ceph-mon[137093]: pgmap v199: 161 pgs: 21 active+undersized+degraded, 39 active+undersized, 101 active+clean; 585 KiB data, 194 MiB used, 715 GiB / 715 GiB avail; 73/627 objects degraded (11.643%) 2024-03-30T14:09:10.832 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:10 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:09:10.832 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:10 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:09:10.832 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:10 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:09:10.832 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:10 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:09:10.832 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:10 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:09:10.832 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:10 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:09:10.832 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:10 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:09:10.832 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:10 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:09:10.832 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:10 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:09:10.832 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:10 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:09:10.832 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:10 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:09:10.832 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:10 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:09:10.832 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:10 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:09:10.832 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:10 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:09:10.832 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:10 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:09:10.833 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:10 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:09:10.833 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:10 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:09:10.833 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:10 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:09:10.833 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:10 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:09:10.833 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:10 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:09:10.833 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:10 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:09:10.833 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:10 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:09:10.833 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:10 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:09:10.833 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:10 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:09:10.833 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:10 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:09:10.833 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:10 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:09:10.833 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:10 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:09:10.833 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:10 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:09:10.833 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:10 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:09:10.833 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:10 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:09:10.833 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:10 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:09:10.834 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:10 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:09:10.834 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:10 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:09:10.834 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:10 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:09:10.834 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:10 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:09:10.834 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:10 smithi099 ceph-mon[137093]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 3 pgs inactive, 4 pgs peering) 2024-03-30T14:09:10.834 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:10 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:09:10.834 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:10 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:09:10.834 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:10 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:09:10.834 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:10 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:09:10.834 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:10 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:09:10.834 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:10 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:09:10.834 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:10 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:09:10.834 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:10 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:09:10.835 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:10 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:09:10.835 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:10 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:09:10.835 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:10 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:09:10.835 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:10 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:09:10.835 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:10 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:09:10.835 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:10 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:09:10.835 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:10 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:09:10.835 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:10 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:09:10.835 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:10 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:09:10.835 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:10 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:09:10.835 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:10 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:09:10.836 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:10 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:09:10.836 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:10 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:09:10.836 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:10 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:09:10.836 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:10 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:09:10.836 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:10 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:09:10.836 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:10 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:09:10.836 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:10 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:09:10.836 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:10 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:09:10.836 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:10 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:09:10.836 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:10 smithi099 ceph-mon[143401]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 3 pgs inactive, 4 pgs peering) 2024-03-30T14:09:10.836 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:10 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:09:10.836 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:10 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:09:10.836 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:10 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:09:10.836 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:10 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:09:10.836 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:10 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:09:10.837 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:10 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:09:10.837 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:10 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:09:10.837 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:10 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:09:10.837 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:10 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:09:10.837 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:10 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:09:10.837 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:10 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:09:10.837 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:10 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:09:10.837 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:10 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:09:10.837 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:10 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:09:10.837 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:10 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:09:10.837 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:10 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:09:10.837 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:10 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:09:10.838 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:10 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:09:10.838 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:10 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:09:10.838 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:10 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:09:10.838 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:10 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:09:10.838 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:10 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:09:10.838 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:10 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:09:10.838 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:10 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:09:10.838 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:10 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:09:10.838 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:10 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:09:10.838 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:10 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:09:10.839 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:10 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:09:10.839 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:10 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:09:10.839 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:10 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:09:10.839 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:10 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:09:10.839 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:10 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:09:10.839 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:10 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:09:11.497 INFO:journalctl@ceph.osd.5.smithi181.stdout:Mar 30 14:09:11 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-5[154441]: 2024-03-30T14:09:11.163+0000 7f3044fe17c0 -1 osd.5 0 read_superblock omap replica is missing. 2024-03-30T14:09:11.497 INFO:journalctl@ceph.osd.5.smithi181.stdout:Mar 30 14:09:11 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-5[154441]: 2024-03-30T14:09:11.194+0000 7f3044fe17c0 -1 osd.5 138 log_to_monitors true 2024-03-30T14:09:11.828 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:11 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:09:11.829 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:11 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:09:11.829 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:11 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:09:11.829 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:11 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:09:11.829 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:11 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:09:11.829 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:11 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:09:11.829 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:11 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:09:11.829 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:11 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:09:11.829 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:11 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:09:11.829 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:11 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:09:11.829 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:11 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:09:11.829 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:11 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:09:11.829 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:11 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:09:11.830 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:11 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:09:11.830 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:11 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:09:11.830 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:11 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:09:11.830 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:11 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:09:11.830 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:11 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:09:11.830 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:11 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:09:11.830 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:11 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:09:11.830 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:11 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:09:11.830 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:11 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:09:11.830 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:11 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:09:11.830 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:11 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:09:11.830 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:11 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:09:11.830 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:11 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:09:11.830 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:11 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:09:11.830 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:11 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:09:11.831 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:11 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:09:11.831 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:11 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:09:11.831 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:11 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:09:11.831 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:11 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:09:11.831 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:11 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:09:11.831 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:11 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:09:11.831 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:11 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:09:11.831 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:11 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:09:11.832 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:11 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:09:11.832 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:11 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:09:11.832 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:11 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:09:11.832 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:11 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:09:11.832 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:11 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:09:11.832 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:11 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:09:11.832 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:11 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:09:11.832 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:11 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:09:11.832 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:11 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:09:11.832 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:11 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:09:11.832 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:11 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:09:11.832 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:11 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:09:11.832 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:11 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:09:11.832 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:11 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:09:11.832 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:11 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:09:11.833 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:11 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:09:11.833 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:11 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:09:11.833 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:11 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:09:11.833 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:11 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:09:11.833 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:11 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:09:11.833 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:11 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:09:11.833 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:11 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:09:11.833 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:11 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:09:11.833 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:11 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:09:11.833 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:11 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:09:11.833 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:11 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:09:11.833 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:11 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:09:11.833 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:11 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:09:11.833 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:11 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:09:11.833 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:11 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:09:11.834 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:11 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:09:11.834 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:11 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:09:11.834 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:11 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:09:11.834 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:11 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:09:11.834 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:11 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:09:11.834 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:11 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:09:11.834 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:11 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:09:11.834 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:11 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:09:11.834 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:11 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:09:11.834 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:11 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:09:11.834 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:11 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:09:11.834 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:11 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:09:11.834 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:11 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:09:11.835 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:11 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:09:11.835 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:11 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:09:11.835 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:11 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:09:11.835 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:11 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:09:11.835 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:11 smithi099 ceph-mon[143401]: from='osd.5 [v2:172.21.15.181:6808/210718176,v1:172.21.15.181:6809/210718176]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-03-30T14:09:11.835 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:11 smithi099 ceph-mon[143401]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-03-30T14:09:11.835 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:11 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:09:11.835 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:11 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:09:11.835 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:11 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:09:11.835 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:11 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:09:11.835 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:11 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:09:11.836 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:11 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:09:11.836 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:11 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:09:11.836 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:11 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:09:11.836 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:11 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:09:11.836 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:11 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:09:11.836 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:11 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:09:11.836 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:11 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:09:11.836 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:11 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:09:11.836 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:11 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:09:11.836 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:11 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:09:11.836 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:11 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:09:11.836 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:11 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:09:11.836 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:11 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:09:11.837 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:11 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:09:11.837 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:11 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:09:11.837 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:11 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:09:11.837 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:11 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:09:11.837 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:11 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:09:11.837 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:11 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:09:11.837 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:11 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:09:11.837 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:11 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:09:11.837 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:11 smithi099 ceph-mon[137093]: from='osd.5 [v2:172.21.15.181:6808/210718176,v1:172.21.15.181:6809/210718176]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-03-30T14:09:11.837 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:11 smithi099 ceph-mon[137093]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-03-30T14:09:11.837 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:11 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:09:11.837 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:11 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:09:11.837 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:11 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:09:11.837 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:11 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:09:11.838 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:11 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:09:11.838 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:11 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:09:11.838 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:11 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:09:11.838 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:11 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:09:11.838 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:11 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:09:11.838 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:11 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:09:11.838 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:11 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:09:11.838 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:11 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:09:11.838 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:11 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:09:11.839 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:11 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:09:11.839 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:11 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:09:11.839 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:11 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:09:11.839 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:11 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:09:11.839 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:11 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:09:11.839 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:11 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:09:11.839 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:11 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:09:11.839 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:11 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:09:11.839 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:11 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:09:11.839 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:11 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:09:11.839 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:11 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:09:11.839 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:11 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:09:11.840 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:11 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:09:11.840 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:11 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:09:11.840 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:11 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:09:11.840 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:11 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:09:11.840 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:11 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:09:11.840 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:11 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:09:11.840 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:11 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:09:11.840 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:11 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:09:11.840 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:11 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:09:11.840 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:11 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:09:11.945 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:11 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:09:11.945 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:11 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:09:11.945 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:11 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:09:11.945 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:11 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:09:11.945 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:11 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:09:11.945 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:11 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:09:11.945 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:11 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:09:11.945 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:11 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:09:11.945 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:11 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:09:11.945 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:11 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:09:11.945 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:11 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:09:11.945 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:11 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:09:11.946 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:11 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:09:11.946 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:11 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:09:11.946 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:11 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:09:11.946 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:11 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:09:11.946 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:11 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:09:11.946 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:11 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:09:11.946 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:11 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:09:11.946 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:11 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:09:11.946 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:11 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:09:11.946 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:11 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:09:11.946 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:11 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:09:11.946 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:11 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:09:11.946 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:11 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:09:11.946 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:11 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:09:11.947 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:11 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:09:11.947 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:11 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:09:11.947 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:11 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:09:11.947 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:11 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:09:11.947 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:11 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:09:11.947 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:11 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:09:11.947 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:11 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:09:11.947 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:11 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:09:11.947 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:11 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:09:11.948 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:11 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:09:11.948 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:11 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:09:11.948 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:11 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:09:11.948 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:11 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:09:11.948 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:11 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:09:11.948 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:11 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:09:11.948 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:11 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:09:11.948 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:11 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:09:11.948 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:11 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:09:11.948 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:11 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:09:11.948 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:11 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:09:11.948 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:11 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:09:11.948 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:11 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:09:11.948 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:11 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:09:11.949 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:11 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:09:11.949 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:11 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:09:11.949 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:11 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:09:11.949 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:11 smithi181 ceph-mon[115276]: from='osd.5 [v2:172.21.15.181:6808/210718176,v1:172.21.15.181:6809/210718176]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-03-30T14:09:11.949 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:11 smithi181 ceph-mon[115276]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-03-30T14:09:11.949 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:11 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:09:11.949 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:11 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:09:11.949 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:11 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:09:11.949 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:11 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:09:11.949 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:11 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:09:11.949 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:11 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:09:11.949 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:11 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:09:11.949 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:11 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:09:11.949 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:11 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:09:11.949 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:11 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:09:11.950 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:11 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:09:11.950 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:11 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:09:11.950 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:11 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:09:11.950 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:11 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:09:11.950 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:11 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:09:11.950 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:11 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:09:11.950 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:11 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:09:11.950 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:11 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:09:11.950 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:11 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:09:11.950 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:11 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:09:12.821 INFO:journalctl@ceph.osd.5.smithi181.stdout:Mar 30 14:09:12 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-5[154441]: 2024-03-30T14:09:12.650+0000 7f3032431700 -1 osd.5 138 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-03-30T14:09:12.821 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:12 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:09:12.822 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:12 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:09:12.822 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:12 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:09:12.822 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:12 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:09:12.822 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:12 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:09:12.822 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:12 smithi181 ceph-mon[115276]: pgmap v200: 161 pgs: 21 active+undersized+degraded, 39 active+undersized, 101 active+clean; 585 KiB data, 194 MiB used, 715 GiB / 715 GiB avail; 73/627 objects degraded (11.643%) 2024-03-30T14:09:12.822 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:12 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:09:12.822 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:12 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:09:12.822 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:12 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:09:12.822 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:12 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:09:12.822 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:12 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:09:12.822 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:12 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:09:12.822 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:12 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:09:12.822 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:12 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:09:12.822 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:12 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:09:12.822 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:12 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:09:12.823 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:12 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:09:12.823 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:12 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:09:12.823 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:12 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:09:12.823 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:12 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:09:12.823 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:12 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:09:12.823 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:12 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:09:12.823 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:12 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:09:12.823 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:12 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:09:12.823 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:12 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:09:12.823 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:12 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:09:12.823 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:12 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:09:12.823 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:12 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:09:12.823 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:12 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:09:12.823 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:12 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:09:12.823 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:12 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:09:12.823 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:12 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:09:12.824 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:12 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:09:12.824 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:12 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:09:12.824 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:12 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:09:12.824 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:12 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:09:12.824 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:12 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:09:12.824 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:12 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:09:12.824 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:12 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:09:12.824 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:12 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:09:12.824 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:12 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:09:12.824 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:12 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:09:12.824 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:12 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:09:12.824 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:12 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:09:12.824 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:12 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:09:12.824 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:12 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:09:12.824 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:12 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:09:12.824 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:12 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:09:12.825 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:12 smithi181 ceph-mon[115276]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-03-30T14:09:12.825 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:12 smithi181 ceph-mon[115276]: osdmap e141: 8 total, 7 up, 8 in 2024-03-30T14:09:12.825 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:12 smithi181 ceph-mon[115276]: from='osd.5 [v2:172.21.15.181:6808/210718176,v1:172.21.15.181:6809/210718176]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi181", "root=default"]}]: dispatch 2024-03-30T14:09:12.825 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:12 smithi181 ceph-mon[115276]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi181", "root=default"]}]: dispatch 2024-03-30T14:09:12.825 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:12 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:09:12.825 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:12 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:09:12.825 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:12 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:09:12.825 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:12 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:09:12.825 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:12 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:09:12.825 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:12 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:09:12.825 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:12 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:09:12.825 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:12 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:09:12.825 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:12 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:09:12.825 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:12 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:09:12.826 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:12 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:09:12.828 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 14:09:12 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[71049]: 2024-03-30T14:09:12.591+0000 7f3c008ec700 -1 mgr.server reply reply (16) Device or resource busy unsafe to stop osd(s) at this time (19 PGs are or would become offline) 2024-03-30T14:09:12.828 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:12 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:09:12.828 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:12 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:09:12.828 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:12 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:09:12.828 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:12 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:09:12.828 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:12 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:09:12.829 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:12 smithi099 ceph-mon[137093]: pgmap v200: 161 pgs: 21 active+undersized+degraded, 39 active+undersized, 101 active+clean; 585 KiB data, 194 MiB used, 715 GiB / 715 GiB avail; 73/627 objects degraded (11.643%) 2024-03-30T14:09:12.829 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:12 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:09:12.829 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:12 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:09:12.829 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:12 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:09:12.829 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:12 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:09:12.829 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:12 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:09:12.829 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:12 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:09:12.829 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:12 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:09:12.829 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:12 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:09:12.829 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:12 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:09:12.829 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:12 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:09:12.829 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:12 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:09:12.829 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:12 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:09:12.830 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:12 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:09:12.830 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:12 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:09:12.830 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:12 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:09:12.830 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:12 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:09:12.830 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:12 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:09:12.830 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:12 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:09:12.830 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:12 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:09:12.830 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:12 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:09:12.830 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:12 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:09:12.830 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:12 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:09:12.830 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:12 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:09:12.830 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:12 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:09:12.831 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:12 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:09:12.831 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:12 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:09:12.831 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:12 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:09:12.831 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:12 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:09:12.831 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:12 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:09:12.831 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:12 smithi099 ceph-mon[143401]: pgmap v200: 161 pgs: 21 active+undersized+degraded, 39 active+undersized, 101 active+clean; 585 KiB data, 194 MiB used, 715 GiB / 715 GiB avail; 73/627 objects degraded (11.643%) 2024-03-30T14:09:12.831 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:12 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:09:12.831 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:12 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:09:12.831 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:12 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:09:12.831 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:12 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:09:12.831 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:12 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:09:12.831 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:12 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:09:12.831 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:12 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:09:12.832 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:12 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:09:12.832 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:12 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:09:12.832 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:12 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:09:12.832 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:12 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:09:12.832 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:12 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:09:12.832 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:12 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:09:12.832 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:12 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:09:12.832 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:12 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:09:12.832 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:12 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:09:12.832 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:12 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:09:12.832 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:12 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:09:12.832 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:12 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:09:12.832 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:12 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:09:12.833 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:12 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:09:12.833 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:12 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:09:12.833 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:12 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:09:12.833 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:12 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:09:12.833 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:12 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:09:12.833 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:12 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:09:12.833 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:12 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:09:12.833 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:12 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:09:12.833 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:12 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:09:12.833 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:12 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:09:12.833 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:12 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:09:12.834 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:12 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:09:12.834 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:12 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:09:12.834 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:12 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:09:12.834 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:12 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:09:12.834 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:12 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:09:12.834 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:12 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:09:12.834 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:12 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:09:12.834 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:12 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:09:12.834 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:12 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:09:12.834 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:12 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:09:12.834 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:12 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:09:12.834 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:12 smithi099 ceph-mon[137093]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-03-30T14:09:12.834 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:12 smithi099 ceph-mon[137093]: osdmap e141: 8 total, 7 up, 8 in 2024-03-30T14:09:12.835 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:12 smithi099 ceph-mon[137093]: from='osd.5 [v2:172.21.15.181:6808/210718176,v1:172.21.15.181:6809/210718176]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi181", "root=default"]}]: dispatch 2024-03-30T14:09:12.835 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:12 smithi099 ceph-mon[137093]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi181", "root=default"]}]: dispatch 2024-03-30T14:09:12.835 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:12 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:09:12.835 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:12 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:09:12.835 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:12 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:09:12.835 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:12 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:09:12.835 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:12 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:09:12.835 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:12 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:09:12.835 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:12 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:09:12.835 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:12 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:09:12.835 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:12 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:09:12.836 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:12 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:09:12.836 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:12 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:09:12.836 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:12 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:09:12.836 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:12 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:09:12.836 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:12 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:09:12.836 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:12 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:09:12.836 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:12 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:09:12.836 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:12 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:09:12.836 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:12 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:09:12.836 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:12 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:09:12.836 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:12 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:09:12.836 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:12 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:09:12.836 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:12 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:09:12.836 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:12 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:09:12.836 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:12 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:09:12.837 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:12 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:09:12.837 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:12 smithi099 ceph-mon[143401]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-03-30T14:09:12.837 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:12 smithi099 ceph-mon[143401]: osdmap e141: 8 total, 7 up, 8 in 2024-03-30T14:09:12.837 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:12 smithi099 ceph-mon[143401]: from='osd.5 [v2:172.21.15.181:6808/210718176,v1:172.21.15.181:6809/210718176]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi181", "root=default"]}]: dispatch 2024-03-30T14:09:12.837 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:12 smithi099 ceph-mon[143401]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi181", "root=default"]}]: dispatch 2024-03-30T14:09:12.837 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:12 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:09:12.837 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:12 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:09:12.837 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:12 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:09:12.837 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:12 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:09:12.837 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:12 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:09:12.837 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:12 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:09:12.837 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:12 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:09:12.837 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:12 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:09:12.838 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:12 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:09:12.838 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:12 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:09:12.838 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:12 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:09:12.838 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:12 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:09:12.838 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:12 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:09:12.838 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:12 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:09:12.838 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:12 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:09:13.747 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:13 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:09:13.747 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:13 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:09:13.747 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:13 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:09:13.747 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:13 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:09:13.747 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:13 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:09:13.747 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:13 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:09:13.748 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:13 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:09:13.748 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:13 smithi181 ceph-mon[115276]: pgmap v202: 161 pgs: 21 active+undersized+degraded, 39 active+undersized, 101 active+clean; 585 KiB data, 209 MiB used, 715 GiB / 715 GiB avail; 73/627 objects degraded (11.643%) 2024-03-30T14:09:13.748 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:13 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:09:13.748 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:13 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:09:13.748 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:13 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:09:13.748 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:13 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:09:13.748 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:13 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:09:13.748 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:13 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "osd ok-to-stop", "ids": ["6"], "max": 16}]: dispatch 2024-03-30T14:09:13.748 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:13 smithi181 ceph-mon[115276]: from='mon.2 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["6"], "max": 16}]: dispatch 2024-03-30T14:09:13.748 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:13 smithi181 ceph-mon[115276]: Upgrade: unsafe to stop osd(s) at this time (19 PGs are or would become offline) 2024-03-30T14:09:13.748 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:13 smithi181 ceph-mon[115276]: from='osd.5 ' entity='osd.5' 2024-03-30T14:09:13.828 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:13 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:09:13.828 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:13 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:09:13.828 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:13 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:09:13.828 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:13 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:09:13.829 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:13 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:09:13.829 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:13 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:09:13.829 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:13 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:09:13.829 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:13 smithi099 ceph-mon[137093]: pgmap v202: 161 pgs: 21 active+undersized+degraded, 39 active+undersized, 101 active+clean; 585 KiB data, 209 MiB used, 715 GiB / 715 GiB avail; 73/627 objects degraded (11.643%) 2024-03-30T14:09:13.829 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:13 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:09:13.829 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:13 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:09:13.829 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:13 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:09:13.829 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:13 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:09:13.829 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:13 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:09:13.829 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:13 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "osd ok-to-stop", "ids": ["6"], "max": 16}]: dispatch 2024-03-30T14:09:13.829 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:13 smithi099 ceph-mon[137093]: from='mon.2 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["6"], "max": 16}]: dispatch 2024-03-30T14:09:13.829 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:13 smithi099 ceph-mon[137093]: Upgrade: unsafe to stop osd(s) at this time (19 PGs are or would become offline) 2024-03-30T14:09:13.829 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:13 smithi099 ceph-mon[137093]: from='osd.5 ' entity='osd.5' 2024-03-30T14:09:13.830 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:13 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:09:13.830 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:13 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:09:13.830 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:13 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:09:13.830 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:13 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:09:13.830 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:13 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:09:13.830 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:13 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:09:13.830 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:13 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:09:13.830 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:13 smithi099 ceph-mon[143401]: pgmap v202: 161 pgs: 21 active+undersized+degraded, 39 active+undersized, 101 active+clean; 585 KiB data, 209 MiB used, 715 GiB / 715 GiB avail; 73/627 objects degraded (11.643%) 2024-03-30T14:09:13.830 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:13 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:09:13.830 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:13 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:09:13.830 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:13 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:09:13.830 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:13 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:09:13.830 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:13 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:09:13.830 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:13 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "osd ok-to-stop", "ids": ["6"], "max": 16}]: dispatch 2024-03-30T14:09:13.831 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:13 smithi099 ceph-mon[143401]: from='mon.2 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["6"], "max": 16}]: dispatch 2024-03-30T14:09:13.831 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:13 smithi099 ceph-mon[143401]: Upgrade: unsafe to stop osd(s) at this time (19 PGs are or would become offline) 2024-03-30T14:09:13.831 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:13 smithi099 ceph-mon[143401]: from='osd.5 ' entity='osd.5' 2024-03-30T14:09:14.747 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:14 smithi181 ceph-mon[115276]: failed to encode map e141 with expected crc 2024-03-30T14:09:14.747 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:14 smithi181 ceph-mon[115276]: failed to encode map e141 with expected crc 2024-03-30T14:09:14.748 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:14 smithi181 ceph-mon[115276]: failed to encode map e141 with expected crc 2024-03-30T14:09:14.748 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:14 smithi181 ceph-mon[115276]: Health check failed: 1 failed cephadm daemon(s) (CEPHADM_FAILED_DAEMON) 2024-03-30T14:09:14.748 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:14 smithi181 ceph-mon[115276]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-03-30T14:09:14.748 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:14 smithi181 ceph-mon[115276]: osd.5 [v2:172.21.15.181:6808/210718176,v1:172.21.15.181:6809/210718176] boot 2024-03-30T14:09:14.748 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:14 smithi181 ceph-mon[115276]: osdmap e142: 8 total, 8 up, 8 in 2024-03-30T14:09:14.748 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:14 smithi181 ceph-mon[115276]: failed to encode map e142 with expected crc 2024-03-30T14:09:14.748 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:14 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-03-30T14:09:14.748 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:14 smithi181 ceph-mon[115276]: failed to encode map e142 with expected crc 2024-03-30T14:09:14.748 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:14 smithi181 ceph-mon[115276]: failed to encode map e142 with expected crc 2024-03-30T14:09:14.828 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 14:09:14 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[71049]: ::ffff:172.21.15.181 - - [30/Mar/2024:14:09:14] "GET /metrics HTTP/1.1" 200 38270 "" "Prometheus/2.43.0" 2024-03-30T14:09:14.828 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:14 smithi099 ceph-mon[137093]: failed to encode map e141 with expected crc 2024-03-30T14:09:14.828 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:14 smithi099 ceph-mon[137093]: failed to encode map e141 with expected crc 2024-03-30T14:09:14.828 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:14 smithi099 ceph-mon[137093]: failed to encode map e141 with expected crc 2024-03-30T14:09:14.829 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:14 smithi099 ceph-mon[137093]: Health check failed: 1 failed cephadm daemon(s) (CEPHADM_FAILED_DAEMON) 2024-03-30T14:09:14.829 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:14 smithi099 ceph-mon[137093]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-03-30T14:09:14.829 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:14 smithi099 ceph-mon[137093]: osd.5 [v2:172.21.15.181:6808/210718176,v1:172.21.15.181:6809/210718176] boot 2024-03-30T14:09:14.829 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:14 smithi099 ceph-mon[137093]: osdmap e142: 8 total, 8 up, 8 in 2024-03-30T14:09:14.829 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:14 smithi099 ceph-mon[137093]: failed to encode map e142 with expected crc 2024-03-30T14:09:14.829 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:14 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-03-30T14:09:14.829 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:14 smithi099 ceph-mon[137093]: failed to encode map e142 with expected crc 2024-03-30T14:09:14.829 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:14 smithi099 ceph-mon[137093]: failed to encode map e142 with expected crc 2024-03-30T14:09:14.829 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:14 smithi099 ceph-mon[143401]: failed to encode map e141 with expected crc 2024-03-30T14:09:14.829 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:14 smithi099 ceph-mon[143401]: failed to encode map e141 with expected crc 2024-03-30T14:09:14.829 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:14 smithi099 ceph-mon[143401]: failed to encode map e141 with expected crc 2024-03-30T14:09:14.829 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:14 smithi099 ceph-mon[143401]: Health check failed: 1 failed cephadm daemon(s) (CEPHADM_FAILED_DAEMON) 2024-03-30T14:09:14.830 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:14 smithi099 ceph-mon[143401]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-03-30T14:09:14.830 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:14 smithi099 ceph-mon[143401]: osd.5 [v2:172.21.15.181:6808/210718176,v1:172.21.15.181:6809/210718176] boot 2024-03-30T14:09:14.830 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:14 smithi099 ceph-mon[143401]: osdmap e142: 8 total, 8 up, 8 in 2024-03-30T14:09:14.830 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:14 smithi099 ceph-mon[143401]: failed to encode map e142 with expected crc 2024-03-30T14:09:14.830 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:14 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-03-30T14:09:14.830 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:14 smithi099 ceph-mon[143401]: failed to encode map e142 with expected crc 2024-03-30T14:09:14.830 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:14 smithi099 ceph-mon[143401]: failed to encode map e142 with expected crc 2024-03-30T14:09:15.996 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:15 smithi181 ceph-mon[115276]: pgmap v204: 161 pgs: 14 peering, 18 active+undersized+degraded, 28 active+undersized, 101 active+clean; 585 KiB data, 209 MiB used, 715 GiB / 715 GiB avail; 698 B/s rd, 0 op/s; 61/627 objects degraded (9.729%) 2024-03-30T14:09:15.996 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:15 smithi181 ceph-mon[115276]: Health check update: Degraded data redundancy: 61/627 objects degraded (9.729%), 18 pgs degraded (PG_DEGRADED) 2024-03-30T14:09:15.996 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:15 smithi181 ceph-mon[115276]: failed to encode map e143 with expected crc 2024-03-30T14:09:15.996 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:15 smithi181 ceph-mon[115276]: failed to encode map e143 with expected crc 2024-03-30T14:09:15.996 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:15 smithi181 ceph-mon[115276]: failed to encode map e143 with expected crc 2024-03-30T14:09:15.996 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:15 smithi181 ceph-mon[115276]: osdmap e143: 8 total, 8 up, 8 in 2024-03-30T14:09:15.996 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:15 smithi181 ceph-mon[115276]: failed to encode map e143 with expected crc 2024-03-30T14:09:15.996 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:15 smithi181 ceph-mon[115276]: failed to encode map e143 with expected crc 2024-03-30T14:09:15.997 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:15 smithi181 ceph-mon[115276]: failed to encode map e143 with expected crc 2024-03-30T14:09:16.078 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:15 smithi099 ceph-mon[137093]: pgmap v204: 161 pgs: 14 peering, 18 active+undersized+degraded, 28 active+undersized, 101 active+clean; 585 KiB data, 209 MiB used, 715 GiB / 715 GiB avail; 698 B/s rd, 0 op/s; 61/627 objects degraded (9.729%) 2024-03-30T14:09:16.078 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:15 smithi099 ceph-mon[137093]: Health check update: Degraded data redundancy: 61/627 objects degraded (9.729%), 18 pgs degraded (PG_DEGRADED) 2024-03-30T14:09:16.078 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:15 smithi099 ceph-mon[137093]: failed to encode map e143 with expected crc 2024-03-30T14:09:16.078 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:15 smithi099 ceph-mon[137093]: failed to encode map e143 with expected crc 2024-03-30T14:09:16.078 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:15 smithi099 ceph-mon[137093]: failed to encode map e143 with expected crc 2024-03-30T14:09:16.079 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:15 smithi099 ceph-mon[137093]: osdmap e143: 8 total, 8 up, 8 in 2024-03-30T14:09:16.079 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:15 smithi099 ceph-mon[137093]: failed to encode map e143 with expected crc 2024-03-30T14:09:16.079 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:15 smithi099 ceph-mon[137093]: failed to encode map e143 with expected crc 2024-03-30T14:09:16.079 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:15 smithi099 ceph-mon[137093]: failed to encode map e143 with expected crc 2024-03-30T14:09:16.079 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:15 smithi099 ceph-mon[143401]: pgmap v204: 161 pgs: 14 peering, 18 active+undersized+degraded, 28 active+undersized, 101 active+clean; 585 KiB data, 209 MiB used, 715 GiB / 715 GiB avail; 698 B/s rd, 0 op/s; 61/627 objects degraded (9.729%) 2024-03-30T14:09:16.079 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:15 smithi099 ceph-mon[143401]: Health check update: Degraded data redundancy: 61/627 objects degraded (9.729%), 18 pgs degraded (PG_DEGRADED) 2024-03-30T14:09:16.079 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:15 smithi099 ceph-mon[143401]: failed to encode map e143 with expected crc 2024-03-30T14:09:16.079 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:15 smithi099 ceph-mon[143401]: failed to encode map e143 with expected crc 2024-03-30T14:09:16.079 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:15 smithi099 ceph-mon[143401]: failed to encode map e143 with expected crc 2024-03-30T14:09:16.079 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:15 smithi099 ceph-mon[143401]: osdmap e143: 8 total, 8 up, 8 in 2024-03-30T14:09:16.079 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:15 smithi099 ceph-mon[143401]: failed to encode map e143 with expected crc 2024-03-30T14:09:16.079 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:15 smithi099 ceph-mon[143401]: failed to encode map e143 with expected crc 2024-03-30T14:09:16.079 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:15 smithi099 ceph-mon[143401]: failed to encode map e143 with expected crc 2024-03-30T14:09:17.669 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:17 smithi181 ceph-mon[115276]: pgmap v206: 161 pgs: 14 peering, 12 active+undersized+degraded, 19 active+undersized, 116 active+clean; 585 KiB data, 209 MiB used, 715 GiB / 715 GiB avail; 575 B/s rd, 0 op/s; 45/627 objects degraded (7.177%) 2024-03-30T14:09:17.999 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:17 smithi099 ceph-mon[137093]: pgmap v206: 161 pgs: 14 peering, 12 active+undersized+degraded, 19 active+undersized, 116 active+clean; 585 KiB data, 209 MiB used, 715 GiB / 715 GiB avail; 575 B/s rd, 0 op/s; 45/627 objects degraded (7.177%) 2024-03-30T14:09:17.999 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:17 smithi099 ceph-mon[143401]: pgmap v206: 161 pgs: 14 peering, 12 active+undersized+degraded, 19 active+undersized, 116 active+clean; 585 KiB data, 209 MiB used, 715 GiB / 715 GiB avail; 575 B/s rd, 0 op/s; 45/627 objects degraded (7.177%) 2024-03-30T14:09:18.828 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:18 smithi099 ceph-mon[143401]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 45/627 objects degraded (7.177%), 12 pgs degraded) 2024-03-30T14:09:18.828 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:18 smithi099 ceph-mon[137093]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 45/627 objects degraded (7.177%), 12 pgs degraded) 2024-03-30T14:09:18.989 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:18 smithi181 ceph-mon[115276]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 45/627 objects degraded (7.177%), 12 pgs degraded) 2024-03-30T14:09:19.997 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:19 smithi181 ceph-mon[115276]: from='client.25136 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T14:09:19.997 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:19 smithi181 ceph-mon[115276]: pgmap v207: 161 pgs: 14 peering, 147 active+clean; 585 KiB data, 210 MiB used, 715 GiB / 715 GiB avail; 160 B/s rd, 0 op/s 2024-03-30T14:09:20.078 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:19 smithi099 ceph-mon[143401]: from='client.25136 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T14:09:20.078 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:19 smithi099 ceph-mon[143401]: pgmap v207: 161 pgs: 14 peering, 147 active+clean; 585 KiB data, 210 MiB used, 715 GiB / 715 GiB avail; 160 B/s rd, 0 op/s 2024-03-30T14:09:20.078 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:19 smithi099 ceph-mon[137093]: from='client.25136 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T14:09:20.078 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:19 smithi099 ceph-mon[137093]: pgmap v207: 161 pgs: 14 peering, 147 active+clean; 585 KiB data, 210 MiB used, 715 GiB / 715 GiB avail; 160 B/s rd, 0 op/s 2024-03-30T14:09:21.497 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:21 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:09:21.498 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:21 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:09:21.498 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:21 smithi181 ceph-mon[115276]: pgmap v208: 161 pgs: 161 active+clean; 585 KiB data, 210 MiB used, 715 GiB / 715 GiB avail; 135 B/s rd, 0 op/s 2024-03-30T14:09:21.498 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:21 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:09:21.498 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:21 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:09:21.498 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:21 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:09:21.498 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:21 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:09:21.578 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:21 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:09:21.578 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:21 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:09:21.578 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:21 smithi099 ceph-mon[137093]: pgmap v208: 161 pgs: 161 active+clean; 585 KiB data, 210 MiB used, 715 GiB / 715 GiB avail; 135 B/s rd, 0 op/s 2024-03-30T14:09:21.578 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:21 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:09:21.578 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:21 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:09:21.579 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:21 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:09:21.579 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:21 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:09:21.579 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:21 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:09:21.579 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:21 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:09:21.579 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:21 smithi099 ceph-mon[143401]: pgmap v208: 161 pgs: 161 active+clean; 585 KiB data, 210 MiB used, 715 GiB / 715 GiB avail; 135 B/s rd, 0 op/s 2024-03-30T14:09:21.579 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:21 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:09:21.579 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:21 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:09:21.579 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:21 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:09:21.579 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:21 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:09:22.497 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:22 smithi181 ceph-mon[115276]: Health check cleared: CEPHADM_FAILED_DAEMON (was: 1 failed cephadm daemon(s)) 2024-03-30T14:09:22.497 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:22 smithi181 ceph-mon[115276]: Cluster is now healthy 2024-03-30T14:09:22.497 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:22 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:09:22.497 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:22 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T14:09:22.578 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:22 smithi099 ceph-mon[137093]: Health check cleared: CEPHADM_FAILED_DAEMON (was: 1 failed cephadm daemon(s)) 2024-03-30T14:09:22.578 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:22 smithi099 ceph-mon[137093]: Cluster is now healthy 2024-03-30T14:09:22.578 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:22 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:09:22.578 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:22 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T14:09:22.579 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:22 smithi099 ceph-mon[143401]: Health check cleared: CEPHADM_FAILED_DAEMON (was: 1 failed cephadm daemon(s)) 2024-03-30T14:09:22.579 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:22 smithi099 ceph-mon[143401]: Cluster is now healthy 2024-03-30T14:09:22.579 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:22 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:09:22.579 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:22 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T14:09:24.079 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:23 smithi099 ceph-mon[137093]: pgmap v209: 161 pgs: 161 active+clean; 585 KiB data, 210 MiB used, 715 GiB / 715 GiB avail; 724 B/s rd, 0 op/s 2024-03-30T14:09:24.079 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:23 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:09:24.079 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:23 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:09:24.079 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:23 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:09:24.079 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:23 smithi099 ceph-mon[143401]: pgmap v209: 161 pgs: 161 active+clean; 585 KiB data, 210 MiB used, 715 GiB / 715 GiB avail; 724 B/s rd, 0 op/s 2024-03-30T14:09:24.079 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:23 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:09:24.079 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:23 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:09:24.079 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:23 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:09:24.247 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:23 smithi181 ceph-mon[115276]: pgmap v209: 161 pgs: 161 active+clean; 585 KiB data, 210 MiB used, 715 GiB / 715 GiB avail; 724 B/s rd, 0 op/s 2024-03-30T14:09:24.247 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:23 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:09:24.247 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:23 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:09:24.247 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:23 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:09:25.078 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 14:09:24 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[71049]: ::ffff:172.21.15.181 - - [30/Mar/2024:14:09:24] "GET /metrics HTTP/1.1" 200 38280 "" "Prometheus/2.43.0" 2024-03-30T14:09:25.828 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:25 smithi099 ceph-mon[137093]: pgmap v210: 161 pgs: 161 active+clean; 585 KiB data, 210 MiB used, 715 GiB / 715 GiB avail; 642 B/s rd, 0 op/s 2024-03-30T14:09:25.828 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:25 smithi099 ceph-mon[143401]: pgmap v210: 161 pgs: 161 active+clean; 585 KiB data, 210 MiB used, 715 GiB / 715 GiB avail; 642 B/s rd, 0 op/s 2024-03-30T14:09:26.247 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:25 smithi181 ceph-mon[115276]: pgmap v210: 161 pgs: 161 active+clean; 585 KiB data, 210 MiB used, 715 GiB / 715 GiB avail; 642 B/s rd, 0 op/s 2024-03-30T14:09:27.999 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:27 smithi099 ceph-mon[137093]: pgmap v211: 161 pgs: 161 active+clean; 585 KiB data, 210 MiB used, 715 GiB / 715 GiB avail; 980 B/s rd, 0 op/s 2024-03-30T14:09:28.000 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:27 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:09:28.000 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:27 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "osd ok-to-stop", "ids": ["6"], "max": 16}]: dispatch 2024-03-30T14:09:28.000 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:27 smithi099 ceph-mon[143401]: pgmap v211: 161 pgs: 161 active+clean; 585 KiB data, 210 MiB used, 715 GiB / 715 GiB avail; 980 B/s rd, 0 op/s 2024-03-30T14:09:28.000 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:27 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:09:28.000 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:27 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "osd ok-to-stop", "ids": ["6"], "max": 16}]: dispatch 2024-03-30T14:09:28.187 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:27 smithi181 ceph-mon[115276]: pgmap v211: 161 pgs: 161 active+clean; 585 KiB data, 210 MiB used, 715 GiB / 715 GiB avail; 980 B/s rd, 0 op/s 2024-03-30T14:09:28.187 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:27 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:09:28.187 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:27 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "osd ok-to-stop", "ids": ["6"], "max": 16}]: dispatch 2024-03-30T14:09:29.078 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:28 smithi099 ceph-mon[143401]: from='mon.2 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["6"], "max": 16}]: dispatch 2024-03-30T14:09:29.078 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:28 smithi099 ceph-mon[143401]: Upgrade: osd.6 is safe to restart 2024-03-30T14:09:29.078 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:28 smithi099 ceph-mon[137093]: from='mon.2 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["6"], "max": 16}]: dispatch 2024-03-30T14:09:29.079 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:28 smithi099 ceph-mon[137093]: Upgrade: osd.6 is safe to restart 2024-03-30T14:09:29.155 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:28 smithi181 ceph-mon[115276]: from='mon.2 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["6"], "max": 16}]: dispatch 2024-03-30T14:09:29.155 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:28 smithi181 ceph-mon[115276]: Upgrade: osd.6 is safe to restart 2024-03-30T14:09:29.514 INFO:teuthology.orchestra.run.smithi099.stdout:true 2024-03-30T14:09:29.828 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:29 smithi099 ceph-mon[143401]: from='client.25136 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T14:09:29.828 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:29 smithi099 ceph-mon[143401]: pgmap v212: 161 pgs: 161 active+clean; 585 KiB data, 210 MiB used, 715 GiB / 715 GiB avail; 708 B/s rd, 0 op/s 2024-03-30T14:09:29.828 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:29 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:09:29.828 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:29 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2024-03-30T14:09:29.828 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:29 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:09:29.828 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:29 smithi099 ceph-mon[137093]: from='client.25136 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T14:09:29.828 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:29 smithi099 ceph-mon[137093]: pgmap v212: 161 pgs: 161 active+clean; 585 KiB data, 210 MiB used, 715 GiB / 715 GiB avail; 708 B/s rd, 0 op/s 2024-03-30T14:09:29.828 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:29 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:09:29.829 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:29 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2024-03-30T14:09:29.829 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:29 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:09:30.017 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:29 smithi181 ceph-mon[115276]: from='client.25136 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T14:09:30.017 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:29 smithi181 ceph-mon[115276]: pgmap v212: 161 pgs: 161 active+clean; 585 KiB data, 210 MiB used, 715 GiB / 715 GiB avail; 708 B/s rd, 0 op/s 2024-03-30T14:09:30.017 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:29 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:09:30.017 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:29 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2024-03-30T14:09:30.017 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:29 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:09:30.159 INFO:teuthology.orchestra.run.smithi099.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-03-30T14:09:30.159 INFO:teuthology.orchestra.run.smithi099.stdout:agent.smithi099 smithi099 running 7s ago 37m - - 2024-03-30T14:09:30.159 INFO:teuthology.orchestra.run.smithi099.stdout:agent.smithi181 smithi181 running 9s ago 37m - - 2024-03-30T14:09:30.159 INFO:teuthology.orchestra.run.smithi099.stdout:alertmanager.a smithi099 *:9093,9094 running (8m) 7s ago 32m 26.9M - 0.25.0 c8568f914cd2 08735152b67d 2024-03-30T14:09:30.159 INFO:teuthology.orchestra.run.smithi099.stdout:grafana.a smithi181 *:3000 running (7m) 9s ago 31m 79.7M - 9.4.12 2bacad6d85d8 d599aa7730d6 2024-03-30T14:09:30.159 INFO:teuthology.orchestra.run.smithi099.stdout:iscsi.foo.smithi099.qyjuvr smithi099 running (10m) 7s ago 31m 61.8M - 3.5 e1d6a67b021e 2f859af6bc2a 2024-03-30T14:09:30.159 INFO:teuthology.orchestra.run.smithi099.stdout:mgr.x smithi181 *:8443,9283,8765 running (9m) 9s ago 37m 451M - 19.0.0-1967-g4e50bbcd b0c4478f1d83 f269106f7913 2024-03-30T14:09:30.159 INFO:teuthology.orchestra.run.smithi099.stdout:mgr.y smithi099 *:8443,9283,8765 running (20m) 7s ago 38m 527M - 19.0.0-1967-g4e50bbcd b0c4478f1d83 0d464b8c1d18 2024-03-30T14:09:30.159 INFO:teuthology.orchestra.run.smithi099.stdout:mon.a smithi099 running (5m) 7s ago 38m 59.4M 2048M 19.0.0-1967-g4e50bbcd b0c4478f1d83 f19388464dfd 2024-03-30T14:09:30.159 INFO:teuthology.orchestra.run.smithi099.stdout:mon.b smithi181 running (6m) 9s ago 37m 58.4M 2048M 19.0.0-1967-g4e50bbcd b0c4478f1d83 0468ed087cdd 2024-03-30T14:09:30.160 INFO:teuthology.orchestra.run.smithi099.stdout:mon.c smithi099 running (5m) 7s ago 37m 48.3M 2048M 19.0.0-1967-g4e50bbcd b0c4478f1d83 731056a2fea6 2024-03-30T14:09:30.160 INFO:teuthology.orchestra.run.smithi099.stdout:node-exporter.a smithi099 *:9100 running (9m) 7s ago 33m 16.5M - 1.5.0 0da6a335fe13 4a3f1f6e7068 2024-03-30T14:09:30.160 INFO:teuthology.orchestra.run.smithi099.stdout:node-exporter.b smithi181 *:9100 running (9m) 9s ago 32m 16.8M - 1.5.0 0da6a335fe13 acea317b5f5d 2024-03-30T14:09:30.160 INFO:teuthology.orchestra.run.smithi099.stdout:osd.0 smithi099 running (3m) 7s ago 36m 57.3M 4096M 19.0.0-1967-g4e50bbcd b0c4478f1d83 d97d48cb3314 2024-03-30T14:09:30.160 INFO:teuthology.orchestra.run.smithi099.stdout:osd.1 smithi099 running (3m) 7s ago 36m 59.7M 4096M 19.0.0-1967-g4e50bbcd b0c4478f1d83 a843295ce83b 2024-03-30T14:09:30.160 INFO:teuthology.orchestra.run.smithi099.stdout:osd.2 smithi099 running (2m) 7s ago 35m 45.9M 4096M 19.0.0-1967-g4e50bbcd b0c4478f1d83 18304adfb0d0 2024-03-30T14:09:30.160 INFO:teuthology.orchestra.run.smithi099.stdout:osd.3 smithi099 running (84s) 7s ago 35m 47.3M 4096M 19.0.0-1967-g4e50bbcd b0c4478f1d83 9b38d79f070e 2024-03-30T14:09:30.160 INFO:teuthology.orchestra.run.smithi099.stdout:osd.4 smithi181 running (55s) 9s ago 35m 52.2M 4096M 19.0.0-1967-g4e50bbcd b0c4478f1d83 b9078af21e45 2024-03-30T14:09:30.160 INFO:teuthology.orchestra.run.smithi099.stdout:osd.5 smithi181 running (22s) 9s ago 34m 50.1M 4096M 19.0.0-1967-g4e50bbcd b0c4478f1d83 bba176b8db2c 2024-03-30T14:09:30.160 INFO:teuthology.orchestra.run.smithi099.stdout:osd.6 smithi181 running (34m) 9s ago 34m 59.9M 4096M 17.2.0 e1d6a67b021e 81d889ea213d 2024-03-30T14:09:30.160 INFO:teuthology.orchestra.run.smithi099.stdout:osd.7 smithi181 running (33m) 9s ago 33m 63.0M 4096M 17.2.0 e1d6a67b021e c08b1839dd7e 2024-03-30T14:09:30.160 INFO:teuthology.orchestra.run.smithi099.stdout:prometheus.a smithi181 *:9095 running (8m) 9s ago 33m 70.5M - 2.43.0 a07b618ecd1d 004088bdf70e 2024-03-30T14:09:30.160 INFO:teuthology.orchestra.run.smithi099.stdout:rgw.foo.smithi099.fxjbmp smithi099 *:8000 running (31m) 7s ago 31m 79.2M - 17.2.0 e1d6a67b021e 400b28b3f650 2024-03-30T14:09:30.160 INFO:teuthology.orchestra.run.smithi099.stdout:rgw.foo.smithi181.wfqwti smithi181 *:8000 running (31m) 9s ago 31m 78.9M - 17.2.0 e1d6a67b021e 97e1b130f9d4 2024-03-30T14:09:30.547 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-03-30T14:09:30.547 INFO:teuthology.orchestra.run.smithi099.stdout: "mon": { 2024-03-30T14:09:30.547 INFO:teuthology.orchestra.run.smithi099.stdout: "ceph version 19.0.0-1967-g4e50bbcd (4e50bbcdd1630c7760b708f3a5b4d38a121e66cb) squid (dev)": 3 2024-03-30T14:09:30.548 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T14:09:30.548 INFO:teuthology.orchestra.run.smithi099.stdout: "mgr": { 2024-03-30T14:09:30.548 INFO:teuthology.orchestra.run.smithi099.stdout: "ceph version 19.0.0-1967-g4e50bbcd (4e50bbcdd1630c7760b708f3a5b4d38a121e66cb) squid (dev)": 2 2024-03-30T14:09:30.548 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T14:09:30.548 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": { 2024-03-30T14:09:30.548 INFO:teuthology.orchestra.run.smithi099.stdout: "ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)": 2, 2024-03-30T14:09:30.548 INFO:teuthology.orchestra.run.smithi099.stdout: "ceph version 19.0.0-1967-g4e50bbcd (4e50bbcdd1630c7760b708f3a5b4d38a121e66cb) squid (dev)": 6 2024-03-30T14:09:30.548 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T14:09:30.548 INFO:teuthology.orchestra.run.smithi099.stdout: "rgw": { 2024-03-30T14:09:30.548 INFO:teuthology.orchestra.run.smithi099.stdout: "ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)": 2 2024-03-30T14:09:30.548 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T14:09:30.548 INFO:teuthology.orchestra.run.smithi099.stdout: "overall": { 2024-03-30T14:09:30.548 INFO:teuthology.orchestra.run.smithi099.stdout: "ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)": 4, 2024-03-30T14:09:30.548 INFO:teuthology.orchestra.run.smithi099.stdout: "ceph version 19.0.0-1967-g4e50bbcd (4e50bbcdd1630c7760b708f3a5b4d38a121e66cb) squid (dev)": 11 2024-03-30T14:09:30.548 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-03-30T14:09:30.549 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-03-30T14:09:30.828 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:30 smithi099 ceph-mon[143401]: Upgrade: Updating osd.6 2024-03-30T14:09:30.828 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:30 smithi099 ceph-mon[143401]: Deploying daemon osd.6 on smithi181 2024-03-30T14:09:30.828 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:30 smithi099 ceph-mon[143401]: from='client.64474 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T14:09:30.828 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:30 smithi099 ceph-mon[143401]: from='client.? 172.21.15.99:0/3180454452' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:09:30.828 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:30 smithi099 ceph-mon[137093]: Upgrade: Updating osd.6 2024-03-30T14:09:30.829 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:30 smithi099 ceph-mon[137093]: Deploying daemon osd.6 on smithi181 2024-03-30T14:09:30.829 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:30 smithi099 ceph-mon[137093]: from='client.64474 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T14:09:30.829 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:30 smithi099 ceph-mon[137093]: from='client.? 172.21.15.99:0/3180454452' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:09:30.880 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-03-30T14:09:30.881 INFO:teuthology.orchestra.run.smithi099.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph:4e50bbcdd1630c7760b708f3a5b4d38a121e66cb", 2024-03-30T14:09:30.881 INFO:teuthology.orchestra.run.smithi099.stdout: "in_progress": true, 2024-03-30T14:09:30.881 INFO:teuthology.orchestra.run.smithi099.stdout: "which": "Upgrading daemons of type(s) crash,osd", 2024-03-30T14:09:30.881 INFO:teuthology.orchestra.run.smithi099.stdout: "services_complete": [], 2024-03-30T14:09:30.881 INFO:teuthology.orchestra.run.smithi099.stdout: "progress": "6/8 daemons upgraded", 2024-03-30T14:09:30.881 INFO:teuthology.orchestra.run.smithi099.stdout: "message": "Currently upgrading osd daemons", 2024-03-30T14:09:30.881 INFO:teuthology.orchestra.run.smithi099.stdout: "is_paused": false 2024-03-30T14:09:30.881 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-03-30T14:09:31.038 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:30 smithi181 ceph-mon[115276]: Upgrade: Updating osd.6 2024-03-30T14:09:31.039 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:30 smithi181 ceph-mon[115276]: Deploying daemon osd.6 on smithi181 2024-03-30T14:09:31.039 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:30 smithi181 ceph-mon[115276]: from='client.64474 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T14:09:31.039 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:30 smithi181 ceph-mon[115276]: from='client.? 172.21.15.99:0/3180454452' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:09:32.070 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:31 smithi181 ceph-mon[115276]: from='client.54477 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T14:09:32.070 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:31 smithi181 ceph-mon[115276]: pgmap v213: 161 pgs: 161 active+clean; 585 KiB data, 210 MiB used, 715 GiB / 715 GiB avail; 885 B/s rd, 0 op/s 2024-03-30T14:09:32.071 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:31 smithi181 ceph-mon[115276]: from='client.64486 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T14:09:32.078 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:31 smithi099 ceph-mon[143401]: from='client.54477 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T14:09:32.078 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:31 smithi099 ceph-mon[143401]: pgmap v213: 161 pgs: 161 active+clean; 585 KiB data, 210 MiB used, 715 GiB / 715 GiB avail; 885 B/s rd, 0 op/s 2024-03-30T14:09:32.078 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:31 smithi099 ceph-mon[143401]: from='client.64486 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T14:09:32.078 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:31 smithi099 ceph-mon[137093]: from='client.54477 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T14:09:32.078 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:31 smithi099 ceph-mon[137093]: pgmap v213: 161 pgs: 161 active+clean; 585 KiB data, 210 MiB used, 715 GiB / 715 GiB avail; 885 B/s rd, 0 op/s 2024-03-30T14:09:32.078 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:31 smithi099 ceph-mon[137093]: from='client.64486 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T14:09:33.078 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:32 smithi099 ceph-mon[137093]: from='client.64498 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T14:09:33.078 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:32 smithi099 ceph-mon[143401]: from='client.64498 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T14:09:33.107 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:32 smithi181 ceph-mon[115276]: from='client.64498 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T14:09:33.497 INFO:journalctl@ceph.osd.6.smithi181.stdout:Mar 30 14:09:33 smithi181 systemd[1]: Stopping Ceph osd.6 for 98ebaeb8-ee99-11ee-b647-cb9ed24678a4... 2024-03-30T14:09:33.997 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:33 smithi181 ceph-mon[115276]: pgmap v214: 161 pgs: 161 active+clean; 585 KiB data, 210 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T14:09:33.997 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:33 smithi181 ceph-mon[115276]: osd.6 marked itself down and dead 2024-03-30T14:09:33.997 INFO:journalctl@ceph.osd.6.smithi181.stdout:Mar 30 14:09:33 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-6[36302]: 2024-03-30T14:09:33.605+0000 7f64adf57700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.6 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-03-30T14:09:33.997 INFO:journalctl@ceph.osd.6.smithi181.stdout:Mar 30 14:09:33 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-6[36302]: 2024-03-30T14:09:33.605+0000 7f64adf57700 -1 osd.6 143 *** Got signal Terminated *** 2024-03-30T14:09:33.997 INFO:journalctl@ceph.osd.6.smithi181.stdout:Mar 30 14:09:33 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-6[36302]: 2024-03-30T14:09:33.605+0000 7f64adf57700 -1 osd.6 143 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-03-30T14:09:34.078 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:33 smithi099 ceph-mon[137093]: pgmap v214: 161 pgs: 161 active+clean; 585 KiB data, 210 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T14:09:34.078 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:33 smithi099 ceph-mon[137093]: osd.6 marked itself down and dead 2024-03-30T14:09:34.078 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:33 smithi099 ceph-mon[143401]: pgmap v214: 161 pgs: 161 active+clean; 585 KiB data, 210 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T14:09:34.078 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:33 smithi099 ceph-mon[143401]: osd.6 marked itself down and dead 2024-03-30T14:09:34.491 INFO:journalctl@ceph.osd.6.smithi181.stdout:Mar 30 14:09:34 smithi181 podman[158064]: 2024-03-30 14:09:34.230874355 +0000 UTC m=+0.744907179 container died 81d889ea213d0915ff3411f09875846a5a47607ab3ba5f7676607fdf4ac44612 (image=quay.io/ceph/ceph@sha256:12a0a4f43413fd97a14a3d47a3451b2d2df50020835bb93db666209f3f77617a, name=ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-6, distribution-scope=public, vcs-type=git, summary=Provides a CentOS Stream container based on the Red Hat Universal Base Image, RELEASE=HEAD, name=centos-stream, io.k8s.display-name=CentOS Stream 8, ceph=True, com.redhat.build-host=cpt-1002.osbs.prod.upshift.rdu2.redhat.com, com.redhat.component=centos-stream-container, maintainer=Guillaume Abrioux , GIT_CLEAN=True, description=CentOS Stream is a continuously delivered distro that tracks just ahead of Red Hat Enterprise Linux development. This image takes the Red Hat UBI and layers on content from CentOS Stream, io.openshift.expose-services=, io.openshift.tags=base centos centos-stream, vendor=Red Hat, Inc., GIT_BRANCH=HEAD, build-date=2022-05-03T08:36:31.336870, url=https://access.redhat.com/containers/#/registry.access.redhat.com/ubi8/images/8.6-754, vcs-ref=f1ee6e37554363ec55e0035aba1a693d3627fdeb, version=8, CEPH_POINT_RELEASE=-17.2.0, com.redhat.license_terms=https://centos.org/legal/licensing-policy/, GIT_REPO=https://github.com/ceph/ceph-container.git, architecture=x86_64, release=754, GIT_COMMIT=b613db0f44179c0940781c1c7fe04e1acb7093ac, io.k8s.description=The Universal Base Image is designed and engineered to be the base layer for all of your containerized applications, middleware and utilities. This base image is freely redistributable, but Red Hat only supports Red Hat technologies through subscriptions for Red Hat products. This image is maintained by Red Hat and updated regularly., io.buildah.version=1.19.8) 2024-03-30T14:09:34.747 INFO:journalctl@ceph.osd.6.smithi181.stdout:Mar 30 14:09:34 smithi181 podman[158064]: 2024-03-30 14:09:34.589636649 +0000 UTC m=+1.103669481 container cleanup 81d889ea213d0915ff3411f09875846a5a47607ab3ba5f7676607fdf4ac44612 (image=quay.io/ceph/ceph@sha256:12a0a4f43413fd97a14a3d47a3451b2d2df50020835bb93db666209f3f77617a, name=ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-6, url=https://access.redhat.com/containers/#/registry.access.redhat.com/ubi8/images/8.6-754, name=centos-stream, vcs-type=git, release=754, build-date=2022-05-03T08:36:31.336870, maintainer=Guillaume Abrioux , io.k8s.display-name=CentOS Stream 8, RELEASE=HEAD, com.redhat.build-host=cpt-1002.osbs.prod.upshift.rdu2.redhat.com, com.redhat.license_terms=https://centos.org/legal/licensing-policy/, io.buildah.version=1.19.8, vcs-ref=f1ee6e37554363ec55e0035aba1a693d3627fdeb, CEPH_POINT_RELEASE=-17.2.0, io.openshift.expose-services=, architecture=x86_64, summary=Provides a CentOS Stream container based on the Red Hat Universal Base Image, GIT_BRANCH=HEAD, io.k8s.description=The Universal Base Image is designed and engineered to be the base layer for all of your containerized applications, middleware and utilities. This base image is freely redistributable, but Red Hat only supports Red Hat technologies through subscriptions for Red Hat products. This image is maintained by Red Hat and updated regularly., vendor=Red Hat, Inc., com.redhat.component=centos-stream-container, distribution-scope=public, GIT_CLEAN=True, description=CentOS Stream is a continuously delivered distro that tracks just ahead of Red Hat Enterprise Linux development. This image takes the Red Hat UBI and layers on content from CentOS Stream, GIT_COMMIT=b613db0f44179c0940781c1c7fe04e1acb7093ac, GIT_REPO=https://github.com/ceph/ceph-container.git, io.openshift.tags=base centos centos-stream, ceph=True, version=8) 2024-03-30T14:09:34.747 INFO:journalctl@ceph.osd.6.smithi181.stdout:Mar 30 14:09:34 smithi181 bash[158064]: ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-6 2024-03-30T14:09:35.078 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 14:09:34 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[71049]: ::ffff:172.21.15.181 - - [30/Mar/2024:14:09:34] "GET /metrics HTTP/1.1" 200 38280 "" "Prometheus/2.43.0" 2024-03-30T14:09:35.078 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:34 smithi099 ceph-mon[137093]: Health check failed: 1 osds down (OSD_DOWN) 2024-03-30T14:09:35.078 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:34 smithi099 ceph-mon[137093]: osdmap e144: 8 total, 7 up, 8 in 2024-03-30T14:09:35.078 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:34 smithi099 ceph-mon[137093]: failed to encode map e144 with expected crc 2024-03-30T14:09:35.079 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:34 smithi099 ceph-mon[137093]: failed to encode map e144 with expected crc 2024-03-30T14:09:35.079 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:34 smithi099 ceph-mon[137093]: failed to encode map e144 with expected crc 2024-03-30T14:09:35.079 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:34 smithi099 ceph-mon[137093]: failed to encode map e144 with expected crc 2024-03-30T14:09:35.079 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:34 smithi099 ceph-mon[137093]: pgmap v216: 161 pgs: 15 peering, 7 stale+active+clean, 139 active+clean; 585 KiB data, 210 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:09:35.079 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:34 smithi099 ceph-mon[137093]: osdmap e145: 8 total, 7 up, 8 in 2024-03-30T14:09:35.079 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:34 smithi099 ceph-mon[143401]: Health check failed: 1 osds down (OSD_DOWN) 2024-03-30T14:09:35.079 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:34 smithi099 ceph-mon[143401]: osdmap e144: 8 total, 7 up, 8 in 2024-03-30T14:09:35.079 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:34 smithi099 ceph-mon[143401]: failed to encode map e144 with expected crc 2024-03-30T14:09:35.079 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:34 smithi099 ceph-mon[143401]: failed to encode map e144 with expected crc 2024-03-30T14:09:35.079 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:34 smithi099 ceph-mon[143401]: failed to encode map e144 with expected crc 2024-03-30T14:09:35.079 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:34 smithi099 ceph-mon[143401]: failed to encode map e144 with expected crc 2024-03-30T14:09:35.079 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:34 smithi099 ceph-mon[143401]: pgmap v216: 161 pgs: 15 peering, 7 stale+active+clean, 139 active+clean; 585 KiB data, 210 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:09:35.079 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:34 smithi099 ceph-mon[143401]: osdmap e145: 8 total, 7 up, 8 in 2024-03-30T14:09:35.206 INFO:journalctl@ceph.osd.6.smithi181.stdout:Mar 30 14:09:34 smithi181 podman[158081]: 2024-03-30 14:09:34.85797432 +0000 UTC m=+0.623025480 container remove 81d889ea213d0915ff3411f09875846a5a47607ab3ba5f7676607fdf4ac44612 (image=quay.io/ceph/ceph@sha256:12a0a4f43413fd97a14a3d47a3451b2d2df50020835bb93db666209f3f77617a, name=ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-6, CEPH_POINT_RELEASE=-17.2.0, maintainer=Guillaume Abrioux , io.buildah.version=1.19.8, summary=Provides a CentOS Stream container based on the Red Hat Universal Base Image, ceph=True, version=8, io.openshift.expose-services=, name=centos-stream, vcs-ref=f1ee6e37554363ec55e0035aba1a693d3627fdeb, GIT_CLEAN=True, vcs-type=git, com.redhat.build-host=cpt-1002.osbs.prod.upshift.rdu2.redhat.com, RELEASE=HEAD, build-date=2022-05-03T08:36:31.336870, GIT_BRANCH=HEAD, distribution-scope=public, vendor=Red Hat, Inc., com.redhat.component=centos-stream-container, release=754, url=https://access.redhat.com/containers/#/registry.access.redhat.com/ubi8/images/8.6-754, io.openshift.tags=base centos centos-stream, description=CentOS Stream is a continuously delivered distro that tracks just ahead of Red Hat Enterprise Linux development. This image takes the Red Hat UBI and layers on content from CentOS Stream, com.redhat.license_terms=https://centos.org/legal/licensing-policy/, architecture=x86_64, GIT_COMMIT=b613db0f44179c0940781c1c7fe04e1acb7093ac, io.k8s.description=The Universal Base Image is designed and engineered to be the base layer for all of your containerized applications, middleware and utilities. This base image is freely redistributable, but Red Hat only supports Red Hat technologies through subscriptions for Red Hat products. This image is maintained by Red Hat and updated regularly., GIT_REPO=https://github.com/ceph/ceph-container.git, io.k8s.display-name=CentOS Stream 8) 2024-03-30T14:09:35.207 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:34 smithi181 ceph-mon[115276]: Health check failed: 1 osds down (OSD_DOWN) 2024-03-30T14:09:35.207 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:34 smithi181 ceph-mon[115276]: osdmap e144: 8 total, 7 up, 8 in 2024-03-30T14:09:35.207 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:34 smithi181 ceph-mon[115276]: failed to encode map e144 with expected crc 2024-03-30T14:09:35.207 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:34 smithi181 ceph-mon[115276]: failed to encode map e144 with expected crc 2024-03-30T14:09:35.207 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:34 smithi181 ceph-mon[115276]: failed to encode map e144 with expected crc 2024-03-30T14:09:35.207 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:34 smithi181 ceph-mon[115276]: failed to encode map e144 with expected crc 2024-03-30T14:09:35.207 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:34 smithi181 ceph-mon[115276]: pgmap v216: 161 pgs: 15 peering, 7 stale+active+clean, 139 active+clean; 585 KiB data, 210 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:09:35.207 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:34 smithi181 ceph-mon[115276]: osdmap e145: 8 total, 7 up, 8 in 2024-03-30T14:09:35.461 INFO:journalctl@ceph.osd.6.smithi181.stdout:Mar 30 14:09:35 smithi181 podman[158170]: 2024-03-30 14:09:35.118405796 +0000 UTC m=+0.017773080 image pull b0c4478f1d83795df4d538bf108aee5fac57194348fb16dcdbb3115f3e2fe95e quay.ceph.io/ceph-ci/ceph:4e50bbcdd1630c7760b708f3a5b4d38a121e66cb 2024-03-30T14:09:35.461 INFO:journalctl@ceph.osd.6.smithi181.stdout:Mar 30 14:09:35 smithi181 podman[158170]: 2024-03-30 14:09:35.242394587 +0000 UTC m=+0.141761961 container create 560fd28e5fce8cfdd8aee17d3b28c24bd9d885d3a50d7400df3c8f0db24cc9d3 (image=quay.ceph.io/ceph-ci/ceph:4e50bbcdd1630c7760b708f3a5b4d38a121e66cb, name=ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-6-deactivate, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=squid-4e50bbc, ceph=True, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240326, GIT_CLEAN=True, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5) 2024-03-30T14:09:35.747 INFO:journalctl@ceph.osd.6.smithi181.stdout:Mar 30 14:09:35 smithi181 podman[158170]: 2024-03-30 14:09:35.469723285 +0000 UTC m=+0.369090564 container init 560fd28e5fce8cfdd8aee17d3b28c24bd9d885d3a50d7400df3c8f0db24cc9d3 (image=quay.ceph.io/ceph-ci/ceph:4e50bbcdd1630c7760b708f3a5b4d38a121e66cb, name=ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-6-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, ceph=True, org.label-schema.build-date=20240326, CEPH_POINT_RELEASE=, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, RELEASE=squid-4e50bbc, maintainer=Guillaume Abrioux ) 2024-03-30T14:09:35.747 INFO:journalctl@ceph.osd.6.smithi181.stdout:Mar 30 14:09:35 smithi181 podman[158170]: 2024-03-30 14:09:35.472964232 +0000 UTC m=+0.372331518 container start 560fd28e5fce8cfdd8aee17d3b28c24bd9d885d3a50d7400df3c8f0db24cc9d3 (image=quay.ceph.io/ceph-ci/ceph:4e50bbcdd1630c7760b708f3a5b4d38a121e66cb, name=ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-6-deactivate, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=squid-4e50bbc, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.build-date=20240326, io.buildah.version=1.33.5) 2024-03-30T14:09:35.747 INFO:journalctl@ceph.osd.6.smithi181.stdout:Mar 30 14:09:35 smithi181 podman[158170]: 2024-03-30 14:09:35.56983188 +0000 UTC m=+0.469199162 container attach 560fd28e5fce8cfdd8aee17d3b28c24bd9d885d3a50d7400df3c8f0db24cc9d3 (image=quay.ceph.io/ceph-ci/ceph:4e50bbcdd1630c7760b708f3a5b4d38a121e66cb, name=ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-6-deactivate, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, ceph=True, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , RELEASE=squid-4e50bbc, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240326) 2024-03-30T14:09:36.018 INFO:journalctl@ceph.osd.6.smithi181.stdout:Mar 30 14:09:35 smithi181 podman[158170]: 2024-03-30 14:09:35.803659819 +0000 UTC m=+0.703027095 container died 560fd28e5fce8cfdd8aee17d3b28c24bd9d885d3a50d7400df3c8f0db24cc9d3 (image=quay.ceph.io/ceph-ci/ceph:4e50bbcdd1630c7760b708f3a5b4d38a121e66cb, name=ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-6-deactivate, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=squid-4e50bbc, ceph=True, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240326, GIT_BRANCH=HEAD, io.buildah.version=1.33.5) 2024-03-30T14:09:36.018 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:35 smithi181 ceph-mon[115276]: failed to encode map e145 with expected crc 2024-03-30T14:09:36.018 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:35 smithi181 ceph-mon[115276]: failed to encode map e145 with expected crc 2024-03-30T14:09:36.018 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:35 smithi181 ceph-mon[115276]: Health check failed: Reduced data availability: 2 pgs peering (PG_AVAILABILITY) 2024-03-30T14:09:36.078 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:35 smithi099 ceph-mon[137093]: failed to encode map e145 with expected crc 2024-03-30T14:09:36.078 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:35 smithi099 ceph-mon[137093]: failed to encode map e145 with expected crc 2024-03-30T14:09:36.078 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:35 smithi099 ceph-mon[137093]: Health check failed: Reduced data availability: 2 pgs peering (PG_AVAILABILITY) 2024-03-30T14:09:36.078 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:35 smithi099 ceph-mon[143401]: failed to encode map e145 with expected crc 2024-03-30T14:09:36.079 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:35 smithi099 ceph-mon[143401]: failed to encode map e145 with expected crc 2024-03-30T14:09:36.079 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:35 smithi099 ceph-mon[143401]: Health check failed: Reduced data availability: 2 pgs peering (PG_AVAILABILITY) 2024-03-30T14:09:36.747 INFO:journalctl@ceph.osd.6.smithi181.stdout:Mar 30 14:09:36 smithi181 podman[158283]: 2024-03-30 14:09:36.432392506 +0000 UTC m=+0.622859612 container remove 560fd28e5fce8cfdd8aee17d3b28c24bd9d885d3a50d7400df3c8f0db24cc9d3 (image=quay.ceph.io/ceph-ci/ceph:4e50bbcdd1630c7760b708f3a5b4d38a121e66cb, name=ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-6-deactivate, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, RELEASE=squid-4e50bbc, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, ceph=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240326) 2024-03-30T14:09:36.747 INFO:journalctl@ceph.osd.6.smithi181.stdout:Mar 30 14:09:36 smithi181 systemd[1]: ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4@osd.6.service: Deactivated successfully. 2024-03-30T14:09:36.747 INFO:journalctl@ceph.osd.6.smithi181.stdout:Mar 30 14:09:36 smithi181 systemd[1]: Stopped Ceph osd.6 for 98ebaeb8-ee99-11ee-b647-cb9ed24678a4. 2024-03-30T14:09:36.747 INFO:journalctl@ceph.osd.6.smithi181.stdout:Mar 30 14:09:36 smithi181 systemd[1]: ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4@osd.6.service: Consumed 14.772s CPU time. 2024-03-30T14:09:36.747 INFO:journalctl@ceph.osd.6.smithi181.stdout:Mar 30 14:09:36 smithi181 systemd[1]: Starting Ceph osd.6 for 98ebaeb8-ee99-11ee-b647-cb9ed24678a4... 2024-03-30T14:09:37.211 INFO:journalctl@ceph.osd.6.smithi181.stdout:Mar 30 14:09:36 smithi181 podman[158455]: 2024-03-30 14:09:36.789834185 +0000 UTC m=+0.019488492 image pull b0c4478f1d83795df4d538bf108aee5fac57194348fb16dcdbb3115f3e2fe95e quay.ceph.io/ceph-ci/ceph:4e50bbcdd1630c7760b708f3a5b4d38a121e66cb 2024-03-30T14:09:37.211 INFO:journalctl@ceph.osd.6.smithi181.stdout:Mar 30 14:09:36 smithi181 podman[158455]: 2024-03-30 14:09:36.9253336 +0000 UTC m=+0.154987940 container create 7ff4cc4d6adadafc72c4a3b1863f42abbf0d636d3e5c730fdd1b1eb4bb23660c (image=quay.ceph.io/ceph-ci/ceph:4e50bbcdd1630c7760b708f3a5b4d38a121e66cb, name=ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-6-activate, org.label-schema.license=GPLv2, ceph=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, RELEASE=squid-4e50bbc, GIT_CLEAN=True, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, org.label-schema.build-date=20240326, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0) 2024-03-30T14:09:38.078 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:37 smithi099 ceph-mon[137093]: pgmap v218: 161 pgs: 5 active+undersized+degraded, 20 peering, 3 stale+active+clean, 9 active+undersized, 124 active+clean; 585 KiB data, 210 MiB used, 715 GiB / 715 GiB avail; 14/627 objects degraded (2.233%) 2024-03-30T14:09:38.078 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:37 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:09:38.079 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:37 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T14:09:38.079 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:37 smithi099 ceph-mon[137093]: Health check failed: Degraded data redundancy: 14/627 objects degraded (2.233%), 5 pgs degraded (PG_DEGRADED) 2024-03-30T14:09:38.079 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:37 smithi099 ceph-mon[143401]: pgmap v218: 161 pgs: 5 active+undersized+degraded, 20 peering, 3 stale+active+clean, 9 active+undersized, 124 active+clean; 585 KiB data, 210 MiB used, 715 GiB / 715 GiB avail; 14/627 objects degraded (2.233%) 2024-03-30T14:09:38.079 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:37 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:09:38.079 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:37 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T14:09:38.079 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:37 smithi099 ceph-mon[143401]: Health check failed: Degraded data redundancy: 14/627 objects degraded (2.233%), 5 pgs degraded (PG_DEGRADED) 2024-03-30T14:09:38.245 INFO:journalctl@ceph.osd.6.smithi181.stdout:Mar 30 14:09:37 smithi181 podman[158455]: 2024-03-30 14:09:37.772700965 +0000 UTC m=+1.002355267 container init 7ff4cc4d6adadafc72c4a3b1863f42abbf0d636d3e5c730fdd1b1eb4bb23660c (image=quay.ceph.io/ceph-ci/ceph:4e50bbcdd1630c7760b708f3a5b4d38a121e66cb, name=ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-6-activate, CEPH_POINT_RELEASE=, RELEASE=squid-4e50bbc, GIT_CLEAN=True, ceph=True, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240326, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5) 2024-03-30T14:09:38.245 INFO:journalctl@ceph.osd.6.smithi181.stdout:Mar 30 14:09:37 smithi181 podman[158455]: 2024-03-30 14:09:37.77689357 +0000 UTC m=+1.006547867 container start 7ff4cc4d6adadafc72c4a3b1863f42abbf0d636d3e5c730fdd1b1eb4bb23660c (image=quay.ceph.io/ceph-ci/ceph:4e50bbcdd1630c7760b708f3a5b4d38a121e66cb, name=ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-6-activate, RELEASE=squid-4e50bbc, GIT_CLEAN=True, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, ceph=True, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.build-date=20240326, org.label-schema.name=CentOS Stream 8 Base Image) 2024-03-30T14:09:38.245 INFO:journalctl@ceph.osd.6.smithi181.stdout:Mar 30 14:09:37 smithi181 podman[158455]: 2024-03-30 14:09:37.872475158 +0000 UTC m=+1.102129453 container attach 7ff4cc4d6adadafc72c4a3b1863f42abbf0d636d3e5c730fdd1b1eb4bb23660c (image=quay.ceph.io/ceph-ci/ceph:4e50bbcdd1630c7760b708f3a5b4d38a121e66cb, name=ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-6-activate, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, GIT_CLEAN=True, org.label-schema.build-date=20240326, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , RELEASE=squid-4e50bbc, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, GIT_BRANCH=HEAD) 2024-03-30T14:09:38.245 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:37 smithi181 ceph-mon[115276]: pgmap v218: 161 pgs: 5 active+undersized+degraded, 20 peering, 3 stale+active+clean, 9 active+undersized, 124 active+clean; 585 KiB data, 210 MiB used, 715 GiB / 715 GiB avail; 14/627 objects degraded (2.233%) 2024-03-30T14:09:38.245 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:37 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:09:38.245 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:37 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T14:09:38.245 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:37 smithi181 ceph-mon[115276]: Health check failed: Degraded data redundancy: 14/627 objects degraded (2.233%), 5 pgs degraded (PG_DEGRADED) 2024-03-30T14:09:38.497 INFO:journalctl@ceph.osd.6.smithi181.stdout:Mar 30 14:09:38 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-6-activate[158486]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2024-03-30T14:09:38.497 INFO:journalctl@ceph.osd.6.smithi181.stdout:Mar 30 14:09:38 smithi181 bash[158455]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2024-03-30T14:09:38.497 INFO:journalctl@ceph.osd.6.smithi181.stdout:Mar 30 14:09:38 smithi181 bash[158455]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-6 --no-mon-config --dev /dev/mapper/vg_nvme-lv_2 2024-03-30T14:09:38.498 INFO:journalctl@ceph.osd.6.smithi181.stdout:Mar 30 14:09:38 smithi181 bash[158455]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_2 2024-03-30T14:09:38.498 INFO:journalctl@ceph.osd.6.smithi181.stdout:Mar 30 14:09:38 smithi181 bash[158455]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-1 2024-03-30T14:09:38.498 INFO:journalctl@ceph.osd.6.smithi181.stdout:Mar 30 14:09:38 smithi181 bash[158455]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-6/block 2024-03-30T14:09:38.498 INFO:journalctl@ceph.osd.6.smithi181.stdout:Mar 30 14:09:38 smithi181 bash[158455]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2024-03-30T14:09:38.498 INFO:journalctl@ceph.osd.6.smithi181.stdout:Mar 30 14:09:38 smithi181 bash[158455]: --> ceph-volume raw activate successful for osd ID: 6 2024-03-30T14:09:38.498 INFO:journalctl@ceph.osd.6.smithi181.stdout:Mar 30 14:09:38 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-6-activate[158486]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-6 --no-mon-config --dev /dev/mapper/vg_nvme-lv_2 2024-03-30T14:09:38.498 INFO:journalctl@ceph.osd.6.smithi181.stdout:Mar 30 14:09:38 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-6-activate[158486]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_2 2024-03-30T14:09:38.498 INFO:journalctl@ceph.osd.6.smithi181.stdout:Mar 30 14:09:38 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-6-activate[158486]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-1 2024-03-30T14:09:38.498 INFO:journalctl@ceph.osd.6.smithi181.stdout:Mar 30 14:09:38 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-6-activate[158486]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-6/block 2024-03-30T14:09:38.498 INFO:journalctl@ceph.osd.6.smithi181.stdout:Mar 30 14:09:38 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-6-activate[158486]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2024-03-30T14:09:38.498 INFO:journalctl@ceph.osd.6.smithi181.stdout:Mar 30 14:09:38 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-6-activate[158486]: --> ceph-volume raw activate successful for osd ID: 6 2024-03-30T14:09:38.498 INFO:journalctl@ceph.osd.6.smithi181.stdout:Mar 30 14:09:38 smithi181 podman[158455]: 2024-03-30 14:09:38.284034052 +0000 UTC m=+1.513688338 container died 7ff4cc4d6adadafc72c4a3b1863f42abbf0d636d3e5c730fdd1b1eb4bb23660c (image=quay.ceph.io/ceph-ci/ceph:4e50bbcdd1630c7760b708f3a5b4d38a121e66cb, name=ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-6-activate, RELEASE=squid-4e50bbc, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, GIT_CLEAN=True, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240326, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS) 2024-03-30T14:09:39.379 INFO:journalctl@ceph.osd.6.smithi181.stdout:Mar 30 14:09:39 smithi181 podman[158751]: 2024-03-30 14:09:39.027160043 +0000 UTC m=+0.738178958 container remove 7ff4cc4d6adadafc72c4a3b1863f42abbf0d636d3e5c730fdd1b1eb4bb23660c (image=quay.ceph.io/ceph-ci/ceph:4e50bbcdd1630c7760b708f3a5b4d38a121e66cb, name=ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-6-activate, org.label-schema.build-date=20240326, io.buildah.version=1.33.5, ceph=True, org.label-schema.license=GPLv2, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , RELEASE=squid-4e50bbc, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-03-30T14:09:40.078 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:39 smithi099 ceph-mon[137093]: from='client.25136 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T14:09:40.079 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:39 smithi099 ceph-mon[137093]: pgmap v219: 161 pgs: 12 active+undersized+degraded, 20 peering, 21 active+undersized, 108 active+clean; 585 KiB data, 214 MiB used, 715 GiB / 715 GiB avail; 41/627 objects degraded (6.539%) 2024-03-30T14:09:40.079 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:39 smithi099 ceph-mon[143401]: from='client.25136 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T14:09:40.079 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:39 smithi099 ceph-mon[143401]: pgmap v219: 161 pgs: 12 active+undersized+degraded, 20 peering, 21 active+undersized, 108 active+clean; 585 KiB data, 214 MiB used, 715 GiB / 715 GiB avail; 41/627 objects degraded (6.539%) 2024-03-30T14:09:40.247 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:39 smithi181 ceph-mon[115276]: from='client.25136 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T14:09:40.247 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:39 smithi181 ceph-mon[115276]: pgmap v219: 161 pgs: 12 active+undersized+degraded, 20 peering, 21 active+undersized, 108 active+clean; 585 KiB data, 214 MiB used, 715 GiB / 715 GiB avail; 41/627 objects degraded (6.539%) 2024-03-30T14:09:40.997 INFO:journalctl@ceph.osd.6.smithi181.stdout:Mar 30 14:09:40 smithi181 podman[158975]: 2024-03-30 14:09:40.608581387 +0000 UTC m=+0.021924315 image pull b0c4478f1d83795df4d538bf108aee5fac57194348fb16dcdbb3115f3e2fe95e quay.ceph.io/ceph-ci/ceph:4e50bbcdd1630c7760b708f3a5b4d38a121e66cb 2024-03-30T14:09:40.998 INFO:journalctl@ceph.osd.6.smithi181.stdout:Mar 30 14:09:40 smithi181 podman[158975]: 2024-03-30 14:09:40.727327373 +0000 UTC m=+0.140670276 container create 4a29dfeb4b16278d9a6230a521b56b7b1629c4ef4005d5ae0c685636acaa0e1d (image=quay.ceph.io/ceph-ci/ceph:4e50bbcdd1630c7760b708f3a5b4d38a121e66cb, name=ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-6, RELEASE=squid-4e50bbc, GIT_BRANCH=HEAD, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240326, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image) 2024-03-30T14:09:40.998 INFO:journalctl@ceph.osd.6.smithi181.stdout:Mar 30 14:09:40 smithi181 podman[158975]: 2024-03-30 14:09:40.912800625 +0000 UTC m=+0.326143539 container init 4a29dfeb4b16278d9a6230a521b56b7b1629c4ef4005d5ae0c685636acaa0e1d (image=quay.ceph.io/ceph-ci/ceph:4e50bbcdd1630c7760b708f3a5b4d38a121e66cb, name=ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-6, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240326, io.buildah.version=1.33.5, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, GIT_CLEAN=True, org.label-schema.vendor=CentOS, RELEASE=squid-4e50bbc, ceph=True, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=) 2024-03-30T14:09:40.998 INFO:journalctl@ceph.osd.6.smithi181.stdout:Mar 30 14:09:40 smithi181 podman[158975]: 2024-03-30 14:09:40.915836807 +0000 UTC m=+0.329179712 container start 4a29dfeb4b16278d9a6230a521b56b7b1629c4ef4005d5ae0c685636acaa0e1d (image=quay.ceph.io/ceph-ci/ceph:4e50bbcdd1630c7760b708f3a5b4d38a121e66cb, name=ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-6, org.label-schema.license=GPLv2, ceph=True, org.label-schema.vendor=CentOS, RELEASE=squid-4e50bbc, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, GIT_BRANCH=HEAD, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240326) 2024-03-30T14:09:40.998 INFO:journalctl@ceph.osd.6.smithi181.stdout:Mar 30 14:09:40 smithi181 ceph-osd[159020]: -- 172.21.15.181:0/1125629457 <== mon.2 v2:172.21.15.181:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55f78065f680 con 0x55f780628c00 2024-03-30T14:09:41.249 INFO:journalctl@ceph.osd.6.smithi181.stdout:Mar 30 14:09:41 smithi181 bash[158975]: 4a29dfeb4b16278d9a6230a521b56b7b1629c4ef4005d5ae0c685636acaa0e1d 2024-03-30T14:09:41.249 INFO:journalctl@ceph.osd.6.smithi181.stdout:Mar 30 14:09:41 smithi181 systemd[1]: Started Ceph osd.6 for 98ebaeb8-ee99-11ee-b647-cb9ed24678a4. 2024-03-30T14:09:41.598 INFO:journalctl@ceph.osd.6.smithi181.stdout:Mar 30 14:09:41 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-6[159016]: 2024-03-30T14:09:41.457+0000 7f40bb86a7c0 -1 Falling back to public interface 2024-03-30T14:09:41.599 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:41 smithi181 ceph-mon[115276]: pgmap v220: 161 pgs: 18 active+undersized+degraded, 35 active+undersized, 108 active+clean; 585 KiB data, 214 MiB used, 715 GiB / 715 GiB avail; 74/627 objects degraded (11.802%) 2024-03-30T14:09:41.599 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:41 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:09:41.599 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:41 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:09:41.599 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:41 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:09:41.599 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:41 smithi181 ceph-mon[115276]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg inactive, 3 pgs peering) 2024-03-30T14:09:41.599 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:41 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:09:41.599 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:41 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:09:41.599 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:41 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:09:41.599 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:41 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:09:41.600 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:41 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:09:41.600 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:41 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:09:41.600 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:41 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:09:41.600 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:41 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:09:41.600 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:41 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:09:41.600 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:41 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:09:41.600 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:41 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:09:41.600 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:41 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:09:41.600 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:41 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:09:41.600 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:41 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:09:41.600 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:41 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:09:41.828 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:41 smithi099 ceph-mon[143401]: pgmap v220: 161 pgs: 18 active+undersized+degraded, 35 active+undersized, 108 active+clean; 585 KiB data, 214 MiB used, 715 GiB / 715 GiB avail; 74/627 objects degraded (11.802%) 2024-03-30T14:09:41.828 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:41 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:09:41.828 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:41 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:09:41.828 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:41 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:09:41.829 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:41 smithi099 ceph-mon[143401]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg inactive, 3 pgs peering) 2024-03-30T14:09:41.829 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:41 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:09:41.829 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:41 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:09:41.829 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:41 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:09:41.829 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:41 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:09:41.829 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:41 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:09:41.829 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:41 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:09:41.829 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:41 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:09:41.829 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:41 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:09:41.829 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:41 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:09:41.829 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:41 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:09:41.829 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:41 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:09:41.829 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:41 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:09:41.830 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:41 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:09:41.830 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:41 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:09:41.830 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:41 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:09:41.830 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:41 smithi099 ceph-mon[137093]: pgmap v220: 161 pgs: 18 active+undersized+degraded, 35 active+undersized, 108 active+clean; 585 KiB data, 214 MiB used, 715 GiB / 715 GiB avail; 74/627 objects degraded (11.802%) 2024-03-30T14:09:41.830 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:41 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:09:41.830 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:41 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:09:41.830 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:41 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:09:41.830 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:41 smithi099 ceph-mon[137093]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg inactive, 3 pgs peering) 2024-03-30T14:09:41.830 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:41 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:09:41.831 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:41 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:09:41.831 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:41 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:09:41.831 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:41 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:09:41.831 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:41 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:09:41.831 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:41 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:09:41.831 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:41 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:09:41.831 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:41 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:09:41.831 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:41 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:09:41.831 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:41 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:09:41.831 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:41 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:09:41.831 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:41 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:09:41.831 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:41 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:09:41.831 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:41 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:09:41.832 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:41 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:09:42.738 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:42 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:09:42.738 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:42 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:09:42.738 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:42 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:09:42.738 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:42 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:09:42.738 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:42 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:09:42.738 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:42 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:09:42.738 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:42 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:09:42.738 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:42 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:09:42.738 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:42 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:09:42.738 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:42 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:09:42.738 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:42 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:09:42.739 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:42 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:09:42.739 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:42 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:09:42.739 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:42 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:09:42.739 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:42 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:09:42.739 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:42 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:09:42.739 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:42 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:09:42.739 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:42 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:09:42.739 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:42 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:09:42.739 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:42 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:09:42.739 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:42 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:09:42.739 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:42 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:09:42.739 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:42 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:09:42.739 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:42 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:09:42.739 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:42 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:09:42.739 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:42 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:09:42.740 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:42 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:09:42.740 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:42 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:09:42.740 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:42 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:09:42.740 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:42 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:09:42.740 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:42 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:09:42.740 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:42 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:09:42.740 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:42 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:09:42.740 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:42 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:09:42.740 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:42 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:09:42.740 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:42 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:09:42.740 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:42 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:09:42.740 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:42 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:09:42.740 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:42 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:09:42.740 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:42 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:09:42.741 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:42 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:09:42.741 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:42 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:09:42.741 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:42 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:09:42.741 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:42 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:09:42.741 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:42 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:09:42.741 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:42 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:09:42.741 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:42 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:09:42.741 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:42 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:09:42.741 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:42 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:09:42.741 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:42 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:09:42.741 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:42 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:09:42.741 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:42 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:09:42.741 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:42 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:09:42.741 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:42 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:09:42.741 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:42 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:09:42.828 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:42 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:09:42.828 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:42 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:09:42.828 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:42 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:09:42.828 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:42 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:09:42.828 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:42 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:09:42.828 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:42 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:09:42.829 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:42 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:09:42.829 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:42 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:09:42.829 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:42 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:09:42.829 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:42 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:09:42.829 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:42 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:09:42.829 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:42 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:09:42.829 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:42 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:09:42.829 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:42 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:09:42.829 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:42 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:09:42.829 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:42 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:09:42.829 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:42 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:09:42.829 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:42 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:09:42.829 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:42 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:09:42.829 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:42 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:09:42.829 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:42 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:09:42.830 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:42 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:09:42.830 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:42 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:09:42.830 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:42 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:09:42.830 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:42 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:09:42.830 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:42 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:09:42.830 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:42 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:09:42.830 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:42 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:09:42.830 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:42 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:09:42.830 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:42 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:09:42.830 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:42 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:09:42.831 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:42 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:09:42.831 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:42 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:09:42.831 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:42 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:09:42.831 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:42 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:09:42.831 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:42 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:09:42.831 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:42 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:09:42.831 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:42 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:09:42.831 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:42 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:09:42.831 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:42 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:09:42.831 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:42 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:09:42.831 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:42 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:09:42.831 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:42 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:09:42.831 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:42 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:09:42.831 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:42 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:09:42.831 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:42 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:09:42.832 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:42 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:09:42.832 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:42 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:09:42.832 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:42 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:09:42.832 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:42 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:09:42.832 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:42 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:09:42.832 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:42 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:09:42.832 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:42 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:09:42.832 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:42 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:09:42.832 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:42 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:09:42.832 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:42 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:09:42.832 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:42 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:09:42.832 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:42 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:09:42.832 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:42 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:09:42.832 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:42 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:09:42.832 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:42 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:09:42.833 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:42 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:09:42.833 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:42 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:09:42.833 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:42 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:09:42.833 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:42 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:09:42.833 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:42 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:09:42.833 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:42 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:09:42.833 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:42 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:09:42.833 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:42 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:09:42.833 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:42 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:09:42.833 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:42 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:09:42.833 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:42 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:09:42.833 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:42 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:09:42.833 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:42 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:09:42.833 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:42 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:09:42.833 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:42 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:09:42.833 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:42 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:09:42.834 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:42 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:09:42.834 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:42 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:09:42.834 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:42 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:09:42.834 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:42 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:09:42.834 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:42 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:09:42.834 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:42 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:09:42.834 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:42 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:09:42.834 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:42 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:09:42.834 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:42 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:09:42.835 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:42 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:09:42.835 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:42 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:09:42.835 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:42 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:09:42.835 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:42 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:09:42.835 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:42 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:09:42.835 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:42 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:09:42.835 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:42 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:09:42.835 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:42 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:09:42.835 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:42 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:09:42.835 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:42 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:09:42.835 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:42 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:09:42.835 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:42 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:09:42.835 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:42 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:09:42.835 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:42 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:09:42.835 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:42 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:09:42.836 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:42 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:09:42.836 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:42 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:09:42.836 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:42 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:09:42.836 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:42 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:09:42.836 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:42 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:09:42.836 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:42 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:09:42.836 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:42 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:09:42.836 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:42 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:09:42.836 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:42 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:09:43.747 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:43 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:09:43.748 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:43 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:09:43.748 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:43 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:09:43.748 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:43 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:09:43.748 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:43 smithi181 ceph-mon[115276]: pgmap v221: 161 pgs: 18 active+undersized+degraded, 35 active+undersized, 108 active+clean; 585 KiB data, 214 MiB used, 715 GiB / 715 GiB avail; 74/627 objects degraded (11.802%) 2024-03-30T14:09:43.748 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:43 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:09:43.748 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:43 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:09:43.748 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:43 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:09:43.748 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:43 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:09:43.748 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:43 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:09:43.748 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:43 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:09:43.748 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:43 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:09:43.748 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:43 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:09:43.748 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:43 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:09:43.749 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:43 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:09:43.749 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:43 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:09:43.749 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:43 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:09:43.749 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:43 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:09:43.749 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:43 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:09:43.749 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:43 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:09:43.749 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:43 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:09:43.749 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:43 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:09:43.749 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:43 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:09:43.749 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:43 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:09:43.749 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:43 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:09:43.749 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:43 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:09:43.749 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:43 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:09:43.749 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:43 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:09:43.749 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:43 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:09:43.750 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:43 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:09:43.750 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:43 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:09:43.750 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:43 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:09:43.750 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:43 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:09:43.750 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:43 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:09:43.750 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:43 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:09:43.750 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:43 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:09:43.750 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:43 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:09:43.750 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:43 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:09:43.750 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:43 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:09:43.750 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:43 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:09:43.750 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:43 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:09:43.750 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:43 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:09:43.751 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:43 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:09:43.751 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:43 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:09:43.751 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:43 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:09:43.751 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:43 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:09:43.751 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:43 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:09:43.751 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:43 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:09:43.751 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:43 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:09:43.751 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:43 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:09:43.751 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:43 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:09:43.751 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:43 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:09:43.751 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:43 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:09:43.751 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:43 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:09:43.751 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:43 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:09:43.751 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:43 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:09:43.751 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:43 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:09:43.752 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:43 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:09:43.752 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:43 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:09:43.752 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:43 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:09:43.752 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:43 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:09:43.752 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:43 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:09:43.828 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 14:09:43 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[71049]: 2024-03-30T14:09:43.527+0000 7f3c008ec700 -1 mgr.server reply reply (16) Device or resource busy unsafe to stop osd(s) at this time (20 PGs are or would become offline) 2024-03-30T14:09:43.828 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:43 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:09:43.828 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:43 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:09:43.828 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:43 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:09:43.829 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:43 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:09:43.829 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:43 smithi099 ceph-mon[137093]: pgmap v221: 161 pgs: 18 active+undersized+degraded, 35 active+undersized, 108 active+clean; 585 KiB data, 214 MiB used, 715 GiB / 715 GiB avail; 74/627 objects degraded (11.802%) 2024-03-30T14:09:43.829 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:43 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:09:43.829 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:43 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:09:43.829 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:43 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:09:43.829 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:43 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:09:43.829 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:43 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:09:43.829 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:43 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:09:43.829 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:43 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:09:43.829 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:43 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:09:43.829 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:43 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:09:43.829 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:43 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:09:43.829 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:43 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:09:43.830 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:43 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:09:43.830 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:43 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:09:43.830 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:43 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:09:43.830 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:43 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:09:43.830 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:43 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:09:43.830 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:43 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:09:43.830 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:43 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:09:43.830 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:43 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:09:43.830 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:43 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:09:43.830 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:43 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:09:43.830 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:43 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:09:43.830 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:43 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:09:43.830 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:43 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:09:43.831 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:43 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:09:43.831 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:43 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:09:43.831 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:43 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:09:43.831 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:43 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:09:43.831 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:43 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:09:43.831 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:43 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:09:43.831 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:43 smithi099 ceph-mon[143401]: pgmap v221: 161 pgs: 18 active+undersized+degraded, 35 active+undersized, 108 active+clean; 585 KiB data, 214 MiB used, 715 GiB / 715 GiB avail; 74/627 objects degraded (11.802%) 2024-03-30T14:09:43.831 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:43 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:09:43.831 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:43 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:09:43.831 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:43 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:09:43.832 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:43 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:09:43.832 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:43 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:09:43.832 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:43 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:09:43.832 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:43 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:09:43.832 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:43 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:09:43.832 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:43 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:09:43.832 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:43 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:09:43.832 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:43 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:09:43.832 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:43 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:09:43.832 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:43 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:09:43.832 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:43 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:09:43.832 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:43 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:09:43.832 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:43 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:09:43.832 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:43 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:09:43.833 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:43 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:09:43.833 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:43 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:09:43.833 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:43 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:09:43.833 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:43 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:09:43.833 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:43 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:09:43.833 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:43 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:09:43.833 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:43 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:09:43.833 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:43 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:09:43.833 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:43 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:09:43.833 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:43 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:09:43.833 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:43 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:09:43.834 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:43 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:09:43.834 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:43 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:09:43.834 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:43 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:09:43.834 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:43 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:09:43.834 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:43 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:09:43.834 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:43 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:09:43.834 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:43 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:09:43.834 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:43 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:09:43.834 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:43 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:09:43.834 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:43 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:09:43.834 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:43 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:09:43.834 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:43 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:09:43.834 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:43 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:09:43.835 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:43 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:09:43.835 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:43 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:09:43.835 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:43 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:09:43.835 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:43 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:09:43.835 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:43 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:09:43.835 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:43 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:09:43.835 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:43 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:09:43.835 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:43 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:09:43.835 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:43 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:09:43.835 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:43 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:09:43.835 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:43 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:09:43.835 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:43 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:09:43.835 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:43 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:09:43.835 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:43 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:09:43.835 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:43 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:09:43.835 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:43 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:09:43.836 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:43 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:09:43.836 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:43 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:09:43.836 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:43 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:09:43.836 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:43 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:09:43.836 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:43 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:09:43.836 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:43 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:09:43.836 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:43 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:09:43.836 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:43 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:09:43.836 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:43 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:09:43.836 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:43 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:09:43.836 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:43 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:09:43.836 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:43 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:09:43.836 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:43 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:09:43.837 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:43 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:09:43.837 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:43 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:09:43.837 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:43 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:09:43.837 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:43 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:09:43.837 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:43 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:09:43.837 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:43 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:09:43.837 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:43 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:09:43.837 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:43 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:09:43.837 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:43 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:09:43.837 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:43 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:09:43.837 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:43 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:09:43.837 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:43 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:09:43.837 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:43 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:09:43.838 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:43 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:09:43.838 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:43 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:09:43.838 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:43 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:09:43.838 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:43 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:09:43.838 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:43 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:09:44.462 INFO:journalctl@ceph.osd.6.smithi181.stdout:Mar 30 14:09:44 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-6[159016]: 2024-03-30T14:09:44.194+0000 7f40bb86a7c0 -1 osd.6 0 read_superblock omap replica is missing. 2024-03-30T14:09:44.462 INFO:journalctl@ceph.osd.6.smithi181.stdout:Mar 30 14:09:44 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-6[159016]: 2024-03-30T14:09:44.223+0000 7f40bb86a7c0 -1 osd.6 143 log_to_monitors true 2024-03-30T14:09:44.661 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:44 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:09:44.661 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:44 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:09:44.661 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:44 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:09:44.661 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:44 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:09:44.661 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:44 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:09:44.662 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:44 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:09:44.662 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:44 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:09:44.662 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:44 smithi099 ceph-mon[137093]: pgmap v222: 161 pgs: 18 active+undersized+degraded, 35 active+undersized, 108 active+clean; 585 KiB data, 214 MiB used, 715 GiB / 715 GiB avail; 550 B/s rd, 0 op/s; 74/627 objects degraded (11.802%) 2024-03-30T14:09:44.662 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:44 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:09:44.662 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:44 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:09:44.662 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:44 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:09:44.662 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:44 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:09:44.662 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:44 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "osd ok-to-stop", "ids": ["7"], "max": 16}]: dispatch 2024-03-30T14:09:44.662 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:44 smithi099 ceph-mon[137093]: from='mon.2 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["7"], "max": 16}]: dispatch 2024-03-30T14:09:44.662 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:44 smithi099 ceph-mon[137093]: Upgrade: unsafe to stop osd(s) at this time (20 PGs are or would become offline) 2024-03-30T14:09:44.662 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:44 smithi099 ceph-mon[137093]: from='osd.6 [v2:172.21.15.181:6816/37569499,v1:172.21.15.181:6817/37569499]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-03-30T14:09:44.662 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:44 smithi099 ceph-mon[137093]: from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-03-30T14:09:44.662 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:44 smithi099 ceph-mon[137093]: Health check failed: 1 failed cephadm daemon(s) (CEPHADM_FAILED_DAEMON) 2024-03-30T14:09:44.663 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:44 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:09:44.663 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:44 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:09:44.663 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:44 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:09:44.663 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:44 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:09:44.663 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:44 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:09:44.663 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:44 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:09:44.663 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:44 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:09:44.663 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:44 smithi099 ceph-mon[143401]: pgmap v222: 161 pgs: 18 active+undersized+degraded, 35 active+undersized, 108 active+clean; 585 KiB data, 214 MiB used, 715 GiB / 715 GiB avail; 550 B/s rd, 0 op/s; 74/627 objects degraded (11.802%) 2024-03-30T14:09:44.663 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:44 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:09:44.663 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:44 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:09:44.663 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:44 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:09:44.663 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:44 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:09:44.663 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:44 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "osd ok-to-stop", "ids": ["7"], "max": 16}]: dispatch 2024-03-30T14:09:44.664 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:44 smithi099 ceph-mon[143401]: from='mon.2 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["7"], "max": 16}]: dispatch 2024-03-30T14:09:44.664 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:44 smithi099 ceph-mon[143401]: Upgrade: unsafe to stop osd(s) at this time (20 PGs are or would become offline) 2024-03-30T14:09:44.664 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:44 smithi099 ceph-mon[143401]: from='osd.6 [v2:172.21.15.181:6816/37569499,v1:172.21.15.181:6817/37569499]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-03-30T14:09:44.664 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:44 smithi099 ceph-mon[143401]: from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-03-30T14:09:44.664 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:44 smithi099 ceph-mon[143401]: Health check failed: 1 failed cephadm daemon(s) (CEPHADM_FAILED_DAEMON) 2024-03-30T14:09:44.747 INFO:journalctl@ceph.osd.6.smithi181.stdout:Mar 30 14:09:44 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-6[159016]: 2024-03-30T14:09:44.506+0000 7f40accc2700 -1 osd.6 143 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-03-30T14:09:44.747 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:44 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:09:44.747 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:44 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:09:44.747 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:44 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:09:44.748 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:44 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:09:44.748 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:44 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:09:44.748 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:44 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:09:44.748 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:44 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:09:44.748 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:44 smithi181 ceph-mon[115276]: pgmap v222: 161 pgs: 18 active+undersized+degraded, 35 active+undersized, 108 active+clean; 585 KiB data, 214 MiB used, 715 GiB / 715 GiB avail; 550 B/s rd, 0 op/s; 74/627 objects degraded (11.802%) 2024-03-30T14:09:44.748 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:44 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:09:44.748 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:44 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:09:44.748 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:44 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:09:44.748 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:44 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:09:44.748 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:44 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "osd ok-to-stop", "ids": ["7"], "max": 16}]: dispatch 2024-03-30T14:09:44.748 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:44 smithi181 ceph-mon[115276]: from='mon.2 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["7"], "max": 16}]: dispatch 2024-03-30T14:09:44.749 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:44 smithi181 ceph-mon[115276]: Upgrade: unsafe to stop osd(s) at this time (20 PGs are or would become offline) 2024-03-30T14:09:44.749 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:44 smithi181 ceph-mon[115276]: from='osd.6 [v2:172.21.15.181:6816/37569499,v1:172.21.15.181:6817/37569499]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-03-30T14:09:44.749 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:44 smithi181 ceph-mon[115276]: from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-03-30T14:09:44.749 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:44 smithi181 ceph-mon[115276]: Health check failed: 1 failed cephadm daemon(s) (CEPHADM_FAILED_DAEMON) 2024-03-30T14:09:45.041 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 14:09:44 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[71049]: ::ffff:172.21.15.181 - - [30/Mar/2024:14:09:44] "GET /metrics HTTP/1.1" 200 38278 "" "Prometheus/2.43.0" 2024-03-30T14:09:45.747 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:45 smithi181 ceph-mon[115276]: from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-03-30T14:09:45.747 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:45 smithi181 ceph-mon[115276]: failed to encode map e146 with expected crc 2024-03-30T14:09:45.748 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:45 smithi181 ceph-mon[115276]: from='osd.6 [v2:172.21.15.181:6816/37569499,v1:172.21.15.181:6817/37569499]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi181", "root=default"]}]: dispatch 2024-03-30T14:09:45.748 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:45 smithi181 ceph-mon[115276]: osdmap e146: 8 total, 7 up, 8 in 2024-03-30T14:09:45.748 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:45 smithi181 ceph-mon[115276]: from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi181", "root=default"]}]: dispatch 2024-03-30T14:09:45.748 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:45 smithi181 ceph-mon[115276]: Health check update: Degraded data redundancy: 74/627 objects degraded (11.802%), 18 pgs degraded (PG_DEGRADED) 2024-03-30T14:09:45.751 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:45 smithi099 ceph-mon[137093]: from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-03-30T14:09:45.752 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:45 smithi099 ceph-mon[137093]: failed to encode map e146 with expected crc 2024-03-30T14:09:45.752 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:45 smithi099 ceph-mon[137093]: from='osd.6 [v2:172.21.15.181:6816/37569499,v1:172.21.15.181:6817/37569499]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi181", "root=default"]}]: dispatch 2024-03-30T14:09:45.752 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:45 smithi099 ceph-mon[137093]: osdmap e146: 8 total, 7 up, 8 in 2024-03-30T14:09:45.752 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:45 smithi099 ceph-mon[137093]: from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi181", "root=default"]}]: dispatch 2024-03-30T14:09:45.752 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:45 smithi099 ceph-mon[137093]: Health check update: Degraded data redundancy: 74/627 objects degraded (11.802%), 18 pgs degraded (PG_DEGRADED) 2024-03-30T14:09:45.752 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:45 smithi099 ceph-mon[143401]: from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-03-30T14:09:45.752 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:45 smithi099 ceph-mon[143401]: failed to encode map e146 with expected crc 2024-03-30T14:09:45.752 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:45 smithi099 ceph-mon[143401]: from='osd.6 [v2:172.21.15.181:6816/37569499,v1:172.21.15.181:6817/37569499]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi181", "root=default"]}]: dispatch 2024-03-30T14:09:45.752 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:45 smithi099 ceph-mon[143401]: osdmap e146: 8 total, 7 up, 8 in 2024-03-30T14:09:45.752 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:45 smithi099 ceph-mon[143401]: from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi181", "root=default"]}]: dispatch 2024-03-30T14:09:45.752 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:45 smithi099 ceph-mon[143401]: Health check update: Degraded data redundancy: 74/627 objects degraded (11.802%), 18 pgs degraded (PG_DEGRADED) 2024-03-30T14:09:46.747 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:46 smithi181 ceph-mon[115276]: pgmap v224: 161 pgs: 18 active+undersized+degraded, 35 active+undersized, 108 active+clean; 585 KiB data, 229 MiB used, 715 GiB / 715 GiB avail; 550 B/s rd, 0 op/s; 74/627 objects degraded (11.802%) 2024-03-30T14:09:46.747 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:46 smithi181 ceph-mon[115276]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-03-30T14:09:46.747 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:46 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-03-30T14:09:46.747 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:46 smithi181 ceph-mon[115276]: osd.6 [v2:172.21.15.181:6816/37569499,v1:172.21.15.181:6817/37569499] boot 2024-03-30T14:09:46.747 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:46 smithi181 ceph-mon[115276]: osdmap e147: 8 total, 8 up, 8 in 2024-03-30T14:09:46.747 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:46 smithi181 ceph-mon[115276]: failed to encode map e147 with expected crc 2024-03-30T14:09:46.747 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:46 smithi181 ceph-mon[115276]: failed to encode map e147 with expected crc 2024-03-30T14:09:46.748 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:46 smithi181 ceph-mon[115276]: failed to encode map e147 with expected crc 2024-03-30T14:09:46.748 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:46 smithi181 ceph-mon[115276]: failed to encode map e147 with expected crc 2024-03-30T14:09:46.748 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:46 smithi181 ceph-mon[115276]: failed to encode map e147 with expected crc 2024-03-30T14:09:46.748 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:46 smithi181 ceph-mon[115276]: osdmap e148: 8 total, 8 up, 8 in 2024-03-30T14:09:46.807 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:46 smithi099 ceph-mon[143401]: pgmap v224: 161 pgs: 18 active+undersized+degraded, 35 active+undersized, 108 active+clean; 585 KiB data, 229 MiB used, 715 GiB / 715 GiB avail; 550 B/s rd, 0 op/s; 74/627 objects degraded (11.802%) 2024-03-30T14:09:46.807 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:46 smithi099 ceph-mon[143401]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-03-30T14:09:46.807 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:46 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-03-30T14:09:46.807 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:46 smithi099 ceph-mon[143401]: osd.6 [v2:172.21.15.181:6816/37569499,v1:172.21.15.181:6817/37569499] boot 2024-03-30T14:09:46.807 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:46 smithi099 ceph-mon[143401]: osdmap e147: 8 total, 8 up, 8 in 2024-03-30T14:09:46.807 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:46 smithi099 ceph-mon[143401]: failed to encode map e147 with expected crc 2024-03-30T14:09:46.807 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:46 smithi099 ceph-mon[143401]: failed to encode map e147 with expected crc 2024-03-30T14:09:46.807 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:46 smithi099 ceph-mon[143401]: failed to encode map e147 with expected crc 2024-03-30T14:09:46.808 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:46 smithi099 ceph-mon[143401]: failed to encode map e147 with expected crc 2024-03-30T14:09:46.808 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:46 smithi099 ceph-mon[143401]: failed to encode map e147 with expected crc 2024-03-30T14:09:46.808 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:46 smithi099 ceph-mon[143401]: osdmap e148: 8 total, 8 up, 8 in 2024-03-30T14:09:46.808 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:46 smithi099 ceph-mon[137093]: pgmap v224: 161 pgs: 18 active+undersized+degraded, 35 active+undersized, 108 active+clean; 585 KiB data, 229 MiB used, 715 GiB / 715 GiB avail; 550 B/s rd, 0 op/s; 74/627 objects degraded (11.802%) 2024-03-30T14:09:46.808 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:46 smithi099 ceph-mon[137093]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-03-30T14:09:46.808 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:46 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-03-30T14:09:46.808 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:46 smithi099 ceph-mon[137093]: osd.6 [v2:172.21.15.181:6816/37569499,v1:172.21.15.181:6817/37569499] boot 2024-03-30T14:09:46.808 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:46 smithi099 ceph-mon[137093]: osdmap e147: 8 total, 8 up, 8 in 2024-03-30T14:09:46.808 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:46 smithi099 ceph-mon[137093]: failed to encode map e147 with expected crc 2024-03-30T14:09:46.808 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:46 smithi099 ceph-mon[137093]: failed to encode map e147 with expected crc 2024-03-30T14:09:46.808 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:46 smithi099 ceph-mon[137093]: failed to encode map e147 with expected crc 2024-03-30T14:09:46.808 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:46 smithi099 ceph-mon[137093]: failed to encode map e147 with expected crc 2024-03-30T14:09:46.809 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:46 smithi099 ceph-mon[137093]: failed to encode map e147 with expected crc 2024-03-30T14:09:46.809 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:46 smithi099 ceph-mon[137093]: osdmap e148: 8 total, 8 up, 8 in 2024-03-30T14:09:47.578 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:47 smithi099 ceph-mon[137093]: failed to encode map e148 with expected crc 2024-03-30T14:09:47.578 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:47 smithi099 ceph-mon[137093]: failed to encode map e148 with expected crc 2024-03-30T14:09:47.578 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:47 smithi099 ceph-mon[137093]: failed to encode map e148 with expected crc 2024-03-30T14:09:47.578 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:47 smithi099 ceph-mon[143401]: failed to encode map e148 with expected crc 2024-03-30T14:09:47.578 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:47 smithi099 ceph-mon[143401]: failed to encode map e148 with expected crc 2024-03-30T14:09:47.578 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:47 smithi099 ceph-mon[143401]: failed to encode map e148 with expected crc 2024-03-30T14:09:47.747 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:47 smithi181 ceph-mon[115276]: failed to encode map e148 with expected crc 2024-03-30T14:09:47.747 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:47 smithi181 ceph-mon[115276]: failed to encode map e148 with expected crc 2024-03-30T14:09:47.747 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:47 smithi181 ceph-mon[115276]: failed to encode map e148 with expected crc 2024-03-30T14:09:48.723 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:48 smithi181 ceph-mon[115276]: pgmap v227: 161 pgs: 10 peering, 11 active+undersized+degraded, 25 active+undersized, 115 active+clean; 585 KiB data, 229 MiB used, 715 GiB / 715 GiB avail; 965 B/s rd, 0 op/s; 51/627 objects degraded (8.134%) 2024-03-30T14:09:48.828 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:48 smithi099 ceph-mon[143401]: pgmap v227: 161 pgs: 10 peering, 11 active+undersized+degraded, 25 active+undersized, 115 active+clean; 585 KiB data, 229 MiB used, 715 GiB / 715 GiB avail; 965 B/s rd, 0 op/s; 51/627 objects degraded (8.134%) 2024-03-30T14:09:48.828 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:48 smithi099 ceph-mon[137093]: pgmap v227: 161 pgs: 10 peering, 11 active+undersized+degraded, 25 active+undersized, 115 active+clean; 585 KiB data, 229 MiB used, 715 GiB / 715 GiB avail; 965 B/s rd, 0 op/s; 51/627 objects degraded (8.134%) 2024-03-30T14:09:49.747 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:49 smithi181 ceph-mon[115276]: from='client.25136 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T14:09:49.828 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:49 smithi099 ceph-mon[137093]: from='client.25136 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T14:09:49.828 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:49 smithi099 ceph-mon[143401]: from='client.25136 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T14:09:50.747 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:50 smithi181 ceph-mon[115276]: pgmap v228: 161 pgs: 10 peering, 4 active+undersized+degraded, 10 active+undersized, 137 active+clean; 585 KiB data, 233 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s; 13/627 objects degraded (2.073%) 2024-03-30T14:09:50.747 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:50 smithi181 ceph-mon[115276]: Health check update: Degraded data redundancy: 13/627 objects degraded (2.073%), 4 pgs degraded (PG_DEGRADED) 2024-03-30T14:09:50.828 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:50 smithi099 ceph-mon[137093]: pgmap v228: 161 pgs: 10 peering, 4 active+undersized+degraded, 10 active+undersized, 137 active+clean; 585 KiB data, 233 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s; 13/627 objects degraded (2.073%) 2024-03-30T14:09:50.828 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:50 smithi099 ceph-mon[137093]: Health check update: Degraded data redundancy: 13/627 objects degraded (2.073%), 4 pgs degraded (PG_DEGRADED) 2024-03-30T14:09:50.828 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:50 smithi099 ceph-mon[143401]: pgmap v228: 161 pgs: 10 peering, 4 active+undersized+degraded, 10 active+undersized, 137 active+clean; 585 KiB data, 233 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s; 13/627 objects degraded (2.073%) 2024-03-30T14:09:50.828 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:50 smithi099 ceph-mon[143401]: Health check update: Degraded data redundancy: 13/627 objects degraded (2.073%), 4 pgs degraded (PG_DEGRADED) 2024-03-30T14:09:51.828 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:51 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:09:51.828 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:51 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:09:51.828 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:51 smithi099 ceph-mon[137093]: pgmap v229: 161 pgs: 10 peering, 151 active+clean; 585 KiB data, 234 MiB used, 715 GiB / 715 GiB avail; 840 B/s rd, 0 op/s 2024-03-30T14:09:51.828 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:51 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:09:51.828 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:51 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:09:51.828 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:51 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:09:51.828 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:51 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:09:51.829 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:51 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:09:51.829 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:51 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:09:51.829 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:51 smithi099 ceph-mon[143401]: pgmap v229: 161 pgs: 10 peering, 151 active+clean; 585 KiB data, 234 MiB used, 715 GiB / 715 GiB avail; 840 B/s rd, 0 op/s 2024-03-30T14:09:51.829 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:51 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:09:51.829 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:51 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:09:51.829 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:51 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:09:51.829 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:51 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:09:51.997 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:51 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:09:51.997 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:51 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:09:51.997 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:51 smithi181 ceph-mon[115276]: pgmap v229: 161 pgs: 10 peering, 151 active+clean; 585 KiB data, 234 MiB used, 715 GiB / 715 GiB avail; 840 B/s rd, 0 op/s 2024-03-30T14:09:51.997 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:51 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:09:51.997 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:51 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:09:51.997 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:51 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:09:51.998 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:51 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:09:52.828 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:52 smithi099 ceph-mon[143401]: Health check cleared: CEPHADM_FAILED_DAEMON (was: 1 failed cephadm daemon(s)) 2024-03-30T14:09:52.828 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:52 smithi099 ceph-mon[143401]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 13/627 objects degraded (2.073%), 4 pgs degraded) 2024-03-30T14:09:52.828 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:52 smithi099 ceph-mon[143401]: Cluster is now healthy 2024-03-30T14:09:52.828 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:52 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:09:52.828 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:52 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T14:09:52.828 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:52 smithi099 ceph-mon[137093]: Health check cleared: CEPHADM_FAILED_DAEMON (was: 1 failed cephadm daemon(s)) 2024-03-30T14:09:52.828 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:52 smithi099 ceph-mon[137093]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 13/627 objects degraded (2.073%), 4 pgs degraded) 2024-03-30T14:09:52.829 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:52 smithi099 ceph-mon[137093]: Cluster is now healthy 2024-03-30T14:09:52.829 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:52 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:09:52.829 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:52 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T14:09:52.997 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:52 smithi181 ceph-mon[115276]: Health check cleared: CEPHADM_FAILED_DAEMON (was: 1 failed cephadm daemon(s)) 2024-03-30T14:09:52.997 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:52 smithi181 ceph-mon[115276]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 13/627 objects degraded (2.073%), 4 pgs degraded) 2024-03-30T14:09:52.997 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:52 smithi181 ceph-mon[115276]: Cluster is now healthy 2024-03-30T14:09:52.997 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:52 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:09:52.997 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:52 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T14:09:53.828 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:53 smithi099 ceph-mon[137093]: pgmap v230: 161 pgs: 161 active+clean; 585 KiB data, 234 MiB used, 715 GiB / 715 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-03-30T14:09:53.828 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:53 smithi099 ceph-mon[143401]: pgmap v230: 161 pgs: 161 active+clean; 585 KiB data, 234 MiB used, 715 GiB / 715 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-03-30T14:09:53.997 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:53 smithi181 ceph-mon[115276]: pgmap v230: 161 pgs: 161 active+clean; 585 KiB data, 234 MiB used, 715 GiB / 715 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-03-30T14:09:55.078 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 14:09:54 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[71049]: ::ffff:172.21.15.181 - - [30/Mar/2024:14:09:54] "GET /metrics HTTP/1.1" 200 38287 "" "Prometheus/2.43.0" 2024-03-30T14:09:55.997 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:55 smithi181 ceph-mon[115276]: pgmap v231: 161 pgs: 161 active+clean; 585 KiB data, 234 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-03-30T14:09:56.078 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:55 smithi099 ceph-mon[143401]: pgmap v231: 161 pgs: 161 active+clean; 585 KiB data, 234 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-03-30T14:09:56.078 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:55 smithi099 ceph-mon[137093]: pgmap v231: 161 pgs: 161 active+clean; 585 KiB data, 234 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-03-30T14:09:57.997 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:57 smithi181 ceph-mon[115276]: pgmap v232: 161 pgs: 161 active+clean; 585 KiB data, 234 MiB used, 715 GiB / 715 GiB avail; 1014 B/s rd, 0 op/s 2024-03-30T14:09:58.022 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:57 smithi099 ceph-mon[137093]: pgmap v232: 161 pgs: 161 active+clean; 585 KiB data, 234 MiB used, 715 GiB / 715 GiB avail; 1014 B/s rd, 0 op/s 2024-03-30T14:09:58.023 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:57 smithi099 ceph-mon[143401]: pgmap v232: 161 pgs: 161 active+clean; 585 KiB data, 234 MiB used, 715 GiB / 715 GiB avail; 1014 B/s rd, 0 op/s 2024-03-30T14:09:58.997 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:58 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "osd ok-to-stop", "ids": ["7"], "max": 16}]: dispatch 2024-03-30T14:09:59.006 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:58 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "osd ok-to-stop", "ids": ["7"], "max": 16}]: dispatch 2024-03-30T14:09:59.006 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:58 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "osd ok-to-stop", "ids": ["7"], "max": 16}]: dispatch 2024-03-30T14:09:59.747 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:59 smithi181 ceph-mon[115276]: from='client.25136 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T14:09:59.747 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:59 smithi181 ceph-mon[115276]: from='mon.2 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["7"], "max": 16}]: dispatch 2024-03-30T14:09:59.747 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:59 smithi181 ceph-mon[115276]: Upgrade: osd.7 is safe to restart 2024-03-30T14:09:59.747 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:09:59 smithi181 ceph-mon[115276]: pgmap v233: 161 pgs: 161 active+clean; 585 KiB data, 234 MiB used, 715 GiB / 715 GiB avail; 920 B/s rd, 0 op/s 2024-03-30T14:10:00.078 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:59 smithi099 ceph-mon[137093]: from='client.25136 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T14:10:00.078 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:59 smithi099 ceph-mon[137093]: from='mon.2 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["7"], "max": 16}]: dispatch 2024-03-30T14:10:00.078 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:59 smithi099 ceph-mon[137093]: Upgrade: osd.7 is safe to restart 2024-03-30T14:10:00.078 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:09:59 smithi099 ceph-mon[137093]: pgmap v233: 161 pgs: 161 active+clean; 585 KiB data, 234 MiB used, 715 GiB / 715 GiB avail; 920 B/s rd, 0 op/s 2024-03-30T14:10:00.079 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:59 smithi099 ceph-mon[143401]: from='client.25136 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T14:10:00.079 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:59 smithi099 ceph-mon[143401]: from='mon.2 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["7"], "max": 16}]: dispatch 2024-03-30T14:10:00.079 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:59 smithi099 ceph-mon[143401]: Upgrade: osd.7 is safe to restart 2024-03-30T14:10:00.079 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:09:59 smithi099 ceph-mon[143401]: pgmap v233: 161 pgs: 161 active+clean; 585 KiB data, 234 MiB used, 715 GiB / 715 GiB avail; 920 B/s rd, 0 op/s 2024-03-30T14:10:00.835 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:10:00 smithi181 ceph-mon[115276]: overall HEALTH_OK 2024-03-30T14:10:00.835 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:10:00 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:10:00.835 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:10:00 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2024-03-30T14:10:00.835 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:10:00 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:10:01.078 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:10:00 smithi099 ceph-mon[137093]: overall HEALTH_OK 2024-03-30T14:10:01.078 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:10:00 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:10:01.078 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:10:00 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2024-03-30T14:10:01.078 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:10:00 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:10:01.078 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:10:00 smithi099 ceph-mon[143401]: overall HEALTH_OK 2024-03-30T14:10:01.078 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:10:00 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:10:01.078 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:10:00 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2024-03-30T14:10:01.079 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:10:00 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:10:01.234 INFO:teuthology.orchestra.run.smithi099.stdout:true 2024-03-30T14:10:01.881 INFO:teuthology.orchestra.run.smithi099.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-03-30T14:10:01.882 INFO:teuthology.orchestra.run.smithi099.stdout:agent.smithi099 smithi099 running 18s ago 38m - - 2024-03-30T14:10:01.882 INFO:teuthology.orchestra.run.smithi099.stdout:agent.smithi181 smithi181 running 11s ago 38m - - 2024-03-30T14:10:01.882 INFO:teuthology.orchestra.run.smithi099.stdout:alertmanager.a smithi099 *:9093,9094 running (8m) 18s ago 32m 26.9M - 0.25.0 c8568f914cd2 08735152b67d 2024-03-30T14:10:01.882 INFO:teuthology.orchestra.run.smithi099.stdout:grafana.a smithi181 *:3000 running (8m) 11s ago 32m 78.9M - 9.4.12 2bacad6d85d8 d599aa7730d6 2024-03-30T14:10:01.882 INFO:teuthology.orchestra.run.smithi099.stdout:iscsi.foo.smithi099.qyjuvr smithi099 running (11m) 18s ago 31m 61.9M - 3.5 e1d6a67b021e 2f859af6bc2a 2024-03-30T14:10:01.882 INFO:teuthology.orchestra.run.smithi099.stdout:mgr.x smithi181 *:8443,9283,8765 running (10m) 11s ago 37m 451M - 19.0.0-1967-g4e50bbcd b0c4478f1d83 f269106f7913 2024-03-30T14:10:01.882 INFO:teuthology.orchestra.run.smithi099.stdout:mgr.y smithi099 *:8443,9283,8765 running (21m) 18s ago 39m 527M - 19.0.0-1967-g4e50bbcd b0c4478f1d83 0d464b8c1d18 2024-03-30T14:10:01.882 INFO:teuthology.orchestra.run.smithi099.stdout:mon.a smithi099 running (6m) 18s ago 39m 60.9M 2048M 19.0.0-1967-g4e50bbcd b0c4478f1d83 f19388464dfd 2024-03-30T14:10:01.882 INFO:teuthology.orchestra.run.smithi099.stdout:mon.b smithi181 running (7m) 11s ago 37m 59.8M 2048M 19.0.0-1967-g4e50bbcd b0c4478f1d83 0468ed087cdd 2024-03-30T14:10:01.882 INFO:teuthology.orchestra.run.smithi099.stdout:mon.c smithi099 running (5m) 18s ago 37m 50.0M 2048M 19.0.0-1967-g4e50bbcd b0c4478f1d83 731056a2fea6 2024-03-30T14:10:01.882 INFO:teuthology.orchestra.run.smithi099.stdout:node-exporter.a smithi099 *:9100 running (9m) 18s ago 33m 16.5M - 1.5.0 0da6a335fe13 4a3f1f6e7068 2024-03-30T14:10:01.882 INFO:teuthology.orchestra.run.smithi099.stdout:node-exporter.b smithi181 *:9100 running (9m) 11s ago 33m 17.0M - 1.5.0 0da6a335fe13 acea317b5f5d 2024-03-30T14:10:01.882 INFO:teuthology.orchestra.run.smithi099.stdout:osd.0 smithi099 running (4m) 18s ago 37m 57.6M 4096M 19.0.0-1967-g4e50bbcd b0c4478f1d83 d97d48cb3314 2024-03-30T14:10:01.883 INFO:teuthology.orchestra.run.smithi099.stdout:osd.1 smithi099 running (3m) 18s ago 36m 60.8M 4096M 19.0.0-1967-g4e50bbcd b0c4478f1d83 a843295ce83b 2024-03-30T14:10:01.883 INFO:teuthology.orchestra.run.smithi099.stdout:osd.2 smithi099 running (2m) 18s ago 36m 46.4M 4096M 19.0.0-1967-g4e50bbcd b0c4478f1d83 18304adfb0d0 2024-03-30T14:10:01.883 INFO:teuthology.orchestra.run.smithi099.stdout:osd.3 smithi099 running (115s) 18s ago 36m 46.9M 4096M 19.0.0-1967-g4e50bbcd b0c4478f1d83 9b38d79f070e 2024-03-30T14:10:01.883 INFO:teuthology.orchestra.run.smithi099.stdout:osd.4 smithi181 running (87s) 11s ago 35m 53.1M 4096M 19.0.0-1967-g4e50bbcd b0c4478f1d83 b9078af21e45 2024-03-30T14:10:01.883 INFO:teuthology.orchestra.run.smithi099.stdout:osd.5 smithi181 running (54s) 11s ago 35m 51.0M 4096M 19.0.0-1967-g4e50bbcd b0c4478f1d83 bba176b8db2c 2024-03-30T14:10:01.883 INFO:teuthology.orchestra.run.smithi099.stdout:osd.6 smithi181 running (21s) 11s ago 34m 42.1M 4096M 19.0.0-1967-g4e50bbcd b0c4478f1d83 4a29dfeb4b16 2024-03-30T14:10:01.883 INFO:teuthology.orchestra.run.smithi099.stdout:osd.7 smithi181 running (34m) 11s ago 34m 63.8M 4096M 17.2.0 e1d6a67b021e c08b1839dd7e 2024-03-30T14:10:01.883 INFO:teuthology.orchestra.run.smithi099.stdout:prometheus.a smithi181 *:9095 running (9m) 11s ago 33m 70.5M - 2.43.0 a07b618ecd1d 004088bdf70e 2024-03-30T14:10:01.883 INFO:teuthology.orchestra.run.smithi099.stdout:rgw.foo.smithi099.fxjbmp smithi099 *:8000 running (31m) 18s ago 31m 79.3M - 17.2.0 e1d6a67b021e 400b28b3f650 2024-03-30T14:10:01.883 INFO:teuthology.orchestra.run.smithi099.stdout:rgw.foo.smithi181.wfqwti smithi181 *:8000 running (31m) 11s ago 31m 79.1M - 17.2.0 e1d6a67b021e 97e1b130f9d4 2024-03-30T14:10:01.883 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:10:01 smithi099 ceph-mon[137093]: Upgrade: Updating osd.7 2024-03-30T14:10:01.884 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:10:01 smithi099 ceph-mon[137093]: Deploying daemon osd.7 on smithi181 2024-03-30T14:10:01.884 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:10:01 smithi099 ceph-mon[137093]: pgmap v234: 161 pgs: 161 active+clean; 585 KiB data, 234 MiB used, 715 GiB / 715 GiB avail; 920 B/s rd, 0 op/s 2024-03-30T14:10:01.884 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:10:01 smithi099 ceph-mon[143401]: Upgrade: Updating osd.7 2024-03-30T14:10:01.884 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:10:01 smithi099 ceph-mon[143401]: Deploying daemon osd.7 on smithi181 2024-03-30T14:10:01.884 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:10:01 smithi099 ceph-mon[143401]: pgmap v234: 161 pgs: 161 active+clean; 585 KiB data, 234 MiB used, 715 GiB / 715 GiB avail; 920 B/s rd, 0 op/s 2024-03-30T14:10:01.997 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:10:01 smithi181 ceph-mon[115276]: Upgrade: Updating osd.7 2024-03-30T14:10:01.997 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:10:01 smithi181 ceph-mon[115276]: Deploying daemon osd.7 on smithi181 2024-03-30T14:10:01.997 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:10:01 smithi181 ceph-mon[115276]: pgmap v234: 161 pgs: 161 active+clean; 585 KiB data, 234 MiB used, 715 GiB / 715 GiB avail; 920 B/s rd, 0 op/s 2024-03-30T14:10:02.276 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-03-30T14:10:02.276 INFO:teuthology.orchestra.run.smithi099.stdout: "mon": { 2024-03-30T14:10:02.276 INFO:teuthology.orchestra.run.smithi099.stdout: "ceph version 19.0.0-1967-g4e50bbcd (4e50bbcdd1630c7760b708f3a5b4d38a121e66cb) squid (dev)": 3 2024-03-30T14:10:02.276 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T14:10:02.276 INFO:teuthology.orchestra.run.smithi099.stdout: "mgr": { 2024-03-30T14:10:02.276 INFO:teuthology.orchestra.run.smithi099.stdout: "ceph version 19.0.0-1967-g4e50bbcd (4e50bbcdd1630c7760b708f3a5b4d38a121e66cb) squid (dev)": 2 2024-03-30T14:10:02.276 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T14:10:02.276 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": { 2024-03-30T14:10:02.276 INFO:teuthology.orchestra.run.smithi099.stdout: "ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)": 1, 2024-03-30T14:10:02.276 INFO:teuthology.orchestra.run.smithi099.stdout: "ceph version 19.0.0-1967-g4e50bbcd (4e50bbcdd1630c7760b708f3a5b4d38a121e66cb) squid (dev)": 7 2024-03-30T14:10:02.276 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T14:10:02.276 INFO:teuthology.orchestra.run.smithi099.stdout: "rgw": { 2024-03-30T14:10:02.276 INFO:teuthology.orchestra.run.smithi099.stdout: "ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)": 2 2024-03-30T14:10:02.276 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T14:10:02.277 INFO:teuthology.orchestra.run.smithi099.stdout: "overall": { 2024-03-30T14:10:02.277 INFO:teuthology.orchestra.run.smithi099.stdout: "ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)": 3, 2024-03-30T14:10:02.277 INFO:teuthology.orchestra.run.smithi099.stdout: "ceph version 19.0.0-1967-g4e50bbcd (4e50bbcdd1630c7760b708f3a5b4d38a121e66cb) squid (dev)": 12 2024-03-30T14:10:02.277 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-03-30T14:10:02.277 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-03-30T14:10:02.606 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-03-30T14:10:02.607 INFO:teuthology.orchestra.run.smithi099.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph:4e50bbcdd1630c7760b708f3a5b4d38a121e66cb", 2024-03-30T14:10:02.607 INFO:teuthology.orchestra.run.smithi099.stdout: "in_progress": true, 2024-03-30T14:10:02.607 INFO:teuthology.orchestra.run.smithi099.stdout: "which": "Upgrading daemons of type(s) crash,osd", 2024-03-30T14:10:02.607 INFO:teuthology.orchestra.run.smithi099.stdout: "services_complete": [], 2024-03-30T14:10:02.607 INFO:teuthology.orchestra.run.smithi099.stdout: "progress": "7/8 daemons upgraded", 2024-03-30T14:10:02.607 INFO:teuthology.orchestra.run.smithi099.stdout: "message": "Currently upgrading osd daemons", 2024-03-30T14:10:02.607 INFO:teuthology.orchestra.run.smithi099.stdout: "is_paused": false 2024-03-30T14:10:02.607 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-03-30T14:10:02.747 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:10:02 smithi181 ceph-mon[115276]: from='client.54507 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T14:10:02.747 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:10:02 smithi181 ceph-mon[115276]: from='client.64516 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T14:10:02.747 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:10:02 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:10:02.747 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:10:02 smithi181 ceph-mon[115276]: from='client.? 172.21.15.99:0/1299376951' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:10:03.042 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:10:02 smithi099 ceph-mon[137093]: from='client.54507 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T14:10:03.042 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:10:02 smithi099 ceph-mon[137093]: from='client.64516 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T14:10:03.042 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:10:02 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:10:03.042 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:10:02 smithi099 ceph-mon[137093]: from='client.? 172.21.15.99:0/1299376951' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:10:03.043 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:10:02 smithi099 ceph-mon[143401]: from='client.54507 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T14:10:03.043 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:10:02 smithi099 ceph-mon[143401]: from='client.64516 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T14:10:03.043 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:10:02 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:10:03.043 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:10:02 smithi099 ceph-mon[143401]: from='client.? 172.21.15.99:0/1299376951' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:10:03.826 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:10:03 smithi181 ceph-mon[115276]: from='client.54519 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T14:10:03.826 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:10:03 smithi181 ceph-mon[115276]: pgmap v235: 161 pgs: 161 active+clean; 585 KiB data, 234 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T14:10:03.827 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:10:03 smithi181 ceph-mon[115276]: from='client.64534 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T14:10:03.827 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:10:03 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:10:03.827 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:10:03 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:10:03.827 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:10:03 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:10:04.078 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:10:03 smithi099 ceph-mon[137093]: from='client.54519 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T14:10:04.078 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:10:03 smithi099 ceph-mon[137093]: pgmap v235: 161 pgs: 161 active+clean; 585 KiB data, 234 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T14:10:04.078 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:10:03 smithi099 ceph-mon[137093]: from='client.64534 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T14:10:04.078 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:10:03 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:10:04.078 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:10:03 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:10:04.078 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:10:03 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:10:04.078 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:10:03 smithi099 ceph-mon[143401]: from='client.54519 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T14:10:04.079 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:10:03 smithi099 ceph-mon[143401]: pgmap v235: 161 pgs: 161 active+clean; 585 KiB data, 234 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T14:10:04.079 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:10:03 smithi099 ceph-mon[143401]: from='client.64534 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T14:10:04.079 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:10:03 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:10:04.079 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:10:03 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:10:04.079 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:10:03 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:10:04.756 INFO:journalctl@ceph.osd.7.smithi181.stdout:Mar 30 14:10:04 smithi181 systemd[1]: Stopping Ceph osd.7 for 98ebaeb8-ee99-11ee-b647-cb9ed24678a4... 2024-03-30T14:10:05.078 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 14:10:04 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[71049]: ::ffff:172.21.15.181 - - [30/Mar/2024:14:10:04] "GET /metrics HTTP/1.1" 200 38287 "" "Prometheus/2.43.0" 2024-03-30T14:10:05.247 INFO:journalctl@ceph.osd.7.smithi181.stdout:Mar 30 14:10:04 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-7[39311]: 2024-03-30T14:10:04.763+0000 7f77ce4ad700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.7 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-03-30T14:10:05.260 INFO:journalctl@ceph.osd.7.smithi181.stdout:Mar 30 14:10:04 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-7[39311]: 2024-03-30T14:10:04.763+0000 7f77ce4ad700 -1 osd.7 148 *** Got signal Terminated *** 2024-03-30T14:10:05.260 INFO:journalctl@ceph.osd.7.smithi181.stdout:Mar 30 14:10:04 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-7[39311]: 2024-03-30T14:10:04.763+0000 7f77ce4ad700 -1 osd.7 148 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-03-30T14:10:05.784 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:10:05 smithi099 ceph-mon[137093]: pgmap v236: 161 pgs: 161 active+clean; 585 KiB data, 234 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T14:10:05.784 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:10:05 smithi099 ceph-mon[137093]: osd.7 marked itself down and dead 2024-03-30T14:10:05.785 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:10:05 smithi099 ceph-mon[143401]: pgmap v236: 161 pgs: 161 active+clean; 585 KiB data, 234 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T14:10:05.785 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:10:05 smithi099 ceph-mon[143401]: osd.7 marked itself down and dead 2024-03-30T14:10:05.936 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:10:05 smithi181 ceph-mon[115276]: pgmap v236: 161 pgs: 161 active+clean; 585 KiB data, 234 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T14:10:05.936 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:10:05 smithi181 ceph-mon[115276]: osd.7 marked itself down and dead 2024-03-30T14:10:06.247 INFO:journalctl@ceph.osd.7.smithi181.stdout:Mar 30 14:10:05 smithi181 podman[161645]: 2024-03-30 14:10:05.993172646 +0000 UTC m=+1.344163531 container died c08b1839dd7e3e65173753fa48bfede3434acbae2c5b6a86163efdb1c8f683c7 (image=quay.io/ceph/ceph@sha256:12a0a4f43413fd97a14a3d47a3451b2d2df50020835bb93db666209f3f77617a, name=ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-7, io.buildah.version=1.19.8, version=8, GIT_COMMIT=b613db0f44179c0940781c1c7fe04e1acb7093ac, com.redhat.license_terms=https://centos.org/legal/licensing-policy/, summary=Provides a CentOS Stream container based on the Red Hat Universal Base Image, GIT_REPO=https://github.com/ceph/ceph-container.git, description=CentOS Stream is a continuously delivered distro that tracks just ahead of Red Hat Enterprise Linux development. This image takes the Red Hat UBI and layers on content from CentOS Stream, vcs-type=git, distribution-scope=public, release=754, RELEASE=HEAD, io.k8s.description=The Universal Base Image is designed and engineered to be the base layer for all of your containerized applications, middleware and utilities. This base image is freely redistributable, but Red Hat only supports Red Hat technologies through subscriptions for Red Hat products. This image is maintained by Red Hat and updated regularly., vcs-ref=f1ee6e37554363ec55e0035aba1a693d3627fdeb, maintainer=Guillaume Abrioux , vendor=Red Hat, Inc., name=centos-stream, CEPH_POINT_RELEASE=-17.2.0, io.openshift.expose-services=, architecture=x86_64, build-date=2022-05-03T08:36:31.336870, com.redhat.build-host=cpt-1002.osbs.prod.upshift.rdu2.redhat.com, ceph=True, com.redhat.component=centos-stream-container, url=https://access.redhat.com/containers/#/registry.access.redhat.com/ubi8/images/8.6-754, GIT_CLEAN=True, io.k8s.display-name=CentOS Stream 8, io.openshift.tags=base centos centos-stream, GIT_BRANCH=HEAD) 2024-03-30T14:10:06.623 INFO:journalctl@ceph.osd.7.smithi181.stdout:Mar 30 14:10:06 smithi181 podman[161645]: 2024-03-30 14:10:06.42247863 +0000 UTC m=+1.773469502 container cleanup c08b1839dd7e3e65173753fa48bfede3434acbae2c5b6a86163efdb1c8f683c7 (image=quay.io/ceph/ceph@sha256:12a0a4f43413fd97a14a3d47a3451b2d2df50020835bb93db666209f3f77617a, name=ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-7, vcs-type=git, release=754, summary=Provides a CentOS Stream container based on the Red Hat Universal Base Image, io.k8s.display-name=CentOS Stream 8, build-date=2022-05-03T08:36:31.336870, io.openshift.tags=base centos centos-stream, GIT_CLEAN=True, CEPH_POINT_RELEASE=-17.2.0, com.redhat.build-host=cpt-1002.osbs.prod.upshift.rdu2.redhat.com, GIT_COMMIT=b613db0f44179c0940781c1c7fe04e1acb7093ac, description=CentOS Stream is a continuously delivered distro that tracks just ahead of Red Hat Enterprise Linux development. This image takes the Red Hat UBI and layers on content from CentOS Stream, ceph=True, vcs-ref=f1ee6e37554363ec55e0035aba1a693d3627fdeb, com.redhat.component=centos-stream-container, maintainer=Guillaume Abrioux , url=https://access.redhat.com/containers/#/registry.access.redhat.com/ubi8/images/8.6-754, version=8, vendor=Red Hat, Inc., distribution-scope=public, GIT_BRANCH=HEAD, io.k8s.description=The Universal Base Image is designed and engineered to be the base layer for all of your containerized applications, middleware and utilities. This base image is freely redistributable, but Red Hat only supports Red Hat technologies through subscriptions for Red Hat products. This image is maintained by Red Hat and updated regularly., architecture=x86_64, name=centos-stream, GIT_REPO=https://github.com/ceph/ceph-container.git, io.openshift.expose-services=, io.buildah.version=1.19.8, RELEASE=HEAD, com.redhat.license_terms=https://centos.org/legal/licensing-policy/) 2024-03-30T14:10:06.624 INFO:journalctl@ceph.osd.7.smithi181.stdout:Mar 30 14:10:06 smithi181 bash[161645]: ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-7 2024-03-30T14:10:06.828 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:10:06 smithi099 ceph-mon[137093]: Health check failed: 1 osds down (OSD_DOWN) 2024-03-30T14:10:06.828 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:10:06 smithi099 ceph-mon[137093]: Health check failed: all OSDs are running squid or later but require_osd_release < squid (OSD_UPGRADE_FINISHED) 2024-03-30T14:10:06.828 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:10:06 smithi099 ceph-mon[137093]: osdmap e149: 8 total, 7 up, 8 in 2024-03-30T14:10:06.828 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:10:06 smithi099 ceph-mon[143401]: Health check failed: 1 osds down (OSD_DOWN) 2024-03-30T14:10:06.829 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:10:06 smithi099 ceph-mon[143401]: Health check failed: all OSDs are running squid or later but require_osd_release < squid (OSD_UPGRADE_FINISHED) 2024-03-30T14:10:06.829 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:10:06 smithi099 ceph-mon[143401]: osdmap e149: 8 total, 7 up, 8 in 2024-03-30T14:10:06.997 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:10:06 smithi181 ceph-mon[115276]: Health check failed: 1 osds down (OSD_DOWN) 2024-03-30T14:10:06.997 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:10:06 smithi181 ceph-mon[115276]: Health check failed: all OSDs are running squid or later but require_osd_release < squid (OSD_UPGRADE_FINISHED) 2024-03-30T14:10:06.997 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:10:06 smithi181 ceph-mon[115276]: osdmap e149: 8 total, 7 up, 8 in 2024-03-30T14:10:06.997 INFO:journalctl@ceph.osd.7.smithi181.stdout:Mar 30 14:10:06 smithi181 podman[161781]: 2024-03-30 14:10:06.632095447 +0000 UTC m=+0.636732919 container remove c08b1839dd7e3e65173753fa48bfede3434acbae2c5b6a86163efdb1c8f683c7 (image=quay.io/ceph/ceph@sha256:12a0a4f43413fd97a14a3d47a3451b2d2df50020835bb93db666209f3f77617a, name=ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-7, url=https://access.redhat.com/containers/#/registry.access.redhat.com/ubi8/images/8.6-754, GIT_CLEAN=True, io.openshift.tags=base centos centos-stream, GIT_REPO=https://github.com/ceph/ceph-container.git, GIT_COMMIT=b613db0f44179c0940781c1c7fe04e1acb7093ac, ceph=True, com.redhat.component=centos-stream-container, CEPH_POINT_RELEASE=-17.2.0, architecture=x86_64, io.openshift.expose-services=, io.buildah.version=1.19.8, build-date=2022-05-03T08:36:31.336870, vcs-ref=f1ee6e37554363ec55e0035aba1a693d3627fdeb, GIT_BRANCH=HEAD, version=8, com.redhat.license_terms=https://centos.org/legal/licensing-policy/, io.k8s.description=The Universal Base Image is designed and engineered to be the base layer for all of your containerized applications, middleware and utilities. This base image is freely redistributable, but Red Hat only supports Red Hat technologies through subscriptions for Red Hat products. This image is maintained by Red Hat and updated regularly., com.redhat.build-host=cpt-1002.osbs.prod.upshift.rdu2.redhat.com, maintainer=Guillaume Abrioux , vendor=Red Hat, Inc., name=centos-stream, distribution-scope=public, io.k8s.display-name=CentOS Stream 8, summary=Provides a CentOS Stream container based on the Red Hat Universal Base Image, release=754, RELEASE=HEAD, vcs-type=git, description=CentOS Stream is a continuously delivered distro that tracks just ahead of Red Hat Enterprise Linux development. This image takes the Red Hat UBI and layers on content from CentOS Stream) 2024-03-30T14:10:07.931 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:10:07 smithi181 ceph-mon[115276]: pgmap v238: 161 pgs: 23 stale+active+clean, 138 active+clean; 585 KiB data, 234 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-03-30T14:10:07.931 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:10:07 smithi181 ceph-mon[115276]: osdmap e150: 8 total, 7 up, 8 in 2024-03-30T14:10:07.931 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:10:07 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:10:07.931 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:10:07 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T14:10:07.931 INFO:journalctl@ceph.osd.7.smithi181.stdout:Mar 30 14:10:07 smithi181 podman[161992]: 2024-03-30 14:10:07.702925533 +0000 UTC m=+0.114261802 container create 443dd49ecd738326e46dd39caa36e2614e45798478f253b41574e46332097122 (image=quay.ceph.io/ceph-ci/ceph:4e50bbcdd1630c7760b708f3a5b4d38a121e66cb, name=ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-7-deactivate, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240326, RELEASE=squid-4e50bbc, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_CLEAN=True, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, org.label-schema.license=GPLv2) 2024-03-30T14:10:07.932 INFO:journalctl@ceph.osd.7.smithi181.stdout:Mar 30 14:10:07 smithi181 podman[161992]: 2024-03-30 14:10:07.608116666 +0000 UTC m=+0.019452889 image pull b0c4478f1d83795df4d538bf108aee5fac57194348fb16dcdbb3115f3e2fe95e quay.ceph.io/ceph-ci/ceph:4e50bbcdd1630c7760b708f3a5b4d38a121e66cb 2024-03-30T14:10:07.932 INFO:journalctl@ceph.osd.7.smithi181.stdout:Mar 30 14:10:07 smithi181 podman[161992]: 2024-03-30 14:10:07.939258484 +0000 UTC m=+0.350594717 container init 443dd49ecd738326e46dd39caa36e2614e45798478f253b41574e46332097122 (image=quay.ceph.io/ceph-ci/ceph:4e50bbcdd1630c7760b708f3a5b4d38a121e66cb, name=ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-7-deactivate, ceph=True, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.build-date=20240326, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, RELEASE=squid-4e50bbc, GIT_CLEAN=True) 2024-03-30T14:10:08.029 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:10:07 smithi099 ceph-mon[137093]: pgmap v238: 161 pgs: 23 stale+active+clean, 138 active+clean; 585 KiB data, 234 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-03-30T14:10:08.030 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:10:07 smithi099 ceph-mon[137093]: osdmap e150: 8 total, 7 up, 8 in 2024-03-30T14:10:08.030 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:10:07 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:10:08.030 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:10:07 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T14:10:08.030 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:10:07 smithi099 ceph-mon[143401]: pgmap v238: 161 pgs: 23 stale+active+clean, 138 active+clean; 585 KiB data, 234 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-03-30T14:10:08.030 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:10:07 smithi099 ceph-mon[143401]: osdmap e150: 8 total, 7 up, 8 in 2024-03-30T14:10:08.030 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:10:07 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:10:08.030 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:10:07 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T14:10:08.234 INFO:journalctl@ceph.osd.7.smithi181.stdout:Mar 30 14:10:07 smithi181 podman[161992]: 2024-03-30 14:10:07.94283448 +0000 UTC m=+0.354170699 container start 443dd49ecd738326e46dd39caa36e2614e45798478f253b41574e46332097122 (image=quay.ceph.io/ceph-ci/ceph:4e50bbcdd1630c7760b708f3a5b4d38a121e66cb, name=ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-7-deactivate, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-4e50bbc, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.build-date=20240326, io.buildah.version=1.33.5) 2024-03-30T14:10:08.234 INFO:journalctl@ceph.osd.7.smithi181.stdout:Mar 30 14:10:08 smithi181 podman[161992]: 2024-03-30 14:10:08.047267786 +0000 UTC m=+0.458604006 container attach 443dd49ecd738326e46dd39caa36e2614e45798478f253b41574e46332097122 (image=quay.ceph.io/ceph-ci/ceph:4e50bbcdd1630c7760b708f3a5b4d38a121e66cb, name=ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-7-deactivate, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, io.buildah.version=1.33.5, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240326, GIT_BRANCH=HEAD, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, RELEASE=squid-4e50bbc, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-03-30T14:10:08.497 INFO:journalctl@ceph.osd.7.smithi181.stdout:Mar 30 14:10:08 smithi181 podman[161992]: 2024-03-30 14:10:08.243450946 +0000 UTC m=+0.654787168 container died 443dd49ecd738326e46dd39caa36e2614e45798478f253b41574e46332097122 (image=quay.ceph.io/ceph-ci/ceph:4e50bbcdd1630c7760b708f3a5b4d38a121e66cb, name=ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-7-deactivate, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240326, ceph=True, org.label-schema.license=GPLv2, RELEASE=squid-4e50bbc) 2024-03-30T14:10:08.997 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:10:08 smithi181 ceph-mon[115276]: Health check failed: Degraded data redundancy: 16/627 objects degraded (2.552%), 5 pgs degraded (PG_DEGRADED) 2024-03-30T14:10:08.997 INFO:journalctl@ceph.osd.7.smithi181.stdout:Mar 30 14:10:08 smithi181 podman[162083]: 2024-03-30 14:10:08.825661893 +0000 UTC m=+0.577316285 container remove 443dd49ecd738326e46dd39caa36e2614e45798478f253b41574e46332097122 (image=quay.ceph.io/ceph-ci/ceph:4e50bbcdd1630c7760b708f3a5b4d38a121e66cb, name=ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-7-deactivate, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, CEPH_POINT_RELEASE=, RELEASE=squid-4e50bbc, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240326, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0) 2024-03-30T14:10:08.997 INFO:journalctl@ceph.osd.7.smithi181.stdout:Mar 30 14:10:08 smithi181 systemd[1]: ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4@osd.7.service: Deactivated successfully. 2024-03-30T14:10:08.997 INFO:journalctl@ceph.osd.7.smithi181.stdout:Mar 30 14:10:08 smithi181 systemd[1]: Stopped Ceph osd.7 for 98ebaeb8-ee99-11ee-b647-cb9ed24678a4. 2024-03-30T14:10:08.998 INFO:journalctl@ceph.osd.7.smithi181.stdout:Mar 30 14:10:08 smithi181 systemd[1]: ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4@osd.7.service: Consumed 18.035s CPU time. 2024-03-30T14:10:09.078 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:10:08 smithi099 ceph-mon[137093]: Health check failed: Degraded data redundancy: 16/627 objects degraded (2.552%), 5 pgs degraded (PG_DEGRADED) 2024-03-30T14:10:09.078 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:10:08 smithi099 ceph-mon[143401]: Health check failed: Degraded data redundancy: 16/627 objects degraded (2.552%), 5 pgs degraded (PG_DEGRADED) 2024-03-30T14:10:09.328 INFO:journalctl@ceph.osd.7.smithi181.stdout:Mar 30 14:10:09 smithi181 systemd[1]: Starting Ceph osd.7 for 98ebaeb8-ee99-11ee-b647-cb9ed24678a4... 2024-03-30T14:10:09.689 INFO:journalctl@ceph.osd.7.smithi181.stdout:Mar 30 14:10:09 smithi181 podman[162232]: 2024-03-30 14:10:09.440002529 +0000 UTC m=+0.098655731 image pull b0c4478f1d83795df4d538bf108aee5fac57194348fb16dcdbb3115f3e2fe95e quay.ceph.io/ceph-ci/ceph:4e50bbcdd1630c7760b708f3a5b4d38a121e66cb 2024-03-30T14:10:09.689 INFO:journalctl@ceph.osd.7.smithi181.stdout:Mar 30 14:10:09 smithi181 podman[162232]: 2024-03-30 14:10:09.56181513 +0000 UTC m=+0.220468360 container create 06612f32b5a95312bd0ffd4e4d5c56aecc32d0dc25b0532d98b8ff4d5ff66058 (image=quay.ceph.io/ceph-ci/ceph:4e50bbcdd1630c7760b708f3a5b4d38a121e66cb, name=ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-7-activate, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, ceph=True, RELEASE=squid-4e50bbc, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.build-date=20240326, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0) 2024-03-30T14:10:09.997 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:10:09 smithi181 ceph-mon[115276]: from='client.25136 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T14:10:09.997 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:10:09 smithi181 ceph-mon[115276]: pgmap v240: 161 pgs: 5 active+undersized+degraded, 20 stale+active+clean, 4 active+undersized, 132 active+clean; 585 KiB data, 234 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s; 16/627 objects degraded (2.552%) 2024-03-30T14:10:10.078 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:10:09 smithi099 ceph-mon[137093]: from='client.25136 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T14:10:10.078 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:10:09 smithi099 ceph-mon[137093]: pgmap v240: 161 pgs: 5 active+undersized+degraded, 20 stale+active+clean, 4 active+undersized, 132 active+clean; 585 KiB data, 234 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s; 16/627 objects degraded (2.552%) 2024-03-30T14:10:10.078 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:10:09 smithi099 ceph-mon[143401]: from='client.25136 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T14:10:10.078 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:10:09 smithi099 ceph-mon[143401]: pgmap v240: 161 pgs: 5 active+undersized+degraded, 20 stale+active+clean, 4 active+undersized, 132 active+clean; 585 KiB data, 234 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s; 16/627 objects degraded (2.552%) 2024-03-30T14:10:10.401 INFO:journalctl@ceph.osd.7.smithi181.stdout:Mar 30 14:10:10 smithi181 podman[162232]: 2024-03-30 14:10:10.133163086 +0000 UTC m=+0.791816270 container init 06612f32b5a95312bd0ffd4e4d5c56aecc32d0dc25b0532d98b8ff4d5ff66058 (image=quay.ceph.io/ceph-ci/ceph:4e50bbcdd1630c7760b708f3a5b4d38a121e66cb, name=ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-7-activate, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.build-date=20240326, io.buildah.version=1.33.5, RELEASE=squid-4e50bbc) 2024-03-30T14:10:10.401 INFO:journalctl@ceph.osd.7.smithi181.stdout:Mar 30 14:10:10 smithi181 podman[162232]: 2024-03-30 14:10:10.136380284 +0000 UTC m=+0.795033469 container start 06612f32b5a95312bd0ffd4e4d5c56aecc32d0dc25b0532d98b8ff4d5ff66058 (image=quay.ceph.io/ceph-ci/ceph:4e50bbcdd1630c7760b708f3a5b4d38a121e66cb, name=ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-7-activate, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240326, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, ceph=True, RELEASE=squid-4e50bbc) 2024-03-30T14:10:10.401 INFO:journalctl@ceph.osd.7.smithi181.stdout:Mar 30 14:10:10 smithi181 podman[162232]: 2024-03-30 14:10:10.21624168 +0000 UTC m=+0.874894872 container attach 06612f32b5a95312bd0ffd4e4d5c56aecc32d0dc25b0532d98b8ff4d5ff66058 (image=quay.ceph.io/ceph-ci/ceph:4e50bbcdd1630c7760b708f3a5b4d38a121e66cb, name=ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-7-activate, GIT_BRANCH=HEAD, ceph=True, RELEASE=squid-4e50bbc, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.build-date=20240326, CEPH_POINT_RELEASE=) 2024-03-30T14:10:10.747 INFO:journalctl@ceph.osd.7.smithi181.stdout:Mar 30 14:10:10 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-7-activate[162269]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2024-03-30T14:10:10.747 INFO:journalctl@ceph.osd.7.smithi181.stdout:Mar 30 14:10:10 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-7-activate[162269]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-7 --no-mon-config --dev /dev/mapper/vg_nvme-lv_1 2024-03-30T14:10:10.747 INFO:journalctl@ceph.osd.7.smithi181.stdout:Mar 30 14:10:10 smithi181 bash[162232]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2024-03-30T14:10:10.747 INFO:journalctl@ceph.osd.7.smithi181.stdout:Mar 30 14:10:10 smithi181 bash[162232]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-7 --no-mon-config --dev /dev/mapper/vg_nvme-lv_1 2024-03-30T14:10:10.748 INFO:journalctl@ceph.osd.7.smithi181.stdout:Mar 30 14:10:10 smithi181 bash[162232]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_1 2024-03-30T14:10:10.748 INFO:journalctl@ceph.osd.7.smithi181.stdout:Mar 30 14:10:10 smithi181 bash[162232]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-0 2024-03-30T14:10:10.748 INFO:journalctl@ceph.osd.7.smithi181.stdout:Mar 30 14:10:10 smithi181 bash[162232]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-7/block 2024-03-30T14:10:10.748 INFO:journalctl@ceph.osd.7.smithi181.stdout:Mar 30 14:10:10 smithi181 bash[162232]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2024-03-30T14:10:10.748 INFO:journalctl@ceph.osd.7.smithi181.stdout:Mar 30 14:10:10 smithi181 bash[162232]: --> ceph-volume raw activate successful for osd ID: 7 2024-03-30T14:10:10.748 INFO:journalctl@ceph.osd.7.smithi181.stdout:Mar 30 14:10:10 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-7-activate[162269]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_1 2024-03-30T14:10:10.748 INFO:journalctl@ceph.osd.7.smithi181.stdout:Mar 30 14:10:10 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-7-activate[162269]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-0 2024-03-30T14:10:10.748 INFO:journalctl@ceph.osd.7.smithi181.stdout:Mar 30 14:10:10 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-7-activate[162269]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-7/block 2024-03-30T14:10:10.748 INFO:journalctl@ceph.osd.7.smithi181.stdout:Mar 30 14:10:10 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-7-activate[162269]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2024-03-30T14:10:10.748 INFO:journalctl@ceph.osd.7.smithi181.stdout:Mar 30 14:10:10 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-7-activate[162269]: --> ceph-volume raw activate successful for osd ID: 7 2024-03-30T14:10:11.074 INFO:journalctl@ceph.osd.7.smithi181.stdout:Mar 30 14:10:10 smithi181 podman[162232]: 2024-03-30 14:10:10.802588917 +0000 UTC m=+1.461242102 container died 06612f32b5a95312bd0ffd4e4d5c56aecc32d0dc25b0532d98b8ff4d5ff66058 (image=quay.ceph.io/ceph-ci/ceph:4e50bbcdd1630c7760b708f3a5b4d38a121e66cb, name=ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-7-activate, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240326, RELEASE=squid-4e50bbc, ceph=True, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0) 2024-03-30T14:10:11.899 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:10:11 smithi181 ceph-mon[115276]: pgmap v241: 161 pgs: 23 active+undersized+degraded, 1 stale+active+clean, 33 active+undersized, 104 active+clean; 585 KiB data, 234 MiB used, 715 GiB / 715 GiB avail; 68/627 objects degraded (10.845%) 2024-03-30T14:10:11.900 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:10:11 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:10:11.900 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:10:11 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:10:11.900 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:10:11 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:10:11.900 INFO:journalctl@ceph.osd.7.smithi181.stdout:Mar 30 14:10:11 smithi181 podman[162453]: 2024-03-30 14:10:11.623222459 +0000 UTC m=+0.994673676 container remove 06612f32b5a95312bd0ffd4e4d5c56aecc32d0dc25b0532d98b8ff4d5ff66058 (image=quay.ceph.io/ceph-ci/ceph:4e50bbcdd1630c7760b708f3a5b4d38a121e66cb, name=ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-7-activate, RELEASE=squid-4e50bbc, io.buildah.version=1.33.5, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240326, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True) 2024-03-30T14:10:12.078 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:10:11 smithi099 ceph-mon[143401]: pgmap v241: 161 pgs: 23 active+undersized+degraded, 1 stale+active+clean, 33 active+undersized, 104 active+clean; 585 KiB data, 234 MiB used, 715 GiB / 715 GiB avail; 68/627 objects degraded (10.845%) 2024-03-30T14:10:12.078 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:10:11 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:10:12.078 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:10:11 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:10:12.078 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:10:11 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:10:12.078 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:10:11 smithi099 ceph-mon[137093]: pgmap v241: 161 pgs: 23 active+undersized+degraded, 1 stale+active+clean, 33 active+undersized, 104 active+clean; 585 KiB data, 234 MiB used, 715 GiB / 715 GiB avail; 68/627 objects degraded (10.845%) 2024-03-30T14:10:12.079 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:10:11 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:10:12.079 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:10:11 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:10:12.079 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:10:11 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:10:12.747 INFO:journalctl@ceph.osd.7.smithi181.stdout:Mar 30 14:10:12 smithi181 podman[162588]: 2024-03-30 14:10:12.369710087 +0000 UTC m=+0.648302579 image pull b0c4478f1d83795df4d538bf108aee5fac57194348fb16dcdbb3115f3e2fe95e quay.ceph.io/ceph-ci/ceph:4e50bbcdd1630c7760b708f3a5b4d38a121e66cb 2024-03-30T14:10:12.747 INFO:journalctl@ceph.osd.7.smithi181.stdout:Mar 30 14:10:12 smithi181 podman[162588]: 2024-03-30 14:10:12.469024475 +0000 UTC m=+0.747616997 container create 7940232eb4fe392a35152a0f996efc8e0eb9fca87c66ec8ff82f739c0292834a (image=quay.ceph.io/ceph-ci/ceph:4e50bbcdd1630c7760b708f3a5b4d38a121e66cb, name=ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-7, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, org.label-schema.build-date=20240326, org.label-schema.vendor=CentOS, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-4e50bbc, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, ceph=True, GIT_CLEAN=True) 2024-03-30T14:10:12.747 INFO:journalctl@ceph.osd.7.smithi181.stdout:Mar 30 14:10:12 smithi181 podman[162588]: 2024-03-30 14:10:12.663449754 +0000 UTC m=+0.942042234 container init 7940232eb4fe392a35152a0f996efc8e0eb9fca87c66ec8ff82f739c0292834a (image=quay.ceph.io/ceph-ci/ceph:4e50bbcdd1630c7760b708f3a5b4d38a121e66cb, name=ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-7, GIT_CLEAN=True, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.schema-version=1.0, RELEASE=squid-4e50bbc, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240326, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux ) 2024-03-30T14:10:12.747 INFO:journalctl@ceph.osd.7.smithi181.stdout:Mar 30 14:10:12 smithi181 podman[162588]: 2024-03-30 14:10:12.66642424 +0000 UTC m=+0.945016729 container start 7940232eb4fe392a35152a0f996efc8e0eb9fca87c66ec8ff82f739c0292834a (image=quay.ceph.io/ceph-ci/ceph:4e50bbcdd1630c7760b708f3a5b4d38a121e66cb, name=ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-7, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240326, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=squid-4e50bbc, GIT_CLEAN=True, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS) 2024-03-30T14:10:12.748 INFO:journalctl@ceph.osd.7.smithi181.stdout:Mar 30 14:10:12 smithi181 ceph-osd[162670]: -- 172.21.15.181:0/3699690725 <== mon.2 v2:172.21.15.181:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5599bc585680 con 0x5599bc54f000 2024-03-30T14:10:13.013 INFO:journalctl@ceph.osd.7.smithi181.stdout:Mar 30 14:10:12 smithi181 bash[162588]: 7940232eb4fe392a35152a0f996efc8e0eb9fca87c66ec8ff82f739c0292834a 2024-03-30T14:10:13.013 INFO:journalctl@ceph.osd.7.smithi181.stdout:Mar 30 14:10:12 smithi181 systemd[1]: Started Ceph osd.7 for 98ebaeb8-ee99-11ee-b647-cb9ed24678a4. 2024-03-30T14:10:13.288 INFO:journalctl@ceph.osd.7.smithi181.stdout:Mar 30 14:10:13 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-7[162666]: 2024-03-30T14:10:13.205+0000 7f8a077d27c0 -1 Falling back to public interface 2024-03-30T14:10:13.938 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:10:13 smithi181 ceph-mon[115276]: pgmap v242: 161 pgs: 29 active+undersized+degraded, 40 active+undersized, 92 active+clean; 585 KiB data, 234 MiB used, 715 GiB / 715 GiB avail; 87/627 objects degraded (13.876%) 2024-03-30T14:10:13.938 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:10:13 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:10:13.938 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:10:13 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:10:13.938 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:10:13 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:10:13.938 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:10:13 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:10:13.938 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:10:13 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:10:13.939 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:10:13 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:10:13.939 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:10:13 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:10:13.939 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:10:13 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:10:13.939 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:10:13 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:10:13.939 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:10:13 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:10:13.939 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:10:13 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:10:13.939 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:10:13 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:10:13.939 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:10:13 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:10:13.939 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:10:13 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:10:13.939 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:10:13 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:10:13.939 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:10:13 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:10:13.939 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:10:13 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:10:13.939 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:10:13 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:10:13.939 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:10:13 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:10:13.939 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:10:13 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:10:13.940 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:10:13 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:10:13.940 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:10:13 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:10:13.940 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:10:13 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:10:13.940 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:10:13 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:10:13.940 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:10:13 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:10:13.940 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:10:13 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:10:13.940 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:10:13 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:10:13.940 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:10:13 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:10:13.940 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:10:13 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:10:13.940 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:10:13 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:10:13.940 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:10:13 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:10:13.940 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:10:13 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:10:13.940 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:10:13 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:10:13.940 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:10:13 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:10:13.940 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:10:13 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:10:13.940 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:10:13 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:10:13.941 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:10:13 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:10:13.941 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:10:13 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:10:13.941 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:10:13 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:10:13.941 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:10:13 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:10:13.941 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:10:13 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:10:13.941 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:10:13 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:10:13.941 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:10:13 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:10:13.941 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:10:13 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:10:13.941 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:10:13 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:10:13.941 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:10:13 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:10:13.941 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:10:13 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:10:13.941 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:10:13 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:10:13.941 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:10:13 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:10:13.941 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:10:13 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:10:14.078 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:10:13 smithi099 ceph-mon[137093]: pgmap v242: 161 pgs: 29 active+undersized+degraded, 40 active+undersized, 92 active+clean; 585 KiB data, 234 MiB used, 715 GiB / 715 GiB avail; 87/627 objects degraded (13.876%) 2024-03-30T14:10:14.078 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:10:13 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:10:14.078 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:10:13 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:10:14.078 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:10:13 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:10:14.079 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:10:13 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:10:14.079 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:10:13 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:10:14.079 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:10:13 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:10:14.079 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:10:13 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:10:14.079 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:10:13 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:10:14.079 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:10:13 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:10:14.079 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:10:13 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:10:14.079 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:10:13 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:10:14.079 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:10:13 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:10:14.079 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:10:13 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:10:14.079 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:10:13 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:10:14.079 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:10:13 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:10:14.079 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:10:13 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:10:14.079 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:10:13 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:10:14.079 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:10:13 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:10:14.080 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:10:13 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:10:14.080 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:10:13 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:10:14.080 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:10:13 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:10:14.080 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:10:13 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:10:14.080 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:10:13 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:10:14.080 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:10:13 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:10:14.080 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:10:13 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:10:14.080 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:10:13 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:10:14.080 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:10:13 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:10:14.080 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:10:13 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:10:14.080 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:10:13 smithi099 ceph-mon[143401]: pgmap v242: 161 pgs: 29 active+undersized+degraded, 40 active+undersized, 92 active+clean; 585 KiB data, 234 MiB used, 715 GiB / 715 GiB avail; 87/627 objects degraded (13.876%) 2024-03-30T14:10:14.080 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:10:13 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:10:14.081 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:10:13 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:10:14.081 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:10:13 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:10:14.081 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:10:13 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:10:14.081 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:10:13 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:10:14.081 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:10:13 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:10:14.081 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:10:13 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:10:14.081 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:10:13 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:10:14.081 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:10:13 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:10:14.081 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:10:13 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:10:14.081 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:10:13 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:10:14.081 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:10:13 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:10:14.081 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:10:13 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:10:14.081 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:10:13 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:10:14.081 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:10:13 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:10:14.082 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:10:13 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:10:14.082 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:10:13 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:10:14.082 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:10:13 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:10:14.082 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:10:13 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:10:14.082 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:10:13 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:10:14.082 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:10:13 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:10:14.082 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:10:13 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:10:14.082 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:10:13 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:10:14.082 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:10:13 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:10:14.082 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:10:13 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:10:14.082 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:10:13 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:10:14.082 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:10:13 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:10:14.082 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:10:13 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:10:14.083 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:10:13 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:10:14.083 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:10:13 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:10:14.083 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:10:13 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:10:14.083 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:10:13 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:10:14.083 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:10:13 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:10:14.083 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:10:13 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:10:14.083 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:10:13 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:10:14.083 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:10:13 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:10:14.083 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:10:13 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:10:14.083 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:10:13 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:10:14.084 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:10:13 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:10:14.084 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:10:13 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:10:14.084 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:10:13 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:10:14.084 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:10:13 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:10:14.084 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:10:13 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:10:14.084 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:10:13 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:10:14.084 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:10:13 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:10:14.084 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:10:13 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:10:14.084 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:10:13 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:10:14.084 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:10:13 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:10:14.084 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:10:13 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:10:14.084 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:10:13 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:10:14.084 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:10:13 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:10:14.084 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:10:13 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:10:14.085 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:10:13 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:10:14.085 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:10:13 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:10:14.085 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:10:13 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:10:14.085 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:10:13 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:10:14.085 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:10:13 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:10:14.085 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:10:13 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:10:14.085 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:10:13 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:10:14.085 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:10:13 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:10:14.085 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:10:13 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:10:14.085 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:10:13 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:10:14.085 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:10:13 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:10:14.085 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:10:13 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:10:14.085 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:10:13 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:10:14.085 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:10:13 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:10:14.085 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:10:13 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:10:14.086 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:10:13 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:10:14.086 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:10:13 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:10:14.086 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:10:13 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:10:14.086 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:10:13 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:10:14.086 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:10:13 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:10:14.998 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:10:14 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:10:14.998 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:10:14 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:10:14.998 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:10:14 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:10:14.998 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:10:14 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:10:14.998 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:10:14 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:10:14.998 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:10:14 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:10:14.998 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:10:14 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:10:14.998 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:10:14 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:10:14.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:10:14 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:10:14.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:10:14 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:10:14.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:10:14 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:10:14.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:10:14 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:10:14.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:10:14 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:10:14.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:10:14 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:10:14.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:10:14 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:10:14.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:10:14 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:10:14.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:10:14 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:10:14.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:10:14 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:10:14.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:10:14 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:10:14.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:10:14 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:10:14.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:10:14 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:10:15.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:10:14 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:10:15.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:10:14 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:10:15.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:10:14 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:10:15.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:10:14 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:10:15.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:10:14 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:10:15.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:10:14 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:10:15.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:10:14 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:10:15.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:10:14 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:10:15.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:10:14 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:10:15.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:10:14 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:10:15.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:10:14 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:10:15.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:10:14 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:10:15.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:10:14 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:10:15.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:10:14 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:10:15.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:10:14 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.0"}]: dispatch 2024-03-30T14:10:15.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:10:14 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.0"}]: dispatch 2024-03-30T14:10:15.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:10:14 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.0"}]': finished 2024-03-30T14:10:15.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:10:14 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.1"}]: dispatch 2024-03-30T14:10:15.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:10:14 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.1"}]: dispatch 2024-03-30T14:10:15.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:10:14 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.1"}]': finished 2024-03-30T14:10:15.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:10:14 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.2"}]: dispatch 2024-03-30T14:10:15.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:10:14 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.2"}]: dispatch 2024-03-30T14:10:15.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:10:14 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.2"}]': finished 2024-03-30T14:10:15.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:10:14 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.3"}]: dispatch 2024-03-30T14:10:15.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:10:14 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.3"}]: dispatch 2024-03-30T14:10:15.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:10:14 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.3"}]': finished 2024-03-30T14:10:15.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:10:14 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.4"}]: dispatch 2024-03-30T14:10:15.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:10:14 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.4"}]: dispatch 2024-03-30T14:10:15.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:10:14 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.4"}]': finished 2024-03-30T14:10:15.002 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:10:14 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.5"}]: dispatch 2024-03-30T14:10:15.002 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:10:14 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.5"}]: dispatch 2024-03-30T14:10:15.002 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:10:14 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.5"}]': finished 2024-03-30T14:10:15.002 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:10:14 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.6"}]: dispatch 2024-03-30T14:10:15.002 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:10:14 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.6"}]: dispatch 2024-03-30T14:10:15.002 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:10:14 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.6"}]': finished 2024-03-30T14:10:15.002 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:10:14 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.7"}]: dispatch 2024-03-30T14:10:15.002 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:10:14 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.7"}]: dispatch 2024-03-30T14:10:15.002 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:10:14 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.7"}]': finished 2024-03-30T14:10:15.002 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:10:14 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "osd require-osd-release", "release": "squid"}]: dispatch 2024-03-30T14:10:15.002 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:10:14 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' cmd=[{"prefix": "osd require-osd-release", "release": "squid"}]: dispatch 2024-03-30T14:10:15.078 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:10:14 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:10:15.079 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:10:14 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:10:15.079 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:10:14 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:10:15.079 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:10:14 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:10:15.079 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:10:14 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:10:15.079 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:10:14 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:10:15.079 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:10:14 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:10:15.079 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:10:14 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:10:15.079 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:10:14 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:10:15.079 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:10:14 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:10:15.079 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:10:14 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:10:15.079 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:10:14 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:10:15.080 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:10:14 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:10:15.080 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:10:14 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:10:15.080 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:10:14 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:10:15.080 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:10:14 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:10:15.080 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:10:14 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:10:15.080 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:10:14 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:10:15.080 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:10:14 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:10:15.080 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:10:14 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:10:15.080 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:10:14 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:10:15.080 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:10:14 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:10:15.080 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:10:14 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:10:15.080 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:10:14 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:10:15.080 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:10:14 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:10:15.080 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:10:14 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:10:15.080 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:10:14 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:10:15.081 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:10:14 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:10:15.081 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:10:14 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:10:15.081 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:10:14 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:10:15.081 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:10:14 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:10:15.081 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:10:14 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:10:15.081 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:10:14 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:10:15.081 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:10:14 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:10:15.081 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:10:14 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:10:15.081 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:10:14 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.0"}]: dispatch 2024-03-30T14:10:15.082 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:10:14 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.0"}]: dispatch 2024-03-30T14:10:15.082 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:10:14 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.0"}]': finished 2024-03-30T14:10:15.082 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:10:14 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.1"}]: dispatch 2024-03-30T14:10:15.082 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:10:14 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.1"}]: dispatch 2024-03-30T14:10:15.082 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:10:14 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.1"}]': finished 2024-03-30T14:10:15.082 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:10:14 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.2"}]: dispatch 2024-03-30T14:10:15.082 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:10:14 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.2"}]: dispatch 2024-03-30T14:10:15.082 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:10:14 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.2"}]': finished 2024-03-30T14:10:15.082 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:10:14 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.3"}]: dispatch 2024-03-30T14:10:15.082 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:10:14 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.3"}]: dispatch 2024-03-30T14:10:15.082 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:10:14 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.3"}]': finished 2024-03-30T14:10:15.082 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:10:14 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.4"}]: dispatch 2024-03-30T14:10:15.083 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:10:14 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.4"}]: dispatch 2024-03-30T14:10:15.083 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:10:14 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.4"}]': finished 2024-03-30T14:10:15.083 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:10:14 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.5"}]: dispatch 2024-03-30T14:10:15.083 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:10:14 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.5"}]: dispatch 2024-03-30T14:10:15.083 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:10:14 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.5"}]': finished 2024-03-30T14:10:15.083 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:10:14 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.6"}]: dispatch 2024-03-30T14:10:15.083 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:10:14 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.6"}]: dispatch 2024-03-30T14:10:15.083 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:10:14 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.6"}]': finished 2024-03-30T14:10:15.083 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:10:14 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.7"}]: dispatch 2024-03-30T14:10:15.083 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:10:14 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.7"}]: dispatch 2024-03-30T14:10:15.083 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:10:14 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.7"}]': finished 2024-03-30T14:10:15.083 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:10:14 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "osd require-osd-release", "release": "squid"}]: dispatch 2024-03-30T14:10:15.083 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:10:14 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' cmd=[{"prefix": "osd require-osd-release", "release": "squid"}]: dispatch 2024-03-30T14:10:15.084 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 14:10:14 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[71049]: ::ffff:172.21.15.181 - - [30/Mar/2024:14:10:14] "GET /metrics HTTP/1.1" 200 38366 "" "Prometheus/2.43.0" 2024-03-30T14:10:15.084 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:10:14 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:10:15.084 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:10:14 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:10:15.084 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:10:14 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:10:15.084 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:10:14 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:10:15.084 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:10:14 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:10:15.084 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:10:14 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:10:15.085 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:10:14 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:10:15.085 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:10:14 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:10:15.085 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:10:14 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:10:15.085 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:10:14 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:10:15.085 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:10:14 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:10:15.085 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:10:14 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:10:15.085 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:10:14 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:10:15.085 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:10:14 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:10:15.085 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:10:14 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:10:15.085 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:10:14 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:10:15.085 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:10:14 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:10:15.085 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:10:14 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:10:15.086 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:10:14 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:10:15.086 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:10:14 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:10:15.086 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:10:14 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:10:15.086 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:10:14 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:10:15.086 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:10:14 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:10:15.086 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:10:14 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:10:15.086 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:10:14 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:10:15.086 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:10:14 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:10:15.086 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:10:14 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:10:15.086 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:10:14 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:10:15.086 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:10:14 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:10:15.086 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:10:14 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:10:15.086 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:10:14 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:10:15.086 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:10:14 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:10:15.087 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:10:14 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:10:15.087 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:10:14 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:10:15.087 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:10:14 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:10:15.087 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:10:14 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.0"}]: dispatch 2024-03-30T14:10:15.087 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:10:14 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.0"}]: dispatch 2024-03-30T14:10:15.087 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:10:14 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.0"}]': finished 2024-03-30T14:10:15.087 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:10:14 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.1"}]: dispatch 2024-03-30T14:10:15.087 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:10:14 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.1"}]: dispatch 2024-03-30T14:10:15.087 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:10:14 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.1"}]': finished 2024-03-30T14:10:15.087 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:10:14 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.2"}]: dispatch 2024-03-30T14:10:15.087 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:10:14 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.2"}]: dispatch 2024-03-30T14:10:15.087 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:10:14 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.2"}]': finished 2024-03-30T14:10:15.087 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:10:14 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.3"}]: dispatch 2024-03-30T14:10:15.087 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:10:14 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.3"}]: dispatch 2024-03-30T14:10:15.088 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:10:14 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.3"}]': finished 2024-03-30T14:10:15.088 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:10:14 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.4"}]: dispatch 2024-03-30T14:10:15.089 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:10:14 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.4"}]: dispatch 2024-03-30T14:10:15.089 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:10:14 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.4"}]': finished 2024-03-30T14:10:15.089 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:10:14 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.5"}]: dispatch 2024-03-30T14:10:15.089 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:10:14 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.5"}]: dispatch 2024-03-30T14:10:15.089 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:10:14 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.5"}]': finished 2024-03-30T14:10:15.089 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:10:14 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.6"}]: dispatch 2024-03-30T14:10:15.090 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:10:14 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.6"}]: dispatch 2024-03-30T14:10:15.090 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:10:14 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.6"}]': finished 2024-03-30T14:10:15.090 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:10:14 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.7"}]: dispatch 2024-03-30T14:10:15.090 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:10:14 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.7"}]: dispatch 2024-03-30T14:10:15.090 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:10:14 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.7"}]': finished 2024-03-30T14:10:15.090 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:10:14 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "osd require-osd-release", "release": "squid"}]: dispatch 2024-03-30T14:10:15.090 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:10:14 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' cmd=[{"prefix": "osd require-osd-release", "release": "squid"}]: dispatch 2024-03-30T14:10:15.958 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:10:15 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:10:15.958 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:10:15 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:10:15.958 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:10:15 smithi181 ceph-mon[115276]: pgmap v243: 161 pgs: 29 active+undersized+degraded, 40 active+undersized, 92 active+clean; 585 KiB data, 234 MiB used, 715 GiB / 715 GiB avail; 87/627 objects degraded (13.876%) 2024-03-30T14:10:15.958 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:10:15 smithi181 ceph-mon[115276]: Upgrade: Setting container_image for all osd 2024-03-30T14:10:15.959 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:10:15 smithi181 ceph-mon[115276]: Upgrade: Setting require_osd_release to 19 squid 2024-03-30T14:10:15.959 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:10:15 smithi181 ceph-mon[115276]: Health check update: Degraded data redundancy: 87/627 objects degraded (13.876%), 29 pgs degraded (PG_DEGRADED) 2024-03-30T14:10:15.959 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:10:15 smithi181 ceph-mon[115276]: Health check failed: 1 failed cephadm daemon(s) (CEPHADM_FAILED_DAEMON) 2024-03-30T14:10:15.959 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:10:15 smithi181 ceph-mon[115276]: Health check cleared: OSD_UPGRADE_FINISHED (was: all OSDs are running squid or later but require_osd_release < squid) 2024-03-30T14:10:15.959 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:10:15 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' cmd='[{"prefix": "osd require-osd-release", "release": "squid"}]': finished 2024-03-30T14:10:15.959 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:10:15 smithi181 ceph-mon[115276]: osdmap e151: 8 total, 7 up, 8 in 2024-03-30T14:10:15.959 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:10:15 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:10:15.959 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:10:15 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:10:15.959 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:10:15 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:10:15.959 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:10:15 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:10:15.959 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:10:15 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:10:15.959 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:10:15 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:10:15.959 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:10:15 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:10:15.959 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:10:15 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:10:15.960 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:10:15 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:10:15.960 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:10:15 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:10:15.960 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:10:15 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:10:15.960 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:10:15 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:10:15.960 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:10:15 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:10:15.960 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:10:15 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:10:15.960 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:10:15 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:10:15.960 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:10:15 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:10:15.960 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:10:15 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:10:15.960 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:10:15 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]: dispatch 2024-03-30T14:10:15.960 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:10:15 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]: dispatch 2024-03-30T14:10:15.960 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:10:15 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]': finished 2024-03-30T14:10:15.960 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:10:15 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-03-30T14:10:15.960 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:10:15 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-03-30T14:10:15.960 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:10:15 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon"}]': finished 2024-03-30T14:10:15.960 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:10:15 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]: dispatch 2024-03-30T14:10:15.961 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:10:15 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]: dispatch 2024-03-30T14:10:15.961 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:10:15 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]': finished 2024-03-30T14:10:15.961 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:10:15 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd"}]: dispatch 2024-03-30T14:10:15.961 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:10:15 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd"}]: dispatch 2024-03-30T14:10:15.961 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:10:15 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd"}]': finished 2024-03-30T14:10:15.961 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:10:15 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds"}]: dispatch 2024-03-30T14:10:15.961 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:10:15 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds"}]: dispatch 2024-03-30T14:10:15.961 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:10:15 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds"}]': finished 2024-03-30T14:10:15.961 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:10:15 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]: dispatch 2024-03-30T14:10:15.961 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:10:15 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]: dispatch 2024-03-30T14:10:15.961 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:10:15 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]: dispatch 2024-03-30T14:10:15.961 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:10:15 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]: dispatch 2024-03-30T14:10:15.961 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:10:15 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]': finished 2024-03-30T14:10:15.961 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:10:15 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-03-30T14:10:15.961 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:10:15 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-03-30T14:10:15.962 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:10:15 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"}]: dispatch 2024-03-30T14:10:15.962 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:10:15 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"}]: dispatch 2024-03-30T14:10:15.962 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:10:15 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"}]': finished 2024-03-30T14:10:15.962 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:10:15 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]: dispatch 2024-03-30T14:10:15.962 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:10:15 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]: dispatch 2024-03-30T14:10:15.962 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:10:15 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]: dispatch 2024-03-30T14:10:15.962 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:10:15 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]: dispatch 2024-03-30T14:10:15.962 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:10:15 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]': finished 2024-03-30T14:10:15.962 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:10:15 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]: dispatch 2024-03-30T14:10:15.962 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:10:15 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]: dispatch 2024-03-30T14:10:15.962 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:10:15 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]': finished 2024-03-30T14:10:15.962 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:10:15 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-03-30T14:10:15.962 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:10:15 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-03-30T14:10:15.962 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:10:15 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-03-30T14:10:15.963 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:10:15 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-03-30T14:10:15.963 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:10:15 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-03-30T14:10:15.963 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:10:15 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-03-30T14:10:15.963 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:10:15 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-03-30T14:10:15.963 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:10:15 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-03-30T14:10:15.963 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:10:15 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-03-30T14:10:15.963 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:10:15 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-03-30T14:10:15.963 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:10:15 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-03-30T14:10:15.963 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:10:15 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-03-30T14:10:15.963 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:10:15 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]: dispatch 2024-03-30T14:10:15.963 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:10:15 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' cmd=[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]: dispatch 2024-03-30T14:10:15.963 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:10:15 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' cmd='[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]': finished 2024-03-30T14:10:15.963 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:10:15 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:10:15.964 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:10:15 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:10:15.964 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:10:15 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:10:15.964 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:10:15 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:10:15.964 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:10:15 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:10:15.964 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:10:15 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:10:16.078 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:10:15 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:10:16.078 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:10:15 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:10:16.079 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:10:15 smithi099 ceph-mon[137093]: pgmap v243: 161 pgs: 29 active+undersized+degraded, 40 active+undersized, 92 active+clean; 585 KiB data, 234 MiB used, 715 GiB / 715 GiB avail; 87/627 objects degraded (13.876%) 2024-03-30T14:10:16.079 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:10:15 smithi099 ceph-mon[137093]: Upgrade: Setting container_image for all osd 2024-03-30T14:10:16.079 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:10:15 smithi099 ceph-mon[137093]: Upgrade: Setting require_osd_release to 19 squid 2024-03-30T14:10:16.079 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:10:15 smithi099 ceph-mon[137093]: Health check update: Degraded data redundancy: 87/627 objects degraded (13.876%), 29 pgs degraded (PG_DEGRADED) 2024-03-30T14:10:16.079 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:10:15 smithi099 ceph-mon[137093]: Health check failed: 1 failed cephadm daemon(s) (CEPHADM_FAILED_DAEMON) 2024-03-30T14:10:16.079 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:10:15 smithi099 ceph-mon[137093]: Health check cleared: OSD_UPGRADE_FINISHED (was: all OSDs are running squid or later but require_osd_release < squid) 2024-03-30T14:10:16.079 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:10:15 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' cmd='[{"prefix": "osd require-osd-release", "release": "squid"}]': finished 2024-03-30T14:10:16.079 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:10:15 smithi099 ceph-mon[137093]: osdmap e151: 8 total, 7 up, 8 in 2024-03-30T14:10:16.079 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:10:15 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:10:16.079 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:10:15 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:10:16.079 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:10:15 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:10:16.079 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:10:15 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:10:16.079 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:10:15 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:10:16.080 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:10:15 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:10:16.080 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:10:15 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:10:16.080 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:10:15 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:10:16.080 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:10:15 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:10:16.080 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:10:15 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:10:16.080 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:10:15 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:10:16.080 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:10:15 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:10:16.080 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:10:15 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:10:16.080 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:10:15 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:10:16.080 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:10:15 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:10:16.080 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:10:15 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:10:16.080 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:10:15 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:10:16.080 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:10:15 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]: dispatch 2024-03-30T14:10:16.080 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:10:15 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]: dispatch 2024-03-30T14:10:16.080 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:10:15 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]': finished 2024-03-30T14:10:16.080 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:10:15 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-03-30T14:10:16.081 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:10:15 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:10:16.081 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:10:15 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:10:16.081 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:10:15 smithi099 ceph-mon[143401]: pgmap v243: 161 pgs: 29 active+undersized+degraded, 40 active+undersized, 92 active+clean; 585 KiB data, 234 MiB used, 715 GiB / 715 GiB avail; 87/627 objects degraded (13.876%) 2024-03-30T14:10:16.081 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:10:15 smithi099 ceph-mon[143401]: Upgrade: Setting container_image for all osd 2024-03-30T14:10:16.081 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:10:15 smithi099 ceph-mon[143401]: Upgrade: Setting require_osd_release to 19 squid 2024-03-30T14:10:16.081 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:10:15 smithi099 ceph-mon[143401]: Health check update: Degraded data redundancy: 87/627 objects degraded (13.876%), 29 pgs degraded (PG_DEGRADED) 2024-03-30T14:10:16.081 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:10:15 smithi099 ceph-mon[143401]: Health check failed: 1 failed cephadm daemon(s) (CEPHADM_FAILED_DAEMON) 2024-03-30T14:10:16.081 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:10:15 smithi099 ceph-mon[143401]: Health check cleared: OSD_UPGRADE_FINISHED (was: all OSDs are running squid or later but require_osd_release < squid) 2024-03-30T14:10:16.081 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:10:15 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' cmd='[{"prefix": "osd require-osd-release", "release": "squid"}]': finished 2024-03-30T14:10:16.082 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:10:15 smithi099 ceph-mon[143401]: osdmap e151: 8 total, 7 up, 8 in 2024-03-30T14:10:16.082 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:10:15 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:10:16.082 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:10:15 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:10:16.082 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:10:15 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:10:16.082 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:10:15 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:10:16.082 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:10:15 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:10:16.082 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:10:15 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:10:16.082 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:10:15 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:10:16.082 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:10:15 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:10:16.082 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:10:15 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:10:16.082 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:10:15 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:10:16.082 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:10:15 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:10:16.082 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:10:15 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:10:16.082 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:10:15 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:10:16.082 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:10:15 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:10:16.083 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:10:15 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:10:16.083 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:10:15 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:10:16.083 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:10:15 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:10:16.083 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:10:15 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]: dispatch 2024-03-30T14:10:16.083 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:10:15 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]: dispatch 2024-03-30T14:10:16.083 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:10:15 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]': finished 2024-03-30T14:10:16.083 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:10:15 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-03-30T14:10:16.083 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:10:15 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-03-30T14:10:16.083 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:10:15 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon"}]': finished 2024-03-30T14:10:16.083 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:10:15 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]: dispatch 2024-03-30T14:10:16.083 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:10:15 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]: dispatch 2024-03-30T14:10:16.083 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:10:15 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]': finished 2024-03-30T14:10:16.083 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:10:15 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd"}]: dispatch 2024-03-30T14:10:16.083 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:10:15 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd"}]: dispatch 2024-03-30T14:10:16.083 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:10:15 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd"}]': finished 2024-03-30T14:10:16.084 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:10:15 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds"}]: dispatch 2024-03-30T14:10:16.084 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:10:15 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds"}]: dispatch 2024-03-30T14:10:16.084 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:10:15 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds"}]': finished 2024-03-30T14:10:16.084 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:10:15 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]: dispatch 2024-03-30T14:10:16.084 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:10:15 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]: dispatch 2024-03-30T14:10:16.084 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:10:15 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]: dispatch 2024-03-30T14:10:16.084 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:10:15 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]: dispatch 2024-03-30T14:10:16.084 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:10:15 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]': finished 2024-03-30T14:10:16.084 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:10:15 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-03-30T14:10:16.084 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:10:15 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-03-30T14:10:16.084 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:10:15 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"}]: dispatch 2024-03-30T14:10:16.084 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:10:15 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"}]: dispatch 2024-03-30T14:10:16.084 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:10:15 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"}]': finished 2024-03-30T14:10:16.084 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:10:15 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]: dispatch 2024-03-30T14:10:16.084 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:10:15 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]: dispatch 2024-03-30T14:10:16.085 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:10:15 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-03-30T14:10:16.085 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:10:15 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon"}]': finished 2024-03-30T14:10:16.085 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:10:15 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]: dispatch 2024-03-30T14:10:16.085 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:10:15 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]: dispatch 2024-03-30T14:10:16.085 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:10:15 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]': finished 2024-03-30T14:10:16.085 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:10:15 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd"}]: dispatch 2024-03-30T14:10:16.085 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:10:15 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd"}]: dispatch 2024-03-30T14:10:16.085 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:10:15 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd"}]': finished 2024-03-30T14:10:16.085 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:10:15 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds"}]: dispatch 2024-03-30T14:10:16.085 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:10:15 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds"}]: dispatch 2024-03-30T14:10:16.085 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:10:15 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds"}]': finished 2024-03-30T14:10:16.085 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:10:15 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]: dispatch 2024-03-30T14:10:16.086 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:10:15 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]: dispatch 2024-03-30T14:10:16.086 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:10:15 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]: dispatch 2024-03-30T14:10:16.086 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:10:15 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]: dispatch 2024-03-30T14:10:16.086 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:10:15 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]': finished 2024-03-30T14:10:16.086 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:10:15 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-03-30T14:10:16.086 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:10:15 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-03-30T14:10:16.086 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:10:15 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"}]: dispatch 2024-03-30T14:10:16.086 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:10:15 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"}]: dispatch 2024-03-30T14:10:16.086 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:10:15 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"}]': finished 2024-03-30T14:10:16.086 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:10:15 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]: dispatch 2024-03-30T14:10:16.086 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:10:15 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]: dispatch 2024-03-30T14:10:16.087 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:10:15 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]: dispatch 2024-03-30T14:10:16.087 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:10:15 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]: dispatch 2024-03-30T14:10:16.087 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:10:15 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]': finished 2024-03-30T14:10:16.087 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:10:15 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]: dispatch 2024-03-30T14:10:16.087 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:10:15 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]: dispatch 2024-03-30T14:10:16.087 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:10:15 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]': finished 2024-03-30T14:10:16.087 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:10:15 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-03-30T14:10:16.087 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:10:15 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-03-30T14:10:16.087 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:10:15 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-03-30T14:10:16.087 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:10:15 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-03-30T14:10:16.087 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:10:15 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-03-30T14:10:16.087 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:10:15 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-03-30T14:10:16.087 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:10:15 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-03-30T14:10:16.088 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:10:15 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-03-30T14:10:16.088 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:10:15 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-03-30T14:10:16.088 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:10:15 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-03-30T14:10:16.088 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:10:15 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-03-30T14:10:16.088 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:10:15 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-03-30T14:10:16.088 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:10:15 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]: dispatch 2024-03-30T14:10:16.088 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:10:15 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' cmd=[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]: dispatch 2024-03-30T14:10:16.088 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:10:15 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' cmd='[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]': finished 2024-03-30T14:10:16.088 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:10:15 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:10:16.088 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:10:15 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:10:16.088 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:10:15 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:10:16.088 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:10:15 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:10:16.089 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:10:15 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]: dispatch 2024-03-30T14:10:16.089 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:10:15 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]: dispatch 2024-03-30T14:10:16.089 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:10:15 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]': finished 2024-03-30T14:10:16.089 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:10:15 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]: dispatch 2024-03-30T14:10:16.089 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:10:15 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]: dispatch 2024-03-30T14:10:16.089 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:10:15 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]': finished 2024-03-30T14:10:16.089 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:10:15 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-03-30T14:10:16.089 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:10:15 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-03-30T14:10:16.089 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:10:15 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-03-30T14:10:16.089 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:10:15 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-03-30T14:10:16.089 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:10:15 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-03-30T14:10:16.089 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:10:15 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-03-30T14:10:16.089 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:10:15 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-03-30T14:10:16.089 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:10:15 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-03-30T14:10:16.090 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:10:15 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-03-30T14:10:16.090 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:10:15 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-03-30T14:10:16.090 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:10:15 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-03-30T14:10:16.090 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:10:15 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-03-30T14:10:16.090 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:10:15 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]: dispatch 2024-03-30T14:10:16.090 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:10:15 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' cmd=[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]: dispatch 2024-03-30T14:10:16.090 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:10:15 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' cmd='[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]': finished 2024-03-30T14:10:16.090 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:10:15 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:10:16.090 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:10:15 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:10:16.090 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:10:15 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:10:16.090 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:10:15 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:10:16.091 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:10:15 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:10:16.091 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:10:15 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:10:16.091 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:10:15 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:10:16.091 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:10:15 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:10:16.240 INFO:journalctl@ceph.osd.7.smithi181.stdout:Mar 30 14:10:15 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-7[162666]: 2024-03-30T14:10:15.964+0000 7f8a077d27c0 -1 osd.7 0 read_superblock omap replica is missing. 2024-03-30T14:10:16.240 INFO:journalctl@ceph.osd.7.smithi181.stdout:Mar 30 14:10:15 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-7[162666]: 2024-03-30T14:10:15.993+0000 7f8a077d27c0 -1 osd.7 148 log_to_monitors true 2024-03-30T14:10:16.997 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:10:16 smithi181 ceph-mon[115276]: Upgrade: Setting container_image for all mds 2024-03-30T14:10:16.998 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:10:16 smithi181 ceph-mon[115276]: Upgrade: Setting container_image for all rbd-mirror 2024-03-30T14:10:16.998 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:10:16 smithi181 ceph-mon[115276]: Upgrade: Setting container_image for all ceph-exporter 2024-03-30T14:10:16.998 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:10:16 smithi181 ceph-mon[115276]: Upgrade: Setting container_image for all nfs 2024-03-30T14:10:16.998 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:10:16 smithi181 ceph-mon[115276]: Upgrade: Setting container_image for all nvmeof 2024-03-30T14:10:16.998 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:10:16 smithi181 ceph-mon[115276]: Upgrade: Finalizing container_image settings 2024-03-30T14:10:16.998 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:10:16 smithi181 ceph-mon[115276]: Upgrade: Complete! 2024-03-30T14:10:16.998 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:10:16 smithi181 ceph-mon[115276]: pgmap v245: 161 pgs: 29 active+undersized+degraded, 40 active+undersized, 92 active+clean; 585 KiB data, 234 MiB used, 715 GiB / 715 GiB avail; 87/627 objects degraded (13.876%) 2024-03-30T14:10:16.998 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:10:16 smithi181 ceph-mon[115276]: pgmap v246: 161 pgs: 29 active+undersized+degraded, 40 active+undersized, 92 active+clean; 585 KiB data, 234 MiB used, 715 GiB / 715 GiB avail; 87/627 objects degraded (13.876%) 2024-03-30T14:10:16.998 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:10:16 smithi181 ceph-mon[115276]: pgmap v247: 161 pgs: 29 active+undersized+degraded, 40 active+undersized, 92 active+clean; 585 KiB data, 234 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s; 87/627 objects degraded (13.876%) 2024-03-30T14:10:16.998 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:10:16 smithi181 ceph-mon[115276]: pgmap v248: 161 pgs: 29 active+undersized+degraded, 40 active+undersized, 92 active+clean; 585 KiB data, 234 MiB used, 715 GiB / 715 GiB avail; 87/627 objects degraded (13.876%) 2024-03-30T14:10:16.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:10:16 smithi181 ceph-mon[115276]: from='osd.7 [v2:172.21.15.181:6824/2664508587,v1:172.21.15.181:6825/2664508587]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-03-30T14:10:16.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:10:16 smithi181 ceph-mon[115276]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-03-30T14:10:17.078 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:10:16 smithi099 ceph-mon[143401]: Upgrade: Setting container_image for all mds 2024-03-30T14:10:17.078 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:10:16 smithi099 ceph-mon[143401]: Upgrade: Setting container_image for all rbd-mirror 2024-03-30T14:10:17.078 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:10:16 smithi099 ceph-mon[143401]: Upgrade: Setting container_image for all ceph-exporter 2024-03-30T14:10:17.078 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:10:16 smithi099 ceph-mon[143401]: Upgrade: Setting container_image for all nfs 2024-03-30T14:10:17.078 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:10:16 smithi099 ceph-mon[143401]: Upgrade: Setting container_image for all nvmeof 2024-03-30T14:10:17.078 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:10:16 smithi099 ceph-mon[143401]: Upgrade: Finalizing container_image settings 2024-03-30T14:10:17.079 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:10:16 smithi099 ceph-mon[143401]: Upgrade: Complete! 2024-03-30T14:10:17.079 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:10:16 smithi099 ceph-mon[143401]: pgmap v245: 161 pgs: 29 active+undersized+degraded, 40 active+undersized, 92 active+clean; 585 KiB data, 234 MiB used, 715 GiB / 715 GiB avail; 87/627 objects degraded (13.876%) 2024-03-30T14:10:17.079 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:10:16 smithi099 ceph-mon[143401]: pgmap v246: 161 pgs: 29 active+undersized+degraded, 40 active+undersized, 92 active+clean; 585 KiB data, 234 MiB used, 715 GiB / 715 GiB avail; 87/627 objects degraded (13.876%) 2024-03-30T14:10:17.079 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:10:16 smithi099 ceph-mon[143401]: pgmap v247: 161 pgs: 29 active+undersized+degraded, 40 active+undersized, 92 active+clean; 585 KiB data, 234 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s; 87/627 objects degraded (13.876%) 2024-03-30T14:10:17.079 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:10:16 smithi099 ceph-mon[143401]: pgmap v248: 161 pgs: 29 active+undersized+degraded, 40 active+undersized, 92 active+clean; 585 KiB data, 234 MiB used, 715 GiB / 715 GiB avail; 87/627 objects degraded (13.876%) 2024-03-30T14:10:17.079 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:10:16 smithi099 ceph-mon[143401]: from='osd.7 [v2:172.21.15.181:6824/2664508587,v1:172.21.15.181:6825/2664508587]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-03-30T14:10:17.079 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:10:16 smithi099 ceph-mon[143401]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-03-30T14:10:17.079 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:10:16 smithi099 ceph-mon[137093]: Upgrade: Setting container_image for all mds 2024-03-30T14:10:17.079 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:10:16 smithi099 ceph-mon[137093]: Upgrade: Setting container_image for all rbd-mirror 2024-03-30T14:10:17.079 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:10:16 smithi099 ceph-mon[137093]: Upgrade: Setting container_image for all ceph-exporter 2024-03-30T14:10:17.079 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:10:16 smithi099 ceph-mon[137093]: Upgrade: Setting container_image for all nfs 2024-03-30T14:10:17.079 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:10:16 smithi099 ceph-mon[137093]: Upgrade: Setting container_image for all nvmeof 2024-03-30T14:10:17.080 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:10:16 smithi099 ceph-mon[137093]: Upgrade: Finalizing container_image settings 2024-03-30T14:10:17.080 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:10:16 smithi099 ceph-mon[137093]: Upgrade: Complete! 2024-03-30T14:10:17.080 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:10:16 smithi099 ceph-mon[137093]: pgmap v245: 161 pgs: 29 active+undersized+degraded, 40 active+undersized, 92 active+clean; 585 KiB data, 234 MiB used, 715 GiB / 715 GiB avail; 87/627 objects degraded (13.876%) 2024-03-30T14:10:17.080 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:10:16 smithi099 ceph-mon[137093]: pgmap v246: 161 pgs: 29 active+undersized+degraded, 40 active+undersized, 92 active+clean; 585 KiB data, 234 MiB used, 715 GiB / 715 GiB avail; 87/627 objects degraded (13.876%) 2024-03-30T14:10:17.080 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:10:16 smithi099 ceph-mon[137093]: pgmap v247: 161 pgs: 29 active+undersized+degraded, 40 active+undersized, 92 active+clean; 585 KiB data, 234 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s; 87/627 objects degraded (13.876%) 2024-03-30T14:10:17.080 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:10:16 smithi099 ceph-mon[137093]: pgmap v248: 161 pgs: 29 active+undersized+degraded, 40 active+undersized, 92 active+clean; 585 KiB data, 234 MiB used, 715 GiB / 715 GiB avail; 87/627 objects degraded (13.876%) 2024-03-30T14:10:17.080 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:10:16 smithi099 ceph-mon[137093]: from='osd.7 [v2:172.21.15.181:6824/2664508587,v1:172.21.15.181:6825/2664508587]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-03-30T14:10:17.080 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:10:16 smithi099 ceph-mon[137093]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-03-30T14:10:17.432 INFO:journalctl@ceph.osd.7.smithi181.stdout:Mar 30 14:10:17 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-7[162666]: 2024-03-30T14:10:17.175+0000 7f89f4c22700 -1 osd.7 148 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-03-30T14:10:17.997 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:10:17 smithi181 ceph-mon[115276]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-03-30T14:10:17.997 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:10:17 smithi181 ceph-mon[115276]: from='osd.7 [v2:172.21.15.181:6824/2664508587,v1:172.21.15.181:6825/2664508587]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi181", "root=default"]}]: dispatch 2024-03-30T14:10:17.997 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:10:17 smithi181 ceph-mon[115276]: osdmap e152: 8 total, 7 up, 8 in 2024-03-30T14:10:17.997 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:10:17 smithi181 ceph-mon[115276]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi181", "root=default"]}]: dispatch 2024-03-30T14:10:17.997 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:10:17 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:10:17.997 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:10:17 smithi181 ceph-mon[115276]: from='osd.7 ' entity='osd.7' 2024-03-30T14:10:18.034 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:10:17 smithi099 ceph-mon[137093]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-03-30T14:10:18.034 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:10:17 smithi099 ceph-mon[137093]: from='osd.7 [v2:172.21.15.181:6824/2664508587,v1:172.21.15.181:6825/2664508587]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi181", "root=default"]}]: dispatch 2024-03-30T14:10:18.034 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:10:17 smithi099 ceph-mon[137093]: osdmap e152: 8 total, 7 up, 8 in 2024-03-30T14:10:18.034 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:10:17 smithi099 ceph-mon[137093]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi181", "root=default"]}]: dispatch 2024-03-30T14:10:18.034 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:10:17 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:10:18.034 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:10:17 smithi099 ceph-mon[137093]: from='osd.7 ' entity='osd.7' 2024-03-30T14:10:18.034 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:10:17 smithi099 ceph-mon[143401]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-03-30T14:10:18.035 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:10:17 smithi099 ceph-mon[143401]: from='osd.7 [v2:172.21.15.181:6824/2664508587,v1:172.21.15.181:6825/2664508587]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi181", "root=default"]}]: dispatch 2024-03-30T14:10:18.035 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:10:17 smithi099 ceph-mon[143401]: osdmap e152: 8 total, 7 up, 8 in 2024-03-30T14:10:18.035 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:10:17 smithi099 ceph-mon[143401]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi181", "root=default"]}]: dispatch 2024-03-30T14:10:18.035 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:10:17 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:10:18.035 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:10:17 smithi099 ceph-mon[143401]: from='osd.7 ' entity='osd.7' 2024-03-30T14:10:18.959 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:10:18 smithi181 ceph-mon[115276]: pgmap v250: 161 pgs: 29 active+undersized+degraded, 40 active+undersized, 92 active+clean; 585 KiB data, 244 MiB used, 715 GiB / 715 GiB avail; 2.3 KiB/s rd, 2 op/s; 87/627 objects degraded (13.876%) 2024-03-30T14:10:18.959 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:10:18 smithi181 ceph-mon[115276]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-03-30T14:10:18.959 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:10:18 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-03-30T14:10:18.959 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:10:18 smithi181 ceph-mon[115276]: osd.7 [v2:172.21.15.181:6824/2664508587,v1:172.21.15.181:6825/2664508587] boot 2024-03-30T14:10:18.959 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:10:18 smithi181 ceph-mon[115276]: osdmap e153: 8 total, 8 up, 8 in 2024-03-30T14:10:19.078 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:10:18 smithi099 ceph-mon[143401]: pgmap v250: 161 pgs: 29 active+undersized+degraded, 40 active+undersized, 92 active+clean; 585 KiB data, 244 MiB used, 715 GiB / 715 GiB avail; 2.3 KiB/s rd, 2 op/s; 87/627 objects degraded (13.876%) 2024-03-30T14:10:19.078 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:10:18 smithi099 ceph-mon[143401]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-03-30T14:10:19.078 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:10:18 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-03-30T14:10:19.078 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:10:18 smithi099 ceph-mon[143401]: osd.7 [v2:172.21.15.181:6824/2664508587,v1:172.21.15.181:6825/2664508587] boot 2024-03-30T14:10:19.078 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:10:18 smithi099 ceph-mon[143401]: osdmap e153: 8 total, 8 up, 8 in 2024-03-30T14:10:19.078 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:10:18 smithi099 ceph-mon[137093]: pgmap v250: 161 pgs: 29 active+undersized+degraded, 40 active+undersized, 92 active+clean; 585 KiB data, 244 MiB used, 715 GiB / 715 GiB avail; 2.3 KiB/s rd, 2 op/s; 87/627 objects degraded (13.876%) 2024-03-30T14:10:19.079 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:10:18 smithi099 ceph-mon[137093]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-03-30T14:10:19.079 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:10:18 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-03-30T14:10:19.079 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:10:18 smithi099 ceph-mon[137093]: osd.7 [v2:172.21.15.181:6824/2664508587,v1:172.21.15.181:6825/2664508587] boot 2024-03-30T14:10:19.079 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:10:18 smithi099 ceph-mon[137093]: osdmap e153: 8 total, 8 up, 8 in 2024-03-30T14:10:19.997 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:10:19 smithi181 ceph-mon[115276]: from='client.25136 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T14:10:19.997 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:10:19 smithi181 ceph-mon[115276]: osdmap e154: 8 total, 8 up, 8 in 2024-03-30T14:10:20.078 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:10:19 smithi099 ceph-mon[137093]: from='client.25136 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T14:10:20.078 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:10:19 smithi099 ceph-mon[137093]: osdmap e154: 8 total, 8 up, 8 in 2024-03-30T14:10:20.078 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:10:19 smithi099 ceph-mon[143401]: from='client.25136 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T14:10:20.078 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:10:19 smithi099 ceph-mon[143401]: osdmap e154: 8 total, 8 up, 8 in 2024-03-30T14:10:20.960 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:10:20 smithi181 ceph-mon[115276]: pgmap v253: 161 pgs: 4 peering, 23 active+undersized+degraded, 38 active+undersized, 96 active+clean; 585 KiB data, 244 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s; 72/627 objects degraded (11.483%) 2024-03-30T14:10:20.960 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:10:20 smithi181 ceph-mon[115276]: Health check update: Degraded data redundancy: 72/627 objects degraded (11.483%), 23 pgs degraded (PG_DEGRADED) 2024-03-30T14:10:21.078 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:10:20 smithi099 ceph-mon[137093]: pgmap v253: 161 pgs: 4 peering, 23 active+undersized+degraded, 38 active+undersized, 96 active+clean; 585 KiB data, 244 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s; 72/627 objects degraded (11.483%) 2024-03-30T14:10:21.078 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:10:20 smithi099 ceph-mon[137093]: Health check update: Degraded data redundancy: 72/627 objects degraded (11.483%), 23 pgs degraded (PG_DEGRADED) 2024-03-30T14:10:21.078 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:10:20 smithi099 ceph-mon[143401]: pgmap v253: 161 pgs: 4 peering, 23 active+undersized+degraded, 38 active+undersized, 96 active+clean; 585 KiB data, 244 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s; 72/627 objects degraded (11.483%) 2024-03-30T14:10:21.078 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:10:20 smithi099 ceph-mon[143401]: Health check update: Degraded data redundancy: 72/627 objects degraded (11.483%), 23 pgs degraded (PG_DEGRADED) 2024-03-30T14:10:22.747 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:10:22 smithi181 ceph-mon[115276]: pgmap v254: 161 pgs: 4 peering, 12 active+undersized+degraded, 17 active+undersized, 128 active+clean; 585 KiB data, 244 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 1 op/s; 46/627 objects degraded (7.337%) 2024-03-30T14:10:22.748 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:10:22 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:10:22.748 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:10:22 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:10:22.748 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:10:22 smithi181 ceph-mon[115276]: pgmap v255: 161 pgs: 4 peering, 12 active+undersized+degraded, 17 active+undersized, 128 active+clean; 585 KiB data, 244 MiB used, 715 GiB / 715 GiB avail; 1.0 KiB/s rd, 1 op/s; 46/627 objects degraded (7.337%) 2024-03-30T14:10:22.748 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:10:22 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:10:22.748 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:10:22 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:10:22.748 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:10:22 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:10:22.748 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:10:22 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:10:22.748 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:10:22 smithi181 ceph-mon[115276]: Health check cleared: CEPHADM_FAILED_DAEMON (was: 1 failed cephadm daemon(s)) 2024-03-30T14:10:22.748 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:10:22 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:10:22.748 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:10:22 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T14:10:22.828 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:10:22 smithi099 ceph-mon[137093]: pgmap v254: 161 pgs: 4 peering, 12 active+undersized+degraded, 17 active+undersized, 128 active+clean; 585 KiB data, 244 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 1 op/s; 46/627 objects degraded (7.337%) 2024-03-30T14:10:22.828 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:10:22 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:10:22.828 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:10:22 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:10:22.828 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:10:22 smithi099 ceph-mon[137093]: pgmap v255: 161 pgs: 4 peering, 12 active+undersized+degraded, 17 active+undersized, 128 active+clean; 585 KiB data, 244 MiB used, 715 GiB / 715 GiB avail; 1.0 KiB/s rd, 1 op/s; 46/627 objects degraded (7.337%) 2024-03-30T14:10:22.828 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:10:22 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:10:22.828 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:10:22 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:10:22.829 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:10:22 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:10:22.829 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:10:22 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:10:22.829 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:10:22 smithi099 ceph-mon[137093]: Health check cleared: CEPHADM_FAILED_DAEMON (was: 1 failed cephadm daemon(s)) 2024-03-30T14:10:22.829 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:10:22 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:10:22.829 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:10:22 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T14:10:22.829 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:10:22 smithi099 ceph-mon[143401]: pgmap v254: 161 pgs: 4 peering, 12 active+undersized+degraded, 17 active+undersized, 128 active+clean; 585 KiB data, 244 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 1 op/s; 46/627 objects degraded (7.337%) 2024-03-30T14:10:22.829 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:10:22 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:10:22.829 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:10:22 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:10:22.829 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:10:22 smithi099 ceph-mon[143401]: pgmap v255: 161 pgs: 4 peering, 12 active+undersized+degraded, 17 active+undersized, 128 active+clean; 585 KiB data, 244 MiB used, 715 GiB / 715 GiB avail; 1.0 KiB/s rd, 1 op/s; 46/627 objects degraded (7.337%) 2024-03-30T14:10:22.829 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:10:22 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:10:22.829 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:10:22 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:10:22.830 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:10:22 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:10:22.830 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:10:22 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:10:22.830 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:10:22 smithi099 ceph-mon[143401]: Health check cleared: CEPHADM_FAILED_DAEMON (was: 1 failed cephadm daemon(s)) 2024-03-30T14:10:22.830 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:10:22 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:10:22.830 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:10:22 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T14:10:24.489 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:10:24 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:10:24.489 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:10:24 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:10:24.489 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:10:24 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:10:24.489 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:10:24 smithi099 ceph-mon[143401]: pgmap v256: 161 pgs: 4 peering, 157 active+clean; 585 KiB data, 245 MiB used, 715 GiB / 715 GiB avail; 822 B/s rd, 0 op/s 2024-03-30T14:10:24.489 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:10:24 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:10:24.489 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:10:24 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:10:24.490 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:10:24 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:10:24.490 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:10:24 smithi099 ceph-mon[137093]: pgmap v256: 161 pgs: 4 peering, 157 active+clean; 585 KiB data, 245 MiB used, 715 GiB / 715 GiB avail; 822 B/s rd, 0 op/s 2024-03-30T14:10:24.496 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:10:24 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:10:24.497 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:10:24 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:10:24.497 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:10:24 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:10:24.497 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:10:24 smithi181 ceph-mon[115276]: pgmap v256: 161 pgs: 4 peering, 157 active+clean; 585 KiB data, 245 MiB used, 715 GiB / 715 GiB avail; 822 B/s rd, 0 op/s 2024-03-30T14:10:25.044 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 14:10:24 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[71049]: ::ffff:172.21.15.181 - - [30/Mar/2024:14:10:24] "GET /metrics HTTP/1.1" 200 38378 "" "Prometheus/2.43.0" 2024-03-30T14:10:25.328 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:10:25 smithi099 ceph-mon[137093]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 46/627 objects degraded (7.337%), 12 pgs degraded) 2024-03-30T14:10:25.328 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:10:25 smithi099 ceph-mon[137093]: Cluster is now healthy 2024-03-30T14:10:25.328 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:10:25 smithi099 ceph-mon[143401]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 46/627 objects degraded (7.337%), 12 pgs degraded) 2024-03-30T14:10:25.328 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:10:25 smithi099 ceph-mon[143401]: Cluster is now healthy 2024-03-30T14:10:25.497 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:10:25 smithi181 ceph-mon[115276]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 46/627 objects degraded (7.337%), 12 pgs degraded) 2024-03-30T14:10:25.497 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:10:25 smithi181 ceph-mon[115276]: Cluster is now healthy 2024-03-30T14:10:26.328 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:10:26 smithi099 ceph-mon[137093]: pgmap v257: 161 pgs: 161 active+clean; 585 KiB data, 245 MiB used, 715 GiB / 715 GiB avail; 698 B/s rd, 0 op/s 2024-03-30T14:10:26.328 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:10:26 smithi099 ceph-mon[143401]: pgmap v257: 161 pgs: 161 active+clean; 585 KiB data, 245 MiB used, 715 GiB / 715 GiB avail; 698 B/s rd, 0 op/s 2024-03-30T14:10:26.496 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:10:26 smithi181 ceph-mon[115276]: pgmap v257: 161 pgs: 161 active+clean; 585 KiB data, 245 MiB used, 715 GiB / 715 GiB avail; 698 B/s rd, 0 op/s 2024-03-30T14:10:28.828 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:10:28 smithi099 ceph-mon[137093]: pgmap v258: 161 pgs: 161 active+clean; 585 KiB data, 245 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T14:10:28.828 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:10:28 smithi099 ceph-mon[143401]: pgmap v258: 161 pgs: 161 active+clean; 585 KiB data, 245 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T14:10:28.997 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:10:28 smithi181 ceph-mon[115276]: pgmap v258: 161 pgs: 161 active+clean; 585 KiB data, 245 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T14:10:29.828 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:10:29 smithi099 ceph-mon[137093]: from='client.25136 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T14:10:29.828 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:10:29 smithi099 ceph-mon[143401]: from='client.25136 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T14:10:29.997 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:10:29 smithi181 ceph-mon[115276]: from='client.25136 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T14:10:30.828 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:10:30 smithi099 ceph-mon[137093]: pgmap v259: 161 pgs: 161 active+clean; 585 KiB data, 245 MiB used, 715 GiB / 715 GiB avail; 1001 B/s rd, 0 op/s 2024-03-30T14:10:30.828 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:10:30 smithi099 ceph-mon[143401]: pgmap v259: 161 pgs: 161 active+clean; 585 KiB data, 245 MiB used, 715 GiB / 715 GiB avail; 1001 B/s rd, 0 op/s 2024-03-30T14:10:30.997 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:10:30 smithi181 ceph-mon[115276]: pgmap v259: 161 pgs: 161 active+clean; 585 KiB data, 245 MiB used, 715 GiB / 715 GiB avail; 1001 B/s rd, 0 op/s 2024-03-30T14:10:32.747 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:10:32 smithi181 ceph-mon[115276]: pgmap v260: 161 pgs: 161 active+clean; 585 KiB data, 245 MiB used, 715 GiB / 715 GiB avail; 1001 B/s rd, 0 op/s 2024-03-30T14:10:32.747 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:10:32 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:10:32.828 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:10:32 smithi099 ceph-mon[137093]: pgmap v260: 161 pgs: 161 active+clean; 585 KiB data, 245 MiB used, 715 GiB / 715 GiB avail; 1001 B/s rd, 0 op/s 2024-03-30T14:10:32.828 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:10:32 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:10:32.828 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:10:32 smithi099 ceph-mon[143401]: pgmap v260: 161 pgs: 161 active+clean; 585 KiB data, 245 MiB used, 715 GiB / 715 GiB avail; 1001 B/s rd, 0 op/s 2024-03-30T14:10:32.828 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:10:32 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:10:33.647 DEBUG:teuthology.orchestra.run.smithi099:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 98ebaeb8-ee99-11ee-b647-cb9ed24678a4 -e sha1=4e50bbcdd1630c7760b708f3a5b4d38a121e66cb -- bash -c 'ceph orch ps' 2024-03-30T14:10:34.828 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:10:34 smithi099 ceph-mon[137093]: from='client.54540 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T14:10:34.828 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:10:34 smithi099 ceph-mon[137093]: pgmap v261: 161 pgs: 161 active+clean; 585 KiB data, 245 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T14:10:34.828 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 14:10:34 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[71049]: ::ffff:172.21.15.181 - - [30/Mar/2024:14:10:34] "GET /metrics HTTP/1.1" 200 38378 "" "Prometheus/2.43.0" 2024-03-30T14:10:34.828 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:10:34 smithi099 ceph-mon[143401]: from='client.54540 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T14:10:34.829 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:10:34 smithi099 ceph-mon[143401]: pgmap v261: 161 pgs: 161 active+clean; 585 KiB data, 245 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T14:10:34.876 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:10:34 smithi181 ceph-mon[115276]: from='client.54540 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T14:10:34.876 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:10:34 smithi181 ceph-mon[115276]: pgmap v261: 161 pgs: 161 active+clean; 585 KiB data, 245 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T14:10:35.788 INFO:teuthology.orchestra.run.smithi099.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-03-30T14:10:35.789 INFO:teuthology.orchestra.run.smithi099.stdout:agent.smithi099 smithi099 running 12s ago 38m - - 2024-03-30T14:10:35.789 INFO:teuthology.orchestra.run.smithi099.stdout:agent.smithi181 smithi181 running 14s ago 38m - - 2024-03-30T14:10:35.789 INFO:teuthology.orchestra.run.smithi099.stdout:alertmanager.a smithi099 *:9093,9094 running (9m) 12s ago 33m 26.9M - 0.25.0 c8568f914cd2 08735152b67d 2024-03-30T14:10:35.789 INFO:teuthology.orchestra.run.smithi099.stdout:grafana.a smithi181 *:3000 running (8m) 14s ago 32m 79.4M - 9.4.12 2bacad6d85d8 d599aa7730d6 2024-03-30T14:10:35.789 INFO:teuthology.orchestra.run.smithi099.stdout:iscsi.foo.smithi099.qyjuvr smithi099 running (11m) 12s ago 32m 61.9M - 3.5 e1d6a67b021e 2f859af6bc2a 2024-03-30T14:10:35.789 INFO:teuthology.orchestra.run.smithi099.stdout:mgr.x smithi181 *:8443,9283,8765 running (11m) 14s ago 38m 451M - 19.0.0-1967-g4e50bbcd b0c4478f1d83 f269106f7913 2024-03-30T14:10:35.789 INFO:teuthology.orchestra.run.smithi099.stdout:mgr.y smithi099 *:8443,9283,8765 running (21m) 12s ago 39m 529M - 19.0.0-1967-g4e50bbcd b0c4478f1d83 0d464b8c1d18 2024-03-30T14:10:35.789 INFO:teuthology.orchestra.run.smithi099.stdout:mon.a smithi099 running (6m) 12s ago 39m 63.5M 2048M 19.0.0-1967-g4e50bbcd b0c4478f1d83 f19388464dfd 2024-03-30T14:10:35.789 INFO:teuthology.orchestra.run.smithi099.stdout:mon.b smithi181 running (8m) 14s ago 38m 61.4M 2048M 19.0.0-1967-g4e50bbcd b0c4478f1d83 0468ed087cdd 2024-03-30T14:10:35.789 INFO:teuthology.orchestra.run.smithi099.stdout:mon.c smithi099 running (6m) 12s ago 38m 53.3M 2048M 19.0.0-1967-g4e50bbcd b0c4478f1d83 731056a2fea6 2024-03-30T14:10:35.789 INFO:teuthology.orchestra.run.smithi099.stdout:node-exporter.a smithi099 *:9100 running (10m) 12s ago 34m 16.8M - 1.5.0 0da6a335fe13 4a3f1f6e7068 2024-03-30T14:10:35.789 INFO:teuthology.orchestra.run.smithi099.stdout:node-exporter.b smithi181 *:9100 running (10m) 14s ago 34m 16.8M - 1.5.0 0da6a335fe13 acea317b5f5d 2024-03-30T14:10:35.789 INFO:teuthology.orchestra.run.smithi099.stdout:osd.0 smithi099 running (5m) 12s ago 37m 59.3M 4096M 19.0.0-1967-g4e50bbcd b0c4478f1d83 d97d48cb3314 2024-03-30T14:10:35.790 INFO:teuthology.orchestra.run.smithi099.stdout:osd.1 smithi099 running (4m) 12s ago 37m 62.9M 4096M 19.0.0-1967-g4e50bbcd b0c4478f1d83 a843295ce83b 2024-03-30T14:10:35.790 INFO:teuthology.orchestra.run.smithi099.stdout:osd.2 smithi099 running (3m) 12s ago 36m 48.2M 4096M 19.0.0-1967-g4e50bbcd b0c4478f1d83 18304adfb0d0 2024-03-30T14:10:35.790 INFO:teuthology.orchestra.run.smithi099.stdout:osd.3 smithi099 running (2m) 12s ago 36m 50.0M 4096M 19.0.0-1967-g4e50bbcd b0c4478f1d83 9b38d79f070e 2024-03-30T14:10:35.790 INFO:teuthology.orchestra.run.smithi099.stdout:osd.4 smithi181 running (2m) 14s ago 36m 53.7M 4096M 19.0.0-1967-g4e50bbcd b0c4478f1d83 b9078af21e45 2024-03-30T14:10:35.790 INFO:teuthology.orchestra.run.smithi099.stdout:osd.5 smithi181 running (88s) 14s ago 35m 51.8M 4096M 19.0.0-1967-g4e50bbcd b0c4478f1d83 bba176b8db2c 2024-03-30T14:10:35.790 INFO:teuthology.orchestra.run.smithi099.stdout:osd.6 smithi181 running (55s) 14s ago 35m 43.1M 4096M 19.0.0-1967-g4e50bbcd b0c4478f1d83 4a29dfeb4b16 2024-03-30T14:10:35.790 INFO:teuthology.orchestra.run.smithi099.stdout:osd.7 smithi181 running (23s) 14s ago 35m 12.8M 4096M 19.0.0-1967-g4e50bbcd b0c4478f1d83 7940232eb4fe 2024-03-30T14:10:35.790 INFO:teuthology.orchestra.run.smithi099.stdout:prometheus.a smithi181 *:9095 running (9m) 14s ago 34m 70.5M - 2.43.0 a07b618ecd1d 004088bdf70e 2024-03-30T14:10:35.790 INFO:teuthology.orchestra.run.smithi099.stdout:rgw.foo.smithi099.fxjbmp smithi099 *:8000 running (32m) 12s ago 32m 79.5M - 17.2.0 e1d6a67b021e 400b28b3f650 2024-03-30T14:10:35.790 INFO:teuthology.orchestra.run.smithi099.stdout:rgw.foo.smithi181.wfqwti smithi181 *:8000 running (32m) 14s ago 32m 79.2M - 17.2.0 e1d6a67b021e 97e1b130f9d4 2024-03-30T14:10:36.559 DEBUG:teuthology.orchestra.run.smithi099:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 98ebaeb8-ee99-11ee-b647-cb9ed24678a4 -e sha1=4e50bbcdd1630c7760b708f3a5b4d38a121e66cb -- bash -c 'ceph versions | jq -e '"'"'.osd | length == 1'"'"'' 2024-03-30T14:10:36.719 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:10:36 smithi181 ceph-mon[115276]: pgmap v262: 161 pgs: 161 active+clean; 585 KiB data, 245 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T14:10:36.719 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:10:36 smithi181 ceph-mon[115276]: from='client.54546 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T14:10:36.828 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:10:36 smithi099 ceph-mon[137093]: pgmap v262: 161 pgs: 161 active+clean; 585 KiB data, 245 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T14:10:36.828 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:10:36 smithi099 ceph-mon[137093]: from='client.54546 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T14:10:36.828 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:10:36 smithi099 ceph-mon[143401]: pgmap v262: 161 pgs: 161 active+clean; 585 KiB data, 245 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T14:10:36.829 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:10:36 smithi099 ceph-mon[143401]: from='client.54546 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T14:10:37.828 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:10:37 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:10:37.828 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:10:37 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:10:37.828 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:10:37 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:10:37.828 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:10:37 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:10:37.828 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:10:37 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T14:10:37.829 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:10:37 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:10:37.829 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:10:37 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:10:37.829 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:10:37 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:10:37.829 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:10:37 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:10:37.829 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:10:37 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T14:10:37.997 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:10:37 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:10:37.997 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:10:37 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:10:37.997 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:10:37 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:10:37.997 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:10:37 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:10:37.997 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:10:37 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T14:10:38.828 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:10:38 smithi099 ceph-mon[137093]: pgmap v263: 161 pgs: 161 active+clean; 585 KiB data, 245 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T14:10:38.828 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:10:38 smithi099 ceph-mon[143401]: pgmap v263: 161 pgs: 161 active+clean; 585 KiB data, 245 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T14:10:38.917 INFO:teuthology.orchestra.run.smithi099.stdout:true 2024-03-30T14:10:39.247 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:10:38 smithi181 ceph-mon[115276]: pgmap v263: 161 pgs: 161 active+clean; 585 KiB data, 245 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T14:10:39.531 DEBUG:teuthology.orchestra.run.smithi099:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 98ebaeb8-ee99-11ee-b647-cb9ed24678a4 -e sha1=4e50bbcdd1630c7760b708f3a5b4d38a121e66cb -- bash -c 'ceph versions | jq -e '"'"'.osd | keys'"'"' | grep $sha1' 2024-03-30T14:10:39.853 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:10:39 smithi099 ceph-mon[137093]: from='client.25136 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T14:10:39.853 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:10:39 smithi099 ceph-mon[137093]: from='client.? 172.21.15.99:0/4131355425' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:10:39.853 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:10:39 smithi099 ceph-mon[143401]: from='client.25136 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T14:10:39.854 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:10:39 smithi099 ceph-mon[143401]: from='client.? 172.21.15.99:0/4131355425' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:10:40.247 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:10:39 smithi181 ceph-mon[115276]: from='client.25136 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T14:10:40.247 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:10:39 smithi181 ceph-mon[115276]: from='client.? 172.21.15.99:0/4131355425' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:10:40.827 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:10:40 smithi099 ceph-mon[137093]: pgmap v264: 161 pgs: 161 active+clean; 585 KiB data, 245 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T14:10:40.828 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:10:40 smithi099 ceph-mon[143401]: pgmap v264: 161 pgs: 161 active+clean; 585 KiB data, 245 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T14:10:41.247 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:10:40 smithi181 ceph-mon[115276]: pgmap v264: 161 pgs: 161 active+clean; 585 KiB data, 245 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T14:10:41.730 INFO:teuthology.orchestra.run.smithi099.stdout: "ceph version 19.0.0-1967-g4e50bbcd (4e50bbcdd1630c7760b708f3a5b4d38a121e66cb) squid (dev)" 2024-03-30T14:10:42.077 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:10:41 smithi099 ceph-mon[137093]: from='client.? 172.21.15.99:0/3226329636' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:10:42.078 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:10:41 smithi099 ceph-mon[143401]: from='client.? 172.21.15.99:0/3226329636' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:10:42.247 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:10:41 smithi181 ceph-mon[115276]: from='client.? 172.21.15.99:0/3226329636' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:10:42.508 DEBUG:teuthology.orchestra.run.smithi099:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 98ebaeb8-ee99-11ee-b647-cb9ed24678a4 -e sha1=4e50bbcdd1630c7760b708f3a5b4d38a121e66cb -- bash -c 'ceph orch upgrade status' 2024-03-30T14:10:43.062 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:10:42 smithi099 ceph-mon[137093]: pgmap v265: 161 pgs: 161 active+clean; 585 KiB data, 245 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T14:10:43.063 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:10:42 smithi099 ceph-mon[143401]: pgmap v265: 161 pgs: 161 active+clean; 585 KiB data, 245 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T14:10:43.247 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:10:42 smithi181 ceph-mon[115276]: pgmap v265: 161 pgs: 161 active+clean; 585 KiB data, 245 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T14:10:44.577 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:10:44 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:10:44.578 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:10:44 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:10:44.578 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:10:44 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:10:44.578 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:10:44 smithi099 ceph-mon[143401]: pgmap v266: 161 pgs: 161 active+clean; 585 KiB data, 245 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T14:10:44.578 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:10:44 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:10:44.578 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:10:44 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:10:44.578 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:10:44 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:10:44.578 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:10:44 smithi099 ceph-mon[137093]: pgmap v266: 161 pgs: 161 active+clean; 585 KiB data, 245 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T14:10:44.663 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-03-30T14:10:44.663 INFO:teuthology.orchestra.run.smithi099.stdout: "target_image": null, 2024-03-30T14:10:44.664 INFO:teuthology.orchestra.run.smithi099.stdout: "in_progress": false, 2024-03-30T14:10:44.664 INFO:teuthology.orchestra.run.smithi099.stdout: "which": "", 2024-03-30T14:10:44.664 INFO:teuthology.orchestra.run.smithi099.stdout: "services_complete": [], 2024-03-30T14:10:44.664 INFO:teuthology.orchestra.run.smithi099.stdout: "progress": null, 2024-03-30T14:10:44.664 INFO:teuthology.orchestra.run.smithi099.stdout: "message": "", 2024-03-30T14:10:44.664 INFO:teuthology.orchestra.run.smithi099.stdout: "is_paused": false 2024-03-30T14:10:44.664 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-03-30T14:10:44.747 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:10:44 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:10:44.747 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:10:44 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:10:44.747 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:10:44 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:10:44.747 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:10:44 smithi181 ceph-mon[115276]: pgmap v266: 161 pgs: 161 active+clean; 585 KiB data, 245 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T14:10:45.078 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 14:10:44 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[71049]: ::ffff:172.21.15.181 - - [30/Mar/2024:14:10:44] "GET /metrics HTTP/1.1" 200 38375 "" "Prometheus/2.43.0" 2024-03-30T14:10:45.455 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:10:45 smithi099 ceph-mon[137093]: from='client.64567 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T14:10:45.455 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:10:45 smithi099 ceph-mon[143401]: from='client.64567 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T14:10:45.478 DEBUG:teuthology.orchestra.run.smithi099:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 98ebaeb8-ee99-11ee-b647-cb9ed24678a4 -e sha1=4e50bbcdd1630c7760b708f3a5b4d38a121e66cb -- bash -c 'ceph health detail' 2024-03-30T14:10:45.747 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:10:45 smithi181 ceph-mon[115276]: from='client.64567 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T14:10:46.537 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:10:46 smithi099 ceph-mon[137093]: pgmap v267: 161 pgs: 161 active+clean; 585 KiB data, 245 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T14:10:46.537 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:10:46 smithi099 ceph-mon[143401]: pgmap v267: 161 pgs: 161 active+clean; 585 KiB data, 245 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T14:10:46.746 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:10:46 smithi181 ceph-mon[115276]: pgmap v267: 161 pgs: 161 active+clean; 585 KiB data, 245 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T14:10:48.828 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:10:48 smithi099 ceph-mon[137093]: pgmap v268: 161 pgs: 161 active+clean; 585 KiB data, 245 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T14:10:48.828 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:10:48 smithi099 ceph-mon[143401]: pgmap v268: 161 pgs: 161 active+clean; 585 KiB data, 245 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T14:10:48.997 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:10:48 smithi181 ceph-mon[115276]: pgmap v268: 161 pgs: 161 active+clean; 585 KiB data, 245 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T14:10:49.578 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:10:49 smithi099 ceph-mon[137093]: from='client.25136 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T14:10:49.578 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:10:49 smithi099 ceph-mon[143401]: from='client.25136 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T14:10:49.713 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:10:49 smithi181 ceph-mon[115276]: from='client.25136 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T14:10:49.746 INFO:teuthology.orchestra.run.smithi099.stdout:HEALTH_OK 2024-03-30T14:10:50.426 DEBUG:teuthology.orchestra.run.smithi099:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 98ebaeb8-ee99-11ee-b647-cb9ed24678a4 -e sha1=4e50bbcdd1630c7760b708f3a5b4d38a121e66cb -- bash -c 'ceph orch upgrade start --image quay.ceph.io/ceph-ci/ceph:$sha1 --services rgw.foo' 2024-03-30T14:10:50.741 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:10:50 smithi099 ceph-mon[137093]: pgmap v269: 161 pgs: 161 active+clean; 585 KiB data, 245 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T14:10:50.741 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:10:50 smithi099 ceph-mon[137093]: from='client.? 172.21.15.99:0/4239687994' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-03-30T14:10:50.741 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:10:50 smithi099 ceph-mon[143401]: pgmap v269: 161 pgs: 161 active+clean; 585 KiB data, 245 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T14:10:50.741 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:10:50 smithi099 ceph-mon[143401]: from='client.? 172.21.15.99:0/4239687994' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-03-30T14:10:50.804 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:10:50 smithi181 ceph-mon[115276]: pgmap v269: 161 pgs: 161 active+clean; 585 KiB data, 245 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T14:10:50.804 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:10:50 smithi181 ceph-mon[115276]: from='client.? 172.21.15.99:0/4239687994' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-03-30T14:10:52.828 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:10:52 smithi099 ceph-mon[137093]: pgmap v270: 161 pgs: 161 active+clean; 585 KiB data, 245 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T14:10:52.828 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:10:52 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T14:10:52.828 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:10:52 smithi099 ceph-mon[143401]: pgmap v270: 161 pgs: 161 active+clean; 585 KiB data, 245 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T14:10:52.828 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:10:52 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T14:10:52.997 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:10:52 smithi181 ceph-mon[115276]: pgmap v270: 161 pgs: 161 active+clean; 585 KiB data, 245 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T14:10:52.997 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:10:52 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T14:10:53.828 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:10:53 smithi099 ceph-mon[137093]: from='client.54576 -' entity='client.admin' cmd=[{"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:4e50bbcdd1630c7760b708f3a5b4d38a121e66cb", "services": "rgw.foo", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T14:10:53.828 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:10:53 smithi099 ceph-mon[143401]: from='client.54576 -' entity='client.admin' cmd=[{"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:4e50bbcdd1630c7760b708f3a5b4d38a121e66cb", "services": "rgw.foo", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T14:10:53.996 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:10:53 smithi181 ceph-mon[115276]: from='client.54576 -' entity='client.admin' cmd=[{"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:4e50bbcdd1630c7760b708f3a5b4d38a121e66cb", "services": "rgw.foo", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T14:10:54.026 INFO:teuthology.orchestra.run.smithi099.stdout:Initiating upgrade to quay.ceph.io/ceph-ci/ceph:4e50bbcdd1630c7760b708f3a5b4d38a121e66cb 2024-03-30T14:10:54.740 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:10:54 smithi099 ceph-mon[143401]: pgmap v271: 161 pgs: 161 active+clean; 585 KiB data, 245 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T14:10:54.740 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:10:54 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:10:54.740 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:10:54 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:10:54.740 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:10:54 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:10:54.740 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:10:54 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:10:54.741 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:10:54 smithi099 ceph-mon[137093]: pgmap v271: 161 pgs: 161 active+clean; 585 KiB data, 245 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T14:10:54.741 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:10:54 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:10:54.741 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:10:54 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:10:54.741 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:10:54 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:10:54.741 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:10:54 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:10:54.742 DEBUG:teuthology.orchestra.run.smithi099:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 98ebaeb8-ee99-11ee-b647-cb9ed24678a4 -e sha1=4e50bbcdd1630c7760b708f3a5b4d38a121e66cb -- bash -c 'while ceph orch upgrade status | jq '"'"'.in_progress'"'"' | grep true && ! ceph orch upgrade status | jq '"'"'.message'"'"' | grep Error ; do ceph orch ps ; ceph versions ; ceph orch upgrade status ; sleep 30 ; done' 2024-03-30T14:10:54.997 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:10:54 smithi181 ceph-mon[115276]: pgmap v271: 161 pgs: 161 active+clean; 585 KiB data, 245 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T14:10:54.997 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:10:54 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:10:54.997 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:10:54 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:10:54.997 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:10:54 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:10:54.997 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:10:54 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:10:55.014 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 14:10:54 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[71049]: ::ffff:172.21.15.181 - - [30/Mar/2024:14:10:54] "GET /metrics HTTP/1.1" 200 38376 "" "Prometheus/2.43.0" 2024-03-30T14:10:55.828 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:10:55 smithi099 ceph-mon[137093]: Upgrade: Started with target quay.ceph.io/ceph-ci/ceph:4e50bbcdd1630c7760b708f3a5b4d38a121e66cb 2024-03-30T14:10:55.828 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:10:55 smithi099 ceph-mon[137093]: Upgrade: First pull of quay.ceph.io/ceph-ci/ceph:4e50bbcdd1630c7760b708f3a5b4d38a121e66cb 2024-03-30T14:10:55.828 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:10:55 smithi099 ceph-mon[143401]: Upgrade: Started with target quay.ceph.io/ceph-ci/ceph:4e50bbcdd1630c7760b708f3a5b4d38a121e66cb 2024-03-30T14:10:55.828 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:10:55 smithi099 ceph-mon[143401]: Upgrade: First pull of quay.ceph.io/ceph-ci/ceph:4e50bbcdd1630c7760b708f3a5b4d38a121e66cb 2024-03-30T14:10:55.997 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:10:55 smithi181 ceph-mon[115276]: Upgrade: Started with target quay.ceph.io/ceph-ci/ceph:4e50bbcdd1630c7760b708f3a5b4d38a121e66cb 2024-03-30T14:10:55.997 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:10:55 smithi181 ceph-mon[115276]: Upgrade: First pull of quay.ceph.io/ceph-ci/ceph:4e50bbcdd1630c7760b708f3a5b4d38a121e66cb 2024-03-30T14:10:56.827 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:10:56 smithi099 ceph-mon[137093]: pgmap v272: 161 pgs: 161 active+clean; 585 KiB data, 245 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T14:10:56.828 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:10:56 smithi099 ceph-mon[143401]: pgmap v272: 161 pgs: 161 active+clean; 585 KiB data, 245 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T14:10:56.855 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:10:56 smithi181 ceph-mon[115276]: pgmap v272: 161 pgs: 161 active+clean; 585 KiB data, 245 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T14:10:57.829 INFO:teuthology.orchestra.run.smithi099.stdout:true 2024-03-30T14:10:57.913 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:10:57 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:10:57.913 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:10:57 smithi099 ceph-mon[143401]: Upgrade: Target is version 19.0.0-1967-g4e50bbcd (squid) 2024-03-30T14:10:57.913 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:10:57 smithi099 ceph-mon[143401]: Upgrade: Target container is quay.ceph.io/ceph-ci/ceph:4e50bbcdd1630c7760b708f3a5b4d38a121e66cb, digests ['quay.ceph.io/ceph-ci/ceph@sha256:8f3809717761e681477c3ef1d8d2c03114aee2c597cd7380b93b8c10f47fcb5d'] 2024-03-30T14:10:57.913 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:10:57 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:10:57.913 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:10:57 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:10:57.913 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:10:57 smithi099 ceph-mon[143401]: Upgrade: Setting container_image for all mgr 2024-03-30T14:10:57.913 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:10:57 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:10:57.913 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:10:57 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:10:57.913 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:10:57 smithi099 ceph-mon[143401]: Upgrade: Setting container_image for all mon 2024-03-30T14:10:57.913 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:10:57 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:10:57.913 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:10:57 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:10:57.913 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:10:57 smithi099 ceph-mon[143401]: Upgrade: Setting container_image for all crash 2024-03-30T14:10:57.914 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:10:57 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:10:57.914 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:10:57 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:10:57.914 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:10:57 smithi099 ceph-mon[143401]: Upgrade: Setting container_image for all osd 2024-03-30T14:10:57.914 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:10:57 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:10:57.914 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:10:57 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:10:57.914 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:10:57 smithi099 ceph-mon[143401]: Upgrade: Setting container_image for all mds 2024-03-30T14:10:57.914 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:10:57 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:10:57.914 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:10:57 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:10:57.914 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:10:57 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:10:57.914 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:10:57 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:10:57.914 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:10:57 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:10:57.915 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:10:57 smithi099 ceph-mon[137093]: Upgrade: Target is version 19.0.0-1967-g4e50bbcd (squid) 2024-03-30T14:10:57.915 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:10:57 smithi099 ceph-mon[137093]: Upgrade: Target container is quay.ceph.io/ceph-ci/ceph:4e50bbcdd1630c7760b708f3a5b4d38a121e66cb, digests ['quay.ceph.io/ceph-ci/ceph@sha256:8f3809717761e681477c3ef1d8d2c03114aee2c597cd7380b93b8c10f47fcb5d'] 2024-03-30T14:10:57.915 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:10:57 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:10:57.915 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:10:57 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:10:57.915 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:10:57 smithi099 ceph-mon[137093]: Upgrade: Setting container_image for all mgr 2024-03-30T14:10:57.915 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:10:57 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:10:57.915 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:10:57 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:10:57.915 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:10:57 smithi099 ceph-mon[137093]: Upgrade: Setting container_image for all mon 2024-03-30T14:10:57.915 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:10:57 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:10:57.915 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:10:57 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:10:57.915 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:10:57 smithi099 ceph-mon[137093]: Upgrade: Setting container_image for all crash 2024-03-30T14:10:57.915 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:10:57 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:10:57.915 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:10:57 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:10:57.915 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:10:57 smithi099 ceph-mon[137093]: Upgrade: Setting container_image for all osd 2024-03-30T14:10:57.916 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:10:57 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:10:57.916 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:10:57 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:10:57.916 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:10:57 smithi099 ceph-mon[137093]: Upgrade: Setting container_image for all mds 2024-03-30T14:10:57.916 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:10:57 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:10:57.916 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:10:57 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:10:57.916 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:10:57 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:10:57.916 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:10:57 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:10:57.997 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:10:57 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:10:57.997 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:10:57 smithi181 ceph-mon[115276]: Upgrade: Target is version 19.0.0-1967-g4e50bbcd (squid) 2024-03-30T14:10:57.997 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:10:57 smithi181 ceph-mon[115276]: Upgrade: Target container is quay.ceph.io/ceph-ci/ceph:4e50bbcdd1630c7760b708f3a5b4d38a121e66cb, digests ['quay.ceph.io/ceph-ci/ceph@sha256:8f3809717761e681477c3ef1d8d2c03114aee2c597cd7380b93b8c10f47fcb5d'] 2024-03-30T14:10:57.997 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:10:57 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:10:57.997 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:10:57 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:10:57.997 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:10:57 smithi181 ceph-mon[115276]: Upgrade: Setting container_image for all mgr 2024-03-30T14:10:57.997 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:10:57 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:10:57.997 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:10:57 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:10:57.998 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:10:57 smithi181 ceph-mon[115276]: Upgrade: Setting container_image for all mon 2024-03-30T14:10:57.998 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:10:57 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:10:57.998 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:10:57 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:10:57.998 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:10:57 smithi181 ceph-mon[115276]: Upgrade: Setting container_image for all crash 2024-03-30T14:10:57.998 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:10:57 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:10:57.998 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:10:57 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:10:57.998 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:10:57 smithi181 ceph-mon[115276]: Upgrade: Setting container_image for all osd 2024-03-30T14:10:57.998 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:10:57 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:10:57.998 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:10:57 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:10:57.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:10:57 smithi181 ceph-mon[115276]: Upgrade: Setting container_image for all mds 2024-03-30T14:10:57.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:10:57 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:10:57.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:10:57 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:10:57.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:10:57 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:10:57.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:10:57 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:10:58.490 INFO:teuthology.orchestra.run.smithi099.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-03-30T14:10:58.490 INFO:teuthology.orchestra.run.smithi099.stdout:agent.smithi099 smithi099 running 15s ago 39m - - 2024-03-30T14:10:58.490 INFO:teuthology.orchestra.run.smithi099.stdout:agent.smithi181 smithi181 running 1s ago 39m - - 2024-03-30T14:10:58.490 INFO:teuthology.orchestra.run.smithi099.stdout:alertmanager.a smithi099 *:9093,9094 running (9m) 15s ago 33m 26.9M - 0.25.0 c8568f914cd2 08735152b67d 2024-03-30T14:10:58.490 INFO:teuthology.orchestra.run.smithi099.stdout:grafana.a smithi181 *:3000 running (9m) 1s ago 33m 78.8M - 9.4.12 2bacad6d85d8 d599aa7730d6 2024-03-30T14:10:58.490 INFO:teuthology.orchestra.run.smithi099.stdout:iscsi.foo.smithi099.qyjuvr smithi099 running (12m) 15s ago 32m 61.9M - 3.5 e1d6a67b021e 2f859af6bc2a 2024-03-30T14:10:58.490 INFO:teuthology.orchestra.run.smithi099.stdout:mgr.x smithi181 *:8443,9283,8765 running (11m) 1s ago 38m 452M - 19.0.0-1967-g4e50bbcd b0c4478f1d83 f269106f7913 2024-03-30T14:10:58.490 INFO:teuthology.orchestra.run.smithi099.stdout:mgr.y smithi099 *:8443,9283,8765 running (22m) 15s ago 40m 530M - 19.0.0-1967-g4e50bbcd b0c4478f1d83 0d464b8c1d18 2024-03-30T14:10:58.491 INFO:teuthology.orchestra.run.smithi099.stdout:mon.a smithi099 running (7m) 15s ago 40m 64.9M 2048M 19.0.0-1967-g4e50bbcd b0c4478f1d83 f19388464dfd 2024-03-30T14:10:58.491 INFO:teuthology.orchestra.run.smithi099.stdout:mon.b smithi181 running (8m) 1s ago 38m 63.5M 2048M 19.0.0-1967-g4e50bbcd b0c4478f1d83 0468ed087cdd 2024-03-30T14:10:58.491 INFO:teuthology.orchestra.run.smithi099.stdout:mon.c smithi099 running (6m) 15s ago 38m 54.0M 2048M 19.0.0-1967-g4e50bbcd b0c4478f1d83 731056a2fea6 2024-03-30T14:10:58.491 INFO:teuthology.orchestra.run.smithi099.stdout:node-exporter.a smithi099 *:9100 running (10m) 15s ago 34m 16.6M - 1.5.0 0da6a335fe13 4a3f1f6e7068 2024-03-30T14:10:58.491 INFO:teuthology.orchestra.run.smithi099.stdout:node-exporter.b smithi181 *:9100 running (10m) 1s ago 34m 17.0M - 1.5.0 0da6a335fe13 acea317b5f5d 2024-03-30T14:10:58.491 INFO:teuthology.orchestra.run.smithi099.stdout:osd.0 smithi099 running (5m) 15s ago 38m 59.5M 4096M 19.0.0-1967-g4e50bbcd b0c4478f1d83 d97d48cb3314 2024-03-30T14:10:58.491 INFO:teuthology.orchestra.run.smithi099.stdout:osd.1 smithi099 running (4m) 15s ago 37m 62.0M 4096M 19.0.0-1967-g4e50bbcd b0c4478f1d83 a843295ce83b 2024-03-30T14:10:58.491 INFO:teuthology.orchestra.run.smithi099.stdout:osd.2 smithi099 running (3m) 15s ago 37m 48.8M 4096M 19.0.0-1967-g4e50bbcd b0c4478f1d83 18304adfb0d0 2024-03-30T14:10:58.491 INFO:teuthology.orchestra.run.smithi099.stdout:osd.3 smithi099 running (2m) 15s ago 36m 49.1M 4096M 19.0.0-1967-g4e50bbcd b0c4478f1d83 9b38d79f070e 2024-03-30T14:10:58.491 INFO:teuthology.orchestra.run.smithi099.stdout:osd.4 smithi181 running (2m) 1s ago 36m 54.1M 4096M 19.0.0-1967-g4e50bbcd b0c4478f1d83 b9078af21e45 2024-03-30T14:10:58.491 INFO:teuthology.orchestra.run.smithi099.stdout:osd.5 smithi181 running (111s) 1s ago 36m 52.7M 4096M 19.0.0-1967-g4e50bbcd b0c4478f1d83 bba176b8db2c 2024-03-30T14:10:58.491 INFO:teuthology.orchestra.run.smithi099.stdout:osd.6 smithi181 running (77s) 1s ago 35m 44.3M 4096M 19.0.0-1967-g4e50bbcd b0c4478f1d83 4a29dfeb4b16 2024-03-30T14:10:58.491 INFO:teuthology.orchestra.run.smithi099.stdout:osd.7 smithi181 running (46s) 1s ago 35m 51.2M 4096M 19.0.0-1967-g4e50bbcd b0c4478f1d83 7940232eb4fe 2024-03-30T14:10:58.491 INFO:teuthology.orchestra.run.smithi099.stdout:prometheus.a smithi181 *:9095 running (10m) 1s ago 34m 70.5M - 2.43.0 a07b618ecd1d 004088bdf70e 2024-03-30T14:10:58.491 INFO:teuthology.orchestra.run.smithi099.stdout:rgw.foo.smithi099.fxjbmp smithi099 *:8000 running (32m) 15s ago 32m 79.6M - 17.2.0 e1d6a67b021e 400b28b3f650 2024-03-30T14:10:58.491 INFO:teuthology.orchestra.run.smithi099.stdout:rgw.foo.smithi181.wfqwti smithi181 *:8000 running (32m) 1s ago 32m 79.4M - 17.2.0 e1d6a67b021e 97e1b130f9d4 2024-03-30T14:10:58.792 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:10:58 smithi099 ceph-mon[137093]: pgmap v273: 161 pgs: 161 active+clean; 585 KiB data, 245 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T14:10:58.792 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:10:58 smithi099 ceph-mon[143401]: pgmap v273: 161 pgs: 161 active+clean; 585 KiB data, 245 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T14:10:58.895 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-03-30T14:10:58.896 INFO:teuthology.orchestra.run.smithi099.stdout: "mon": { 2024-03-30T14:10:58.896 INFO:teuthology.orchestra.run.smithi099.stdout: "ceph version 19.0.0-1967-g4e50bbcd (4e50bbcdd1630c7760b708f3a5b4d38a121e66cb) squid (dev)": 3 2024-03-30T14:10:58.896 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T14:10:58.896 INFO:teuthology.orchestra.run.smithi099.stdout: "mgr": { 2024-03-30T14:10:58.896 INFO:teuthology.orchestra.run.smithi099.stdout: "ceph version 19.0.0-1967-g4e50bbcd (4e50bbcdd1630c7760b708f3a5b4d38a121e66cb) squid (dev)": 2 2024-03-30T14:10:58.896 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T14:10:58.896 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": { 2024-03-30T14:10:58.896 INFO:teuthology.orchestra.run.smithi099.stdout: "ceph version 19.0.0-1967-g4e50bbcd (4e50bbcdd1630c7760b708f3a5b4d38a121e66cb) squid (dev)": 8 2024-03-30T14:10:58.896 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T14:10:58.896 INFO:teuthology.orchestra.run.smithi099.stdout: "rgw": { 2024-03-30T14:10:58.896 INFO:teuthology.orchestra.run.smithi099.stdout: "ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)": 2 2024-03-30T14:10:58.896 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T14:10:58.897 INFO:teuthology.orchestra.run.smithi099.stdout: "overall": { 2024-03-30T14:10:58.897 INFO:teuthology.orchestra.run.smithi099.stdout: "ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)": 2, 2024-03-30T14:10:58.897 INFO:teuthology.orchestra.run.smithi099.stdout: "ceph version 19.0.0-1967-g4e50bbcd (4e50bbcdd1630c7760b708f3a5b4d38a121e66cb) squid (dev)": 13 2024-03-30T14:10:58.897 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-03-30T14:10:58.897 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-03-30T14:10:58.997 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:10:58 smithi181 ceph-mon[115276]: pgmap v273: 161 pgs: 161 active+clean; 585 KiB data, 245 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T14:10:59.240 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-03-30T14:10:59.241 INFO:teuthology.orchestra.run.smithi099.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph:4e50bbcdd1630c7760b708f3a5b4d38a121e66cb", 2024-03-30T14:10:59.241 INFO:teuthology.orchestra.run.smithi099.stdout: "in_progress": true, 2024-03-30T14:10:59.241 INFO:teuthology.orchestra.run.smithi099.stdout: "which": "Upgrading daemons in service(s) rgw.foo", 2024-03-30T14:10:59.241 INFO:teuthology.orchestra.run.smithi099.stdout: "services_complete": [], 2024-03-30T14:10:59.241 INFO:teuthology.orchestra.run.smithi099.stdout: "progress": "0/2 daemons upgraded", 2024-03-30T14:10:59.241 INFO:teuthology.orchestra.run.smithi099.stdout: "message": "Currently upgrading rgw daemons", 2024-03-30T14:10:59.241 INFO:teuthology.orchestra.run.smithi099.stdout: "is_paused": false 2024-03-30T14:10:59.241 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-03-30T14:10:59.828 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:10:59 smithi099 ceph-mon[137093]: from='client.64585 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T14:10:59.828 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:10:59 smithi099 ceph-mon[137093]: from='client.25136 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T14:10:59.828 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:10:59 smithi099 ceph-mon[137093]: from='client.64591 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T14:10:59.828 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:10:59 smithi099 ceph-mon[137093]: from='client.64597 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T14:10:59.828 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:10:59 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:10:59.828 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:10:59 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.foo.smithi099.fxjbmp", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2024-03-30T14:10:59.828 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:10:59 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.foo.smithi099.fxjbmp", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2024-03-30T14:10:59.828 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:10:59 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:10:59.828 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:10:59 smithi099 ceph-mon[137093]: from='client.? 172.21.15.99:0/2332924463' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:10:59.829 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:10:59 smithi099 ceph-mon[143401]: from='client.64585 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T14:10:59.829 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:10:59 smithi099 ceph-mon[143401]: from='client.25136 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T14:10:59.829 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:10:59 smithi099 ceph-mon[143401]: from='client.64591 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T14:10:59.829 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:10:59 smithi099 ceph-mon[143401]: from='client.64597 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T14:10:59.829 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:10:59 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:10:59.829 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:10:59 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.foo.smithi099.fxjbmp", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2024-03-30T14:10:59.829 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:10:59 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.foo.smithi099.fxjbmp", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2024-03-30T14:10:59.829 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:10:59 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:10:59.829 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:10:59 smithi099 ceph-mon[143401]: from='client.? 172.21.15.99:0/2332924463' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:10:59.997 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:10:59 smithi181 ceph-mon[115276]: from='client.64585 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T14:10:59.997 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:10:59 smithi181 ceph-mon[115276]: from='client.25136 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T14:10:59.997 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:10:59 smithi181 ceph-mon[115276]: from='client.64591 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T14:10:59.997 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:10:59 smithi181 ceph-mon[115276]: from='client.64597 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T14:10:59.997 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:10:59 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:10:59.997 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:10:59 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.foo.smithi099.fxjbmp", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2024-03-30T14:10:59.997 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:10:59 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.foo.smithi099.fxjbmp", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2024-03-30T14:10:59.997 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:10:59 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:10:59.997 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:10:59 smithi181 ceph-mon[115276]: from='client.? 172.21.15.99:0/2332924463' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:00.756 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:00 smithi099 ceph-mon[137093]: Upgrade: Updating rgw.foo.smithi099.fxjbmp (1/2) 2024-03-30T14:11:00.756 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:00 smithi099 ceph-mon[137093]: Deploying daemon rgw.foo.smithi099.fxjbmp on smithi099 2024-03-30T14:11:00.756 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:00 smithi099 ceph-mon[137093]: from='client.64609 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T14:11:00.756 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:00 smithi099 ceph-mon[137093]: pgmap v274: 161 pgs: 161 active+clean; 585 KiB data, 245 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T14:11:00.757 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:00 smithi099 ceph-mon[143401]: Upgrade: Updating rgw.foo.smithi099.fxjbmp (1/2) 2024-03-30T14:11:00.757 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:00 smithi099 ceph-mon[143401]: Deploying daemon rgw.foo.smithi099.fxjbmp on smithi099 2024-03-30T14:11:00.757 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:00 smithi099 ceph-mon[143401]: from='client.64609 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T14:11:00.757 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:00 smithi099 ceph-mon[143401]: pgmap v274: 161 pgs: 161 active+clean; 585 KiB data, 245 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T14:11:00.997 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:00 smithi181 ceph-mon[115276]: Upgrade: Updating rgw.foo.smithi099.fxjbmp (1/2) 2024-03-30T14:11:00.997 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:00 smithi181 ceph-mon[115276]: Deploying daemon rgw.foo.smithi099.fxjbmp on smithi099 2024-03-30T14:11:00.997 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:00 smithi181 ceph-mon[115276]: from='client.64609 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T14:11:00.997 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:00 smithi181 ceph-mon[115276]: pgmap v274: 161 pgs: 161 active+clean; 585 KiB data, 245 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T14:11:02.366 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:02 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:02.366 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:02 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:02.366 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:02 smithi099 ceph-mon[137093]: pgmap v275: 161 pgs: 161 active+clean; 585 KiB data, 245 MiB used, 715 GiB / 715 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-03-30T14:11:02.367 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:02 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:02.367 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:02 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:02.367 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:02 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:02.367 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:02 smithi099 ceph-mon[143401]: pgmap v275: 161 pgs: 161 active+clean; 585 KiB data, 245 MiB used, 715 GiB / 715 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-03-30T14:11:02.367 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:02 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:02.497 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:02 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:02.497 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:02 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:02.497 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:02 smithi181 ceph-mon[115276]: pgmap v275: 161 pgs: 161 active+clean; 585 KiB data, 245 MiB used, 715 GiB / 715 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-03-30T14:11:02.497 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:02 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:03.327 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:03 smithi099 ceph-mon[137093]: Health check failed: 1 failed cephadm daemon(s) (CEPHADM_FAILED_DAEMON) 2024-03-30T14:11:03.328 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:03 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:03.328 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:03 smithi099 ceph-mon[143401]: Health check failed: 1 failed cephadm daemon(s) (CEPHADM_FAILED_DAEMON) 2024-03-30T14:11:03.328 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:03 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:03.496 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:03 smithi181 ceph-mon[115276]: Health check failed: 1 failed cephadm daemon(s) (CEPHADM_FAILED_DAEMON) 2024-03-30T14:11:03.497 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:03 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:04.496 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:04 smithi181 ceph-mon[115276]: pgmap v276: 161 pgs: 161 active+clean; 585 KiB data, 245 MiB used, 715 GiB / 715 GiB avail; 876 B/s rd, 0 op/s 2024-03-30T14:11:04.497 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:04 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:04.578 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:04 smithi099 ceph-mon[137093]: pgmap v276: 161 pgs: 161 active+clean; 585 KiB data, 245 MiB used, 715 GiB / 715 GiB avail; 876 B/s rd, 0 op/s 2024-03-30T14:11:04.578 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:04 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:04.578 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:04 smithi099 ceph-mon[143401]: pgmap v276: 161 pgs: 161 active+clean; 585 KiB data, 245 MiB used, 715 GiB / 715 GiB avail; 876 B/s rd, 0 op/s 2024-03-30T14:11:04.578 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:04 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:05.078 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 14:11:04 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[71049]: ::ffff:172.21.15.181 - - [30/Mar/2024:14:11:04] "GET /metrics HTTP/1.1" 200 38376 "" "Prometheus/2.43.0" 2024-03-30T14:11:06.164 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:05 smithi099 ceph-mon[137093]: Upgrade: Updating rgw.foo.smithi181.wfqwti (2/2) 2024-03-30T14:11:06.164 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:05 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:06.164 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:05 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.foo.smithi181.wfqwti", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2024-03-30T14:11:06.164 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:05 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.foo.smithi181.wfqwti", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2024-03-30T14:11:06.164 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:05 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:06.164 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:05 smithi099 ceph-mon[137093]: Deploying daemon rgw.foo.smithi181.wfqwti on smithi181 2024-03-30T14:11:06.164 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:05 smithi099 ceph-mon[137093]: pgmap v277: 161 pgs: 161 active+clean; 585 KiB data, 249 MiB used, 715 GiB / 715 GiB avail; 29 KiB/s rd, 87 B/s wr, 43 op/s 2024-03-30T14:11:06.164 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:05 smithi099 ceph-mon[143401]: Upgrade: Updating rgw.foo.smithi181.wfqwti (2/2) 2024-03-30T14:11:06.165 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:05 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:06.165 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:05 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.foo.smithi181.wfqwti", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2024-03-30T14:11:06.165 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:05 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.foo.smithi181.wfqwti", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2024-03-30T14:11:06.165 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:05 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:06.165 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:05 smithi099 ceph-mon[143401]: Deploying daemon rgw.foo.smithi181.wfqwti on smithi181 2024-03-30T14:11:06.165 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:05 smithi099 ceph-mon[143401]: pgmap v277: 161 pgs: 161 active+clean; 585 KiB data, 249 MiB used, 715 GiB / 715 GiB avail; 29 KiB/s rd, 87 B/s wr, 43 op/s 2024-03-30T14:11:06.236 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:05 smithi181 ceph-mon[115276]: Upgrade: Updating rgw.foo.smithi181.wfqwti (2/2) 2024-03-30T14:11:06.237 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:05 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:06.237 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:05 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.foo.smithi181.wfqwti", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2024-03-30T14:11:06.237 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:05 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.foo.smithi181.wfqwti", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2024-03-30T14:11:06.237 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:05 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:06.237 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:05 smithi181 ceph-mon[115276]: Deploying daemon rgw.foo.smithi181.wfqwti on smithi181 2024-03-30T14:11:06.237 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:05 smithi181 ceph-mon[115276]: pgmap v277: 161 pgs: 161 active+clean; 585 KiB data, 249 MiB used, 715 GiB / 715 GiB avail; 29 KiB/s rd, 87 B/s wr, 43 op/s 2024-03-30T14:11:08.069 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:07 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:08.069 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:07 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T14:11:08.069 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:07 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:08.069 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:07 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T14:11:08.209 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:07 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:08.209 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:07 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T14:11:08.997 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:08 smithi181 ceph-mon[115276]: pgmap v278: 161 pgs: 161 active+clean; 585 KiB data, 257 MiB used, 715 GiB / 715 GiB avail; 49 KiB/s rd, 87 B/s wr, 74 op/s 2024-03-30T14:11:09.061 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:08 smithi099 ceph-mon[137093]: pgmap v278: 161 pgs: 161 active+clean; 585 KiB data, 257 MiB used, 715 GiB / 715 GiB avail; 49 KiB/s rd, 87 B/s wr, 74 op/s 2024-03-30T14:11:09.062 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:08 smithi099 ceph-mon[143401]: pgmap v278: 161 pgs: 161 active+clean; 585 KiB data, 257 MiB used, 715 GiB / 715 GiB avail; 49 KiB/s rd, 87 B/s wr, 74 op/s 2024-03-30T14:11:09.918 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:09 smithi181 ceph-mon[115276]: from='client.25136 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T14:11:10.077 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:09 smithi099 ceph-mon[137093]: from='client.25136 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T14:11:10.078 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:09 smithi099 ceph-mon[143401]: from='client.25136 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T14:11:11.078 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:10 smithi099 ceph-mon[143401]: pgmap v279: 161 pgs: 161 active+clean; 585 KiB data, 257 MiB used, 715 GiB / 715 GiB avail; 56 KiB/s rd, 87 B/s wr, 86 op/s 2024-03-30T14:11:11.078 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:10 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:11.078 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:10 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:11.078 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:10 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:11.078 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:10 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:11.078 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:10 smithi099 ceph-mon[143401]: pgmap v280: 161 pgs: 161 active+clean; 585 KiB data, 257 MiB used, 715 GiB / 715 GiB avail; 62 KiB/s rd, 96 B/s wr, 95 op/s 2024-03-30T14:11:11.078 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:10 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:11.079 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:10 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:11.079 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:10 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:11.079 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:10 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:11.079 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:10 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:11.079 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:10 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:11.079 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:10 smithi099 ceph-mon[143401]: Checking dashboard <-> RGW credentials 2024-03-30T14:11:11.079 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:10 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:11.079 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:10 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:11.079 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:10 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:11.079 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:10 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:11.079 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:10 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:11.079 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:10 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:11.080 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:10 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:11.080 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:10 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:11.080 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:10 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:11.080 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:10 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:11.080 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:10 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:11.080 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:10 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:11.080 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:10 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:11.080 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:10 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:11.080 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:10 smithi099 ceph-mon[137093]: pgmap v279: 161 pgs: 161 active+clean; 585 KiB data, 257 MiB used, 715 GiB / 715 GiB avail; 56 KiB/s rd, 87 B/s wr, 86 op/s 2024-03-30T14:11:11.080 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:10 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:11.080 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:10 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:11.081 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:10 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:11.081 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:10 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:11.081 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:10 smithi099 ceph-mon[137093]: pgmap v280: 161 pgs: 161 active+clean; 585 KiB data, 257 MiB used, 715 GiB / 715 GiB avail; 62 KiB/s rd, 96 B/s wr, 95 op/s 2024-03-30T14:11:11.081 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:10 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:11.081 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:10 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:11.081 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:10 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:11.081 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:10 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:11.081 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:10 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:11.081 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:10 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:11.081 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:10 smithi099 ceph-mon[137093]: Checking dashboard <-> RGW credentials 2024-03-30T14:11:11.081 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:10 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:11.081 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:10 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:11.081 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:10 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:11.082 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:10 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:11.082 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:10 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:11.082 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:10 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:11.082 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:10 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:11.082 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:10 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:11.082 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:10 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:11.082 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:10 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:11.082 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:10 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:11.082 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:10 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:11.082 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:10 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:11.082 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:10 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:11.247 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:10 smithi181 ceph-mon[115276]: pgmap v279: 161 pgs: 161 active+clean; 585 KiB data, 257 MiB used, 715 GiB / 715 GiB avail; 56 KiB/s rd, 87 B/s wr, 86 op/s 2024-03-30T14:11:11.247 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:10 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:11.247 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:10 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:11.247 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:10 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:11.247 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:10 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:11.247 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:10 smithi181 ceph-mon[115276]: pgmap v280: 161 pgs: 161 active+clean; 585 KiB data, 257 MiB used, 715 GiB / 715 GiB avail; 62 KiB/s rd, 96 B/s wr, 95 op/s 2024-03-30T14:11:11.247 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:10 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:11.247 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:10 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:11.247 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:10 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:11.247 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:10 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:11.247 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:10 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:11.248 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:10 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:11.248 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:10 smithi181 ceph-mon[115276]: Checking dashboard <-> RGW credentials 2024-03-30T14:11:11.248 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:10 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:11.248 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:10 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:11.248 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:10 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:11.248 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:10 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:11.248 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:10 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:11.248 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:10 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:11.248 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:10 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:11.248 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:10 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:11.248 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:10 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:11.248 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:10 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:11.248 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:10 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:11.248 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:10 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:11.249 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:10 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:11.249 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:10 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:11.997 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:11 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:11.997 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:11 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:11.997 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:11 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:11.997 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:11 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:11.997 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:11 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:11.998 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:11 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:11.998 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:11 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:11.998 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:11 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:11.998 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:11 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:11.998 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:11 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:11.998 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:11 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:11.998 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:11 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:11.998 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:11 smithi181 ceph-mon[115276]: Health check cleared: CEPHADM_FAILED_DAEMON (was: 1 failed cephadm daemon(s)) 2024-03-30T14:11:11.998 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:11 smithi181 ceph-mon[115276]: Cluster is now healthy 2024-03-30T14:11:11.998 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:11 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:11.998 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:11 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:11.998 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:11 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:11.998 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:11 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:11.998 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:11 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:11.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:11 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:11.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:11 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:11.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:11 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:11.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:11 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:11.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:11 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:11.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:11 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:11.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:11 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:11.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:11 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:11.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:11 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:11.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:11 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:11.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:11 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:11.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:11 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:11.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:11 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:11.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:11 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:12.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:11 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:12.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:11 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:12.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:11 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:12.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:11 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:12.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:11 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:12.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:11 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:12.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:11 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:12.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:11 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:12.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:11 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:12.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:11 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:12.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:11 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:12.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:11 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:12.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:11 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:12.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:11 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:12.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:11 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:12.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:11 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:12.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:11 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:12.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:11 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:12.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:11 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:12.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:11 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:12.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:11 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:12.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:11 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:12.078 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:11 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:12.078 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:11 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:12.078 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:11 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:12.079 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:11 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:12.079 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:11 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:12.079 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:11 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:12.079 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:11 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:12.079 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:11 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:12.079 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:11 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:12.079 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:11 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:12.079 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:11 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:12.079 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:11 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:12.079 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:11 smithi099 ceph-mon[143401]: Health check cleared: CEPHADM_FAILED_DAEMON (was: 1 failed cephadm daemon(s)) 2024-03-30T14:11:12.079 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:11 smithi099 ceph-mon[143401]: Cluster is now healthy 2024-03-30T14:11:12.079 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:11 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:12.079 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:11 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:12.079 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:11 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:12.079 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:11 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:12.080 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:11 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:12.080 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:11 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:12.080 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:11 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:12.080 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:11 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:12.080 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:11 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:12.080 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:11 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:12.080 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:11 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:12.080 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:11 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:12.080 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:11 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:12.080 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:11 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:12.080 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:11 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:12.080 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:11 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:12.081 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:11 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:12.081 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:11 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:12.081 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:11 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:12.081 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:11 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:12.081 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:11 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:12.081 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:11 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:12.081 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:11 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:12.081 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:11 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:12.081 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:11 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:12.081 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:11 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:12.081 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:11 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:12.081 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:11 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:12.081 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:11 smithi099 ceph-mon[137093]: Health check cleared: CEPHADM_FAILED_DAEMON (was: 1 failed cephadm daemon(s)) 2024-03-30T14:11:12.082 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:11 smithi099 ceph-mon[137093]: Cluster is now healthy 2024-03-30T14:11:12.082 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:11 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:12.082 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:11 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:12.082 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:11 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:12.082 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:11 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:12.082 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:11 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:12.082 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:11 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:12.082 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:11 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:12.082 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:11 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:12.082 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:11 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:12.082 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:11 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:12.082 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:11 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:12.082 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:11 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:12.082 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:11 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:12.083 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:11 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:12.083 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:11 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:12.083 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:11 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:12.083 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:11 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:12.083 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:11 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:12.083 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:11 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:12.083 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:11 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:12.083 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:11 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:12.083 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:11 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:12.083 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:11 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:12.083 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:11 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:12.084 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:11 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:12.084 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:11 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:12.084 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:11 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:12.084 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:11 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:12.084 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:11 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:12.084 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:11 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:12.084 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:11 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:12.084 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:11 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:12.084 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:11 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:12.084 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:11 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:12.084 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:11 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:12.084 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:11 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:12.084 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:11 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:12.084 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:11 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:12.084 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:11 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:12.084 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:11 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:12.085 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:11 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:12.085 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:11 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:12.085 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:11 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:12.085 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:11 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:12.085 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:11 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:12.085 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:11 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:12.085 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:11 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:12.085 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:11 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:12.085 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:11 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:12.085 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:11 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:12.085 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:11 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:12.085 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:11 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:12.085 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:11 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:12.085 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:11 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:12.086 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:11 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:12.086 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:11 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:12.086 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:11 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:12.086 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:11 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:12.086 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:11 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:12.086 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:11 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:12.086 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:11 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:12.086 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:11 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:12.086 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:11 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:12.086 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:11 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:12.086 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:11 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:12.086 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:11 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:12.997 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:12 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:12.997 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:12 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:12.997 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:12 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:12.997 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:12 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:12.997 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:12 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:12.997 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:12 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:12.998 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:12 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:12.998 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:12 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:12.998 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:12 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:12.998 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:12 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:12.998 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:12 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:12.998 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:12 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:12.998 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:12 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:12.998 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:12 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:12.998 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:12 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:12.998 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:12 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:12.998 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:12 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:12.998 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:12 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:12.998 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:12 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:12.998 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:12 smithi181 ceph-mon[115276]: pgmap v281: 161 pgs: 161 active+clean; 585 KiB data, 257 MiB used, 715 GiB / 715 GiB avail; 82 KiB/s rd, 93 B/s wr, 126 op/s 2024-03-30T14:11:12.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:12 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:12.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:12 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:12.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:12 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:12.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:12 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:12.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:12 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:12.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:12 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:12.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:12 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:12.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:12 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:12.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:12 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:12.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:12 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:12.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:12 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:12.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:12 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:12.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:12 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:12.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:12 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:12.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:12 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:12.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:12 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:13.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:12 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:13.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:12 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:13.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:12 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:13.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:12 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:13.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:12 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:13.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:12 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:13.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:12 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:13.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:12 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:13.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:12 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:13.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:12 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:13.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:12 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:13.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:12 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:13.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:12 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:13.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:12 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:13.078 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:12 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:13.078 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:12 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:13.078 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:12 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:13.078 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:12 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:13.078 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:12 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:13.078 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:12 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:13.078 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:12 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:13.079 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:12 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:13.079 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:12 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:13.079 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:12 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:13.079 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:12 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:13.079 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:12 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:13.079 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:12 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:13.079 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:12 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:13.079 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:12 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:13.079 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:12 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:13.079 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:12 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:13.079 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:12 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:13.079 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:12 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:13.079 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:12 smithi099 ceph-mon[143401]: pgmap v281: 161 pgs: 161 active+clean; 585 KiB data, 257 MiB used, 715 GiB / 715 GiB avail; 82 KiB/s rd, 93 B/s wr, 126 op/s 2024-03-30T14:11:13.079 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:12 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:13.079 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:12 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:13.079 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:12 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:13.080 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:12 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:13.080 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:12 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:13.080 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:12 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:13.080 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:12 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:13.080 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:12 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:13.080 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:12 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:13.080 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:12 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:13.080 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:12 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:13.080 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:12 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:13.080 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:12 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:13.081 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:12 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:13.081 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:12 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:13.081 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:12 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:13.081 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:12 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:13.081 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:12 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:13.081 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:12 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:13.081 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:12 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:13.081 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:12 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:13.081 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:12 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:13.081 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:12 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:13.081 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:12 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:13.081 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:12 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:13.081 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:12 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:13.081 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:12 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:13.081 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:12 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:13.081 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:12 smithi099 ceph-mon[137093]: pgmap v281: 161 pgs: 161 active+clean; 585 KiB data, 257 MiB used, 715 GiB / 715 GiB avail; 82 KiB/s rd, 93 B/s wr, 126 op/s 2024-03-30T14:11:13.082 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:12 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:13.082 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:12 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:13.082 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:12 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:13.082 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:12 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:13.082 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:12 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:13.082 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:12 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:13.082 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:12 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:13.082 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:12 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:13.082 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:12 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:13.082 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:12 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:13.083 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:12 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:13.083 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:12 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:13.083 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:12 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:13.083 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:12 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:13.083 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:12 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:13.083 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:12 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:13.083 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:12 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:13.083 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:12 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:13.083 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:12 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:13.083 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:12 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:13.083 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:12 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:13.083 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:12 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:13.084 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:12 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:13.084 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:12 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:13.084 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:12 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:13.084 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:12 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:13.084 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:12 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:13.084 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:12 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:13.084 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:12 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:13.084 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:12 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:13.084 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:12 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:13.084 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:12 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:13.084 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:12 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:13.085 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:12 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:13.085 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:12 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:13.085 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:12 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:13.085 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:12 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:13.085 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:12 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:13.085 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:12 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:13.085 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:12 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:13.085 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:12 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:13.085 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:12 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:13.085 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:12 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:13.085 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:12 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:13.085 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:12 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:13.085 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:12 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:13.085 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:12 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:13.085 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:12 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:13.086 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:12 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:13.086 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:12 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:13.086 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:12 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:13.938 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:13 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:13.939 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:13 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:13.939 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:13 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:13.939 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:13 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:13.939 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:13 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:13.939 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:13 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:13.939 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:13 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:13.939 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:13 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:13.939 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:13 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:13.939 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:13 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:13.939 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:13 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:13.939 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:13 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:13.939 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:13 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:13.939 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:13 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:13.939 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:13 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:13.940 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:13 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:13.940 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:13 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:13.940 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:13 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:13.940 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:13 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:13.940 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:13 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:13.940 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:13 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:13.940 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:13 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:13.940 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:13 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:13.940 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:13 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:13.940 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:13 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:13.940 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:13 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:13.940 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:13 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:13.940 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:13 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:13.940 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:13 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:13.940 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:13 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:13.940 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:13 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:13.941 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:13 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:13.941 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:13 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:13.941 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:13 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:13.941 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:13 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:13.941 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:13 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:13.941 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:13 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:13.941 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:13 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:13.941 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:13 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:13.941 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:13 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:13.941 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:13 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:14.297 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:13 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:14.297 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:13 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:14.297 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:13 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:14.297 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:13 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:14.297 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:13 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:14.297 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:13 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:14.297 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:13 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:14.297 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:13 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:14.297 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:13 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:14.297 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:13 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:14.297 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:13 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:14.298 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:13 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:14.298 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:13 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:14.298 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:13 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:14.298 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:13 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:14.298 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:13 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:14.298 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:13 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:14.298 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:13 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:14.298 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:13 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:14.298 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:13 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:14.298 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:13 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:14.298 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:13 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:14.298 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:13 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:14.298 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:13 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:14.298 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:13 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:14.298 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:13 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:14.299 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:13 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:14.299 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:13 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:14.299 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:13 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:14.299 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:13 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:14.299 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:13 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:14.299 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:13 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:14.299 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:13 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:14.299 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:13 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:14.299 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:13 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:14.299 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:13 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:14.299 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:13 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:14.299 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:13 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:14.299 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:13 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:14.299 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:13 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:14.299 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:13 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:14.300 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:13 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:14.300 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:13 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:14.300 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:13 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:14.300 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:13 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:14.300 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:13 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:14.300 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:13 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:14.300 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:13 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:14.300 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:13 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:14.300 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:13 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:14.300 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:13 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:14.300 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:13 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:14.300 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:13 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:14.301 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:13 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:14.301 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:13 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:14.301 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:13 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:14.301 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:13 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:14.301 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:13 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:14.301 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:13 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:14.301 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:13 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:14.301 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:13 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:14.301 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:13 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:14.301 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:13 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:14.301 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:13 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:14.301 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:13 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:14.301 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:13 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:14.301 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:13 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:14.301 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:13 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:14.301 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:13 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:14.302 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:13 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:14.302 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:13 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:14.302 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:13 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:14.302 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:13 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:14.302 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:13 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:14.302 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:13 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:14.302 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:13 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:14.302 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:13 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:14.302 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:13 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:14.302 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:13 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:14.302 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:13 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:14.302 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:13 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:14.302 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:13 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:14.997 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:14 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:14.997 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:14 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:14.997 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:14 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:14.997 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:14 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:14.997 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:14 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:14.997 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:14 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:14.997 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:14 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:14.997 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:14 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:14.997 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:14 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:14.998 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:14 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:14.998 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:14 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:14.998 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:14 smithi181 ceph-mon[115276]: pgmap v282: 161 pgs: 161 active+clean; 585 KiB data, 257 MiB used, 715 GiB / 715 GiB avail; 99 KiB/s rd, 93 B/s wr, 152 op/s 2024-03-30T14:11:14.998 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:14 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:14.998 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:14 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:14.998 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:14 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:14.998 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:14 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:14.998 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:14 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:14.998 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:14 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:14.998 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:14 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:14.998 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:14 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:14.998 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:14 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:14.998 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:14 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:14.998 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:14 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:14.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:14 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:14.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:14 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:14.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:14 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:14.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:14 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:14.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:14 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:14.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:14 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:14.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:14 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:14.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:14 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:14.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:14 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:14.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:14 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:14.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:14 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:14.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:14 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:14.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:14 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:14.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:14 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:14.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:14 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:14.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:14 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:15.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:14 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:15.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:14 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:15.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:14 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:15.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:14 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:15.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:14 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:15.077 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 14:11:14 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[71049]: ::ffff:172.21.15.181 - - [30/Mar/2024:14:11:14] "GET /metrics HTTP/1.1" 200 38378 "" "Prometheus/2.43.0" 2024-03-30T14:11:15.078 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:14 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:15.078 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:14 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:15.078 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:14 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:15.078 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:14 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:15.078 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:14 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:15.078 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:14 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:15.078 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:14 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:15.079 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:14 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:15.079 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:14 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:15.079 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:14 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:15.079 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:14 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:15.079 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:14 smithi099 ceph-mon[137093]: pgmap v282: 161 pgs: 161 active+clean; 585 KiB data, 257 MiB used, 715 GiB / 715 GiB avail; 99 KiB/s rd, 93 B/s wr, 152 op/s 2024-03-30T14:11:15.079 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:14 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:15.079 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:14 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:15.079 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:14 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:15.079 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:14 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:15.079 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:14 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:15.079 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:14 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:15.079 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:14 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:15.079 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:14 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:15.079 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:14 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:15.079 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:14 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:15.080 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:14 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:15.080 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:14 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:15.080 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:14 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:15.080 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:14 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:15.080 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:14 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:15.080 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:14 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:15.080 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:14 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:15.080 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:14 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:15.080 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:14 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:15.080 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:14 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:15.080 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:14 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:15.080 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:14 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:15.081 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:14 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:15.081 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:14 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:15.081 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:14 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:15.081 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:14 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:15.081 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:14 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:15.081 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:14 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:15.081 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:14 smithi099 ceph-mon[143401]: pgmap v282: 161 pgs: 161 active+clean; 585 KiB data, 257 MiB used, 715 GiB / 715 GiB avail; 99 KiB/s rd, 93 B/s wr, 152 op/s 2024-03-30T14:11:15.081 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:14 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:15.081 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:14 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:15.081 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:14 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:15.081 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:14 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:15.081 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:14 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:15.081 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:14 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:15.081 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:14 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:15.082 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:14 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:15.082 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:14 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:15.082 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:14 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:15.082 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:14 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:15.082 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:14 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:15.082 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:14 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:15.082 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:14 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:15.082 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:14 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:15.082 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:14 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:15.082 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:14 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:15.082 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:14 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:15.083 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:14 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:15.083 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:14 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:15.083 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:14 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:15.083 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:14 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:15.083 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:14 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:15.083 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:14 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:15.083 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:14 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:15.083 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:14 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:15.083 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:14 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:15.083 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:14 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:15.083 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:14 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:15.083 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:14 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:15.083 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:14 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:15.083 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:14 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:15.084 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:14 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:15.084 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:14 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:15.084 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:14 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:15.084 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:14 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:15.084 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:14 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:15.084 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:14 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:15.084 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:14 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:15.084 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:14 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:15.084 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:14 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:15.084 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:14 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:15.084 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:14 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:15.084 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:14 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:15.084 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:14 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:15.085 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:14 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:15.085 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:14 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:16.082 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:15 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:16.082 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:15 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:16.082 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:15 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:16.082 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:15 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:16.082 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:15 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:16.082 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:15 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:16.082 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:15 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:16.082 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:15 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:16.083 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:15 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:16.083 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:15 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:16.083 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:15 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:16.083 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:15 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:16.083 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:15 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:16.083 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:15 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:16.083 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:15 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:16.083 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:15 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:16.083 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:15 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:16.083 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:15 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:16.083 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:15 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:16.083 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:15 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:16.083 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:15 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:16.083 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:15 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:16.084 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:15 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:16.084 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:15 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:16.084 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:15 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:16.084 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:15 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:16.084 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:15 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:16.084 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:15 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:16.084 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:15 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:16.084 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:15 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:16.084 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:15 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:16.084 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:15 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:16.084 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:15 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:16.084 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:15 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:16.084 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:15 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:16.084 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:15 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:16.084 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:15 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:16.085 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:15 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:16.085 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:15 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:16.085 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:15 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:16.085 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:15 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:16.085 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:15 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:16.085 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:15 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:16.085 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:15 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:16.085 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:15 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:16.085 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:15 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:16.085 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:15 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:16.085 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:15 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:16.085 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:15 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:16.085 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:15 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:16.085 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:15 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:16.086 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:15 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:16.086 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:15 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:16.086 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:15 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:16.086 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:15 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:16.086 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:15 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:16.086 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:15 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:16.086 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:15 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:16.086 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:15 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:16.086 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:15 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:16.086 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:15 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:16.086 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:15 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:16.086 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:15 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:16.086 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:15 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:16.086 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:15 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:16.087 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:15 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:16.137 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:15 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:16.137 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:15 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:16.137 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:15 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:16.137 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:15 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:16.137 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:15 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:16.137 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:15 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:16.137 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:15 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:16.137 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:15 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:16.137 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:15 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:16.138 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:15 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:16.138 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:15 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:16.138 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:15 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:16.138 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:15 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:16.138 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:15 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:16.138 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:15 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:16.138 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:15 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:16.138 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:15 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:16.138 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:15 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:16.138 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:15 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:16.138 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:15 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:16.138 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:15 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:16.138 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:15 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:16.138 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:15 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:16.139 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:15 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:16.139 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:15 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:16.139 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:15 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:16.139 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:15 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:16.139 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:15 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:16.139 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:15 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:16.139 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:15 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:16.139 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:15 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:16.139 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:15 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:16.139 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:15 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:16.139 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:15 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:16.139 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:15 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:16.139 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:15 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:16.139 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:15 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:16.140 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:15 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:16.140 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:15 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:16.140 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:15 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:16.140 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:15 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:16.140 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:15 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:16.140 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:15 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:16.140 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:15 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:16.140 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:15 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:16.140 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:15 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:16.140 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:15 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:16.140 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:15 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:16.140 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:15 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:16.140 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:15 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:16.140 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:15 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:16.141 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:15 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:16.141 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:15 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:16.141 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:15 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:16.141 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:15 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:16.141 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:15 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:16.141 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:15 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:16.141 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:15 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:16.141 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:15 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:16.141 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:15 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:16.141 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:15 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:16.141 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:15 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:16.141 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:15 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:16.141 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:15 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:16.141 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:15 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:16.142 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:15 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:16.142 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:15 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:16.142 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:15 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:16.142 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:15 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:16.142 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:15 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:16.142 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:15 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:16.142 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:15 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:16.142 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:15 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:16.142 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:15 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:16.142 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:15 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:16.142 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:15 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:16.142 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:15 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:16.143 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:15 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:16.143 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:15 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:16.143 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:15 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:16.143 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:15 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:16.143 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:15 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:16.143 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:15 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:16.143 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:15 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:16.143 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:15 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:16.143 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:15 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:16.143 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:15 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:16.143 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:15 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:16.143 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:15 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:16.143 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:15 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:16.143 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:15 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:16.144 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:15 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:16.144 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:15 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:16.144 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:15 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:16.144 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:15 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:16.144 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:15 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:16.144 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:15 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:16.144 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:15 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:16.144 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:15 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:16.144 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:15 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:16.144 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:15 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:16.144 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:15 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:16.144 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:15 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:16.144 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:15 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:16.144 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:15 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:16.145 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:15 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:16.145 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:15 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:16.145 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:15 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:16.145 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:15 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:16.145 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:15 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:16.145 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:15 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:16.145 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:15 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:16.145 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:15 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:16.145 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:15 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:16.145 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:15 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:16.145 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:15 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:16.145 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:15 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:16.145 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:15 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:16.145 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:15 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:16.145 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:15 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:16.146 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:15 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:16.146 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:15 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:16.146 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:15 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:16.146 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:15 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:16.146 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:15 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:16.146 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:15 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:16.146 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:15 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:16.146 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:15 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:16.146 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:15 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:16.146 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:15 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:16.146 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:15 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:16.146 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:15 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:17.078 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:16 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:17.078 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:16 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:17.078 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:16 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:17.078 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:16 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:17.078 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:16 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:17.078 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:16 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:17.078 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:16 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:17.079 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:16 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:17.079 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:16 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:17.079 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:16 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:17.079 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:16 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:17.079 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:16 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:17.079 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:16 smithi099 ceph-mon[143401]: pgmap v283: 161 pgs: 161 active+clean; 585 KiB data, 265 MiB used, 715 GiB / 715 GiB avail; 92 KiB/s rd, 93 B/s wr, 141 op/s 2024-03-30T14:11:17.079 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:16 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:17.079 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:16 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:17.079 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:16 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:17.079 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:16 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:17.079 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:16 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:17.079 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:16 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:17.079 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:16 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:17.080 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:16 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:17.080 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:16 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:17.080 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:16 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:17.080 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:16 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:17.080 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:16 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:17.080 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:16 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:17.080 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:16 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:17.080 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:16 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:17.080 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:16 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:17.080 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:16 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:17.080 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:16 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:17.081 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:16 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:17.081 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:16 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:17.081 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:16 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:17.081 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:16 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:17.081 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:16 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:17.081 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:16 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:17.081 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:16 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:17.081 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:16 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:17.081 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:16 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:17.081 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:16 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:17.081 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:16 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:17.081 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:16 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:17.081 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:16 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:17.082 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:16 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:17.082 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:16 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:17.082 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:16 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:17.082 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:16 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:17.082 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:16 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:17.082 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:16 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:17.083 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:16 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:17.083 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:16 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:17.083 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:16 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:17.083 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:16 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:17.083 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:16 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:17.083 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:16 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:17.083 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:16 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:17.083 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:16 smithi099 ceph-mon[137093]: pgmap v283: 161 pgs: 161 active+clean; 585 KiB data, 265 MiB used, 715 GiB / 715 GiB avail; 92 KiB/s rd, 93 B/s wr, 141 op/s 2024-03-30T14:11:17.083 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:16 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:17.083 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:16 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:17.083 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:16 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:17.083 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:16 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:17.083 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:16 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:17.083 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:16 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:17.084 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:16 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:17.084 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:16 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:17.084 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:16 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:17.084 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:16 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:17.084 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:16 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:17.084 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:16 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:17.084 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:16 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:17.084 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:16 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:17.084 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:16 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:17.084 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:16 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:17.084 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:16 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:17.084 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:16 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:17.084 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:16 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:17.084 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:16 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:17.085 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:16 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:17.085 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:16 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:17.085 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:16 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:17.085 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:16 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:17.085 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:16 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:17.085 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:16 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:17.085 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:16 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:17.085 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:16 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:17.085 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:16 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:17.085 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:16 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:17.086 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:16 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:17.086 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:16 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:17.247 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:16 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:17.247 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:16 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:17.247 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:16 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:17.247 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:16 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:17.247 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:16 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:17.248 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:16 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:17.248 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:16 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:17.248 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:16 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:17.248 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:16 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:17.248 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:16 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:17.248 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:16 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:17.248 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:16 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:17.248 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:16 smithi181 ceph-mon[115276]: pgmap v283: 161 pgs: 161 active+clean; 585 KiB data, 265 MiB used, 715 GiB / 715 GiB avail; 92 KiB/s rd, 93 B/s wr, 141 op/s 2024-03-30T14:11:17.248 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:16 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:17.248 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:16 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:17.248 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:16 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:17.248 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:16 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:17.248 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:16 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:17.248 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:16 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:17.248 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:16 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:17.249 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:16 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:17.249 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:16 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:17.249 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:16 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:17.249 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:16 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:17.249 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:16 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:17.249 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:16 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:17.249 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:16 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:17.249 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:16 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:17.249 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:16 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:17.249 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:16 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:17.249 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:16 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:17.249 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:16 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:17.249 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:16 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:17.249 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:16 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:17.249 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:16 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:17.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:16 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:17.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:16 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:17.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:16 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:17.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:16 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:17.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:16 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:17.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:16 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:17.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:16 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:17.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:16 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:17.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:16 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:17.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:16 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:17.997 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:17 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:17.997 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:17 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:17.997 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:17 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:17.997 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:17 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:17.997 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:17 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:17.997 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:17 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:17.998 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:17 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:17.998 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:17 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:17.998 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:17 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:17.998 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:17 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:17.998 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:17 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:17.998 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:17 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:17.998 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:17 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:17.998 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:17 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:17.998 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:17 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:17.998 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:17 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:17.998 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:17 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:17.998 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:17 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:17.998 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:17 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:17.998 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:17 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:17.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:17 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:17.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:17 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:17.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:17 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:17.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:17 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:17.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:17 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:17.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:17 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:17.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:17 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:17.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:17 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:17.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:17 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:17.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:17 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:17.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:17 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:17.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:17 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:18.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:17 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:18.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:17 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:18.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:17 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:18.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:17 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:18.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:17 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:18.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:17 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:18.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:17 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:18.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:17 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:18.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:17 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:18.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:17 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:18.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:17 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:18.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:17 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:18.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:17 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:18.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:17 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:18.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:17 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:18.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:17 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:18.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:17 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:18.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:17 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:18.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:17 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:18.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:17 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:18.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:17 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:18.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:17 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:18.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:17 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:18.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:17 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:18.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:17 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:18.002 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:17 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:18.002 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:17 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:18.002 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:17 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:18.002 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:17 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:18.078 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:17 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:18.078 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:17 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:18.078 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:17 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:18.078 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:17 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:18.078 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:17 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:18.078 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:17 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:18.078 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:17 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:18.079 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:17 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:18.079 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:17 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:18.079 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:17 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:18.079 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:17 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:18.079 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:17 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:18.079 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:17 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:18.079 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:17 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:18.079 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:17 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:18.079 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:17 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:18.079 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:17 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:18.079 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:17 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:18.079 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:17 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:18.079 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:17 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:18.080 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:17 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:18.080 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:17 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:18.080 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:17 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:18.080 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:17 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:18.080 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:17 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:18.080 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:17 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:18.080 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:17 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:18.080 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:17 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:18.080 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:17 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:18.080 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:17 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:18.080 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:17 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:18.081 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:17 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:18.081 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:17 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:18.081 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:17 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:18.081 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:17 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:18.081 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:17 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:18.081 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:17 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:18.081 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:17 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:18.081 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:17 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:18.081 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:17 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:18.081 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:17 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:18.081 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:17 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:18.081 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:17 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:18.081 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:17 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:18.081 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:17 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:18.082 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:17 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:18.082 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:17 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:18.082 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:17 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:18.082 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:17 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:18.082 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:17 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:18.082 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:17 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:18.082 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:17 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:18.082 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:17 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:18.082 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:17 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:18.082 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:17 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:18.082 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:17 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:18.082 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:17 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:18.082 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:17 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:18.082 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:17 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:18.082 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:17 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:18.083 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:17 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:18.083 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:17 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:18.083 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:17 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:18.083 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:17 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:18.083 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:17 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:18.084 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:17 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:18.084 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:17 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:18.084 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:17 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:18.084 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:17 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:18.084 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:17 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:18.084 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:17 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:18.084 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:17 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:18.084 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:17 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:18.084 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:17 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:18.084 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:17 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:18.084 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:17 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:18.084 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:17 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:18.084 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:17 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:18.084 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:17 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:18.085 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:17 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:18.085 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:17 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:18.085 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:17 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:18.085 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:17 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:18.085 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:17 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:18.085 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:17 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:18.085 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:17 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:18.085 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:17 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:18.085 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:17 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:18.085 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:17 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:18.085 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:17 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:18.085 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:17 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:18.085 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:17 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:18.086 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:17 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:18.086 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:17 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:18.086 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:17 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:18.086 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:17 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:18.086 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:17 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:18.086 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:17 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:18.086 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:17 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:18.086 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:17 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:18.086 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:17 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:18.086 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:17 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:18.086 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:17 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:18.086 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:17 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:18.086 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:17 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:18.086 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:17 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:18.087 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:17 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:18.087 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:17 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:18.087 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:17 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:18.087 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:17 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:18.087 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:17 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:18.087 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:17 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:18.087 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:17 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:18.087 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:17 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:18.087 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:17 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:18.087 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:17 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:18.088 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:17 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:18.088 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:17 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:18.088 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:17 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:18.088 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:17 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:18.088 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:17 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:18.088 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:17 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:19.155 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:18 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:19.155 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:18 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:19.155 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:18 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:19.155 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:18 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:19.156 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:18 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:19.156 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:18 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:19.156 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:18 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:19.156 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:18 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:19.156 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:18 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:19.156 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:18 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:19.156 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:18 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:19.156 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:18 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:19.156 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:18 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:19.156 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:18 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:19.156 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:18 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:19.156 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:18 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:19.156 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:18 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:19.156 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:18 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:19.156 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:18 smithi099 ceph-mon[137093]: from='client.25136 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T14:11:19.156 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:18 smithi099 ceph-mon[137093]: pgmap v284: 161 pgs: 161 active+clean; 585 KiB data, 265 MiB used, 715 GiB / 715 GiB avail; 71 KiB/s rd, 93 B/s wr, 108 op/s 2024-03-30T14:11:19.157 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:18 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:19.157 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:18 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:19.157 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:18 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:19.157 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:18 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:19.157 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:18 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:19.157 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:18 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:19.157 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:18 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:19.157 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:18 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:19.157 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:18 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:19.157 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:18 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:19.157 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:18 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:19.157 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:18 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:19.158 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:18 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:19.158 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:18 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:19.158 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:18 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:19.158 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:18 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:19.158 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:18 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:19.158 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:18 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:19.158 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:18 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:19.158 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:18 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:19.158 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:18 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:19.158 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:18 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:19.158 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:18 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:19.158 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:18 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:19.158 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:18 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:19.158 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:18 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:19.158 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:18 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:19.159 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:18 smithi099 ceph-mon[143401]: from='client.25136 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T14:11:19.159 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:18 smithi099 ceph-mon[143401]: pgmap v284: 161 pgs: 161 active+clean; 585 KiB data, 265 MiB used, 715 GiB / 715 GiB avail; 71 KiB/s rd, 93 B/s wr, 108 op/s 2024-03-30T14:11:19.159 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:18 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:19.159 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:18 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:19.159 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:18 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:19.159 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:18 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:19.159 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:18 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:19.159 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:18 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:19.159 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:18 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:19.159 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:18 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:19.159 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:18 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:19.160 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:18 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:19.160 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:18 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:19.160 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:18 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:19.160 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:18 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:19.160 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:18 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:19.160 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:18 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:19.160 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:18 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:19.160 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:18 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:19.160 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:18 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:19.160 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:18 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:19.160 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:18 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:19.160 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:18 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:19.160 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:18 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:19.161 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:18 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:19.161 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:18 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:19.161 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:18 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:19.161 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:18 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:19.161 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:18 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:19.161 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:18 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:19.161 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:18 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:19.161 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:18 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:19.161 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:18 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:19.161 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:18 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:19.161 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:18 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:19.161 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:18 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:19.161 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:18 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:19.161 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:18 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:19.161 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:18 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:19.161 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:18 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:19.162 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:18 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:19.162 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:18 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:19.162 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:18 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:19.162 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:18 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:19.162 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:18 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:19.162 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:18 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:19.162 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:18 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:19.162 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:18 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:19.162 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:18 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:19.162 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:18 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:19.162 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:18 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:19.162 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:18 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:19.163 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:18 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:19.163 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:18 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:19.163 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:18 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:19.163 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:18 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:19.163 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:18 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:19.163 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:18 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:19.163 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:18 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:19.163 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:18 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:19.163 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:18 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:19.163 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:18 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:19.163 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:18 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:19.163 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:18 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:19.163 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:18 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:19.163 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:18 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:19.163 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:18 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:19.163 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:18 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:19.164 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:18 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:19.164 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:18 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:19.164 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:18 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:19.164 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:18 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:19.164 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:18 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:19.164 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:18 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:19.164 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:18 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:19.248 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:18 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:19.248 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:18 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:19.248 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:18 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:19.248 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:18 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:19.248 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:18 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:19.248 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:18 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:19.248 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:18 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:19.248 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:18 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:19.248 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:18 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:19.248 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:18 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:19.249 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:18 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:19.249 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:18 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:19.249 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:18 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:19.249 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:18 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:19.249 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:18 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:19.249 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:18 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:19.249 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:18 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:19.249 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:18 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:19.249 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:18 smithi181 ceph-mon[115276]: from='client.25136 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T14:11:19.249 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:18 smithi181 ceph-mon[115276]: pgmap v284: 161 pgs: 161 active+clean; 585 KiB data, 265 MiB used, 715 GiB / 715 GiB avail; 71 KiB/s rd, 93 B/s wr, 108 op/s 2024-03-30T14:11:19.249 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:18 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:19.249 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:18 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:19.249 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:18 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:19.249 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:18 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:19.249 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:18 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:19.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:18 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:19.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:18 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:19.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:18 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:19.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:18 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:19.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:18 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:19.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:18 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:19.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:18 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:19.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:18 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:19.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:18 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:19.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:18 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:19.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:18 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:19.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:18 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:19.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:18 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:19.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:18 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:19.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:18 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:19.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:18 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:19.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:18 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:19.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:18 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:19.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:18 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:19.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:18 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:19.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:18 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:19.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:18 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:19.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:18 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:19.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:18 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:19.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:18 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:19.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:18 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:19.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:18 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:19.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:18 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:19.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:18 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:19.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:18 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:19.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:18 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:19.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:18 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:19.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:18 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:19.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:18 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:19.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:18 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:19.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:18 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:20.129 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:19 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:20.129 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:19 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:20.129 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:19 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:20.129 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:19 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:20.129 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:19 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:20.130 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:19 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:20.130 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:19 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:20.130 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:19 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:20.130 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:19 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:20.130 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:19 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:20.130 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:19 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:20.130 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:19 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:20.130 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:19 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:20.130 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:19 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:20.130 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:19 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:20.130 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:19 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:20.130 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:19 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:20.130 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:19 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:20.131 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:19 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:20.131 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:19 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:20.131 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:19 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:20.131 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:19 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:20.131 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:19 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:20.131 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:19 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:20.131 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:19 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:20.131 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:19 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:20.131 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:19 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:20.131 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:19 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:20.131 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:19 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:20.131 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:19 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:20.131 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:19 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:20.131 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:19 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:20.132 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:19 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:20.132 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:19 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:20.132 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:19 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:20.132 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:19 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:20.132 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:19 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:20.132 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:19 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:20.132 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:19 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:20.132 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:19 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:20.132 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:19 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:20.132 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:19 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:20.132 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:19 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:20.132 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:19 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:20.133 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:19 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:20.133 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:19 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:20.133 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:19 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:20.133 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:19 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:20.133 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:19 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:20.133 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:19 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:20.133 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:19 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:20.133 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:19 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:20.133 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:19 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:20.133 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:19 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:20.133 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:19 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:20.133 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:19 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:20.133 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:19 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:20.133 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:19 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:20.134 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:19 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:20.134 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:19 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:20.134 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:19 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:20.134 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:19 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:20.134 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:19 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:20.134 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:19 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:20.134 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:19 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:20.134 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:19 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:20.134 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:19 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:20.134 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:19 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:20.134 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:19 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:20.135 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:19 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:20.135 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:19 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:20.135 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:19 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:20.135 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:19 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:20.135 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:19 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:20.135 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:19 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:20.135 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:19 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:20.135 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:19 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:20.135 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:19 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:20.135 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:19 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:20.135 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:19 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:20.135 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:19 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:20.135 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:19 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:20.135 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:19 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:20.135 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:19 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:20.136 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:19 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:20.136 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:19 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:20.136 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:19 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:20.136 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:19 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:20.136 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:19 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:20.136 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:19 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:20.136 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:19 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:20.136 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:19 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:20.136 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:19 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:20.136 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:19 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:20.136 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:19 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:20.136 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:19 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:20.136 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:19 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:20.137 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:19 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:20.137 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:19 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:20.137 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:19 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:20.137 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:19 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:20.137 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:19 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:20.137 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:19 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:20.137 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:19 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:20.137 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:19 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:20.137 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:19 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:20.137 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:19 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:20.137 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:19 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:20.137 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:19 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:20.137 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:19 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:20.137 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:19 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:20.137 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:19 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:20.138 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:19 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:20.138 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:19 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:20.138 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:19 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:20.138 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:19 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:20.138 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:19 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:20.138 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:19 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:20.138 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:19 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:20.138 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:19 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:20.138 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:19 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:20.138 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:19 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:20.247 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:19 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:20.247 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:19 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:20.247 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:19 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:20.247 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:19 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:20.247 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:19 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:20.247 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:19 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:20.247 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:19 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:20.247 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:19 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:20.247 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:19 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:20.247 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:19 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:20.248 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:19 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:20.248 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:19 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:20.248 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:19 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:20.248 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:19 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:20.248 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:19 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:20.248 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:19 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:20.248 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:19 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:20.248 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:19 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:20.248 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:19 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:20.248 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:19 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:20.248 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:19 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:20.248 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:19 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:20.248 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:19 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:20.248 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:19 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:20.248 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:19 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:20.249 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:19 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:20.249 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:19 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:20.249 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:19 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:20.249 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:19 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:20.249 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:19 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:20.249 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:19 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:20.249 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:19 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:20.249 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:19 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:20.249 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:19 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:20.249 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:19 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:20.249 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:19 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:20.249 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:19 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:20.249 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:19 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:20.249 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:19 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:20.249 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:19 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:20.249 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:19 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:20.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:19 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:20.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:19 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:20.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:19 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:20.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:19 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:20.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:19 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:20.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:19 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:20.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:19 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:20.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:19 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:20.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:19 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:20.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:19 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:20.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:19 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:20.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:19 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:20.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:19 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:20.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:19 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:20.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:19 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:20.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:19 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:20.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:19 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:20.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:19 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:20.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:19 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:20.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:19 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:20.925 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:20 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:20.925 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:20 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:20.926 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:20 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:20.926 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:20 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:20.926 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:20 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:20.926 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:20 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:20.926 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:20 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:20.926 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:20 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:20.926 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:20 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:20.926 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:20 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:20.926 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:20 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:20.926 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:20 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:20.926 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:20 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:20.926 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:20 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:20.926 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:20 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:20.926 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:20 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:20.927 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:20 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:20.927 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:20 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:20.927 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:20 smithi181 ceph-mon[115276]: pgmap v285: 161 pgs: 161 active+clean; 585 KiB data, 265 MiB used, 715 GiB / 715 GiB avail; 62 KiB/s rd, 93 B/s wr, 95 op/s 2024-03-30T14:11:20.927 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:20 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:20.927 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:20 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:20.927 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:20 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:20.927 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:20 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:20.927 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:20 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:20.927 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:20 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:20.927 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:20 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:20.927 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:20 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:20.927 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:20 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:20.927 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:20 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:20.927 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:20 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:20.927 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:20 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:20.928 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:20 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:20.928 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:20 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:20.928 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:20 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:20.928 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:20 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:20.928 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:20 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:20.928 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:20 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:20.928 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:20 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:20.928 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:20 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:20.928 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:20 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:20.928 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:20 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:20.928 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:20 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:20.928 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:20 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:20.928 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:20 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:20.928 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:20 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:20.929 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:20 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:20.929 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:20 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:20.929 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:20 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:20.929 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:20 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:20.929 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:20 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:20.929 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:20 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:20.929 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:20 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:20.929 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:20 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:20.929 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:20 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:20.929 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:20 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:20.929 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:20 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:20.929 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:20 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:20.929 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:20 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:20.929 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:20 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:20.929 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:20 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:20.930 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:20 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:20.930 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:20 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:20.930 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:20 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:20.930 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:20 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:20.930 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:20 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:20.930 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:20 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:21.237 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:20 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:21.238 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:20 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:21.238 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:20 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:21.238 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:20 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:21.238 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:20 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:21.238 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:20 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:21.238 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:20 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:21.238 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:20 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:21.238 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:20 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:21.238 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:20 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:21.238 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:20 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:21.238 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:20 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:21.238 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:20 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:21.238 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:20 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:21.238 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:20 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:21.239 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:20 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:21.239 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:20 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:21.239 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:20 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:21.239 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:20 smithi099 ceph-mon[137093]: pgmap v285: 161 pgs: 161 active+clean; 585 KiB data, 265 MiB used, 715 GiB / 715 GiB avail; 62 KiB/s rd, 93 B/s wr, 95 op/s 2024-03-30T14:11:21.239 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:20 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:21.239 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:20 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:21.239 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:20 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:21.239 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:20 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:21.239 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:20 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:21.239 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:20 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:21.239 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:20 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:21.239 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:20 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:21.239 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:20 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:21.239 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:20 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:21.240 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:20 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:21.240 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:20 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:21.240 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:20 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:21.240 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:20 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:21.240 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:20 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:21.240 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:20 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:21.240 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:20 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:21.240 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:20 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:21.241 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:20 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:21.241 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:20 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:21.241 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:20 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:21.241 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:20 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:21.241 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:20 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:21.241 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:20 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:21.241 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:20 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:21.241 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:20 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:21.241 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:20 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:21.241 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:20 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:21.241 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:20 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:21.241 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:20 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:21.241 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:20 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:21.241 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:20 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:21.241 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:20 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:21.242 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:20 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:21.242 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:20 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:21.242 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:20 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:21.242 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:20 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:21.242 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:20 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:21.242 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:20 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:21.242 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:20 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:21.242 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:20 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:21.242 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:20 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:21.243 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:20 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:21.243 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:20 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:21.243 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:20 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:21.243 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:20 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:21.243 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:20 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:21.243 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:20 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:21.243 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:20 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:21.243 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:20 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:21.243 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:20 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:21.243 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:20 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:21.243 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:20 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:21.244 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:20 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:21.244 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:20 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:21.244 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:20 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:21.244 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:20 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:21.244 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:20 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:21.244 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:20 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:21.244 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:20 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:21.244 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:20 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:21.244 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:20 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:21.244 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:20 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:21.244 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:20 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:21.244 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:20 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:21.244 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:20 smithi099 ceph-mon[143401]: pgmap v285: 161 pgs: 161 active+clean; 585 KiB data, 265 MiB used, 715 GiB / 715 GiB avail; 62 KiB/s rd, 93 B/s wr, 95 op/s 2024-03-30T14:11:21.244 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:20 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:21.245 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:20 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:21.245 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:20 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:21.245 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:20 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:21.245 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:20 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:21.245 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:20 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:21.245 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:20 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:21.245 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:20 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:21.245 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:20 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:21.245 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:20 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:21.245 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:20 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:21.245 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:20 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:21.245 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:20 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:21.245 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:20 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:21.245 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:20 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:21.245 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:20 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:21.246 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:20 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:21.246 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:20 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:21.246 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:20 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:21.246 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:20 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:21.246 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:20 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:21.246 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:20 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:21.246 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:20 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:21.246 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:20 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:21.246 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:20 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:21.246 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:20 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:21.246 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:20 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:21.246 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:20 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:21.246 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:20 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:21.247 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:20 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:21.247 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:20 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:21.247 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:20 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:21.247 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:20 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:21.247 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:20 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:21.247 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:20 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:21.247 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:20 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:21.247 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:20 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:21.247 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:20 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:21.247 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:20 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:21.247 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:20 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:21.247 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:20 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:21.247 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:20 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:21.247 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:20 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:21.247 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:20 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:21.248 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:20 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:21.248 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:20 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:21.248 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:20 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:22.120 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:21 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:22.120 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:21 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:22.120 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:21 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:22.120 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:21 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:22.120 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:21 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:22.120 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:21 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:22.120 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:21 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:22.120 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:21 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:22.120 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:21 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:22.121 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:21 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:22.121 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:21 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:22.121 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:21 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:22.121 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:21 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:22.121 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:21 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:22.121 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:21 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:22.121 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:21 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:22.121 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:21 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:22.121 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:21 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:22.121 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:21 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:22.121 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:21 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:22.121 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:21 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:22.121 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:21 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:22.121 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:21 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:22.122 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:21 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:22.122 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:21 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:22.122 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:21 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:22.122 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:21 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:22.122 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:21 smithi099 ceph-mon[137093]: pgmap v286: 161 pgs: 161 active+clean; 585 KiB data, 265 MiB used, 715 GiB / 715 GiB avail; 61 KiB/s rd, 91 B/s wr, 93 op/s 2024-03-30T14:11:22.122 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:21 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:22.122 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:21 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:22.122 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:21 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:22.122 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:21 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:22.122 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:21 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:22.122 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:21 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:22.123 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:21 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:22.123 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:21 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:22.123 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:21 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:22.123 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:21 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:22.123 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:21 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:22.123 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:21 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:22.123 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:21 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:22.123 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:21 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:22.123 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:21 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:22.123 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:21 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:22.123 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:21 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:22.123 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:21 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:22.123 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:21 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:22.123 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:21 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:22.124 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:21 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:22.124 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:21 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:22.124 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:21 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:22.124 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:21 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:22.124 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:21 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:22.124 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:21 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:22.124 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:21 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:22.124 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:21 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:22.124 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:21 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:22.124 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:21 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:22.124 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:21 smithi099 ceph-mon[143401]: pgmap v286: 161 pgs: 161 active+clean; 585 KiB data, 265 MiB used, 715 GiB / 715 GiB avail; 61 KiB/s rd, 91 B/s wr, 93 op/s 2024-03-30T14:11:22.124 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:21 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:22.125 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:21 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:22.125 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:21 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:22.125 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:21 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:22.125 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:21 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:22.125 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:21 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:22.125 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:21 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:22.125 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:21 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:22.125 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:21 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T14:11:22.125 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:21 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:22.126 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:21 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:22.126 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:21 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:22.126 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:21 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:22.126 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:21 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:22.126 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:21 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T14:11:22.247 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:21 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:22.247 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:21 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:22.248 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:21 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:22.248 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:21 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:22.248 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:21 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:22.248 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:21 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:22.248 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:21 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:22.248 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:21 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:22.248 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:21 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:22.248 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:21 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:22.248 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:21 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:22.248 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:21 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:22.248 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:21 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:22.248 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:21 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:22.248 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:21 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:22.248 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:21 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:22.249 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:21 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:22.249 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:21 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:22.249 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:21 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:22.249 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:21 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:22.249 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:21 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:22.249 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:21 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:22.249 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:21 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:22.249 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:21 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:22.249 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:21 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:22.249 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:21 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:22.249 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:21 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:22.249 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:21 smithi181 ceph-mon[115276]: pgmap v286: 161 pgs: 161 active+clean; 585 KiB data, 265 MiB used, 715 GiB / 715 GiB avail; 61 KiB/s rd, 91 B/s wr, 93 op/s 2024-03-30T14:11:22.249 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:21 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:22.249 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:21 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:22.249 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:21 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:22.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:21 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:22.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:21 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:22.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:21 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:22.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:21 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:22.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:21 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:22.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:21 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T14:11:22.938 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:22 smithi099 ceph-mon[137093]: Health check failed: 1 failed cephadm daemon(s) (CEPHADM_FAILED_DAEMON) 2024-03-30T14:11:22.938 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:22 smithi099 ceph-mon[143401]: Health check failed: 1 failed cephadm daemon(s) (CEPHADM_FAILED_DAEMON) 2024-03-30T14:11:22.967 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:22 smithi181 ceph-mon[115276]: Health check failed: 1 failed cephadm daemon(s) (CEPHADM_FAILED_DAEMON) 2024-03-30T14:11:23.897 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:23 smithi099 ceph-mon[137093]: pgmap v287: 161 pgs: 161 active+clean; 585 KiB data, 265 MiB used, 715 GiB / 715 GiB avail; 39 KiB/s rd, 91 B/s wr, 59 op/s 2024-03-30T14:11:23.897 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:23 smithi099 ceph-mon[143401]: pgmap v287: 161 pgs: 161 active+clean; 585 KiB data, 265 MiB used, 715 GiB / 715 GiB avail; 39 KiB/s rd, 91 B/s wr, 59 op/s 2024-03-30T14:11:24.246 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:23 smithi181 ceph-mon[115276]: pgmap v287: 161 pgs: 161 active+clean; 585 KiB data, 265 MiB used, 715 GiB / 715 GiB avail; 39 KiB/s rd, 91 B/s wr, 59 op/s 2024-03-30T14:11:25.063 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 14:11:24 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[71049]: ::ffff:172.21.15.181 - - [30/Mar/2024:14:11:24] "GET /metrics HTTP/1.1" 200 38391 "" "Prometheus/2.43.0" 2024-03-30T14:11:26.747 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:26 smithi181 ceph-mon[115276]: pgmap v288: 161 pgs: 161 active+clean; 585 KiB data, 265 MiB used, 715 GiB / 715 GiB avail; 23 KiB/s rd, 91 B/s wr, 34 op/s 2024-03-30T14:11:26.747 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:26 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:26.747 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:26 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:26.747 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:26 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:26.782 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:26 smithi099 ceph-mon[137093]: pgmap v288: 161 pgs: 161 active+clean; 585 KiB data, 265 MiB used, 715 GiB / 715 GiB avail; 23 KiB/s rd, 91 B/s wr, 34 op/s 2024-03-30T14:11:26.783 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:26 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:26.783 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:26 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:26.783 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:26 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:26.783 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:26 smithi099 ceph-mon[143401]: pgmap v288: 161 pgs: 161 active+clean; 585 KiB data, 265 MiB used, 715 GiB / 715 GiB avail; 23 KiB/s rd, 91 B/s wr, 34 op/s 2024-03-30T14:11:26.783 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:26 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:26.783 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:26 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:26.783 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:26 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:27.628 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:27 smithi099 ceph-mon[137093]: pgmap v289: 161 pgs: 161 active+clean; 585 KiB data, 265 MiB used, 715 GiB / 715 GiB avail; 1.0 KiB/s rd, 1 op/s 2024-03-30T14:11:27.628 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:27 smithi099 ceph-mon[137093]: Upgrade: Updating rgw.foo.smithi099.fxjbmp 2024-03-30T14:11:27.629 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:27 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.foo.smithi099.fxjbmp", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2024-03-30T14:11:27.629 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:27 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.foo.smithi099.fxjbmp", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2024-03-30T14:11:27.629 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:27 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:27.629 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:27 smithi099 ceph-mon[137093]: Deploying daemon rgw.foo.smithi099.fxjbmp on smithi099 2024-03-30T14:11:27.629 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:27 smithi099 ceph-mon[137093]: Health check cleared: CEPHADM_FAILED_DAEMON (was: 1 failed cephadm daemon(s)) 2024-03-30T14:11:27.629 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:27 smithi099 ceph-mon[137093]: Cluster is now healthy 2024-03-30T14:11:27.629 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:27 smithi099 ceph-mon[143401]: pgmap v289: 161 pgs: 161 active+clean; 585 KiB data, 265 MiB used, 715 GiB / 715 GiB avail; 1.0 KiB/s rd, 1 op/s 2024-03-30T14:11:27.629 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:27 smithi099 ceph-mon[143401]: Upgrade: Updating rgw.foo.smithi099.fxjbmp 2024-03-30T14:11:27.629 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:27 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.foo.smithi099.fxjbmp", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2024-03-30T14:11:27.630 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:27 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.foo.smithi099.fxjbmp", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2024-03-30T14:11:27.630 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:27 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:27.630 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:27 smithi099 ceph-mon[143401]: Deploying daemon rgw.foo.smithi099.fxjbmp on smithi099 2024-03-30T14:11:27.630 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:27 smithi099 ceph-mon[143401]: Health check cleared: CEPHADM_FAILED_DAEMON (was: 1 failed cephadm daemon(s)) 2024-03-30T14:11:27.630 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:27 smithi099 ceph-mon[143401]: Cluster is now healthy 2024-03-30T14:11:27.746 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:27 smithi181 ceph-mon[115276]: pgmap v289: 161 pgs: 161 active+clean; 585 KiB data, 265 MiB used, 715 GiB / 715 GiB avail; 1.0 KiB/s rd, 1 op/s 2024-03-30T14:11:27.746 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:27 smithi181 ceph-mon[115276]: Upgrade: Updating rgw.foo.smithi099.fxjbmp 2024-03-30T14:11:27.747 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:27 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.foo.smithi099.fxjbmp", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2024-03-30T14:11:27.747 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:27 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.foo.smithi099.fxjbmp", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2024-03-30T14:11:27.747 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:27 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:27.747 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:27 smithi181 ceph-mon[115276]: Deploying daemon rgw.foo.smithi099.fxjbmp on smithi099 2024-03-30T14:11:27.747 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:27 smithi181 ceph-mon[115276]: Health check cleared: CEPHADM_FAILED_DAEMON (was: 1 failed cephadm daemon(s)) 2024-03-30T14:11:27.747 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:27 smithi181 ceph-mon[115276]: Cluster is now healthy 2024-03-30T14:11:28.746 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:28 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:28.747 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:28 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:28.747 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:28 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:28.811 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:28 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:28.811 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:28 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:28.811 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:28 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:28.811 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:28 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:28.811 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:28 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:28.811 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:28 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:29.599 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:29 smithi099 ceph-mon[137093]: from='client.25136 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T14:11:29.599 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:29 smithi099 ceph-mon[137093]: pgmap v290: 161 pgs: 161 active+clean; 585 KiB data, 265 MiB used, 715 GiB / 715 GiB avail; 1.0 KiB/s rd, 1 op/s 2024-03-30T14:11:29.600 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:29 smithi099 ceph-mon[143401]: from='client.25136 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T14:11:29.600 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:29 smithi099 ceph-mon[143401]: pgmap v290: 161 pgs: 161 active+clean; 585 KiB data, 265 MiB used, 715 GiB / 715 GiB avail; 1.0 KiB/s rd, 1 op/s 2024-03-30T14:11:29.600 INFO:teuthology.orchestra.run.smithi099.stdout:true 2024-03-30T14:11:29.746 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:29 smithi181 ceph-mon[115276]: from='client.25136 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T14:11:29.747 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:29 smithi181 ceph-mon[115276]: pgmap v290: 161 pgs: 161 active+clean; 585 KiB data, 265 MiB used, 715 GiB / 715 GiB avail; 1.0 KiB/s rd, 1 op/s 2024-03-30T14:11:30.332 INFO:teuthology.orchestra.run.smithi099.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-03-30T14:11:30.332 INFO:teuthology.orchestra.run.smithi099.stdout:agent.smithi099 smithi099 running 2s ago 39m - - 2024-03-30T14:11:30.332 INFO:teuthology.orchestra.run.smithi099.stdout:agent.smithi181 smithi181 running 11s ago 39m - - 2024-03-30T14:11:30.332 INFO:teuthology.orchestra.run.smithi099.stdout:alertmanager.a smithi099 *:9093,9094 running (10m) 2s ago 34m 26.9M - 0.25.0 c8568f914cd2 08735152b67d 2024-03-30T14:11:30.332 INFO:teuthology.orchestra.run.smithi099.stdout:grafana.a smithi181 *:3000 running (9m) 11s ago 33m 78.8M - 9.4.12 2bacad6d85d8 d599aa7730d6 2024-03-30T14:11:30.332 INFO:teuthology.orchestra.run.smithi099.stdout:iscsi.foo.smithi099.qyjuvr smithi099 running (12m) 2s ago 33m 61.9M - 3.5 e1d6a67b021e 2f859af6bc2a 2024-03-30T14:11:30.333 INFO:teuthology.orchestra.run.smithi099.stdout:mgr.x smithi181 *:8443,9283,8765 running (11m) 11s ago 39m 452M - 19.0.0-1967-g4e50bbcd b0c4478f1d83 f269106f7913 2024-03-30T14:11:30.333 INFO:teuthology.orchestra.run.smithi099.stdout:mgr.y smithi099 *:8443,9283,8765 running (22m) 2s ago 40m 534M - 19.0.0-1967-g4e50bbcd b0c4478f1d83 0d464b8c1d18 2024-03-30T14:11:30.333 INFO:teuthology.orchestra.run.smithi099.stdout:mon.a smithi099 running (7m) 2s ago 40m 65.2M 2048M 19.0.0-1967-g4e50bbcd b0c4478f1d83 f19388464dfd 2024-03-30T14:11:30.333 INFO:teuthology.orchestra.run.smithi099.stdout:mon.b smithi181 running (8m) 11s ago 39m 62.7M 2048M 19.0.0-1967-g4e50bbcd b0c4478f1d83 0468ed087cdd 2024-03-30T14:11:30.333 INFO:teuthology.orchestra.run.smithi099.stdout:mon.c smithi099 running (7m) 2s ago 39m 53.6M 2048M 19.0.0-1967-g4e50bbcd b0c4478f1d83 731056a2fea6 2024-03-30T14:11:30.333 INFO:teuthology.orchestra.run.smithi099.stdout:node-exporter.a smithi099 *:9100 running (11m) 2s ago 35m 16.1M - 1.5.0 0da6a335fe13 4a3f1f6e7068 2024-03-30T14:11:30.333 INFO:teuthology.orchestra.run.smithi099.stdout:node-exporter.b smithi181 *:9100 running (11m) 11s ago 34m 16.7M - 1.5.0 0da6a335fe13 acea317b5f5d 2024-03-30T14:11:30.333 INFO:teuthology.orchestra.run.smithi099.stdout:osd.0 smithi099 running (5m) 2s ago 38m 61.1M 4096M 19.0.0-1967-g4e50bbcd b0c4478f1d83 d97d48cb3314 2024-03-30T14:11:30.333 INFO:teuthology.orchestra.run.smithi099.stdout:osd.1 smithi099 running (5m) 2s ago 38m 64.7M 4096M 19.0.0-1967-g4e50bbcd b0c4478f1d83 a843295ce83b 2024-03-30T14:11:30.333 INFO:teuthology.orchestra.run.smithi099.stdout:osd.2 smithi099 running (4m) 2s ago 37m 50.1M 4096M 19.0.0-1967-g4e50bbcd b0c4478f1d83 18304adfb0d0 2024-03-30T14:11:30.333 INFO:teuthology.orchestra.run.smithi099.stdout:osd.3 smithi099 running (3m) 2s ago 37m 52.1M 4096M 19.0.0-1967-g4e50bbcd b0c4478f1d83 9b38d79f070e 2024-03-30T14:11:30.333 INFO:teuthology.orchestra.run.smithi099.stdout:osd.4 smithi181 running (2m) 11s ago 37m 57.5M 4096M 19.0.0-1967-g4e50bbcd b0c4478f1d83 b9078af21e45 2024-03-30T14:11:30.333 INFO:teuthology.orchestra.run.smithi099.stdout:osd.5 smithi181 running (2m) 11s ago 36m 54.0M 4096M 19.0.0-1967-g4e50bbcd b0c4478f1d83 bba176b8db2c 2024-03-30T14:11:30.333 INFO:teuthology.orchestra.run.smithi099.stdout:osd.6 smithi181 running (109s) 11s ago 36m 45.6M 4096M 19.0.0-1967-g4e50bbcd b0c4478f1d83 4a29dfeb4b16 2024-03-30T14:11:30.334 INFO:teuthology.orchestra.run.smithi099.stdout:osd.7 smithi181 running (77s) 11s ago 35m 52.9M 4096M 19.0.0-1967-g4e50bbcd b0c4478f1d83 7940232eb4fe 2024-03-30T14:11:30.334 INFO:teuthology.orchestra.run.smithi099.stdout:prometheus.a smithi181 *:9095 running (10m) 11s ago 35m 70.5M - 2.43.0 a07b618ecd1d 004088bdf70e 2024-03-30T14:11:30.334 INFO:teuthology.orchestra.run.smithi099.stdout:rgw.foo.smithi099.fxjbmp smithi099 *:8000 running (27s) 2s ago 33m 75.2M - 19.0.0-1967-g4e50bbcd b0c4478f1d83 a8e1010fd06c 2024-03-30T14:11:30.334 INFO:teuthology.orchestra.run.smithi099.stdout:rgw.foo.smithi181.wfqwti smithi181 *:8000 running (20s) 11s ago 33m 76.5M - 19.0.0-1967-g4e50bbcd b0c4478f1d83 d341398e6f10 2024-03-30T14:11:30.749 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-03-30T14:11:30.749 INFO:teuthology.orchestra.run.smithi099.stdout: "mon": { 2024-03-30T14:11:30.749 INFO:teuthology.orchestra.run.smithi099.stdout: "ceph version 19.0.0-1967-g4e50bbcd (4e50bbcdd1630c7760b708f3a5b4d38a121e66cb) squid (dev)": 3 2024-03-30T14:11:30.749 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T14:11:30.749 INFO:teuthology.orchestra.run.smithi099.stdout: "mgr": { 2024-03-30T14:11:30.749 INFO:teuthology.orchestra.run.smithi099.stdout: "ceph version 19.0.0-1967-g4e50bbcd (4e50bbcdd1630c7760b708f3a5b4d38a121e66cb) squid (dev)": 2 2024-03-30T14:11:30.749 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T14:11:30.749 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": { 2024-03-30T14:11:30.750 INFO:teuthology.orchestra.run.smithi099.stdout: "ceph version 19.0.0-1967-g4e50bbcd (4e50bbcdd1630c7760b708f3a5b4d38a121e66cb) squid (dev)": 8 2024-03-30T14:11:30.750 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T14:11:30.750 INFO:teuthology.orchestra.run.smithi099.stdout: "rgw": { 2024-03-30T14:11:30.750 INFO:teuthology.orchestra.run.smithi099.stdout: "ceph version 19.0.0-1967-g4e50bbcd (4e50bbcdd1630c7760b708f3a5b4d38a121e66cb) squid (dev)": 2 2024-03-30T14:11:30.750 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T14:11:30.750 INFO:teuthology.orchestra.run.smithi099.stdout: "overall": { 2024-03-30T14:11:30.750 INFO:teuthology.orchestra.run.smithi099.stdout: "ceph version 19.0.0-1967-g4e50bbcd (4e50bbcdd1630c7760b708f3a5b4d38a121e66cb) squid (dev)": 15 2024-03-30T14:11:30.750 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-03-30T14:11:30.750 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-03-30T14:11:30.859 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:30 smithi099 ceph-mon[137093]: from='client.54681 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T14:11:30.859 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:30 smithi099 ceph-mon[137093]: from='client.? 172.21.15.99:0/3873277537' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:30.859 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:30 smithi099 ceph-mon[143401]: from='client.54681 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T14:11:30.859 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:30 smithi099 ceph-mon[143401]: from='client.? 172.21.15.99:0/3873277537' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:31.202 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-03-30T14:11:31.202 INFO:teuthology.orchestra.run.smithi099.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph:4e50bbcdd1630c7760b708f3a5b4d38a121e66cb", 2024-03-30T14:11:31.202 INFO:teuthology.orchestra.run.smithi099.stdout: "in_progress": true, 2024-03-30T14:11:31.202 INFO:teuthology.orchestra.run.smithi099.stdout: "which": "Upgrading daemons in service(s) rgw.foo", 2024-03-30T14:11:31.202 INFO:teuthology.orchestra.run.smithi099.stdout: "services_complete": [], 2024-03-30T14:11:31.203 INFO:teuthology.orchestra.run.smithi099.stdout: "progress": "1/2 daemons upgraded", 2024-03-30T14:11:31.203 INFO:teuthology.orchestra.run.smithi099.stdout: "message": "Currently upgrading rgw daemons", 2024-03-30T14:11:31.203 INFO:teuthology.orchestra.run.smithi099.stdout: "is_paused": false 2024-03-30T14:11:31.203 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-03-30T14:11:31.246 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:30 smithi181 ceph-mon[115276]: from='client.54681 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T14:11:31.247 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:30 smithi181 ceph-mon[115276]: from='client.? 172.21.15.99:0/3873277537' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:32.078 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:31 smithi099 ceph-mon[143401]: from='client.54687 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T14:11:32.078 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:31 smithi099 ceph-mon[143401]: pgmap v291: 161 pgs: 161 active+clean; 585 KiB data, 265 MiB used, 715 GiB / 715 GiB avail; 1.0 KiB/s rd, 1 op/s 2024-03-30T14:11:32.078 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:31 smithi099 ceph-mon[143401]: from='client.54693 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T14:11:32.078 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:31 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:32.079 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:31 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:32.079 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:31 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:32.079 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:31 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:32.079 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:31 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:32.079 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:31 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:32.079 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:31 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:32.079 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:31 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:32.079 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:31 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:32.079 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:31 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:32.079 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:31 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:32.079 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:31 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:32.079 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:31 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:32.079 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:31 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:32.080 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:31 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:32.080 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:31 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:32.080 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:31 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:32.080 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:31 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:32.080 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:31 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:32.080 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:31 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:32.080 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:31 smithi099 ceph-mon[137093]: from='client.54687 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T14:11:32.080 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:31 smithi099 ceph-mon[137093]: pgmap v291: 161 pgs: 161 active+clean; 585 KiB data, 265 MiB used, 715 GiB / 715 GiB avail; 1.0 KiB/s rd, 1 op/s 2024-03-30T14:11:32.080 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:31 smithi099 ceph-mon[137093]: from='client.54693 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T14:11:32.080 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:31 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:32.081 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:31 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:32.081 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:31 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:32.081 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:31 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:32.081 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:31 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:32.081 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:31 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:32.081 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:31 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:32.081 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:31 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:32.081 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:31 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:32.081 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:31 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:32.081 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:31 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:32.081 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:31 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:32.081 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:31 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:32.081 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:31 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:32.081 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:31 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:32.082 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:31 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:32.082 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:31 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:32.082 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:31 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:32.082 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:31 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:32.082 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:31 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:32.246 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:31 smithi181 ceph-mon[115276]: from='client.54687 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T14:11:32.247 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:31 smithi181 ceph-mon[115276]: pgmap v291: 161 pgs: 161 active+clean; 585 KiB data, 265 MiB used, 715 GiB / 715 GiB avail; 1.0 KiB/s rd, 1 op/s 2024-03-30T14:11:32.247 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:31 smithi181 ceph-mon[115276]: from='client.54693 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T14:11:32.247 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:31 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:32.247 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:31 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:32.247 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:31 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:32.247 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:31 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:32.247 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:31 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:32.247 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:31 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:32.247 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:31 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:32.247 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:31 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:32.247 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:31 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:32.248 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:31 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:32.248 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:31 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:32.248 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:31 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:32.248 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:31 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:32.248 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:31 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:32.248 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:31 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:32.248 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:31 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:32.248 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:31 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:32.248 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:31 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:32.248 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:31 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:32.248 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:31 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:32.950 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:32 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:32.950 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:32 smithi099 ceph-mon[137093]: Checking dashboard <-> RGW credentials 2024-03-30T14:11:32.950 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:32 smithi099 ceph-mon[137093]: from='client.54723 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T14:11:32.951 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:32 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:32.951 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:32 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:32.951 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:32 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:32.951 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:32 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:32.951 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:32 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:32.951 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:32 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:32.951 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:32 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:32.951 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:32 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:32.951 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:32 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:32.951 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:32 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:32.951 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:32 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:32.951 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:32 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:32.951 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:32 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:32.951 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:32 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:32.951 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:32 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:32.951 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:32 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:32.952 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:32 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:32.952 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:32 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:32.952 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:32 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:32.952 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:32 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:32.952 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:32 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:32.952 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:32 smithi099 ceph-mon[137093]: pgmap v292: 161 pgs: 161 active+clean; 585 KiB data, 265 MiB used, 715 GiB / 715 GiB avail; 13 KiB/s rd, 0 B/s wr, 19 op/s 2024-03-30T14:11:32.952 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:32 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:32.952 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:32 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:32.952 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:32 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:32.952 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:32 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:32.952 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:32 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:32.953 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:32 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:32.953 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:32 smithi099 ceph-mon[143401]: Checking dashboard <-> RGW credentials 2024-03-30T14:11:32.953 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:32 smithi099 ceph-mon[143401]: from='client.54723 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T14:11:32.953 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:32 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:32.953 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:32 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:32.953 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:32 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:32.953 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:32 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:32.953 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:32 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:32.953 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:32 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:32.953 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:32 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:32.953 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:32 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:32.953 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:32 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:32.954 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:32 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:32.954 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:32 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:32.954 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:32 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:32.954 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:32 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:32.954 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:32 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:32.954 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:32 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:32.954 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:32 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:32.954 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:32 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:32.954 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:32 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:32.954 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:32 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:32.954 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:32 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:32.954 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:32 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:32.954 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:32 smithi099 ceph-mon[143401]: pgmap v292: 161 pgs: 161 active+clean; 585 KiB data, 265 MiB used, 715 GiB / 715 GiB avail; 13 KiB/s rd, 0 B/s wr, 19 op/s 2024-03-30T14:11:32.954 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:32 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:32.955 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:32 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:32.955 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:32 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:32.955 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:32 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:32.955 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:32 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:32.955 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:32 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:32.955 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:32 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:32.955 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:32 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:32.955 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:32 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:32.955 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:32 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:32.955 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:32 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:32.955 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:32 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:32.955 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:32 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:32.955 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:32 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:32.955 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:32 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:32.955 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:32 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:32.956 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:32 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:32.956 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:32 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:32.956 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:32 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:32.956 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:32 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:32.956 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:32 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:32.956 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:32 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:32.956 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:32 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:32.956 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:32 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:32.956 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:32 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:32.956 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:32 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:32.956 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:32 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:32.956 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:32 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:32.956 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:32 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:32.956 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:32 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:32.957 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:32 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:32.957 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:32 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:32.957 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:32 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:32.957 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:32 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:32.957 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:32 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:32.957 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:32 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:32.957 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:32 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:32.957 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:32 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:32.957 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:32 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:32.957 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:32 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:32.957 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:32 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:32.957 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:32 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:32.957 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:32 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:32.958 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:32 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:32.958 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:32 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:32.958 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:32 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:32.958 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:32 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:32.958 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:32 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:32.958 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:32 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:32.958 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:32 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:32.958 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:32 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:32.958 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:32 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:32.958 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:32 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:32.958 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:32 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:32.958 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:32 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:32.997 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:32 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:32.997 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:32 smithi181 ceph-mon[115276]: Checking dashboard <-> RGW credentials 2024-03-30T14:11:32.997 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:32 smithi181 ceph-mon[115276]: from='client.54723 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T14:11:32.998 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:32 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:32.998 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:32 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:32.998 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:32 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:32.998 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:32 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:32.998 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:32 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:32.998 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:32 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:32.998 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:32 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:32.998 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:32 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:32.998 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:32 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:32.998 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:32 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:32.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:32 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:32.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:32 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:32.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:32 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:32.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:32 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:32.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:32 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:32.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:32 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:32.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:32 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:32.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:32 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:32.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:32 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:32.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:32 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:32.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:32 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:32.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:32 smithi181 ceph-mon[115276]: pgmap v292: 161 pgs: 161 active+clean; 585 KiB data, 265 MiB used, 715 GiB / 715 GiB avail; 13 KiB/s rd, 0 B/s wr, 19 op/s 2024-03-30T14:11:32.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:32 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:32.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:32 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:33.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:32 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:33.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:32 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:33.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:32 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:33.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:32 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:33.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:32 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:33.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:32 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:33.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:32 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:33.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:32 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:33.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:32 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:33.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:32 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:33.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:32 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:33.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:32 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:33.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:32 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:33.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:32 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:33.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:32 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:33.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:32 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:33.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:32 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:33.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:32 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:33.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:32 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:33.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:32 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:33.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:32 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:33.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:32 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:33.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:32 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:33.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:32 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:33.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:32 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:33.002 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:32 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:33.002 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:32 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:33.002 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:32 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:34.078 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:33 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:34.078 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:33 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:34.078 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:33 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:34.078 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:33 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:34.079 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:33 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:34.079 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:33 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:34.079 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:33 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:34.079 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:33 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:34.079 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:33 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:34.079 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:33 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:34.080 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:33 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:34.080 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:33 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:34.080 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:33 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:34.080 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:33 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:34.080 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:33 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:34.080 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:33 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:34.081 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:33 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:34.081 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:33 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:34.081 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:33 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:34.081 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:33 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:34.081 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:33 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:34.081 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:33 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:34.082 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:33 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:34.082 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:33 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:34.082 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:33 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:34.082 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:33 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:34.082 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:33 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:34.083 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:33 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:34.083 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:33 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:34.083 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:33 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:34.084 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:33 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:34.084 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:33 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:34.084 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:33 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:34.084 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:33 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:34.084 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:33 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:34.084 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:33 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:34.085 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:33 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:34.085 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:33 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:34.085 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:33 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:34.085 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:33 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:34.085 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:33 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:34.085 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:33 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:34.086 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:33 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:34.086 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:33 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:34.086 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:33 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:34.086 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:33 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:34.087 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:33 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:34.087 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:33 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:34.087 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:33 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:34.087 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:33 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:34.087 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:33 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:34.087 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:33 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:34.087 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:33 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:34.088 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:33 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:34.088 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:33 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:34.088 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:33 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:34.088 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:33 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:34.088 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:33 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:34.088 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:33 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:34.088 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:33 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:34.089 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:33 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:34.089 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:33 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:34.089 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:33 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:34.089 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:33 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:34.090 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:33 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:34.090 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:33 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:34.090 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:33 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:34.091 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:33 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:34.091 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:33 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:34.091 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:33 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:34.091 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:33 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:34.091 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:33 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:34.091 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:33 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:34.091 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:33 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:34.092 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:33 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:34.092 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:33 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:34.092 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:33 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:34.092 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:33 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:34.092 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:33 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:34.093 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:33 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:34.093 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:33 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:34.093 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:33 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:34.093 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:33 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:34.093 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:33 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:34.094 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:33 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:34.094 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:33 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:34.094 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:33 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:34.094 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:33 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:34.095 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:33 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:34.095 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:33 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:34.095 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:33 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:34.095 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:33 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:34.095 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:33 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:34.095 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:33 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:34.095 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:33 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:34.095 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:33 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:34.247 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:33 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:34.247 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:33 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:34.247 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:33 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:34.247 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:33 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:34.247 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:33 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:34.247 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:33 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:34.247 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:33 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:34.248 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:33 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:34.248 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:33 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:34.248 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:33 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:34.248 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:33 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:34.248 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:33 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:34.248 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:33 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:34.248 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:33 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:34.248 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:33 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:34.248 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:33 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:34.248 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:33 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:34.248 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:33 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:34.248 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:33 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:34.248 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:33 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:34.248 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:33 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:34.249 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:33 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:34.249 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:33 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:34.249 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:33 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:34.249 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:33 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:34.249 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:33 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:34.249 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:33 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:34.249 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:33 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:34.249 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:33 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:34.249 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:33 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:34.249 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:33 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:34.249 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:33 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:34.249 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:33 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:34.249 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:33 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:34.249 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:33 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:34.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:33 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:34.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:33 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:34.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:33 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:34.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:33 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:34.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:33 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:34.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:33 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:34.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:33 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:34.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:33 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:34.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:33 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:34.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:33 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:34.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:33 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:34.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:33 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:34.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:33 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:35.077 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 14:11:34 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[71049]: ::ffff:172.21.15.181 - - [30/Mar/2024:14:11:34] "GET /metrics HTTP/1.1" 200 38391 "" "Prometheus/2.43.0" 2024-03-30T14:11:35.078 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:34 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:35.078 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:34 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:35.078 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:34 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:35.078 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:34 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:35.078 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:34 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:35.078 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:34 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:35.078 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:34 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:35.079 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:34 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:35.079 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:34 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:35.079 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:34 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:35.079 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:34 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:35.079 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:34 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:35.079 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:34 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:35.079 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:34 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:35.079 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:34 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:35.079 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:34 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:35.079 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:34 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:35.079 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:34 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:35.079 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:34 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:35.079 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:34 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:35.079 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:34 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:35.080 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:34 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:35.080 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:34 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:35.080 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:34 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:35.080 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:34 smithi099 ceph-mon[143401]: pgmap v293: 161 pgs: 161 active+clean; 585 KiB data, 265 MiB used, 715 GiB / 715 GiB avail; 30 KiB/s rd, 0 B/s wr, 45 op/s 2024-03-30T14:11:35.080 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:34 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:35.080 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:34 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:35.080 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:34 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:35.080 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:34 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:35.080 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:34 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:35.080 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:34 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:35.080 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:34 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:35.080 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:34 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:35.081 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:34 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:35.081 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:34 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:35.081 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:34 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:35.081 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:34 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:35.081 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:34 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:35.081 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:34 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:35.081 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:34 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:35.081 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:34 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:35.081 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:34 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:35.081 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:34 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:35.081 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:34 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:35.081 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:34 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:35.081 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:34 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:35.081 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:34 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:35.081 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:34 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:35.082 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:34 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:35.082 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:34 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:35.082 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:34 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:35.082 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:34 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:35.082 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:34 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:35.082 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:34 smithi099 ceph-mon[137093]: pgmap v293: 161 pgs: 161 active+clean; 585 KiB data, 265 MiB used, 715 GiB / 715 GiB avail; 30 KiB/s rd, 0 B/s wr, 45 op/s 2024-03-30T14:11:35.082 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:34 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:35.082 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:34 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:35.082 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:34 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:35.082 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:34 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:35.083 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:34 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:35.083 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:34 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:35.083 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:34 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:35.083 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:34 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:35.083 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:34 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:35.083 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:34 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:35.083 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:34 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:35.083 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:34 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:35.083 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:34 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:35.083 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:34 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:35.083 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:34 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:35.083 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:34 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:35.083 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:34 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:35.083 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:34 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:35.084 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:34 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:35.084 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:34 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:35.084 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:34 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:35.084 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:34 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:35.084 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:34 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:35.084 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:34 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:35.084 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:34 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:35.084 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:34 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:35.084 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:34 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:35.084 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:34 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:35.084 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:34 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:35.084 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:34 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:35.084 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:34 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:35.084 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:34 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:35.084 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:34 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:35.084 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:34 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:35.085 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:34 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:35.085 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:34 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:35.085 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:34 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:35.085 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:34 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:35.085 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:34 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:35.085 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:34 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:35.085 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:34 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:35.085 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:34 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:35.085 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:34 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:35.085 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:34 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:35.085 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:34 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:35.086 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:34 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:35.086 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:34 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:35.086 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:34 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:35.086 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:34 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:35.086 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:34 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:35.086 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:34 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:35.086 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:34 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:35.086 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:34 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:35.086 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:34 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:35.086 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:34 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:35.086 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:34 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:35.086 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:34 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:35.086 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:34 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:35.086 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:34 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:35.087 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:34 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:35.087 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:34 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:35.087 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:34 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:35.087 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:34 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:35.087 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:34 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:35.087 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:34 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:35.087 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:34 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:35.087 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:34 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:35.087 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:34 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:35.087 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:34 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:35.087 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:34 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:35.088 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:34 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:35.088 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:34 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:35.088 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:34 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:35.088 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:34 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:35.088 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:34 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:35.088 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:34 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:35.088 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:34 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:35.088 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:34 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:35.088 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:34 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:35.088 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:34 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:35.088 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:34 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:35.088 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:34 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:35.088 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:34 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:35.089 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:34 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:35.089 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:34 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:35.089 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:34 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:35.089 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:34 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:35.089 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:34 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:35.089 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:34 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:35.089 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:34 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:35.247 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:34 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:35.247 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:34 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:35.247 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:34 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:35.248 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:34 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:35.248 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:34 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:35.248 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:34 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:35.248 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:34 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:35.248 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:34 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:35.248 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:34 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:35.248 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:34 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:35.248 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:34 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:35.248 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:34 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:35.248 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:34 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:35.248 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:34 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:35.248 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:34 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:35.248 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:34 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:35.249 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:34 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:35.249 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:34 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:35.249 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:34 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:35.249 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:34 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:35.249 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:34 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:35.249 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:34 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:35.249 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:34 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:35.249 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:34 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:35.249 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:34 smithi181 ceph-mon[115276]: pgmap v293: 161 pgs: 161 active+clean; 585 KiB data, 265 MiB used, 715 GiB / 715 GiB avail; 30 KiB/s rd, 0 B/s wr, 45 op/s 2024-03-30T14:11:35.249 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:34 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:35.249 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:34 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:35.249 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:34 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:35.249 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:34 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:35.249 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:34 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:35.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:34 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:35.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:34 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:35.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:34 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:35.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:34 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:35.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:34 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:35.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:34 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:35.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:34 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:35.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:34 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:35.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:34 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:35.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:34 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:35.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:34 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:35.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:34 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:35.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:34 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:35.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:34 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:35.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:34 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:35.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:34 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:35.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:34 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:35.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:34 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:35.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:34 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:35.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:34 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:35.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:34 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:35.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:34 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:35.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:34 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:35.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:34 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:35.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:34 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:35.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:34 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:35.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:34 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:35.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:34 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:35.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:34 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:35.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:34 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:35.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:34 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:35.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:34 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:35.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:34 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:35.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:34 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:35.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:34 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:35.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:34 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:35.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:34 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:35.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:34 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:35.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:34 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:35.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:34 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:35.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:34 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:35.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:34 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:36.078 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:35 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:36.078 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:35 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:36.078 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:35 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:36.078 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:35 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:36.078 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:35 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:36.078 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:35 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:36.078 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:35 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:36.079 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:35 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:36.079 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:35 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:36.079 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:35 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:36.079 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:35 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:36.079 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:35 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:36.079 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:35 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:36.079 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:35 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:36.079 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:35 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:36.079 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:35 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:36.079 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:35 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:36.079 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:35 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:36.079 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:35 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:36.079 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:35 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:36.080 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:35 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:36.080 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:35 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:36.080 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:35 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:36.080 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:35 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:36.080 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:35 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:36.080 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:35 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:36.080 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:35 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:36.080 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:35 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:36.080 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:35 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:36.080 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:35 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:36.080 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:35 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:36.080 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:35 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:36.080 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:35 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:36.080 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:35 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:36.081 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:35 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:36.081 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:35 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:36.081 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:35 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:36.081 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:35 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:36.081 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:35 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:36.081 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:35 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:36.081 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:35 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:36.081 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:35 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:36.081 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:35 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:36.081 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:35 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:36.081 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:35 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:36.081 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:35 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:36.081 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:35 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:36.082 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:35 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:36.082 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:35 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:36.082 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:35 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:36.082 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:35 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:36.082 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:35 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:36.082 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:35 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:36.082 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:35 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:36.082 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:35 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:36.083 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:35 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:36.083 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:35 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:36.083 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:35 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:36.083 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:35 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:36.083 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:35 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:36.083 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:35 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:36.083 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:35 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:36.083 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:35 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:36.083 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:35 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:36.083 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:35 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:36.083 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:35 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:36.083 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:35 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:36.083 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:35 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:36.084 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:35 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:36.084 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:35 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:36.084 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:35 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:36.084 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:35 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:36.084 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:35 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:36.084 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:35 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:36.084 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:35 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:36.084 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:35 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:36.084 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:35 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:36.084 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:35 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:36.084 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:35 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:36.084 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:35 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:36.084 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:35 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:36.084 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:35 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:36.085 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:35 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:36.085 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:35 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:36.085 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:35 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:36.085 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:35 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:36.085 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:35 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:36.085 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:35 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:36.085 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:35 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:36.085 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:35 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:36.085 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:35 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:36.085 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:35 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:36.085 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:35 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:36.085 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:35 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:36.085 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:35 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:36.085 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:35 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:36.086 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:35 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:36.086 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:35 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:36.086 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:35 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:36.086 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:35 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:36.086 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:35 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:36.086 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:35 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:36.086 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:35 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:36.086 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:35 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:36.086 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:35 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:36.086 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:35 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:36.086 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:35 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:36.086 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:35 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:36.086 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:35 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:36.086 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:35 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:36.247 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:35 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:36.247 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:35 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:36.247 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:35 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:36.247 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:35 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:36.247 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:35 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:36.247 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:35 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:36.248 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:35 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:36.248 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:35 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:36.248 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:35 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:36.248 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:35 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:36.248 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:35 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:36.248 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:35 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:36.248 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:35 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:36.248 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:35 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:36.248 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:35 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:36.248 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:35 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:36.248 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:35 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:36.248 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:35 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:36.249 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:35 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:36.249 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:35 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:36.249 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:35 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:36.249 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:35 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:36.249 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:35 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:36.249 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:35 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:36.249 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:35 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:36.249 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:35 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:36.249 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:35 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:36.249 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:35 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:36.249 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:35 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:36.249 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:35 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:36.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:35 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:36.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:35 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:36.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:35 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:36.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:35 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:36.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:35 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:36.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:35 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:36.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:35 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:36.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:35 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:36.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:35 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:36.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:35 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:36.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:35 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:36.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:35 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:36.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:35 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:36.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:35 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:36.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:35 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:36.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:35 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:36.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:35 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:36.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:35 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:36.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:35 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:36.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:35 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:36.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:35 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:36.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:35 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:36.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:35 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:36.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:35 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:36.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:35 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:37.078 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:36 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:37.078 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:36 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:37.078 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:36 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:37.079 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:36 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:37.079 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:36 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:37.079 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:36 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:37.079 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:36 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:37.079 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:36 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:37.079 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:36 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:37.079 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:36 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:37.079 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:36 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:37.079 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:36 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:37.080 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:36 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:37.080 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:36 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:37.080 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:36 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:37.080 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:36 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:37.080 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:36 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:37.080 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:36 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:37.080 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:36 smithi099 ceph-mon[143401]: pgmap v294: 161 pgs: 161 active+clean; 585 KiB data, 265 MiB used, 715 GiB / 715 GiB avail; 64 KiB/s rd, 95 B/s wr, 96 op/s 2024-03-30T14:11:37.080 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:36 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:37.080 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:36 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:37.080 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:36 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:37.080 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:36 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:37.080 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:36 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:37.080 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:36 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:37.081 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:36 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:37.081 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:36 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:37.081 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:36 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:37.081 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:36 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:37.081 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:36 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:37.081 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:36 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:37.081 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:36 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:37.081 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:36 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:37.081 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:36 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:37.081 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:36 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:37.082 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:36 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:37.082 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:36 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:37.082 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:36 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:37.082 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:36 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:37.082 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:36 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:37.082 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:36 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:37.082 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:36 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:37.082 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:36 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:37.082 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:36 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:37.082 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:36 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:37.082 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:36 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:37.082 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:36 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:37.083 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:36 smithi099 ceph-mon[137093]: pgmap v294: 161 pgs: 161 active+clean; 585 KiB data, 265 MiB used, 715 GiB / 715 GiB avail; 64 KiB/s rd, 95 B/s wr, 96 op/s 2024-03-30T14:11:37.083 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:36 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:37.083 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:36 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:37.083 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:36 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:37.083 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:36 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:37.083 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:36 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:37.083 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:36 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:37.083 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:36 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:37.083 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:36 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:37.083 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:36 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:37.083 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:36 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:37.084 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:36 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:37.084 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:36 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:37.084 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:36 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:37.084 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:36 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:37.084 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:36 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:37.084 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:36 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:37.084 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:36 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:37.084 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:36 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:37.084 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:36 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:37.084 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:36 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:37.084 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:36 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:37.085 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:36 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:37.085 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:36 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:37.085 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:36 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:37.085 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:36 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:37.085 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:36 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:37.085 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:36 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:37.085 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:36 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:37.086 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:36 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:37.086 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:36 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:37.086 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:36 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:37.086 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:36 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:37.086 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:36 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:37.086 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:36 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:37.086 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:36 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:37.086 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:36 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:37.086 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:36 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:37.086 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:36 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:37.086 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:36 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:37.086 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:36 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:37.087 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:36 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:37.087 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:36 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:37.087 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:36 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:37.087 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:36 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:37.087 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:36 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:37.087 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:36 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:37.087 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:36 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:37.087 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:36 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:37.087 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:36 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T14:11:37.088 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:36 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:37.088 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:36 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:37.088 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:36 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:37.088 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:36 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:37.088 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:36 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:37.088 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:36 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:37.088 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:36 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:37.088 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:36 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:37.088 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:36 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:37.088 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:36 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:37.088 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:36 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:37.089 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:36 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:37.089 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:36 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:37.089 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:36 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:37.089 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:36 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:37.089 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:36 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:37.089 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:36 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:37.089 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:36 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:37.089 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:36 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:37.089 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:36 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:37.089 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:36 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:37.090 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:36 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:37.090 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:36 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:37.090 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:36 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:37.090 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:36 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:37.090 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:36 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:37.090 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:36 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:37.090 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:36 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:37.090 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:36 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:37.090 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:36 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:37.090 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:36 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:37.090 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:36 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:37.090 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:36 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:37.090 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:36 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:37.091 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:36 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:37.091 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:36 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:37.091 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:36 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:37.091 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:36 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:37.091 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:36 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T14:11:37.247 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:36 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:37.247 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:36 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:37.247 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:36 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:37.248 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:36 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:37.248 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:36 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:37.248 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:36 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:37.248 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:36 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:37.248 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:36 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:37.248 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:36 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:37.248 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:36 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:37.248 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:36 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:37.248 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:36 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:37.248 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:36 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:37.248 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:36 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:37.248 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:36 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:37.248 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:36 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:37.248 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:36 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:37.249 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:36 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:37.249 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:36 smithi181 ceph-mon[115276]: pgmap v294: 161 pgs: 161 active+clean; 585 KiB data, 265 MiB used, 715 GiB / 715 GiB avail; 64 KiB/s rd, 95 B/s wr, 96 op/s 2024-03-30T14:11:37.249 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:36 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:37.249 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:36 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:37.249 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:36 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:37.249 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:36 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:37.249 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:36 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:37.249 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:36 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:37.249 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:36 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:37.249 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:36 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:37.249 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:36 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:37.249 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:36 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:37.249 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:36 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:37.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:36 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:37.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:36 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:37.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:36 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:37.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:36 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:37.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:36 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:37.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:36 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:37.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:36 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:37.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:36 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:37.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:36 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:37.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:36 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:37.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:36 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:37.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:36 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:37.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:36 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:37.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:36 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:37.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:36 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:37.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:36 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:37.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:36 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:37.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:36 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:37.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:36 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:37.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:36 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:37.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:36 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:37.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:36 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:37.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:36 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:37.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:36 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:37.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:36 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:37.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:36 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:37.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:36 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:37.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:36 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:37.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:36 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:37.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:36 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:37.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:36 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:37.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:36 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:37.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:36 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:37.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:36 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:37.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:36 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:37.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:36 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:37.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:36 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:37.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:36 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T14:11:37.828 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:37 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:37.828 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:37 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:37.828 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:37 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:37.828 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:37 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:37.828 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:37 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:37.828 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:37 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:37.828 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:37 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:37.828 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:37 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:37.828 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:37 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:37.828 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:37 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:37.829 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:37 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:37.829 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:37 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:37.829 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:37 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:37.829 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:37 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:37.829 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:37 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:37.829 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:37 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:37.829 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:37 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:37.829 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:37 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:37.829 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:37 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:37.829 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:37 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:37.829 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:37 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:37.829 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:37 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:37.829 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:37 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:37.829 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:37 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:37.829 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:37 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:37.829 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:37 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:37.830 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:37 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:37.830 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:37 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:37.830 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:37 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:37.830 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:37 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:37.830 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:37 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:37.830 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:37 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:37.830 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:37 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:37.830 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:37 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:37.830 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:37 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:37.830 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:37 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:37.831 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:37 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:37.831 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:37 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:37.831 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:37 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:37.831 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:37 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:37.831 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:37 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:37.831 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:37 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:37.831 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:37 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:37.831 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:37 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:37.831 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:37 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:37.831 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:37 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:37.831 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:37 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:37.831 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:37 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:37.831 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:37 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:37.831 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:37 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:37.831 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:37 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:37.831 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:37 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:37.831 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:37 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:37.832 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:37 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:37.832 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:37 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:37.832 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:37 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:37.832 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:37 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:37.832 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:37 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:37.832 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:37 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:37.832 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:37 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:37.832 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:37 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:37.832 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:37 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:37.832 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:37 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:37.832 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:37 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:37.832 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:37 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:37.833 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:37 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:37.833 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:37 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:37.833 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:37 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:37.833 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:37 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:37.833 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:37 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:37.833 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:37 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:37.833 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:37 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:37.833 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:37 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:37.833 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:37 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:37.833 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:37 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:37.833 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:37 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:37.833 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:37 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:37.833 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:37 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:37.833 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:37 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:37.833 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:37 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:37.834 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:37 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:37.834 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:37 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:37.834 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:37 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:37.834 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:37 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:37.834 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:37 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:37.834 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:37 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:37.834 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:37 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:37.834 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:37 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:37.834 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:37 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:37.834 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:37 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:37.834 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:37 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:37.834 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:37 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:37.835 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:37 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:37.835 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:37 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:37.835 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:37 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:37.835 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:37 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:37.835 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:37 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:37.835 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:37 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:37.835 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:37 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:37.835 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:37 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:37.835 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:37 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:37.835 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:37 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:37.836 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:37 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:37.836 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:37 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:37.836 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:37 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:37.836 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:37 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:37.836 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:37 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:37.836 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:37 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:38.247 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:37 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:38.247 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:37 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:38.247 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:37 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:38.247 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:37 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:38.247 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:37 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:38.247 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:37 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:38.247 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:37 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:38.247 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:37 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:38.248 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:37 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:38.248 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:37 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:38.248 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:37 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:38.248 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:37 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:38.248 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:37 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:38.248 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:37 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:38.248 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:37 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:38.248 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:37 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:38.248 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:37 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:38.248 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:37 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:38.248 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:37 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:38.248 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:37 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:38.248 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:37 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:38.248 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:37 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:38.248 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:37 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:38.249 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:37 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:38.249 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:37 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:38.249 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:37 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:38.249 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:37 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:38.249 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:37 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:38.249 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:37 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:38.249 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:37 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:38.249 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:37 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:38.249 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:37 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:38.249 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:37 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:38.249 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:37 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:38.249 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:37 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:38.249 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:37 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:38.249 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:37 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:38.249 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:37 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:38.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:37 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:38.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:37 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:38.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:37 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:38.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:37 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:38.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:37 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:38.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:37 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:38.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:37 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:38.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:37 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:38.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:37 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:38.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:37 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:38.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:37 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:38.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:37 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:38.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:37 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:38.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:37 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:38.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:37 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:38.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:37 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:39.079 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:38 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:39.079 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:38 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:39.079 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:38 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:39.079 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:38 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:39.079 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:38 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:39.079 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:38 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:39.079 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:38 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:39.079 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:38 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:39.080 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:38 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:39.080 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:38 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:39.080 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:38 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:39.080 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:38 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:39.080 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:38 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:39.080 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:38 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:39.080 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:38 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:39.080 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:38 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:39.080 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:38 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:39.080 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:38 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:39.081 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:38 smithi099 ceph-mon[143401]: from='client.25136 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T14:11:39.081 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:38 smithi099 ceph-mon[143401]: pgmap v295: 161 pgs: 161 active+clean; 585 KiB data, 265 MiB used, 715 GiB / 715 GiB avail; 57 KiB/s rd, 85 B/s wr, 86 op/s 2024-03-30T14:11:39.081 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:38 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:39.081 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:38 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:39.081 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:38 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:39.081 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:38 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:39.081 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:38 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:39.081 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:38 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:39.081 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:38 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:39.081 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:38 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:39.081 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:38 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:39.082 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:38 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:39.082 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:38 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:39.082 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:38 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:39.082 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:38 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:39.082 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:38 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:39.082 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:38 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:39.082 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:38 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:39.082 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:38 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:39.082 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:38 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:39.082 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:38 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:39.082 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:38 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:39.082 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:38 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:39.082 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:38 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:39.082 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:38 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:39.083 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:38 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:39.083 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:38 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:39.083 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:38 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:39.083 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:38 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:39.083 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:38 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:39.083 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:38 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:39.083 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:38 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:39.083 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:38 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:39.083 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:38 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:39.084 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:38 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:39.084 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:38 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:39.084 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:38 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:39.084 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:38 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:39.084 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:38 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:39.084 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:38 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:39.084 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:38 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:39.084 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:38 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:39.084 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:38 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:39.084 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:38 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:39.084 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:38 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:39.084 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:38 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:39.084 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:38 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:39.084 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:38 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:39.085 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:38 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:39.085 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:38 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:39.085 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:38 smithi099 ceph-mon[137093]: from='client.25136 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T14:11:39.085 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:38 smithi099 ceph-mon[137093]: pgmap v295: 161 pgs: 161 active+clean; 585 KiB data, 265 MiB used, 715 GiB / 715 GiB avail; 57 KiB/s rd, 85 B/s wr, 86 op/s 2024-03-30T14:11:39.085 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:38 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:39.085 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:38 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:39.085 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:38 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:39.085 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:38 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:39.085 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:38 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:39.085 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:38 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:39.085 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:38 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:39.085 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:38 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:39.085 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:38 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:39.085 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:38 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:39.086 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:38 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:39.086 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:38 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:39.086 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:38 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:39.086 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:38 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:39.086 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:38 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:39.086 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:38 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:39.086 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:38 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:39.086 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:38 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:39.086 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:38 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:39.086 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:38 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:39.086 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:38 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:39.086 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:38 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:39.086 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:38 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:39.087 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:38 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:39.087 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:38 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:39.087 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:38 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:39.087 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:38 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:39.087 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:38 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:39.087 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:38 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:39.087 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:38 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:39.247 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:38 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:39.247 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:38 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:39.247 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:38 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:39.247 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:38 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:39.247 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:38 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:39.247 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:38 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:39.247 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:38 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:39.248 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:38 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:39.248 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:38 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:39.248 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:38 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:39.248 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:38 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:39.248 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:38 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:39.248 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:38 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:39.248 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:38 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:39.248 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:38 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:39.248 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:38 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:39.248 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:38 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:39.248 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:38 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:39.248 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:38 smithi181 ceph-mon[115276]: from='client.25136 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T14:11:39.248 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:38 smithi181 ceph-mon[115276]: pgmap v295: 161 pgs: 161 active+clean; 585 KiB data, 265 MiB used, 715 GiB / 715 GiB avail; 57 KiB/s rd, 85 B/s wr, 86 op/s 2024-03-30T14:11:39.248 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:38 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:39.248 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:38 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:39.249 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:38 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:39.249 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:38 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:39.249 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:38 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:39.249 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:38 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:39.249 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:38 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:39.249 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:38 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:39.249 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:38 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:39.249 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:38 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:39.249 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:38 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:39.249 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:38 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:39.249 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:38 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:39.249 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:38 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:39.249 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:38 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:39.249 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:38 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:39.249 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:38 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:39.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:38 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:39.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:38 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:39.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:38 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:39.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:38 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:39.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:38 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:39.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:38 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:39.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:38 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:39.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:38 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:39.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:38 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:39.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:38 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:39.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:38 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:39.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:38 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:39.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:38 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:40.033 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:39 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:40.033 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:39 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:40.033 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:39 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:40.033 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:39 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:40.033 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:39 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:40.033 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:39 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:40.033 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:39 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:40.033 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:39 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:40.033 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:39 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:40.033 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:39 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:40.033 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:39 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:40.033 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:39 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:40.033 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:39 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:40.034 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:39 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:40.034 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:39 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:40.034 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:39 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:40.034 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:39 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:40.034 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:39 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:40.034 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:39 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:40.034 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:39 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:40.034 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:39 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:40.034 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:39 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:40.034 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:39 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:40.034 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:39 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:40.034 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:39 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:40.034 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:39 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:40.035 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:39 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:40.035 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:39 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:40.035 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:39 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:40.035 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:39 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:40.035 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:39 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:40.035 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:39 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:40.035 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:39 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:40.035 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:39 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:40.036 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:39 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:40.036 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:39 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:40.036 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:39 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:40.036 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:39 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:40.036 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:39 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:40.036 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:39 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:40.036 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:39 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:40.036 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:39 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:40.036 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:39 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:40.036 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:39 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:40.036 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:39 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:40.036 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:39 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:40.036 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:39 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:40.036 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:39 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:40.037 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:39 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:40.037 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:39 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:40.037 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:39 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:40.037 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:39 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:40.037 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:39 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:40.037 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:39 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:40.037 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:39 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:40.037 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:39 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:40.037 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:39 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:40.037 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:39 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:40.037 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:39 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:40.037 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:39 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:40.038 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:39 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:40.038 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:39 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:40.038 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:39 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:40.038 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:39 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:40.038 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:39 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:40.038 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:39 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:40.038 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:39 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:40.038 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:39 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:40.038 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:39 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:40.038 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:39 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:40.038 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:39 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:40.038 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:39 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:40.038 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:39 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:40.038 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:39 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:40.039 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:39 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:40.039 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:39 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:40.039 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:39 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:40.039 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:39 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:40.039 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:39 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:40.039 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:39 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:40.039 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:39 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:40.039 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:39 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:40.039 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:39 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:40.039 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:39 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:40.039 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:39 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:40.039 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:39 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:40.040 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:39 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:40.040 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:39 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:40.040 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:39 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:40.040 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:39 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:40.040 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:39 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:40.040 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:39 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:40.040 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:39 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:40.040 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:39 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:40.040 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:39 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:40.040 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:39 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:40.040 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:39 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:40.041 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:39 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:40.041 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:39 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:40.041 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:39 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:40.041 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:39 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:40.041 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:39 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:40.247 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:39 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:40.247 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:39 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:40.247 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:39 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:40.247 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:39 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:40.247 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:39 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:40.247 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:39 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:40.248 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:39 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:40.248 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:39 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:40.248 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:39 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:40.248 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:39 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:40.248 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:39 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:40.248 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:39 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:40.248 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:39 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:40.248 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:39 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:40.248 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:39 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:40.248 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:39 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:40.248 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:39 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:40.248 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:39 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:40.248 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:39 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:40.248 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:39 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:40.248 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:39 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:40.249 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:39 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:40.249 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:39 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:40.249 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:39 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:40.249 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:39 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:40.249 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:39 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:40.249 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:39 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:40.249 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:39 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:40.249 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:39 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:40.249 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:39 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:40.249 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:39 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:40.249 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:39 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:40.249 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:39 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:40.249 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:39 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:40.249 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:39 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:40.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:39 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:40.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:39 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:40.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:39 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:40.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:39 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:40.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:39 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:40.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:39 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:40.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:39 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:40.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:39 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:40.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:39 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:40.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:39 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:40.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:39 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:40.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:39 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:40.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:39 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:40.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:39 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:40.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:39 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:40.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:39 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:40.997 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:40 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:40.997 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:40 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:40.997 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:40 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:40.997 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:40 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:40.997 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:40 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:40.997 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:40 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:40.998 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:40 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:40.998 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:40 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:40.998 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:40 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:40.998 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:40 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:40.998 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:40 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:40.998 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:40 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:40.998 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:40 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:40.998 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:40 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:40.998 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:40 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:40.998 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:40 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:40.998 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:40 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:40.998 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:40 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:40.998 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:40 smithi181 ceph-mon[115276]: pgmap v296: 161 pgs: 161 active+clean; 585 KiB data, 265 MiB used, 715 GiB / 715 GiB avail; 57 KiB/s rd, 85 B/s wr, 86 op/s 2024-03-30T14:11:40.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:40 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:40.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:40 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:40.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:40 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:40.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:40 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:40.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:40 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:40.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:40 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:40.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:40 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:40.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:40 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:40.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:40 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:40.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:40 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:40.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:40 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:40.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:40 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:40.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:40 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:40.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:40 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:41.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:40 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:41.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:40 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:41.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:40 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:41.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:40 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:41.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:40 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:41.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:40 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:41.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:40 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:41.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:40 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:41.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:40 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:41.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:40 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:41.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:40 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:41.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:40 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:41.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:40 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:41.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:40 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:41.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:40 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:41.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:40 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:41.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:40 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:41.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:40 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:41.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:40 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:41.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:40 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:41.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:40 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:41.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:40 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:41.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:40 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:41.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:40 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:41.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:40 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:41.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:40 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:41.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:40 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:41.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:40 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:41.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:40 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:41.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:40 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:41.002 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:40 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:41.002 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:40 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:41.002 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:40 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:41.002 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:40 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:41.078 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:40 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:41.078 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:40 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:41.078 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:40 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:41.078 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:40 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:41.079 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:40 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:41.079 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:40 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:41.079 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:40 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:41.079 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:40 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:41.079 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:40 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:41.079 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:40 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:41.079 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:40 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:41.079 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:40 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:41.079 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:40 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:41.079 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:40 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:41.079 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:40 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:41.079 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:40 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:41.079 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:40 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:41.079 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:40 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:41.079 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:40 smithi099 ceph-mon[137093]: pgmap v296: 161 pgs: 161 active+clean; 585 KiB data, 265 MiB used, 715 GiB / 715 GiB avail; 57 KiB/s rd, 85 B/s wr, 86 op/s 2024-03-30T14:11:41.079 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:40 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:41.080 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:40 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:41.080 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:40 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:41.080 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:40 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:41.080 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:40 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:41.080 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:40 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:41.080 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:40 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:41.080 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:40 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:41.080 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:40 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:41.080 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:40 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:41.081 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:40 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:41.081 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:40 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:41.081 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:40 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:41.081 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:40 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:41.081 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:40 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:41.081 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:40 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:41.081 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:40 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:41.081 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:40 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:41.081 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:40 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:41.081 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:40 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:41.081 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:40 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:41.081 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:40 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:41.081 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:40 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:41.081 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:40 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:41.081 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:40 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:41.082 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:40 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:41.082 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:40 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:41.082 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:40 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:41.082 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:40 smithi099 ceph-mon[143401]: pgmap v296: 161 pgs: 161 active+clean; 585 KiB data, 265 MiB used, 715 GiB / 715 GiB avail; 57 KiB/s rd, 85 B/s wr, 86 op/s 2024-03-30T14:11:41.082 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:40 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:41.082 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:40 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:41.082 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:40 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:41.082 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:40 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:41.082 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:40 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:41.082 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:40 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:41.082 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:40 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:41.082 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:40 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:41.082 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:40 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:41.082 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:40 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:41.083 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:40 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:41.083 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:40 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:41.083 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:40 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:41.083 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:40 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:41.083 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:40 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:41.083 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:40 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:41.083 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:40 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:41.083 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:40 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:41.083 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:40 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:41.083 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:40 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:41.083 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:40 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:41.083 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:40 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:41.083 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:40 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:41.083 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:40 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:41.083 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:40 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:41.084 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:40 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:41.084 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:40 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:41.084 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:40 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:41.084 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:40 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:41.084 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:40 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:41.084 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:40 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:41.084 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:40 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:41.084 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:40 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:41.084 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:40 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:41.084 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:40 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:41.084 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:40 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:41.084 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:40 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:41.084 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:40 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:41.084 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:40 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:41.084 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:40 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:41.085 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:40 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:41.085 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:40 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:41.085 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:40 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:41.085 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:40 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:41.085 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:40 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:41.085 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:40 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:41.085 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:40 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:41.085 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:40 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:41.085 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:40 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:41.085 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:40 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:41.086 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:40 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:41.086 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:40 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:41.086 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:40 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:41.086 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:40 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:41.086 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:40 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:41.086 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:40 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:41.086 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:40 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:41.086 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:40 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:41.086 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:40 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:41.086 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:40 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:41.086 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:40 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:41.086 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:40 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:41.086 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:40 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:41.087 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:40 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:41.087 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:40 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:41.087 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:40 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:41.087 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:40 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:41.087 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:40 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:41.087 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:40 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:41.087 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:40 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:41.087 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:40 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:41.087 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:40 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:41.087 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:40 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:41.087 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:40 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:41.087 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:40 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:41.087 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:40 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:41.087 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:40 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:41.087 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:40 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:41.088 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:40 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:41.088 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:40 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:41.088 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:40 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:41.088 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:40 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:41.088 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:40 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:41.088 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:40 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:41.088 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:40 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:41.088 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:40 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:41.935 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:41 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:41.935 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:41 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:41.935 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:41 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:41.935 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:41 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:41.935 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:41 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:41.935 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:41 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:41.935 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:41 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:41.935 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:41 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:41.935 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:41 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:41.935 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:41 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:41.936 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:41 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:41.936 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:41 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:41.936 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:41 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:41.936 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:41 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:41.936 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:41 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:41.936 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:41 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:41.936 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:41 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:41.936 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:41 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:41.936 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:41 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:41.936 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:41 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:41.936 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:41 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:41.936 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:41 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:41.936 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:41 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:41.936 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:41 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:41.937 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:41 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:41.937 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:41 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:41.937 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:41 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:41.937 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:41 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:41.937 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:41 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:41.937 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:41 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:41.937 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:41 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:41.937 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:41 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:41.937 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:41 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:41.938 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:41 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:41.938 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:41 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:41.938 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:41 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:41.938 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:41 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:41.938 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:41 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:41.938 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:41 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:41.938 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:41 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:41.938 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:41 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:41.938 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:41 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:41.938 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:41 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:41.938 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:41 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:41.938 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:41 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:41.938 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:41 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:41.938 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:41 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:41.938 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:41 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:41.939 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:41 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:41.939 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:41 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:41.939 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:41 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:41.939 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:41 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:41.939 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:41 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:41.939 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:41 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:42.011 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:41 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:42.011 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:41 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:42.011 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:41 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:42.011 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:41 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:42.011 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:41 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:42.011 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:41 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:42.011 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:41 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:42.011 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:41 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:42.012 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:41 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:42.012 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:41 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:42.012 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:41 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:42.012 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:41 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:42.012 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:41 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:42.012 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:41 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:42.012 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:41 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:42.012 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:41 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:42.012 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:41 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:42.012 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:41 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:42.012 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:41 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:42.012 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:41 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:42.012 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:41 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:42.012 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:41 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:42.013 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:41 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:42.013 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:41 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:42.013 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:41 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:42.013 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:41 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:42.013 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:41 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:42.013 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:41 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:42.013 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:41 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:42.013 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:41 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:42.013 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:41 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:42.013 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:41 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:42.013 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:41 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:42.013 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:41 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:42.014 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:41 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:42.014 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:41 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:42.014 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:41 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:42.014 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:41 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:42.014 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:41 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:42.014 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:41 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:42.014 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:41 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:42.014 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:41 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:42.014 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:41 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:42.014 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:41 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:42.014 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:41 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:42.014 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:41 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:42.014 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:41 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:42.015 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:41 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:42.015 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:41 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:42.015 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:41 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:42.015 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:41 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:42.015 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:41 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:42.015 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:41 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:42.015 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:41 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:42.015 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:41 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:42.015 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:41 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:42.015 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:41 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:42.015 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:41 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:42.015 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:41 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:42.015 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:41 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:42.016 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:41 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:42.016 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:41 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:42.016 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:41 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:42.016 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:41 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:42.016 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:41 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:42.016 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:41 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:42.016 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:41 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:42.016 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:41 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:42.016 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:41 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:42.016 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:41 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:42.016 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:41 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:42.016 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:41 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:42.016 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:41 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:42.016 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:41 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:42.016 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:41 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:42.017 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:41 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:42.017 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:41 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:42.017 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:41 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:42.017 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:41 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:42.017 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:41 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:42.017 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:41 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:42.017 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:41 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:42.017 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:41 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:42.017 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:41 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:42.017 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:41 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:42.017 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:41 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:42.017 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:41 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:42.017 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:41 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:42.018 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:41 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:42.018 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:41 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:42.018 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:41 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:42.018 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:41 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:42.018 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:41 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:42.018 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:41 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:42.018 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:41 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:42.018 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:41 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:42.018 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:41 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:42.018 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:41 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:42.018 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:41 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:42.018 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:41 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:42.018 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:41 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:42.018 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:41 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:42.019 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:41 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:42.019 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:41 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:42.019 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:41 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:42.019 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:41 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:42.019 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:41 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:42.019 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:41 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:42.997 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:42 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:42.997 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:42 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:42.997 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:42 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:42.997 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:42 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:42.997 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:42 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:42.998 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:42 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:42.998 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:42 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:42.998 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:42 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:42.998 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:42 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:42.998 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:42 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:42.998 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:42 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:42.998 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:42 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:42.998 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:42 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:42.998 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:42 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:42.998 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:42 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:42.998 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:42 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:42.998 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:42 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:42.998 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:42 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:42.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:42 smithi181 ceph-mon[115276]: pgmap v297: 161 pgs: 161 active+clean; 585 KiB data, 265 MiB used, 715 GiB / 715 GiB avail; 57 KiB/s rd, 85 B/s wr, 86 op/s 2024-03-30T14:11:42.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:42 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:42.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:42 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:42.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:42 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:42.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:42 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:42.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:42 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:42.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:42 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:42.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:42 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:42.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:42 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:42.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:42 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:42.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:42 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:42.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:42 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:42.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:42 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:42.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:42 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:42.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:42 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:42.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:42 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:43.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:42 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:43.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:42 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:43.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:42 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:43.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:42 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:43.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:42 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:43.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:42 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:43.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:42 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:43.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:42 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:43.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:42 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:43.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:42 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:43.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:42 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:43.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:42 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:43.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:42 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:43.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:42 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:43.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:42 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:43.000 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:42 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:43.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:42 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:43.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:42 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:43.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:42 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:43.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:42 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:43.001 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:42 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:43.078 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:42 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:43.078 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:42 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:43.078 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:42 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:43.078 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:42 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:43.078 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:42 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:43.078 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:42 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:43.078 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:42 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:43.078 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:42 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:43.078 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:42 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:43.079 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:42 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:43.079 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:42 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:43.079 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:42 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:43.079 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:42 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:43.079 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:42 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:43.079 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:42 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:43.079 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:42 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:43.079 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:42 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:43.079 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:42 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:43.079 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:42 smithi099 ceph-mon[143401]: pgmap v297: 161 pgs: 161 active+clean; 585 KiB data, 265 MiB used, 715 GiB / 715 GiB avail; 57 KiB/s rd, 85 B/s wr, 86 op/s 2024-03-30T14:11:43.079 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:42 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:43.079 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:42 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:43.079 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:42 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:43.079 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:42 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:43.079 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:42 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:43.080 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:42 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:43.080 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:42 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:43.080 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:42 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:43.080 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:42 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:43.080 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:42 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:43.080 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:42 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:43.080 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:42 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:43.080 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:42 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:43.081 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:42 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:43.081 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:42 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:43.081 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:42 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:43.081 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:42 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:43.081 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:42 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:43.081 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:42 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:43.081 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:42 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:43.081 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:42 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:43.081 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:42 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:43.081 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:42 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:43.081 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:42 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:43.081 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:42 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:43.081 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:42 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:43.081 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:42 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:43.082 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:42 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:43.082 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:42 smithi099 ceph-mon[137093]: pgmap v297: 161 pgs: 161 active+clean; 585 KiB data, 265 MiB used, 715 GiB / 715 GiB avail; 57 KiB/s rd, 85 B/s wr, 86 op/s 2024-03-30T14:11:43.082 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:42 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:43.082 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:42 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:43.082 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:42 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:43.082 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:42 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:43.082 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:42 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:43.082 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:42 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:43.082 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:42 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:43.082 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:42 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:43.082 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:42 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:43.082 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:42 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:43.082 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:42 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:43.082 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:42 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:43.082 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:42 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:43.083 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:42 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:43.083 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:42 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:43.083 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:42 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:43.083 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:42 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:43.083 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:42 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:43.083 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:42 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:43.083 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:42 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:43.083 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:42 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:43.083 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:42 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:43.083 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:42 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:43.083 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:42 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:43.083 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:42 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:43.083 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:42 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:43.083 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:42 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:43.083 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:42 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:43.084 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:42 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:43.084 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:42 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:43.084 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:42 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:43.084 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:42 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:43.084 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:42 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:43.084 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:42 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:43.084 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:42 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:43.084 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:42 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:43.084 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:42 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:43.084 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:42 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:43.084 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:42 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:43.085 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:42 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:43.085 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:42 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:43.085 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:42 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:43.085 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:42 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:43.085 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:42 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:43.085 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:42 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:43.085 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:42 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:43.085 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:42 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:43.085 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:42 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:43.085 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:42 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:43.085 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:42 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:43.085 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:42 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:43.085 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:42 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:43.085 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:42 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:43.086 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:42 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:43.086 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:42 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:43.086 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:42 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:43.086 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:42 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:43.086 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:42 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:43.086 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:42 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:43.086 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:42 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:43.086 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:42 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:43.086 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:42 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:44.078 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:43 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:44.078 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:43 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:44.078 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:43 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:44.078 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:43 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:44.078 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:43 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:44.078 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:43 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:44.078 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:43 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:44.079 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:43 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:44.079 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:43 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:44.079 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:43 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:44.079 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:43 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:44.079 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:43 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:44.079 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:43 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:44.079 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:43 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:44.079 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:43 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:44.079 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:43 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:44.079 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:43 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:44.079 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:43 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:44.079 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:43 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:44.079 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:43 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:44.079 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:43 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:44.080 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:43 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:44.080 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:43 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:44.080 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:43 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:44.080 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:43 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:44.080 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:43 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:44.080 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:43 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:44.080 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:43 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:44.080 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:43 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:44.080 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:43 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:44.081 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:43 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:44.081 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:43 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:44.081 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:43 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:44.081 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:43 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:44.081 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:43 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:44.081 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:43 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:44.081 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:43 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:44.081 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:43 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:44.081 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:43 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:44.081 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:43 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:44.081 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:43 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:44.081 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:43 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:44.081 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:43 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:44.082 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:43 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:44.082 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:43 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:44.082 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:43 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:44.082 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:43 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:44.082 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:43 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:44.082 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:43 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:44.082 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:43 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:44.082 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:43 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:44.082 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:43 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:44.082 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:43 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:44.082 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:43 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:44.082 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:43 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:44.083 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:43 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:44.083 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:43 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:44.083 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:43 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:44.083 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:43 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:44.083 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:43 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:44.083 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:43 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:44.083 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:43 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:44.083 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:43 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:44.083 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:43 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:44.083 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:43 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:44.084 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:43 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:44.084 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:43 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:44.084 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:43 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:44.084 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:43 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:44.084 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:43 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:44.084 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:43 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:44.084 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:43 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:44.084 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:43 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:44.084 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:43 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:44.084 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:43 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:44.084 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:43 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:44.084 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:43 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:44.084 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:43 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:44.084 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:43 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:44.085 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:43 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:44.085 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:43 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:44.085 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:43 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:44.085 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:43 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:44.085 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:43 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:44.085 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:43 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:44.085 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:43 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:44.085 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:43 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:44.085 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:43 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:44.085 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:43 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:44.085 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:43 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:44.086 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:43 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:44.086 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:43 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:44.086 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:43 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:44.086 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:43 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:44.086 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:43 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:44.086 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:43 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:44.086 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:43 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:44.086 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:43 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:44.086 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:43 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:44.086 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:43 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:44.086 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:43 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:44.087 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:43 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:44.087 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:43 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:44.087 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:43 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:44.087 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:43 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:44.087 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:43 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:44.087 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:43 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:44.087 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:43 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:44.087 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:43 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:44.087 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:43 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:44.087 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:43 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:44.087 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:43 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:44.087 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:43 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:44.087 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:43 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:44.087 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:43 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:44.088 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:43 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:44.088 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:43 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:44.088 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:43 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:44.088 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:43 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:44.088 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:43 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:44.088 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:43 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:44.088 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:43 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:44.088 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:43 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:44.088 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:43 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:44.088 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:43 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:44.088 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:43 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:44.088 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:43 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:44.089 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:43 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:44.207 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:43 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:44.207 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:43 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:44.207 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:43 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:44.207 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:43 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:44.207 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:43 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:44.207 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:43 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:44.207 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:43 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:44.207 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:43 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:44.207 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:43 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:44.207 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:43 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:44.208 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:43 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:44.208 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:43 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:44.208 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:43 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:44.208 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:43 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:44.208 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:43 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:44.208 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:43 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:44.208 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:43 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:44.208 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:43 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:44.208 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:43 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:44.208 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:43 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:44.208 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:43 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:44.208 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:43 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:44.208 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:43 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:44.208 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:43 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:44.208 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:43 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:44.209 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:43 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:44.209 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:43 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:44.209 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:43 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:44.209 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:43 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:44.209 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:43 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:44.209 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:43 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:44.209 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:43 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:44.209 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:43 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:44.210 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:43 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:44.210 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:43 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:44.210 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:43 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:44.210 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:43 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:44.210 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:43 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:44.210 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:43 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:44.210 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:43 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:44.210 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:43 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:44.210 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:43 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:44.210 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:43 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:44.210 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:43 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:44.210 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:43 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:44.210 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:43 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:44.210 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:43 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:44.211 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:43 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:44.211 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:43 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:44.211 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:43 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:44.211 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:43 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:44.211 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:43 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:44.211 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:43 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:44.211 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:43 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:44.211 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:43 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:44.211 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:43 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:44.211 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:43 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:44.211 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:43 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:44.211 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:43 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:44.211 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:43 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:44.211 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:43 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:44.211 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:43 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:44.212 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:43 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:44.212 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:43 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:44.496 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 14:11:44 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a[112419]: logger=cleanup t=2024-03-30T14:11:44.215472385Z level=info msg="Completed cleanup jobs" duration=1.962414ms 2024-03-30T14:11:45.057 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 14:11:44 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[71049]: ::ffff:172.21.15.181 - - [30/Mar/2024:14:11:44] "GET /metrics HTTP/1.1" 200 38390 "" "Prometheus/2.43.0" 2024-03-30T14:11:45.057 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:44 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:45.057 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:44 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:45.057 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:44 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:45.057 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:44 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:45.057 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:44 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:45.057 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:44 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:45.057 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:44 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:45.057 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:44 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:45.058 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:44 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:45.058 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:44 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:45.058 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:44 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:45.058 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:44 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:45.058 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:44 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:45.058 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:44 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:45.058 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:44 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:45.058 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:44 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:45.058 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:44 smithi099 ceph-mon[143401]: pgmap v298: 161 pgs: 161 active+clean; 585 KiB data, 265 MiB used, 715 GiB / 715 GiB avail; 46 KiB/s rd, 85 B/s wr, 70 op/s 2024-03-30T14:11:45.058 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:44 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:45.058 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:44 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:45.058 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:44 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:45.058 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:44 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:45.058 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:44 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:45.059 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:44 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:45.059 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:44 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:45.059 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:44 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:45.059 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:44 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:45.059 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:44 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:45.059 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:44 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:45.059 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:44 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:45.059 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:44 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:45.059 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:44 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:45.059 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:44 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:45.059 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:44 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:45.059 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:44 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:45.060 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:44 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:45.060 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:44 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:45.060 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:44 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:45.060 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:44 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:45.060 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:44 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:45.060 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:44 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:45.060 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:44 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:45.060 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:44 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:45.060 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:44 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:45.060 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:44 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:45.060 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:44 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:45.060 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:44 smithi099 ceph-mon[137093]: pgmap v298: 161 pgs: 161 active+clean; 585 KiB data, 265 MiB used, 715 GiB / 715 GiB avail; 46 KiB/s rd, 85 B/s wr, 70 op/s 2024-03-30T14:11:45.060 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:44 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:45.060 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:44 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:45.060 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:44 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:45.061 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:44 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:45.061 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:44 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:45.061 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:44 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:45.061 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:44 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:45.061 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:44 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:45.061 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:44 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:45.061 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:44 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:45.061 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:44 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:45.061 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:44 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:45.247 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:44 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:45.247 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:44 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:45.247 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:44 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:45.247 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:44 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:45.247 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:44 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:45.247 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:44 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:45.247 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:44 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:45.247 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:44 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:45.247 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:44 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:45.247 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:44 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:45.247 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:44 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:45.248 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:44 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:45.248 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:44 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:45.248 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:44 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:45.248 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:44 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:45.248 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:44 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:45.248 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:44 smithi181 ceph-mon[115276]: pgmap v298: 161 pgs: 161 active+clean; 585 KiB data, 265 MiB used, 715 GiB / 715 GiB avail; 46 KiB/s rd, 85 B/s wr, 70 op/s 2024-03-30T14:11:45.248 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:44 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:45.248 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:44 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:45.248 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:44 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:45.248 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:44 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:45.248 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:44 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:45.248 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:44 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:45.248 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:44 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:45.248 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:44 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:45.249 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:44 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:45.249 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:44 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:45.249 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:44 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:45.249 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:44 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:45.977 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:45 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:45.977 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:45 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:45.977 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:45 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:45.977 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:45 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:45.978 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:45 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:45.978 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:45 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:45.978 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:45 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:45.978 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:45 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:45.978 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:45 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:45.978 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:45 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:45.978 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:45 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:45.978 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:45 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:45.978 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:45 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:45.978 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:45 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:45.978 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:45 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:45.978 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:45 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:45.978 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:45 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:45.978 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:45 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:45.979 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:45 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:45.979 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:45 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:45.979 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:45 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:45.979 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:45 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:45.979 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:45 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:45.979 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:45 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:45.979 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:45 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:45.979 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:45 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:45.979 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:45 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:45.979 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:45 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:45.979 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:45 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:45.979 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:45 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:45.979 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:45 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:45.979 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:45 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:45.979 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:45 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:45.980 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:45 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:45.980 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:45 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:45.980 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:45 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:45.980 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:45 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:45.980 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:45 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:45.980 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:45 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:45.980 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:45 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:45.980 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:45 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:45.980 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:45 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:45.980 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:45 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:45.980 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:45 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:45.980 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:45 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:45.980 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:45 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:45.980 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:45 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:45.980 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:45 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:45.981 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:45 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:45.981 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:45 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:45.981 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:45 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:45.981 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:45 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:45.981 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:45 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:45.981 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:45 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:45.981 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:45 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:45.981 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:45 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:45.981 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:45 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:45.981 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:45 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:45.981 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:45 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:45.981 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:45 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:45.981 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:45 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:45.982 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:45 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:45.982 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:45 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:45.982 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:45 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:45.982 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:45 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:45.982 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:45 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:45.982 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:45 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:45.982 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:45 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:45.982 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:45 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:45.982 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:45 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:45.982 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:45 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:45.982 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:45 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:45.982 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:45 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:45.982 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:45 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:45.982 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:45 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:45.983 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:45 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:45.983 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:45 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:45.983 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:45 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:45.983 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:45 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:45.983 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:45 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:45.983 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:45 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:45.983 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:45 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:45.983 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:45 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:45.983 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:45 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:45.983 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:45 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:45.983 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:45 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:45.983 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:45 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:45.983 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:45 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:45.983 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:45 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:45.983 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:45 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:45.984 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:45 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:45.984 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:45 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:45.984 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:45 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:45.984 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:45 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:45.984 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:45 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:45.984 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:45 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:45.984 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:45 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:45.984 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:45 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:45.984 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:45 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:45.984 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:45 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:45.984 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:45 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:45.984 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:45 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:45.984 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:45 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:45.984 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:45 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:45.984 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:45 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:45.984 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:45 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:46.247 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:45 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:46.247 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:45 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:46.247 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:45 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:46.247 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:45 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:46.247 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:45 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:46.247 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:45 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:46.247 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:45 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:46.247 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:45 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:46.248 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:45 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:46.248 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:45 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:46.248 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:45 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:46.248 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:45 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:46.248 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:45 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:46.248 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:45 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:46.248 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:45 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:46.248 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:45 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:46.248 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:45 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:46.248 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:45 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:46.248 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:45 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:46.248 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:45 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:46.248 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:45 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:46.248 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:45 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:46.249 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:45 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:46.249 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:45 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:46.249 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:45 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:46.249 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:45 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:46.249 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:45 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:46.249 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:45 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:46.249 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:45 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:46.249 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:45 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:46.249 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:45 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:46.249 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:45 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:46.249 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:45 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:46.249 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:45 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:46.249 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:45 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:46.249 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:45 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:46.249 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:45 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:46.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:45 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:46.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:45 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:46.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:45 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:46.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:45 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:46.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:45 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:46.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:45 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:46.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:45 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:46.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:45 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:46.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:45 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:46.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:45 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:46.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:45 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:46.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:45 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:46.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:45 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:46.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:45 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:46.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:45 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:46.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:45 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:46.833 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:46 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:46.833 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:46 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:46.833 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:46 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:46.833 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:46 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:46.833 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:46 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:46.834 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:46 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:46.834 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:46 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:46.834 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:46 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:46.834 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:46 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:46.834 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:46 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:46.834 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:46 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:46.834 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:46 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:46.834 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:46 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:46.834 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:46 smithi099 ceph-mon[137093]: pgmap v299: 161 pgs: 161 active+clean; 585 KiB data, 265 MiB used, 715 GiB / 715 GiB avail; 31 KiB/s rd, 85 B/s wr, 46 op/s 2024-03-30T14:11:46.834 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:46 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:46.834 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:46 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:46.834 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:46 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:46.834 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:46 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:46.834 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:46 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:46.835 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:46 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:46.835 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:46 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:46.835 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:46 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:46.835 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:46 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:46.835 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:46 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:46.835 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:46 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:46.835 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:46 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:46.835 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:46 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:46.835 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:46 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:46.835 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:46 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:46.836 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:46 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:46.836 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:46 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:46.836 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:46 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:46.836 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:46 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:46.836 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:46 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:46.836 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:46 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:46.836 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:46 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:46.836 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:46 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:46.836 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:46 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:46.836 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:46 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:46.836 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:46 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:46.836 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:46 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:46.837 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:46 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:46.837 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:46 smithi099 ceph-mon[143401]: pgmap v299: 161 pgs: 161 active+clean; 585 KiB data, 265 MiB used, 715 GiB / 715 GiB avail; 31 KiB/s rd, 85 B/s wr, 46 op/s 2024-03-30T14:11:46.837 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:46 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:46.837 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:46 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:46.837 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:46 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:46.837 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:46 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:46.837 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:46 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:46.837 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:46 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:46.837 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:46 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:46.837 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:46 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:46.837 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:46 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:46.837 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:46 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:46.837 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:46 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:46.837 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:46 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:46.837 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:46 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:46.838 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:46 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:46.838 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:46 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:46.838 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:46 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:46.838 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:46 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:46.838 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:46 smithi099 ceph-mon[137093]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:46.838 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:46 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:46.838 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:46 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:46.838 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:46 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:46.838 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:46 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:46.838 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:46 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:46.839 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:46 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:46.839 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:46 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:46.839 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:46 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:46.839 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:46 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:46.839 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:46 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:46.839 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:46 smithi099 ceph-mon[137093]: Upgrade: Setting container_image for all rgw 2024-03-30T14:11:46.839 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:46 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:46.839 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:46 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rgw.foo.smithi099.fxjbmp"}]: dispatch 2024-03-30T14:11:46.839 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:46 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rgw.foo.smithi099.fxjbmp"}]: dispatch 2024-03-30T14:11:46.839 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:46 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rgw.foo.smithi099.fxjbmp"}]': finished 2024-03-30T14:11:46.839 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:46 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rgw.foo.smithi181.wfqwti"}]: dispatch 2024-03-30T14:11:46.839 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:46 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rgw.foo.smithi181.wfqwti"}]: dispatch 2024-03-30T14:11:46.839 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:46 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rgw.foo.smithi181.wfqwti"}]': finished 2024-03-30T14:11:46.839 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:46 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:46.839 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:46 smithi099 ceph-mon[137093]: Upgrade: Setting container_image for all rbd-mirror 2024-03-30T14:11:46.839 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:46 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:46.840 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:46 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:46.840 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:46 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:46.840 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:46 smithi099 ceph-mon[137093]: Upgrade: Setting container_image for all ceph-exporter 2024-03-30T14:11:46.840 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:46 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:46.840 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:46 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:46.840 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:46 smithi099 ceph-mon[137093]: Upgrade: Setting container_image for all nfs 2024-03-30T14:11:46.840 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:46 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:46.840 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:46 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:46.841 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:46 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:46.841 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:46 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:46.841 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:46 smithi099 ceph-mon[143401]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:46.841 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:46 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:46.841 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:46 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:46.841 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:46 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:46.841 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:46 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:46.841 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:46 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:46.841 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:46 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:46.841 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:46 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:46.841 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:46 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:46.841 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:46 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:46.841 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:46 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:46.842 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:46 smithi099 ceph-mon[143401]: Upgrade: Setting container_image for all rgw 2024-03-30T14:11:46.842 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:46 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:46.842 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:46 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rgw.foo.smithi099.fxjbmp"}]: dispatch 2024-03-30T14:11:46.842 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:46 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rgw.foo.smithi099.fxjbmp"}]: dispatch 2024-03-30T14:11:46.842 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:46 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rgw.foo.smithi099.fxjbmp"}]': finished 2024-03-30T14:11:46.842 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:46 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rgw.foo.smithi181.wfqwti"}]: dispatch 2024-03-30T14:11:46.842 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:46 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rgw.foo.smithi181.wfqwti"}]: dispatch 2024-03-30T14:11:46.842 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:46 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rgw.foo.smithi181.wfqwti"}]': finished 2024-03-30T14:11:46.842 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:46 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:46.842 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:46 smithi099 ceph-mon[143401]: Upgrade: Setting container_image for all rbd-mirror 2024-03-30T14:11:46.842 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:46 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:46.842 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:46 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:46.842 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:46 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:46.842 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:46 smithi099 ceph-mon[143401]: Upgrade: Setting container_image for all ceph-exporter 2024-03-30T14:11:46.843 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:46 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:46.843 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:46 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:46.843 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:46 smithi099 ceph-mon[143401]: Upgrade: Setting container_image for all nfs 2024-03-30T14:11:46.843 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:46 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:46.843 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:46 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:46.843 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:46 smithi099 ceph-mon[137093]: Upgrade: Setting container_image for all nvmeof 2024-03-30T14:11:46.843 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:46 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:46.843 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:46 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:46.843 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:46 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:46.844 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:46 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:46.844 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:46 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:46.844 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:46 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:46.844 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:46 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:46.844 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:46 smithi099 ceph-mon[137093]: Upgrade: Finalizing container_image settings 2024-03-30T14:11:46.844 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:46 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]: dispatch 2024-03-30T14:11:46.844 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:46 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]: dispatch 2024-03-30T14:11:46.844 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:46 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]': finished 2024-03-30T14:11:46.844 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:46 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-03-30T14:11:46.844 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:46 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-03-30T14:11:46.844 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:46 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon"}]': finished 2024-03-30T14:11:46.844 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:46 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]: dispatch 2024-03-30T14:11:46.844 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:46 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]: dispatch 2024-03-30T14:11:46.845 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:46 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]': finished 2024-03-30T14:11:46.845 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:46 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd"}]: dispatch 2024-03-30T14:11:46.845 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:46 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd"}]: dispatch 2024-03-30T14:11:46.845 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:46 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd"}]': finished 2024-03-30T14:11:46.845 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:46 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds"}]: dispatch 2024-03-30T14:11:46.845 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:46 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds"}]: dispatch 2024-03-30T14:11:46.845 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:46 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds"}]': finished 2024-03-30T14:11:46.845 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:46 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]: dispatch 2024-03-30T14:11:46.845 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:46 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]: dispatch 2024-03-30T14:11:46.846 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:46 smithi099 ceph-mon[143401]: Upgrade: Setting container_image for all nvmeof 2024-03-30T14:11:46.846 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:46 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:46.846 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:46 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:46.846 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:46 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:46.846 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:46 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:46.846 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:46 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:46.846 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:46 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:46.846 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:46 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:46.846 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:46 smithi099 ceph-mon[143401]: Upgrade: Finalizing container_image settings 2024-03-30T14:11:46.846 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:46 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]: dispatch 2024-03-30T14:11:46.846 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:46 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]: dispatch 2024-03-30T14:11:46.846 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:46 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]': finished 2024-03-30T14:11:46.846 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:46 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-03-30T14:11:46.847 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:46 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-03-30T14:11:46.847 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:46 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon"}]': finished 2024-03-30T14:11:46.847 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:46 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]: dispatch 2024-03-30T14:11:46.847 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:46 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]: dispatch 2024-03-30T14:11:46.847 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:46 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]': finished 2024-03-30T14:11:46.847 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:46 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd"}]: dispatch 2024-03-30T14:11:46.847 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:46 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd"}]: dispatch 2024-03-30T14:11:46.847 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:46 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd"}]': finished 2024-03-30T14:11:46.847 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:46 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds"}]: dispatch 2024-03-30T14:11:46.847 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:46 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds"}]: dispatch 2024-03-30T14:11:46.847 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:46 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds"}]': finished 2024-03-30T14:11:46.847 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:46 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]: dispatch 2024-03-30T14:11:46.847 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:46 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]: dispatch 2024-03-30T14:11:46.847 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:46 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]': finished 2024-03-30T14:11:46.847 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:46 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]: dispatch 2024-03-30T14:11:46.848 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:46 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]: dispatch 2024-03-30T14:11:46.848 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:46 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]': finished 2024-03-30T14:11:46.848 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:46 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-03-30T14:11:46.848 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:46 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-03-30T14:11:46.848 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:46 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"}]: dispatch 2024-03-30T14:11:46.848 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:46 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"}]: dispatch 2024-03-30T14:11:46.848 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:46 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"}]': finished 2024-03-30T14:11:46.848 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:46 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]: dispatch 2024-03-30T14:11:46.848 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:46 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]: dispatch 2024-03-30T14:11:46.848 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:46 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]: dispatch 2024-03-30T14:11:46.848 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:46 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]: dispatch 2024-03-30T14:11:46.848 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:46 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]': finished 2024-03-30T14:11:46.848 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:46 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]: dispatch 2024-03-30T14:11:46.848 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:46 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]: dispatch 2024-03-30T14:11:46.849 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:46 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]': finished 2024-03-30T14:11:46.849 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:46 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-03-30T14:11:46.849 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:46 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-03-30T14:11:46.849 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:46 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-03-30T14:11:46.849 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:46 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-03-30T14:11:46.849 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:46 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-03-30T14:11:46.849 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:46 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-03-30T14:11:46.849 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:46 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-03-30T14:11:46.849 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:46 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]': finished 2024-03-30T14:11:46.849 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:46 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]: dispatch 2024-03-30T14:11:46.849 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:46 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]: dispatch 2024-03-30T14:11:46.850 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:46 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]': finished 2024-03-30T14:11:46.850 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:46 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-03-30T14:11:46.850 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:46 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-03-30T14:11:46.850 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:46 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"}]: dispatch 2024-03-30T14:11:46.850 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:46 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"}]: dispatch 2024-03-30T14:11:46.850 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:46 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"}]': finished 2024-03-30T14:11:46.850 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:46 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]: dispatch 2024-03-30T14:11:46.850 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:46 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]: dispatch 2024-03-30T14:11:46.850 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:46 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]: dispatch 2024-03-30T14:11:46.850 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:46 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]: dispatch 2024-03-30T14:11:46.850 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:46 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]': finished 2024-03-30T14:11:46.850 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:46 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]: dispatch 2024-03-30T14:11:46.851 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:46 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]: dispatch 2024-03-30T14:11:46.851 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:46 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]': finished 2024-03-30T14:11:46.851 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:46 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-03-30T14:11:46.851 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:46 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-03-30T14:11:46.851 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:46 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-03-30T14:11:46.851 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:46 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-03-30T14:11:46.851 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:46 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-03-30T14:11:46.851 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:46 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-03-30T14:11:46.851 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:46 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-03-30T14:11:46.851 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:46 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-03-30T14:11:46.852 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:46 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-03-30T14:11:46.852 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:46 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-03-30T14:11:46.852 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:46 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-03-30T14:11:46.852 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:46 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-03-30T14:11:46.852 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:46 smithi099 ceph-mon[143401]: Upgrade: Complete! 2024-03-30T14:11:46.852 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:46 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]: dispatch 2024-03-30T14:11:46.852 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:46 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' cmd=[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]: dispatch 2024-03-30T14:11:46.852 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:46 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' cmd='[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]': finished 2024-03-30T14:11:46.852 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:46 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:46.852 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:46 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:46.852 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:46 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:46.852 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:46 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:46.852 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:46 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:46.852 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:46 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:46.853 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:46 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-03-30T14:11:46.853 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:46 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-03-30T14:11:46.853 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:46 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-03-30T14:11:46.853 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:46 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-03-30T14:11:46.853 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:46 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-03-30T14:11:46.853 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:46 smithi099 ceph-mon[137093]: Upgrade: Complete! 2024-03-30T14:11:46.853 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:46 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]: dispatch 2024-03-30T14:11:46.853 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:46 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' cmd=[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]: dispatch 2024-03-30T14:11:46.853 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:46 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' cmd='[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]': finished 2024-03-30T14:11:46.853 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:46 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:46.853 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:46 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:46.853 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:46 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:46.853 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:46 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:46.854 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:46 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:46.854 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:46 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:47.247 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:46 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:47.247 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:46 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:47.248 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:46 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:47.248 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:46 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:47.248 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:46 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:47.248 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:46 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:47.248 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:46 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:47.248 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:46 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:47.248 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:46 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:47.248 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:46 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:47.248 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:46 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:47.248 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:46 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:47.248 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:46 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:47.248 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:46 smithi181 ceph-mon[115276]: pgmap v299: 161 pgs: 161 active+clean; 585 KiB data, 265 MiB used, 715 GiB / 715 GiB avail; 31 KiB/s rd, 85 B/s wr, 46 op/s 2024-03-30T14:11:47.248 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:46 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:47.248 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:46 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:47.248 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:46 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:47.249 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:46 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:47.249 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:46 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:47.249 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:46 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:47.249 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:46 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:47.249 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:46 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:47.249 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:46 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:47.249 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:46 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:47.249 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:46 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:47.249 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:46 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:47.249 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:46 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:47.249 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:46 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:47.249 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:46 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:47.249 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:46 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:47.249 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:46 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:47.249 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:46 smithi181 ceph-mon[115276]: Metadata not up to date on all hosts. Skipping non agent specs 2024-03-30T14:11:47.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:46 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:47.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:46 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:47.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:46 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:47.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:46 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:11:47.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:46 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:47.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:46 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:47.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:46 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:47.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:46 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:47.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:46 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:47.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:46 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:47.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:46 smithi181 ceph-mon[115276]: Upgrade: Setting container_image for all rgw 2024-03-30T14:11:47.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:46 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:47.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:46 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rgw.foo.smithi099.fxjbmp"}]: dispatch 2024-03-30T14:11:47.250 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:46 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rgw.foo.smithi099.fxjbmp"}]: dispatch 2024-03-30T14:11:47.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:46 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rgw.foo.smithi099.fxjbmp"}]': finished 2024-03-30T14:11:47.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:46 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rgw.foo.smithi181.wfqwti"}]: dispatch 2024-03-30T14:11:47.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:46 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rgw.foo.smithi181.wfqwti"}]: dispatch 2024-03-30T14:11:47.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:46 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rgw.foo.smithi181.wfqwti"}]': finished 2024-03-30T14:11:47.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:46 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:47.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:46 smithi181 ceph-mon[115276]: Upgrade: Setting container_image for all rbd-mirror 2024-03-30T14:11:47.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:46 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:47.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:46 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:47.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:46 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:47.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:46 smithi181 ceph-mon[115276]: Upgrade: Setting container_image for all ceph-exporter 2024-03-30T14:11:47.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:46 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:47.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:46 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:47.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:46 smithi181 ceph-mon[115276]: Upgrade: Setting container_image for all nfs 2024-03-30T14:11:47.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:46 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:47.251 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:46 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:47.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:46 smithi181 ceph-mon[115276]: Upgrade: Setting container_image for all nvmeof 2024-03-30T14:11:47.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:46 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:47.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:46 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:47.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:46 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:47.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:46 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:47.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:46 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:47.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:46 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:47.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:46 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:11:47.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:46 smithi181 ceph-mon[115276]: Upgrade: Finalizing container_image settings 2024-03-30T14:11:47.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:46 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]: dispatch 2024-03-30T14:11:47.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:46 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]: dispatch 2024-03-30T14:11:47.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:46 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]': finished 2024-03-30T14:11:47.252 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:46 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-03-30T14:11:47.253 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:46 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-03-30T14:11:47.253 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:46 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon"}]': finished 2024-03-30T14:11:47.253 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:46 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]: dispatch 2024-03-30T14:11:47.253 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:46 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]: dispatch 2024-03-30T14:11:47.253 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:46 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]': finished 2024-03-30T14:11:47.253 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:46 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd"}]: dispatch 2024-03-30T14:11:47.253 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:46 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd"}]: dispatch 2024-03-30T14:11:47.253 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:46 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd"}]': finished 2024-03-30T14:11:47.253 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:46 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds"}]: dispatch 2024-03-30T14:11:47.253 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:46 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds"}]: dispatch 2024-03-30T14:11:47.253 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:46 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds"}]': finished 2024-03-30T14:11:47.253 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:46 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]: dispatch 2024-03-30T14:11:47.253 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:46 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]: dispatch 2024-03-30T14:11:47.254 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:46 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]': finished 2024-03-30T14:11:47.254 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:46 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]: dispatch 2024-03-30T14:11:47.254 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:46 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]: dispatch 2024-03-30T14:11:47.254 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:46 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]': finished 2024-03-30T14:11:47.254 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:46 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-03-30T14:11:47.254 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:46 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-03-30T14:11:47.254 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:46 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"}]: dispatch 2024-03-30T14:11:47.255 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:46 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"}]: dispatch 2024-03-30T14:11:47.255 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:46 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"}]': finished 2024-03-30T14:11:47.255 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:46 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]: dispatch 2024-03-30T14:11:47.255 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:46 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]: dispatch 2024-03-30T14:11:47.255 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:46 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]: dispatch 2024-03-30T14:11:47.255 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:46 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]: dispatch 2024-03-30T14:11:47.255 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:46 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]': finished 2024-03-30T14:11:47.255 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:46 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]: dispatch 2024-03-30T14:11:47.255 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:46 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]: dispatch 2024-03-30T14:11:47.255 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:46 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]': finished 2024-03-30T14:11:47.255 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:46 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-03-30T14:11:47.255 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:46 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-03-30T14:11:47.255 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:46 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-03-30T14:11:47.255 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:46 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-03-30T14:11:47.256 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:46 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-03-30T14:11:47.256 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:46 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-03-30T14:11:47.256 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:46 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-03-30T14:11:47.256 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:46 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-03-30T14:11:47.256 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:46 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-03-30T14:11:47.256 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:46 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-03-30T14:11:47.256 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:46 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-03-30T14:11:47.256 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:46 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-03-30T14:11:47.256 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:46 smithi181 ceph-mon[115276]: Upgrade: Complete! 2024-03-30T14:11:47.256 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:46 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]: dispatch 2024-03-30T14:11:47.256 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:46 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' cmd=[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]: dispatch 2024-03-30T14:11:47.256 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:46 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' cmd='[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]': finished 2024-03-30T14:11:47.256 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:46 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:47.257 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:46 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:47.257 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:46 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:47.257 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:46 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:11:47.257 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:46 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:11:47.257 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:46 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:48.247 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:47 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:48.247 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:47 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:48.247 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:47 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:48.247 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:47 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:48.305 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:47 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:48.305 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:47 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:48.305 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:47 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:48.305 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:47 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:48.305 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:47 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:48.305 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:47 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:48.305 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:47 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:48.305 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:47 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:11:49.246 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:48 smithi181 ceph-mon[115276]: pgmap v300: 161 pgs: 161 active+clean; 585 KiB data, 265 MiB used, 715 GiB / 715 GiB avail; 767 B/s rd, 0 op/s 2024-03-30T14:11:49.246 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:48 smithi181 ceph-mon[115276]: from='client.25136 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T14:11:49.328 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:48 smithi099 ceph-mon[137093]: pgmap v300: 161 pgs: 161 active+clean; 585 KiB data, 265 MiB used, 715 GiB / 715 GiB avail; 767 B/s rd, 0 op/s 2024-03-30T14:11:49.328 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:48 smithi099 ceph-mon[137093]: from='client.25136 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T14:11:49.328 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:48 smithi099 ceph-mon[143401]: pgmap v300: 161 pgs: 161 active+clean; 585 KiB data, 265 MiB used, 715 GiB / 715 GiB avail; 767 B/s rd, 0 op/s 2024-03-30T14:11:49.328 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:48 smithi099 ceph-mon[143401]: from='client.25136 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T14:11:51.827 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:51 smithi099 ceph-mon[137093]: pgmap v301: 161 pgs: 161 active+clean; 585 KiB data, 265 MiB used, 715 GiB / 715 GiB avail; 767 B/s rd, 0 op/s 2024-03-30T14:11:51.828 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:51 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T14:11:51.828 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:51 smithi099 ceph-mon[143401]: pgmap v301: 161 pgs: 161 active+clean; 585 KiB data, 265 MiB used, 715 GiB / 715 GiB avail; 767 B/s rd, 0 op/s 2024-03-30T14:11:51.828 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:51 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T14:11:52.247 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:51 smithi181 ceph-mon[115276]: pgmap v301: 161 pgs: 161 active+clean; 585 KiB data, 265 MiB used, 715 GiB / 715 GiB avail; 767 B/s rd, 0 op/s 2024-03-30T14:11:52.247 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:51 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T14:11:54.077 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:53 smithi099 ceph-mon[137093]: pgmap v302: 161 pgs: 161 active+clean; 585 KiB data, 265 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T14:11:54.078 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:53 smithi099 ceph-mon[143401]: pgmap v302: 161 pgs: 161 active+clean; 585 KiB data, 265 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T14:11:54.247 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:53 smithi181 ceph-mon[115276]: pgmap v302: 161 pgs: 161 active+clean; 585 KiB data, 265 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T14:11:55.077 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:54 smithi099 ceph-mon[137093]: pgmap v303: 161 pgs: 161 active+clean; 585 KiB data, 265 MiB used, 715 GiB / 715 GiB avail; 767 B/s rd, 0 op/s 2024-03-30T14:11:55.078 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:54 smithi099 ceph-mon[143401]: pgmap v303: 161 pgs: 161 active+clean; 585 KiB data, 265 MiB used, 715 GiB / 715 GiB avail; 767 B/s rd, 0 op/s 2024-03-30T14:11:55.078 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 14:11:54 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[71049]: ::ffff:172.21.15.181 - - [30/Mar/2024:14:11:54] "GET /metrics HTTP/1.1" 200 38412 "" "Prometheus/2.43.0" 2024-03-30T14:11:55.246 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:54 smithi181 ceph-mon[115276]: pgmap v303: 161 pgs: 161 active+clean; 585 KiB data, 265 MiB used, 715 GiB / 715 GiB avail; 767 B/s rd, 0 op/s 2024-03-30T14:11:57.496 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:57 smithi181 ceph-mon[115276]: pgmap v304: 161 pgs: 161 active+clean; 585 KiB data, 265 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T14:11:57.577 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:57 smithi099 ceph-mon[137093]: pgmap v304: 161 pgs: 161 active+clean; 585 KiB data, 265 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T14:11:57.578 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:57 smithi099 ceph-mon[143401]: pgmap v304: 161 pgs: 161 active+clean; 585 KiB data, 265 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T14:11:59.479 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:59 smithi099 ceph-mon[137093]: pgmap v305: 161 pgs: 161 active+clean; 585 KiB data, 265 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T14:11:59.479 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:11:59 smithi099 ceph-mon[137093]: from='client.25136 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T14:11:59.479 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:59 smithi099 ceph-mon[143401]: pgmap v305: 161 pgs: 161 active+clean; 585 KiB data, 265 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T14:11:59.480 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:11:59 smithi099 ceph-mon[143401]: from='client.25136 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T14:11:59.496 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:59 smithi181 ceph-mon[115276]: pgmap v305: 161 pgs: 161 active+clean; 585 KiB data, 265 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T14:11:59.496 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:11:59 smithi181 ceph-mon[115276]: from='client.25136 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T14:12:00.707 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:12:00 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:12:00.707 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:12:00 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:12:00.707 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:12:00 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:12:00.827 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:12:00 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:12:00.828 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:12:00 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:12:00.828 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:12:00 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:12:00.828 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:12:00 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:12:00.828 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:12:00 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:12:00.828 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:12:00 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:12:01.828 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:12:01 smithi099 ceph-mon[137093]: pgmap v306: 161 pgs: 161 active+clean; 585 KiB data, 265 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T14:12:01.828 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:12:01 smithi099 ceph-mon[143401]: pgmap v306: 161 pgs: 161 active+clean; 585 KiB data, 265 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T14:12:01.940 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:12:01 smithi181 ceph-mon[115276]: pgmap v306: 161 pgs: 161 active+clean; 585 KiB data, 265 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T14:12:02.343 DEBUG:teuthology.orchestra.run.smithi099:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 98ebaeb8-ee99-11ee-b647-cb9ed24678a4 -e sha1=4e50bbcdd1630c7760b708f3a5b4d38a121e66cb -- bash -c 'ceph orch ps' 2024-03-30T14:12:02.908 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:12:02 smithi099 ceph-mon[137093]: from='client.54765 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T14:12:02.908 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:12:02 smithi099 ceph-mon[143401]: from='client.54765 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T14:12:02.996 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:12:02 smithi181 ceph-mon[115276]: from='client.54765 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T14:12:03.686 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:12:03 smithi099 ceph-mon[137093]: pgmap v307: 161 pgs: 161 active+clean; 585 KiB data, 265 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T14:12:03.687 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:12:03 smithi099 ceph-mon[143401]: pgmap v307: 161 pgs: 161 active+clean; 585 KiB data, 265 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T14:12:03.746 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:12:03 smithi181 ceph-mon[115276]: pgmap v307: 161 pgs: 161 active+clean; 585 KiB data, 265 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T14:12:04.420 INFO:teuthology.orchestra.run.smithi099.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-03-30T14:12:04.420 INFO:teuthology.orchestra.run.smithi099.stdout:agent.smithi099 smithi099 running 17s ago 40m - - 2024-03-30T14:12:04.420 INFO:teuthology.orchestra.run.smithi099.stdout:agent.smithi181 smithi181 running 4s ago 40m - - 2024-03-30T14:12:04.420 INFO:teuthology.orchestra.run.smithi099.stdout:alertmanager.a smithi099 *:9093,9094 running (10m) 17s ago 34m 26.9M - 0.25.0 c8568f914cd2 08735152b67d 2024-03-30T14:12:04.420 INFO:teuthology.orchestra.run.smithi099.stdout:grafana.a smithi181 *:3000 running (10m) 4s ago 34m 78.9M - 9.4.12 2bacad6d85d8 d599aa7730d6 2024-03-30T14:12:04.420 INFO:teuthology.orchestra.run.smithi099.stdout:iscsi.foo.smithi099.qyjuvr smithi099 running (13m) 17s ago 33m 61.9M - 3.5 e1d6a67b021e 2f859af6bc2a 2024-03-30T14:12:04.420 INFO:teuthology.orchestra.run.smithi099.stdout:mgr.x smithi181 *:8443,9283,8765 running (12m) 4s ago 39m 452M - 19.0.0-1967-g4e50bbcd b0c4478f1d83 f269106f7913 2024-03-30T14:12:04.420 INFO:teuthology.orchestra.run.smithi099.stdout:mgr.y smithi099 *:8443,9283,8765 running (23m) 17s ago 41m 536M - 19.0.0-1967-g4e50bbcd b0c4478f1d83 0d464b8c1d18 2024-03-30T14:12:04.421 INFO:teuthology.orchestra.run.smithi099.stdout:mon.a smithi099 running (8m) 17s ago 41m 68.2M 2048M 19.0.0-1967-g4e50bbcd b0c4478f1d83 f19388464dfd 2024-03-30T14:12:04.421 INFO:teuthology.orchestra.run.smithi099.stdout:mon.b smithi181 running (9m) 4s ago 39m 64.1M 2048M 19.0.0-1967-g4e50bbcd b0c4478f1d83 0468ed087cdd 2024-03-30T14:12:04.421 INFO:teuthology.orchestra.run.smithi099.stdout:mon.c smithi099 running (7m) 17s ago 40m 56.3M 2048M 19.0.0-1967-g4e50bbcd b0c4478f1d83 731056a2fea6 2024-03-30T14:12:04.421 INFO:teuthology.orchestra.run.smithi099.stdout:node-exporter.a smithi099 *:9100 running (11m) 17s ago 35m 16.5M - 1.5.0 0da6a335fe13 4a3f1f6e7068 2024-03-30T14:12:04.421 INFO:teuthology.orchestra.run.smithi099.stdout:node-exporter.b smithi181 *:9100 running (11m) 4s ago 35m 16.6M - 1.5.0 0da6a335fe13 acea317b5f5d 2024-03-30T14:12:04.421 INFO:teuthology.orchestra.run.smithi099.stdout:osd.0 smithi099 running (6m) 17s ago 39m 61.3M 4096M 19.0.0-1967-g4e50bbcd b0c4478f1d83 d97d48cb3314 2024-03-30T14:12:04.421 INFO:teuthology.orchestra.run.smithi099.stdout:osd.1 smithi099 running (5m) 17s ago 38m 65.3M 4096M 19.0.0-1967-g4e50bbcd b0c4478f1d83 a843295ce83b 2024-03-30T14:12:04.421 INFO:teuthology.orchestra.run.smithi099.stdout:osd.2 smithi099 running (4m) 17s ago 38m 50.3M 4096M 19.0.0-1967-g4e50bbcd b0c4478f1d83 18304adfb0d0 2024-03-30T14:12:04.421 INFO:teuthology.orchestra.run.smithi099.stdout:osd.3 smithi099 running (3m) 17s ago 38m 53.0M 4096M 19.0.0-1967-g4e50bbcd b0c4478f1d83 9b38d79f070e 2024-03-30T14:12:04.421 INFO:teuthology.orchestra.run.smithi099.stdout:osd.4 smithi181 running (3m) 4s ago 37m 59.5M 4096M 19.0.0-1967-g4e50bbcd b0c4478f1d83 b9078af21e45 2024-03-30T14:12:04.421 INFO:teuthology.orchestra.run.smithi099.stdout:osd.5 smithi181 running (2m) 4s ago 37m 55.8M 4096M 19.0.0-1967-g4e50bbcd b0c4478f1d83 bba176b8db2c 2024-03-30T14:12:04.421 INFO:teuthology.orchestra.run.smithi099.stdout:osd.6 smithi181 running (2m) 4s ago 36m 47.3M 4096M 19.0.0-1967-g4e50bbcd b0c4478f1d83 4a29dfeb4b16 2024-03-30T14:12:04.421 INFO:teuthology.orchestra.run.smithi099.stdout:osd.7 smithi181 running (112s) 4s ago 36m 53.9M 4096M 19.0.0-1967-g4e50bbcd b0c4478f1d83 7940232eb4fe 2024-03-30T14:12:04.422 INFO:teuthology.orchestra.run.smithi099.stdout:prometheus.a smithi181 *:9095 running (11m) 4s ago 35m 70.5M - 2.43.0 a07b618ecd1d 004088bdf70e 2024-03-30T14:12:04.422 INFO:teuthology.orchestra.run.smithi099.stdout:rgw.foo.smithi099.fxjbmp smithi099 *:8000 running (34s) 17s ago 33m 77.5M - 19.0.0-1967-g4e50bbcd b0c4478f1d83 d4ba347d41c8 2024-03-30T14:12:04.422 INFO:teuthology.orchestra.run.smithi099.stdout:rgw.foo.smithi181.wfqwti smithi181 *:8000 running (54s) 4s ago 33m 76.9M - 19.0.0-1967-g4e50bbcd b0c4478f1d83 d341398e6f10 2024-03-30T14:12:05.077 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 14:12:04 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[71049]: ::ffff:172.21.15.181 - - [30/Mar/2024:14:12:04] "GET /metrics HTTP/1.1" 200 38412 "" "Prometheus/2.43.0" 2024-03-30T14:12:05.126 DEBUG:teuthology.orchestra.run.smithi099:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 98ebaeb8-ee99-11ee-b647-cb9ed24678a4 -e sha1=4e50bbcdd1630c7760b708f3a5b4d38a121e66cb -- bash -c 'ceph versions | jq -e '"'"'.rgw | length == 1'"'"'' 2024-03-30T14:12:05.781 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:12:05 smithi099 ceph-mon[137093]: pgmap v308: 161 pgs: 161 active+clean; 585 KiB data, 265 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T14:12:05.781 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:12:05 smithi099 ceph-mon[137093]: from='client.64783 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T14:12:05.781 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:12:05 smithi099 ceph-mon[143401]: pgmap v308: 161 pgs: 161 active+clean; 585 KiB data, 265 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T14:12:05.781 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:12:05 smithi099 ceph-mon[143401]: from='client.64783 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T14:12:05.996 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:12:05 smithi181 ceph-mon[115276]: pgmap v308: 161 pgs: 161 active+clean; 585 KiB data, 265 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T14:12:05.997 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:12:05 smithi181 ceph-mon[115276]: from='client.64783 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T14:12:07.167 INFO:teuthology.orchestra.run.smithi099.stdout:true 2024-03-30T14:12:07.828 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:12:07 smithi099 ceph-mon[137093]: pgmap v309: 161 pgs: 161 active+clean; 585 KiB data, 265 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T14:12:07.828 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:12:07 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T14:12:07.828 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:12:07 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:12:07.828 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:12:07 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:12:07.828 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:12:07 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:12:07.828 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:12:07 smithi099 ceph-mon[137093]: from='client.? 172.21.15.99:0/228870157' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:12:07.828 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:12:07 smithi099 ceph-mon[143401]: pgmap v309: 161 pgs: 161 active+clean; 585 KiB data, 265 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T14:12:07.828 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:12:07 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T14:12:07.828 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:12:07 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:12:07.829 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:12:07 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:12:07.829 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:12:07 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:12:07.829 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:12:07 smithi099 ceph-mon[143401]: from='client.? 172.21.15.99:0/228870157' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:12:07.878 DEBUG:teuthology.orchestra.run.smithi099:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 98ebaeb8-ee99-11ee-b647-cb9ed24678a4 -e sha1=4e50bbcdd1630c7760b708f3a5b4d38a121e66cb -- bash -c 'ceph versions | jq -e '"'"'.rgw | keys'"'"' | grep $sha1' 2024-03-30T14:12:07.997 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:12:07 smithi181 ceph-mon[115276]: pgmap v309: 161 pgs: 161 active+clean; 585 KiB data, 265 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T14:12:07.997 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:12:07 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T14:12:07.997 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:12:07 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:12:07.997 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:12:07 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:12:07.997 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:12:07 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:12:07.997 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:12:07 smithi181 ceph-mon[115276]: from='client.? 172.21.15.99:0/228870157' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:12:09.688 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:12:09 smithi099 ceph-mon[137093]: pgmap v310: 161 pgs: 161 active+clean; 585 KiB data, 265 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T14:12:09.689 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:12:09 smithi099 ceph-mon[137093]: from='client.25136 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T14:12:09.689 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:12:09 smithi099 ceph-mon[143401]: pgmap v310: 161 pgs: 161 active+clean; 585 KiB data, 265 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T14:12:09.689 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:12:09 smithi099 ceph-mon[143401]: from='client.25136 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T14:12:09.996 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:12:09 smithi181 ceph-mon[115276]: pgmap v310: 161 pgs: 161 active+clean; 585 KiB data, 265 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T14:12:09.996 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:12:09 smithi181 ceph-mon[115276]: from='client.25136 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T14:12:10.227 INFO:teuthology.orchestra.run.smithi099.stdout: "ceph version 19.0.0-1967-g4e50bbcd (4e50bbcdd1630c7760b708f3a5b4d38a121e66cb) squid (dev)" 2024-03-30T14:12:10.996 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:12:10 smithi181 ceph-mon[115276]: from='client.? 172.21.15.99:0/2222152798' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:12:11.077 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:12:10 smithi099 ceph-mon[137093]: from='client.? 172.21.15.99:0/2222152798' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:12:11.078 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:12:10 smithi099 ceph-mon[143401]: from='client.? 172.21.15.99:0/2222152798' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:12:11.463 DEBUG:teuthology.orchestra.run.smithi099:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 98ebaeb8-ee99-11ee-b647-cb9ed24678a4 -e sha1=4e50bbcdd1630c7760b708f3a5b4d38a121e66cb -- bash -c 'ceph orch upgrade status' 2024-03-30T14:12:11.728 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:12:11 smithi099 ceph-mon[137093]: pgmap v311: 161 pgs: 161 active+clean; 585 KiB data, 265 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T14:12:11.728 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:12:11 smithi099 ceph-mon[143401]: pgmap v311: 161 pgs: 161 active+clean; 585 KiB data, 265 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T14:12:11.996 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:12:11 smithi181 ceph-mon[115276]: pgmap v311: 161 pgs: 161 active+clean; 585 KiB data, 265 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T14:12:13.746 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:12:13 smithi181 ceph-mon[115276]: pgmap v312: 161 pgs: 161 active+clean; 585 KiB data, 265 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T14:12:13.991 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:12:13 smithi099 ceph-mon[137093]: pgmap v312: 161 pgs: 161 active+clean; 585 KiB data, 265 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T14:12:13.992 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:12:13 smithi099 ceph-mon[143401]: pgmap v312: 161 pgs: 161 active+clean; 585 KiB data, 265 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T14:12:15.078 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 14:12:14 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[71049]: ::ffff:172.21.15.181 - - [30/Mar/2024:14:12:14] "GET /metrics HTTP/1.1" 200 38411 "" "Prometheus/2.43.0" 2024-03-30T14:12:15.160 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-03-30T14:12:15.161 INFO:teuthology.orchestra.run.smithi099.stdout: "target_image": null, 2024-03-30T14:12:15.161 INFO:teuthology.orchestra.run.smithi099.stdout: "in_progress": false, 2024-03-30T14:12:15.161 INFO:teuthology.orchestra.run.smithi099.stdout: "which": "", 2024-03-30T14:12:15.161 INFO:teuthology.orchestra.run.smithi099.stdout: "services_complete": [], 2024-03-30T14:12:15.161 INFO:teuthology.orchestra.run.smithi099.stdout: "progress": null, 2024-03-30T14:12:15.161 INFO:teuthology.orchestra.run.smithi099.stdout: "message": "", 2024-03-30T14:12:15.161 INFO:teuthology.orchestra.run.smithi099.stdout: "is_paused": false 2024-03-30T14:12:15.161 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-03-30T14:12:15.827 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:12:15 smithi099 ceph-mon[137093]: pgmap v313: 161 pgs: 161 active+clean; 585 KiB data, 265 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T14:12:15.828 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:12:15 smithi099 ceph-mon[143401]: pgmap v313: 161 pgs: 161 active+clean; 585 KiB data, 265 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T14:12:15.917 DEBUG:teuthology.orchestra.run.smithi099:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 98ebaeb8-ee99-11ee-b647-cb9ed24678a4 -e sha1=4e50bbcdd1630c7760b708f3a5b4d38a121e66cb -- bash -c 'ceph health detail' 2024-03-30T14:12:15.996 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:12:15 smithi181 ceph-mon[115276]: pgmap v313: 161 pgs: 161 active+clean; 585 KiB data, 265 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T14:12:16.827 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:12:16 smithi099 ceph-mon[137093]: from='client.54789 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T14:12:16.828 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:12:16 smithi099 ceph-mon[143401]: from='client.54789 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T14:12:16.996 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:12:16 smithi181 ceph-mon[115276]: from='client.54789 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T14:12:17.828 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:12:17 smithi099 ceph-mon[137093]: pgmap v314: 161 pgs: 161 active+clean; 585 KiB data, 265 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T14:12:17.828 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:12:17 smithi099 ceph-mon[143401]: pgmap v314: 161 pgs: 161 active+clean; 585 KiB data, 265 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T14:12:17.973 INFO:teuthology.orchestra.run.smithi099.stdout:HEALTH_OK 2024-03-30T14:12:17.996 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:12:17 smithi181 ceph-mon[115276]: pgmap v314: 161 pgs: 161 active+clean; 585 KiB data, 265 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T14:12:18.773 DEBUG:teuthology.orchestra.run.smithi099:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 98ebaeb8-ee99-11ee-b647-cb9ed24678a4 -e sha1=4e50bbcdd1630c7760b708f3a5b4d38a121e66cb -- bash -c 'ceph orch upgrade start --image quay.ceph.io/ceph-ci/ceph:$sha1' 2024-03-30T14:12:18.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:12:18 smithi181 ceph-mon[115276]: from='client.? 172.21.15.99:0/2715672640' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-03-30T14:12:19.077 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:12:18 smithi099 ceph-mon[137093]: from='client.? 172.21.15.99:0/2715672640' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-03-30T14:12:19.078 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:12:18 smithi099 ceph-mon[143401]: from='client.? 172.21.15.99:0/2715672640' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-03-30T14:12:19.897 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:12:19 smithi181 ceph-mon[115276]: pgmap v315: 161 pgs: 161 active+clean; 585 KiB data, 265 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T14:12:19.897 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:12:19 smithi181 ceph-mon[115276]: from='client.25136 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T14:12:20.077 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:12:19 smithi099 ceph-mon[137093]: pgmap v315: 161 pgs: 161 active+clean; 585 KiB data, 265 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T14:12:20.077 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:12:19 smithi099 ceph-mon[137093]: from='client.25136 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T14:12:20.078 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:12:19 smithi099 ceph-mon[143401]: pgmap v315: 161 pgs: 161 active+clean; 585 KiB data, 265 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T14:12:20.078 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:12:19 smithi099 ceph-mon[143401]: from='client.25136 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T14:12:20.875 INFO:teuthology.orchestra.run.smithi099.stdout:Initiating upgrade to quay.ceph.io/ceph-ci/ceph:4e50bbcdd1630c7760b708f3a5b4d38a121e66cb 2024-03-30T14:12:20.996 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:12:20 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:12:20.997 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:12:20 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:12:20.997 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:12:20 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:12:21.077 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:12:20 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:12:21.077 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:12:20 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:12:21.078 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:12:20 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:12:21.078 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:12:20 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:12:21.078 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:12:20 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:12:21.078 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:12:20 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:12:21.542 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-03-30T14:12:21.554 INFO:tasks.cephadm:Running commands on role mon.a host ubuntu@smithi099.front.sepia.ceph.com 2024-03-30T14:12:21.555 DEBUG:teuthology.orchestra.run.smithi099:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 98ebaeb8-ee99-11ee-b647-cb9ed24678a4 -e sha1=4e50bbcdd1630c7760b708f3a5b4d38a121e66cb -- bash -c 'while ceph orch upgrade status | jq '"'"'.in_progress'"'"' | grep true && ! ceph orch upgrade status | jq '"'"'.message'"'"' | grep Error ; do ceph orch ps ; ceph versions ; ceph orch upgrade status ; ceph health detail ; sleep 30 ; done' 2024-03-30T14:12:21.745 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:12:21 smithi181 ceph-mon[115276]: pgmap v316: 161 pgs: 161 active+clean; 585 KiB data, 265 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T14:12:21.746 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:12:21 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:12:21.746 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:12:21 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:12:21.746 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:12:21 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:12:21.746 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:12:21 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:12:21.931 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:12:21 smithi099 ceph-mon[143401]: pgmap v316: 161 pgs: 161 active+clean; 585 KiB data, 265 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T14:12:21.931 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:12:21 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:12:21.932 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:12:21 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:12:21.932 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:12:21 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:12:21.932 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:12:21 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:12:21.932 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:12:21 smithi099 ceph-mon[137093]: pgmap v316: 161 pgs: 161 active+clean; 585 KiB data, 265 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T14:12:21.932 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:12:21 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:12:21.932 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:12:21 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:12:21.932 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:12:21 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:12:21.932 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:12:21 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:12:22.925 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:12:22 smithi181 ceph-mon[115276]: from='client.64813 -' entity='client.admin' cmd=[{"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:4e50bbcdd1630c7760b708f3a5b4d38a121e66cb", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T14:12:22.925 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:12:22 smithi181 ceph-mon[115276]: Upgrade: Started with target quay.ceph.io/ceph-ci/ceph:4e50bbcdd1630c7760b708f3a5b4d38a121e66cb 2024-03-30T14:12:22.925 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:12:22 smithi181 ceph-mon[115276]: Upgrade: First pull of quay.ceph.io/ceph-ci/ceph:4e50bbcdd1630c7760b708f3a5b4d38a121e66cb 2024-03-30T14:12:22.925 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:12:22 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T14:12:22.970 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:12:22 smithi099 ceph-mon[137093]: from='client.64813 -' entity='client.admin' cmd=[{"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:4e50bbcdd1630c7760b708f3a5b4d38a121e66cb", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T14:12:22.970 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:12:22 smithi099 ceph-mon[137093]: Upgrade: Started with target quay.ceph.io/ceph-ci/ceph:4e50bbcdd1630c7760b708f3a5b4d38a121e66cb 2024-03-30T14:12:22.970 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:12:22 smithi099 ceph-mon[137093]: Upgrade: First pull of quay.ceph.io/ceph-ci/ceph:4e50bbcdd1630c7760b708f3a5b4d38a121e66cb 2024-03-30T14:12:22.970 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:12:22 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T14:12:22.971 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:12:22 smithi099 ceph-mon[143401]: from='client.64813 -' entity='client.admin' cmd=[{"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:4e50bbcdd1630c7760b708f3a5b4d38a121e66cb", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T14:12:22.971 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:12:22 smithi099 ceph-mon[143401]: Upgrade: Started with target quay.ceph.io/ceph-ci/ceph:4e50bbcdd1630c7760b708f3a5b4d38a121e66cb 2024-03-30T14:12:22.971 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:12:22 smithi099 ceph-mon[143401]: Upgrade: First pull of quay.ceph.io/ceph-ci/ceph:4e50bbcdd1630c7760b708f3a5b4d38a121e66cb 2024-03-30T14:12:22.971 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:12:22 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T14:12:23.828 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:12:23 smithi099 ceph-mon[137093]: pgmap v317: 161 pgs: 161 active+clean; 585 KiB data, 265 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T14:12:23.828 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:12:23 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:12:23.828 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:12:23 smithi099 ceph-mon[137093]: Upgrade: Target is version 19.0.0-1967-g4e50bbcd (squid) 2024-03-30T14:12:23.828 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:12:23 smithi099 ceph-mon[137093]: Upgrade: Target container is quay.ceph.io/ceph-ci/ceph:4e50bbcdd1630c7760b708f3a5b4d38a121e66cb, digests ['quay.ceph.io/ceph-ci/ceph@sha256:8f3809717761e681477c3ef1d8d2c03114aee2c597cd7380b93b8c10f47fcb5d'] 2024-03-30T14:12:23.828 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:12:23 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:12:23.828 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:12:23 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:12:23.828 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:12:23 smithi099 ceph-mon[137093]: Upgrade: Setting container_image for all mgr 2024-03-30T14:12:23.828 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:12:23 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:12:23.829 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:12:23 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:12:23.829 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:12:23 smithi099 ceph-mon[137093]: Upgrade: Setting container_image for all mon 2024-03-30T14:12:23.829 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:12:23 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:12:23.829 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:12:23 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:12:23.829 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:12:23 smithi099 ceph-mon[137093]: Upgrade: Setting container_image for all crash 2024-03-30T14:12:23.829 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:12:23 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:12:23.829 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:12:23 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:12:23.829 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:12:23 smithi099 ceph-mon[137093]: Upgrade: Setting container_image for all osd 2024-03-30T14:12:23.829 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:12:23 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:12:23.829 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:12:23 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:12:23.829 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:12:23 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:12:23.829 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:12:23 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:12:23.829 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:12:23 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:12:23.829 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:12:23 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:12:23.829 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:12:23 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:12:23.830 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:12:23 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:12:23.830 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:12:23 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:12:23.830 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:12:23 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:12:23.830 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:12:23 smithi099 ceph-mon[143401]: pgmap v317: 161 pgs: 161 active+clean; 585 KiB data, 265 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T14:12:23.830 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:12:23 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:12:23.830 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:12:23 smithi099 ceph-mon[143401]: Upgrade: Target is version 19.0.0-1967-g4e50bbcd (squid) 2024-03-30T14:12:23.830 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:12:23 smithi099 ceph-mon[143401]: Upgrade: Target container is quay.ceph.io/ceph-ci/ceph:4e50bbcdd1630c7760b708f3a5b4d38a121e66cb, digests ['quay.ceph.io/ceph-ci/ceph@sha256:8f3809717761e681477c3ef1d8d2c03114aee2c597cd7380b93b8c10f47fcb5d'] 2024-03-30T14:12:23.830 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:12:23 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:12:23.830 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:12:23 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:12:23.830 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:12:23 smithi099 ceph-mon[143401]: Upgrade: Setting container_image for all mgr 2024-03-30T14:12:23.830 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:12:23 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:12:23.830 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:12:23 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:12:23.831 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:12:23 smithi099 ceph-mon[143401]: Upgrade: Setting container_image for all mon 2024-03-30T14:12:23.831 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:12:23 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:12:23.831 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:12:23 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:12:23.831 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:12:23 smithi099 ceph-mon[143401]: Upgrade: Setting container_image for all crash 2024-03-30T14:12:23.831 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:12:23 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:12:23.831 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:12:23 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:12:23.831 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:12:23 smithi099 ceph-mon[143401]: Upgrade: Setting container_image for all osd 2024-03-30T14:12:23.831 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:12:23 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:12:23.831 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:12:23 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:12:23.831 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:12:23 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:12:23.831 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:12:23 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:12:23.831 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:12:23 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:12:23.831 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:12:23 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:12:23.831 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:12:23 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:12:23.831 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:12:23 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:12:23.831 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:12:23 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:12:23.832 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:12:23 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:12:23.997 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:12:23 smithi181 ceph-mon[115276]: pgmap v317: 161 pgs: 161 active+clean; 585 KiB data, 265 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T14:12:23.997 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:12:23 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:12:23.997 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:12:23 smithi181 ceph-mon[115276]: Upgrade: Target is version 19.0.0-1967-g4e50bbcd (squid) 2024-03-30T14:12:23.997 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:12:23 smithi181 ceph-mon[115276]: Upgrade: Target container is quay.ceph.io/ceph-ci/ceph:4e50bbcdd1630c7760b708f3a5b4d38a121e66cb, digests ['quay.ceph.io/ceph-ci/ceph@sha256:8f3809717761e681477c3ef1d8d2c03114aee2c597cd7380b93b8c10f47fcb5d'] 2024-03-30T14:12:23.997 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:12:23 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-30T14:12:23.998 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:12:23 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:12:23.998 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:12:23 smithi181 ceph-mon[115276]: Upgrade: Setting container_image for all mgr 2024-03-30T14:12:23.998 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:12:23 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:12:23.998 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:12:23 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:12:23.998 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:12:23 smithi181 ceph-mon[115276]: Upgrade: Setting container_image for all mon 2024-03-30T14:12:23.998 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:12:23 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:12:23.998 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:12:23 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:12:23.998 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:12:23 smithi181 ceph-mon[115276]: Upgrade: Setting container_image for all crash 2024-03-30T14:12:23.998 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:12:23 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:12:23.998 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:12:23 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:12:23.998 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:12:23 smithi181 ceph-mon[115276]: Upgrade: Setting container_image for all osd 2024-03-30T14:12:23.998 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:12:23 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:12:23.998 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:12:23 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:12:23.998 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:12:23 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:12:23.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:12:23 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:12:23.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:12:23 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:12:23.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:12:23 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:12:23.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:12:23 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:12:23.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:12:23 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:12:23.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:12:23 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:12:23.999 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:12:23 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:12:25.074 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:12:24 smithi099 ceph-mon[137093]: Upgrade: Setting container_image for all mds 2024-03-30T14:12:25.075 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:12:24 smithi099 ceph-mon[137093]: Upgrade: Setting container_image for all rgw 2024-03-30T14:12:25.075 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:12:24 smithi099 ceph-mon[137093]: Upgrade: Setting container_image for all rbd-mirror 2024-03-30T14:12:25.075 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:12:24 smithi099 ceph-mon[137093]: Upgrade: Setting container_image for all cephfs-mirror 2024-03-30T14:12:25.075 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:12:24 smithi099 ceph-mon[137093]: Upgrade: Setting container_image for all ceph-exporter 2024-03-30T14:12:25.075 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 14:12:24 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[71049]: ::ffff:172.21.15.181 - - [30/Mar/2024:14:12:24] "GET /metrics HTTP/1.1" 200 38411 "" "Prometheus/2.43.0" 2024-03-30T14:12:25.075 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:12:24 smithi099 ceph-mon[143401]: Upgrade: Setting container_image for all mds 2024-03-30T14:12:25.075 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:12:24 smithi099 ceph-mon[143401]: Upgrade: Setting container_image for all rgw 2024-03-30T14:12:25.075 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:12:24 smithi099 ceph-mon[143401]: Upgrade: Setting container_image for all rbd-mirror 2024-03-30T14:12:25.076 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:12:24 smithi099 ceph-mon[143401]: Upgrade: Setting container_image for all cephfs-mirror 2024-03-30T14:12:25.076 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:12:24 smithi099 ceph-mon[143401]: Upgrade: Setting container_image for all ceph-exporter 2024-03-30T14:12:25.246 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:12:24 smithi181 ceph-mon[115276]: Upgrade: Setting container_image for all mds 2024-03-30T14:12:25.247 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:12:24 smithi181 ceph-mon[115276]: Upgrade: Setting container_image for all rgw 2024-03-30T14:12:25.247 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:12:24 smithi181 ceph-mon[115276]: Upgrade: Setting container_image for all rbd-mirror 2024-03-30T14:12:25.247 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:12:24 smithi181 ceph-mon[115276]: Upgrade: Setting container_image for all cephfs-mirror 2024-03-30T14:12:25.247 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:12:24 smithi181 ceph-mon[115276]: Upgrade: Setting container_image for all ceph-exporter 2024-03-30T14:12:25.816 INFO:teuthology.orchestra.run.smithi099.stdout:true 2024-03-30T14:12:26.022 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:12:25 smithi099 ceph-mon[137093]: pgmap v318: 161 pgs: 161 active+clean; 585 KiB data, 265 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T14:12:26.022 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:12:25 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:12:26.022 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:12:25 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.iscsi.foo.smithi099.qyjuvr", "caps": ["mon", "profile rbd, allow command \"osd blocklist\", allow command \"config-key get\" with \"key\" prefix \"iscsi/\"", "mgr", "allow command \"service status\"", "osd", "allow rwx"]}]: dispatch 2024-03-30T14:12:26.023 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:12:25 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.iscsi.foo.smithi099.qyjuvr", "caps": ["mon", "profile rbd, allow command \"osd blocklist\", allow command \"config-key get\" with \"key\" prefix \"iscsi/\"", "mgr", "allow command \"service status\"", "osd", "allow rwx"]}]: dispatch 2024-03-30T14:12:26.023 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:12:25 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:12:26.023 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:12:25 smithi099 ceph-mon[143401]: pgmap v318: 161 pgs: 161 active+clean; 585 KiB data, 265 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T14:12:26.023 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:12:25 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:12:26.023 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:12:25 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.iscsi.foo.smithi099.qyjuvr", "caps": ["mon", "profile rbd, allow command \"osd blocklist\", allow command \"config-key get\" with \"key\" prefix \"iscsi/\"", "mgr", "allow command \"service status\"", "osd", "allow rwx"]}]: dispatch 2024-03-30T14:12:26.023 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:12:25 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.iscsi.foo.smithi099.qyjuvr", "caps": ["mon", "profile rbd, allow command \"osd blocklist\", allow command \"config-key get\" with \"key\" prefix \"iscsi/\"", "mgr", "allow command \"service status\"", "osd", "allow rwx"]}]: dispatch 2024-03-30T14:12:26.023 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:12:25 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:12:26.246 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:12:25 smithi181 ceph-mon[115276]: pgmap v318: 161 pgs: 161 active+clean; 585 KiB data, 265 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T14:12:26.246 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:12:25 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:12:26.246 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:12:25 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.iscsi.foo.smithi099.qyjuvr", "caps": ["mon", "profile rbd, allow command \"osd blocklist\", allow command \"config-key get\" with \"key\" prefix \"iscsi/\"", "mgr", "allow command \"service status\"", "osd", "allow rwx"]}]: dispatch 2024-03-30T14:12:26.247 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:12:25 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.iscsi.foo.smithi099.qyjuvr", "caps": ["mon", "profile rbd, allow command \"osd blocklist\", allow command \"config-key get\" with \"key\" prefix \"iscsi/\"", "mgr", "allow command \"service status\"", "osd", "allow rwx"]}]: dispatch 2024-03-30T14:12:26.247 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:12:25 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:12:26.499 INFO:teuthology.orchestra.run.smithi099.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-03-30T14:12:26.499 INFO:teuthology.orchestra.run.smithi099.stdout:agent.smithi099 smithi099 running 19s ago 40m - - 2024-03-30T14:12:26.499 INFO:teuthology.orchestra.run.smithi099.stdout:agent.smithi181 smithi181 running 6s ago 40m - - 2024-03-30T14:12:26.499 INFO:teuthology.orchestra.run.smithi099.stdout:alertmanager.a smithi099 *:9093,9094 running (11m) 19s ago 34m 26.9M - 0.25.0 c8568f914cd2 08735152b67d 2024-03-30T14:12:26.499 INFO:teuthology.orchestra.run.smithi099.stdout:grafana.a smithi181 *:3000 running (10m) 6s ago 34m 78.9M - 9.4.12 2bacad6d85d8 d599aa7730d6 2024-03-30T14:12:26.499 INFO:teuthology.orchestra.run.smithi099.stdout:iscsi.foo.smithi099.qyjuvr smithi099 running (13m) 19s ago 34m 61.9M - 3.5 e1d6a67b021e 2f859af6bc2a 2024-03-30T14:12:26.499 INFO:teuthology.orchestra.run.smithi099.stdout:mgr.x smithi181 *:8443,9283,8765 running (12m) 6s ago 39m 452M - 19.0.0-1967-g4e50bbcd b0c4478f1d83 f269106f7913 2024-03-30T14:12:26.499 INFO:teuthology.orchestra.run.smithi099.stdout:mgr.y smithi099 *:8443,9283,8765 running (23m) 19s ago 41m 536M - 19.0.0-1967-g4e50bbcd b0c4478f1d83 0d464b8c1d18 2024-03-30T14:12:26.499 INFO:teuthology.orchestra.run.smithi099.stdout:mon.a smithi099 running (8m) 19s ago 41m 68.7M 2048M 19.0.0-1967-g4e50bbcd b0c4478f1d83 f19388464dfd 2024-03-30T14:12:26.500 INFO:teuthology.orchestra.run.smithi099.stdout:mon.b smithi181 running (9m) 6s ago 40m 64.3M 2048M 19.0.0-1967-g4e50bbcd b0c4478f1d83 0468ed087cdd 2024-03-30T14:12:26.500 INFO:teuthology.orchestra.run.smithi099.stdout:mon.c smithi099 running (8m) 19s ago 40m 55.0M 2048M 19.0.0-1967-g4e50bbcd b0c4478f1d83 731056a2fea6 2024-03-30T14:12:26.500 INFO:teuthology.orchestra.run.smithi099.stdout:node-exporter.a smithi099 *:9100 running (12m) 19s ago 36m 16.4M - 1.5.0 0da6a335fe13 4a3f1f6e7068 2024-03-30T14:12:26.500 INFO:teuthology.orchestra.run.smithi099.stdout:node-exporter.b smithi181 *:9100 running (12m) 6s ago 35m 16.6M - 1.5.0 0da6a335fe13 acea317b5f5d 2024-03-30T14:12:26.500 INFO:teuthology.orchestra.run.smithi099.stdout:osd.0 smithi099 running (6m) 19s ago 39m 61.5M 4096M 19.0.0-1967-g4e50bbcd b0c4478f1d83 d97d48cb3314 2024-03-30T14:12:26.500 INFO:teuthology.orchestra.run.smithi099.stdout:osd.1 smithi099 running (6m) 19s ago 39m 65.4M 4096M 19.0.0-1967-g4e50bbcd b0c4478f1d83 a843295ce83b 2024-03-30T14:12:26.500 INFO:teuthology.orchestra.run.smithi099.stdout:osd.2 smithi099 running (5m) 19s ago 38m 50.4M 4096M 19.0.0-1967-g4e50bbcd b0c4478f1d83 18304adfb0d0 2024-03-30T14:12:26.500 INFO:teuthology.orchestra.run.smithi099.stdout:osd.3 smithi099 running (4m) 19s ago 38m 53.2M 4096M 19.0.0-1967-g4e50bbcd b0c4478f1d83 9b38d79f070e 2024-03-30T14:12:26.500 INFO:teuthology.orchestra.run.smithi099.stdout:osd.4 smithi181 running (3m) 6s ago 38m 60.1M 4096M 19.0.0-1967-g4e50bbcd b0c4478f1d83 b9078af21e45 2024-03-30T14:12:26.500 INFO:teuthology.orchestra.run.smithi099.stdout:osd.5 smithi181 running (3m) 6s ago 37m 55.7M 4096M 19.0.0-1967-g4e50bbcd b0c4478f1d83 bba176b8db2c 2024-03-30T14:12:26.500 INFO:teuthology.orchestra.run.smithi099.stdout:osd.6 smithi181 running (2m) 6s ago 37m 47.5M 4096M 19.0.0-1967-g4e50bbcd b0c4478f1d83 4a29dfeb4b16 2024-03-30T14:12:26.500 INFO:teuthology.orchestra.run.smithi099.stdout:osd.7 smithi181 running (2m) 6s ago 36m 54.1M 4096M 19.0.0-1967-g4e50bbcd b0c4478f1d83 7940232eb4fe 2024-03-30T14:12:26.500 INFO:teuthology.orchestra.run.smithi099.stdout:prometheus.a smithi181 *:9095 running (11m) 6s ago 36m 70.5M - 2.43.0 a07b618ecd1d 004088bdf70e 2024-03-30T14:12:26.500 INFO:teuthology.orchestra.run.smithi099.stdout:rgw.foo.smithi099.fxjbmp smithi099 *:8000 running (56s) 19s ago 34m 77.7M - 19.0.0-1967-g4e50bbcd b0c4478f1d83 d4ba347d41c8 2024-03-30T14:12:26.500 INFO:teuthology.orchestra.run.smithi099.stdout:rgw.foo.smithi181.wfqwti smithi181 *:8000 running (76s) 6s ago 34m 77.1M - 19.0.0-1967-g4e50bbcd b0c4478f1d83 d341398e6f10 2024-03-30T14:12:26.912 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-03-30T14:12:26.912 INFO:teuthology.orchestra.run.smithi099.stdout: "mon": { 2024-03-30T14:12:26.912 INFO:teuthology.orchestra.run.smithi099.stdout: "ceph version 19.0.0-1967-g4e50bbcd (4e50bbcdd1630c7760b708f3a5b4d38a121e66cb) squid (dev)": 3 2024-03-30T14:12:26.912 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T14:12:26.912 INFO:teuthology.orchestra.run.smithi099.stdout: "mgr": { 2024-03-30T14:12:26.912 INFO:teuthology.orchestra.run.smithi099.stdout: "ceph version 19.0.0-1967-g4e50bbcd (4e50bbcdd1630c7760b708f3a5b4d38a121e66cb) squid (dev)": 2 2024-03-30T14:12:26.912 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T14:12:26.912 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": { 2024-03-30T14:12:26.912 INFO:teuthology.orchestra.run.smithi099.stdout: "ceph version 19.0.0-1967-g4e50bbcd (4e50bbcdd1630c7760b708f3a5b4d38a121e66cb) squid (dev)": 8 2024-03-30T14:12:26.912 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T14:12:26.913 INFO:teuthology.orchestra.run.smithi099.stdout: "rgw": { 2024-03-30T14:12:26.913 INFO:teuthology.orchestra.run.smithi099.stdout: "ceph version 19.0.0-1967-g4e50bbcd (4e50bbcdd1630c7760b708f3a5b4d38a121e66cb) squid (dev)": 2 2024-03-30T14:12:26.913 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T14:12:26.913 INFO:teuthology.orchestra.run.smithi099.stdout: "overall": { 2024-03-30T14:12:26.913 INFO:teuthology.orchestra.run.smithi099.stdout: "ceph version 19.0.0-1967-g4e50bbcd (4e50bbcdd1630c7760b708f3a5b4d38a121e66cb) squid (dev)": 15 2024-03-30T14:12:26.913 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-03-30T14:12:26.913 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-03-30T14:12:27.077 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:12:26 smithi099 ceph-mon[137093]: Upgrade: Updating iscsi.foo.smithi099.qyjuvr 2024-03-30T14:12:27.077 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:12:26 smithi099 ceph-mon[137093]: Deploying daemon iscsi.foo.smithi099.qyjuvr on smithi099 2024-03-30T14:12:27.078 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:12:26 smithi099 ceph-mon[143401]: Upgrade: Updating iscsi.foo.smithi099.qyjuvr 2024-03-30T14:12:27.078 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:12:26 smithi099 ceph-mon[143401]: Deploying daemon iscsi.foo.smithi099.qyjuvr on smithi099 2024-03-30T14:12:27.246 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:12:26 smithi181 ceph-mon[115276]: Upgrade: Updating iscsi.foo.smithi099.qyjuvr 2024-03-30T14:12:27.247 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:12:26 smithi181 ceph-mon[115276]: Deploying daemon iscsi.foo.smithi099.qyjuvr on smithi099 2024-03-30T14:12:27.287 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-03-30T14:12:27.287 INFO:teuthology.orchestra.run.smithi099.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph:4e50bbcdd1630c7760b708f3a5b4d38a121e66cb", 2024-03-30T14:12:27.287 INFO:teuthology.orchestra.run.smithi099.stdout: "in_progress": true, 2024-03-30T14:12:27.288 INFO:teuthology.orchestra.run.smithi099.stdout: "which": "Upgrading all daemon types on all hosts", 2024-03-30T14:12:27.288 INFO:teuthology.orchestra.run.smithi099.stdout: "services_complete": [ 2024-03-30T14:12:27.288 INFO:teuthology.orchestra.run.smithi099.stdout: "mon", 2024-03-30T14:12:27.288 INFO:teuthology.orchestra.run.smithi099.stdout: "mgr", 2024-03-30T14:12:27.288 INFO:teuthology.orchestra.run.smithi099.stdout: "rgw", 2024-03-30T14:12:27.288 INFO:teuthology.orchestra.run.smithi099.stdout: "osd" 2024-03-30T14:12:27.288 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-03-30T14:12:27.288 INFO:teuthology.orchestra.run.smithi099.stdout: "progress": "15/21 daemons upgraded", 2024-03-30T14:12:27.288 INFO:teuthology.orchestra.run.smithi099.stdout: "message": "Currently upgrading iscsi daemons", 2024-03-30T14:12:27.288 INFO:teuthology.orchestra.run.smithi099.stdout: "is_paused": false 2024-03-30T14:12:27.288 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-03-30T14:12:27.685 INFO:teuthology.orchestra.run.smithi099.stdout:HEALTH_OK 2024-03-30T14:12:28.077 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:12:27 smithi099 ceph-mon[137093]: from='client.64819 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T14:12:28.078 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:12:27 smithi099 ceph-mon[137093]: pgmap v319: 161 pgs: 161 active+clean; 585 KiB data, 265 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T14:12:28.078 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:12:27 smithi099 ceph-mon[137093]: from='client.64825 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T14:12:28.078 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:12:27 smithi099 ceph-mon[137093]: from='client.64831 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T14:12:28.078 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:12:27 smithi099 ceph-mon[137093]: from='client.? 172.21.15.99:0/2877290934' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:12:28.078 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:12:27 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:12:28.078 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:12:27 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:12:28.078 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:12:27 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:12:28.078 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:12:27 smithi099 ceph-mon[137093]: from='client.? 172.21.15.99:0/445238184' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-03-30T14:12:28.078 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:12:27 smithi099 ceph-mon[143401]: from='client.64819 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T14:12:28.078 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:12:27 smithi099 ceph-mon[143401]: pgmap v319: 161 pgs: 161 active+clean; 585 KiB data, 265 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T14:12:28.078 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:12:27 smithi099 ceph-mon[143401]: from='client.64825 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T14:12:28.079 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:12:27 smithi099 ceph-mon[143401]: from='client.64831 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T14:12:28.079 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:12:27 smithi099 ceph-mon[143401]: from='client.? 172.21.15.99:0/2877290934' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:12:28.079 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:12:27 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:12:28.079 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:12:27 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:12:28.079 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:12:27 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:12:28.079 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:12:27 smithi099 ceph-mon[143401]: from='client.? 172.21.15.99:0/445238184' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-03-30T14:12:28.246 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:12:27 smithi181 ceph-mon[115276]: from='client.64819 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T14:12:28.247 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:12:27 smithi181 ceph-mon[115276]: pgmap v319: 161 pgs: 161 active+clean; 585 KiB data, 265 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T14:12:28.247 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:12:27 smithi181 ceph-mon[115276]: from='client.64825 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T14:12:28.247 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:12:27 smithi181 ceph-mon[115276]: from='client.64831 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T14:12:28.247 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:12:27 smithi181 ceph-mon[115276]: from='client.? 172.21.15.99:0/2877290934' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:12:28.247 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:12:27 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:12:28.247 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:12:27 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:12:28.247 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:12:27 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:12:28.247 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:12:27 smithi181 ceph-mon[115276]: from='client.? 172.21.15.99:0/445238184' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-03-30T14:12:29.077 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:12:28 smithi099 ceph-mon[137093]: from='client.54831 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T14:12:29.078 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:12:28 smithi099 ceph-mon[143401]: from='client.54831 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T14:12:29.246 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:12:28 smithi181 ceph-mon[115276]: from='client.54831 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T14:12:30.077 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:12:29 smithi099 ceph-mon[143401]: pgmap v320: 161 pgs: 161 active+clean; 585 KiB data, 265 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T14:12:30.078 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:12:29 smithi099 ceph-mon[143401]: from='client.25136 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T14:12:30.078 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:12:29 smithi099 ceph-mon[137093]: pgmap v320: 161 pgs: 161 active+clean; 585 KiB data, 265 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T14:12:30.078 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:12:29 smithi099 ceph-mon[137093]: from='client.25136 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T14:12:30.246 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:12:29 smithi181 ceph-mon[115276]: pgmap v320: 161 pgs: 161 active+clean; 585 KiB data, 265 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T14:12:30.246 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:12:29 smithi181 ceph-mon[115276]: from='client.25136 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T14:12:32.077 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:12:31 smithi099 ceph-mon[137093]: pgmap v321: 161 pgs: 161 active+clean; 585 KiB data, 265 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T14:12:32.078 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:12:31 smithi099 ceph-mon[143401]: pgmap v321: 161 pgs: 161 active+clean; 585 KiB data, 265 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T14:12:32.246 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:12:31 smithi181 ceph-mon[115276]: pgmap v321: 161 pgs: 161 active+clean; 585 KiB data, 265 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T14:12:34.077 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:12:33 smithi099 ceph-mon[137093]: pgmap v322: 161 pgs: 161 active+clean; 585 KiB data, 265 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T14:12:34.078 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:12:33 smithi099 ceph-mon[143401]: pgmap v322: 161 pgs: 161 active+clean; 585 KiB data, 265 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T14:12:34.246 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:12:33 smithi181 ceph-mon[115276]: pgmap v322: 161 pgs: 161 active+clean; 585 KiB data, 265 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T14:12:35.077 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 14:12:34 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[71049]: ::ffff:172.21.15.181 - - [30/Mar/2024:14:12:34] "GET /metrics HTTP/1.1" 200 38411 "" "Prometheus/2.43.0" 2024-03-30T14:12:36.077 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:12:35 smithi099 ceph-mon[137093]: pgmap v323: 161 pgs: 161 active+clean; 585 KiB data, 265 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T14:12:36.078 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:12:35 smithi099 ceph-mon[143401]: pgmap v323: 161 pgs: 161 active+clean; 585 KiB data, 265 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T14:12:36.246 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:12:35 smithi181 ceph-mon[115276]: pgmap v323: 161 pgs: 161 active+clean; 585 KiB data, 265 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T14:12:37.077 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:12:36 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T14:12:37.078 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:12:36 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T14:12:37.246 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:12:36 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T14:12:37.827 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:12:37 smithi099 ceph-mon[137093]: pgmap v324: 161 pgs: 161 active+clean; 585 KiB data, 265 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T14:12:37.828 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:12:37 smithi099 ceph-mon[143401]: pgmap v324: 161 pgs: 161 active+clean; 585 KiB data, 265 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T14:12:38.246 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:12:37 smithi181 ceph-mon[115276]: pgmap v324: 161 pgs: 161 active+clean; 585 KiB data, 265 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T14:12:38.827 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 14:12:38 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[71049]: 2024-03-30T14:12:38.615+0000 7f3bd1084700 -1 log_channel(cephadm) log [ERR] : Upgrade: Paused due to UPGRADE_REDEPLOY_DAEMON: Upgrading daemon iscsi.foo.smithi099.qyjuvr on host smithi099 failed. 2024-03-30T14:12:39.877 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:12:39 smithi181 ceph-mon[115276]: pgmap v325: 161 pgs: 161 active+clean; 585 KiB data, 265 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T14:12:39.877 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:12:39 smithi181 ceph-mon[115276]: Upgrade: Paused due to UPGRADE_REDEPLOY_DAEMON: Upgrading daemon iscsi.foo.smithi099.qyjuvr on host smithi099 failed. 2024-03-30T14:12:39.877 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:12:39 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:12:39.877 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:12:39 smithi181 ceph-mon[115276]: pgmap v326: 161 pgs: 161 active+clean; 585 KiB data, 265 MiB used, 715 GiB / 715 GiB avail; 975 B/s rd, 0 op/s 2024-03-30T14:12:39.877 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:12:39 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:12:39.877 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:12:39 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:12:39.877 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:12:39 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:12:39.877 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:12:39 smithi181 ceph-mon[115276]: Health check failed: Upgrading daemon iscsi.foo.smithi099.qyjuvr on host smithi099 failed. (UPGRADE_REDEPLOY_DAEMON) 2024-03-30T14:12:39.926 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:12:39 smithi099 ceph-mon[143401]: pgmap v325: 161 pgs: 161 active+clean; 585 KiB data, 265 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T14:12:39.926 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:12:39 smithi099 ceph-mon[143401]: Upgrade: Paused due to UPGRADE_REDEPLOY_DAEMON: Upgrading daemon iscsi.foo.smithi099.qyjuvr on host smithi099 failed. 2024-03-30T14:12:39.926 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:12:39 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:12:39.926 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:12:39 smithi099 ceph-mon[143401]: pgmap v326: 161 pgs: 161 active+clean; 585 KiB data, 265 MiB used, 715 GiB / 715 GiB avail; 975 B/s rd, 0 op/s 2024-03-30T14:12:39.926 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:12:39 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:12:39.926 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:12:39 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:12:39.926 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:12:39 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:12:39.927 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:12:39 smithi099 ceph-mon[143401]: Health check failed: Upgrading daemon iscsi.foo.smithi099.qyjuvr on host smithi099 failed. (UPGRADE_REDEPLOY_DAEMON) 2024-03-30T14:12:39.927 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:12:39 smithi099 ceph-mon[137093]: pgmap v325: 161 pgs: 161 active+clean; 585 KiB data, 265 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T14:12:39.927 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:12:39 smithi099 ceph-mon[137093]: Upgrade: Paused due to UPGRADE_REDEPLOY_DAEMON: Upgrading daemon iscsi.foo.smithi099.qyjuvr on host smithi099 failed. 2024-03-30T14:12:39.927 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:12:39 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:12:39.927 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:12:39 smithi099 ceph-mon[137093]: pgmap v326: 161 pgs: 161 active+clean; 585 KiB data, 265 MiB used, 715 GiB / 715 GiB avail; 975 B/s rd, 0 op/s 2024-03-30T14:12:39.927 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:12:39 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:12:39.927 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:12:39 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:12:39.927 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:12:39 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:12:39.927 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:12:39 smithi099 ceph-mon[137093]: Health check failed: Upgrading daemon iscsi.foo.smithi099.qyjuvr on host smithi099 failed. (UPGRADE_REDEPLOY_DAEMON) 2024-03-30T14:12:41.246 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:12:40 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:12:41.246 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:12:40 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:12:41.246 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:12:40 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:12:41.246 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:12:40 smithi181 ceph-mon[115276]: pgmap v327: 161 pgs: 161 active+clean; 585 KiB data, 265 MiB used, 715 GiB / 715 GiB avail; 975 B/s rd, 0 op/s 2024-03-30T14:12:41.254 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:12:40 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:12:41.254 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:12:40 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:12:41.254 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:12:40 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:12:41.254 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:12:40 smithi099 ceph-mon[137093]: pgmap v327: 161 pgs: 161 active+clean; 585 KiB data, 265 MiB used, 715 GiB / 715 GiB avail; 975 B/s rd, 0 op/s 2024-03-30T14:12:41.254 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:12:40 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:12:41.255 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:12:40 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:12:41.255 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:12:40 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:12:41.255 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:12:40 smithi099 ceph-mon[143401]: pgmap v327: 161 pgs: 161 active+clean; 585 KiB data, 265 MiB used, 715 GiB / 715 GiB avail; 975 B/s rd, 0 op/s 2024-03-30T14:12:43.747 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:12:43 smithi181 ceph-mon[115276]: pgmap v328: 161 pgs: 161 active+clean; 585 KiB data, 265 MiB used, 715 GiB / 715 GiB avail; 683 B/s rd, 0 op/s 2024-03-30T14:12:44.077 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:12:43 smithi099 ceph-mon[137093]: pgmap v328: 161 pgs: 161 active+clean; 585 KiB data, 265 MiB used, 715 GiB / 715 GiB avail; 683 B/s rd, 0 op/s 2024-03-30T14:12:44.078 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:12:43 smithi099 ceph-mon[143401]: pgmap v328: 161 pgs: 161 active+clean; 585 KiB data, 265 MiB used, 715 GiB / 715 GiB avail; 683 B/s rd, 0 op/s 2024-03-30T14:12:45.077 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 14:12:44 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[71049]: ::ffff:172.21.15.181 - - [30/Mar/2024:14:12:44] "GET /metrics HTTP/1.1" 200 38409 "" "Prometheus/2.43.0" 2024-03-30T14:12:45.996 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:12:45 smithi181 ceph-mon[115276]: pgmap v329: 161 pgs: 161 active+clean; 585 KiB data, 265 MiB used, 715 GiB / 715 GiB avail; 682 B/s rd, 0 op/s 2024-03-30T14:12:46.077 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:12:45 smithi099 ceph-mon[137093]: pgmap v329: 161 pgs: 161 active+clean; 585 KiB data, 265 MiB used, 715 GiB / 715 GiB avail; 682 B/s rd, 0 op/s 2024-03-30T14:12:46.077 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:12:45 smithi099 ceph-mon[143401]: pgmap v329: 161 pgs: 161 active+clean; 585 KiB data, 265 MiB used, 715 GiB / 715 GiB avail; 682 B/s rd, 0 op/s 2024-03-30T14:12:47.996 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:12:47 smithi181 ceph-mon[115276]: pgmap v330: 161 pgs: 161 active+clean; 585 KiB data, 265 MiB used, 715 GiB / 715 GiB avail; 195 B/s rd, 0 op/s 2024-03-30T14:12:47.996 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:12:47 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:12:47.996 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:12:47 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:12:47.996 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:12:47 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:12:48.077 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:12:47 smithi099 ceph-mon[143401]: pgmap v330: 161 pgs: 161 active+clean; 585 KiB data, 265 MiB used, 715 GiB / 715 GiB avail; 195 B/s rd, 0 op/s 2024-03-30T14:12:48.078 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:12:47 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:12:48.078 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:12:47 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:12:48.078 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:12:47 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:12:48.078 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:12:47 smithi099 ceph-mon[137093]: pgmap v330: 161 pgs: 161 active+clean; 585 KiB data, 265 MiB used, 715 GiB / 715 GiB avail; 195 B/s rd, 0 op/s 2024-03-30T14:12:48.078 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:12:47 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:12:48.078 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:12:47 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:12:48.078 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:12:47 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:12:49.127 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:12:48 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:12:49.128 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:12:48 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:12:49.128 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:12:48 smithi099 ceph-mon[137093]: pgmap v331: 161 pgs: 161 active+clean; 585 KiB data, 265 MiB used, 715 GiB / 715 GiB avail; 210 B/s rd, 0 op/s 2024-03-30T14:12:49.128 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:12:48 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:12:49.128 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:12:48 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:12:49.128 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:12:48 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:12:49.128 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:12:48 smithi099 ceph-mon[137093]: pgmap v332: 161 pgs: 161 active+clean; 585 KiB data, 265 MiB used, 715 GiB / 715 GiB avail; 220 B/s rd, 0 op/s 2024-03-30T14:12:49.128 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:12:48 smithi099 ceph-mon[137093]: pgmap v333: 161 pgs: 161 active+clean; 585 KiB data, 265 MiB used, 715 GiB / 715 GiB avail; 281 B/s rd, 0 op/s 2024-03-30T14:12:49.128 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:12:48 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:12:49.128 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:12:48 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:12:49.128 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:12:48 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:12:49.129 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:12:48 smithi099 ceph-mon[143401]: pgmap v331: 161 pgs: 161 active+clean; 585 KiB data, 265 MiB used, 715 GiB / 715 GiB avail; 210 B/s rd, 0 op/s 2024-03-30T14:12:49.129 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:12:48 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:12:49.129 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:12:48 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:12:49.129 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:12:48 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:12:49.129 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:12:48 smithi099 ceph-mon[143401]: pgmap v332: 161 pgs: 161 active+clean; 585 KiB data, 265 MiB used, 715 GiB / 715 GiB avail; 220 B/s rd, 0 op/s 2024-03-30T14:12:49.129 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:12:48 smithi099 ceph-mon[143401]: pgmap v333: 161 pgs: 161 active+clean; 585 KiB data, 265 MiB used, 715 GiB / 715 GiB avail; 281 B/s rd, 0 op/s 2024-03-30T14:12:49.129 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:12:48 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:12:49.246 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:12:48 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:12:49.247 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:12:48 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:12:49.247 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:12:48 smithi181 ceph-mon[115276]: pgmap v331: 161 pgs: 161 active+clean; 585 KiB data, 265 MiB used, 715 GiB / 715 GiB avail; 210 B/s rd, 0 op/s 2024-03-30T14:12:49.247 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:12:48 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:12:49.247 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:12:48 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:12:49.247 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:12:48 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:12:49.247 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:12:48 smithi181 ceph-mon[115276]: pgmap v332: 161 pgs: 161 active+clean; 585 KiB data, 265 MiB used, 715 GiB / 715 GiB avail; 220 B/s rd, 0 op/s 2024-03-30T14:12:49.247 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:12:48 smithi181 ceph-mon[115276]: pgmap v333: 161 pgs: 161 active+clean; 585 KiB data, 265 MiB used, 715 GiB / 715 GiB avail; 281 B/s rd, 0 op/s 2024-03-30T14:12:49.247 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:12:48 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:12:50.077 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:12:49 smithi099 ceph-mon[137093]: Health check failed: 1 failed cephadm daemon(s) (CEPHADM_FAILED_DAEMON) 2024-03-30T14:12:50.077 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:12:49 smithi099 ceph-mon[137093]: from='client.? 172.21.15.99:0/2704946308' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-03-30T14:12:50.078 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:12:49 smithi099 ceph-mon[143401]: Health check failed: 1 failed cephadm daemon(s) (CEPHADM_FAILED_DAEMON) 2024-03-30T14:12:50.078 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:12:49 smithi099 ceph-mon[143401]: from='client.? 172.21.15.99:0/2704946308' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-03-30T14:12:50.148 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:12:49 smithi181 ceph-mon[115276]: Health check failed: 1 failed cephadm daemon(s) (CEPHADM_FAILED_DAEMON) 2024-03-30T14:12:50.148 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:12:49 smithi181 ceph-mon[115276]: from='client.? 172.21.15.99:0/2704946308' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-03-30T14:12:51.246 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:12:50 smithi181 ceph-mon[115276]: pgmap v334: 161 pgs: 161 active+clean; 585 KiB data, 265 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:12:51.246 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:12:50 smithi181 ceph-mon[115276]: from='client.? 172.21.15.99:0/3201624712' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.99:0/2812545997"}]: dispatch 2024-03-30T14:12:51.327 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:12:50 smithi099 ceph-mon[137093]: pgmap v334: 161 pgs: 161 active+clean; 585 KiB data, 265 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:12:51.327 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:12:50 smithi099 ceph-mon[137093]: from='client.? 172.21.15.99:0/3201624712' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.99:0/2812545997"}]: dispatch 2024-03-30T14:12:51.328 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:12:50 smithi099 ceph-mon[143401]: pgmap v334: 161 pgs: 161 active+clean; 585 KiB data, 265 MiB used, 715 GiB / 715 GiB avail 2024-03-30T14:12:51.328 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:12:50 smithi099 ceph-mon[143401]: from='client.? 172.21.15.99:0/3201624712' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.99:0/2812545997"}]: dispatch 2024-03-30T14:12:52.246 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:12:51 smithi181 ceph-mon[115276]: from='client.? 172.21.15.99:0/3201624712' entity='client.iscsi.foo.smithi099.qyjuvr' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.99:0/2812545997"}]': finished 2024-03-30T14:12:52.246 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:12:51 smithi181 ceph-mon[115276]: osdmap e155: 8 total, 8 up, 8 in 2024-03-30T14:12:52.247 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:12:51 smithi181 ceph-mon[115276]: from='client.? 172.21.15.99:0/2666667389' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.99:6800/1678057797"}]: dispatch 2024-03-30T14:12:52.247 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:12:51 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:12:52.247 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:12:51 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T14:12:52.327 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:12:51 smithi099 ceph-mon[137093]: from='client.? 172.21.15.99:0/3201624712' entity='client.iscsi.foo.smithi099.qyjuvr' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.99:0/2812545997"}]': finished 2024-03-30T14:12:52.327 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:12:51 smithi099 ceph-mon[137093]: osdmap e155: 8 total, 8 up, 8 in 2024-03-30T14:12:52.328 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:12:51 smithi099 ceph-mon[137093]: from='client.? 172.21.15.99:0/2666667389' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.99:6800/1678057797"}]: dispatch 2024-03-30T14:12:52.328 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:12:51 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:12:52.328 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:12:51 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T14:12:52.328 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:12:51 smithi099 ceph-mon[143401]: from='client.? 172.21.15.99:0/3201624712' entity='client.iscsi.foo.smithi099.qyjuvr' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.99:0/2812545997"}]': finished 2024-03-30T14:12:52.328 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:12:51 smithi099 ceph-mon[143401]: osdmap e155: 8 total, 8 up, 8 in 2024-03-30T14:12:52.328 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:12:51 smithi099 ceph-mon[143401]: from='client.? 172.21.15.99:0/2666667389' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.99:6800/1678057797"}]: dispatch 2024-03-30T14:12:52.328 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:12:51 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:12:52.328 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:12:51 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T14:12:53.246 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:12:52 smithi181 ceph-mon[115276]: from='client.? 172.21.15.99:0/2666667389' entity='client.iscsi.foo.smithi099.qyjuvr' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.99:6800/1678057797"}]': finished 2024-03-30T14:12:53.246 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:12:52 smithi181 ceph-mon[115276]: osdmap e156: 8 total, 8 up, 8 in 2024-03-30T14:12:53.246 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:12:52 smithi181 ceph-mon[115276]: pgmap v337: 161 pgs: 161 active+clean; 585 KiB data, 265 MiB used, 715 GiB / 715 GiB avail; 508 B/s rd, 0 op/s 2024-03-30T14:12:53.246 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:12:52 smithi181 ceph-mon[115276]: from='client.? 172.21.15.99:0/3930610054' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.99:6801/1678057797"}]: dispatch 2024-03-30T14:12:53.327 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:12:52 smithi099 ceph-mon[137093]: from='client.? 172.21.15.99:0/2666667389' entity='client.iscsi.foo.smithi099.qyjuvr' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.99:6800/1678057797"}]': finished 2024-03-30T14:12:53.327 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:12:52 smithi099 ceph-mon[137093]: osdmap e156: 8 total, 8 up, 8 in 2024-03-30T14:12:53.328 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:12:52 smithi099 ceph-mon[137093]: pgmap v337: 161 pgs: 161 active+clean; 585 KiB data, 265 MiB used, 715 GiB / 715 GiB avail; 508 B/s rd, 0 op/s 2024-03-30T14:12:53.328 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:12:52 smithi099 ceph-mon[137093]: from='client.? 172.21.15.99:0/3930610054' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.99:6801/1678057797"}]: dispatch 2024-03-30T14:12:53.328 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:12:52 smithi099 ceph-mon[143401]: from='client.? 172.21.15.99:0/2666667389' entity='client.iscsi.foo.smithi099.qyjuvr' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.99:6800/1678057797"}]': finished 2024-03-30T14:12:53.328 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:12:52 smithi099 ceph-mon[143401]: osdmap e156: 8 total, 8 up, 8 in 2024-03-30T14:12:53.328 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:12:52 smithi099 ceph-mon[143401]: pgmap v337: 161 pgs: 161 active+clean; 585 KiB data, 265 MiB used, 715 GiB / 715 GiB avail; 508 B/s rd, 0 op/s 2024-03-30T14:12:53.328 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:12:52 smithi099 ceph-mon[143401]: from='client.? 172.21.15.99:0/3930610054' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.99:6801/1678057797"}]: dispatch 2024-03-30T14:12:54.151 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:12:53 smithi181 ceph-mon[115276]: from='client.? 172.21.15.99:0/3930610054' entity='client.iscsi.foo.smithi099.qyjuvr' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.99:6801/1678057797"}]': finished 2024-03-30T14:12:54.151 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:12:53 smithi181 ceph-mon[115276]: osdmap e157: 8 total, 8 up, 8 in 2024-03-30T14:12:54.151 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:12:53 smithi181 ceph-mon[115276]: from='client.? 172.21.15.99:0/3721603251' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.99:0/2844350855"}]: dispatch 2024-03-30T14:12:54.151 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:12:53 smithi181 ceph-mon[115276]: from='client.? ' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.99:0/2844350855"}]: dispatch 2024-03-30T14:12:54.327 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:12:53 smithi099 ceph-mon[143401]: from='client.? 172.21.15.99:0/3930610054' entity='client.iscsi.foo.smithi099.qyjuvr' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.99:6801/1678057797"}]': finished 2024-03-30T14:12:54.328 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:12:53 smithi099 ceph-mon[143401]: osdmap e157: 8 total, 8 up, 8 in 2024-03-30T14:12:54.328 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:12:53 smithi099 ceph-mon[143401]: from='client.? 172.21.15.99:0/3721603251' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.99:0/2844350855"}]: dispatch 2024-03-30T14:12:54.328 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:12:53 smithi099 ceph-mon[143401]: from='client.? ' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.99:0/2844350855"}]: dispatch 2024-03-30T14:12:54.328 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:12:53 smithi099 ceph-mon[137093]: from='client.? 172.21.15.99:0/3930610054' entity='client.iscsi.foo.smithi099.qyjuvr' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.99:6801/1678057797"}]': finished 2024-03-30T14:12:54.328 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:12:53 smithi099 ceph-mon[137093]: osdmap e157: 8 total, 8 up, 8 in 2024-03-30T14:12:54.329 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:12:53 smithi099 ceph-mon[137093]: from='client.? 172.21.15.99:0/3721603251' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.99:0/2844350855"}]: dispatch 2024-03-30T14:12:54.329 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:12:53 smithi099 ceph-mon[137093]: from='client.? ' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.99:0/2844350855"}]: dispatch 2024-03-30T14:12:55.077 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:12:54 smithi099 ceph-mon[143401]: from='client.? ' entity='client.iscsi.foo.smithi099.qyjuvr' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.99:0/2844350855"}]': finished 2024-03-30T14:12:55.077 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:12:54 smithi099 ceph-mon[143401]: osdmap e158: 8 total, 8 up, 8 in 2024-03-30T14:12:55.077 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:12:54 smithi099 ceph-mon[143401]: pgmap v340: 161 pgs: 161 active+clean; 585 KiB data, 265 MiB used, 715 GiB / 715 GiB avail; 511 B/s rd, 0 op/s 2024-03-30T14:12:55.077 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:12:54 smithi099 ceph-mon[143401]: from='client.? 172.21.15.99:0/3242937899' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.99:0/4267059399"}]: dispatch 2024-03-30T14:12:55.078 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:12:54 smithi099 ceph-mon[137093]: from='client.? ' entity='client.iscsi.foo.smithi099.qyjuvr' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.99:0/2844350855"}]': finished 2024-03-30T14:12:55.078 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:12:54 smithi099 ceph-mon[137093]: osdmap e158: 8 total, 8 up, 8 in 2024-03-30T14:12:55.078 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:12:54 smithi099 ceph-mon[137093]: pgmap v340: 161 pgs: 161 active+clean; 585 KiB data, 265 MiB used, 715 GiB / 715 GiB avail; 511 B/s rd, 0 op/s 2024-03-30T14:12:55.078 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:12:54 smithi099 ceph-mon[137093]: from='client.? 172.21.15.99:0/3242937899' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.99:0/4267059399"}]: dispatch 2024-03-30T14:12:55.078 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 14:12:54 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[71049]: ::ffff:172.21.15.181 - - [30/Mar/2024:14:12:54] "GET /metrics HTTP/1.1" 200 38486 "" "Prometheus/2.43.0" 2024-03-30T14:12:55.246 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:12:54 smithi181 ceph-mon[115276]: from='client.? ' entity='client.iscsi.foo.smithi099.qyjuvr' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.99:0/2844350855"}]': finished 2024-03-30T14:12:55.246 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:12:54 smithi181 ceph-mon[115276]: osdmap e158: 8 total, 8 up, 8 in 2024-03-30T14:12:55.246 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:12:54 smithi181 ceph-mon[115276]: pgmap v340: 161 pgs: 161 active+clean; 585 KiB data, 265 MiB used, 715 GiB / 715 GiB avail; 511 B/s rd, 0 op/s 2024-03-30T14:12:55.247 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:12:54 smithi181 ceph-mon[115276]: from='client.? 172.21.15.99:0/3242937899' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.99:0/4267059399"}]: dispatch 2024-03-30T14:12:56.246 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:12:55 smithi181 ceph-mon[115276]: from='client.? 172.21.15.99:0/3242937899' entity='client.iscsi.foo.smithi099.qyjuvr' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.99:0/4267059399"}]': finished 2024-03-30T14:12:56.247 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:12:55 smithi181 ceph-mon[115276]: osdmap e159: 8 total, 8 up, 8 in 2024-03-30T14:12:56.247 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:12:55 smithi181 ceph-mon[115276]: from='client.? 172.21.15.99:0/624542436' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.99:0/3079656397"}]: dispatch 2024-03-30T14:12:56.327 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:12:55 smithi099 ceph-mon[137093]: from='client.? 172.21.15.99:0/3242937899' entity='client.iscsi.foo.smithi099.qyjuvr' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.99:0/4267059399"}]': finished 2024-03-30T14:12:56.327 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:12:55 smithi099 ceph-mon[137093]: osdmap e159: 8 total, 8 up, 8 in 2024-03-30T14:12:56.327 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:12:55 smithi099 ceph-mon[137093]: from='client.? 172.21.15.99:0/624542436' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.99:0/3079656397"}]: dispatch 2024-03-30T14:12:56.328 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:12:55 smithi099 ceph-mon[143401]: from='client.? 172.21.15.99:0/3242937899' entity='client.iscsi.foo.smithi099.qyjuvr' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.99:0/4267059399"}]': finished 2024-03-30T14:12:56.328 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:12:55 smithi099 ceph-mon[143401]: osdmap e159: 8 total, 8 up, 8 in 2024-03-30T14:12:56.328 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:12:55 smithi099 ceph-mon[143401]: from='client.? 172.21.15.99:0/624542436' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.99:0/3079656397"}]: dispatch 2024-03-30T14:12:57.246 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:12:56 smithi181 ceph-mon[115276]: pgmap v342: 161 pgs: 161 active+clean; 585 KiB data, 265 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T14:12:57.246 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:12:56 smithi181 ceph-mon[115276]: from='client.? 172.21.15.99:0/624542436' entity='client.iscsi.foo.smithi099.qyjuvr' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.99:0/3079656397"}]': finished 2024-03-30T14:12:57.247 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:12:56 smithi181 ceph-mon[115276]: osdmap e160: 8 total, 8 up, 8 in 2024-03-30T14:12:57.327 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:12:56 smithi099 ceph-mon[137093]: pgmap v342: 161 pgs: 161 active+clean; 585 KiB data, 265 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T14:12:57.328 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:12:56 smithi099 ceph-mon[137093]: from='client.? 172.21.15.99:0/624542436' entity='client.iscsi.foo.smithi099.qyjuvr' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.99:0/3079656397"}]': finished 2024-03-30T14:12:57.328 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:12:56 smithi099 ceph-mon[137093]: osdmap e160: 8 total, 8 up, 8 in 2024-03-30T14:12:57.328 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:12:56 smithi099 ceph-mon[143401]: pgmap v342: 161 pgs: 161 active+clean; 585 KiB data, 265 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T14:12:57.328 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:12:56 smithi099 ceph-mon[143401]: from='client.? 172.21.15.99:0/624542436' entity='client.iscsi.foo.smithi099.qyjuvr' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.99:0/3079656397"}]': finished 2024-03-30T14:12:57.328 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:12:56 smithi099 ceph-mon[143401]: osdmap e160: 8 total, 8 up, 8 in 2024-03-30T14:12:58.047 INFO:teuthology.orchestra.run.smithi099.stdout:true 2024-03-30T14:12:58.399 INFO:teuthology.orchestra.run.smithi099.stdout:"Error: UPGRADE_REDEPLOY_DAEMON: Upgrading daemon iscsi.foo.smithi099.qyjuvr on host smithi099 failed." 2024-03-30T14:12:59.018 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:12:58 smithi099 ceph-mon[137093]: pgmap v344: 161 pgs: 161 active+clean; 585 KiB data, 265 MiB used, 715 GiB / 715 GiB avail; 1021 B/s rd, 0 op/s 2024-03-30T14:12:59.019 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:12:58 smithi099 ceph-mon[137093]: from='client.54903 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T14:12:59.019 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:12:58 smithi099 ceph-mon[137093]: from='client.54909 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T14:12:59.019 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:12:58 smithi099 ceph-mon[143401]: pgmap v344: 161 pgs: 161 active+clean; 585 KiB data, 265 MiB used, 715 GiB / 715 GiB avail; 1021 B/s rd, 0 op/s 2024-03-30T14:12:59.019 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:12:58 smithi099 ceph-mon[143401]: from='client.54903 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T14:12:59.019 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:12:58 smithi099 ceph-mon[143401]: from='client.54909 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T14:12:59.043 DEBUG:teuthology.orchestra.run.smithi099:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 98ebaeb8-ee99-11ee-b647-cb9ed24678a4 -e sha1=4e50bbcdd1630c7760b708f3a5b4d38a121e66cb -- bash -c 'ceph orch ps' 2024-03-30T14:12:59.246 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:12:58 smithi181 ceph-mon[115276]: pgmap v344: 161 pgs: 161 active+clean; 585 KiB data, 265 MiB used, 715 GiB / 715 GiB avail; 1021 B/s rd, 0 op/s 2024-03-30T14:12:59.247 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:12:58 smithi181 ceph-mon[115276]: from='client.54903 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T14:12:59.247 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:12:58 smithi181 ceph-mon[115276]: from='client.54909 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T14:13:00.189 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:12:59 smithi181 ceph-mon[115276]: from='client.54855 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T14:13:00.327 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:12:59 smithi099 ceph-mon[137093]: from='client.54855 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T14:13:00.328 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:12:59 smithi099 ceph-mon[143401]: from='client.54855 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T14:13:01.234 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:13:01 smithi099 ceph-mon[137093]: pgmap v345: 161 pgs: 161 active+clean; 585 KiB data, 265 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-30T14:13:01.235 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:13:01 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:13:01.235 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:13:01 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:13:01.235 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:13:01 smithi099 ceph-mon[137093]: pgmap v346: 161 pgs: 161 active+clean; 585 KiB data, 265 MiB used, 715 GiB / 715 GiB avail; 837 B/s rd, 0 op/s 2024-03-30T14:13:01.235 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:13:01 smithi099 ceph-mon[137093]: pgmap v347: 161 pgs: 161 active+clean; 585 KiB data, 265 MiB used, 715 GiB / 715 GiB avail; 1004 B/s rd, 0 op/s 2024-03-30T14:13:01.235 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:13:01 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:13:01.235 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:13:01 smithi099 ceph-mon[143401]: pgmap v345: 161 pgs: 161 active+clean; 585 KiB data, 265 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-30T14:13:01.235 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:13:01 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:13:01.236 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:13:01 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:13:01.236 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:13:01 smithi099 ceph-mon[143401]: pgmap v346: 161 pgs: 161 active+clean; 585 KiB data, 265 MiB used, 715 GiB / 715 GiB avail; 837 B/s rd, 0 op/s 2024-03-30T14:13:01.236 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:13:01 smithi099 ceph-mon[143401]: pgmap v347: 161 pgs: 161 active+clean; 585 KiB data, 265 MiB used, 715 GiB / 715 GiB avail; 1004 B/s rd, 0 op/s 2024-03-30T14:13:01.236 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:13:01 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:13:01.496 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:13:01 smithi181 ceph-mon[115276]: pgmap v345: 161 pgs: 161 active+clean; 585 KiB data, 265 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-30T14:13:01.496 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:13:01 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:13:01.497 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:13:01 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:13:01.497 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:13:01 smithi181 ceph-mon[115276]: pgmap v346: 161 pgs: 161 active+clean; 585 KiB data, 265 MiB used, 715 GiB / 715 GiB avail; 837 B/s rd, 0 op/s 2024-03-30T14:13:01.497 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:13:01 smithi181 ceph-mon[115276]: pgmap v347: 161 pgs: 161 active+clean; 585 KiB data, 265 MiB used, 715 GiB / 715 GiB avail; 1004 B/s rd, 0 op/s 2024-03-30T14:13:01.497 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:13:01 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:13:01.556 INFO:teuthology.orchestra.run.smithi099.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-03-30T14:13:01.557 INFO:teuthology.orchestra.run.smithi099.stdout:agent.smithi099 smithi099 running 13s ago 41m - - 2024-03-30T14:13:01.557 INFO:teuthology.orchestra.run.smithi099.stdout:agent.smithi181 smithi181 running 1s ago 41m - - 2024-03-30T14:13:01.557 INFO:teuthology.orchestra.run.smithi099.stdout:alertmanager.a smithi099 *:9093,9094 running (11m) 13s ago 35m - - 0.25.0 c8568f914cd2 08735152b67d 2024-03-30T14:13:01.557 INFO:teuthology.orchestra.run.smithi099.stdout:grafana.a smithi181 *:3000 running (11m) 1s ago 35m 79.0M - 9.4.12 2bacad6d85d8 d599aa7730d6 2024-03-30T14:13:01.557 INFO:teuthology.orchestra.run.smithi099.stdout:iscsi.foo.smithi099.qyjuvr smithi099 unknown 13s ago 34m - - 2024-03-30T14:13:01.557 INFO:teuthology.orchestra.run.smithi099.stdout:mgr.x smithi181 *:8443,9283,8765 running (13m) 1s ago 40m 452M - 19.0.0-1967-g4e50bbcd b0c4478f1d83 f269106f7913 2024-03-30T14:13:01.557 INFO:teuthology.orchestra.run.smithi099.stdout:mgr.y smithi099 *:8443,9283,8765 running (24m) 13s ago 42m - - 19.0.0-1967-g4e50bbcd b0c4478f1d83 0d464b8c1d18 2024-03-30T14:13:01.557 INFO:teuthology.orchestra.run.smithi099.stdout:mon.a smithi099 running (9m) 13s ago 42m - 2048M 19.0.0-1967-g4e50bbcd b0c4478f1d83 f19388464dfd 2024-03-30T14:13:01.557 INFO:teuthology.orchestra.run.smithi099.stdout:mon.b smithi181 running (10m) 1s ago 40m 65.2M 2048M 19.0.0-1967-g4e50bbcd b0c4478f1d83 0468ed087cdd 2024-03-30T14:13:01.557 INFO:teuthology.orchestra.run.smithi099.stdout:mon.c smithi099 running (8m) 13s ago 40m - 2048M 19.0.0-1967-g4e50bbcd b0c4478f1d83 731056a2fea6 2024-03-30T14:13:01.557 INFO:teuthology.orchestra.run.smithi099.stdout:node-exporter.a smithi099 *:9100 running (12m) 13s ago 36m - - 1.5.0 0da6a335fe13 4a3f1f6e7068 2024-03-30T14:13:01.557 INFO:teuthology.orchestra.run.smithi099.stdout:node-exporter.b smithi181 *:9100 running (12m) 1s ago 36m 16.9M - 1.5.0 0da6a335fe13 acea317b5f5d 2024-03-30T14:13:01.558 INFO:teuthology.orchestra.run.smithi099.stdout:osd.0 smithi099 running (7m) 13s ago 40m - 4096M 19.0.0-1967-g4e50bbcd b0c4478f1d83 d97d48cb3314 2024-03-30T14:13:01.558 INFO:teuthology.orchestra.run.smithi099.stdout:osd.1 smithi099 running (6m) 13s ago 39m - 4096M 19.0.0-1967-g4e50bbcd b0c4478f1d83 a843295ce83b 2024-03-30T14:13:01.558 INFO:teuthology.orchestra.run.smithi099.stdout:osd.2 smithi099 running (5m) 13s ago 39m - 4096M 19.0.0-1967-g4e50bbcd b0c4478f1d83 18304adfb0d0 2024-03-30T14:13:01.558 INFO:teuthology.orchestra.run.smithi099.stdout:osd.3 smithi099 running (4m) 13s ago 39m - 4096M 19.0.0-1967-g4e50bbcd b0c4478f1d83 9b38d79f070e 2024-03-30T14:13:01.558 INFO:teuthology.orchestra.run.smithi099.stdout:osd.4 smithi181 running (4m) 1s ago 38m 60.6M 4096M 19.0.0-1967-g4e50bbcd b0c4478f1d83 b9078af21e45 2024-03-30T14:13:01.558 INFO:teuthology.orchestra.run.smithi099.stdout:osd.5 smithi181 running (3m) 1s ago 38m 56.6M 4096M 19.0.0-1967-g4e50bbcd b0c4478f1d83 bba176b8db2c 2024-03-30T14:13:01.558 INFO:teuthology.orchestra.run.smithi099.stdout:osd.6 smithi181 running (3m) 1s ago 37m 47.8M 4096M 19.0.0-1967-g4e50bbcd b0c4478f1d83 4a29dfeb4b16 2024-03-30T14:13:01.558 INFO:teuthology.orchestra.run.smithi099.stdout:osd.7 smithi181 running (2m) 1s ago 37m 54.4M 4096M 19.0.0-1967-g4e50bbcd b0c4478f1d83 7940232eb4fe 2024-03-30T14:13:01.558 INFO:teuthology.orchestra.run.smithi099.stdout:prometheus.a smithi181 *:9095 running (12m) 1s ago 36m 70.5M - 2.43.0 a07b618ecd1d 004088bdf70e 2024-03-30T14:13:01.558 INFO:teuthology.orchestra.run.smithi099.stdout:rgw.foo.smithi099.fxjbmp smithi099 *:8000 running (91s) 13s ago 34m - - 19.0.0-1967-g4e50bbcd b0c4478f1d83 d4ba347d41c8 2024-03-30T14:13:01.558 INFO:teuthology.orchestra.run.smithi099.stdout:rgw.foo.smithi181.wfqwti smithi181 *:8000 running (112s) 1s ago 34m 77.5M - 19.0.0-1967-g4e50bbcd b0c4478f1d83 d341398e6f10 2024-03-30T14:13:02.327 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:13:02 smithi099 ceph-mon[137093]: from='client.54915 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T14:13:02.327 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:13:02 smithi099 ceph-mon[143401]: from='client.54915 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T14:13:02.363 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:13:02 smithi181 ceph-mon[115276]: from='client.54915 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T14:13:02.565 DEBUG:teuthology.orchestra.run.smithi099:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 98ebaeb8-ee99-11ee-b647-cb9ed24678a4 -e sha1=4e50bbcdd1630c7760b708f3a5b4d38a121e66cb -- bash -c 'ceph versions' 2024-03-30T14:13:03.175 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:13:03 smithi099 ceph-mon[137093]: pgmap v348: 161 pgs: 161 active+clean; 585 KiB data, 266 MiB used, 715 GiB / 715 GiB avail; 838 B/s rd, 0 op/s 2024-03-30T14:13:03.176 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:13:03 smithi099 ceph-mon[143401]: pgmap v348: 161 pgs: 161 active+clean; 585 KiB data, 266 MiB used, 715 GiB / 715 GiB avail; 838 B/s rd, 0 op/s 2024-03-30T14:13:03.377 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:13:03 smithi181 ceph-mon[115276]: pgmap v348: 161 pgs: 161 active+clean; 585 KiB data, 266 MiB used, 715 GiB / 715 GiB avail; 838 B/s rd, 0 op/s 2024-03-30T14:13:04.603 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-03-30T14:13:04.603 INFO:teuthology.orchestra.run.smithi099.stdout: "mon": { 2024-03-30T14:13:04.603 INFO:teuthology.orchestra.run.smithi099.stdout: "ceph version 19.0.0-1967-g4e50bbcd (4e50bbcdd1630c7760b708f3a5b4d38a121e66cb) squid (dev)": 3 2024-03-30T14:13:04.603 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T14:13:04.603 INFO:teuthology.orchestra.run.smithi099.stdout: "mgr": { 2024-03-30T14:13:04.603 INFO:teuthology.orchestra.run.smithi099.stdout: "ceph version 19.0.0-1967-g4e50bbcd (4e50bbcdd1630c7760b708f3a5b4d38a121e66cb) squid (dev)": 2 2024-03-30T14:13:04.604 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T14:13:04.604 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": { 2024-03-30T14:13:04.604 INFO:teuthology.orchestra.run.smithi099.stdout: "ceph version 19.0.0-1967-g4e50bbcd (4e50bbcdd1630c7760b708f3a5b4d38a121e66cb) squid (dev)": 8 2024-03-30T14:13:04.604 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T14:13:04.604 INFO:teuthology.orchestra.run.smithi099.stdout: "rgw": { 2024-03-30T14:13:04.604 INFO:teuthology.orchestra.run.smithi099.stdout: "ceph version 19.0.0-1967-g4e50bbcd (4e50bbcdd1630c7760b708f3a5b4d38a121e66cb) squid (dev)": 2 2024-03-30T14:13:04.604 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T14:13:04.604 INFO:teuthology.orchestra.run.smithi099.stdout: "overall": { 2024-03-30T14:13:04.604 INFO:teuthology.orchestra.run.smithi099.stdout: "ceph version 19.0.0-1967-g4e50bbcd (4e50bbcdd1630c7760b708f3a5b4d38a121e66cb) squid (dev)": 15 2024-03-30T14:13:04.604 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-03-30T14:13:04.604 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-03-30T14:13:04.929 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 14:13:04 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[71049]: ::ffff:172.21.15.181 - - [30/Mar/2024:14:13:04] "GET /metrics HTTP/1.1" 200 38486 "" "Prometheus/2.43.0" 2024-03-30T14:13:05.042 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:13:05 smithi181 ceph-mon[115276]: pgmap v349: 161 pgs: 161 active+clean; 585 KiB data, 266 MiB used, 715 GiB / 715 GiB avail; 632 B/s rd, 0 op/s 2024-03-30T14:13:05.043 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:13:05 smithi181 ceph-mon[115276]: from='client.? 172.21.15.99:0/2616976307' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:13:05.321 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:13:05 smithi099 ceph-mon[137093]: pgmap v349: 161 pgs: 161 active+clean; 585 KiB data, 266 MiB used, 715 GiB / 715 GiB avail; 632 B/s rd, 0 op/s 2024-03-30T14:13:05.321 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:13:05 smithi099 ceph-mon[137093]: from='client.? 172.21.15.99:0/2616976307' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:13:05.321 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:13:05 smithi099 ceph-mon[143401]: pgmap v349: 161 pgs: 161 active+clean; 585 KiB data, 266 MiB used, 715 GiB / 715 GiB avail; 632 B/s rd, 0 op/s 2024-03-30T14:13:05.321 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:13:05 smithi099 ceph-mon[143401]: from='client.? 172.21.15.99:0/2616976307' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:13:05.345 DEBUG:teuthology.orchestra.run.smithi099:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 98ebaeb8-ee99-11ee-b647-cb9ed24678a4 -e sha1=4e50bbcdd1630c7760b708f3a5b4d38a121e66cb -- bash -c 'echo "wait for servicemap items w/ changing names to refresh"' 2024-03-30T14:13:07.327 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:13:07 smithi099 ceph-mon[143401]: pgmap v350: 161 pgs: 161 active+clean; 585 KiB data, 266 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T14:13:07.328 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:13:07 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T14:13:07.328 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:13:07 smithi099 ceph-mon[137093]: pgmap v350: 161 pgs: 161 active+clean; 585 KiB data, 266 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T14:13:07.328 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:13:07 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T14:13:07.349 INFO:teuthology.orchestra.run.smithi099.stdout:wait for servicemap items w/ changing names to refresh 2024-03-30T14:13:07.496 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:13:07 smithi181 ceph-mon[115276]: pgmap v350: 161 pgs: 161 active+clean; 585 KiB data, 266 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T14:13:07.496 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:13:07 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T14:13:08.069 DEBUG:teuthology.orchestra.run.smithi099:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 98ebaeb8-ee99-11ee-b647-cb9ed24678a4 -e sha1=4e50bbcdd1630c7760b708f3a5b4d38a121e66cb -- bash -c 'sleep 60' 2024-03-30T14:13:09.246 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:13:08 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:13:09.247 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:13:08 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:13:09.247 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:13:08 smithi181 ceph-mon[115276]: pgmap v351: 161 pgs: 161 active+clean; 585 KiB data, 266 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T14:13:09.247 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:13:08 smithi181 ceph-mon[115276]: pgmap v352: 161 pgs: 161 active+clean; 585 KiB data, 266 MiB used, 715 GiB / 715 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-03-30T14:13:09.247 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:13:08 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:13:09.327 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:13:08 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:13:09.327 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:13:08 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:13:09.328 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:13:08 smithi099 ceph-mon[137093]: pgmap v351: 161 pgs: 161 active+clean; 585 KiB data, 266 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T14:13:09.328 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:13:08 smithi099 ceph-mon[137093]: pgmap v352: 161 pgs: 161 active+clean; 585 KiB data, 266 MiB used, 715 GiB / 715 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-03-30T14:13:09.328 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:13:08 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:13:09.328 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:13:08 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:13:09.328 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:13:08 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:13:09.328 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:13:08 smithi099 ceph-mon[143401]: pgmap v351: 161 pgs: 161 active+clean; 585 KiB data, 266 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T14:13:09.328 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:13:08 smithi099 ceph-mon[143401]: pgmap v352: 161 pgs: 161 active+clean; 585 KiB data, 266 MiB used, 715 GiB / 715 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-03-30T14:13:09.328 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:13:08 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:13:10.158 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:13:10 smithi099 ceph-mon[137093]: from='client.54855 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T14:13:10.158 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:13:10 smithi099 ceph-mon[143401]: from='client.54855 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T14:13:10.497 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:13:10 smithi181 ceph-mon[115276]: from='client.54855 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T14:13:11.271 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:13:11 smithi099 ceph-mon[137093]: pgmap v353: 161 pgs: 161 active+clean; 585 KiB data, 266 MiB used, 715 GiB / 715 GiB avail; 1 KiB/s rd, 1 op/s 2024-03-30T14:13:11.271 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:13:11 smithi099 ceph-mon[143401]: pgmap v353: 161 pgs: 161 active+clean; 585 KiB data, 266 MiB used, 715 GiB / 715 GiB avail; 1 KiB/s rd, 1 op/s 2024-03-30T14:13:11.496 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:13:11 smithi181 ceph-mon[115276]: pgmap v353: 161 pgs: 161 active+clean; 585 KiB data, 266 MiB used, 715 GiB / 715 GiB avail; 1 KiB/s rd, 1 op/s 2024-03-30T14:13:13.294 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:13:13 smithi099 ceph-mon[137093]: pgmap v354: 161 pgs: 161 active+clean; 585 KiB data, 266 MiB used, 715 GiB / 715 GiB avail; 1 KiB/s rd, 1 op/s 2024-03-30T14:13:13.294 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:13:13 smithi099 ceph-mon[143401]: pgmap v354: 161 pgs: 161 active+clean; 585 KiB data, 266 MiB used, 715 GiB / 715 GiB avail; 1 KiB/s rd, 1 op/s 2024-03-30T14:13:13.498 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:13:13 smithi181 ceph-mon[115276]: pgmap v354: 161 pgs: 161 active+clean; 585 KiB data, 266 MiB used, 715 GiB / 715 GiB avail; 1 KiB/s rd, 1 op/s 2024-03-30T14:13:14.577 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:13:14 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:13:14.578 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:13:14 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:13:14.578 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:13:14 smithi099 ceph-mon[137093]: pgmap v355: 161 pgs: 161 active+clean; 585 KiB data, 266 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-03-30T14:13:14.578 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:13:14 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:13:14.578 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:13:14 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:13:14.578 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:13:14 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:13:14.578 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:13:14 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:13:14.578 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:13:14 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:13:14.578 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:13:14 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:13:14.578 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:13:14 smithi099 ceph-mon[143401]: pgmap v355: 161 pgs: 161 active+clean; 585 KiB data, 266 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-03-30T14:13:14.579 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:13:14 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:13:14.579 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:13:14 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:13:14.579 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:13:14 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:13:14.579 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:13:14 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:13:14.746 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:13:14 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:13:14.746 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:13:14 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:13:14.746 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:13:14 smithi181 ceph-mon[115276]: pgmap v355: 161 pgs: 161 active+clean; 585 KiB data, 266 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-03-30T14:13:14.747 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:13:14 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:13:14.747 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:13:14 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:13:14.747 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:13:14 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:13:14.747 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:13:14 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:13:15.000 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 14:13:14 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[71049]: ::ffff:172.21.15.181 - - [30/Mar/2024:14:13:14] "GET /metrics HTTP/1.1" 200 38490 "" "Prometheus/2.43.0" 2024-03-30T14:13:15.577 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:13:15 smithi099 ceph-mon[137093]: Health check cleared: CEPHADM_FAILED_DAEMON (was: 1 failed cephadm daemon(s)) 2024-03-30T14:13:15.577 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:13:15 smithi099 ceph-mon[143401]: Health check cleared: CEPHADM_FAILED_DAEMON (was: 1 failed cephadm daemon(s)) 2024-03-30T14:13:15.746 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:13:15 smithi181 ceph-mon[115276]: Health check cleared: CEPHADM_FAILED_DAEMON (was: 1 failed cephadm daemon(s)) 2024-03-30T14:13:16.578 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:13:16 smithi099 ceph-mon[137093]: pgmap v356: 161 pgs: 161 active+clean; 585 KiB data, 266 MiB used, 715 GiB / 715 GiB avail; 551 B/s rd, 0 op/s 2024-03-30T14:13:16.578 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:13:16 smithi099 ceph-mon[143401]: pgmap v356: 161 pgs: 161 active+clean; 585 KiB data, 266 MiB used, 715 GiB / 715 GiB avail; 551 B/s rd, 0 op/s 2024-03-30T14:13:16.746 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:13:16 smithi181 ceph-mon[115276]: pgmap v356: 161 pgs: 161 active+clean; 585 KiB data, 266 MiB used, 715 GiB / 715 GiB avail; 551 B/s rd, 0 op/s 2024-03-30T14:13:18.746 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:13:18 smithi181 ceph-mon[115276]: pgmap v357: 161 pgs: 161 active+clean; 585 KiB data, 266 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-03-30T14:13:18.828 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:13:18 smithi099 ceph-mon[137093]: pgmap v357: 161 pgs: 161 active+clean; 585 KiB data, 266 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-03-30T14:13:18.828 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:13:18 smithi099 ceph-mon[143401]: pgmap v357: 161 pgs: 161 active+clean; 585 KiB data, 266 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-03-30T14:13:20.496 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:13:20 smithi181 ceph-mon[115276]: pgmap v358: 161 pgs: 161 active+clean; 585 KiB data, 266 MiB used, 715 GiB / 715 GiB avail; 907 B/s rd, 0 op/s 2024-03-30T14:13:20.497 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:13:20 smithi181 ceph-mon[115276]: from='client.54855 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T14:13:20.497 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:13:20 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:13:20.497 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:13:20 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:13:20.497 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:13:20 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:13:20.827 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:13:20 smithi099 ceph-mon[137093]: pgmap v358: 161 pgs: 161 active+clean; 585 KiB data, 266 MiB used, 715 GiB / 715 GiB avail; 907 B/s rd, 0 op/s 2024-03-30T14:13:20.827 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:13:20 smithi099 ceph-mon[137093]: from='client.54855 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T14:13:20.827 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:13:20 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:13:20.827 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:13:20 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:13:20.828 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:13:20 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:13:20.828 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:13:20 smithi099 ceph-mon[143401]: pgmap v358: 161 pgs: 161 active+clean; 585 KiB data, 266 MiB used, 715 GiB / 715 GiB avail; 907 B/s rd, 0 op/s 2024-03-30T14:13:20.828 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:13:20 smithi099 ceph-mon[143401]: from='client.54855 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T14:13:20.828 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:13:20 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:13:20.828 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:13:20 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:13:20.828 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:13:20 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:13:23.077 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:13:22 smithi099 ceph-mon[143401]: pgmap v359: 161 pgs: 161 active+clean; 585 KiB data, 266 MiB used, 715 GiB / 715 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-03-30T14:13:23.077 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:13:22 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:13:23.077 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:13:22 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T14:13:23.078 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:13:22 smithi099 ceph-mon[137093]: pgmap v359: 161 pgs: 161 active+clean; 585 KiB data, 266 MiB used, 715 GiB / 715 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-03-30T14:13:23.078 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:13:22 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:13:23.078 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:13:22 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T14:13:23.176 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:13:22 smithi181 ceph-mon[115276]: pgmap v359: 161 pgs: 161 active+clean; 585 KiB data, 266 MiB used, 715 GiB / 715 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-03-30T14:13:23.177 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:13:22 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:13:23.177 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:13:22 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T14:13:24.996 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:13:24 smithi181 ceph-mon[115276]: pgmap v360: 161 pgs: 161 active+clean; 585 KiB data, 266 MiB used, 715 GiB / 715 GiB avail; 907 B/s rd, 0 op/s 2024-03-30T14:13:25.077 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:13:24 smithi099 ceph-mon[143401]: pgmap v360: 161 pgs: 161 active+clean; 585 KiB data, 266 MiB used, 715 GiB / 715 GiB avail; 907 B/s rd, 0 op/s 2024-03-30T14:13:25.078 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:13:24 smithi099 ceph-mon[137093]: pgmap v360: 161 pgs: 161 active+clean; 585 KiB data, 266 MiB used, 715 GiB / 715 GiB avail; 907 B/s rd, 0 op/s 2024-03-30T14:13:25.078 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 14:13:24 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[71049]: ::ffff:172.21.15.181 - - [30/Mar/2024:14:13:24] "GET /metrics HTTP/1.1" 200 38490 "" "Prometheus/2.43.0" 2024-03-30T14:13:27.077 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:13:26 smithi099 ceph-mon[137093]: pgmap v361: 161 pgs: 161 active+clean; 585 KiB data, 266 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T14:13:27.078 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:13:26 smithi099 ceph-mon[143401]: pgmap v361: 161 pgs: 161 active+clean; 585 KiB data, 266 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T14:13:27.246 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:13:26 smithi181 ceph-mon[115276]: pgmap v361: 161 pgs: 161 active+clean; 585 KiB data, 266 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T14:13:29.077 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:13:28 smithi099 ceph-mon[143401]: pgmap v362: 161 pgs: 161 active+clean; 585 KiB data, 266 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T14:13:29.077 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:13:28 smithi099 ceph-mon[137093]: pgmap v362: 161 pgs: 161 active+clean; 585 KiB data, 266 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T14:13:29.246 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:13:28 smithi181 ceph-mon[115276]: pgmap v362: 161 pgs: 161 active+clean; 585 KiB data, 266 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T14:13:30.827 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:13:30 smithi099 ceph-mon[137093]: pgmap v363: 161 pgs: 161 active+clean; 585 KiB data, 266 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T14:13:30.828 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:13:30 smithi099 ceph-mon[137093]: from='client.54855 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T14:13:30.828 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:13:30 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:13:30.828 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:13:30 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:13:30.828 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:13:30 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:13:30.828 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:13:30 smithi099 ceph-mon[143401]: pgmap v363: 161 pgs: 161 active+clean; 585 KiB data, 266 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T14:13:30.828 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:13:30 smithi099 ceph-mon[143401]: from='client.54855 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T14:13:30.828 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:13:30 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:13:30.828 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:13:30 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:13:30.828 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:13:30 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:13:31.246 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:13:30 smithi181 ceph-mon[115276]: pgmap v363: 161 pgs: 161 active+clean; 585 KiB data, 266 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T14:13:31.246 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:13:30 smithi181 ceph-mon[115276]: from='client.54855 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T14:13:31.246 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:13:30 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:13:31.246 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:13:30 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:13:31.247 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:13:30 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:13:33.077 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:13:32 smithi099 ceph-mon[137093]: pgmap v364: 161 pgs: 161 active+clean; 585 KiB data, 266 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T14:13:33.078 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:13:32 smithi099 ceph-mon[143401]: pgmap v364: 161 pgs: 161 active+clean; 585 KiB data, 266 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T14:13:33.246 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:13:32 smithi181 ceph-mon[115276]: pgmap v364: 161 pgs: 161 active+clean; 585 KiB data, 266 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T14:13:34.997 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:13:34 smithi181 ceph-mon[115276]: pgmap v365: 161 pgs: 161 active+clean; 585 KiB data, 266 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T14:13:35.077 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:13:34 smithi099 ceph-mon[137093]: pgmap v365: 161 pgs: 161 active+clean; 585 KiB data, 266 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T14:13:35.078 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:13:34 smithi099 ceph-mon[143401]: pgmap v365: 161 pgs: 161 active+clean; 585 KiB data, 266 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T14:13:35.078 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 14:13:34 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[71049]: ::ffff:172.21.15.181 - - [30/Mar/2024:14:13:34] "GET /metrics HTTP/1.1" 200 38490 "" "Prometheus/2.43.0" 2024-03-30T14:13:37.078 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:13:36 smithi099 ceph-mon[137093]: pgmap v366: 161 pgs: 161 active+clean; 585 KiB data, 266 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T14:13:37.078 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:13:36 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T14:13:37.078 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:13:36 smithi099 ceph-mon[143401]: pgmap v366: 161 pgs: 161 active+clean; 585 KiB data, 266 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T14:13:37.078 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:13:36 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T14:13:37.246 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:13:36 smithi181 ceph-mon[115276]: pgmap v366: 161 pgs: 161 active+clean; 585 KiB data, 266 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T14:13:37.246 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:13:36 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T14:13:39.077 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:13:38 smithi099 ceph-mon[137093]: pgmap v367: 161 pgs: 161 active+clean; 585 KiB data, 266 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T14:13:39.077 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:13:38 smithi099 ceph-mon[143401]: pgmap v367: 161 pgs: 161 active+clean; 585 KiB data, 266 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T14:13:39.246 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:13:38 smithi181 ceph-mon[115276]: pgmap v367: 161 pgs: 161 active+clean; 585 KiB data, 266 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T14:13:41.077 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:13:40 smithi099 ceph-mon[137093]: pgmap v368: 161 pgs: 161 active+clean; 585 KiB data, 266 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T14:13:41.077 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:13:40 smithi099 ceph-mon[137093]: from='client.54855 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T14:13:41.077 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:13:40 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:13:41.077 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:13:40 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:13:41.078 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:13:40 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:13:41.078 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:13:40 smithi099 ceph-mon[143401]: pgmap v368: 161 pgs: 161 active+clean; 585 KiB data, 266 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T14:13:41.078 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:13:40 smithi099 ceph-mon[143401]: from='client.54855 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T14:13:41.078 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:13:40 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:13:41.078 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:13:40 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:13:41.078 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:13:40 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:13:41.246 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:13:40 smithi181 ceph-mon[115276]: pgmap v368: 161 pgs: 161 active+clean; 585 KiB data, 266 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T14:13:41.246 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:13:40 smithi181 ceph-mon[115276]: from='client.54855 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T14:13:41.247 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:13:40 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:13:41.247 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:13:40 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:13:41.247 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:13:40 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:13:43.077 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:13:42 smithi099 ceph-mon[137093]: pgmap v369: 161 pgs: 161 active+clean; 585 KiB data, 266 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T14:13:43.077 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:13:42 smithi099 ceph-mon[143401]: pgmap v369: 161 pgs: 161 active+clean; 585 KiB data, 266 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T14:13:43.246 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:13:42 smithi181 ceph-mon[115276]: pgmap v369: 161 pgs: 161 active+clean; 585 KiB data, 266 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T14:13:44.813 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:13:44 smithi181 ceph-mon[115276]: pgmap v370: 161 pgs: 161 active+clean; 585 KiB data, 266 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T14:13:45.077 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:13:44 smithi099 ceph-mon[137093]: pgmap v370: 161 pgs: 161 active+clean; 585 KiB data, 266 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T14:13:45.077 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:13:44 smithi099 ceph-mon[143401]: pgmap v370: 161 pgs: 161 active+clean; 585 KiB data, 266 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T14:13:45.078 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 14:13:44 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[71049]: ::ffff:172.21.15.181 - - [30/Mar/2024:14:13:44] "GET /metrics HTTP/1.1" 200 38486 "" "Prometheus/2.43.0" 2024-03-30T14:13:45.972 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:13:45 smithi181 ceph-mon[115276]: pgmap v371: 161 pgs: 161 active+clean; 585 KiB data, 266 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T14:13:46.077 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:13:45 smithi099 ceph-mon[137093]: pgmap v371: 161 pgs: 161 active+clean; 585 KiB data, 266 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T14:13:46.077 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:13:45 smithi099 ceph-mon[143401]: pgmap v371: 161 pgs: 161 active+clean; 585 KiB data, 266 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T14:13:48.746 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:13:48 smithi181 ceph-mon[115276]: pgmap v372: 161 pgs: 161 active+clean; 585 KiB data, 266 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T14:13:48.827 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:13:48 smithi099 ceph-mon[137093]: pgmap v372: 161 pgs: 161 active+clean; 585 KiB data, 266 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T14:13:48.827 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:13:48 smithi099 ceph-mon[143401]: pgmap v372: 161 pgs: 161 active+clean; 585 KiB data, 266 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T14:13:50.678 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:13:50 smithi099 ceph-mon[137093]: pgmap v373: 161 pgs: 161 active+clean; 585 KiB data, 266 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T14:13:50.678 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:13:50 smithi099 ceph-mon[137093]: from='client.54855 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T14:13:50.678 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:13:50 smithi099 ceph-mon[143401]: pgmap v373: 161 pgs: 161 active+clean; 585 KiB data, 266 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T14:13:50.679 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:13:50 smithi099 ceph-mon[143401]: from='client.54855 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T14:13:50.747 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:13:50 smithi181 ceph-mon[115276]: pgmap v373: 161 pgs: 161 active+clean; 585 KiB data, 266 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T14:13:50.747 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:13:50 smithi181 ceph-mon[115276]: from='client.54855 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T14:13:51.998 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:13:51 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:13:51.998 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:13:51 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:13:51.998 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:13:51 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:13:52.077 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:13:51 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:13:52.077 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:13:51 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:13:52.077 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:13:51 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:13:52.078 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:13:51 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:13:52.078 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:13:51 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:13:52.078 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:13:51 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:13:52.996 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:13:52 smithi181 ceph-mon[115276]: pgmap v374: 161 pgs: 161 active+clean; 585 KiB data, 266 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T14:13:52.996 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:13:52 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T14:13:53.014 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:13:52 smithi099 ceph-mon[137093]: pgmap v374: 161 pgs: 161 active+clean; 585 KiB data, 266 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T14:13:53.015 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:13:52 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T14:13:53.015 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:13:52 smithi099 ceph-mon[143401]: pgmap v374: 161 pgs: 161 active+clean; 585 KiB data, 266 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T14:13:53.015 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:13:52 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T14:13:54.996 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:13:54 smithi181 ceph-mon[115276]: pgmap v375: 161 pgs: 161 active+clean; 585 KiB data, 266 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T14:13:55.078 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:13:54 smithi099 ceph-mon[137093]: pgmap v375: 161 pgs: 161 active+clean; 585 KiB data, 266 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T14:13:55.078 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 14:13:54 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[71049]: ::ffff:172.21.15.181 - - [30/Mar/2024:14:13:54] "GET /metrics HTTP/1.1" 200 38488 "" "Prometheus/2.43.0" 2024-03-30T14:13:55.078 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:13:54 smithi099 ceph-mon[143401]: pgmap v375: 161 pgs: 161 active+clean; 585 KiB data, 266 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T14:13:56.996 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:13:56 smithi181 ceph-mon[115276]: pgmap v376: 161 pgs: 161 active+clean; 585 KiB data, 266 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T14:13:57.077 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:13:56 smithi099 ceph-mon[143401]: pgmap v376: 161 pgs: 161 active+clean; 585 KiB data, 266 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T14:13:57.078 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:13:56 smithi099 ceph-mon[137093]: pgmap v376: 161 pgs: 161 active+clean; 585 KiB data, 266 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T14:13:58.996 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:13:58 smithi181 ceph-mon[115276]: pgmap v377: 161 pgs: 161 active+clean; 585 KiB data, 266 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T14:13:59.077 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:13:58 smithi099 ceph-mon[137093]: pgmap v377: 161 pgs: 161 active+clean; 585 KiB data, 266 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T14:13:59.077 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:13:58 smithi099 ceph-mon[143401]: pgmap v377: 161 pgs: 161 active+clean; 585 KiB data, 266 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T14:14:00.996 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:14:00 smithi181 ceph-mon[115276]: pgmap v378: 161 pgs: 161 active+clean; 585 KiB data, 266 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T14:14:00.997 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:14:00 smithi181 ceph-mon[115276]: from='client.54855 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T14:14:00.997 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:14:00 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:14:00.997 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:14:00 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:14:00.997 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:14:00 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:14:00.997 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:14:00 smithi099 ceph-mon[143401]: pgmap v378: 161 pgs: 161 active+clean; 585 KiB data, 266 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T14:14:00.997 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:14:00 smithi099 ceph-mon[143401]: from='client.54855 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T14:14:00.997 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:14:00 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:14:00.997 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:14:00 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:14:00.997 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:14:00 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:14:00.998 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:14:00 smithi099 ceph-mon[137093]: pgmap v378: 161 pgs: 161 active+clean; 585 KiB data, 266 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T14:14:00.998 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:14:00 smithi099 ceph-mon[137093]: from='client.54855 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T14:14:00.998 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:14:00 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:14:00.998 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:14:00 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:14:00.998 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:14:00 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:14:02.996 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:14:02 smithi181 ceph-mon[115276]: pgmap v379: 161 pgs: 161 active+clean; 585 KiB data, 266 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T14:14:03.077 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:14:02 smithi099 ceph-mon[137093]: pgmap v379: 161 pgs: 161 active+clean; 585 KiB data, 266 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T14:14:03.077 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:14:02 smithi099 ceph-mon[143401]: pgmap v379: 161 pgs: 161 active+clean; 585 KiB data, 266 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T14:14:04.949 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:14:04 smithi181 ceph-mon[115276]: pgmap v380: 161 pgs: 161 active+clean; 585 KiB data, 266 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T14:14:05.077 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:14:04 smithi099 ceph-mon[137093]: pgmap v380: 161 pgs: 161 active+clean; 585 KiB data, 266 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T14:14:05.077 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:14:04 smithi099 ceph-mon[143401]: pgmap v380: 161 pgs: 161 active+clean; 585 KiB data, 266 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T14:14:05.078 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 14:14:04 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[71049]: ::ffff:172.21.15.181 - - [30/Mar/2024:14:14:04] "GET /metrics HTTP/1.1" 200 38488 "" "Prometheus/2.43.0" 2024-03-30T14:14:06.997 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:14:06 smithi181 ceph-mon[115276]: pgmap v381: 161 pgs: 161 active+clean; 585 KiB data, 266 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T14:14:07.077 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:14:06 smithi099 ceph-mon[137093]: pgmap v381: 161 pgs: 161 active+clean; 585 KiB data, 266 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T14:14:07.078 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:14:06 smithi099 ceph-mon[143401]: pgmap v381: 161 pgs: 161 active+clean; 585 KiB data, 266 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T14:14:07.996 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:14:07 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T14:14:08.077 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:14:07 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T14:14:08.077 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:14:07 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T14:14:08.996 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:14:08 smithi181 ceph-mon[115276]: pgmap v382: 161 pgs: 161 active+clean; 585 KiB data, 266 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T14:14:09.077 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:14:08 smithi099 ceph-mon[137093]: pgmap v382: 161 pgs: 161 active+clean; 585 KiB data, 266 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T14:14:09.077 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:14:08 smithi099 ceph-mon[143401]: pgmap v382: 161 pgs: 161 active+clean; 585 KiB data, 266 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T14:14:10.570 DEBUG:teuthology.orchestra.run.smithi099:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 98ebaeb8-ee99-11ee-b647-cb9ed24678a4 -e sha1=4e50bbcdd1630c7760b708f3a5b4d38a121e66cb -- bash -c 'ceph orch ps' 2024-03-30T14:14:10.816 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:14:10 smithi099 ceph-mon[143401]: pgmap v383: 161 pgs: 161 active+clean; 585 KiB data, 266 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T14:14:10.816 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:14:10 smithi099 ceph-mon[143401]: from='client.54855 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T14:14:10.817 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:14:10 smithi099 ceph-mon[137093]: pgmap v383: 161 pgs: 161 active+clean; 585 KiB data, 266 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T14:14:10.817 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:14:10 smithi099 ceph-mon[137093]: from='client.54855 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T14:14:10.997 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:14:10 smithi181 ceph-mon[115276]: pgmap v383: 161 pgs: 161 active+clean; 585 KiB data, 266 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T14:14:10.997 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:14:10 smithi181 ceph-mon[115276]: from='client.54855 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T14:14:11.891 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:14:11 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:14:11.892 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:14:11 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:14:11.892 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:14:11 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:14:11.892 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:14:11 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:14:11.892 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:14:11 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:14:11.892 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:14:11 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:14:12.246 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:14:11 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:14:12.246 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:14:11 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:14:12.246 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:14:11 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:14:12.599 INFO:teuthology.orchestra.run.smithi099.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-03-30T14:14:12.599 INFO:teuthology.orchestra.run.smithi099.stdout:agent.smithi099 smithi099 running 1s ago 42m - - 2024-03-30T14:14:12.599 INFO:teuthology.orchestra.run.smithi099.stdout:agent.smithi181 smithi181 running 12s ago 42m - - 2024-03-30T14:14:12.599 INFO:teuthology.orchestra.run.smithi099.stdout:alertmanager.a smithi099 *:9093,9094 running (13m) 1s ago 36m - - 0.25.0 c8568f914cd2 08735152b67d 2024-03-30T14:14:12.599 INFO:teuthology.orchestra.run.smithi099.stdout:grafana.a smithi181 *:3000 running (12m) 12s ago 36m 78.3M - 9.4.12 2bacad6d85d8 d599aa7730d6 2024-03-30T14:14:12.600 INFO:teuthology.orchestra.run.smithi099.stdout:iscsi.foo.smithi099.qyjuvr smithi099 running (83s) 1s ago 35m - - 3.7 b0c4478f1d83 0eeb401a0623 2024-03-30T14:14:12.600 INFO:teuthology.orchestra.run.smithi099.stdout:mgr.x smithi181 *:8443,9283,8765 running (14m) 12s ago 41m 453M - 19.0.0-1967-g4e50bbcd b0c4478f1d83 f269106f7913 2024-03-30T14:14:12.600 INFO:teuthology.orchestra.run.smithi099.stdout:mgr.y smithi099 *:8443,9283,8765 running (25m) 1s ago 43m - - 19.0.0-1967-g4e50bbcd b0c4478f1d83 0d464b8c1d18 2024-03-30T14:14:12.600 INFO:teuthology.orchestra.run.smithi099.stdout:mon.a smithi099 running (10m) 1s ago 43m - 2048M 19.0.0-1967-g4e50bbcd b0c4478f1d83 f19388464dfd 2024-03-30T14:14:12.600 INFO:teuthology.orchestra.run.smithi099.stdout:mon.b smithi181 running (11m) 12s ago 41m 66.8M 2048M 19.0.0-1967-g4e50bbcd b0c4478f1d83 0468ed087cdd 2024-03-30T14:14:12.600 INFO:teuthology.orchestra.run.smithi099.stdout:mon.c smithi099 running (9m) 1s ago 42m - 2048M 19.0.0-1967-g4e50bbcd b0c4478f1d83 731056a2fea6 2024-03-30T14:14:12.600 INFO:teuthology.orchestra.run.smithi099.stdout:node-exporter.a smithi099 *:9100 running (13m) 1s ago 37m - - 1.5.0 0da6a335fe13 4a3f1f6e7068 2024-03-30T14:14:12.600 INFO:teuthology.orchestra.run.smithi099.stdout:node-exporter.b smithi181 *:9100 running (13m) 12s ago 37m 17.2M - 1.5.0 0da6a335fe13 acea317b5f5d 2024-03-30T14:14:12.600 INFO:teuthology.orchestra.run.smithi099.stdout:osd.0 smithi099 running (8m) 1s ago 41m - 4096M 19.0.0-1967-g4e50bbcd b0c4478f1d83 d97d48cb3314 2024-03-30T14:14:12.600 INFO:teuthology.orchestra.run.smithi099.stdout:osd.1 smithi099 running (8m) 1s ago 41m - 4096M 19.0.0-1967-g4e50bbcd b0c4478f1d83 a843295ce83b 2024-03-30T14:14:12.600 INFO:teuthology.orchestra.run.smithi099.stdout:osd.2 smithi099 running (7m) 1s ago 40m - 4096M 19.0.0-1967-g4e50bbcd b0c4478f1d83 18304adfb0d0 2024-03-30T14:14:12.600 INFO:teuthology.orchestra.run.smithi099.stdout:osd.3 smithi099 running (6m) 1s ago 40m - 4096M 19.0.0-1967-g4e50bbcd b0c4478f1d83 9b38d79f070e 2024-03-30T14:14:12.600 INFO:teuthology.orchestra.run.smithi099.stdout:osd.4 smithi181 running (5m) 12s ago 39m 61.1M 4096M 19.0.0-1967-g4e50bbcd b0c4478f1d83 b9078af21e45 2024-03-30T14:14:12.600 INFO:teuthology.orchestra.run.smithi099.stdout:osd.5 smithi181 running (5m) 12s ago 39m 57.2M 4096M 19.0.0-1967-g4e50bbcd b0c4478f1d83 bba176b8db2c 2024-03-30T14:14:12.601 INFO:teuthology.orchestra.run.smithi099.stdout:osd.6 smithi181 running (4m) 12s ago 39m 48.7M 4096M 19.0.0-1967-g4e50bbcd b0c4478f1d83 4a29dfeb4b16 2024-03-30T14:14:12.601 INFO:teuthology.orchestra.run.smithi099.stdout:osd.7 smithi181 running (4m) 12s ago 38m 55.3M 4096M 19.0.0-1967-g4e50bbcd b0c4478f1d83 7940232eb4fe 2024-03-30T14:14:12.601 INFO:teuthology.orchestra.run.smithi099.stdout:prometheus.a smithi181 *:9095 running (13m) 12s ago 37m 70.6M - 2.43.0 a07b618ecd1d 004088bdf70e 2024-03-30T14:14:12.601 INFO:teuthology.orchestra.run.smithi099.stdout:rgw.foo.smithi099.fxjbmp smithi099 *:8000 running (2m) 1s ago 36m - - 19.0.0-1967-g4e50bbcd b0c4478f1d83 d4ba347d41c8 2024-03-30T14:14:12.601 INFO:teuthology.orchestra.run.smithi099.stdout:rgw.foo.smithi181.wfqwti smithi181 *:8000 running (3m) 12s ago 36m 78.2M - 19.0.0-1967-g4e50bbcd b0c4478f1d83 d341398e6f10 2024-03-30T14:14:12.936 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:14:12 smithi099 ceph-mon[137093]: pgmap v384: 161 pgs: 161 active+clean; 585 KiB data, 266 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T14:14:12.936 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:14:12 smithi099 ceph-mon[143401]: pgmap v384: 161 pgs: 161 active+clean; 585 KiB data, 266 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T14:14:13.246 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:14:12 smithi181 ceph-mon[115276]: pgmap v384: 161 pgs: 161 active+clean; 585 KiB data, 266 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T14:14:13.836 DEBUG:teuthology.orchestra.run.smithi099:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 98ebaeb8-ee99-11ee-b647-cb9ed24678a4 -e sha1=4e50bbcdd1630c7760b708f3a5b4d38a121e66cb -- bash -c 'ceph versions' 2024-03-30T14:14:14.077 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:14:13 smithi099 ceph-mon[137093]: from='client.64939 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T14:14:14.078 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:14:13 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-03-30T14:14:14.078 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:14:13 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-03-30T14:14:14.078 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:14:13 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-03-30T14:14:14.078 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:14:13 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-03-30T14:14:14.078 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:14:13 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-03-30T14:14:14.078 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:14:13 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-03-30T14:14:14.078 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:14:13 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-03-30T14:14:14.078 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:14:13 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-03-30T14:14:14.078 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:14:13 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:14:14.078 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:14:13 smithi099 ceph-mon[143401]: from='client.64939 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T14:14:14.079 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:14:13 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-03-30T14:14:14.079 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:14:13 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-03-30T14:14:14.079 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:14:13 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-03-30T14:14:14.079 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:14:13 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-03-30T14:14:14.079 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:14:13 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-03-30T14:14:14.079 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:14:13 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-03-30T14:14:14.079 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:14:13 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-03-30T14:14:14.079 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:14:13 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-03-30T14:14:14.079 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:14:13 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:14:14.246 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:14:13 smithi181 ceph-mon[115276]: from='client.64939 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T14:14:14.246 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:14:13 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-03-30T14:14:14.246 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:14:13 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-03-30T14:14:14.246 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:14:13 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-03-30T14:14:14.247 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:14:13 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-03-30T14:14:14.247 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:14:13 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-03-30T14:14:14.247 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:14:13 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-03-30T14:14:14.247 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:14:13 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-03-30T14:14:14.247 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:14:13 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-03-30T14:14:14.247 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:14:13 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:14:15.077 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 14:14:14 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[71049]: ::ffff:172.21.15.181 - - [30/Mar/2024:14:14:14] "GET /metrics HTTP/1.1" 200 38488 "" "Prometheus/2.43.0" 2024-03-30T14:14:15.077 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:14:14 smithi099 ceph-mon[137093]: pgmap v385: 161 pgs: 161 active+clean; 585 KiB data, 266 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-30T14:14:15.078 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:14:14 smithi099 ceph-mon[137093]: Adjusting osd_memory_target on smithi099 to 2736M 2024-03-30T14:14:15.078 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:14:14 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:14:15.078 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:14:14 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:14:15.078 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:14:14 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-03-30T14:14:15.078 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:14:14 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-03-30T14:14:15.078 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:14:14 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-03-30T14:14:15.078 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:14:14 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-03-30T14:14:15.078 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:14:14 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-03-30T14:14:15.078 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:14:14 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-03-30T14:14:15.078 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:14:14 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-03-30T14:14:15.078 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:14:14 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-03-30T14:14:15.078 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:14:14 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:14:15.078 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:14:14 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:14:15.079 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:14:14 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:14:15.079 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:14:14 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:14:15.079 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:14:14 smithi099 ceph-mon[143401]: pgmap v385: 161 pgs: 161 active+clean; 585 KiB data, 266 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-30T14:14:15.079 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:14:14 smithi099 ceph-mon[143401]: Adjusting osd_memory_target on smithi099 to 2736M 2024-03-30T14:14:15.079 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:14:14 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:14:15.079 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:14:14 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:14:15.079 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:14:14 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-03-30T14:14:15.079 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:14:14 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-03-30T14:14:15.079 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:14:14 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-03-30T14:14:15.079 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:14:14 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-03-30T14:14:15.079 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:14:14 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-03-30T14:14:15.079 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:14:14 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-03-30T14:14:15.079 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:14:14 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-03-30T14:14:15.080 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:14:14 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-03-30T14:14:15.080 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:14:14 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:14:15.080 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:14:14 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:14:15.080 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:14:14 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:14:15.080 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:14:14 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:14:15.246 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:14:14 smithi181 ceph-mon[115276]: pgmap v385: 161 pgs: 161 active+clean; 585 KiB data, 266 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-30T14:14:15.247 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:14:14 smithi181 ceph-mon[115276]: Adjusting osd_memory_target on smithi099 to 2736M 2024-03-30T14:14:15.247 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:14:14 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:14:15.247 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:14:14 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:14:15.247 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:14:14 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-03-30T14:14:15.247 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:14:14 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-03-30T14:14:15.247 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:14:14 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-03-30T14:14:15.247 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:14:14 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-03-30T14:14:15.247 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:14:14 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-03-30T14:14:15.247 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:14:14 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-03-30T14:14:15.247 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:14:14 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-03-30T14:14:15.247 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:14:14 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-03-30T14:14:15.247 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:14:14 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:14:15.248 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:14:14 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-30T14:14:15.248 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:14:14 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-30T14:14:15.248 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:14:14 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:14:16.069 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:14:15 smithi099 ceph-mon[137093]: Adjusting osd_memory_target on smithi181 to 2992M 2024-03-30T14:14:16.070 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:14:15 smithi099 ceph-mon[143401]: Adjusting osd_memory_target on smithi181 to 2992M 2024-03-30T14:14:16.180 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:14:15 smithi181 ceph-mon[115276]: Adjusting osd_memory_target on smithi181 to 2992M 2024-03-30T14:14:16.598 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-03-30T14:14:16.598 INFO:teuthology.orchestra.run.smithi099.stdout: "mon": { 2024-03-30T14:14:16.598 INFO:teuthology.orchestra.run.smithi099.stdout: "ceph version 19.0.0-1967-g4e50bbcd (4e50bbcdd1630c7760b708f3a5b4d38a121e66cb) squid (dev)": 3 2024-03-30T14:14:16.598 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T14:14:16.599 INFO:teuthology.orchestra.run.smithi099.stdout: "mgr": { 2024-03-30T14:14:16.599 INFO:teuthology.orchestra.run.smithi099.stdout: "ceph version 19.0.0-1967-g4e50bbcd (4e50bbcdd1630c7760b708f3a5b4d38a121e66cb) squid (dev)": 2 2024-03-30T14:14:16.599 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T14:14:16.599 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": { 2024-03-30T14:14:16.599 INFO:teuthology.orchestra.run.smithi099.stdout: "ceph version 19.0.0-1967-g4e50bbcd (4e50bbcdd1630c7760b708f3a5b4d38a121e66cb) squid (dev)": 8 2024-03-30T14:14:16.599 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T14:14:16.599 INFO:teuthology.orchestra.run.smithi099.stdout: "rgw": { 2024-03-30T14:14:16.599 INFO:teuthology.orchestra.run.smithi099.stdout: "ceph version 19.0.0-1967-g4e50bbcd (4e50bbcdd1630c7760b708f3a5b4d38a121e66cb) squid (dev)": 2 2024-03-30T14:14:16.599 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-30T14:14:16.599 INFO:teuthology.orchestra.run.smithi099.stdout: "overall": { 2024-03-30T14:14:16.599 INFO:teuthology.orchestra.run.smithi099.stdout: "ceph version 19.0.0-1967-g4e50bbcd (4e50bbcdd1630c7760b708f3a5b4d38a121e66cb) squid (dev)": 15 2024-03-30T14:14:16.599 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-03-30T14:14:16.599 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-03-30T14:14:17.077 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:14:16 smithi099 ceph-mon[143401]: pgmap v386: 161 pgs: 161 active+clean; 585 KiB data, 266 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-30T14:14:17.077 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:14:16 smithi099 ceph-mon[143401]: from='client.? 172.21.15.99:0/1152994430' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:14:17.077 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:14:16 smithi099 ceph-mon[137093]: pgmap v386: 161 pgs: 161 active+clean; 585 KiB data, 266 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-30T14:14:17.077 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:14:16 smithi099 ceph-mon[137093]: from='client.? 172.21.15.99:0/1152994430' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:14:17.246 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:14:16 smithi181 ceph-mon[115276]: pgmap v386: 161 pgs: 161 active+clean; 585 KiB data, 266 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-03-30T14:14:17.246 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:14:16 smithi181 ceph-mon[115276]: from='client.? 172.21.15.99:0/1152994430' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:14:17.594 DEBUG:teuthology.orchestra.run.smithi099:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 98ebaeb8-ee99-11ee-b647-cb9ed24678a4 -e sha1=4e50bbcdd1630c7760b708f3a5b4d38a121e66cb -- bash -c 'ceph orch upgrade status' 2024-03-30T14:14:18.077 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:14:17 smithi099 ceph-mon[143401]: pgmap v387: 161 pgs: 161 active+clean; 585 KiB data, 266 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T14:14:18.077 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:14:17 smithi099 ceph-mon[137093]: pgmap v387: 161 pgs: 161 active+clean; 585 KiB data, 266 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T14:14:18.246 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:14:17 smithi181 ceph-mon[115276]: pgmap v387: 161 pgs: 161 active+clean; 585 KiB data, 266 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T14:14:19.525 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-03-30T14:14:19.526 INFO:teuthology.orchestra.run.smithi099.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph:4e50bbcdd1630c7760b708f3a5b4d38a121e66cb", 2024-03-30T14:14:19.526 INFO:teuthology.orchestra.run.smithi099.stdout: "in_progress": true, 2024-03-30T14:14:19.526 INFO:teuthology.orchestra.run.smithi099.stdout: "which": "Upgrading all daemon types on all hosts", 2024-03-30T14:14:19.526 INFO:teuthology.orchestra.run.smithi099.stdout: "services_complete": [ 2024-03-30T14:14:19.526 INFO:teuthology.orchestra.run.smithi099.stdout: "rgw", 2024-03-30T14:14:19.526 INFO:teuthology.orchestra.run.smithi099.stdout: "mon", 2024-03-30T14:14:19.526 INFO:teuthology.orchestra.run.smithi099.stdout: "osd", 2024-03-30T14:14:19.526 INFO:teuthology.orchestra.run.smithi099.stdout: "mgr", 2024-03-30T14:14:19.526 INFO:teuthology.orchestra.run.smithi099.stdout: "iscsi" 2024-03-30T14:14:19.526 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-03-30T14:14:19.526 INFO:teuthology.orchestra.run.smithi099.stdout: "progress": "16/21 daemons upgraded", 2024-03-30T14:14:19.526 INFO:teuthology.orchestra.run.smithi099.stdout: "message": "Error: UPGRADE_REDEPLOY_DAEMON: Upgrading daemon iscsi.foo.smithi099.qyjuvr on host smithi099 failed.", 2024-03-30T14:14:19.527 INFO:teuthology.orchestra.run.smithi099.stdout: "is_paused": true 2024-03-30T14:14:19.527 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-03-30T14:14:20.180 DEBUG:teuthology.orchestra.run.smithi099:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 98ebaeb8-ee99-11ee-b647-cb9ed24678a4 -e sha1=4e50bbcdd1630c7760b708f3a5b4d38a121e66cb -- bash -c 'ceph health detail' 2024-03-30T14:14:20.490 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:14:20 smithi099 ceph-mon[137093]: pgmap v388: 161 pgs: 161 active+clean; 585 KiB data, 266 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T14:14:20.490 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:14:20 smithi099 ceph-mon[137093]: from='client.54855 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T14:14:20.490 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:14:20 smithi099 ceph-mon[137093]: from='client.64951 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T14:14:20.490 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:14:20 smithi099 ceph-mon[143401]: pgmap v388: 161 pgs: 161 active+clean; 585 KiB data, 266 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T14:14:20.490 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:14:20 smithi099 ceph-mon[143401]: from='client.54855 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T14:14:20.490 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:14:20 smithi099 ceph-mon[143401]: from='client.64951 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T14:14:20.746 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:14:20 smithi181 ceph-mon[115276]: pgmap v388: 161 pgs: 161 active+clean; 585 KiB data, 266 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T14:14:20.746 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:14:20 smithi181 ceph-mon[115276]: from='client.54855 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T14:14:20.746 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:14:20 smithi181 ceph-mon[115276]: from='client.64951 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T14:14:21.688 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:14:21 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:14:21.689 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:14:21 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:14:21.689 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:14:21 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:14:21.689 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:14:21 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:14:21.689 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:14:21 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:14:21.689 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:14:21 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:14:21.880 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:14:21 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:14:21.881 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:14:21 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:14:21.881 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:14:21 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:14:22.202 INFO:teuthology.orchestra.run.smithi099.stdout:HEALTH_WARN Upgrading daemon iscsi.foo.smithi099.qyjuvr on host smithi099 failed. 2024-03-30T14:14:22.203 INFO:teuthology.orchestra.run.smithi099.stdout:[WRN] UPGRADE_REDEPLOY_DAEMON: Upgrading daemon iscsi.foo.smithi099.qyjuvr on host smithi099 failed. 2024-03-30T14:14:22.203 INFO:teuthology.orchestra.run.smithi099.stdout: Upgrade daemon: iscsi.foo.smithi099.qyjuvr: cephadm exited with an error code: 1, stderr: Redeploy daemon iscsi.foo.smithi099.qyjuvr ... 2024-03-30T14:14:22.203 INFO:teuthology.orchestra.run.smithi099.stdout:Creating ceph-iscsi config... 2024-03-30T14:14:22.203 INFO:teuthology.orchestra.run.smithi099.stdout:Write file: /var/lib/ceph/98ebaeb8-ee99-11ee-b647-cb9ed24678a4/iscsi.foo.smithi099.qyjuvr/iscsi-gateway.cfg 2024-03-30T14:14:22.203 INFO:teuthology.orchestra.run.smithi099.stdout:Write file: /var/lib/ceph/98ebaeb8-ee99-11ee-b647-cb9ed24678a4/iscsi.foo.smithi099.qyjuvr/tcmu-runner-entrypoint.sh 2024-03-30T14:14:22.203 INFO:teuthology.orchestra.run.smithi099.stdout:Failed to trim old cgroups /sys/fs/cgroup/system.slice/system-ceph\x2d98ebaeb8\x2dee99\x2d11ee\x2db647\x2dcb9ed24678a4.slice/ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4@iscsi.foo.smithi099.qyjuvr.service 2024-03-30T14:14:22.203 INFO:teuthology.orchestra.run.smithi099.stdout:Non-zero exit code 1 from systemctl start ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4@iscsi.foo.smithi099.qyjuvr 2024-03-30T14:14:22.203 INFO:teuthology.orchestra.run.smithi099.stdout:systemctl: stderr Job for ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4@iscsi.foo.smithi099.qyjuvr.service failed because the control process exited with error code. 2024-03-30T14:14:22.203 INFO:teuthology.orchestra.run.smithi099.stdout:systemctl: stderr See "systemctl status ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4@iscsi.foo.smithi099.qyjuvr.service" and "journalctl -xeu ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4@iscsi.foo.smithi099.qyjuvr.service" for details. 2024-03-30T14:14:22.203 INFO:teuthology.orchestra.run.smithi099.stdout:Traceback (most recent call last): 2024-03-30T14:14:22.203 INFO:teuthology.orchestra.run.smithi099.stdout: File "/usr/lib64/python3.9/runpy.py", line 197, in _run_module_as_main 2024-03-30T14:14:22.203 INFO:teuthology.orchestra.run.smithi099.stdout: return _run_code(code, main_globals, None, 2024-03-30T14:14:22.203 INFO:teuthology.orchestra.run.smithi099.stdout: File "/usr/lib64/python3.9/runpy.py", line 87, in _run_code 2024-03-30T14:14:22.203 INFO:teuthology.orchestra.run.smithi099.stdout: exec(code, run_globals) 2024-03-30T14:14:22.203 INFO:teuthology.orchestra.run.smithi099.stdout: File "/var/lib/ceph/98ebaeb8-ee99-11ee-b647-cb9ed24678a4/cephadm.a8f553f8c0a1bbbd91f4e60c8e13381b6fabffa3561f875fe77bb96af479b3ca/__main__.py", line 5528, in 2024-03-30T14:14:22.204 INFO:teuthology.orchestra.run.smithi099.stdout: File "/var/lib/ceph/98ebaeb8-ee99-11ee-b647-cb9ed24678a4/cephadm.a8f553f8c0a1bbbd91f4e60c8e13381b6fabffa3561f875fe77bb96af479b3ca/__main__.py", line 5516, in main 2024-03-30T14:14:22.204 INFO:teuthology.orchestra.run.smithi099.stdout: File "/var/lib/ceph/98ebaeb8-ee99-11ee-b647-cb9ed24678a4/cephadm.a8f553f8c0a1bbbd91f4e60c8e13381b6fabffa3561f875fe77bb96af479b3ca/__main__.py", line 3040, in command_deploy_from 2024-03-30T14:14:22.204 INFO:teuthology.orchestra.run.smithi099.stdout: File "/var/lib/ceph/98ebaeb8-ee99-11ee-b647-cb9ed24678a4/cephadm.a8f553f8c0a1bbbd91f4e60c8e13381b6fabffa3561f875fe77bb96af479b3ca/__main__.py", line 3075, in _common_deploy 2024-03-30T14:14:22.204 INFO:teuthology.orchestra.run.smithi099.stdout: File "/var/lib/ceph/98ebaeb8-ee99-11ee-b647-cb9ed24678a4/cephadm.a8f553f8c0a1bbbd91f4e60c8e13381b6fabffa3561f875fe77bb96af479b3ca/__main__.py", line 3095, in _deploy_daemon_container 2024-03-30T14:14:22.204 INFO:teuthology.orchestra.run.smithi099.stdout: File "/var/lib/ceph/98ebaeb8-ee99-11ee-b647-cb9ed24678a4/cephadm.a8f553f8c0a1bbbd91f4e60c8e13381b6fabffa3561f875fe77bb96af479b3ca/__main__.py", line 1031, in deploy_daemon 2024-03-30T14:14:22.204 INFO:teuthology.orchestra.run.smithi099.stdout: File "/var/lib/ceph/98ebaeb8-ee99-11ee-b647-cb9ed24678a4/cephadm.a8f553f8c0a1bbbd91f4e60c8e13381b6fabffa3561f875fe77bb96af479b3ca/__main__.py", line 1167, in deploy_daemon_units 2024-03-30T14:14:22.204 INFO:teuthology.orchestra.run.smithi099.stdout: File "/var/lib/ceph/98ebaeb8-ee99-11ee-b647-cb9ed24678a4/cephadm.a8f553f8c0a1bbbd91f4e60c8e13381b6fabffa3561f875fe77bb96af479b3ca/cephadmlib/call_wrappers.py", line 307, in call_throws 2024-03-30T14:14:22.204 INFO:teuthology.orchestra.run.smithi099.stdout:RuntimeError: Failed command: systemctl start ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4@iscsi.foo.smithi099.qyjuvr: Job for ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4@iscsi.foo.smithi099.qyjuvr.service failed because the control process exited with error code. 2024-03-30T14:14:22.204 INFO:teuthology.orchestra.run.smithi099.stdout:See "systemctl status ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4@iscsi.foo.smithi099.qyjuvr.service" and "journalctl -xeu ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4@iscsi.foo.smithi099.qyjuvr.service" for details. 2024-03-30T14:14:22.827 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:14:22 smithi099 ceph-mon[137093]: pgmap v389: 161 pgs: 161 active+clean; 585 KiB data, 266 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T14:14:22.827 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:14:22 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T14:14:22.827 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:14:22 smithi099 ceph-mon[137093]: from='client.? 172.21.15.99:0/1490456424' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-03-30T14:14:22.827 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:14:22 smithi099 ceph-mon[143401]: pgmap v389: 161 pgs: 161 active+clean; 585 KiB data, 266 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T14:14:22.828 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:14:22 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T14:14:22.828 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:14:22 smithi099 ceph-mon[143401]: from='client.? 172.21.15.99:0/1490456424' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-03-30T14:14:22.870 DEBUG:teuthology.orchestra.run.smithi099:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 98ebaeb8-ee99-11ee-b647-cb9ed24678a4 -e sha1=4e50bbcdd1630c7760b708f3a5b4d38a121e66cb -- bash -c 'ceph versions | jq -e '"'"'.overall | length == 1'"'"'' 2024-03-30T14:14:22.996 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:14:22 smithi181 ceph-mon[115276]: pgmap v389: 161 pgs: 161 active+clean; 585 KiB data, 266 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T14:14:22.996 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:14:22 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T14:14:22.996 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:14:22 smithi181 ceph-mon[115276]: from='client.? 172.21.15.99:0/1490456424' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-03-30T14:14:24.746 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:14:24 smithi181 ceph-mon[115276]: pgmap v390: 161 pgs: 161 active+clean; 585 KiB data, 266 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T14:14:24.790 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:14:24 smithi099 ceph-mon[137093]: pgmap v390: 161 pgs: 161 active+clean; 585 KiB data, 266 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T14:14:24.790 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:14:24 smithi099 ceph-mon[143401]: pgmap v390: 161 pgs: 161 active+clean; 585 KiB data, 266 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T14:14:25.006 INFO:teuthology.orchestra.run.smithi099.stdout:true 2024-03-30T14:14:25.077 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 14:14:24 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[71049]: ::ffff:172.21.15.181 - - [30/Mar/2024:14:14:24] "GET /metrics HTTP/1.1" 200 38486 "" "Prometheus/2.43.0" 2024-03-30T14:14:25.826 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:14:25 smithi099 ceph-mon[137093]: from='client.? 172.21.15.99:0/1778825047' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:14:25.826 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:14:25 smithi099 ceph-mon[143401]: from='client.? 172.21.15.99:0/1778825047' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:14:25.856 DEBUG:teuthology.orchestra.run.smithi099:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 98ebaeb8-ee99-11ee-b647-cb9ed24678a4 -e sha1=4e50bbcdd1630c7760b708f3a5b4d38a121e66cb -- bash -c 'ceph versions | jq -e '"'"'.overall | keys'"'"' | grep $sha1' 2024-03-30T14:14:25.934 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:14:25 smithi181 ceph-mon[115276]: from='client.? 172.21.15.99:0/1778825047' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:14:26.827 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:14:26 smithi099 ceph-mon[137093]: pgmap v391: 161 pgs: 161 active+clean; 585 KiB data, 266 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T14:14:26.828 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:14:26 smithi099 ceph-mon[143401]: pgmap v391: 161 pgs: 161 active+clean; 585 KiB data, 266 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T14:14:26.996 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:14:26 smithi181 ceph-mon[115276]: pgmap v391: 161 pgs: 161 active+clean; 585 KiB data, 266 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T14:14:28.061 INFO:teuthology.orchestra.run.smithi099.stdout: "ceph version 19.0.0-1967-g4e50bbcd (4e50bbcdd1630c7760b708f3a5b4d38a121e66cb) squid (dev)" 2024-03-30T14:14:28.667 DEBUG:teuthology.orchestra.run.smithi099:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 98ebaeb8-ee99-11ee-b647-cb9ed24678a4 -e sha1=4e50bbcdd1630c7760b708f3a5b4d38a121e66cb -- bash -c 'ceph orch ls | grep '"'"'^osd '"'"'' 2024-03-30T14:14:28.693 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:14:28 smithi099 ceph-mon[137093]: pgmap v392: 161 pgs: 161 active+clean; 585 KiB data, 266 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T14:14:28.693 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:14:28 smithi099 ceph-mon[137093]: from='client.? 172.21.15.99:0/358984977' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:14:28.693 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:14:28 smithi099 ceph-mon[143401]: pgmap v392: 161 pgs: 161 active+clean; 585 KiB data, 266 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T14:14:28.694 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:14:28 smithi099 ceph-mon[143401]: from='client.? 172.21.15.99:0/358984977' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:14:28.996 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:14:28 smithi181 ceph-mon[115276]: pgmap v392: 161 pgs: 161 active+clean; 585 KiB data, 266 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T14:14:28.996 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:14:28 smithi181 ceph-mon[115276]: from='client.? 172.21.15.99:0/358984977' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-03-30T14:14:30.649 INFO:teuthology.orchestra.run.smithi099.stdout:osd 8 19s ago - 2024-03-30T14:14:30.827 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:14:30 smithi099 ceph-mon[143401]: pgmap v393: 161 pgs: 161 active+clean; 585 KiB data, 266 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T14:14:30.827 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:14:30 smithi099 ceph-mon[143401]: from='client.54855 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T14:14:30.827 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:14:30 smithi099 ceph-mon[137093]: pgmap v393: 161 pgs: 161 active+clean; 585 KiB data, 266 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T14:14:30.827 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:14:30 smithi099 ceph-mon[137093]: from='client.54855 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T14:14:30.996 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:14:30 smithi181 ceph-mon[115276]: pgmap v393: 161 pgs: 161 active+clean; 585 KiB data, 266 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T14:14:30.996 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:14:30 smithi181 ceph-mon[115276]: from='client.54855 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T14:14:31.448 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-03-30T14:14:31.457 INFO:tasks.cephadm:Running commands on role mon.a host ubuntu@smithi099.front.sepia.ceph.com 2024-03-30T14:14:31.457 DEBUG:teuthology.orchestra.run.smithi099:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 98ebaeb8-ee99-11ee-b647-cb9ed24678a4 -- bash -c 'ceph orch upgrade ls' 2024-03-30T14:14:31.746 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:14:31 smithi181 ceph-mon[115276]: from='client.54963 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T14:14:31.746 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:14:31 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:14:31.746 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:14:31 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:14:31.746 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:14:31 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:14:31.798 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:14:31 smithi099 ceph-mon[143401]: from='client.54963 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T14:14:31.799 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:14:31 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:14:31.799 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:14:31 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:14:31.799 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:14:31 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:14:31.799 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:14:31 smithi099 ceph-mon[137093]: from='client.54963 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T14:14:31.799 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:14:31 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:14:31.799 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:14:31 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:14:31.799 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:14:31 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:14:32.773 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:14:32 smithi099 ceph-mon[143401]: pgmap v394: 161 pgs: 161 active+clean; 585 KiB data, 266 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T14:14:32.774 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:14:32 smithi099 ceph-mon[137093]: pgmap v394: 161 pgs: 161 active+clean; 585 KiB data, 266 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T14:14:32.996 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:14:32 smithi181 ceph-mon[115276]: pgmap v394: 161 pgs: 161 active+clean; 585 KiB data, 266 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T14:14:34.109 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-03-30T14:14:34.109 INFO:teuthology.orchestra.run.smithi099.stdout: "image": "quay.io/ceph/ceph", 2024-03-30T14:14:34.110 INFO:teuthology.orchestra.run.smithi099.stdout: "registry": "quay.io", 2024-03-30T14:14:34.110 INFO:teuthology.orchestra.run.smithi099.stdout: "bare_image": "ceph/ceph", 2024-03-30T14:14:34.110 INFO:teuthology.orchestra.run.smithi099.stdout: "versions": [] 2024-03-30T14:14:34.110 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-03-30T14:14:34.789 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:14:34 smithi099 ceph-mon[137093]: pgmap v395: 161 pgs: 161 active+clean; 585 KiB data, 266 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T14:14:34.789 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:14:34 smithi099 ceph-mon[137093]: from='client.54969 -' entity='client.admin' cmd=[{"prefix": "orch upgrade ls", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T14:14:34.789 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:14:34 smithi099 ceph-mon[143401]: pgmap v395: 161 pgs: 161 active+clean; 585 KiB data, 266 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T14:14:34.789 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:14:34 smithi099 ceph-mon[143401]: from='client.54969 -' entity='client.admin' cmd=[{"prefix": "orch upgrade ls", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T14:14:34.996 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:14:34 smithi181 ceph-mon[115276]: pgmap v395: 161 pgs: 161 active+clean; 585 KiB data, 266 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T14:14:34.996 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:14:34 smithi181 ceph-mon[115276]: from='client.54969 -' entity='client.admin' cmd=[{"prefix": "orch upgrade ls", "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T14:14:35.077 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 14:14:34 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[71049]: ::ffff:172.21.15.181 - - [30/Mar/2024:14:14:34] "GET /metrics HTTP/1.1" 200 38486 "" "Prometheus/2.43.0" 2024-03-30T14:14:35.277 DEBUG:teuthology.orchestra.run.smithi099:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 98ebaeb8-ee99-11ee-b647-cb9ed24678a4 -- bash -c 'ceph orch upgrade ls --image quay.io/ceph/ceph --show-all-versions | grep 16.2.0' 2024-03-30T14:14:36.746 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:14:36 smithi099 ceph-mon[137093]: pgmap v396: 161 pgs: 161 active+clean; 585 KiB data, 266 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T14:14:36.746 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:14:36 smithi099 ceph-mon[143401]: pgmap v396: 161 pgs: 161 active+clean; 585 KiB data, 266 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T14:14:36.996 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:14:36 smithi181 ceph-mon[115276]: pgmap v396: 161 pgs: 161 active+clean; 585 KiB data, 266 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T14:14:37.827 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:14:37 smithi099 ceph-mon[137093]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T14:14:37.828 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:14:37 smithi099 ceph-mon[143401]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T14:14:37.996 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:14:37 smithi181 ceph-mon[115276]: from='mgr.44103 172.21.15.99:0/1791722413' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-30T14:14:38.827 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:14:38 smithi099 ceph-mon[137093]: pgmap v397: 161 pgs: 161 active+clean; 585 KiB data, 266 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T14:14:38.828 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:14:38 smithi099 ceph-mon[143401]: pgmap v397: 161 pgs: 161 active+clean; 585 KiB data, 266 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T14:14:38.996 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:14:38 smithi181 ceph-mon[115276]: pgmap v397: 161 pgs: 161 active+clean; 585 KiB data, 266 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T14:14:39.180 INFO:teuthology.orchestra.run.smithi099.stdout: "16.2.0", 2024-03-30T14:14:39.827 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:14:39 smithi099 ceph-mon[137093]: from='client.54975 -' entity='client.admin' cmd=[{"prefix": "orch upgrade ls", "image": "quay.io/ceph/ceph", "show_all_versions": true, "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T14:14:39.827 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:14:39 smithi099 ceph-mon[143401]: from='client.54975 -' entity='client.admin' cmd=[{"prefix": "orch upgrade ls", "image": "quay.io/ceph/ceph", "show_all_versions": true, "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T14:14:39.853 DEBUG:teuthology.orchestra.run.smithi099:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 98ebaeb8-ee99-11ee-b647-cb9ed24678a4 -- bash -c 'ceph orch upgrade ls --image quay.io/ceph/ceph --tags | grep v16.2.2' 2024-03-30T14:14:39.996 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:14:39 smithi181 ceph-mon[115276]: from='client.54975 -' entity='client.admin' cmd=[{"prefix": "orch upgrade ls", "image": "quay.io/ceph/ceph", "show_all_versions": true, "target": ["mon-mgr", ""]}]: dispatch 2024-03-30T14:14:40.827 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:14:40 smithi099 ceph-mon[137093]: pgmap v398: 161 pgs: 161 active+clean; 585 KiB data, 266 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T14:14:40.827 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:14:40 smithi099 ceph-mon[137093]: from='client.54855 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T14:14:40.827 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:14:40 smithi099 ceph-mon[143401]: pgmap v398: 161 pgs: 161 active+clean; 585 KiB data, 266 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T14:14:40.827 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:14:40 smithi099 ceph-mon[143401]: from='client.54855 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T14:14:40.996 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:14:40 smithi181 ceph-mon[115276]: pgmap v398: 161 pgs: 161 active+clean; 585 KiB data, 266 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-03-30T14:14:40.996 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:14:40 smithi181 ceph-mon[115276]: from='client.54855 -' entity='client.iscsi.foo.smithi099.qyjuvr' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-03-30T14:14:41.827 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:14:41 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:14:41.827 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:14:41 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:14:41.827 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:14:41 smithi099 ceph-mon[137093]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:14:41.827 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:14:41 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:14:41.828 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:14:41 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:14:41.828 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:14:41 smithi099 ceph-mon[143401]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:14:41.996 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:14:41 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:14:41.996 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:14:41 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:14:41.996 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:14:41 smithi181 ceph-mon[115276]: from='mgr.44103 ' entity='mgr.y' 2024-03-30T14:14:42.492 INFO:teuthology.orchestra.run.smithi099.stdout: "v16.2.2", 2024-03-30T14:14:42.493 INFO:teuthology.orchestra.run.smithi099.stdout: "v16.2.2-20210505", 2024-03-30T14:14:42.827 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:14:42 smithi099 ceph-mon[137093]: pgmap v399: 161 pgs: 161 active+clean; 585 KiB data, 266 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T14:14:42.827 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:14:42 smithi099 ceph-mon[143401]: pgmap v399: 161 pgs: 161 active+clean; 585 KiB data, 266 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T14:14:42.996 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:14:42 smithi181 ceph-mon[115276]: pgmap v399: 161 pgs: 161 active+clean; 585 KiB data, 266 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-03-30T14:14:43.120 DEBUG:teuthology.run_tasks:Unwinding manager cephadm 2024-03-30T14:14:43.130 INFO:tasks.cephadm:Teardown begin 2024-03-30T14:14:43.130 DEBUG:teuthology.orchestra.run.smithi099:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-03-30T14:14:43.167 DEBUG:teuthology.orchestra.run.smithi181:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-03-30T14:14:43.210 INFO:tasks.cephadm:Cleaning up testdir ceph.* files... 2024-03-30T14:14:43.210 DEBUG:teuthology.orchestra.run.smithi099:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-03-30T14:14:43.227 DEBUG:teuthology.orchestra.run.smithi181:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-03-30T14:14:43.267 INFO:tasks.cephadm:Stopping all daemons... 2024-03-30T14:14:43.267 INFO:tasks.cephadm.mon.a:Stopping mon.a... 2024-03-30T14:14:43.267 DEBUG:teuthology.orchestra.run.smithi099:> sudo systemctl stop ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4@mon.a 2024-03-30T14:14:43.572 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:14:43 smithi099 systemd[1]: Stopping Ceph mon.a for 98ebaeb8-ee99-11ee-b647-cb9ed24678a4... 2024-03-30T14:14:43.827 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:14:43 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mon-a[137068]: 2024-03-30T14:14:43.579+0000 7fd278fa7700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-03-30T14:14:43.827 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:14:43 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mon-a[137068]: 2024-03-30T14:14:43.579+0000 7fd278fa7700 -1 mon.a@0(leader) e4 *** Got Signal Terminated *** 2024-03-30T14:14:43.827 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:14:43 smithi099 podman[207218]: 2024-03-30 14:14:43.702976732 +0000 UTC m=+0.234899838 container died f19388464dfd748aa01003e3f475731ec12333ca4d1d17c4de98678bf70c5574 (image=quay.ceph.io/ceph-ci/ceph:4e50bbcdd1630c7760b708f3a5b4d38a121e66cb, name=ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mon-a, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, RELEASE=squid-4e50bbc, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, io.buildah.version=1.33.5, org.label-schema.build-date=20240326, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_CLEAN=True, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-03-30T14:14:44.327 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:14:44 smithi099 podman[207218]: 2024-03-30 14:14:44.197155989 +0000 UTC m=+0.729079101 container cleanup f19388464dfd748aa01003e3f475731ec12333ca4d1d17c4de98678bf70c5574 (image=quay.ceph.io/ceph-ci/ceph:4e50bbcdd1630c7760b708f3a5b4d38a121e66cb, name=ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mon-a, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_BRANCH=HEAD, RELEASE=squid-4e50bbc, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, org.label-schema.build-date=20240326, org.label-schema.license=GPLv2, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0) 2024-03-30T14:14:44.327 INFO:journalctl@ceph.mon.a.smithi099.stdout:Mar 30 14:14:44 smithi099 bash[207218]: ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mon-a 2024-03-30T14:14:44.535 DEBUG:teuthology.orchestra.run.smithi099:> sudo pkill -f 'journalctl -f -n 0 -u ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4@mon.a.service' 2024-03-30T14:14:44.591 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-03-30T14:14:44.591 INFO:tasks.cephadm.mon.a:Stopped mon.a 2024-03-30T14:14:44.591 INFO:tasks.cephadm.mon.b:Stopping mon.c... 2024-03-30T14:14:44.591 DEBUG:teuthology.orchestra.run.smithi099:> sudo systemctl stop ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4@mon.c 2024-03-30T14:14:44.788 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:14:44 smithi099 systemd[1]: Stopping Ceph mon.c for 98ebaeb8-ee99-11ee-b647-cb9ed24678a4... 2024-03-30T14:14:45.077 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 14:14:44 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[71049]: ::ffff:172.21.15.181 - - [30/Mar/2024:14:14:44] "GET /metrics HTTP/1.1" 200 38488 "" "Prometheus/2.43.0" 2024-03-30T14:14:45.077 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:14:44 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mon-c[143397]: 2024-03-30T14:14:44.892+0000 7f22840ea700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.c -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-03-30T14:14:45.077 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:14:44 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mon-c[143397]: 2024-03-30T14:14:44.892+0000 7f22840ea700 -1 mon.c@1(peon) e4 *** Got Signal Terminated *** 2024-03-30T14:14:45.077 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:14:44 smithi099 podman[207339]: 2024-03-30 14:14:44.934286034 +0000 UTC m=+0.152223196 container died 731056a2fea67aba1b837e3115a42a524b21192422c27317f49443181f265527 (image=quay.ceph.io/ceph-ci/ceph:4e50bbcdd1630c7760b708f3a5b4d38a121e66cb, name=ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mon-c, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240326, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, ceph=True, org.label-schema.schema-version=1.0, RELEASE=squid-4e50bbc, io.buildah.version=1.33.5, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux ) 2024-03-30T14:14:45.569 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:14:45 smithi099 podman[207339]: 2024-03-30 14:14:45.285291716 +0000 UTC m=+0.503228870 container cleanup 731056a2fea67aba1b837e3115a42a524b21192422c27317f49443181f265527 (image=quay.ceph.io/ceph-ci/ceph:4e50bbcdd1630c7760b708f3a5b4d38a121e66cb, name=ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mon-c, RELEASE=squid-4e50bbc, org.label-schema.build-date=20240326, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, ceph=True) 2024-03-30T14:14:45.569 INFO:journalctl@ceph.mon.c.smithi099.stdout:Mar 30 14:14:45 smithi099 bash[207339]: ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mon-c 2024-03-30T14:14:45.695 DEBUG:teuthology.orchestra.run.smithi099:> sudo pkill -f 'journalctl -f -n 0 -u ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4@mon.c.service' 2024-03-30T14:14:45.731 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-03-30T14:14:45.732 INFO:tasks.cephadm.mon.b:Stopped mon.c 2024-03-30T14:14:45.732 INFO:tasks.cephadm.mon.b:Stopping mon.b... 2024-03-30T14:14:45.732 DEBUG:teuthology.orchestra.run.smithi181:> sudo systemctl stop ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4@mon.b 2024-03-30T14:14:45.996 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:14:45 smithi181 systemd[1]: Stopping Ceph mon.b for 98ebaeb8-ee99-11ee-b647-cb9ed24678a4... 2024-03-30T14:14:46.293 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:14:46 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mon-b[115272]: 2024-03-30T14:14:46.239+0000 7f7c36597700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.b -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-03-30T14:14:46.293 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:14:46 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mon-b[115272]: 2024-03-30T14:14:46.239+0000 7f7c36597700 -1 mon.b@2(peon) e4 *** Got Signal Terminated *** 2024-03-30T14:14:46.559 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:14:46 smithi181 podman[177188]: 2024-03-30 14:14:46.301908167 +0000 UTC m=+0.185151819 container died 0468ed087cdd924e714de865c81d64cccd9fd88310697053bba1f6bd75544474 (image=quay.ceph.io/ceph-ci/ceph:4e50bbcdd1630c7760b708f3a5b4d38a121e66cb, name=ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mon-b, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.build-date=20240326, org.label-schema.vendor=CentOS, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, GIT_CLEAN=True, RELEASE=squid-4e50bbc, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True) 2024-03-30T14:14:46.893 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:14:46 smithi181 podman[177188]: 2024-03-30 14:14:46.749900401 +0000 UTC m=+0.633144056 container cleanup 0468ed087cdd924e714de865c81d64cccd9fd88310697053bba1f6bd75544474 (image=quay.ceph.io/ceph-ci/ceph:4e50bbcdd1630c7760b708f3a5b4d38a121e66cb, name=ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mon-b, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, org.label-schema.build-date=20240326, RELEASE=squid-4e50bbc, org.label-schema.schema-version=1.0, ceph=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-03-30T14:14:46.893 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:14:46 smithi181 bash[177188]: ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mon-b 2024-03-30T14:14:47.497 INFO:journalctl@ceph.mon.b.smithi181.stdout:Mar 30 14:14:47 smithi181 podman[177214]: 2024-03-30 14:14:47.252735288 +0000 UTC m=+0.955485428 container remove 0468ed087cdd924e714de865c81d64cccd9fd88310697053bba1f6bd75544474 (image=quay.ceph.io/ceph-ci/ceph:4e50bbcdd1630c7760b708f3a5b4d38a121e66cb, name=ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mon-b, ceph=True, org.label-schema.build-date=20240326, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_CLEAN=True, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, RELEASE=squid-4e50bbc, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=) 2024-03-30T14:14:47.700 DEBUG:teuthology.orchestra.run.smithi181:> sudo pkill -f 'journalctl -f -n 0 -u ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4@mon.b.service' 2024-03-30T14:14:47.753 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-03-30T14:14:47.753 INFO:tasks.cephadm.mon.b:Stopped mon.b 2024-03-30T14:14:47.754 INFO:tasks.cephadm.mgr.y:Stopping mgr.y... 2024-03-30T14:14:47.754 DEBUG:teuthology.orchestra.run.smithi099:> sudo systemctl stop ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4@mgr.y 2024-03-30T14:14:48.077 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 14:14:47 smithi099 systemd[1]: Stopping Ceph mgr.y for 98ebaeb8-ee99-11ee-b647-cb9ed24678a4... 2024-03-30T14:14:48.511 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 14:14:48 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[71049]: 2024-03-30T14:14:48.208+0000 7f3c3f155700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mgr -n mgr.y -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-03-30T14:14:48.511 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 14:14:48 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y[71049]: 2024-03-30T14:14:48.208+0000 7f3c3f155700 -1 mgr handle_mgr_signal *** Got signal Terminated *** 2024-03-30T14:14:48.511 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 14:14:48 smithi099 podman[207783]: 2024-03-30 14:14:48.251776907 +0000 UTC m=+0.281112393 container died 0d464b8c1d1843df7d6f4d612d968f8d930994e8c5eb6c5e932f271d4e381b6f (image=quay.ceph.io/ceph-ci/ceph:4e50bbcdd1630c7760b708f3a5b4d38a121e66cb, name=ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, org.label-schema.build-date=20240326, GIT_BRANCH=HEAD, ceph=True, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=squid-4e50bbc) 2024-03-30T14:14:48.827 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 14:14:48 smithi099 podman[207783]: 2024-03-30 14:14:48.72799045 +0000 UTC m=+0.757325968 container cleanup 0d464b8c1d1843df7d6f4d612d968f8d930994e8c5eb6c5e932f271d4e381b6f (image=quay.ceph.io/ceph-ci/ceph:4e50bbcdd1630c7760b708f3a5b4d38a121e66cb, name=ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y, org.label-schema.build-date=20240326, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, CEPH_POINT_RELEASE=, RELEASE=squid-4e50bbc, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-03-30T14:14:48.827 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 14:14:48 smithi099 bash[207783]: ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y 2024-03-30T14:14:49.272 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Mar 30 14:14:49 smithi099 podman[207814]: 2024-03-30 14:14:49.00460384 +0000 UTC m=+0.753756276 container remove 0d464b8c1d1843df7d6f4d612d968f8d930994e8c5eb6c5e932f271d4e381b6f (image=quay.ceph.io/ceph-ci/ceph:4e50bbcdd1630c7760b708f3a5b4d38a121e66cb, name=ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-y, GIT_CLEAN=True, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, ceph=True, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, RELEASE=squid-4e50bbc, org.label-schema.build-date=20240326, org.label-schema.license=GPLv2) 2024-03-30T14:14:49.771 DEBUG:teuthology.orchestra.run.smithi099:> sudo pkill -f 'journalctl -f -n 0 -u ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4@mgr.y.service' 2024-03-30T14:14:49.813 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-03-30T14:14:49.813 INFO:tasks.cephadm.mgr.y:Stopped mgr.y 2024-03-30T14:14:49.814 INFO:tasks.cephadm.mgr.x:Stopping mgr.x... 2024-03-30T14:14:49.814 DEBUG:teuthology.orchestra.run.smithi181:> sudo systemctl stop ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4@mgr.x 2024-03-30T14:14:50.138 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 14:14:49 smithi181 systemd[1]: Stopping Ceph mgr.x for 98ebaeb8-ee99-11ee-b647-cb9ed24678a4... 2024-03-30T14:14:50.409 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 14:14:50 smithi181 podman[177366]: 2024-03-30 14:14:50.147975215 +0000 UTC m=+0.128581320 container died f269106f7913e6f6e452ac36855055176d6269bc34accbaf1826e21b6952c745 (image=quay.ceph.io/ceph-ci/ceph:4e50bbcdd1630c7760b708f3a5b4d38a121e66cb, name=ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-x, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=squid-4e50bbc, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240326, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, GIT_CLEAN=True, GIT_BRANCH=HEAD) 2024-03-30T14:14:50.746 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 14:14:50 smithi181 podman[177366]: 2024-03-30 14:14:50.508605781 +0000 UTC m=+0.489211859 container cleanup f269106f7913e6f6e452ac36855055176d6269bc34accbaf1826e21b6952c745 (image=quay.ceph.io/ceph-ci/ceph:4e50bbcdd1630c7760b708f3a5b4d38a121e66cb, name=ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-x, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240326, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, RELEASE=squid-4e50bbc, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, GIT_CLEAN=True, GIT_BRANCH=HEAD, ceph=True) 2024-03-30T14:14:50.746 INFO:journalctl@ceph.mgr.x.smithi181.stdout:Mar 30 14:14:50 smithi181 bash[177366]: ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-mgr-x 2024-03-30T14:14:50.894 DEBUG:teuthology.orchestra.run.smithi181:> sudo pkill -f 'journalctl -f -n 0 -u ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4@mgr.x.service' 2024-03-30T14:14:50.933 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-03-30T14:14:50.933 INFO:tasks.cephadm.mgr.x:Stopped mgr.x 2024-03-30T14:14:50.933 INFO:tasks.cephadm.osd.0:Stopping osd.0... 2024-03-30T14:14:50.934 DEBUG:teuthology.orchestra.run.smithi099:> sudo systemctl stop ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4@osd.0 2024-03-30T14:14:51.246 INFO:journalctl@ceph.osd.0.smithi099.stdout:Mar 30 14:14:50 smithi099 systemd[1]: Stopping Ceph osd.0 for 98ebaeb8-ee99-11ee-b647-cb9ed24678a4... 2024-03-30T14:14:51.577 INFO:journalctl@ceph.osd.0.smithi099.stdout:Mar 30 14:14:51 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-0[148404]: 2024-03-30T14:14:51.375+0000 7fc385fa6700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.0 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-03-30T14:14:51.577 INFO:journalctl@ceph.osd.0.smithi099.stdout:Mar 30 14:14:51 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-0[148404]: 2024-03-30T14:14:51.375+0000 7fc385fa6700 -1 osd.0 160 *** Got signal Terminated *** 2024-03-30T14:14:51.577 INFO:journalctl@ceph.osd.0.smithi099.stdout:Mar 30 14:14:51 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-0[148404]: 2024-03-30T14:14:51.375+0000 7fc385fa6700 -1 osd.0 160 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-03-30T14:14:57.077 INFO:journalctl@ceph.osd.0.smithi099.stdout:Mar 30 14:14:56 smithi099 podman[208181]: 2024-03-30 14:14:56.791254966 +0000 UTC m=+5.514675517 container died d97d48cb3314924ffef1baf7f781dee8c324f566cda9181c75dcc0fcb889b8e6 (image=quay.ceph.io/ceph-ci/ceph:4e50bbcdd1630c7760b708f3a5b4d38a121e66cb, name=ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-0, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240326, org.label-schema.license=GPLv2, GIT_CLEAN=True, io.buildah.version=1.33.5, RELEASE=squid-4e50bbc, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, maintainer=Guillaume Abrioux ) 2024-03-30T14:14:57.463 INFO:journalctl@ceph.osd.0.smithi099.stdout:Mar 30 14:14:57 smithi099 podman[208181]: 2024-03-30 14:14:57.220878233 +0000 UTC m=+5.944298768 container cleanup d97d48cb3314924ffef1baf7f781dee8c324f566cda9181c75dcc0fcb889b8e6 (image=quay.ceph.io/ceph-ci/ceph:4e50bbcdd1630c7760b708f3a5b4d38a121e66cb, name=ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-0, RELEASE=squid-4e50bbc, org.label-schema.build-date=20240326, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.vendor=CentOS, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-03-30T14:14:57.463 INFO:journalctl@ceph.osd.0.smithi099.stdout:Mar 30 14:14:57 smithi099 bash[208181]: ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-0 2024-03-30T14:14:57.783 INFO:journalctl@ceph.osd.0.smithi099.stdout:Mar 30 14:14:57 smithi099 podman[208266]: 2024-03-30 14:14:57.472626302 +0000 UTC m=+0.677326509 container remove d97d48cb3314924ffef1baf7f781dee8c324f566cda9181c75dcc0fcb889b8e6 (image=quay.ceph.io/ceph-ci/ceph:4e50bbcdd1630c7760b708f3a5b4d38a121e66cb, name=ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-0, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240326, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=squid-4e50bbc, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_BRANCH=HEAD, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, GIT_CLEAN=True, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=) 2024-03-30T14:14:58.663 INFO:journalctl@ceph.osd.0.smithi099.stdout:Mar 30 14:14:58 smithi099 podman[208421]: 2024-03-30 14:14:58.319072846 +0000 UTC m=+0.017696782 image pull b0c4478f1d83795df4d538bf108aee5fac57194348fb16dcdbb3115f3e2fe95e quay.ceph.io/ceph-ci/ceph:4e50bbcdd1630c7760b708f3a5b4d38a121e66cb 2024-03-30T14:14:58.663 INFO:journalctl@ceph.osd.0.smithi099.stdout:Mar 30 14:14:58 smithi099 podman[208421]: 2024-03-30 14:14:58.44376481 +0000 UTC m=+0.142388743 container create 42c0522f29dbd9fb82437422ca2335a24c1d1cb653d198c828702e5008d2535d (image=quay.ceph.io/ceph-ci/ceph:4e50bbcdd1630c7760b708f3a5b4d38a121e66cb, name=ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-0-deactivate, ceph=True, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-4e50bbc, io.buildah.version=1.33.5, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, org.label-schema.build-date=20240326) 2024-03-30T14:14:58.663 INFO:journalctl@ceph.osd.0.smithi099.stdout:Mar 30 14:14:58 smithi099 podman[208421]: 2024-03-30 14:14:58.67187828 +0000 UTC m=+0.370502222 container init 42c0522f29dbd9fb82437422ca2335a24c1d1cb653d198c828702e5008d2535d (image=quay.ceph.io/ceph-ci/ceph:4e50bbcdd1630c7760b708f3a5b4d38a121e66cb, name=ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-0-deactivate, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240326, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, GIT_BRANCH=HEAD, RELEASE=squid-4e50bbc, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, ceph=True) 2024-03-30T14:14:58.953 INFO:journalctl@ceph.osd.0.smithi099.stdout:Mar 30 14:14:58 smithi099 podman[208421]: 2024-03-30 14:14:58.675359657 +0000 UTC m=+0.373983590 container start 42c0522f29dbd9fb82437422ca2335a24c1d1cb653d198c828702e5008d2535d (image=quay.ceph.io/ceph-ci/ceph:4e50bbcdd1630c7760b708f3a5b4d38a121e66cb, name=ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-0-deactivate, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, CEPH_POINT_RELEASE=, ceph=True, io.buildah.version=1.33.5, org.label-schema.build-date=20240326, RELEASE=squid-4e50bbc, GIT_CLEAN=True, maintainer=Guillaume Abrioux ) 2024-03-30T14:14:58.953 INFO:journalctl@ceph.osd.0.smithi099.stdout:Mar 30 14:14:58 smithi099 podman[208421]: 2024-03-30 14:14:58.771475771 +0000 UTC m=+0.470099722 container attach 42c0522f29dbd9fb82437422ca2335a24c1d1cb653d198c828702e5008d2535d (image=quay.ceph.io/ceph-ci/ceph:4e50bbcdd1630c7760b708f3a5b4d38a121e66cb, name=ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-0-deactivate, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.schema-version=1.0, GIT_CLEAN=True, RELEASE=squid-4e50bbc, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240326, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, org.label-schema.vendor=CentOS) 2024-03-30T14:14:59.327 INFO:journalctl@ceph.osd.0.smithi099.stdout:Mar 30 14:14:58 smithi099 podman[208421]: 2024-03-30 14:14:58.962304604 +0000 UTC m=+0.660928540 container died 42c0522f29dbd9fb82437422ca2335a24c1d1cb653d198c828702e5008d2535d (image=quay.ceph.io/ceph-ci/ceph:4e50bbcdd1630c7760b708f3a5b4d38a121e66cb, name=ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-0-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, RELEASE=squid-4e50bbc, org.label-schema.build-date=20240326, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, ceph=True, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5) 2024-03-30T14:14:59.573 DEBUG:teuthology.orchestra.run.smithi099:> sudo pkill -f 'journalctl -f -n 0 -u ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4@osd.0.service' 2024-03-30T14:14:59.600 INFO:journalctl@ceph.osd.0.smithi099.stdout:Mar 30 14:14:59 smithi099 podman[208448]: 2024-03-30 14:14:59.558347316 +0000 UTC m=+0.590205184 container remove 42c0522f29dbd9fb82437422ca2335a24c1d1cb653d198c828702e5008d2535d (image=quay.ceph.io/ceph-ci/ceph:4e50bbcdd1630c7760b708f3a5b4d38a121e66cb, name=ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-0-deactivate, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240326, org.label-schema.license=GPLv2, GIT_CLEAN=True, RELEASE=squid-4e50bbc, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , ceph=True, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-03-30T14:14:59.600 INFO:journalctl@ceph.osd.0.smithi099.stdout:Mar 30 14:14:59 smithi099 systemd[1]: ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4@osd.0.service: Deactivated successfully. 2024-03-30T14:14:59.600 INFO:journalctl@ceph.osd.0.smithi099.stdout:Mar 30 14:14:59 smithi099 systemd[1]: Stopped Ceph osd.0 for 98ebaeb8-ee99-11ee-b647-cb9ed24678a4. 2024-03-30T14:14:59.600 INFO:journalctl@ceph.osd.0.smithi099.stdout:Mar 30 14:14:59 smithi099 systemd[1]: ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4@osd.0.service: Consumed 6.978s CPU time. 2024-03-30T14:14:59.617 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-03-30T14:14:59.618 INFO:tasks.cephadm.osd.0:Stopped osd.0 2024-03-30T14:14:59.618 INFO:tasks.cephadm.osd.1:Stopping osd.1... 2024-03-30T14:14:59.618 DEBUG:teuthology.orchestra.run.smithi099:> sudo systemctl stop ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4@osd.1 2024-03-30T14:14:59.936 INFO:journalctl@ceph.osd.1.smithi099.stdout:Mar 30 14:14:59 smithi099 systemd[1]: Stopping Ceph osd.1 for 98ebaeb8-ee99-11ee-b647-cb9ed24678a4... 2024-03-30T14:15:00.327 INFO:journalctl@ceph.osd.1.smithi099.stdout:Mar 30 14:14:59 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-1[155899]: 2024-03-30T14:14:59.944+0000 7f97b5c02700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.1 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-03-30T14:15:00.327 INFO:journalctl@ceph.osd.1.smithi099.stdout:Mar 30 14:14:59 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-1[155899]: 2024-03-30T14:14:59.944+0000 7f97b5c02700 -1 osd.1 160 *** Got signal Terminated *** 2024-03-30T14:15:00.327 INFO:journalctl@ceph.osd.1.smithi099.stdout:Mar 30 14:14:59 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-1[155899]: 2024-03-30T14:14:59.944+0000 7f97b5c02700 -1 osd.1 160 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-03-30T14:15:05.620 INFO:journalctl@ceph.osd.1.smithi099.stdout:Mar 30 14:15:05 smithi099 podman[208527]: 2024-03-30 14:15:05.353529293 +0000 UTC m=+5.503625918 container died a843295ce83b8cc69fab77d5b26f3d9b6d05835c183c2dec6ed48cf4c670cb70 (image=quay.ceph.io/ceph-ci/ceph:4e50bbcdd1630c7760b708f3a5b4d38a121e66cb, name=ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-1, GIT_BRANCH=HEAD, org.label-schema.build-date=20240326, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, GIT_CLEAN=True, org.label-schema.schema-version=1.0, RELEASE=squid-4e50bbc, maintainer=Guillaume Abrioux , ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=) 2024-03-30T14:15:06.011 INFO:journalctl@ceph.osd.1.smithi099.stdout:Mar 30 14:15:05 smithi099 podman[208527]: 2024-03-30 14:15:05.794326401 +0000 UTC m=+5.944423027 container cleanup a843295ce83b8cc69fab77d5b26f3d9b6d05835c183c2dec6ed48cf4c670cb70 (image=quay.ceph.io/ceph-ci/ceph:4e50bbcdd1630c7760b708f3a5b4d38a121e66cb, name=ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-1, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-4e50bbc, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240326, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, org.label-schema.license=GPLv2) 2024-03-30T14:15:06.012 INFO:journalctl@ceph.osd.1.smithi099.stdout:Mar 30 14:15:05 smithi099 bash[208527]: ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-1 2024-03-30T14:15:06.327 INFO:journalctl@ceph.osd.1.smithi099.stdout:Mar 30 14:15:06 smithi099 podman[208544]: 2024-03-30 14:15:06.02074791 +0000 UTC m=+0.660447529 container remove a843295ce83b8cc69fab77d5b26f3d9b6d05835c183c2dec6ed48cf4c670cb70 (image=quay.ceph.io/ceph-ci/ceph:4e50bbcdd1630c7760b708f3a5b4d38a121e66cb, name=ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-1, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, org.label-schema.license=GPLv2, GIT_CLEAN=True, RELEASE=squid-4e50bbc, org.label-schema.build-date=20240326, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux ) 2024-03-30T14:15:06.912 INFO:journalctl@ceph.osd.1.smithi099.stdout:Mar 30 14:15:06 smithi099 podman[208641]: 2024-03-30 14:15:06.35358033 +0000 UTC m=+0.017741792 image pull b0c4478f1d83795df4d538bf108aee5fac57194348fb16dcdbb3115f3e2fe95e quay.ceph.io/ceph-ci/ceph:4e50bbcdd1630c7760b708f3a5b4d38a121e66cb 2024-03-30T14:15:06.912 INFO:journalctl@ceph.osd.1.smithi099.stdout:Mar 30 14:15:06 smithi099 podman[208641]: 2024-03-30 14:15:06.454942153 +0000 UTC m=+0.119103638 container create 2bdeb99ca58a3a8540b0ea953ab3a873eb44c7ab1499389138064d1e92eb7fb5 (image=quay.ceph.io/ceph-ci/ceph:4e50bbcdd1630c7760b708f3a5b4d38a121e66cb, name=ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-1-deactivate, org.label-schema.build-date=20240326, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, GIT_BRANCH=HEAD, ceph=True, RELEASE=squid-4e50bbc) 2024-03-30T14:15:06.912 INFO:journalctl@ceph.osd.1.smithi099.stdout:Mar 30 14:15:06 smithi099 podman[208641]: 2024-03-30 14:15:06.64968748 +0000 UTC m=+0.313848935 container init 2bdeb99ca58a3a8540b0ea953ab3a873eb44c7ab1499389138064d1e92eb7fb5 (image=quay.ceph.io/ceph-ci/ceph:4e50bbcdd1630c7760b708f3a5b4d38a121e66cb, name=ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-1-deactivate, org.label-schema.vendor=CentOS, RELEASE=squid-4e50bbc, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, ceph=True, org.label-schema.license=GPLv2, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240326, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-03-30T14:15:06.912 INFO:journalctl@ceph.osd.1.smithi099.stdout:Mar 30 14:15:06 smithi099 podman[208641]: 2024-03-30 14:15:06.65292898 +0000 UTC m=+0.317090434 container start 2bdeb99ca58a3a8540b0ea953ab3a873eb44c7ab1499389138064d1e92eb7fb5 (image=quay.ceph.io/ceph-ci/ceph:4e50bbcdd1630c7760b708f3a5b4d38a121e66cb, name=ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-1-deactivate, io.buildah.version=1.33.5, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240326, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, org.label-schema.vendor=CentOS, RELEASE=squid-4e50bbc, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=) 2024-03-30T14:15:06.912 INFO:journalctl@ceph.osd.1.smithi099.stdout:Mar 30 14:15:06 smithi099 podman[208641]: 2024-03-30 14:15:06.723967384 +0000 UTC m=+0.388128855 container attach 2bdeb99ca58a3a8540b0ea953ab3a873eb44c7ab1499389138064d1e92eb7fb5 (image=quay.ceph.io/ceph-ci/ceph:4e50bbcdd1630c7760b708f3a5b4d38a121e66cb, name=ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-1-deactivate, maintainer=Guillaume Abrioux , RELEASE=squid-4e50bbc, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240326, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, ceph=True, io.buildah.version=1.33.5, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0) 2024-03-30T14:15:07.077 INFO:journalctl@ceph.osd.1.smithi099.stdout:Mar 30 14:15:06 smithi099 podman[208641]: 2024-03-30 14:15:06.948773331 +0000 UTC m=+0.612934792 container died 2bdeb99ca58a3a8540b0ea953ab3a873eb44c7ab1499389138064d1e92eb7fb5 (image=quay.ceph.io/ceph-ci/ceph:4e50bbcdd1630c7760b708f3a5b4d38a121e66cb, name=ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-1-deactivate, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, RELEASE=squid-4e50bbc, GIT_CLEAN=True, org.label-schema.build-date=20240326, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , ceph=True, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0) 2024-03-30T14:15:07.614 DEBUG:teuthology.orchestra.run.smithi099:> sudo pkill -f 'journalctl -f -n 0 -u ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4@osd.1.service' 2024-03-30T14:15:07.657 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-03-30T14:15:07.658 INFO:tasks.cephadm.osd.1:Stopped osd.1 2024-03-30T14:15:07.658 INFO:tasks.cephadm.osd.2:Stopping osd.2... 2024-03-30T14:15:07.658 DEBUG:teuthology.orchestra.run.smithi099:> sudo systemctl stop ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4@osd.2 2024-03-30T14:15:07.964 INFO:journalctl@ceph.osd.2.smithi099.stdout:Mar 30 14:15:07 smithi099 systemd[1]: Stopping Ceph osd.2 for 98ebaeb8-ee99-11ee-b647-cb9ed24678a4... 2024-03-30T14:15:08.327 INFO:journalctl@ceph.osd.2.smithi099.stdout:Mar 30 14:15:07 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-2[162419]: 2024-03-30T14:15:07.972+0000 7fd78b36f700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.2 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-03-30T14:15:08.327 INFO:journalctl@ceph.osd.2.smithi099.stdout:Mar 30 14:15:07 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-2[162419]: 2024-03-30T14:15:07.972+0000 7fd78b36f700 -1 osd.2 160 *** Got signal Terminated *** 2024-03-30T14:15:08.327 INFO:journalctl@ceph.osd.2.smithi099.stdout:Mar 30 14:15:07 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-2[162419]: 2024-03-30T14:15:07.972+0000 7fd78b36f700 -1 osd.2 160 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-03-30T14:15:13.771 INFO:journalctl@ceph.osd.2.smithi099.stdout:Mar 30 14:15:13 smithi099 podman[208746]: 2024-03-30 14:15:13.554371131 +0000 UTC m=+5.665325540 container died 18304adfb0d0edef64069dc48eab168266787b192b69bb46639f7964f6ee38fe (image=quay.ceph.io/ceph-ci/ceph:4e50bbcdd1630c7760b708f3a5b4d38a121e66cb, name=ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-2, maintainer=Guillaume Abrioux , RELEASE=squid-4e50bbc, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240326, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_CLEAN=True, io.buildah.version=1.33.5, ceph=True) 2024-03-30T14:15:14.063 INFO:journalctl@ceph.osd.2.smithi099.stdout:Mar 30 14:15:13 smithi099 podman[208746]: 2024-03-30 14:15:13.871628414 +0000 UTC m=+5.982582815 container cleanup 18304adfb0d0edef64069dc48eab168266787b192b69bb46639f7964f6ee38fe (image=quay.ceph.io/ceph-ci/ceph:4e50bbcdd1630c7760b708f3a5b4d38a121e66cb, name=ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-2, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240326, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, ceph=True, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, RELEASE=squid-4e50bbc, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.license=GPLv2) 2024-03-30T14:15:14.063 INFO:journalctl@ceph.osd.2.smithi099.stdout:Mar 30 14:15:13 smithi099 bash[208746]: ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-2 2024-03-30T14:15:14.327 INFO:journalctl@ceph.osd.2.smithi099.stdout:Mar 30 14:15:14 smithi099 podman[209298]: 2024-03-30 14:15:14.072897837 +0000 UTC m=+0.649006580 container remove 18304adfb0d0edef64069dc48eab168266787b192b69bb46639f7964f6ee38fe (image=quay.ceph.io/ceph-ci/ceph:4e50bbcdd1630c7760b708f3a5b4d38a121e66cb, name=ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-2, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-4e50bbc, ceph=True, org.label-schema.build-date=20240326, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5) 2024-03-30T14:15:16.327 INFO:journalctl@ceph.osd.2.smithi099.stdout:Mar 30 14:15:15 smithi099 podman[209539]: 2024-03-30 14:15:15.781699897 +0000 UTC m=+0.017454163 image pull b0c4478f1d83795df4d538bf108aee5fac57194348fb16dcdbb3115f3e2fe95e quay.ceph.io/ceph-ci/ceph:4e50bbcdd1630c7760b708f3a5b4d38a121e66cb 2024-03-30T14:15:16.327 INFO:journalctl@ceph.osd.2.smithi099.stdout:Mar 30 14:15:15 smithi099 podman[209539]: 2024-03-30 14:15:15.89091862 +0000 UTC m=+0.126672878 container create 3340539f98cde08982b9c3373c88ac24fa41072192003ac44960a0c8b0fff119 (image=quay.ceph.io/ceph-ci/ceph:4e50bbcdd1630c7760b708f3a5b4d38a121e66cb, name=ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-2-deactivate, org.label-schema.vendor=CentOS, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=squid-4e50bbc, GIT_CLEAN=True, io.buildah.version=1.33.5, org.label-schema.build-date=20240326, GIT_BRANCH=HEAD) 2024-03-30T14:15:16.973 INFO:journalctl@ceph.osd.2.smithi099.stdout:Mar 30 14:15:16 smithi099 podman[209539]: 2024-03-30 14:15:16.748962906 +0000 UTC m=+0.984717171 container init 3340539f98cde08982b9c3373c88ac24fa41072192003ac44960a0c8b0fff119 (image=quay.ceph.io/ceph-ci/ceph:4e50bbcdd1630c7760b708f3a5b4d38a121e66cb, name=ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-2-deactivate, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240326, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, ceph=True, GIT_CLEAN=True, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=squid-4e50bbc, GIT_BRANCH=HEAD) 2024-03-30T14:15:16.974 INFO:journalctl@ceph.osd.2.smithi099.stdout:Mar 30 14:15:16 smithi099 podman[209539]: 2024-03-30 14:15:16.752314741 +0000 UTC m=+0.988069000 container start 3340539f98cde08982b9c3373c88ac24fa41072192003ac44960a0c8b0fff119 (image=quay.ceph.io/ceph-ci/ceph:4e50bbcdd1630c7760b708f3a5b4d38a121e66cb, name=ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-2-deactivate, RELEASE=squid-4e50bbc, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, org.label-schema.build-date=20240326, GIT_CLEAN=True, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, ceph=True, CEPH_POINT_RELEASE=) 2024-03-30T14:15:16.974 INFO:journalctl@ceph.osd.2.smithi099.stdout:Mar 30 14:15:16 smithi099 podman[209539]: 2024-03-30 14:15:16.831914749 +0000 UTC m=+1.067669013 container attach 3340539f98cde08982b9c3373c88ac24fa41072192003ac44960a0c8b0fff119 (image=quay.ceph.io/ceph-ci/ceph:4e50bbcdd1630c7760b708f3a5b4d38a121e66cb, name=ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-2-deactivate, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, org.label-schema.build-date=20240326, RELEASE=squid-4e50bbc, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD) 2024-03-30T14:15:17.327 INFO:journalctl@ceph.osd.2.smithi099.stdout:Mar 30 14:15:17 smithi099 podman[209539]: 2024-03-30 14:15:17.080920806 +0000 UTC m=+1.316675059 container died 3340539f98cde08982b9c3373c88ac24fa41072192003ac44960a0c8b0fff119 (image=quay.ceph.io/ceph-ci/ceph:4e50bbcdd1630c7760b708f3a5b4d38a121e66cb, name=ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-2-deactivate, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, ceph=True, CEPH_POINT_RELEASE=, RELEASE=squid-4e50bbc, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.build-date=20240326, GIT_BRANCH=HEAD) 2024-03-30T14:15:17.496 INFO:journalctl@ceph.osd.5.smithi181.stdout:Mar 30 14:15:17 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-5[154441]: 2024-03-30T14:15:17.224+0000 7f3033c34700 -1 osd.5 160 heartbeat_check: no reply from 172.21.15.99:6806 osd.0 since back 2024-03-30T14:14:51.048258+0000 front 2024-03-30T14:14:51.048173+0000 (oldest deadline 2024-03-30T14:15:16.948172+0000) 2024-03-30T14:15:17.790 DEBUG:teuthology.orchestra.run.smithi099:> sudo pkill -f 'journalctl -f -n 0 -u ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4@osd.2.service' 2024-03-30T14:15:17.831 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-03-30T14:15:17.831 INFO:tasks.cephadm.osd.2:Stopped osd.2 2024-03-30T14:15:17.831 INFO:tasks.cephadm.osd.3:Stopping osd.3... 2024-03-30T14:15:17.831 DEBUG:teuthology.orchestra.run.smithi099:> sudo systemctl stop ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4@osd.3 2024-03-30T14:15:18.047 INFO:journalctl@ceph.osd.3.smithi099.stdout:Mar 30 14:15:17 smithi099 systemd[1]: Stopping Ceph osd.3 for 98ebaeb8-ee99-11ee-b647-cb9ed24678a4... 2024-03-30T14:15:18.220 INFO:journalctl@ceph.osd.7.smithi181.stdout:Mar 30 14:15:17 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-7[162666]: 2024-03-30T14:15:17.876+0000 7f89f6425700 -1 osd.7 160 heartbeat_check: no reply from 172.21.15.99:6806 osd.0 since back 2024-03-30T14:14:54.735757+0000 front 2024-03-30T14:14:54.735668+0000 (oldest deadline 2024-03-30T14:15:17.035489+0000) 2024-03-30T14:15:18.496 INFO:journalctl@ceph.osd.5.smithi181.stdout:Mar 30 14:15:18 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-5[154441]: 2024-03-30T14:15:18.229+0000 7f3033c34700 -1 osd.5 160 heartbeat_check: no reply from 172.21.15.99:6806 osd.0 since back 2024-03-30T14:14:51.048258+0000 front 2024-03-30T14:14:51.048173+0000 (oldest deadline 2024-03-30T14:15:16.948172+0000) 2024-03-30T14:15:18.577 INFO:journalctl@ceph.osd.3.smithi099.stdout:Mar 30 14:15:18 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-3[171090]: 2024-03-30T14:15:18.542+0000 7fba07910700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.3 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-03-30T14:15:18.577 INFO:journalctl@ceph.osd.3.smithi099.stdout:Mar 30 14:15:18 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-3[171090]: 2024-03-30T14:15:18.542+0000 7fba07910700 -1 osd.3 160 *** Got signal Terminated *** 2024-03-30T14:15:18.577 INFO:journalctl@ceph.osd.3.smithi099.stdout:Mar 30 14:15:18 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-3[171090]: 2024-03-30T14:15:18.542+0000 7fba07910700 -1 osd.3 160 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-03-30T14:15:19.203 INFO:journalctl@ceph.osd.7.smithi181.stdout:Mar 30 14:15:18 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-7[162666]: 2024-03-30T14:15:18.909+0000 7f89f6425700 -1 osd.7 160 heartbeat_check: no reply from 172.21.15.99:6806 osd.0 since back 2024-03-30T14:14:54.735757+0000 front 2024-03-30T14:14:54.735668+0000 (oldest deadline 2024-03-30T14:15:17.035489+0000) 2024-03-30T14:15:19.496 INFO:journalctl@ceph.osd.5.smithi181.stdout:Mar 30 14:15:19 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-5[154441]: 2024-03-30T14:15:19.211+0000 7f3033c34700 -1 osd.5 160 heartbeat_check: no reply from 172.21.15.99:6806 osd.0 since back 2024-03-30T14:14:51.048258+0000 front 2024-03-30T14:14:51.048173+0000 (oldest deadline 2024-03-30T14:15:16.948172+0000) 2024-03-30T14:15:20.154 INFO:journalctl@ceph.osd.4.smithi181.stdout:Mar 30 14:15:19 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-4[149712]: 2024-03-30T14:15:19.827+0000 7efd0ab53700 -1 osd.4 160 heartbeat_check: no reply from 172.21.15.99:6806 osd.0 since back 2024-03-30T14:14:54.771783+0000 front 2024-03-30T14:14:54.771773+0000 (oldest deadline 2024-03-30T14:15:19.471610+0000) 2024-03-30T14:15:20.154 INFO:journalctl@ceph.osd.7.smithi181.stdout:Mar 30 14:15:19 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-7[162666]: 2024-03-30T14:15:19.904+0000 7f89f6425700 -1 osd.7 160 heartbeat_check: no reply from 172.21.15.99:6806 osd.0 since back 2024-03-30T14:14:54.735757+0000 front 2024-03-30T14:14:54.735668+0000 (oldest deadline 2024-03-30T14:15:17.035489+0000) 2024-03-30T14:15:20.155 INFO:journalctl@ceph.osd.6.smithi181.stdout:Mar 30 14:15:19 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-6[159016]: 2024-03-30T14:15:19.778+0000 7f40ae4c5700 -1 osd.6 160 heartbeat_check: no reply from 172.21.15.99:6806 osd.0 since back 2024-03-30T14:14:55.671948+0000 front 2024-03-30T14:14:55.672008+0000 (oldest deadline 2024-03-30T14:15:19.771809+0000) 2024-03-30T14:15:20.496 INFO:journalctl@ceph.osd.5.smithi181.stdout:Mar 30 14:15:20 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-5[154441]: 2024-03-30T14:15:20.162+0000 7f3033c34700 -1 osd.5 160 heartbeat_check: no reply from 172.21.15.99:6806 osd.0 since back 2024-03-30T14:14:51.048258+0000 front 2024-03-30T14:14:51.048173+0000 (oldest deadline 2024-03-30T14:15:16.948172+0000) 2024-03-30T14:15:20.860 INFO:journalctl@ceph.osd.6.smithi181.stdout:Mar 30 14:15:20 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-6[159016]: 2024-03-30T14:15:20.772+0000 7f40ae4c5700 -1 osd.6 160 heartbeat_check: no reply from 172.21.15.99:6806 osd.0 since back 2024-03-30T14:14:55.671948+0000 front 2024-03-30T14:14:55.672008+0000 (oldest deadline 2024-03-30T14:15:19.771809+0000) 2024-03-30T14:15:21.169 INFO:journalctl@ceph.osd.4.smithi181.stdout:Mar 30 14:15:20 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-4[149712]: 2024-03-30T14:15:20.869+0000 7efd0ab53700 -1 osd.4 160 heartbeat_check: no reply from 172.21.15.99:6806 osd.0 since back 2024-03-30T14:14:54.771783+0000 front 2024-03-30T14:14:54.771773+0000 (oldest deadline 2024-03-30T14:15:19.471610+0000) 2024-03-30T14:15:21.169 INFO:journalctl@ceph.osd.7.smithi181.stdout:Mar 30 14:15:20 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-7[162666]: 2024-03-30T14:15:20.872+0000 7f89f6425700 -1 osd.7 160 heartbeat_check: no reply from 172.21.15.99:6806 osd.0 since back 2024-03-30T14:14:54.735757+0000 front 2024-03-30T14:14:54.735668+0000 (oldest deadline 2024-03-30T14:15:17.035489+0000) 2024-03-30T14:15:21.327 INFO:journalctl@ceph.osd.3.smithi099.stdout:Mar 30 14:15:20 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-3[171090]: 2024-03-30T14:15:20.958+0000 7fba03f04700 -1 osd.3 160 heartbeat_check: no reply from 172.21.15.99:6806 osd.0 since back 2024-03-30T14:14:55.532834+0000 front 2024-03-30T14:14:55.532821+0000 (oldest deadline 2024-03-30T14:15:20.733337+0000) 2024-03-30T14:15:21.496 INFO:journalctl@ceph.osd.5.smithi181.stdout:Mar 30 14:15:21 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-5[154441]: 2024-03-30T14:15:21.177+0000 7f3033c34700 -1 osd.5 160 heartbeat_check: no reply from 172.21.15.99:6806 osd.0 since back 2024-03-30T14:14:51.048258+0000 front 2024-03-30T14:14:51.048173+0000 (oldest deadline 2024-03-30T14:15:16.948172+0000) 2024-03-30T14:15:22.166 INFO:journalctl@ceph.osd.4.smithi181.stdout:Mar 30 14:15:21 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-4[149712]: 2024-03-30T14:15:21.882+0000 7efd0ab53700 -1 osd.4 160 heartbeat_check: no reply from 172.21.15.99:6806 osd.0 since back 2024-03-30T14:14:54.771783+0000 front 2024-03-30T14:14:54.771773+0000 (oldest deadline 2024-03-30T14:15:19.471610+0000) 2024-03-30T14:15:22.166 INFO:journalctl@ceph.osd.6.smithi181.stdout:Mar 30 14:15:21 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-6[159016]: 2024-03-30T14:15:21.823+0000 7f40ae4c5700 -1 osd.6 160 heartbeat_check: no reply from 172.21.15.99:6806 osd.0 since back 2024-03-30T14:14:55.671948+0000 front 2024-03-30T14:14:55.672008+0000 (oldest deadline 2024-03-30T14:15:19.771809+0000) 2024-03-30T14:15:22.167 INFO:journalctl@ceph.osd.7.smithi181.stdout:Mar 30 14:15:21 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-7[162666]: 2024-03-30T14:15:21.823+0000 7f89f6425700 -1 osd.7 160 heartbeat_check: no reply from 172.21.15.99:6806 osd.0 since back 2024-03-30T14:14:54.735757+0000 front 2024-03-30T14:14:54.735668+0000 (oldest deadline 2024-03-30T14:15:17.035489+0000) 2024-03-30T14:15:22.327 INFO:journalctl@ceph.osd.3.smithi099.stdout:Mar 30 14:15:21 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-3[171090]: 2024-03-30T14:15:21.916+0000 7fba03f04700 -1 osd.3 160 heartbeat_check: no reply from 172.21.15.99:6806 osd.0 since back 2024-03-30T14:14:55.532834+0000 front 2024-03-30T14:14:55.532821+0000 (oldest deadline 2024-03-30T14:15:20.733337+0000) 2024-03-30T14:15:22.496 INFO:journalctl@ceph.osd.5.smithi181.stdout:Mar 30 14:15:22 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-5[154441]: 2024-03-30T14:15:22.175+0000 7f3033c34700 -1 osd.5 160 heartbeat_check: no reply from 172.21.15.99:6806 osd.0 since back 2024-03-30T14:14:51.048258+0000 front 2024-03-30T14:14:51.048173+0000 (oldest deadline 2024-03-30T14:15:16.948172+0000) 2024-03-30T14:15:23.185 INFO:journalctl@ceph.osd.4.smithi181.stdout:Mar 30 14:15:22 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-4[149712]: 2024-03-30T14:15:22.834+0000 7efd0ab53700 -1 osd.4 160 heartbeat_check: no reply from 172.21.15.99:6806 osd.0 since back 2024-03-30T14:14:54.771783+0000 front 2024-03-30T14:14:54.771773+0000 (oldest deadline 2024-03-30T14:15:19.471610+0000) 2024-03-30T14:15:23.185 INFO:journalctl@ceph.osd.6.smithi181.stdout:Mar 30 14:15:22 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-6[159016]: 2024-03-30T14:15:22.780+0000 7f40ae4c5700 -1 osd.6 160 heartbeat_check: no reply from 172.21.15.99:6806 osd.0 since back 2024-03-30T14:14:55.671948+0000 front 2024-03-30T14:14:55.672008+0000 (oldest deadline 2024-03-30T14:15:19.771809+0000) 2024-03-30T14:15:23.186 INFO:journalctl@ceph.osd.7.smithi181.stdout:Mar 30 14:15:22 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-7[162666]: 2024-03-30T14:15:22.813+0000 7f89f6425700 -1 osd.7 160 heartbeat_check: no reply from 172.21.15.99:6806 osd.0 since back 2024-03-30T14:14:54.735757+0000 front 2024-03-30T14:14:54.735668+0000 (oldest deadline 2024-03-30T14:15:17.035489+0000) 2024-03-30T14:15:23.327 INFO:journalctl@ceph.osd.3.smithi099.stdout:Mar 30 14:15:22 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-3[171090]: 2024-03-30T14:15:22.957+0000 7fba03f04700 -1 osd.3 160 heartbeat_check: no reply from 172.21.15.99:6806 osd.0 since back 2024-03-30T14:14:55.532834+0000 front 2024-03-30T14:14:55.532821+0000 (oldest deadline 2024-03-30T14:15:20.733337+0000) 2024-03-30T14:15:23.496 INFO:journalctl@ceph.osd.5.smithi181.stdout:Mar 30 14:15:23 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-5[154441]: 2024-03-30T14:15:23.194+0000 7f3033c34700 -1 osd.5 160 heartbeat_check: no reply from 172.21.15.99:6806 osd.0 since back 2024-03-30T14:14:51.048258+0000 front 2024-03-30T14:14:51.048173+0000 (oldest deadline 2024-03-30T14:15:16.948172+0000) 2024-03-30T14:15:24.109 INFO:journalctl@ceph.osd.3.smithi099.stdout:Mar 30 14:15:23 smithi099 podman[209722]: 2024-03-30 14:15:23.850567275 +0000 UTC m=+5.430066529 container died 9b38d79f070e439d9d9d10f214cfb49396001144320af1806b2b85d3f39f5a49 (image=quay.ceph.io/ceph-ci/ceph:4e50bbcdd1630c7760b708f3a5b4d38a121e66cb, name=ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-3, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240326, RELEASE=squid-4e50bbc, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_CLEAN=True) 2024-03-30T14:15:24.140 INFO:journalctl@ceph.osd.4.smithi181.stdout:Mar 30 14:15:23 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-4[149712]: 2024-03-30T14:15:23.792+0000 7efd0ab53700 -1 osd.4 160 heartbeat_check: no reply from 172.21.15.99:6806 osd.0 since back 2024-03-30T14:14:54.771783+0000 front 2024-03-30T14:14:54.771773+0000 (oldest deadline 2024-03-30T14:15:19.471610+0000) 2024-03-30T14:15:24.140 INFO:journalctl@ceph.osd.6.smithi181.stdout:Mar 30 14:15:23 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-6[159016]: 2024-03-30T14:15:23.827+0000 7f40ae4c5700 -1 osd.6 160 heartbeat_check: no reply from 172.21.15.99:6806 osd.0 since back 2024-03-30T14:14:55.671948+0000 front 2024-03-30T14:14:55.672008+0000 (oldest deadline 2024-03-30T14:15:19.771809+0000) 2024-03-30T14:15:24.141 INFO:journalctl@ceph.osd.7.smithi181.stdout:Mar 30 14:15:23 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-7[162666]: 2024-03-30T14:15:23.804+0000 7f89f6425700 -1 osd.7 160 heartbeat_check: no reply from 172.21.15.99:6806 osd.0 since back 2024-03-30T14:14:54.735757+0000 front 2024-03-30T14:14:54.735668+0000 (oldest deadline 2024-03-30T14:15:17.035489+0000) 2024-03-30T14:15:24.493 INFO:journalctl@ceph.osd.3.smithi099.stdout:Mar 30 14:15:24 smithi099 podman[209722]: 2024-03-30 14:15:24.292295977 +0000 UTC m=+5.871795262 container cleanup 9b38d79f070e439d9d9d10f214cfb49396001144320af1806b2b85d3f39f5a49 (image=quay.ceph.io/ceph-ci/ceph:4e50bbcdd1630c7760b708f3a5b4d38a121e66cb, name=ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-3, org.label-schema.build-date=20240326, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, ceph=True, RELEASE=squid-4e50bbc, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0) 2024-03-30T14:15:24.493 INFO:journalctl@ceph.osd.3.smithi099.stdout:Mar 30 14:15:24 smithi099 bash[209722]: ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-3 2024-03-30T14:15:24.496 INFO:journalctl@ceph.osd.5.smithi181.stdout:Mar 30 14:15:24 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-5[154441]: 2024-03-30T14:15:24.148+0000 7f3033c34700 -1 osd.5 160 heartbeat_check: no reply from 172.21.15.99:6806 osd.0 since back 2024-03-30T14:14:51.048258+0000 front 2024-03-30T14:14:51.048173+0000 (oldest deadline 2024-03-30T14:15:16.948172+0000) 2024-03-30T14:15:24.827 INFO:journalctl@ceph.osd.3.smithi099.stdout:Mar 30 14:15:24 smithi099 podman[209741]: 2024-03-30 14:15:24.502030571 +0000 UTC m=+0.651528641 container remove 9b38d79f070e439d9d9d10f214cfb49396001144320af1806b2b85d3f39f5a49 (image=quay.ceph.io/ceph-ci/ceph:4e50bbcdd1630c7760b708f3a5b4d38a121e66cb, name=ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-3, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240326, org.label-schema.license=GPLv2, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, GIT_CLEAN=True, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, RELEASE=squid-4e50bbc, maintainer=Guillaume Abrioux ) 2024-03-30T14:15:24.995 INFO:journalctl@ceph.osd.4.smithi181.stdout:Mar 30 14:15:24 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-4[149712]: 2024-03-30T14:15:24.813+0000 7efd0ab53700 -1 osd.4 160 heartbeat_check: no reply from 172.21.15.99:6806 osd.0 since back 2024-03-30T14:14:54.771783+0000 front 2024-03-30T14:14:54.771773+0000 (oldest deadline 2024-03-30T14:15:19.471610+0000) 2024-03-30T14:15:24.996 INFO:journalctl@ceph.osd.6.smithi181.stdout:Mar 30 14:15:24 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-6[159016]: 2024-03-30T14:15:24.781+0000 7f40ae4c5700 -1 osd.6 160 heartbeat_check: no reply from 172.21.15.99:6806 osd.0 since back 2024-03-30T14:14:55.671948+0000 front 2024-03-30T14:14:55.672008+0000 (oldest deadline 2024-03-30T14:15:19.771809+0000) 2024-03-30T14:15:24.996 INFO:journalctl@ceph.osd.7.smithi181.stdout:Mar 30 14:15:24 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-7[162666]: 2024-03-30T14:15:24.786+0000 7f89f6425700 -1 osd.7 160 heartbeat_check: no reply from 172.21.15.99:6806 osd.0 since back 2024-03-30T14:14:54.735757+0000 front 2024-03-30T14:14:54.735668+0000 (oldest deadline 2024-03-30T14:15:17.035489+0000) 2024-03-30T14:15:25.147 INFO:journalctl@ceph.osd.3.smithi099.stdout:Mar 30 14:15:24 smithi099 podman[209836]: 2024-03-30 14:15:24.801570129 +0000 UTC m=+0.017652983 image pull b0c4478f1d83795df4d538bf108aee5fac57194348fb16dcdbb3115f3e2fe95e quay.ceph.io/ceph-ci/ceph:4e50bbcdd1630c7760b708f3a5b4d38a121e66cb 2024-03-30T14:15:25.147 INFO:journalctl@ceph.osd.3.smithi099.stdout:Mar 30 14:15:24 smithi099 podman[209836]: 2024-03-30 14:15:24.944558784 +0000 UTC m=+0.160641641 container create 430b19fa08cba2d56e16d37da0e1733527ff802e306c3befc00ef19177ae4f3f (image=quay.ceph.io/ceph-ci/ceph:4e50bbcdd1630c7760b708f3a5b4d38a121e66cb, name=ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-3-deactivate, org.label-schema.schema-version=1.0, GIT_CLEAN=True, ceph=True, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, RELEASE=squid-4e50bbc, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, org.label-schema.build-date=20240326, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=) 2024-03-30T14:15:25.147 INFO:journalctl@ceph.osd.3.smithi099.stdout:Mar 30 14:15:25 smithi099 podman[209836]: 2024-03-30 14:15:25.156289077 +0000 UTC m=+0.372371943 container init 430b19fa08cba2d56e16d37da0e1733527ff802e306c3befc00ef19177ae4f3f (image=quay.ceph.io/ceph-ci/ceph:4e50bbcdd1630c7760b708f3a5b4d38a121e66cb, name=ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-3-deactivate, io.buildah.version=1.33.5, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.license=GPLv2, RELEASE=squid-4e50bbc, org.label-schema.build-date=20240326, org.label-schema.schema-version=1.0, ceph=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image) 2024-03-30T14:15:25.246 INFO:journalctl@ceph.osd.5.smithi181.stdout:Mar 30 14:15:25 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-5[154441]: 2024-03-30T14:15:25.120+0000 7f3033c34700 -1 osd.5 160 heartbeat_check: no reply from 172.21.15.99:6806 osd.0 since back 2024-03-30T14:14:51.048258+0000 front 2024-03-30T14:14:51.048173+0000 (oldest deadline 2024-03-30T14:15:16.948172+0000) 2024-03-30T14:15:25.441 INFO:journalctl@ceph.osd.3.smithi099.stdout:Mar 30 14:15:25 smithi099 podman[209836]: 2024-03-30 14:15:25.159663243 +0000 UTC m=+0.375746100 container start 430b19fa08cba2d56e16d37da0e1733527ff802e306c3befc00ef19177ae4f3f (image=quay.ceph.io/ceph-ci/ceph:4e50bbcdd1630c7760b708f3a5b4d38a121e66cb, name=ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-3-deactivate, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-4e50bbc, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240326, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux ) 2024-03-30T14:15:25.441 INFO:journalctl@ceph.osd.3.smithi099.stdout:Mar 30 14:15:25 smithi099 podman[209836]: 2024-03-30 14:15:25.222507928 +0000 UTC m=+0.438590789 container attach 430b19fa08cba2d56e16d37da0e1733527ff802e306c3befc00ef19177ae4f3f (image=quay.ceph.io/ceph-ci/ceph:4e50bbcdd1630c7760b708f3a5b4d38a121e66cb, name=ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-3-deactivate, RELEASE=squid-4e50bbc, org.label-schema.license=GPLv2, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, GIT_CLEAN=True, io.buildah.version=1.33.5, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240326) 2024-03-30T14:15:25.732 INFO:journalctl@ceph.osd.3.smithi099.stdout:Mar 30 14:15:25 smithi099 podman[209836]: 2024-03-30 14:15:25.450125362 +0000 UTC m=+0.666208219 container died 430b19fa08cba2d56e16d37da0e1733527ff802e306c3befc00ef19177ae4f3f (image=quay.ceph.io/ceph-ci/ceph:4e50bbcdd1630c7760b708f3a5b4d38a121e66cb, name=ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-3-deactivate, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, GIT_CLEAN=True, RELEASE=squid-4e50bbc, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, ceph=True, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240326, maintainer=Guillaume Abrioux ) 2024-03-30T14:15:25.996 INFO:journalctl@ceph.osd.6.smithi181.stdout:Mar 30 14:15:25 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-6[159016]: 2024-03-30T14:15:25.753+0000 7f40ae4c5700 -1 osd.6 160 heartbeat_check: no reply from 172.21.15.99:6806 osd.0 since back 2024-03-30T14:14:55.671948+0000 front 2024-03-30T14:14:55.672008+0000 (oldest deadline 2024-03-30T14:15:19.771809+0000) 2024-03-30T14:15:25.996 INFO:journalctl@ceph.osd.7.smithi181.stdout:Mar 30 14:15:25 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-7[162666]: 2024-03-30T14:15:25.790+0000 7f89f6425700 -1 osd.7 160 heartbeat_check: no reply from 172.21.15.99:6806 osd.0 since back 2024-03-30T14:14:54.735757+0000 front 2024-03-30T14:14:54.735668+0000 (oldest deadline 2024-03-30T14:15:17.035489+0000) 2024-03-30T14:15:25.996 INFO:journalctl@ceph.osd.4.smithi181.stdout:Mar 30 14:15:25 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-4[149712]: 2024-03-30T14:15:25.842+0000 7efd0ab53700 -1 osd.4 160 heartbeat_check: no reply from 172.21.15.99:6806 osd.0 since back 2024-03-30T14:14:54.771783+0000 front 2024-03-30T14:14:54.771773+0000 (oldest deadline 2024-03-30T14:15:19.471610+0000) 2024-03-30T14:15:25.996 INFO:journalctl@ceph.osd.4.smithi181.stdout:Mar 30 14:15:25 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-4[149712]: 2024-03-30T14:15:25.842+0000 7efd0ab53700 -1 osd.4 160 heartbeat_check: no reply from 172.21.15.99:6814 osd.1 since back 2024-03-30T14:14:59.472092+0000 front 2024-03-30T14:14:59.472154+0000 (oldest deadline 2024-03-30T14:15:25.372046+0000) 2024-03-30T14:15:26.018 DEBUG:teuthology.orchestra.run.smithi099:> sudo pkill -f 'journalctl -f -n 0 -u ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4@osd.3.service' 2024-03-30T14:15:26.059 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-03-30T14:15:26.060 INFO:tasks.cephadm.osd.3:Stopped osd.3 2024-03-30T14:15:26.060 INFO:tasks.cephadm.osd.4:Stopping osd.4... 2024-03-30T14:15:26.060 DEBUG:teuthology.orchestra.run.smithi181:> sudo systemctl stop ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4@osd.4 2024-03-30T14:15:26.417 INFO:journalctl@ceph.osd.4.smithi181.stdout:Mar 30 14:15:26 smithi181 systemd[1]: Stopping Ceph osd.4 for 98ebaeb8-ee99-11ee-b647-cb9ed24678a4... 2024-03-30T14:15:26.418 INFO:journalctl@ceph.osd.5.smithi181.stdout:Mar 30 14:15:26 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-5[154441]: 2024-03-30T14:15:26.137+0000 7f3033c34700 -1 osd.5 160 heartbeat_check: no reply from 172.21.15.99:6806 osd.0 since back 2024-03-30T14:14:51.048258+0000 front 2024-03-30T14:14:51.048173+0000 (oldest deadline 2024-03-30T14:15:16.948172+0000) 2024-03-30T14:15:26.739 INFO:journalctl@ceph.osd.4.smithi181.stdout:Mar 30 14:15:26 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-4[149712]: 2024-03-30T14:15:26.571+0000 7efd12567700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.4 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-03-30T14:15:26.739 INFO:journalctl@ceph.osd.4.smithi181.stdout:Mar 30 14:15:26 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-4[149712]: 2024-03-30T14:15:26.571+0000 7efd12567700 -1 osd.4 160 *** Got signal Terminated *** 2024-03-30T14:15:26.739 INFO:journalctl@ceph.osd.4.smithi181.stdout:Mar 30 14:15:26 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-4[149712]: 2024-03-30T14:15:26.571+0000 7efd12567700 -1 osd.4 160 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-03-30T14:15:26.996 INFO:journalctl@ceph.osd.6.smithi181.stdout:Mar 30 14:15:26 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-6[159016]: 2024-03-30T14:15:26.747+0000 7f40ae4c5700 -1 osd.6 160 heartbeat_check: no reply from 172.21.15.99:6806 osd.0 since back 2024-03-30T14:14:55.671948+0000 front 2024-03-30T14:14:55.672008+0000 (oldest deadline 2024-03-30T14:15:19.771809+0000) 2024-03-30T14:15:26.996 INFO:journalctl@ceph.osd.7.smithi181.stdout:Mar 30 14:15:26 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-7[162666]: 2024-03-30T14:15:26.833+0000 7f89f6425700 -1 osd.7 160 heartbeat_check: no reply from 172.21.15.99:6806 osd.0 since back 2024-03-30T14:14:54.735757+0000 front 2024-03-30T14:14:54.735668+0000 (oldest deadline 2024-03-30T14:15:17.035489+0000) 2024-03-30T14:15:26.996 INFO:journalctl@ceph.osd.4.smithi181.stdout:Mar 30 14:15:26 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-4[149712]: 2024-03-30T14:15:26.840+0000 7efd0ab53700 -1 osd.4 160 heartbeat_check: no reply from 172.21.15.99:6806 osd.0 since back 2024-03-30T14:14:54.771783+0000 front 2024-03-30T14:14:54.771773+0000 (oldest deadline 2024-03-30T14:15:19.471610+0000) 2024-03-30T14:15:26.997 INFO:journalctl@ceph.osd.4.smithi181.stdout:Mar 30 14:15:26 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-4[149712]: 2024-03-30T14:15:26.840+0000 7efd0ab53700 -1 osd.4 160 heartbeat_check: no reply from 172.21.15.99:6814 osd.1 since back 2024-03-30T14:14:59.472092+0000 front 2024-03-30T14:14:59.472154+0000 (oldest deadline 2024-03-30T14:15:25.372046+0000) 2024-03-30T14:15:27.496 INFO:journalctl@ceph.osd.5.smithi181.stdout:Mar 30 14:15:27 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-5[154441]: 2024-03-30T14:15:27.114+0000 7f3033c34700 -1 osd.5 160 heartbeat_check: no reply from 172.21.15.99:6806 osd.0 since back 2024-03-30T14:14:51.048258+0000 front 2024-03-30T14:14:51.048173+0000 (oldest deadline 2024-03-30T14:15:16.948172+0000) 2024-03-30T14:15:27.986 INFO:journalctl@ceph.osd.6.smithi181.stdout:Mar 30 14:15:27 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-6[159016]: 2024-03-30T14:15:27.733+0000 7f40ae4c5700 -1 osd.6 160 heartbeat_check: no reply from 172.21.15.99:6806 osd.0 since back 2024-03-30T14:14:55.671948+0000 front 2024-03-30T14:14:55.672008+0000 (oldest deadline 2024-03-30T14:15:19.771809+0000) 2024-03-30T14:15:27.986 INFO:journalctl@ceph.osd.7.smithi181.stdout:Mar 30 14:15:27 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-7[162666]: 2024-03-30T14:15:27.816+0000 7f89f6425700 -1 osd.7 160 heartbeat_check: no reply from 172.21.15.99:6806 osd.0 since back 2024-03-30T14:14:54.735757+0000 front 2024-03-30T14:14:54.735668+0000 (oldest deadline 2024-03-30T14:15:17.035489+0000) 2024-03-30T14:15:27.986 INFO:journalctl@ceph.osd.4.smithi181.stdout:Mar 30 14:15:27 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-4[149712]: 2024-03-30T14:15:27.852+0000 7efd0ab53700 -1 osd.4 160 heartbeat_check: no reply from 172.21.15.99:6806 osd.0 since back 2024-03-30T14:14:54.771783+0000 front 2024-03-30T14:14:54.771773+0000 (oldest deadline 2024-03-30T14:15:19.471610+0000) 2024-03-30T14:15:27.986 INFO:journalctl@ceph.osd.4.smithi181.stdout:Mar 30 14:15:27 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-4[149712]: 2024-03-30T14:15:27.852+0000 7efd0ab53700 -1 osd.4 160 heartbeat_check: no reply from 172.21.15.99:6814 osd.1 since back 2024-03-30T14:14:59.472092+0000 front 2024-03-30T14:14:59.472154+0000 (oldest deadline 2024-03-30T14:15:25.372046+0000) 2024-03-30T14:15:28.246 INFO:journalctl@ceph.osd.5.smithi181.stdout:Mar 30 14:15:28 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-5[154441]: 2024-03-30T14:15:28.094+0000 7f3033c34700 -1 osd.5 160 heartbeat_check: no reply from 172.21.15.99:6806 osd.0 since back 2024-03-30T14:14:51.048258+0000 front 2024-03-30T14:14:51.048173+0000 (oldest deadline 2024-03-30T14:15:16.948172+0000) 2024-03-30T14:15:28.996 INFO:journalctl@ceph.osd.6.smithi181.stdout:Mar 30 14:15:28 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-6[159016]: 2024-03-30T14:15:28.724+0000 7f40ae4c5700 -1 osd.6 160 heartbeat_check: no reply from 172.21.15.99:6806 osd.0 since back 2024-03-30T14:14:55.671948+0000 front 2024-03-30T14:14:55.672008+0000 (oldest deadline 2024-03-30T14:15:19.771809+0000) 2024-03-30T14:15:28.996 INFO:journalctl@ceph.osd.6.smithi181.stdout:Mar 30 14:15:28 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-6[159016]: 2024-03-30T14:15:28.724+0000 7f40ae4c5700 -1 osd.6 160 heartbeat_check: no reply from 172.21.15.99:6814 osd.1 since back 2024-03-30T14:15:04.373319+0000 front 2024-03-30T14:15:04.373414+0000 (oldest deadline 2024-03-30T14:15:28.473188+0000) 2024-03-30T14:15:28.996 INFO:journalctl@ceph.osd.7.smithi181.stdout:Mar 30 14:15:28 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-7[162666]: 2024-03-30T14:15:28.779+0000 7f89f6425700 -1 osd.7 160 heartbeat_check: no reply from 172.21.15.99:6806 osd.0 since back 2024-03-30T14:14:54.735757+0000 front 2024-03-30T14:14:54.735668+0000 (oldest deadline 2024-03-30T14:15:17.035489+0000) 2024-03-30T14:15:28.997 INFO:journalctl@ceph.osd.7.smithi181.stdout:Mar 30 14:15:28 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-7[162666]: 2024-03-30T14:15:28.779+0000 7f89f6425700 -1 osd.7 160 heartbeat_check: no reply from 172.21.15.99:6814 osd.1 since back 2024-03-30T14:15:04.537446+0000 front 2024-03-30T14:15:04.537483+0000 (oldest deadline 2024-03-30T14:15:28.037269+0000) 2024-03-30T14:15:28.997 INFO:journalctl@ceph.osd.4.smithi181.stdout:Mar 30 14:15:28 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-4[149712]: 2024-03-30T14:15:28.811+0000 7efd0ab53700 -1 osd.4 160 heartbeat_check: no reply from 172.21.15.99:6806 osd.0 since back 2024-03-30T14:14:54.771783+0000 front 2024-03-30T14:14:54.771773+0000 (oldest deadline 2024-03-30T14:15:19.471610+0000) 2024-03-30T14:15:28.997 INFO:journalctl@ceph.osd.4.smithi181.stdout:Mar 30 14:15:28 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-4[149712]: 2024-03-30T14:15:28.811+0000 7efd0ab53700 -1 osd.4 160 heartbeat_check: no reply from 172.21.15.99:6814 osd.1 since back 2024-03-30T14:14:59.472092+0000 front 2024-03-30T14:14:59.472154+0000 (oldest deadline 2024-03-30T14:15:25.372046+0000) 2024-03-30T14:15:29.496 INFO:journalctl@ceph.osd.5.smithi181.stdout:Mar 30 14:15:29 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-5[154441]: 2024-03-30T14:15:29.044+0000 7f3033c34700 -1 osd.5 160 heartbeat_check: no reply from 172.21.15.99:6806 osd.0 since back 2024-03-30T14:14:51.048258+0000 front 2024-03-30T14:14:51.048173+0000 (oldest deadline 2024-03-30T14:15:16.948172+0000) 2024-03-30T14:15:29.996 INFO:journalctl@ceph.osd.4.smithi181.stdout:Mar 30 14:15:29 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-4[149712]: 2024-03-30T14:15:29.839+0000 7efd0ab53700 -1 osd.4 160 heartbeat_check: no reply from 172.21.15.99:6806 osd.0 since back 2024-03-30T14:14:54.771783+0000 front 2024-03-30T14:14:54.771773+0000 (oldest deadline 2024-03-30T14:15:19.471610+0000) 2024-03-30T14:15:29.996 INFO:journalctl@ceph.osd.4.smithi181.stdout:Mar 30 14:15:29 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-4[149712]: 2024-03-30T14:15:29.839+0000 7efd0ab53700 -1 osd.4 160 heartbeat_check: no reply from 172.21.15.99:6814 osd.1 since back 2024-03-30T14:14:59.472092+0000 front 2024-03-30T14:14:59.472154+0000 (oldest deadline 2024-03-30T14:15:25.372046+0000) 2024-03-30T14:15:29.996 INFO:journalctl@ceph.osd.6.smithi181.stdout:Mar 30 14:15:29 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-6[159016]: 2024-03-30T14:15:29.747+0000 7f40ae4c5700 -1 osd.6 160 heartbeat_check: no reply from 172.21.15.99:6806 osd.0 since back 2024-03-30T14:14:55.671948+0000 front 2024-03-30T14:14:55.672008+0000 (oldest deadline 2024-03-30T14:15:19.771809+0000) 2024-03-30T14:15:29.996 INFO:journalctl@ceph.osd.6.smithi181.stdout:Mar 30 14:15:29 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-6[159016]: 2024-03-30T14:15:29.747+0000 7f40ae4c5700 -1 osd.6 160 heartbeat_check: no reply from 172.21.15.99:6814 osd.1 since back 2024-03-30T14:15:04.373319+0000 front 2024-03-30T14:15:04.373414+0000 (oldest deadline 2024-03-30T14:15:28.473188+0000) 2024-03-30T14:15:29.997 INFO:journalctl@ceph.osd.7.smithi181.stdout:Mar 30 14:15:29 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-7[162666]: 2024-03-30T14:15:29.823+0000 7f89f6425700 -1 osd.7 160 heartbeat_check: no reply from 172.21.15.99:6806 osd.0 since back 2024-03-30T14:14:54.735757+0000 front 2024-03-30T14:14:54.735668+0000 (oldest deadline 2024-03-30T14:15:17.035489+0000) 2024-03-30T14:15:29.997 INFO:journalctl@ceph.osd.7.smithi181.stdout:Mar 30 14:15:29 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-7[162666]: 2024-03-30T14:15:29.823+0000 7f89f6425700 -1 osd.7 160 heartbeat_check: no reply from 172.21.15.99:6814 osd.1 since back 2024-03-30T14:15:04.537446+0000 front 2024-03-30T14:15:04.537483+0000 (oldest deadline 2024-03-30T14:15:28.037269+0000) 2024-03-30T14:15:30.496 INFO:journalctl@ceph.osd.5.smithi181.stdout:Mar 30 14:15:30 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-5[154441]: 2024-03-30T14:15:30.084+0000 7f3033c34700 -1 osd.5 160 heartbeat_check: no reply from 172.21.15.99:6806 osd.0 since back 2024-03-30T14:14:51.048258+0000 front 2024-03-30T14:14:51.048173+0000 (oldest deadline 2024-03-30T14:15:16.948172+0000) 2024-03-30T14:15:30.496 INFO:journalctl@ceph.osd.5.smithi181.stdout:Mar 30 14:15:30 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-5[154441]: 2024-03-30T14:15:30.084+0000 7f3033c34700 -1 osd.5 160 heartbeat_check: no reply from 172.21.15.99:6814 osd.1 since back 2024-03-30T14:15:04.450202+0000 front 2024-03-30T14:15:04.450043+0000 (oldest deadline 2024-03-30T14:15:29.150016+0000) 2024-03-30T14:15:31.102 INFO:journalctl@ceph.osd.4.smithi181.stdout:Mar 30 14:15:30 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-4[149712]: 2024-03-30T14:15:30.837+0000 7efd0ab53700 -1 osd.4 160 heartbeat_check: no reply from 172.21.15.99:6806 osd.0 since back 2024-03-30T14:14:54.771783+0000 front 2024-03-30T14:14:54.771773+0000 (oldest deadline 2024-03-30T14:15:19.471610+0000) 2024-03-30T14:15:31.103 INFO:journalctl@ceph.osd.4.smithi181.stdout:Mar 30 14:15:30 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-4[149712]: 2024-03-30T14:15:30.837+0000 7efd0ab53700 -1 osd.4 160 heartbeat_check: no reply from 172.21.15.99:6814 osd.1 since back 2024-03-30T14:14:59.472092+0000 front 2024-03-30T14:14:59.472154+0000 (oldest deadline 2024-03-30T14:15:25.372046+0000) 2024-03-30T14:15:31.103 INFO:journalctl@ceph.osd.6.smithi181.stdout:Mar 30 14:15:30 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-6[159016]: 2024-03-30T14:15:30.795+0000 7f40ae4c5700 -1 osd.6 160 heartbeat_check: no reply from 172.21.15.99:6806 osd.0 since back 2024-03-30T14:14:55.671948+0000 front 2024-03-30T14:14:55.672008+0000 (oldest deadline 2024-03-30T14:15:19.771809+0000) 2024-03-30T14:15:31.103 INFO:journalctl@ceph.osd.6.smithi181.stdout:Mar 30 14:15:30 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-6[159016]: 2024-03-30T14:15:30.795+0000 7f40ae4c5700 -1 osd.6 160 heartbeat_check: no reply from 172.21.15.99:6814 osd.1 since back 2024-03-30T14:15:04.373319+0000 front 2024-03-30T14:15:04.373414+0000 (oldest deadline 2024-03-30T14:15:28.473188+0000) 2024-03-30T14:15:31.103 INFO:journalctl@ceph.osd.7.smithi181.stdout:Mar 30 14:15:30 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-7[162666]: 2024-03-30T14:15:30.775+0000 7f89f6425700 -1 osd.7 160 heartbeat_check: no reply from 172.21.15.99:6806 osd.0 since back 2024-03-30T14:14:54.735757+0000 front 2024-03-30T14:14:54.735668+0000 (oldest deadline 2024-03-30T14:15:17.035489+0000) 2024-03-30T14:15:31.103 INFO:journalctl@ceph.osd.7.smithi181.stdout:Mar 30 14:15:30 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-7[162666]: 2024-03-30T14:15:30.775+0000 7f89f6425700 -1 osd.7 160 heartbeat_check: no reply from 172.21.15.99:6814 osd.1 since back 2024-03-30T14:15:04.537446+0000 front 2024-03-30T14:15:04.537483+0000 (oldest deadline 2024-03-30T14:15:28.037269+0000) 2024-03-30T14:15:31.496 INFO:journalctl@ceph.osd.5.smithi181.stdout:Mar 30 14:15:31 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-5[154441]: 2024-03-30T14:15:31.111+0000 7f3033c34700 -1 osd.5 160 heartbeat_check: no reply from 172.21.15.99:6806 osd.0 since back 2024-03-30T14:14:51.048258+0000 front 2024-03-30T14:14:51.048173+0000 (oldest deadline 2024-03-30T14:15:16.948172+0000) 2024-03-30T14:15:31.496 INFO:journalctl@ceph.osd.5.smithi181.stdout:Mar 30 14:15:31 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-5[154441]: 2024-03-30T14:15:31.111+0000 7f3033c34700 -1 osd.5 160 heartbeat_check: no reply from 172.21.15.99:6814 osd.1 since back 2024-03-30T14:15:04.450202+0000 front 2024-03-30T14:15:04.450043+0000 (oldest deadline 2024-03-30T14:15:29.150016+0000) 2024-03-30T14:15:31.996 INFO:journalctl@ceph.osd.4.smithi181.stdout:Mar 30 14:15:31 smithi181 podman[178358]: 2024-03-30 14:15:31.989338555 +0000 UTC m=+5.526478362 container died b9078af21e45d305d631ed1983693d3c0770435bd065d406ee512aeb37992599 (image=quay.ceph.io/ceph-ci/ceph:4e50bbcdd1630c7760b708f3a5b4d38a121e66cb, name=ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-4, org.label-schema.build-date=20240326, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, ceph=True, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=squid-4e50bbc, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2) 2024-03-30T14:15:31.996 INFO:journalctl@ceph.osd.6.smithi181.stdout:Mar 30 14:15:31 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-6[159016]: 2024-03-30T14:15:31.753+0000 7f40ae4c5700 -1 osd.6 160 heartbeat_check: no reply from 172.21.15.99:6806 osd.0 since back 2024-03-30T14:14:55.671948+0000 front 2024-03-30T14:14:55.672008+0000 (oldest deadline 2024-03-30T14:15:19.771809+0000) 2024-03-30T14:15:31.996 INFO:journalctl@ceph.osd.6.smithi181.stdout:Mar 30 14:15:31 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-6[159016]: 2024-03-30T14:15:31.753+0000 7f40ae4c5700 -1 osd.6 160 heartbeat_check: no reply from 172.21.15.99:6814 osd.1 since back 2024-03-30T14:15:04.373319+0000 front 2024-03-30T14:15:04.373414+0000 (oldest deadline 2024-03-30T14:15:28.473188+0000) 2024-03-30T14:15:31.997 INFO:journalctl@ceph.osd.7.smithi181.stdout:Mar 30 14:15:31 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-7[162666]: 2024-03-30T14:15:31.751+0000 7f89f6425700 -1 osd.7 160 heartbeat_check: no reply from 172.21.15.99:6806 osd.0 since back 2024-03-30T14:14:54.735757+0000 front 2024-03-30T14:14:54.735668+0000 (oldest deadline 2024-03-30T14:15:17.035489+0000) 2024-03-30T14:15:31.997 INFO:journalctl@ceph.osd.7.smithi181.stdout:Mar 30 14:15:31 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-7[162666]: 2024-03-30T14:15:31.751+0000 7f89f6425700 -1 osd.7 160 heartbeat_check: no reply from 172.21.15.99:6814 osd.1 since back 2024-03-30T14:15:04.537446+0000 front 2024-03-30T14:15:04.537483+0000 (oldest deadline 2024-03-30T14:15:28.037269+0000) 2024-03-30T14:15:32.449 INFO:journalctl@ceph.osd.5.smithi181.stdout:Mar 30 14:15:32 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-5[154441]: 2024-03-30T14:15:32.081+0000 7f3033c34700 -1 osd.5 160 heartbeat_check: no reply from 172.21.15.99:6806 osd.0 since back 2024-03-30T14:14:51.048258+0000 front 2024-03-30T14:14:51.048173+0000 (oldest deadline 2024-03-30T14:15:16.948172+0000) 2024-03-30T14:15:32.449 INFO:journalctl@ceph.osd.5.smithi181.stdout:Mar 30 14:15:32 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-5[154441]: 2024-03-30T14:15:32.081+0000 7f3033c34700 -1 osd.5 160 heartbeat_check: no reply from 172.21.15.99:6814 osd.1 since back 2024-03-30T14:15:04.450202+0000 front 2024-03-30T14:15:04.450043+0000 (oldest deadline 2024-03-30T14:15:29.150016+0000) 2024-03-30T14:15:32.708 INFO:journalctl@ceph.osd.4.smithi181.stdout:Mar 30 14:15:32 smithi181 podman[178358]: 2024-03-30 14:15:32.458122217 +0000 UTC m=+5.995262019 container cleanup b9078af21e45d305d631ed1983693d3c0770435bd065d406ee512aeb37992599 (image=quay.ceph.io/ceph-ci/ceph:4e50bbcdd1630c7760b708f3a5b4d38a121e66cb, name=ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-4, RELEASE=squid-4e50bbc, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.build-date=20240326, CEPH_POINT_RELEASE=) 2024-03-30T14:15:32.709 INFO:journalctl@ceph.osd.4.smithi181.stdout:Mar 30 14:15:32 smithi181 bash[178358]: ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-4 2024-03-30T14:15:32.996 INFO:journalctl@ceph.osd.4.smithi181.stdout:Mar 30 14:15:32 smithi181 podman[178422]: 2024-03-30 14:15:32.718059202 +0000 UTC m=+0.732006592 container remove b9078af21e45d305d631ed1983693d3c0770435bd065d406ee512aeb37992599 (image=quay.ceph.io/ceph-ci/ceph:4e50bbcdd1630c7760b708f3a5b4d38a121e66cb, name=ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-4, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240326, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, RELEASE=squid-4e50bbc, org.label-schema.license=GPLv2, GIT_CLEAN=True, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0) 2024-03-30T14:15:32.996 INFO:journalctl@ceph.osd.6.smithi181.stdout:Mar 30 14:15:32 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-6[159016]: 2024-03-30T14:15:32.767+0000 7f40ae4c5700 -1 osd.6 160 heartbeat_check: no reply from 172.21.15.99:6806 osd.0 since back 2024-03-30T14:14:55.671948+0000 front 2024-03-30T14:14:55.672008+0000 (oldest deadline 2024-03-30T14:15:19.771809+0000) 2024-03-30T14:15:32.997 INFO:journalctl@ceph.osd.6.smithi181.stdout:Mar 30 14:15:32 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-6[159016]: 2024-03-30T14:15:32.767+0000 7f40ae4c5700 -1 osd.6 160 heartbeat_check: no reply from 172.21.15.99:6814 osd.1 since back 2024-03-30T14:15:04.373319+0000 front 2024-03-30T14:15:04.373414+0000 (oldest deadline 2024-03-30T14:15:28.473188+0000) 2024-03-30T14:15:32.997 INFO:journalctl@ceph.osd.7.smithi181.stdout:Mar 30 14:15:32 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-7[162666]: 2024-03-30T14:15:32.796+0000 7f89f6425700 -1 osd.7 160 heartbeat_check: no reply from 172.21.15.99:6806 osd.0 since back 2024-03-30T14:14:54.735757+0000 front 2024-03-30T14:14:54.735668+0000 (oldest deadline 2024-03-30T14:15:17.035489+0000) 2024-03-30T14:15:32.997 INFO:journalctl@ceph.osd.7.smithi181.stdout:Mar 30 14:15:32 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-7[162666]: 2024-03-30T14:15:32.796+0000 7f89f6425700 -1 osd.7 160 heartbeat_check: no reply from 172.21.15.99:6814 osd.1 since back 2024-03-30T14:15:04.537446+0000 front 2024-03-30T14:15:04.537483+0000 (oldest deadline 2024-03-30T14:15:28.037269+0000) 2024-03-30T14:15:33.279 INFO:journalctl@ceph.osd.4.smithi181.stdout:Mar 30 14:15:33 smithi181 podman[178517]: 2024-03-30 14:15:32.930335205 +0000 UTC m=+0.017993380 image pull b0c4478f1d83795df4d538bf108aee5fac57194348fb16dcdbb3115f3e2fe95e quay.ceph.io/ceph-ci/ceph:4e50bbcdd1630c7760b708f3a5b4d38a121e66cb 2024-03-30T14:15:33.279 INFO:journalctl@ceph.osd.4.smithi181.stdout:Mar 30 14:15:33 smithi181 podman[178517]: 2024-03-30 14:15:33.052252621 +0000 UTC m=+0.139910786 container create 25270b4fc8ffc93a849baf82198918f7435f0e162dd4a4f94e4183d434310e14 (image=quay.ceph.io/ceph-ci/ceph:4e50bbcdd1630c7760b708f3a5b4d38a121e66cb, name=ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-4-deactivate, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, RELEASE=squid-4e50bbc, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.build-date=20240326, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image) 2024-03-30T14:15:33.280 INFO:journalctl@ceph.osd.5.smithi181.stdout:Mar 30 14:15:33 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-5[154441]: 2024-03-30T14:15:33.079+0000 7f3033c34700 -1 osd.5 160 heartbeat_check: no reply from 172.21.15.99:6806 osd.0 since back 2024-03-30T14:14:51.048258+0000 front 2024-03-30T14:14:51.048173+0000 (oldest deadline 2024-03-30T14:15:16.948172+0000) 2024-03-30T14:15:33.280 INFO:journalctl@ceph.osd.5.smithi181.stdout:Mar 30 14:15:33 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-5[154441]: 2024-03-30T14:15:33.079+0000 7f3033c34700 -1 osd.5 160 heartbeat_check: no reply from 172.21.15.99:6814 osd.1 since back 2024-03-30T14:15:04.450202+0000 front 2024-03-30T14:15:04.450043+0000 (oldest deadline 2024-03-30T14:15:29.150016+0000) 2024-03-30T14:15:33.576 INFO:journalctl@ceph.osd.4.smithi181.stdout:Mar 30 14:15:33 smithi181 podman[178517]: 2024-03-30 14:15:33.288224075 +0000 UTC m=+0.375882263 container init 25270b4fc8ffc93a849baf82198918f7435f0e162dd4a4f94e4183d434310e14 (image=quay.ceph.io/ceph-ci/ceph:4e50bbcdd1630c7760b708f3a5b4d38a121e66cb, name=ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-4-deactivate, ceph=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, RELEASE=squid-4e50bbc, org.label-schema.license=GPLv2, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240326) 2024-03-30T14:15:33.576 INFO:journalctl@ceph.osd.4.smithi181.stdout:Mar 30 14:15:33 smithi181 podman[178517]: 2024-03-30 14:15:33.291919147 +0000 UTC m=+0.379577309 container start 25270b4fc8ffc93a849baf82198918f7435f0e162dd4a4f94e4183d434310e14 (image=quay.ceph.io/ceph-ci/ceph:4e50bbcdd1630c7760b708f3a5b4d38a121e66cb, name=ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-4-deactivate, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, GIT_CLEAN=True, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240326, org.label-schema.schema-version=1.0, ceph=True, RELEASE=squid-4e50bbc, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS) 2024-03-30T14:15:33.576 INFO:journalctl@ceph.osd.4.smithi181.stdout:Mar 30 14:15:33 smithi181 podman[178517]: 2024-03-30 14:15:33.379860488 +0000 UTC m=+0.467518651 container attach 25270b4fc8ffc93a849baf82198918f7435f0e162dd4a4f94e4183d434310e14 (image=quay.ceph.io/ceph-ci/ceph:4e50bbcdd1630c7760b708f3a5b4d38a121e66cb, name=ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-4-deactivate, RELEASE=squid-4e50bbc, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240326, io.buildah.version=1.33.5, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=) 2024-03-30T14:15:33.891 INFO:journalctl@ceph.osd.4.smithi181.stdout:Mar 30 14:15:33 smithi181 podman[178517]: 2024-03-30 14:15:33.585788605 +0000 UTC m=+0.673446780 container died 25270b4fc8ffc93a849baf82198918f7435f0e162dd4a4f94e4183d434310e14 (image=quay.ceph.io/ceph-ci/ceph:4e50bbcdd1630c7760b708f3a5b4d38a121e66cb, name=ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-4-deactivate, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.build-date=20240326, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, RELEASE=squid-4e50bbc, GIT_CLEAN=True, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0) 2024-03-30T14:15:33.892 INFO:journalctl@ceph.osd.6.smithi181.stdout:Mar 30 14:15:33 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-6[159016]: 2024-03-30T14:15:33.765+0000 7f40ae4c5700 -1 osd.6 160 heartbeat_check: no reply from 172.21.15.99:6806 osd.0 since back 2024-03-30T14:14:55.671948+0000 front 2024-03-30T14:14:55.672008+0000 (oldest deadline 2024-03-30T14:15:19.771809+0000) 2024-03-30T14:15:33.892 INFO:journalctl@ceph.osd.6.smithi181.stdout:Mar 30 14:15:33 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-6[159016]: 2024-03-30T14:15:33.765+0000 7f40ae4c5700 -1 osd.6 160 heartbeat_check: no reply from 172.21.15.99:6814 osd.1 since back 2024-03-30T14:15:04.373319+0000 front 2024-03-30T14:15:04.373414+0000 (oldest deadline 2024-03-30T14:15:28.473188+0000) 2024-03-30T14:15:33.892 INFO:journalctl@ceph.osd.7.smithi181.stdout:Mar 30 14:15:33 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-7[162666]: 2024-03-30T14:15:33.763+0000 7f89f6425700 -1 osd.7 160 heartbeat_check: no reply from 172.21.15.99:6806 osd.0 since back 2024-03-30T14:14:54.735757+0000 front 2024-03-30T14:14:54.735668+0000 (oldest deadline 2024-03-30T14:15:17.035489+0000) 2024-03-30T14:15:33.892 INFO:journalctl@ceph.osd.7.smithi181.stdout:Mar 30 14:15:33 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-7[162666]: 2024-03-30T14:15:33.763+0000 7f89f6425700 -1 osd.7 160 heartbeat_check: no reply from 172.21.15.99:6814 osd.1 since back 2024-03-30T14:15:04.537446+0000 front 2024-03-30T14:15:04.537483+0000 (oldest deadline 2024-03-30T14:15:28.037269+0000) 2024-03-30T14:15:34.165 INFO:journalctl@ceph.osd.5.smithi181.stdout:Mar 30 14:15:34 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-5[154441]: 2024-03-30T14:15:34.123+0000 7f3033c34700 -1 osd.5 160 heartbeat_check: no reply from 172.21.15.99:6806 osd.0 since back 2024-03-30T14:14:51.048258+0000 front 2024-03-30T14:14:51.048173+0000 (oldest deadline 2024-03-30T14:15:16.948172+0000) 2024-03-30T14:15:34.165 INFO:journalctl@ceph.osd.5.smithi181.stdout:Mar 30 14:15:34 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-5[154441]: 2024-03-30T14:15:34.124+0000 7f3033c34700 -1 osd.5 160 heartbeat_check: no reply from 172.21.15.99:6814 osd.1 since back 2024-03-30T14:15:04.450202+0000 front 2024-03-30T14:15:04.450043+0000 (oldest deadline 2024-03-30T14:15:29.150016+0000) 2024-03-30T14:15:34.190 DEBUG:teuthology.orchestra.run.smithi181:> sudo pkill -f 'journalctl -f -n 0 -u ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4@osd.4.service' 2024-03-30T14:15:34.233 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-03-30T14:15:34.233 INFO:tasks.cephadm.osd.4:Stopped osd.4 2024-03-30T14:15:34.234 INFO:tasks.cephadm.osd.5:Stopping osd.5... 2024-03-30T14:15:34.234 DEBUG:teuthology.orchestra.run.smithi181:> sudo systemctl stop ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4@osd.5 2024-03-30T14:15:34.496 INFO:journalctl@ceph.osd.5.smithi181.stdout:Mar 30 14:15:34 smithi181 systemd[1]: Stopping Ceph osd.5 for 98ebaeb8-ee99-11ee-b647-cb9ed24678a4... 2024-03-30T14:15:34.996 INFO:journalctl@ceph.osd.6.smithi181.stdout:Mar 30 14:15:34 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-6[159016]: 2024-03-30T14:15:34.742+0000 7f40ae4c5700 -1 osd.6 160 heartbeat_check: no reply from 172.21.15.99:6806 osd.0 since back 2024-03-30T14:14:55.671948+0000 front 2024-03-30T14:14:55.672008+0000 (oldest deadline 2024-03-30T14:15:19.771809+0000) 2024-03-30T14:15:34.996 INFO:journalctl@ceph.osd.6.smithi181.stdout:Mar 30 14:15:34 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-6[159016]: 2024-03-30T14:15:34.742+0000 7f40ae4c5700 -1 osd.6 160 heartbeat_check: no reply from 172.21.15.99:6814 osd.1 since back 2024-03-30T14:15:04.373319+0000 front 2024-03-30T14:15:04.373414+0000 (oldest deadline 2024-03-30T14:15:28.473188+0000) 2024-03-30T14:15:34.997 INFO:journalctl@ceph.osd.7.smithi181.stdout:Mar 30 14:15:34 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-7[162666]: 2024-03-30T14:15:34.723+0000 7f89f6425700 -1 osd.7 160 heartbeat_check: no reply from 172.21.15.99:6806 osd.0 since back 2024-03-30T14:14:54.735757+0000 front 2024-03-30T14:14:54.735668+0000 (oldest deadline 2024-03-30T14:15:17.035489+0000) 2024-03-30T14:15:34.997 INFO:journalctl@ceph.osd.7.smithi181.stdout:Mar 30 14:15:34 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-7[162666]: 2024-03-30T14:15:34.723+0000 7f89f6425700 -1 osd.7 160 heartbeat_check: no reply from 172.21.15.99:6814 osd.1 since back 2024-03-30T14:15:04.537446+0000 front 2024-03-30T14:15:04.537483+0000 (oldest deadline 2024-03-30T14:15:28.037269+0000) 2024-03-30T14:15:34.997 INFO:journalctl@ceph.osd.5.smithi181.stdout:Mar 30 14:15:34 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-5[154441]: 2024-03-30T14:15:34.593+0000 7f303b648700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.5 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-03-30T14:15:34.997 INFO:journalctl@ceph.osd.5.smithi181.stdout:Mar 30 14:15:34 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-5[154441]: 2024-03-30T14:15:34.593+0000 7f303b648700 -1 osd.5 160 *** Got signal Terminated *** 2024-03-30T14:15:34.997 INFO:journalctl@ceph.osd.5.smithi181.stdout:Mar 30 14:15:34 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-5[154441]: 2024-03-30T14:15:34.593+0000 7f303b648700 -1 osd.5 160 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-03-30T14:15:35.496 INFO:journalctl@ceph.osd.5.smithi181.stdout:Mar 30 14:15:35 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-5[154441]: 2024-03-30T14:15:35.125+0000 7f3033c34700 -1 osd.5 160 heartbeat_check: no reply from 172.21.15.99:6806 osd.0 since back 2024-03-30T14:14:51.048258+0000 front 2024-03-30T14:14:51.048173+0000 (oldest deadline 2024-03-30T14:15:16.948172+0000) 2024-03-30T14:15:35.496 INFO:journalctl@ceph.osd.5.smithi181.stdout:Mar 30 14:15:35 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-5[154441]: 2024-03-30T14:15:35.125+0000 7f3033c34700 -1 osd.5 160 heartbeat_check: no reply from 172.21.15.99:6814 osd.1 since back 2024-03-30T14:15:04.450202+0000 front 2024-03-30T14:15:04.450043+0000 (oldest deadline 2024-03-30T14:15:29.150016+0000) 2024-03-30T14:15:35.496 INFO:journalctl@ceph.osd.5.smithi181.stdout:Mar 30 14:15:35 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-5[154441]: 2024-03-30T14:15:35.125+0000 7f3033c34700 -1 osd.5 160 heartbeat_check: no reply from 172.21.15.99:6822 osd.2 since back 2024-03-30T14:15:09.150575+0000 front 2024-03-30T14:15:09.150465+0000 (oldest deadline 2024-03-30T14:15:34.450485+0000) 2024-03-30T14:15:35.996 INFO:journalctl@ceph.osd.6.smithi181.stdout:Mar 30 14:15:35 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-6[159016]: 2024-03-30T14:15:35.729+0000 7f40ae4c5700 -1 osd.6 160 heartbeat_check: no reply from 172.21.15.99:6806 osd.0 since back 2024-03-30T14:14:55.671948+0000 front 2024-03-30T14:14:55.672008+0000 (oldest deadline 2024-03-30T14:15:19.771809+0000) 2024-03-30T14:15:35.996 INFO:journalctl@ceph.osd.6.smithi181.stdout:Mar 30 14:15:35 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-6[159016]: 2024-03-30T14:15:35.729+0000 7f40ae4c5700 -1 osd.6 160 heartbeat_check: no reply from 172.21.15.99:6814 osd.1 since back 2024-03-30T14:15:04.373319+0000 front 2024-03-30T14:15:04.373414+0000 (oldest deadline 2024-03-30T14:15:28.473188+0000) 2024-03-30T14:15:35.996 INFO:journalctl@ceph.osd.6.smithi181.stdout:Mar 30 14:15:35 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-6[159016]: 2024-03-30T14:15:35.729+0000 7f40ae4c5700 -1 osd.6 160 heartbeat_check: no reply from 172.21.15.99:6822 osd.2 since back 2024-03-30T14:15:11.974325+0000 front 2024-03-30T14:15:11.974252+0000 (oldest deadline 2024-03-30T14:15:34.874106+0000) 2024-03-30T14:15:35.997 INFO:journalctl@ceph.osd.7.smithi181.stdout:Mar 30 14:15:35 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-7[162666]: 2024-03-30T14:15:35.683+0000 7f89f6425700 -1 osd.7 160 heartbeat_check: no reply from 172.21.15.99:6806 osd.0 since back 2024-03-30T14:14:54.735757+0000 front 2024-03-30T14:14:54.735668+0000 (oldest deadline 2024-03-30T14:15:17.035489+0000) 2024-03-30T14:15:35.997 INFO:journalctl@ceph.osd.7.smithi181.stdout:Mar 30 14:15:35 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-7[162666]: 2024-03-30T14:15:35.683+0000 7f89f6425700 -1 osd.7 160 heartbeat_check: no reply from 172.21.15.99:6814 osd.1 since back 2024-03-30T14:15:04.537446+0000 front 2024-03-30T14:15:04.537483+0000 (oldest deadline 2024-03-30T14:15:28.037269+0000) 2024-03-30T14:15:35.997 INFO:journalctl@ceph.osd.7.smithi181.stdout:Mar 30 14:15:35 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-7[162666]: 2024-03-30T14:15:35.683+0000 7f89f6425700 -1 osd.7 160 heartbeat_check: no reply from 172.21.15.99:6822 osd.2 since back 2024-03-30T14:15:09.738215+0000 front 2024-03-30T14:15:09.738166+0000 (oldest deadline 2024-03-30T14:15:35.637991+0000) 2024-03-30T14:15:36.496 INFO:journalctl@ceph.osd.5.smithi181.stdout:Mar 30 14:15:36 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-5[154441]: 2024-03-30T14:15:36.155+0000 7f3033c34700 -1 osd.5 160 heartbeat_check: no reply from 172.21.15.99:6806 osd.0 since back 2024-03-30T14:14:51.048258+0000 front 2024-03-30T14:14:51.048173+0000 (oldest deadline 2024-03-30T14:15:16.948172+0000) 2024-03-30T14:15:36.496 INFO:journalctl@ceph.osd.5.smithi181.stdout:Mar 30 14:15:36 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-5[154441]: 2024-03-30T14:15:36.155+0000 7f3033c34700 -1 osd.5 160 heartbeat_check: no reply from 172.21.15.99:6814 osd.1 since back 2024-03-30T14:15:04.450202+0000 front 2024-03-30T14:15:04.450043+0000 (oldest deadline 2024-03-30T14:15:29.150016+0000) 2024-03-30T14:15:36.496 INFO:journalctl@ceph.osd.5.smithi181.stdout:Mar 30 14:15:36 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-5[154441]: 2024-03-30T14:15:36.155+0000 7f3033c34700 -1 osd.5 160 heartbeat_check: no reply from 172.21.15.99:6822 osd.2 since back 2024-03-30T14:15:09.150575+0000 front 2024-03-30T14:15:09.150465+0000 (oldest deadline 2024-03-30T14:15:34.450485+0000) 2024-03-30T14:15:36.999 INFO:journalctl@ceph.osd.7.smithi181.stdout:Mar 30 14:15:36 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-7[162666]: 2024-03-30T14:15:36.712+0000 7f89f6425700 -1 osd.7 160 heartbeat_check: no reply from 172.21.15.99:6806 osd.0 since back 2024-03-30T14:14:54.735757+0000 front 2024-03-30T14:14:54.735668+0000 (oldest deadline 2024-03-30T14:15:17.035489+0000) 2024-03-30T14:15:37.000 INFO:journalctl@ceph.osd.7.smithi181.stdout:Mar 30 14:15:36 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-7[162666]: 2024-03-30T14:15:36.712+0000 7f89f6425700 -1 osd.7 160 heartbeat_check: no reply from 172.21.15.99:6814 osd.1 since back 2024-03-30T14:15:04.537446+0000 front 2024-03-30T14:15:04.537483+0000 (oldest deadline 2024-03-30T14:15:28.037269+0000) 2024-03-30T14:15:37.000 INFO:journalctl@ceph.osd.7.smithi181.stdout:Mar 30 14:15:36 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-7[162666]: 2024-03-30T14:15:36.712+0000 7f89f6425700 -1 osd.7 160 heartbeat_check: no reply from 172.21.15.99:6822 osd.2 since back 2024-03-30T14:15:09.738215+0000 front 2024-03-30T14:15:09.738166+0000 (oldest deadline 2024-03-30T14:15:35.637991+0000) 2024-03-30T14:15:37.000 INFO:journalctl@ceph.osd.6.smithi181.stdout:Mar 30 14:15:36 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-6[159016]: 2024-03-30T14:15:36.708+0000 7f40ae4c5700 -1 osd.6 160 heartbeat_check: no reply from 172.21.15.99:6806 osd.0 since back 2024-03-30T14:14:55.671948+0000 front 2024-03-30T14:14:55.672008+0000 (oldest deadline 2024-03-30T14:15:19.771809+0000) 2024-03-30T14:15:37.000 INFO:journalctl@ceph.osd.6.smithi181.stdout:Mar 30 14:15:36 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-6[159016]: 2024-03-30T14:15:36.708+0000 7f40ae4c5700 -1 osd.6 160 heartbeat_check: no reply from 172.21.15.99:6814 osd.1 since back 2024-03-30T14:15:04.373319+0000 front 2024-03-30T14:15:04.373414+0000 (oldest deadline 2024-03-30T14:15:28.473188+0000) 2024-03-30T14:15:37.000 INFO:journalctl@ceph.osd.6.smithi181.stdout:Mar 30 14:15:36 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-6[159016]: 2024-03-30T14:15:36.708+0000 7f40ae4c5700 -1 osd.6 160 heartbeat_check: no reply from 172.21.15.99:6822 osd.2 since back 2024-03-30T14:15:11.974325+0000 front 2024-03-30T14:15:11.974252+0000 (oldest deadline 2024-03-30T14:15:34.874106+0000) 2024-03-30T14:15:37.497 INFO:journalctl@ceph.osd.5.smithi181.stdout:Mar 30 14:15:37 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-5[154441]: 2024-03-30T14:15:37.194+0000 7f3033c34700 -1 osd.5 160 heartbeat_check: no reply from 172.21.15.99:6806 osd.0 since back 2024-03-30T14:14:51.048258+0000 front 2024-03-30T14:14:51.048173+0000 (oldest deadline 2024-03-30T14:15:16.948172+0000) 2024-03-30T14:15:37.497 INFO:journalctl@ceph.osd.5.smithi181.stdout:Mar 30 14:15:37 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-5[154441]: 2024-03-30T14:15:37.194+0000 7f3033c34700 -1 osd.5 160 heartbeat_check: no reply from 172.21.15.99:6814 osd.1 since back 2024-03-30T14:15:04.450202+0000 front 2024-03-30T14:15:04.450043+0000 (oldest deadline 2024-03-30T14:15:29.150016+0000) 2024-03-30T14:15:37.497 INFO:journalctl@ceph.osd.5.smithi181.stdout:Mar 30 14:15:37 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-5[154441]: 2024-03-30T14:15:37.194+0000 7f3033c34700 -1 osd.5 160 heartbeat_check: no reply from 172.21.15.99:6822 osd.2 since back 2024-03-30T14:15:09.150575+0000 front 2024-03-30T14:15:09.150465+0000 (oldest deadline 2024-03-30T14:15:34.450485+0000) 2024-03-30T14:15:37.924 INFO:journalctl@ceph.osd.6.smithi181.stdout:Mar 30 14:15:37 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-6[159016]: 2024-03-30T14:15:37.680+0000 7f40ae4c5700 -1 osd.6 160 heartbeat_check: no reply from 172.21.15.99:6806 osd.0 since back 2024-03-30T14:14:55.671948+0000 front 2024-03-30T14:14:55.672008+0000 (oldest deadline 2024-03-30T14:15:19.771809+0000) 2024-03-30T14:15:37.924 INFO:journalctl@ceph.osd.6.smithi181.stdout:Mar 30 14:15:37 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-6[159016]: 2024-03-30T14:15:37.680+0000 7f40ae4c5700 -1 osd.6 160 heartbeat_check: no reply from 172.21.15.99:6814 osd.1 since back 2024-03-30T14:15:04.373319+0000 front 2024-03-30T14:15:04.373414+0000 (oldest deadline 2024-03-30T14:15:28.473188+0000) 2024-03-30T14:15:37.924 INFO:journalctl@ceph.osd.6.smithi181.stdout:Mar 30 14:15:37 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-6[159016]: 2024-03-30T14:15:37.680+0000 7f40ae4c5700 -1 osd.6 160 heartbeat_check: no reply from 172.21.15.99:6822 osd.2 since back 2024-03-30T14:15:11.974325+0000 front 2024-03-30T14:15:11.974252+0000 (oldest deadline 2024-03-30T14:15:34.874106+0000) 2024-03-30T14:15:37.924 INFO:journalctl@ceph.osd.7.smithi181.stdout:Mar 30 14:15:37 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-7[162666]: 2024-03-30T14:15:37.687+0000 7f89f6425700 -1 osd.7 160 heartbeat_check: no reply from 172.21.15.99:6806 osd.0 since back 2024-03-30T14:14:54.735757+0000 front 2024-03-30T14:14:54.735668+0000 (oldest deadline 2024-03-30T14:15:17.035489+0000) 2024-03-30T14:15:37.925 INFO:journalctl@ceph.osd.7.smithi181.stdout:Mar 30 14:15:37 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-7[162666]: 2024-03-30T14:15:37.687+0000 7f89f6425700 -1 osd.7 160 heartbeat_check: no reply from 172.21.15.99:6814 osd.1 since back 2024-03-30T14:15:04.537446+0000 front 2024-03-30T14:15:04.537483+0000 (oldest deadline 2024-03-30T14:15:28.037269+0000) 2024-03-30T14:15:37.925 INFO:journalctl@ceph.osd.7.smithi181.stdout:Mar 30 14:15:37 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-7[162666]: 2024-03-30T14:15:37.687+0000 7f89f6425700 -1 osd.7 160 heartbeat_check: no reply from 172.21.15.99:6822 osd.2 since back 2024-03-30T14:15:09.738215+0000 front 2024-03-30T14:15:09.738166+0000 (oldest deadline 2024-03-30T14:15:35.637991+0000) 2024-03-30T14:15:38.496 INFO:journalctl@ceph.osd.5.smithi181.stdout:Mar 30 14:15:38 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-5[154441]: 2024-03-30T14:15:38.221+0000 7f3033c34700 -1 osd.5 160 heartbeat_check: no reply from 172.21.15.99:6806 osd.0 since back 2024-03-30T14:14:51.048258+0000 front 2024-03-30T14:14:51.048173+0000 (oldest deadline 2024-03-30T14:15:16.948172+0000) 2024-03-30T14:15:38.496 INFO:journalctl@ceph.osd.5.smithi181.stdout:Mar 30 14:15:38 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-5[154441]: 2024-03-30T14:15:38.221+0000 7f3033c34700 -1 osd.5 160 heartbeat_check: no reply from 172.21.15.99:6814 osd.1 since back 2024-03-30T14:15:04.450202+0000 front 2024-03-30T14:15:04.450043+0000 (oldest deadline 2024-03-30T14:15:29.150016+0000) 2024-03-30T14:15:38.496 INFO:journalctl@ceph.osd.5.smithi181.stdout:Mar 30 14:15:38 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-5[154441]: 2024-03-30T14:15:38.221+0000 7f3033c34700 -1 osd.5 160 heartbeat_check: no reply from 172.21.15.99:6822 osd.2 since back 2024-03-30T14:15:09.150575+0000 front 2024-03-30T14:15:09.150465+0000 (oldest deadline 2024-03-30T14:15:34.450485+0000) 2024-03-30T14:15:38.996 INFO:journalctl@ceph.osd.7.smithi181.stdout:Mar 30 14:15:38 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-7[162666]: 2024-03-30T14:15:38.727+0000 7f89f6425700 -1 osd.7 160 heartbeat_check: no reply from 172.21.15.99:6806 osd.0 since back 2024-03-30T14:14:54.735757+0000 front 2024-03-30T14:14:54.735668+0000 (oldest deadline 2024-03-30T14:15:17.035489+0000) 2024-03-30T14:15:38.996 INFO:journalctl@ceph.osd.7.smithi181.stdout:Mar 30 14:15:38 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-7[162666]: 2024-03-30T14:15:38.727+0000 7f89f6425700 -1 osd.7 160 heartbeat_check: no reply from 172.21.15.99:6814 osd.1 since back 2024-03-30T14:15:04.537446+0000 front 2024-03-30T14:15:04.537483+0000 (oldest deadline 2024-03-30T14:15:28.037269+0000) 2024-03-30T14:15:38.996 INFO:journalctl@ceph.osd.7.smithi181.stdout:Mar 30 14:15:38 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-7[162666]: 2024-03-30T14:15:38.727+0000 7f89f6425700 -1 osd.7 160 heartbeat_check: no reply from 172.21.15.99:6822 osd.2 since back 2024-03-30T14:15:09.738215+0000 front 2024-03-30T14:15:09.738166+0000 (oldest deadline 2024-03-30T14:15:35.637991+0000) 2024-03-30T14:15:38.996 INFO:journalctl@ceph.osd.6.smithi181.stdout:Mar 30 14:15:38 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-6[159016]: 2024-03-30T14:15:38.634+0000 7f40ae4c5700 -1 osd.6 160 heartbeat_check: no reply from 172.21.15.99:6806 osd.0 since back 2024-03-30T14:14:55.671948+0000 front 2024-03-30T14:14:55.672008+0000 (oldest deadline 2024-03-30T14:15:19.771809+0000) 2024-03-30T14:15:38.996 INFO:journalctl@ceph.osd.6.smithi181.stdout:Mar 30 14:15:38 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-6[159016]: 2024-03-30T14:15:38.634+0000 7f40ae4c5700 -1 osd.6 160 heartbeat_check: no reply from 172.21.15.99:6814 osd.1 since back 2024-03-30T14:15:04.373319+0000 front 2024-03-30T14:15:04.373414+0000 (oldest deadline 2024-03-30T14:15:28.473188+0000) 2024-03-30T14:15:38.996 INFO:journalctl@ceph.osd.6.smithi181.stdout:Mar 30 14:15:38 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-6[159016]: 2024-03-30T14:15:38.634+0000 7f40ae4c5700 -1 osd.6 160 heartbeat_check: no reply from 172.21.15.99:6822 osd.2 since back 2024-03-30T14:15:11.974325+0000 front 2024-03-30T14:15:11.974252+0000 (oldest deadline 2024-03-30T14:15:34.874106+0000) 2024-03-30T14:15:39.496 INFO:journalctl@ceph.osd.5.smithi181.stdout:Mar 30 14:15:39 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-5[154441]: 2024-03-30T14:15:39.225+0000 7f3033c34700 -1 osd.5 160 heartbeat_check: no reply from 172.21.15.99:6806 osd.0 since back 2024-03-30T14:14:51.048258+0000 front 2024-03-30T14:14:51.048173+0000 (oldest deadline 2024-03-30T14:15:16.948172+0000) 2024-03-30T14:15:39.496 INFO:journalctl@ceph.osd.5.smithi181.stdout:Mar 30 14:15:39 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-5[154441]: 2024-03-30T14:15:39.225+0000 7f3033c34700 -1 osd.5 160 heartbeat_check: no reply from 172.21.15.99:6814 osd.1 since back 2024-03-30T14:15:04.450202+0000 front 2024-03-30T14:15:04.450043+0000 (oldest deadline 2024-03-30T14:15:29.150016+0000) 2024-03-30T14:15:39.496 INFO:journalctl@ceph.osd.5.smithi181.stdout:Mar 30 14:15:39 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-5[154441]: 2024-03-30T14:15:39.225+0000 7f3033c34700 -1 osd.5 160 heartbeat_check: no reply from 172.21.15.99:6822 osd.2 since back 2024-03-30T14:15:09.150575+0000 front 2024-03-30T14:15:09.150465+0000 (oldest deadline 2024-03-30T14:15:34.450485+0000) 2024-03-30T14:15:39.497 INFO:journalctl@ceph.prometheus.a.smithi181.stdout:Mar 30 14:15:39 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-prometheus-a[100542]: ts=2024-03-30T14:15:39.177Z caller=refresh.go:99 level=error component="discovery manager scrape" discovery=http config=ceph-exporter msg="Unable to refresh target groups" err="Get \"http://172.21.15.99:8765/sd/prometheus/sd-config?service=ceph-exporter\": dial tcp 172.21.15.99:8765: connect: connection refused" 2024-03-30T14:15:39.497 INFO:journalctl@ceph.prometheus.a.smithi181.stdout:Mar 30 14:15:39 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-prometheus-a[100542]: ts=2024-03-30T14:15:39.177Z caller=refresh.go:99 level=error component="discovery manager scrape" discovery=http config=node msg="Unable to refresh target groups" err="Get \"http://172.21.15.99:8765/sd/prometheus/sd-config?service=node-exporter\": dial tcp 172.21.15.99:8765: connect: connection refused" 2024-03-30T14:15:39.497 INFO:journalctl@ceph.prometheus.a.smithi181.stdout:Mar 30 14:15:39 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-prometheus-a[100542]: ts=2024-03-30T14:15:39.178Z caller=refresh.go:99 level=error component="discovery manager notify" discovery=http config=config-0 msg="Unable to refresh target groups" err="Get \"http://172.21.15.99:8765/sd/prometheus/sd-config?service=alertmanager\": dial tcp 172.21.15.99:8765: connect: connection refused" 2024-03-30T14:15:39.497 INFO:journalctl@ceph.prometheus.a.smithi181.stdout:Mar 30 14:15:39 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-prometheus-a[100542]: ts=2024-03-30T14:15:39.182Z caller=refresh.go:99 level=error component="discovery manager scrape" discovery=http config=ceph msg="Unable to refresh target groups" err="Get \"http://172.21.15.99:8765/sd/prometheus/sd-config?service=mgr-prometheus\": dial tcp 172.21.15.99:8765: connect: connection refused" 2024-03-30T14:15:39.993 INFO:journalctl@ceph.osd.6.smithi181.stdout:Mar 30 14:15:39 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-6[159016]: 2024-03-30T14:15:39.648+0000 7f40ae4c5700 -1 osd.6 160 heartbeat_check: no reply from 172.21.15.99:6806 osd.0 since back 2024-03-30T14:14:55.671948+0000 front 2024-03-30T14:14:55.672008+0000 (oldest deadline 2024-03-30T14:15:19.771809+0000) 2024-03-30T14:15:39.993 INFO:journalctl@ceph.osd.6.smithi181.stdout:Mar 30 14:15:39 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-6[159016]: 2024-03-30T14:15:39.648+0000 7f40ae4c5700 -1 osd.6 160 heartbeat_check: no reply from 172.21.15.99:6814 osd.1 since back 2024-03-30T14:15:04.373319+0000 front 2024-03-30T14:15:04.373414+0000 (oldest deadline 2024-03-30T14:15:28.473188+0000) 2024-03-30T14:15:39.993 INFO:journalctl@ceph.osd.6.smithi181.stdout:Mar 30 14:15:39 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-6[159016]: 2024-03-30T14:15:39.648+0000 7f40ae4c5700 -1 osd.6 160 heartbeat_check: no reply from 172.21.15.99:6822 osd.2 since back 2024-03-30T14:15:11.974325+0000 front 2024-03-30T14:15:11.974252+0000 (oldest deadline 2024-03-30T14:15:34.874106+0000) 2024-03-30T14:15:39.993 INFO:journalctl@ceph.osd.7.smithi181.stdout:Mar 30 14:15:39 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-7[162666]: 2024-03-30T14:15:39.749+0000 7f89f6425700 -1 osd.7 160 heartbeat_check: no reply from 172.21.15.99:6806 osd.0 since back 2024-03-30T14:14:54.735757+0000 front 2024-03-30T14:14:54.735668+0000 (oldest deadline 2024-03-30T14:15:17.035489+0000) 2024-03-30T14:15:39.993 INFO:journalctl@ceph.osd.7.smithi181.stdout:Mar 30 14:15:39 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-7[162666]: 2024-03-30T14:15:39.749+0000 7f89f6425700 -1 osd.7 160 heartbeat_check: no reply from 172.21.15.99:6814 osd.1 since back 2024-03-30T14:15:04.537446+0000 front 2024-03-30T14:15:04.537483+0000 (oldest deadline 2024-03-30T14:15:28.037269+0000) 2024-03-30T14:15:39.993 INFO:journalctl@ceph.osd.7.smithi181.stdout:Mar 30 14:15:39 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-7[162666]: 2024-03-30T14:15:39.749+0000 7f89f6425700 -1 osd.7 160 heartbeat_check: no reply from 172.21.15.99:6822 osd.2 since back 2024-03-30T14:15:09.738215+0000 front 2024-03-30T14:15:09.738166+0000 (oldest deadline 2024-03-30T14:15:35.637991+0000) 2024-03-30T14:15:40.246 INFO:journalctl@ceph.osd.5.smithi181.stdout:Mar 30 14:15:40 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-5[154441]: *** Caught signal (Segmentation fault) ** 2024-03-30T14:15:40.247 INFO:journalctl@ceph.osd.5.smithi181.stdout:Mar 30 14:15:40 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-5[154441]: in thread 7f3022c12700 thread_name:safe_timer 2024-03-30T14:15:40.247 INFO:journalctl@ceph.osd.5.smithi181.stdout:Mar 30 14:15:40 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-5[154441]: ceph version 19.0.0-1967-g4e50bbcd (4e50bbcdd1630c7760b708f3a5b4d38a121e66cb) squid (dev) 2024-03-30T14:15:40.247 INFO:journalctl@ceph.osd.5.smithi181.stdout:Mar 30 14:15:40 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-5[154441]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7f3042a9ed20] 2024-03-30T14:15:40.247 INFO:journalctl@ceph.osd.5.smithi181.stdout:Mar 30 14:15:40 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-5[154441]: 2: (BlueStore::_txc_create(BlueStore::Collection*, BlueStore::OpSequencer*, std::__cxx11::list >*, boost::intrusive_ptr)+0x40a) [0x564db7760daa] 2024-03-30T14:15:40.247 INFO:journalctl@ceph.osd.5.smithi181.stdout:Mar 30 14:15:40 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-5[154441]: 3: (BlueStore::queue_transactions(boost::intrusive_ptr&, std::vector >&, boost::intrusive_ptr, ThreadPool::TPHandle*)+0x1f8) [0x564db77ee948] 2024-03-30T14:15:40.247 INFO:journalctl@ceph.osd.5.smithi181.stdout:Mar 30 14:15:40 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-5[154441]: 4: (non-virtual thunk to PrimaryLogPG::queue_transactions(std::vector >&, boost::intrusive_ptr)+0x53) [0x564db73d4713] 2024-03-30T14:15:40.247 INFO:journalctl@ceph.osd.5.smithi181.stdout:Mar 30 14:15:40 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-5[154441]: 5: (ReplicatedBackend::submit_transaction(hobject_t const&, object_stat_sum_t const&, eversion_t const&, std::unique_ptr >&&, eversion_t const&, eversion_t const&, std::vector >&&, std::optional&, Context*, unsigned long, osd_reqid_t, boost::intrusive_ptr)+0x7b1) [0x564db765f821] 2024-03-30T14:15:40.247 INFO:journalctl@ceph.osd.5.smithi181.stdout:Mar 30 14:15:40 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-5[154441]: 6: (PrimaryLogPG::issue_repop(PrimaryLogPG::RepGather*, PrimaryLogPG::OpContext*)+0x424) [0x564db73503f4] 2024-03-30T14:15:40.247 INFO:journalctl@ceph.osd.5.smithi181.stdout:Mar 30 14:15:40 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-5[154441]: 7: (PrimaryLogPG::simple_opc_submit(std::unique_ptr >)+0x5a) [0x564db735245a] 2024-03-30T14:15:40.247 INFO:journalctl@ceph.osd.5.smithi181.stdout:Mar 30 14:15:40 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-5[154441]: 8: (PrimaryLogPG::handle_watch_timeout(std::shared_ptr)+0x873) [0x564db73543c3] 2024-03-30T14:15:40.247 INFO:journalctl@ceph.osd.5.smithi181.stdout:Mar 30 14:15:40 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-5[154441]: 9: (HandleWatchTimeout::complete(int)+0x11a) [0x564db72b577a] 2024-03-30T14:15:40.248 INFO:journalctl@ceph.osd.5.smithi181.stdout:Mar 30 14:15:40 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-5[154441]: 10: (CommonSafeTimer::timer_thread()+0x155) [0x564db7910715] 2024-03-30T14:15:40.248 INFO:journalctl@ceph.osd.5.smithi181.stdout:Mar 30 14:15:40 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-5[154441]: 11: (CommonSafeTimerThread::entry()+0x11) [0x564db7911f41] 2024-03-30T14:15:40.248 INFO:journalctl@ceph.osd.5.smithi181.stdout:Mar 30 14:15:40 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-5[154441]: 12: /lib64/libpthread.so.0(+0x81ca) [0x7f3042a941ca] 2024-03-30T14:15:40.248 INFO:journalctl@ceph.osd.5.smithi181.stdout:Mar 30 14:15:40 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-5[154441]: 13: clone() 2024-03-30T14:15:40.248 INFO:journalctl@ceph.osd.5.smithi181.stdout:Mar 30 14:15:40 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-5[154441]: 2024-03-30T14:15:40.035+0000 7f3022c12700 -1 *** Caught signal (Segmentation fault) ** 2024-03-30T14:15:40.248 INFO:journalctl@ceph.osd.5.smithi181.stdout:Mar 30 14:15:40 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-5[154441]: in thread 7f3022c12700 thread_name:safe_timer 2024-03-30T14:15:40.248 INFO:journalctl@ceph.osd.5.smithi181.stdout:Mar 30 14:15:40 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-5[154441]: 2024-03-30T14:15:40.248 INFO:journalctl@ceph.osd.5.smithi181.stdout:Mar 30 14:15:40 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-5[154441]: ceph version 19.0.0-1967-g4e50bbcd (4e50bbcdd1630c7760b708f3a5b4d38a121e66cb) squid (dev) 2024-03-30T14:15:40.248 INFO:journalctl@ceph.osd.5.smithi181.stdout:Mar 30 14:15:40 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-5[154441]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7f3042a9ed20] 2024-03-30T14:15:40.248 INFO:journalctl@ceph.osd.5.smithi181.stdout:Mar 30 14:15:40 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-5[154441]: 2: (BlueStore::_txc_create(BlueStore::Collection*, BlueStore::OpSequencer*, std::__cxx11::list >*, boost::intrusive_ptr)+0x40a) [0x564db7760daa] 2024-03-30T14:15:40.248 INFO:journalctl@ceph.osd.5.smithi181.stdout:Mar 30 14:15:40 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-5[154441]: 3: (BlueStore::queue_transactions(boost::intrusive_ptr&, std::vector >&, boost::intrusive_ptr, ThreadPool::TPHandle*)+0x1f8) [0x564db77ee948] 2024-03-30T14:15:40.248 INFO:journalctl@ceph.osd.5.smithi181.stdout:Mar 30 14:15:40 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-5[154441]: 4: (non-virtual thunk to PrimaryLogPG::queue_transactions(std::vector >&, boost::intrusive_ptr)+0x53) [0x564db73d4713] 2024-03-30T14:15:40.248 INFO:journalctl@ceph.osd.5.smithi181.stdout:Mar 30 14:15:40 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-5[154441]: 5: (ReplicatedBackend::submit_transaction(hobject_t const&, object_stat_sum_t const&, eversion_t const&, std::unique_ptr >&&, eversion_t const&, eversion_t const&, std::vector >&&, std::optional&, Context*, unsigned long, osd_reqid_t, boost::intrusive_ptr)+0x7b1) [0x564db765f821] 2024-03-30T14:15:40.248 INFO:journalctl@ceph.osd.5.smithi181.stdout:Mar 30 14:15:40 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-5[154441]: 6: (PrimaryLogPG::issue_repop(PrimaryLogPG::RepGather*, PrimaryLogPG::OpContext*)+0x424) [0x564db73503f4] 2024-03-30T14:15:40.248 INFO:journalctl@ceph.osd.5.smithi181.stdout:Mar 30 14:15:40 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-5[154441]: 7: (PrimaryLogPG::simple_opc_submit(std::unique_ptr >)+0x5a) [0x564db735245a] 2024-03-30T14:15:40.249 INFO:journalctl@ceph.osd.5.smithi181.stdout:Mar 30 14:15:40 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-5[154441]: 8: (PrimaryLogPG::handle_watch_timeout(std::shared_ptr)+0x873) [0x564db73543c3] 2024-03-30T14:15:40.249 INFO:journalctl@ceph.osd.5.smithi181.stdout:Mar 30 14:15:40 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-5[154441]: 9: (HandleWatchTimeout::complete(int)+0x11a) [0x564db72b577a] 2024-03-30T14:15:40.249 INFO:journalctl@ceph.osd.5.smithi181.stdout:Mar 30 14:15:40 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-5[154441]: 10: (CommonSafeTimer::timer_thread()+0x155) [0x564db7910715] 2024-03-30T14:15:40.249 INFO:journalctl@ceph.osd.5.smithi181.stdout:Mar 30 14:15:40 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-5[154441]: 11: (CommonSafeTimerThread::entry()+0x11) [0x564db7911f41] 2024-03-30T14:15:40.249 INFO:journalctl@ceph.osd.5.smithi181.stdout:Mar 30 14:15:40 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-5[154441]: 12: /lib64/libpthread.so.0(+0x81ca) [0x7f3042a941ca] 2024-03-30T14:15:40.249 INFO:journalctl@ceph.osd.5.smithi181.stdout:Mar 30 14:15:40 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-5[154441]: 13: clone() 2024-03-30T14:15:40.249 INFO:journalctl@ceph.osd.5.smithi181.stdout:Mar 30 14:15:40 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-5[154441]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-03-30T14:15:40.249 INFO:journalctl@ceph.osd.5.smithi181.stdout:Mar 30 14:15:40 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-5[154441]: 2024-03-30T14:15:40.249 INFO:journalctl@ceph.osd.5.smithi181.stdout:Mar 30 14:15:40 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-5[154441]: -5592> 2024-03-30T14:15:17.224+0000 7f3033c34700 -1 osd.5 160 heartbeat_check: no reply from 172.21.15.99:6806 osd.0 since back 2024-03-30T14:14:51.048258+0000 front 2024-03-30T14:14:51.048173+0000 (oldest deadline 2024-03-30T14:15:16.948172+0000) 2024-03-30T14:15:40.249 INFO:journalctl@ceph.osd.5.smithi181.stdout:Mar 30 14:15:40 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-5[154441]: -5471> 2024-03-30T14:15:18.229+0000 7f3033c34700 -1 osd.5 160 heartbeat_check: no reply from 172.21.15.99:6806 osd.0 since back 2024-03-30T14:14:51.048258+0000 front 2024-03-30T14:14:51.048173+0000 (oldest deadline 2024-03-30T14:15:16.948172+0000) 2024-03-30T14:15:40.249 INFO:journalctl@ceph.osd.5.smithi181.stdout:Mar 30 14:15:40 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-5[154441]: -5333> 2024-03-30T14:15:19.211+0000 7f3033c34700 -1 osd.5 160 heartbeat_check: no reply from 172.21.15.99:6806 osd.0 since back 2024-03-30T14:14:51.048258+0000 front 2024-03-30T14:14:51.048173+0000 (oldest deadline 2024-03-30T14:15:16.948172+0000) 2024-03-30T14:15:40.249 INFO:journalctl@ceph.osd.5.smithi181.stdout:Mar 30 14:15:40 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-5[154441]: -5117> 2024-03-30T14:15:20.162+0000 7f3033c34700 -1 osd.5 160 heartbeat_check: no reply from 172.21.15.99:6806 osd.0 since back 2024-03-30T14:14:51.048258+0000 front 2024-03-30T14:14:51.048173+0000 (oldest deadline 2024-03-30T14:15:16.948172+0000) 2024-03-30T14:15:40.249 INFO:journalctl@ceph.osd.5.smithi181.stdout:Mar 30 14:15:40 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-5[154441]: -4969> 2024-03-30T14:15:21.177+0000 7f3033c34700 -1 osd.5 160 heartbeat_check: no reply from 172.21.15.99:6806 osd.0 since back 2024-03-30T14:14:51.048258+0000 front 2024-03-30T14:14:51.048173+0000 (oldest deadline 2024-03-30T14:15:16.948172+0000) 2024-03-30T14:15:40.249 INFO:journalctl@ceph.osd.5.smithi181.stdout:Mar 30 14:15:40 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-5[154441]: -4921> 2024-03-30T14:15:22.175+0000 7f3033c34700 -1 osd.5 160 heartbeat_check: no reply from 172.21.15.99:6806 osd.0 since back 2024-03-30T14:14:51.048258+0000 front 2024-03-30T14:14:51.048173+0000 (oldest deadline 2024-03-30T14:15:16.948172+0000) 2024-03-30T14:15:40.250 INFO:journalctl@ceph.osd.5.smithi181.stdout:Mar 30 14:15:40 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-5[154441]: -4011> 2024-03-30T14:15:23.194+0000 7f3033c34700 -1 osd.5 160 heartbeat_check: no reply from 172.21.15.99:6806 osd.0 since back 2024-03-30T14:14:51.048258+0000 front 2024-03-30T14:14:51.048173+0000 (oldest deadline 2024-03-30T14:15:16.948172+0000) 2024-03-30T14:15:40.250 INFO:journalctl@ceph.osd.5.smithi181.stdout:Mar 30 14:15:40 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-5[154441]: -3566> 2024-03-30T14:15:24.148+0000 7f3033c34700 -1 osd.5 160 heartbeat_check: no reply from 172.21.15.99:6806 osd.0 since back 2024-03-30T14:14:51.048258+0000 front 2024-03-30T14:14:51.048173+0000 (oldest deadline 2024-03-30T14:15:16.948172+0000) 2024-03-30T14:15:40.250 INFO:journalctl@ceph.osd.5.smithi181.stdout:Mar 30 14:15:40 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-5[154441]: -3392> 2024-03-30T14:15:25.120+0000 7f3033c34700 -1 osd.5 160 heartbeat_check: no reply from 172.21.15.99:6806 osd.0 since back 2024-03-30T14:14:51.048258+0000 front 2024-03-30T14:14:51.048173+0000 (oldest deadline 2024-03-30T14:15:16.948172+0000) 2024-03-30T14:15:40.250 INFO:journalctl@ceph.osd.5.smithi181.stdout:Mar 30 14:15:40 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-5[154441]: -3256> 2024-03-30T14:15:26.137+0000 7f3033c34700 -1 osd.5 160 heartbeat_check: no reply from 172.21.15.99:6806 osd.0 since back 2024-03-30T14:14:51.048258+0000 front 2024-03-30T14:14:51.048173+0000 (oldest deadline 2024-03-30T14:15:16.948172+0000) 2024-03-30T14:15:40.250 INFO:journalctl@ceph.osd.5.smithi181.stdout:Mar 30 14:15:40 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-5[154441]: -3196> 2024-03-30T14:15:27.114+0000 7f3033c34700 -1 osd.5 160 heartbeat_check: no reply from 172.21.15.99:6806 osd.0 since back 2024-03-30T14:14:51.048258+0000 front 2024-03-30T14:14:51.048173+0000 (oldest deadline 2024-03-30T14:15:16.948172+0000) 2024-03-30T14:15:40.250 INFO:journalctl@ceph.osd.5.smithi181.stdout:Mar 30 14:15:40 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-5[154441]: -3112> 2024-03-30T14:15:28.094+0000 7f3033c34700 -1 osd.5 160 heartbeat_check: no reply from 172.21.15.99:6806 osd.0 since back 2024-03-30T14:14:51.048258+0000 front 2024-03-30T14:14:51.048173+0000 (oldest deadline 2024-03-30T14:15:16.948172+0000) 2024-03-30T14:15:40.250 INFO:journalctl@ceph.osd.5.smithi181.stdout:Mar 30 14:15:40 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-5[154441]: -3049> 2024-03-30T14:15:29.044+0000 7f3033c34700 -1 osd.5 160 heartbeat_check: no reply from 172.21.15.99:6806 osd.0 since back 2024-03-30T14:14:51.048258+0000 front 2024-03-30T14:14:51.048173+0000 (oldest deadline 2024-03-30T14:15:16.948172+0000) 2024-03-30T14:15:40.250 INFO:journalctl@ceph.osd.5.smithi181.stdout:Mar 30 14:15:40 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-5[154441]: -2928> 2024-03-30T14:15:30.084+0000 7f3033c34700 -1 osd.5 160 heartbeat_check: no reply from 172.21.15.99:6806 osd.0 since back 2024-03-30T14:14:51.048258+0000 front 2024-03-30T14:14:51.048173+0000 (oldest deadline 2024-03-30T14:15:16.948172+0000) 2024-03-30T14:15:40.250 INFO:journalctl@ceph.osd.5.smithi181.stdout:Mar 30 14:15:40 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-5[154441]: -2927> 2024-03-30T14:15:30.084+0000 7f3033c34700 -1 osd.5 160 heartbeat_check: no reply from 172.21.15.99:6814 osd.1 since back 2024-03-30T14:15:04.450202+0000 front 2024-03-30T14:15:04.450043+0000 (oldest deadline 2024-03-30T14:15:29.150016+0000) 2024-03-30T14:15:40.250 INFO:journalctl@ceph.osd.5.smithi181.stdout:Mar 30 14:15:40 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-5[154441]: -2074> 2024-03-30T14:15:31.111+0000 7f3033c34700 -1 osd.5 160 heartbeat_check: no reply from 172.21.15.99:6806 osd.0 since back 2024-03-30T14:14:51.048258+0000 front 2024-03-30T14:14:51.048173+0000 (oldest deadline 2024-03-30T14:15:16.948172+0000) 2024-03-30T14:15:40.251 INFO:journalctl@ceph.osd.5.smithi181.stdout:Mar 30 14:15:40 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-5[154441]: -2073> 2024-03-30T14:15:31.111+0000 7f3033c34700 -1 osd.5 160 heartbeat_check: no reply from 172.21.15.99:6814 osd.1 since back 2024-03-30T14:15:04.450202+0000 front 2024-03-30T14:15:04.450043+0000 (oldest deadline 2024-03-30T14:15:29.150016+0000) 2024-03-30T14:15:40.251 INFO:journalctl@ceph.osd.5.smithi181.stdout:Mar 30 14:15:40 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-5[154441]: -1614> 2024-03-30T14:15:32.081+0000 7f3033c34700 -1 osd.5 160 heartbeat_check: no reply from 172.21.15.99:6806 osd.0 since back 2024-03-30T14:14:51.048258+0000 front 2024-03-30T14:14:51.048173+0000 (oldest deadline 2024-03-30T14:15:16.948172+0000) 2024-03-30T14:15:40.251 INFO:journalctl@ceph.osd.5.smithi181.stdout:Mar 30 14:15:40 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-5[154441]: -1613> 2024-03-30T14:15:32.081+0000 7f3033c34700 -1 osd.5 160 heartbeat_check: no reply from 172.21.15.99:6814 osd.1 since back 2024-03-30T14:15:04.450202+0000 front 2024-03-30T14:15:04.450043+0000 (oldest deadline 2024-03-30T14:15:29.150016+0000) 2024-03-30T14:15:40.251 INFO:journalctl@ceph.osd.5.smithi181.stdout:Mar 30 14:15:40 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-5[154441]: -1541> 2024-03-30T14:15:33.079+0000 7f3033c34700 -1 osd.5 160 heartbeat_check: no reply from 172.21.15.99:6806 osd.0 since back 2024-03-30T14:14:51.048258+0000 front 2024-03-30T14:14:51.048173+0000 (oldest deadline 2024-03-30T14:15:16.948172+0000) 2024-03-30T14:15:40.251 INFO:journalctl@ceph.osd.5.smithi181.stdout:Mar 30 14:15:40 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-5[154441]: -1540> 2024-03-30T14:15:33.079+0000 7f3033c34700 -1 osd.5 160 heartbeat_check: no reply from 172.21.15.99:6814 osd.1 since back 2024-03-30T14:15:04.450202+0000 front 2024-03-30T14:15:04.450043+0000 (oldest deadline 2024-03-30T14:15:29.150016+0000) 2024-03-30T14:15:40.251 INFO:journalctl@ceph.osd.5.smithi181.stdout:Mar 30 14:15:40 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-5[154441]: -1415> 2024-03-30T14:15:34.123+0000 7f3033c34700 -1 osd.5 160 heartbeat_check: no reply from 172.21.15.99:6806 osd.0 since back 2024-03-30T14:14:51.048258+0000 front 2024-03-30T14:14:51.048173+0000 (oldest deadline 2024-03-30T14:15:16.948172+0000) 2024-03-30T14:15:40.251 INFO:journalctl@ceph.osd.5.smithi181.stdout:Mar 30 14:15:40 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-5[154441]: -1414> 2024-03-30T14:15:34.124+0000 7f3033c34700 -1 osd.5 160 heartbeat_check: no reply from 172.21.15.99:6814 osd.1 since back 2024-03-30T14:15:04.450202+0000 front 2024-03-30T14:15:04.450043+0000 (oldest deadline 2024-03-30T14:15:29.150016+0000) 2024-03-30T14:15:40.251 INFO:journalctl@ceph.osd.5.smithi181.stdout:Mar 30 14:15:40 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-5[154441]: -1384> 2024-03-30T14:15:34.593+0000 7f303b648700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.5 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-03-30T14:15:40.251 INFO:journalctl@ceph.osd.5.smithi181.stdout:Mar 30 14:15:40 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-5[154441]: -1383> 2024-03-30T14:15:34.593+0000 7f303b648700 -1 osd.5 160 *** Got signal Terminated *** 2024-03-30T14:15:40.251 INFO:journalctl@ceph.osd.5.smithi181.stdout:Mar 30 14:15:40 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-5[154441]: -1381> 2024-03-30T14:15:34.593+0000 7f303b648700 -1 osd.5 160 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-03-30T14:15:40.251 INFO:journalctl@ceph.osd.5.smithi181.stdout:Mar 30 14:15:40 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-5[154441]: -1302> 2024-03-30T14:15:35.125+0000 7f3033c34700 -1 osd.5 160 heartbeat_check: no reply from 172.21.15.99:6806 osd.0 since back 2024-03-30T14:14:51.048258+0000 front 2024-03-30T14:14:51.048173+0000 (oldest deadline 2024-03-30T14:15:16.948172+0000) 2024-03-30T14:15:40.252 INFO:journalctl@ceph.osd.5.smithi181.stdout:Mar 30 14:15:40 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-5[154441]: -1301> 2024-03-30T14:15:35.125+0000 7f3033c34700 -1 osd.5 160 heartbeat_check: no reply from 172.21.15.99:6814 osd.1 since back 2024-03-30T14:15:04.450202+0000 front 2024-03-30T14:15:04.450043+0000 (oldest deadline 2024-03-30T14:15:29.150016+0000) 2024-03-30T14:15:40.252 INFO:journalctl@ceph.osd.5.smithi181.stdout:Mar 30 14:15:40 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-5[154441]: -1300> 2024-03-30T14:15:35.125+0000 7f3033c34700 -1 osd.5 160 heartbeat_check: no reply from 172.21.15.99:6822 osd.2 since back 2024-03-30T14:15:09.150575+0000 front 2024-03-30T14:15:09.150465+0000 (oldest deadline 2024-03-30T14:15:34.450485+0000) 2024-03-30T14:15:40.252 INFO:journalctl@ceph.osd.5.smithi181.stdout:Mar 30 14:15:40 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-5[154441]: -1162> 2024-03-30T14:15:36.155+0000 7f3033c34700 -1 osd.5 160 heartbeat_check: no reply from 172.21.15.99:6806 osd.0 since back 2024-03-30T14:14:51.048258+0000 front 2024-03-30T14:14:51.048173+0000 (oldest deadline 2024-03-30T14:15:16.948172+0000) 2024-03-30T14:15:40.252 INFO:journalctl@ceph.osd.5.smithi181.stdout:Mar 30 14:15:40 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-5[154441]: -1161> 2024-03-30T14:15:36.155+0000 7f3033c34700 -1 osd.5 160 heartbeat_check: no reply from 172.21.15.99:6814 osd.1 since back 2024-03-30T14:15:04.450202+0000 front 2024-03-30T14:15:04.450043+0000 (oldest deadline 2024-03-30T14:15:29.150016+0000) 2024-03-30T14:15:40.252 INFO:journalctl@ceph.osd.5.smithi181.stdout:Mar 30 14:15:40 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-5[154441]: -1160> 2024-03-30T14:15:36.155+0000 7f3033c34700 -1 osd.5 160 heartbeat_check: no reply from 172.21.15.99:6822 osd.2 since back 2024-03-30T14:15:09.150575+0000 front 2024-03-30T14:15:09.150465+0000 (oldest deadline 2024-03-30T14:15:34.450485+0000) 2024-03-30T14:15:40.252 INFO:journalctl@ceph.osd.5.smithi181.stdout:Mar 30 14:15:40 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-5[154441]: -1091> 2024-03-30T14:15:37.194+0000 7f3033c34700 -1 osd.5 160 heartbeat_check: no reply from 172.21.15.99:6806 osd.0 since back 2024-03-30T14:14:51.048258+0000 front 2024-03-30T14:14:51.048173+0000 (oldest deadline 2024-03-30T14:15:16.948172+0000) 2024-03-30T14:15:40.252 INFO:journalctl@ceph.osd.5.smithi181.stdout:Mar 30 14:15:40 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-5[154441]: -1090> 2024-03-30T14:15:37.194+0000 7f3033c34700 -1 osd.5 160 heartbeat_check: no reply from 172.21.15.99:6814 osd.1 since back 2024-03-30T14:15:04.450202+0000 front 2024-03-30T14:15:04.450043+0000 (oldest deadline 2024-03-30T14:15:29.150016+0000) 2024-03-30T14:15:40.252 INFO:journalctl@ceph.osd.5.smithi181.stdout:Mar 30 14:15:40 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-5[154441]: -1089> 2024-03-30T14:15:37.194+0000 7f3033c34700 -1 osd.5 160 heartbeat_check: no reply from 172.21.15.99:6822 osd.2 since back 2024-03-30T14:15:09.150575+0000 front 2024-03-30T14:15:09.150465+0000 (oldest deadline 2024-03-30T14:15:34.450485+0000) 2024-03-30T14:15:40.252 INFO:journalctl@ceph.osd.5.smithi181.stdout:Mar 30 14:15:40 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-5[154441]: -1006> 2024-03-30T14:15:38.221+0000 7f3033c34700 -1 osd.5 160 heartbeat_check: no reply from 172.21.15.99:6806 osd.0 since back 2024-03-30T14:14:51.048258+0000 front 2024-03-30T14:14:51.048173+0000 (oldest deadline 2024-03-30T14:15:16.948172+0000) 2024-03-30T14:15:40.252 INFO:journalctl@ceph.osd.5.smithi181.stdout:Mar 30 14:15:40 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-5[154441]: -1005> 2024-03-30T14:15:38.221+0000 7f3033c34700 -1 osd.5 160 heartbeat_check: no reply from 172.21.15.99:6814 osd.1 since back 2024-03-30T14:15:04.450202+0000 front 2024-03-30T14:15:04.450043+0000 (oldest deadline 2024-03-30T14:15:29.150016+0000) 2024-03-30T14:15:40.252 INFO:journalctl@ceph.osd.5.smithi181.stdout:Mar 30 14:15:40 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-5[154441]: -1004> 2024-03-30T14:15:38.221+0000 7f3033c34700 -1 osd.5 160 heartbeat_check: no reply from 172.21.15.99:6822 osd.2 since back 2024-03-30T14:15:09.150575+0000 front 2024-03-30T14:15:09.150465+0000 (oldest deadline 2024-03-30T14:15:34.450485+0000) 2024-03-30T14:15:40.252 INFO:journalctl@ceph.osd.5.smithi181.stdout:Mar 30 14:15:40 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-5[154441]: -128> 2024-03-30T14:15:39.225+0000 7f3033c34700 -1 osd.5 160 heartbeat_check: no reply from 172.21.15.99:6806 osd.0 since back 2024-03-30T14:14:51.048258+0000 front 2024-03-30T14:14:51.048173+0000 (oldest deadline 2024-03-30T14:15:16.948172+0000) 2024-03-30T14:15:40.252 INFO:journalctl@ceph.osd.5.smithi181.stdout:Mar 30 14:15:40 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-5[154441]: -127> 2024-03-30T14:15:39.225+0000 7f3033c34700 -1 osd.5 160 heartbeat_check: no reply from 172.21.15.99:6814 osd.1 since back 2024-03-30T14:15:04.450202+0000 front 2024-03-30T14:15:04.450043+0000 (oldest deadline 2024-03-30T14:15:29.150016+0000) 2024-03-30T14:15:40.252 INFO:journalctl@ceph.osd.5.smithi181.stdout:Mar 30 14:15:40 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-5[154441]: -126> 2024-03-30T14:15:39.225+0000 7f3033c34700 -1 osd.5 160 heartbeat_check: no reply from 172.21.15.99:6822 osd.2 since back 2024-03-30T14:15:09.150575+0000 front 2024-03-30T14:15:09.150465+0000 (oldest deadline 2024-03-30T14:15:34.450485+0000) 2024-03-30T14:15:40.253 INFO:journalctl@ceph.osd.5.smithi181.stdout:Mar 30 14:15:40 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-5[154441]: 0> 2024-03-30T14:15:40.035+0000 7f3022c12700 -1 *** Caught signal (Segmentation fault) ** 2024-03-30T14:15:40.253 INFO:journalctl@ceph.osd.5.smithi181.stdout:Mar 30 14:15:40 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-5[154441]: in thread 7f3022c12700 thread_name:safe_timer 2024-03-30T14:15:40.253 INFO:journalctl@ceph.osd.5.smithi181.stdout:Mar 30 14:15:40 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-5[154441]: 2024-03-30T14:15:40.253 INFO:journalctl@ceph.osd.5.smithi181.stdout:Mar 30 14:15:40 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-5[154441]: ceph version 19.0.0-1967-g4e50bbcd (4e50bbcdd1630c7760b708f3a5b4d38a121e66cb) squid (dev) 2024-03-30T14:15:40.253 INFO:journalctl@ceph.osd.5.smithi181.stdout:Mar 30 14:15:40 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-5[154441]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7f3042a9ed20] 2024-03-30T14:15:40.253 INFO:journalctl@ceph.osd.5.smithi181.stdout:Mar 30 14:15:40 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-5[154441]: 2: (BlueStore::_txc_create(BlueStore::Collection*, BlueStore::OpSequencer*, std::__cxx11::list >*, boost::intrusive_ptr)+0x40a) [0x564db7760daa] 2024-03-30T14:15:40.253 INFO:journalctl@ceph.osd.5.smithi181.stdout:Mar 30 14:15:40 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-5[154441]: 3: (BlueStore::queue_transactions(boost::intrusive_ptr&, std::vector >&, boost::intrusive_ptr, ThreadPool::TPHandle*)+0x1f8) [0x564db77ee948] 2024-03-30T14:15:40.253 INFO:journalctl@ceph.osd.5.smithi181.stdout:Mar 30 14:15:40 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-5[154441]: 4: (non-virtual thunk to PrimaryLogPG::queue_transactions(std::vector >&, boost::intrusive_ptr)+0x53) [0x564db73d4713] 2024-03-30T14:15:40.253 INFO:journalctl@ceph.osd.5.smithi181.stdout:Mar 30 14:15:40 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-5[154441]: 5: (ReplicatedBackend::submit_transaction(hobject_t const&, object_stat_sum_t const&, eversion_t const&, std::unique_ptr >&&, eversion_t const&, eversion_t const&, std::vector >&&, std::optional&, Context*, unsigned long, osd_reqid_t, boost::intrusive_ptr)+0x7b1) [0x564db765f821] 2024-03-30T14:15:40.253 INFO:journalctl@ceph.osd.5.smithi181.stdout:Mar 30 14:15:40 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-5[154441]: 6: (PrimaryLogPG::issue_repop(PrimaryLogPG::RepGather*, PrimaryLogPG::OpContext*)+0x424) [0x564db73503f4] 2024-03-30T14:15:40.253 INFO:journalctl@ceph.osd.5.smithi181.stdout:Mar 30 14:15:40 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-5[154441]: 7: (PrimaryLogPG::simple_opc_submit(std::unique_ptr >)+0x5a) [0x564db735245a] 2024-03-30T14:15:40.253 INFO:journalctl@ceph.osd.5.smithi181.stdout:Mar 30 14:15:40 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-5[154441]: 8: (PrimaryLogPG::handle_watch_timeout(std::shared_ptr)+0x873) [0x564db73543c3] 2024-03-30T14:15:40.253 INFO:journalctl@ceph.osd.5.smithi181.stdout:Mar 30 14:15:40 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-5[154441]: 9: (HandleWatchTimeout::complete(int)+0x11a) [0x564db72b577a] 2024-03-30T14:15:40.253 INFO:journalctl@ceph.osd.5.smithi181.stdout:Mar 30 14:15:40 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-5[154441]: 10: (CommonSafeTimer::timer_thread()+0x155) [0x564db7910715] 2024-03-30T14:15:40.253 INFO:journalctl@ceph.osd.5.smithi181.stdout:Mar 30 14:15:40 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-5[154441]: 11: (CommonSafeTimerThread::entry()+0x11) [0x564db7911f41] 2024-03-30T14:15:40.254 INFO:journalctl@ceph.osd.5.smithi181.stdout:Mar 30 14:15:40 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-5[154441]: 12: /lib64/libpthread.so.0(+0x81ca) [0x7f3042a941ca] 2024-03-30T14:15:40.254 INFO:journalctl@ceph.osd.5.smithi181.stdout:Mar 30 14:15:40 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-5[154441]: 13: clone() 2024-03-30T14:15:40.254 INFO:journalctl@ceph.osd.5.smithi181.stdout:Mar 30 14:15:40 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-5[154441]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-03-30T14:15:40.254 INFO:journalctl@ceph.osd.5.smithi181.stdout:Mar 30 14:15:40 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-5[154441]: 2024-03-30T14:15:40.609 INFO:journalctl@ceph.osd.5.smithi181.stdout:Mar 30 14:15:40 smithi181 podman[178622]: 2024-03-30 14:15:40.34429472 +0000 UTC m=+5.881207689 container died bba176b8db2c4c00b7530bec9268531e98e47dc2f452a0578bdd0d453da995d9 (image=quay.ceph.io/ceph-ci/ceph:4e50bbcdd1630c7760b708f3a5b4d38a121e66cb, name=ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-5, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-4e50bbc, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.build-date=20240326) 2024-03-30T14:15:40.961 INFO:journalctl@ceph.osd.5.smithi181.stdout:Mar 30 14:15:40 smithi181 podman[178622]: 2024-03-30 14:15:40.793874456 +0000 UTC m=+6.330787433 container cleanup bba176b8db2c4c00b7530bec9268531e98e47dc2f452a0578bdd0d453da995d9 (image=quay.ceph.io/ceph-ci/ceph:4e50bbcdd1630c7760b708f3a5b4d38a121e66cb, name=ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-5, GIT_CLEAN=True, org.label-schema.build-date=20240326, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, io.buildah.version=1.33.5, RELEASE=squid-4e50bbc, org.label-schema.schema-version=1.0, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, CEPH_POINT_RELEASE=) 2024-03-30T14:15:40.961 INFO:journalctl@ceph.osd.5.smithi181.stdout:Mar 30 14:15:40 smithi181 bash[178622]: ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-5 2024-03-30T14:15:40.961 INFO:journalctl@ceph.osd.6.smithi181.stdout:Mar 30 14:15:40 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-6[159016]: 2024-03-30T14:15:40.664+0000 7f40ae4c5700 -1 osd.6 160 heartbeat_check: no reply from 172.21.15.99:6806 osd.0 since back 2024-03-30T14:14:55.671948+0000 front 2024-03-30T14:14:55.672008+0000 (oldest deadline 2024-03-30T14:15:19.771809+0000) 2024-03-30T14:15:40.961 INFO:journalctl@ceph.osd.6.smithi181.stdout:Mar 30 14:15:40 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-6[159016]: 2024-03-30T14:15:40.664+0000 7f40ae4c5700 -1 osd.6 160 heartbeat_check: no reply from 172.21.15.99:6814 osd.1 since back 2024-03-30T14:15:04.373319+0000 front 2024-03-30T14:15:04.373414+0000 (oldest deadline 2024-03-30T14:15:28.473188+0000) 2024-03-30T14:15:40.961 INFO:journalctl@ceph.osd.6.smithi181.stdout:Mar 30 14:15:40 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-6[159016]: 2024-03-30T14:15:40.664+0000 7f40ae4c5700 -1 osd.6 160 heartbeat_check: no reply from 172.21.15.99:6822 osd.2 since back 2024-03-30T14:15:11.974325+0000 front 2024-03-30T14:15:11.974252+0000 (oldest deadline 2024-03-30T14:15:34.874106+0000) 2024-03-30T14:15:40.962 INFO:journalctl@ceph.osd.7.smithi181.stdout:Mar 30 14:15:40 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-7[162666]: 2024-03-30T14:15:40.766+0000 7f89f6425700 -1 osd.7 160 heartbeat_check: no reply from 172.21.15.99:6806 osd.0 since back 2024-03-30T14:14:54.735757+0000 front 2024-03-30T14:14:54.735668+0000 (oldest deadline 2024-03-30T14:15:17.035489+0000) 2024-03-30T14:15:40.962 INFO:journalctl@ceph.osd.7.smithi181.stdout:Mar 30 14:15:40 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-7[162666]: 2024-03-30T14:15:40.766+0000 7f89f6425700 -1 osd.7 160 heartbeat_check: no reply from 172.21.15.99:6814 osd.1 since back 2024-03-30T14:15:04.537446+0000 front 2024-03-30T14:15:04.537483+0000 (oldest deadline 2024-03-30T14:15:28.037269+0000) 2024-03-30T14:15:40.962 INFO:journalctl@ceph.osd.7.smithi181.stdout:Mar 30 14:15:40 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-7[162666]: 2024-03-30T14:15:40.766+0000 7f89f6425700 -1 osd.7 160 heartbeat_check: no reply from 172.21.15.99:6822 osd.2 since back 2024-03-30T14:15:09.738215+0000 front 2024-03-30T14:15:09.738166+0000 (oldest deadline 2024-03-30T14:15:35.637991+0000) 2024-03-30T14:15:41.246 INFO:journalctl@ceph.osd.5.smithi181.stdout:Mar 30 14:15:40 smithi181 podman[179084]: 2024-03-30 14:15:40.970192447 +0000 UTC m=+0.849098834 container remove bba176b8db2c4c00b7530bec9268531e98e47dc2f452a0578bdd0d453da995d9 (image=quay.ceph.io/ceph-ci/ceph:4e50bbcdd1630c7760b708f3a5b4d38a121e66cb, name=ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-5, ceph=True, RELEASE=squid-4e50bbc, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240326, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux ) 2024-03-30T14:15:41.246 INFO:journalctl@ceph.osd.5.smithi181.stdout:Mar 30 14:15:40 smithi181 systemd[1]: ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4@osd.5.service: Main process exited, code=exited, status=139/n/a 2024-03-30T14:15:41.907 INFO:journalctl@ceph.osd.6.smithi181.stdout:Mar 30 14:15:41 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-6[159016]: 2024-03-30T14:15:41.662+0000 7f40ae4c5700 -1 osd.6 160 heartbeat_check: no reply from 172.21.15.99:6806 osd.0 since back 2024-03-30T14:14:55.671948+0000 front 2024-03-30T14:14:55.672008+0000 (oldest deadline 2024-03-30T14:15:19.771809+0000) 2024-03-30T14:15:41.907 INFO:journalctl@ceph.osd.6.smithi181.stdout:Mar 30 14:15:41 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-6[159016]: 2024-03-30T14:15:41.662+0000 7f40ae4c5700 -1 osd.6 160 heartbeat_check: no reply from 172.21.15.99:6814 osd.1 since back 2024-03-30T14:15:04.373319+0000 front 2024-03-30T14:15:04.373414+0000 (oldest deadline 2024-03-30T14:15:28.473188+0000) 2024-03-30T14:15:41.907 INFO:journalctl@ceph.osd.6.smithi181.stdout:Mar 30 14:15:41 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-6[159016]: 2024-03-30T14:15:41.662+0000 7f40ae4c5700 -1 osd.6 160 heartbeat_check: no reply from 172.21.15.99:6822 osd.2 since back 2024-03-30T14:15:11.974325+0000 front 2024-03-30T14:15:11.974252+0000 (oldest deadline 2024-03-30T14:15:34.874106+0000) 2024-03-30T14:15:41.907 INFO:journalctl@ceph.osd.7.smithi181.stdout:Mar 30 14:15:41 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-7[162666]: 2024-03-30T14:15:41.785+0000 7f89f6425700 -1 osd.7 160 heartbeat_check: no reply from 172.21.15.99:6806 osd.0 since back 2024-03-30T14:14:54.735757+0000 front 2024-03-30T14:14:54.735668+0000 (oldest deadline 2024-03-30T14:15:17.035489+0000) 2024-03-30T14:15:41.907 INFO:journalctl@ceph.osd.7.smithi181.stdout:Mar 30 14:15:41 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-7[162666]: 2024-03-30T14:15:41.785+0000 7f89f6425700 -1 osd.7 160 heartbeat_check: no reply from 172.21.15.99:6814 osd.1 since back 2024-03-30T14:15:04.537446+0000 front 2024-03-30T14:15:04.537483+0000 (oldest deadline 2024-03-30T14:15:28.037269+0000) 2024-03-30T14:15:41.907 INFO:journalctl@ceph.osd.7.smithi181.stdout:Mar 30 14:15:41 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-7[162666]: 2024-03-30T14:15:41.785+0000 7f89f6425700 -1 osd.7 160 heartbeat_check: no reply from 172.21.15.99:6822 osd.2 since back 2024-03-30T14:15:09.738215+0000 front 2024-03-30T14:15:09.738166+0000 (oldest deadline 2024-03-30T14:15:35.637991+0000) 2024-03-30T14:15:42.746 INFO:journalctl@ceph.osd.5.smithi181.stdout:Mar 30 14:15:42 smithi181 podman[179350]: 2024-03-30 14:15:42.489747553 +0000 UTC m=+0.021901064 image pull b0c4478f1d83795df4d538bf108aee5fac57194348fb16dcdbb3115f3e2fe95e quay.ceph.io/ceph-ci/ceph:4e50bbcdd1630c7760b708f3a5b4d38a121e66cb 2024-03-30T14:15:42.746 INFO:journalctl@ceph.osd.5.smithi181.stdout:Mar 30 14:15:42 smithi181 podman[179350]: 2024-03-30 14:15:42.611086862 +0000 UTC m=+0.143240387 container create c2f47fbf1d160e7a68ff4560be909ce16c562373ec87f467f9b2f7d730cb5a30 (image=quay.ceph.io/ceph-ci/ceph:4e50bbcdd1630c7760b708f3a5b4d38a121e66cb, name=ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-5-deactivate, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.vendor=CentOS, ceph=True, RELEASE=squid-4e50bbc, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240326) 2024-03-30T14:15:42.746 INFO:journalctl@ceph.osd.6.smithi181.stdout:Mar 30 14:15:42 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-6[159016]: 2024-03-30T14:15:42.648+0000 7f40ae4c5700 -1 osd.6 160 heartbeat_check: no reply from 172.21.15.99:6806 osd.0 since back 2024-03-30T14:14:55.671948+0000 front 2024-03-30T14:14:55.672008+0000 (oldest deadline 2024-03-30T14:15:19.771809+0000) 2024-03-30T14:15:42.746 INFO:journalctl@ceph.osd.6.smithi181.stdout:Mar 30 14:15:42 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-6[159016]: 2024-03-30T14:15:42.648+0000 7f40ae4c5700 -1 osd.6 160 heartbeat_check: no reply from 172.21.15.99:6814 osd.1 since back 2024-03-30T14:15:04.373319+0000 front 2024-03-30T14:15:04.373414+0000 (oldest deadline 2024-03-30T14:15:28.473188+0000) 2024-03-30T14:15:42.747 INFO:journalctl@ceph.osd.6.smithi181.stdout:Mar 30 14:15:42 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-6[159016]: 2024-03-30T14:15:42.648+0000 7f40ae4c5700 -1 osd.6 160 heartbeat_check: no reply from 172.21.15.99:6822 osd.2 since back 2024-03-30T14:15:11.974325+0000 front 2024-03-30T14:15:11.974252+0000 (oldest deadline 2024-03-30T14:15:34.874106+0000) 2024-03-30T14:15:43.162 INFO:journalctl@ceph.osd.7.smithi181.stdout:Mar 30 14:15:42 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-7[162666]: 2024-03-30T14:15:42.783+0000 7f89f6425700 -1 osd.7 160 heartbeat_check: no reply from 172.21.15.99:6806 osd.0 since back 2024-03-30T14:14:54.735757+0000 front 2024-03-30T14:14:54.735668+0000 (oldest deadline 2024-03-30T14:15:17.035489+0000) 2024-03-30T14:15:43.162 INFO:journalctl@ceph.osd.7.smithi181.stdout:Mar 30 14:15:42 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-7[162666]: 2024-03-30T14:15:42.783+0000 7f89f6425700 -1 osd.7 160 heartbeat_check: no reply from 172.21.15.99:6814 osd.1 since back 2024-03-30T14:15:04.537446+0000 front 2024-03-30T14:15:04.537483+0000 (oldest deadline 2024-03-30T14:15:28.037269+0000) 2024-03-30T14:15:43.162 INFO:journalctl@ceph.osd.7.smithi181.stdout:Mar 30 14:15:42 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-7[162666]: 2024-03-30T14:15:42.783+0000 7f89f6425700 -1 osd.7 160 heartbeat_check: no reply from 172.21.15.99:6822 osd.2 since back 2024-03-30T14:15:09.738215+0000 front 2024-03-30T14:15:09.738166+0000 (oldest deadline 2024-03-30T14:15:35.637991+0000) 2024-03-30T14:15:43.162 INFO:journalctl@ceph.osd.5.smithi181.stdout:Mar 30 14:15:42 smithi181 podman[179350]: 2024-03-30 14:15:42.863961868 +0000 UTC m=+0.396115368 container init c2f47fbf1d160e7a68ff4560be909ce16c562373ec87f467f9b2f7d730cb5a30 (image=quay.ceph.io/ceph-ci/ceph:4e50bbcdd1630c7760b708f3a5b4d38a121e66cb, name=ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-5-deactivate, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240326, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-4e50bbc, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, io.buildah.version=1.33.5) 2024-03-30T14:15:43.162 INFO:journalctl@ceph.osd.5.smithi181.stdout:Mar 30 14:15:42 smithi181 podman[179350]: 2024-03-30 14:15:42.867379817 +0000 UTC m=+0.399533306 container start c2f47fbf1d160e7a68ff4560be909ce16c562373ec87f467f9b2f7d730cb5a30 (image=quay.ceph.io/ceph-ci/ceph:4e50bbcdd1630c7760b708f3a5b4d38a121e66cb, name=ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-5-deactivate, RELEASE=squid-4e50bbc, org.label-schema.build-date=20240326, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, ceph=True, GIT_CLEAN=True) 2024-03-30T14:15:43.162 INFO:journalctl@ceph.osd.5.smithi181.stdout:Mar 30 14:15:42 smithi181 podman[179350]: 2024-03-30 14:15:42.94801822 +0000 UTC m=+0.480171717 container attach c2f47fbf1d160e7a68ff4560be909ce16c562373ec87f467f9b2f7d730cb5a30 (image=quay.ceph.io/ceph-ci/ceph:4e50bbcdd1630c7760b708f3a5b4d38a121e66cb, name=ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-5-deactivate, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, org.label-schema.build-date=20240326, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-4e50bbc, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, ceph=True) 2024-03-30T14:15:43.496 INFO:journalctl@ceph.osd.5.smithi181.stdout:Mar 30 14:15:43 smithi181 podman[179350]: 2024-03-30 14:15:43.171318274 +0000 UTC m=+0.703471772 container died c2f47fbf1d160e7a68ff4560be909ce16c562373ec87f467f9b2f7d730cb5a30 (image=quay.ceph.io/ceph-ci/ceph:4e50bbcdd1630c7760b708f3a5b4d38a121e66cb, name=ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-5-deactivate, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=squid-4e50bbc, GIT_CLEAN=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240326, ceph=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS) 2024-03-30T14:15:43.774 INFO:journalctl@ceph.osd.6.smithi181.stdout:Mar 30 14:15:43 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-6[159016]: 2024-03-30T14:15:43.654+0000 7f40ae4c5700 -1 osd.6 160 heartbeat_check: no reply from 172.21.15.99:6806 osd.0 since back 2024-03-30T14:14:55.671948+0000 front 2024-03-30T14:14:55.672008+0000 (oldest deadline 2024-03-30T14:15:19.771809+0000) 2024-03-30T14:15:43.774 INFO:journalctl@ceph.osd.6.smithi181.stdout:Mar 30 14:15:43 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-6[159016]: 2024-03-30T14:15:43.654+0000 7f40ae4c5700 -1 osd.6 160 heartbeat_check: no reply from 172.21.15.99:6814 osd.1 since back 2024-03-30T14:15:04.373319+0000 front 2024-03-30T14:15:04.373414+0000 (oldest deadline 2024-03-30T14:15:28.473188+0000) 2024-03-30T14:15:43.775 INFO:journalctl@ceph.osd.6.smithi181.stdout:Mar 30 14:15:43 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-6[159016]: 2024-03-30T14:15:43.654+0000 7f40ae4c5700 -1 osd.6 160 heartbeat_check: no reply from 172.21.15.99:6822 osd.2 since back 2024-03-30T14:15:11.974325+0000 front 2024-03-30T14:15:11.974252+0000 (oldest deadline 2024-03-30T14:15:34.874106+0000) 2024-03-30T14:15:43.797 DEBUG:teuthology.orchestra.run.smithi181:> sudo pkill -f 'journalctl -f -n 0 -u ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4@osd.5.service' 2024-03-30T14:15:43.843 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-03-30T14:15:43.843 INFO:tasks.cephadm.osd.5:Stopped osd.5 2024-03-30T14:15:43.843 INFO:tasks.cephadm.osd.6:Stopping osd.6... 2024-03-30T14:15:43.844 DEBUG:teuthology.orchestra.run.smithi181:> sudo systemctl stop ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4@osd.6 2024-03-30T14:15:44.127 INFO:journalctl@ceph.osd.6.smithi181.stdout:Mar 30 14:15:43 smithi181 systemd[1]: Stopping Ceph osd.6 for 98ebaeb8-ee99-11ee-b647-cb9ed24678a4... 2024-03-30T14:15:44.128 INFO:journalctl@ceph.osd.7.smithi181.stdout:Mar 30 14:15:43 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-7[162666]: 2024-03-30T14:15:43.799+0000 7f89f6425700 -1 osd.7 160 heartbeat_check: no reply from 172.21.15.99:6806 osd.0 since back 2024-03-30T14:14:54.735757+0000 front 2024-03-30T14:14:54.735668+0000 (oldest deadline 2024-03-30T14:15:17.035489+0000) 2024-03-30T14:15:44.128 INFO:journalctl@ceph.osd.7.smithi181.stdout:Mar 30 14:15:43 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-7[162666]: 2024-03-30T14:15:43.799+0000 7f89f6425700 -1 osd.7 160 heartbeat_check: no reply from 172.21.15.99:6814 osd.1 since back 2024-03-30T14:15:04.537446+0000 front 2024-03-30T14:15:04.537483+0000 (oldest deadline 2024-03-30T14:15:28.037269+0000) 2024-03-30T14:15:44.128 INFO:journalctl@ceph.osd.7.smithi181.stdout:Mar 30 14:15:43 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-7[162666]: 2024-03-30T14:15:43.799+0000 7f89f6425700 -1 osd.7 160 heartbeat_check: no reply from 172.21.15.99:6822 osd.2 since back 2024-03-30T14:15:09.738215+0000 front 2024-03-30T14:15:09.738166+0000 (oldest deadline 2024-03-30T14:15:35.637991+0000) 2024-03-30T14:15:44.496 INFO:journalctl@ceph.osd.6.smithi181.stdout:Mar 30 14:15:44 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-6[159016]: 2024-03-30T14:15:44.135+0000 7f40b1ed1700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.6 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-03-30T14:15:44.496 INFO:journalctl@ceph.osd.6.smithi181.stdout:Mar 30 14:15:44 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-6[159016]: 2024-03-30T14:15:44.135+0000 7f40b1ed1700 -1 osd.6 160 *** Got signal Terminated *** 2024-03-30T14:15:44.496 INFO:journalctl@ceph.osd.6.smithi181.stdout:Mar 30 14:15:44 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-6[159016]: 2024-03-30T14:15:44.136+0000 7f40b1ed1700 -1 osd.6 160 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-03-30T14:15:44.961 INFO:journalctl@ceph.osd.6.smithi181.stdout:Mar 30 14:15:44 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-6[159016]: 2024-03-30T14:15:44.657+0000 7f40ae4c5700 -1 osd.6 160 heartbeat_check: no reply from 172.21.15.99:6806 osd.0 since back 2024-03-30T14:14:55.671948+0000 front 2024-03-30T14:14:55.672008+0000 (oldest deadline 2024-03-30T14:15:19.771809+0000) 2024-03-30T14:15:44.961 INFO:journalctl@ceph.osd.6.smithi181.stdout:Mar 30 14:15:44 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-6[159016]: 2024-03-30T14:15:44.657+0000 7f40ae4c5700 -1 osd.6 160 heartbeat_check: no reply from 172.21.15.99:6814 osd.1 since back 2024-03-30T14:15:04.373319+0000 front 2024-03-30T14:15:04.373414+0000 (oldest deadline 2024-03-30T14:15:28.473188+0000) 2024-03-30T14:15:44.961 INFO:journalctl@ceph.osd.6.smithi181.stdout:Mar 30 14:15:44 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-6[159016]: 2024-03-30T14:15:44.657+0000 7f40ae4c5700 -1 osd.6 160 heartbeat_check: no reply from 172.21.15.99:6822 osd.2 since back 2024-03-30T14:15:11.974325+0000 front 2024-03-30T14:15:11.974252+0000 (oldest deadline 2024-03-30T14:15:34.874106+0000) 2024-03-30T14:15:44.961 INFO:journalctl@ceph.osd.7.smithi181.stdout:Mar 30 14:15:44 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-7[162666]: 2024-03-30T14:15:44.844+0000 7f89f6425700 -1 osd.7 160 heartbeat_check: no reply from 172.21.15.99:6806 osd.0 since back 2024-03-30T14:14:54.735757+0000 front 2024-03-30T14:14:54.735668+0000 (oldest deadline 2024-03-30T14:15:17.035489+0000) 2024-03-30T14:15:44.961 INFO:journalctl@ceph.osd.7.smithi181.stdout:Mar 30 14:15:44 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-7[162666]: 2024-03-30T14:15:44.844+0000 7f89f6425700 -1 osd.7 160 heartbeat_check: no reply from 172.21.15.99:6814 osd.1 since back 2024-03-30T14:15:04.537446+0000 front 2024-03-30T14:15:04.537483+0000 (oldest deadline 2024-03-30T14:15:28.037269+0000) 2024-03-30T14:15:44.961 INFO:journalctl@ceph.osd.7.smithi181.stdout:Mar 30 14:15:44 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-7[162666]: 2024-03-30T14:15:44.844+0000 7f89f6425700 -1 osd.7 160 heartbeat_check: no reply from 172.21.15.99:6822 osd.2 since back 2024-03-30T14:15:09.738215+0000 front 2024-03-30T14:15:09.738166+0000 (oldest deadline 2024-03-30T14:15:35.637991+0000) 2024-03-30T14:15:45.723 INFO:journalctl@ceph.osd.6.smithi181.stdout:Mar 30 14:15:45 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-6[159016]: 2024-03-30T14:15:45.648+0000 7f40ae4c5700 -1 osd.6 160 heartbeat_check: no reply from 172.21.15.99:6806 osd.0 since back 2024-03-30T14:14:55.671948+0000 front 2024-03-30T14:14:55.672008+0000 (oldest deadline 2024-03-30T14:15:19.771809+0000) 2024-03-30T14:15:45.723 INFO:journalctl@ceph.osd.6.smithi181.stdout:Mar 30 14:15:45 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-6[159016]: 2024-03-30T14:15:45.648+0000 7f40ae4c5700 -1 osd.6 160 heartbeat_check: no reply from 172.21.15.99:6814 osd.1 since back 2024-03-30T14:15:04.373319+0000 front 2024-03-30T14:15:04.373414+0000 (oldest deadline 2024-03-30T14:15:28.473188+0000) 2024-03-30T14:15:45.723 INFO:journalctl@ceph.osd.6.smithi181.stdout:Mar 30 14:15:45 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-6[159016]: 2024-03-30T14:15:45.648+0000 7f40ae4c5700 -1 osd.6 160 heartbeat_check: no reply from 172.21.15.99:6822 osd.2 since back 2024-03-30T14:15:11.974325+0000 front 2024-03-30T14:15:11.974252+0000 (oldest deadline 2024-03-30T14:15:34.874106+0000) 2024-03-30T14:15:45.723 INFO:journalctl@ceph.osd.6.smithi181.stdout:Mar 30 14:15:45 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-6[159016]: 2024-03-30T14:15:45.648+0000 7f40ae4c5700 -1 osd.6 160 heartbeat_check: no reply from 172.21.15.99:6830 osd.3 since back 2024-03-30T14:15:22.376012+0000 front 2024-03-30T14:15:22.375936+0000 (oldest deadline 2024-03-30T14:15:45.275863+0000) 2024-03-30T14:15:45.996 INFO:journalctl@ceph.osd.7.smithi181.stdout:Mar 30 14:15:45 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-7[162666]: 2024-03-30T14:15:45.823+0000 7f89f6425700 -1 osd.7 160 heartbeat_check: no reply from 172.21.15.99:6806 osd.0 since back 2024-03-30T14:14:54.735757+0000 front 2024-03-30T14:14:54.735668+0000 (oldest deadline 2024-03-30T14:15:17.035489+0000) 2024-03-30T14:15:45.996 INFO:journalctl@ceph.osd.7.smithi181.stdout:Mar 30 14:15:45 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-7[162666]: 2024-03-30T14:15:45.823+0000 7f89f6425700 -1 osd.7 160 heartbeat_check: no reply from 172.21.15.99:6814 osd.1 since back 2024-03-30T14:15:04.537446+0000 front 2024-03-30T14:15:04.537483+0000 (oldest deadline 2024-03-30T14:15:28.037269+0000) 2024-03-30T14:15:45.996 INFO:journalctl@ceph.osd.7.smithi181.stdout:Mar 30 14:15:45 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-7[162666]: 2024-03-30T14:15:45.823+0000 7f89f6425700 -1 osd.7 160 heartbeat_check: no reply from 172.21.15.99:6822 osd.2 since back 2024-03-30T14:15:09.738215+0000 front 2024-03-30T14:15:09.738166+0000 (oldest deadline 2024-03-30T14:15:35.637991+0000) 2024-03-30T14:15:46.996 INFO:journalctl@ceph.osd.6.smithi181.stdout:Mar 30 14:15:46 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-6[159016]: 2024-03-30T14:15:46.605+0000 7f40ae4c5700 -1 osd.6 160 heartbeat_check: no reply from 172.21.15.99:6806 osd.0 since back 2024-03-30T14:14:55.671948+0000 front 2024-03-30T14:14:55.672008+0000 (oldest deadline 2024-03-30T14:15:19.771809+0000) 2024-03-30T14:15:46.996 INFO:journalctl@ceph.osd.6.smithi181.stdout:Mar 30 14:15:46 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-6[159016]: 2024-03-30T14:15:46.605+0000 7f40ae4c5700 -1 osd.6 160 heartbeat_check: no reply from 172.21.15.99:6814 osd.1 since back 2024-03-30T14:15:04.373319+0000 front 2024-03-30T14:15:04.373414+0000 (oldest deadline 2024-03-30T14:15:28.473188+0000) 2024-03-30T14:15:46.996 INFO:journalctl@ceph.osd.6.smithi181.stdout:Mar 30 14:15:46 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-6[159016]: 2024-03-30T14:15:46.605+0000 7f40ae4c5700 -1 osd.6 160 heartbeat_check: no reply from 172.21.15.99:6822 osd.2 since back 2024-03-30T14:15:11.974325+0000 front 2024-03-30T14:15:11.974252+0000 (oldest deadline 2024-03-30T14:15:34.874106+0000) 2024-03-30T14:15:46.996 INFO:journalctl@ceph.osd.6.smithi181.stdout:Mar 30 14:15:46 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-6[159016]: 2024-03-30T14:15:46.605+0000 7f40ae4c5700 -1 osd.6 160 heartbeat_check: no reply from 172.21.15.99:6830 osd.3 since back 2024-03-30T14:15:22.376012+0000 front 2024-03-30T14:15:22.375936+0000 (oldest deadline 2024-03-30T14:15:45.275863+0000) 2024-03-30T14:15:46.997 INFO:journalctl@ceph.osd.7.smithi181.stdout:Mar 30 14:15:46 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-7[162666]: 2024-03-30T14:15:46.830+0000 7f89f6425700 -1 osd.7 160 heartbeat_check: no reply from 172.21.15.99:6806 osd.0 since back 2024-03-30T14:14:54.735757+0000 front 2024-03-30T14:14:54.735668+0000 (oldest deadline 2024-03-30T14:15:17.035489+0000) 2024-03-30T14:15:46.997 INFO:journalctl@ceph.osd.7.smithi181.stdout:Mar 30 14:15:46 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-7[162666]: 2024-03-30T14:15:46.830+0000 7f89f6425700 -1 osd.7 160 heartbeat_check: no reply from 172.21.15.99:6814 osd.1 since back 2024-03-30T14:15:04.537446+0000 front 2024-03-30T14:15:04.537483+0000 (oldest deadline 2024-03-30T14:15:28.037269+0000) 2024-03-30T14:15:46.997 INFO:journalctl@ceph.osd.7.smithi181.stdout:Mar 30 14:15:46 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-7[162666]: 2024-03-30T14:15:46.830+0000 7f89f6425700 -1 osd.7 160 heartbeat_check: no reply from 172.21.15.99:6822 osd.2 since back 2024-03-30T14:15:09.738215+0000 front 2024-03-30T14:15:09.738166+0000 (oldest deadline 2024-03-30T14:15:35.637991+0000) 2024-03-30T14:15:47.746 INFO:journalctl@ceph.osd.6.smithi181.stdout:Mar 30 14:15:47 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-6[159016]: 2024-03-30T14:15:47.645+0000 7f40ae4c5700 -1 osd.6 160 heartbeat_check: no reply from 172.21.15.99:6806 osd.0 since back 2024-03-30T14:14:55.671948+0000 front 2024-03-30T14:14:55.672008+0000 (oldest deadline 2024-03-30T14:15:19.771809+0000) 2024-03-30T14:15:47.746 INFO:journalctl@ceph.osd.6.smithi181.stdout:Mar 30 14:15:47 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-6[159016]: 2024-03-30T14:15:47.645+0000 7f40ae4c5700 -1 osd.6 160 heartbeat_check: no reply from 172.21.15.99:6814 osd.1 since back 2024-03-30T14:15:04.373319+0000 front 2024-03-30T14:15:04.373414+0000 (oldest deadline 2024-03-30T14:15:28.473188+0000) 2024-03-30T14:15:47.746 INFO:journalctl@ceph.osd.6.smithi181.stdout:Mar 30 14:15:47 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-6[159016]: 2024-03-30T14:15:47.645+0000 7f40ae4c5700 -1 osd.6 160 heartbeat_check: no reply from 172.21.15.99:6822 osd.2 since back 2024-03-30T14:15:11.974325+0000 front 2024-03-30T14:15:11.974252+0000 (oldest deadline 2024-03-30T14:15:34.874106+0000) 2024-03-30T14:15:47.746 INFO:journalctl@ceph.osd.6.smithi181.stdout:Mar 30 14:15:47 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-6[159016]: 2024-03-30T14:15:47.645+0000 7f40ae4c5700 -1 osd.6 160 heartbeat_check: no reply from 172.21.15.99:6830 osd.3 since back 2024-03-30T14:15:22.376012+0000 front 2024-03-30T14:15:22.375936+0000 (oldest deadline 2024-03-30T14:15:45.275863+0000) 2024-03-30T14:15:48.246 INFO:journalctl@ceph.osd.7.smithi181.stdout:Mar 30 14:15:47 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-7[162666]: 2024-03-30T14:15:47.835+0000 7f89f6425700 -1 osd.7 160 heartbeat_check: no reply from 172.21.15.99:6806 osd.0 since back 2024-03-30T14:14:54.735757+0000 front 2024-03-30T14:14:54.735668+0000 (oldest deadline 2024-03-30T14:15:17.035489+0000) 2024-03-30T14:15:48.246 INFO:journalctl@ceph.osd.7.smithi181.stdout:Mar 30 14:15:47 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-7[162666]: 2024-03-30T14:15:47.835+0000 7f89f6425700 -1 osd.7 160 heartbeat_check: no reply from 172.21.15.99:6814 osd.1 since back 2024-03-30T14:15:04.537446+0000 front 2024-03-30T14:15:04.537483+0000 (oldest deadline 2024-03-30T14:15:28.037269+0000) 2024-03-30T14:15:48.246 INFO:journalctl@ceph.osd.7.smithi181.stdout:Mar 30 14:15:47 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-7[162666]: 2024-03-30T14:15:47.835+0000 7f89f6425700 -1 osd.7 160 heartbeat_check: no reply from 172.21.15.99:6822 osd.2 since back 2024-03-30T14:15:09.738215+0000 front 2024-03-30T14:15:09.738166+0000 (oldest deadline 2024-03-30T14:15:35.637991+0000) 2024-03-30T14:15:48.246 INFO:journalctl@ceph.osd.7.smithi181.stdout:Mar 30 14:15:47 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-7[162666]: 2024-03-30T14:15:47.835+0000 7f89f6425700 -1 osd.7 160 heartbeat_check: no reply from 172.21.15.99:6830 osd.3 since back 2024-03-30T14:15:22.539867+0000 front 2024-03-30T14:15:22.539913+0000 (oldest deadline 2024-03-30T14:15:47.740060+0000) 2024-03-30T14:15:48.996 INFO:journalctl@ceph.osd.7.smithi181.stdout:Mar 30 14:15:48 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-7[162666]: 2024-03-30T14:15:48.807+0000 7f89f6425700 -1 osd.7 160 heartbeat_check: no reply from 172.21.15.99:6806 osd.0 since back 2024-03-30T14:14:54.735757+0000 front 2024-03-30T14:14:54.735668+0000 (oldest deadline 2024-03-30T14:15:17.035489+0000) 2024-03-30T14:15:48.996 INFO:journalctl@ceph.osd.7.smithi181.stdout:Mar 30 14:15:48 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-7[162666]: 2024-03-30T14:15:48.807+0000 7f89f6425700 -1 osd.7 160 heartbeat_check: no reply from 172.21.15.99:6814 osd.1 since back 2024-03-30T14:15:04.537446+0000 front 2024-03-30T14:15:04.537483+0000 (oldest deadline 2024-03-30T14:15:28.037269+0000) 2024-03-30T14:15:48.996 INFO:journalctl@ceph.osd.7.smithi181.stdout:Mar 30 14:15:48 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-7[162666]: 2024-03-30T14:15:48.807+0000 7f89f6425700 -1 osd.7 160 heartbeat_check: no reply from 172.21.15.99:6822 osd.2 since back 2024-03-30T14:15:09.738215+0000 front 2024-03-30T14:15:09.738166+0000 (oldest deadline 2024-03-30T14:15:35.637991+0000) 2024-03-30T14:15:48.996 INFO:journalctl@ceph.osd.7.smithi181.stdout:Mar 30 14:15:48 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-7[162666]: 2024-03-30T14:15:48.807+0000 7f89f6425700 -1 osd.7 160 heartbeat_check: no reply from 172.21.15.99:6830 osd.3 since back 2024-03-30T14:15:22.539867+0000 front 2024-03-30T14:15:22.539913+0000 (oldest deadline 2024-03-30T14:15:47.740060+0000) 2024-03-30T14:15:48.996 INFO:journalctl@ceph.osd.6.smithi181.stdout:Mar 30 14:15:48 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-6[159016]: 2024-03-30T14:15:48.642+0000 7f40ae4c5700 -1 osd.6 160 heartbeat_check: no reply from 172.21.15.99:6806 osd.0 since back 2024-03-30T14:14:55.671948+0000 front 2024-03-30T14:14:55.672008+0000 (oldest deadline 2024-03-30T14:15:19.771809+0000) 2024-03-30T14:15:48.997 INFO:journalctl@ceph.osd.6.smithi181.stdout:Mar 30 14:15:48 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-6[159016]: 2024-03-30T14:15:48.642+0000 7f40ae4c5700 -1 osd.6 160 heartbeat_check: no reply from 172.21.15.99:6814 osd.1 since back 2024-03-30T14:15:04.373319+0000 front 2024-03-30T14:15:04.373414+0000 (oldest deadline 2024-03-30T14:15:28.473188+0000) 2024-03-30T14:15:48.997 INFO:journalctl@ceph.osd.6.smithi181.stdout:Mar 30 14:15:48 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-6[159016]: 2024-03-30T14:15:48.642+0000 7f40ae4c5700 -1 osd.6 160 heartbeat_check: no reply from 172.21.15.99:6822 osd.2 since back 2024-03-30T14:15:11.974325+0000 front 2024-03-30T14:15:11.974252+0000 (oldest deadline 2024-03-30T14:15:34.874106+0000) 2024-03-30T14:15:48.997 INFO:journalctl@ceph.osd.6.smithi181.stdout:Mar 30 14:15:48 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-6[159016]: 2024-03-30T14:15:48.642+0000 7f40ae4c5700 -1 osd.6 160 heartbeat_check: no reply from 172.21.15.99:6830 osd.3 since back 2024-03-30T14:15:22.376012+0000 front 2024-03-30T14:15:22.375936+0000 (oldest deadline 2024-03-30T14:15:45.275863+0000) 2024-03-30T14:15:49.734 INFO:journalctl@ceph.osd.6.smithi181.stdout:Mar 30 14:15:49 smithi181 podman[179468]: 2024-03-30 14:15:49.487119745 +0000 UTC m=+5.446394754 container died 4a29dfeb4b16278d9a6230a521b56b7b1629c4ef4005d5ae0c685636acaa0e1d (image=quay.ceph.io/ceph-ci/ceph:4e50bbcdd1630c7760b708f3a5b4d38a121e66cb, name=ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-6, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.schema-version=1.0, RELEASE=squid-4e50bbc, ceph=True, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240326) 2024-03-30T14:15:49.996 INFO:journalctl@ceph.osd.6.smithi181.stdout:Mar 30 14:15:49 smithi181 podman[179468]: 2024-03-30 14:15:49.917420991 +0000 UTC m=+5.876696032 container cleanup 4a29dfeb4b16278d9a6230a521b56b7b1629c4ef4005d5ae0c685636acaa0e1d (image=quay.ceph.io/ceph-ci/ceph:4e50bbcdd1630c7760b708f3a5b4d38a121e66cb, name=ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-6, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.build-date=20240326, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, CEPH_POINT_RELEASE=, RELEASE=squid-4e50bbc, GIT_CLEAN=True) 2024-03-30T14:15:49.996 INFO:journalctl@ceph.osd.6.smithi181.stdout:Mar 30 14:15:49 smithi181 bash[179468]: ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-6 2024-03-30T14:15:49.996 INFO:journalctl@ceph.osd.7.smithi181.stdout:Mar 30 14:15:49 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-7[162666]: 2024-03-30T14:15:49.826+0000 7f89f6425700 -1 osd.7 160 heartbeat_check: no reply from 172.21.15.99:6806 osd.0 since back 2024-03-30T14:14:54.735757+0000 front 2024-03-30T14:14:54.735668+0000 (oldest deadline 2024-03-30T14:15:17.035489+0000) 2024-03-30T14:15:49.996 INFO:journalctl@ceph.osd.7.smithi181.stdout:Mar 30 14:15:49 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-7[162666]: 2024-03-30T14:15:49.826+0000 7f89f6425700 -1 osd.7 160 heartbeat_check: no reply from 172.21.15.99:6814 osd.1 since back 2024-03-30T14:15:04.537446+0000 front 2024-03-30T14:15:04.537483+0000 (oldest deadline 2024-03-30T14:15:28.037269+0000) 2024-03-30T14:15:49.996 INFO:journalctl@ceph.osd.7.smithi181.stdout:Mar 30 14:15:49 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-7[162666]: 2024-03-30T14:15:49.826+0000 7f89f6425700 -1 osd.7 160 heartbeat_check: no reply from 172.21.15.99:6822 osd.2 since back 2024-03-30T14:15:09.738215+0000 front 2024-03-30T14:15:09.738166+0000 (oldest deadline 2024-03-30T14:15:35.637991+0000) 2024-03-30T14:15:49.996 INFO:journalctl@ceph.osd.7.smithi181.stdout:Mar 30 14:15:49 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-7[162666]: 2024-03-30T14:15:49.826+0000 7f89f6425700 -1 osd.7 160 heartbeat_check: no reply from 172.21.15.99:6830 osd.3 since back 2024-03-30T14:15:22.539867+0000 front 2024-03-30T14:15:22.539913+0000 (oldest deadline 2024-03-30T14:15:47.740060+0000) 2024-03-30T14:15:50.496 INFO:journalctl@ceph.osd.6.smithi181.stdout:Mar 30 14:15:50 smithi181 podman[179600]: 2024-03-30 14:15:50.107101494 +0000 UTC m=+0.616392676 container remove 4a29dfeb4b16278d9a6230a521b56b7b1629c4ef4005d5ae0c685636acaa0e1d (image=quay.ceph.io/ceph-ci/ceph:4e50bbcdd1630c7760b708f3a5b4d38a121e66cb, name=ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-6, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.build-date=20240326, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, ceph=True, RELEASE=squid-4e50bbc, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0) 2024-03-30T14:15:50.791 INFO:journalctl@ceph.osd.6.smithi181.stdout:Mar 30 14:15:50 smithi181 podman[179693]: 2024-03-30 14:15:50.442449297 +0000 UTC m=+0.018120290 image pull b0c4478f1d83795df4d538bf108aee5fac57194348fb16dcdbb3115f3e2fe95e quay.ceph.io/ceph-ci/ceph:4e50bbcdd1630c7760b708f3a5b4d38a121e66cb 2024-03-30T14:15:50.792 INFO:journalctl@ceph.osd.6.smithi181.stdout:Mar 30 14:15:50 smithi181 podman[179693]: 2024-03-30 14:15:50.55323077 +0000 UTC m=+0.128901743 container create a89dd79224bcbe6d90b620592eaad6482bd6c9cebbdd81a181330f3d2e3b42ec (image=quay.ceph.io/ceph-ci/ceph:4e50bbcdd1630c7760b708f3a5b4d38a121e66cb, name=ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-6-deactivate, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, RELEASE=squid-4e50bbc, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.build-date=20240326, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, ceph=True) 2024-03-30T14:15:50.792 INFO:journalctl@ceph.osd.6.smithi181.stdout:Mar 30 14:15:50 smithi181 podman[179693]: 2024-03-30 14:15:50.755632756 +0000 UTC m=+0.331303740 container init a89dd79224bcbe6d90b620592eaad6482bd6c9cebbdd81a181330f3d2e3b42ec (image=quay.ceph.io/ceph-ci/ceph:4e50bbcdd1630c7760b708f3a5b4d38a121e66cb, name=ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-6-deactivate, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240326, GIT_BRANCH=HEAD, ceph=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, RELEASE=squid-4e50bbc) 2024-03-30T14:15:50.792 INFO:journalctl@ceph.osd.6.smithi181.stdout:Mar 30 14:15:50 smithi181 podman[179693]: 2024-03-30 14:15:50.758787236 +0000 UTC m=+0.334458212 container start a89dd79224bcbe6d90b620592eaad6482bd6c9cebbdd81a181330f3d2e3b42ec (image=quay.ceph.io/ceph-ci/ceph:4e50bbcdd1630c7760b708f3a5b4d38a121e66cb, name=ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-6-deactivate, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240326, org.label-schema.license=GPLv2, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-4e50bbc, io.buildah.version=1.33.5) 2024-03-30T14:15:51.068 INFO:journalctl@ceph.osd.6.smithi181.stdout:Mar 30 14:15:50 smithi181 podman[179693]: 2024-03-30 14:15:50.847349587 +0000 UTC m=+0.423020563 container attach a89dd79224bcbe6d90b620592eaad6482bd6c9cebbdd81a181330f3d2e3b42ec (image=quay.ceph.io/ceph-ci/ceph:4e50bbcdd1630c7760b708f3a5b4d38a121e66cb, name=ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-6-deactivate, org.label-schema.build-date=20240326, org.label-schema.schema-version=1.0, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, CEPH_POINT_RELEASE=, ceph=True, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, RELEASE=squid-4e50bbc, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5) 2024-03-30T14:15:51.069 INFO:journalctl@ceph.osd.6.smithi181.stdout:Mar 30 14:15:51 smithi181 podman[179693]: 2024-03-30 14:15:51.049556958 +0000 UTC m=+0.625227943 container died a89dd79224bcbe6d90b620592eaad6482bd6c9cebbdd81a181330f3d2e3b42ec (image=quay.ceph.io/ceph-ci/ceph:4e50bbcdd1630c7760b708f3a5b4d38a121e66cb, name=ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-6-deactivate, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, RELEASE=squid-4e50bbc, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.build-date=20240326, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image) 2024-03-30T14:15:51.069 INFO:journalctl@ceph.osd.7.smithi181.stdout:Mar 30 14:15:50 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-7[162666]: 2024-03-30T14:15:50.800+0000 7f89f6425700 -1 osd.7 160 heartbeat_check: no reply from 172.21.15.99:6806 osd.0 since back 2024-03-30T14:14:54.735757+0000 front 2024-03-30T14:14:54.735668+0000 (oldest deadline 2024-03-30T14:15:17.035489+0000) 2024-03-30T14:15:51.069 INFO:journalctl@ceph.osd.7.smithi181.stdout:Mar 30 14:15:50 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-7[162666]: 2024-03-30T14:15:50.800+0000 7f89f6425700 -1 osd.7 160 heartbeat_check: no reply from 172.21.15.99:6814 osd.1 since back 2024-03-30T14:15:04.537446+0000 front 2024-03-30T14:15:04.537483+0000 (oldest deadline 2024-03-30T14:15:28.037269+0000) 2024-03-30T14:15:51.069 INFO:journalctl@ceph.osd.7.smithi181.stdout:Mar 30 14:15:50 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-7[162666]: 2024-03-30T14:15:50.800+0000 7f89f6425700 -1 osd.7 160 heartbeat_check: no reply from 172.21.15.99:6822 osd.2 since back 2024-03-30T14:15:09.738215+0000 front 2024-03-30T14:15:09.738166+0000 (oldest deadline 2024-03-30T14:15:35.637991+0000) 2024-03-30T14:15:51.069 INFO:journalctl@ceph.osd.7.smithi181.stdout:Mar 30 14:15:50 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-7[162666]: 2024-03-30T14:15:50.800+0000 7f89f6425700 -1 osd.7 160 heartbeat_check: no reply from 172.21.15.99:6830 osd.3 since back 2024-03-30T14:15:22.539867+0000 front 2024-03-30T14:15:22.539913+0000 (oldest deadline 2024-03-30T14:15:47.740060+0000) 2024-03-30T14:15:51.722 DEBUG:teuthology.orchestra.run.smithi181:> sudo pkill -f 'journalctl -f -n 0 -u ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4@osd.6.service' 2024-03-30T14:15:51.763 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-03-30T14:15:51.763 INFO:tasks.cephadm.osd.6:Stopped osd.6 2024-03-30T14:15:51.763 INFO:tasks.cephadm.osd.7:Stopping osd.7... 2024-03-30T14:15:51.764 DEBUG:teuthology.orchestra.run.smithi181:> sudo systemctl stop ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4@osd.7 2024-03-30T14:15:51.996 INFO:journalctl@ceph.osd.7.smithi181.stdout:Mar 30 14:15:51 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-7[162666]: 2024-03-30T14:15:51.790+0000 7f89f6425700 -1 osd.7 160 heartbeat_check: no reply from 172.21.15.99:6806 osd.0 since back 2024-03-30T14:14:54.735757+0000 front 2024-03-30T14:14:54.735668+0000 (oldest deadline 2024-03-30T14:15:17.035489+0000) 2024-03-30T14:15:51.996 INFO:journalctl@ceph.osd.7.smithi181.stdout:Mar 30 14:15:51 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-7[162666]: 2024-03-30T14:15:51.790+0000 7f89f6425700 -1 osd.7 160 heartbeat_check: no reply from 172.21.15.99:6814 osd.1 since back 2024-03-30T14:15:04.537446+0000 front 2024-03-30T14:15:04.537483+0000 (oldest deadline 2024-03-30T14:15:28.037269+0000) 2024-03-30T14:15:51.996 INFO:journalctl@ceph.osd.7.smithi181.stdout:Mar 30 14:15:51 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-7[162666]: 2024-03-30T14:15:51.790+0000 7f89f6425700 -1 osd.7 160 heartbeat_check: no reply from 172.21.15.99:6822 osd.2 since back 2024-03-30T14:15:09.738215+0000 front 2024-03-30T14:15:09.738166+0000 (oldest deadline 2024-03-30T14:15:35.637991+0000) 2024-03-30T14:15:51.996 INFO:journalctl@ceph.osd.7.smithi181.stdout:Mar 30 14:15:51 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-7[162666]: 2024-03-30T14:15:51.790+0000 7f89f6425700 -1 osd.7 160 heartbeat_check: no reply from 172.21.15.99:6830 osd.3 since back 2024-03-30T14:15:22.539867+0000 front 2024-03-30T14:15:22.539913+0000 (oldest deadline 2024-03-30T14:15:47.740060+0000) 2024-03-30T14:15:51.996 INFO:journalctl@ceph.osd.7.smithi181.stdout:Mar 30 14:15:51 smithi181 systemd[1]: Stopping Ceph osd.7 for 98ebaeb8-ee99-11ee-b647-cb9ed24678a4... 2024-03-30T14:15:52.496 INFO:journalctl@ceph.osd.7.smithi181.stdout:Mar 30 14:15:52 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-7[162666]: 2024-03-30T14:15:52.112+0000 7f89fde39700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.7 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-03-30T14:15:52.496 INFO:journalctl@ceph.osd.7.smithi181.stdout:Mar 30 14:15:52 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-7[162666]: 2024-03-30T14:15:52.112+0000 7f89fde39700 -1 osd.7 160 *** Got signal Terminated *** 2024-03-30T14:15:52.496 INFO:journalctl@ceph.osd.7.smithi181.stdout:Mar 30 14:15:52 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-7[162666]: 2024-03-30T14:15:52.112+0000 7f89fde39700 -1 osd.7 160 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-03-30T14:15:53.246 INFO:journalctl@ceph.osd.7.smithi181.stdout:Mar 30 14:15:52 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-7[162666]: 2024-03-30T14:15:52.773+0000 7f89f6425700 -1 osd.7 160 heartbeat_check: no reply from 172.21.15.99:6806 osd.0 since back 2024-03-30T14:14:54.735757+0000 front 2024-03-30T14:14:54.735668+0000 (oldest deadline 2024-03-30T14:15:17.035489+0000) 2024-03-30T14:15:53.246 INFO:journalctl@ceph.osd.7.smithi181.stdout:Mar 30 14:15:52 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-7[162666]: 2024-03-30T14:15:52.773+0000 7f89f6425700 -1 osd.7 160 heartbeat_check: no reply from 172.21.15.99:6814 osd.1 since back 2024-03-30T14:15:04.537446+0000 front 2024-03-30T14:15:04.537483+0000 (oldest deadline 2024-03-30T14:15:28.037269+0000) 2024-03-30T14:15:53.246 INFO:journalctl@ceph.osd.7.smithi181.stdout:Mar 30 14:15:52 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-7[162666]: 2024-03-30T14:15:52.773+0000 7f89f6425700 -1 osd.7 160 heartbeat_check: no reply from 172.21.15.99:6822 osd.2 since back 2024-03-30T14:15:09.738215+0000 front 2024-03-30T14:15:09.738166+0000 (oldest deadline 2024-03-30T14:15:35.637991+0000) 2024-03-30T14:15:53.246 INFO:journalctl@ceph.osd.7.smithi181.stdout:Mar 30 14:15:52 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-7[162666]: 2024-03-30T14:15:52.773+0000 7f89f6425700 -1 osd.7 160 heartbeat_check: no reply from 172.21.15.99:6830 osd.3 since back 2024-03-30T14:15:22.539867+0000 front 2024-03-30T14:15:22.539913+0000 (oldest deadline 2024-03-30T14:15:47.740060+0000) 2024-03-30T14:15:54.246 INFO:journalctl@ceph.osd.7.smithi181.stdout:Mar 30 14:15:53 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-7[162666]: 2024-03-30T14:15:53.784+0000 7f89f6425700 -1 osd.7 160 heartbeat_check: no reply from 172.21.15.99:6806 osd.0 since back 2024-03-30T14:14:54.735757+0000 front 2024-03-30T14:14:54.735668+0000 (oldest deadline 2024-03-30T14:15:17.035489+0000) 2024-03-30T14:15:54.246 INFO:journalctl@ceph.osd.7.smithi181.stdout:Mar 30 14:15:53 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-7[162666]: 2024-03-30T14:15:53.784+0000 7f89f6425700 -1 osd.7 160 heartbeat_check: no reply from 172.21.15.99:6814 osd.1 since back 2024-03-30T14:15:04.537446+0000 front 2024-03-30T14:15:04.537483+0000 (oldest deadline 2024-03-30T14:15:28.037269+0000) 2024-03-30T14:15:54.246 INFO:journalctl@ceph.osd.7.smithi181.stdout:Mar 30 14:15:53 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-7[162666]: 2024-03-30T14:15:53.784+0000 7f89f6425700 -1 osd.7 160 heartbeat_check: no reply from 172.21.15.99:6822 osd.2 since back 2024-03-30T14:15:09.738215+0000 front 2024-03-30T14:15:09.738166+0000 (oldest deadline 2024-03-30T14:15:35.637991+0000) 2024-03-30T14:15:54.246 INFO:journalctl@ceph.osd.7.smithi181.stdout:Mar 30 14:15:53 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-7[162666]: 2024-03-30T14:15:53.784+0000 7f89f6425700 -1 osd.7 160 heartbeat_check: no reply from 172.21.15.99:6830 osd.3 since back 2024-03-30T14:15:22.539867+0000 front 2024-03-30T14:15:22.539913+0000 (oldest deadline 2024-03-30T14:15:47.740060+0000) 2024-03-30T14:15:55.246 INFO:journalctl@ceph.osd.7.smithi181.stdout:Mar 30 14:15:54 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-7[162666]: 2024-03-30T14:15:54.764+0000 7f89f6425700 -1 osd.7 160 heartbeat_check: no reply from 172.21.15.99:6806 osd.0 since back 2024-03-30T14:14:54.735757+0000 front 2024-03-30T14:14:54.735668+0000 (oldest deadline 2024-03-30T14:15:17.035489+0000) 2024-03-30T14:15:55.246 INFO:journalctl@ceph.osd.7.smithi181.stdout:Mar 30 14:15:54 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-7[162666]: 2024-03-30T14:15:54.764+0000 7f89f6425700 -1 osd.7 160 heartbeat_check: no reply from 172.21.15.99:6814 osd.1 since back 2024-03-30T14:15:04.537446+0000 front 2024-03-30T14:15:04.537483+0000 (oldest deadline 2024-03-30T14:15:28.037269+0000) 2024-03-30T14:15:55.246 INFO:journalctl@ceph.osd.7.smithi181.stdout:Mar 30 14:15:54 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-7[162666]: 2024-03-30T14:15:54.764+0000 7f89f6425700 -1 osd.7 160 heartbeat_check: no reply from 172.21.15.99:6822 osd.2 since back 2024-03-30T14:15:09.738215+0000 front 2024-03-30T14:15:09.738166+0000 (oldest deadline 2024-03-30T14:15:35.637991+0000) 2024-03-30T14:15:55.246 INFO:journalctl@ceph.osd.7.smithi181.stdout:Mar 30 14:15:54 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-7[162666]: 2024-03-30T14:15:54.764+0000 7f89f6425700 -1 osd.7 160 heartbeat_check: no reply from 172.21.15.99:6830 osd.3 since back 2024-03-30T14:15:22.539867+0000 front 2024-03-30T14:15:22.539913+0000 (oldest deadline 2024-03-30T14:15:47.740060+0000) 2024-03-30T14:15:56.246 INFO:journalctl@ceph.osd.7.smithi181.stdout:Mar 30 14:15:55 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-7[162666]: 2024-03-30T14:15:55.769+0000 7f89f6425700 -1 osd.7 160 heartbeat_check: no reply from 172.21.15.99:6806 osd.0 since back 2024-03-30T14:14:54.735757+0000 front 2024-03-30T14:14:54.735668+0000 (oldest deadline 2024-03-30T14:15:17.035489+0000) 2024-03-30T14:15:56.246 INFO:journalctl@ceph.osd.7.smithi181.stdout:Mar 30 14:15:55 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-7[162666]: 2024-03-30T14:15:55.769+0000 7f89f6425700 -1 osd.7 160 heartbeat_check: no reply from 172.21.15.99:6814 osd.1 since back 2024-03-30T14:15:04.537446+0000 front 2024-03-30T14:15:04.537483+0000 (oldest deadline 2024-03-30T14:15:28.037269+0000) 2024-03-30T14:15:56.246 INFO:journalctl@ceph.osd.7.smithi181.stdout:Mar 30 14:15:55 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-7[162666]: 2024-03-30T14:15:55.769+0000 7f89f6425700 -1 osd.7 160 heartbeat_check: no reply from 172.21.15.99:6822 osd.2 since back 2024-03-30T14:15:09.738215+0000 front 2024-03-30T14:15:09.738166+0000 (oldest deadline 2024-03-30T14:15:35.637991+0000) 2024-03-30T14:15:56.246 INFO:journalctl@ceph.osd.7.smithi181.stdout:Mar 30 14:15:55 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-7[162666]: 2024-03-30T14:15:55.769+0000 7f89f6425700 -1 osd.7 160 heartbeat_check: no reply from 172.21.15.99:6830 osd.3 since back 2024-03-30T14:15:22.539867+0000 front 2024-03-30T14:15:22.539913+0000 (oldest deadline 2024-03-30T14:15:47.740060+0000) 2024-03-30T14:15:57.246 INFO:journalctl@ceph.osd.7.smithi181.stdout:Mar 30 14:15:56 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-7[162666]: 2024-03-30T14:15:56.778+0000 7f89f6425700 -1 osd.7 160 heartbeat_check: no reply from 172.21.15.99:6806 osd.0 since back 2024-03-30T14:14:54.735757+0000 front 2024-03-30T14:14:54.735668+0000 (oldest deadline 2024-03-30T14:15:17.035489+0000) 2024-03-30T14:15:57.246 INFO:journalctl@ceph.osd.7.smithi181.stdout:Mar 30 14:15:56 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-7[162666]: 2024-03-30T14:15:56.778+0000 7f89f6425700 -1 osd.7 160 heartbeat_check: no reply from 172.21.15.99:6814 osd.1 since back 2024-03-30T14:15:04.537446+0000 front 2024-03-30T14:15:04.537483+0000 (oldest deadline 2024-03-30T14:15:28.037269+0000) 2024-03-30T14:15:57.246 INFO:journalctl@ceph.osd.7.smithi181.stdout:Mar 30 14:15:56 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-7[162666]: 2024-03-30T14:15:56.778+0000 7f89f6425700 -1 osd.7 160 heartbeat_check: no reply from 172.21.15.99:6822 osd.2 since back 2024-03-30T14:15:09.738215+0000 front 2024-03-30T14:15:09.738166+0000 (oldest deadline 2024-03-30T14:15:35.637991+0000) 2024-03-30T14:15:57.246 INFO:journalctl@ceph.osd.7.smithi181.stdout:Mar 30 14:15:56 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-7[162666]: 2024-03-30T14:15:56.778+0000 7f89f6425700 -1 osd.7 160 heartbeat_check: no reply from 172.21.15.99:6830 osd.3 since back 2024-03-30T14:15:22.539867+0000 front 2024-03-30T14:15:22.539913+0000 (oldest deadline 2024-03-30T14:15:47.740060+0000) 2024-03-30T14:15:57.246 INFO:journalctl@ceph.osd.7.smithi181.stdout:Mar 30 14:15:56 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-7[162666]: 2024-03-30T14:15:56.778+0000 7f89f6425700 -1 osd.7 160 heartbeat_check: no reply from 172.21.15.181:6804 osd.4 since back 2024-03-30T14:15:31.240923+0000 front 2024-03-30T14:15:31.240951+0000 (oldest deadline 2024-03-30T14:15:55.940993+0000) 2024-03-30T14:15:57.687 INFO:journalctl@ceph.osd.7.smithi181.stdout:Mar 30 14:15:57 smithi181 podman[179809]: 2024-03-30 14:15:57.425348666 +0000 UTC m=+5.411741822 container died 7940232eb4fe392a35152a0f996efc8e0eb9fca87c66ec8ff82f739c0292834a (image=quay.ceph.io/ceph-ci/ceph:4e50bbcdd1630c7760b708f3a5b4d38a121e66cb, name=ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-7, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, GIT_BRANCH=HEAD, RELEASE=squid-4e50bbc, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, GIT_CLEAN=True, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240326, org.label-schema.schema-version=1.0) 2024-03-30T14:15:57.996 INFO:journalctl@ceph.osd.7.smithi181.stdout:Mar 30 14:15:57 smithi181 podman[179809]: 2024-03-30 14:15:57.80448131 +0000 UTC m=+5.790874458 container cleanup 7940232eb4fe392a35152a0f996efc8e0eb9fca87c66ec8ff82f739c0292834a (image=quay.ceph.io/ceph-ci/ceph:4e50bbcdd1630c7760b708f3a5b4d38a121e66cb, name=ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-7, org.label-schema.build-date=20240326, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, RELEASE=squid-4e50bbc, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, ceph=True, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0) 2024-03-30T14:15:57.996 INFO:journalctl@ceph.osd.7.smithi181.stdout:Mar 30 14:15:57 smithi181 bash[179809]: ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-7 2024-03-30T14:15:58.356 INFO:journalctl@ceph.osd.7.smithi181.stdout:Mar 30 14:15:58 smithi181 podman[179827]: 2024-03-30 14:15:58.055363709 +0000 UTC m=+0.623332734 container remove 7940232eb4fe392a35152a0f996efc8e0eb9fca87c66ec8ff82f739c0292834a (image=quay.ceph.io/ceph-ci/ceph:4e50bbcdd1630c7760b708f3a5b4d38a121e66cb, name=ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-7, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.build-date=20240326, maintainer=Guillaume Abrioux , GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, RELEASE=squid-4e50bbc, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=) 2024-03-30T14:15:58.657 INFO:journalctl@ceph.osd.7.smithi181.stdout:Mar 30 14:15:58 smithi181 podman[179919]: 2024-03-30 14:15:58.269478557 +0000 UTC m=+0.018294237 image pull b0c4478f1d83795df4d538bf108aee5fac57194348fb16dcdbb3115f3e2fe95e quay.ceph.io/ceph-ci/ceph:4e50bbcdd1630c7760b708f3a5b4d38a121e66cb 2024-03-30T14:15:58.658 INFO:journalctl@ceph.osd.7.smithi181.stdout:Mar 30 14:15:58 smithi181 podman[179919]: 2024-03-30 14:15:58.389351508 +0000 UTC m=+0.138167171 container create 3443911dfe7a555298f66d560428c231bc23ee24839d904e63a64362cbe602d5 (image=quay.ceph.io/ceph-ci/ceph:4e50bbcdd1630c7760b708f3a5b4d38a121e66cb, name=ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-7-deactivate, org.label-schema.license=GPLv2, org.label-schema.build-date=20240326, org.label-schema.schema-version=1.0, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , ceph=True, io.buildah.version=1.33.5, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=squid-4e50bbc) 2024-03-30T14:15:58.658 INFO:journalctl@ceph.osd.7.smithi181.stdout:Mar 30 14:15:58 smithi181 podman[179919]: 2024-03-30 14:15:58.591698904 +0000 UTC m=+0.340514584 container init 3443911dfe7a555298f66d560428c231bc23ee24839d904e63a64362cbe602d5 (image=quay.ceph.io/ceph-ci/ceph:4e50bbcdd1630c7760b708f3a5b4d38a121e66cb, name=ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-7-deactivate, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, RELEASE=squid-4e50bbc, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, ceph=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.build-date=20240326, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0) 2024-03-30T14:15:58.658 INFO:journalctl@ceph.osd.7.smithi181.stdout:Mar 30 14:15:58 smithi181 podman[179919]: 2024-03-30 14:15:58.594756186 +0000 UTC m=+0.343571857 container start 3443911dfe7a555298f66d560428c231bc23ee24839d904e63a64362cbe602d5 (image=quay.ceph.io/ceph-ci/ceph:4e50bbcdd1630c7760b708f3a5b4d38a121e66cb, name=ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-7-deactivate, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, GIT_CLEAN=True, org.label-schema.build-date=20240326, org.label-schema.license=GPLv2, RELEASE=squid-4e50bbc, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=) 2024-03-30T14:15:58.658 INFO:journalctl@ceph.osd.7.smithi181.stdout:Mar 30 14:15:58 smithi181 podman[179919]: 2024-03-30 14:15:58.666679727 +0000 UTC m=+0.415495408 container attach 3443911dfe7a555298f66d560428c231bc23ee24839d904e63a64362cbe602d5 (image=quay.ceph.io/ceph-ci/ceph:4e50bbcdd1630c7760b708f3a5b4d38a121e66cb, name=ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-7-deactivate, org.label-schema.schema-version=1.0, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240326, GIT_CLEAN=True, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, RELEASE=squid-4e50bbc, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , ceph=True) 2024-03-30T14:15:58.996 INFO:journalctl@ceph.osd.7.smithi181.stdout:Mar 30 14:15:58 smithi181 podman[179919]: 2024-03-30 14:15:58.886745805 +0000 UTC m=+0.635561482 container died 3443911dfe7a555298f66d560428c231bc23ee24839d904e63a64362cbe602d5 (image=quay.ceph.io/ceph-ci/ceph:4e50bbcdd1630c7760b708f3a5b4d38a121e66cb, name=ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-osd-7-deactivate, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, ceph=True, io.buildah.version=1.33.5, GIT_CLEAN=True, org.label-schema.build-date=20240326, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, RELEASE=squid-4e50bbc) 2024-03-30T14:15:59.493 DEBUG:teuthology.orchestra.run.smithi181:> sudo pkill -f 'journalctl -f -n 0 -u ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4@osd.7.service' 2024-03-30T14:15:59.533 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-03-30T14:15:59.534 INFO:tasks.cephadm.osd.7:Stopped osd.7 2024-03-30T14:15:59.534 INFO:tasks.cephadm.prometheus.a:Stopping prometheus.a... 2024-03-30T14:15:59.534 DEBUG:teuthology.orchestra.run.smithi181:> sudo systemctl stop ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4@prometheus.a 2024-03-30T14:15:59.746 INFO:journalctl@ceph.prometheus.a.smithi181.stdout:Mar 30 14:15:59 smithi181 systemd[1]: Stopping Ceph prometheus.a for 98ebaeb8-ee99-11ee-b647-cb9ed24678a4... 2024-03-30T14:16:00.123 INFO:journalctl@ceph.prometheus.a.smithi181.stdout:Mar 30 14:15:59 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-prometheus-a[100542]: ts=2024-03-30T14:15:59.865Z caller=main.go:840 level=warn msg="Received SIGTERM, exiting gracefully..." 2024-03-30T14:16:00.123 INFO:journalctl@ceph.prometheus.a.smithi181.stdout:Mar 30 14:15:59 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-prometheus-a[100542]: ts=2024-03-30T14:15:59.865Z caller=main.go:864 level=info msg="Stopping scrape discovery manager..." 2024-03-30T14:16:00.123 INFO:journalctl@ceph.prometheus.a.smithi181.stdout:Mar 30 14:15:59 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-prometheus-a[100542]: ts=2024-03-30T14:15:59.865Z caller=main.go:878 level=info msg="Stopping notify discovery manager..." 2024-03-30T14:16:00.123 INFO:journalctl@ceph.prometheus.a.smithi181.stdout:Mar 30 14:15:59 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-prometheus-a[100542]: ts=2024-03-30T14:15:59.865Z caller=manager.go:988 level=info component="rule manager" msg="Stopping rule manager..." 2024-03-30T14:16:00.123 INFO:journalctl@ceph.prometheus.a.smithi181.stdout:Mar 30 14:15:59 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-prometheus-a[100542]: ts=2024-03-30T14:15:59.865Z caller=main.go:860 level=info msg="Scrape discovery manager stopped" 2024-03-30T14:16:00.123 INFO:journalctl@ceph.prometheus.a.smithi181.stdout:Mar 30 14:15:59 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-prometheus-a[100542]: ts=2024-03-30T14:15:59.865Z caller=main.go:874 level=info msg="Notify discovery manager stopped" 2024-03-30T14:16:00.123 INFO:journalctl@ceph.prometheus.a.smithi181.stdout:Mar 30 14:15:59 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-prometheus-a[100542]: ts=2024-03-30T14:15:59.865Z caller=manager.go:998 level=info component="rule manager" msg="Rule manager stopped" 2024-03-30T14:16:00.123 INFO:journalctl@ceph.prometheus.a.smithi181.stdout:Mar 30 14:15:59 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-prometheus-a[100542]: ts=2024-03-30T14:15:59.865Z caller=main.go:915 level=info msg="Stopping scrape manager..." 2024-03-30T14:16:00.123 INFO:journalctl@ceph.prometheus.a.smithi181.stdout:Mar 30 14:15:59 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-prometheus-a[100542]: ts=2024-03-30T14:15:59.865Z caller=main.go:907 level=info msg="Scrape manager stopped" 2024-03-30T14:16:00.123 INFO:journalctl@ceph.prometheus.a.smithi181.stdout:Mar 30 14:15:59 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-prometheus-a[100542]: ts=2024-03-30T14:15:59.865Z caller=notifier.go:606 level=info component=notifier msg="Stopping notification manager..." 2024-03-30T14:16:00.124 INFO:journalctl@ceph.prometheus.a.smithi181.stdout:Mar 30 14:15:59 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-prometheus-a[100542]: ts=2024-03-30T14:15:59.865Z caller=main.go:1135 level=info msg="Notifier manager stopped" 2024-03-30T14:16:00.124 INFO:journalctl@ceph.prometheus.a.smithi181.stdout:Mar 30 14:15:59 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-prometheus-a[100542]: ts=2024-03-30T14:15:59.866Z caller=main.go:1147 level=info msg="See you next time!" 2024-03-30T14:16:00.124 INFO:journalctl@ceph.prometheus.a.smithi181.stdout:Mar 30 14:15:59 smithi181 podman[180025]: 2024-03-30 14:15:59.875372377 +0000 UTC m=+0.112213627 container died 004088bdf70e4654d32fd5585813a3078d1569b70bb8a062b5cc11f440a5fff4 (image=quay.io/prometheus/prometheus:v2.43.0, name=ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-prometheus-a, maintainer=The Prometheus Authors ) 2024-03-30T14:16:00.481 INFO:journalctl@ceph.prometheus.a.smithi181.stdout:Mar 30 14:16:00 smithi181 podman[180025]: 2024-03-30 14:16:00.231350794 +0000 UTC m=+0.468192053 container cleanup 004088bdf70e4654d32fd5585813a3078d1569b70bb8a062b5cc11f440a5fff4 (image=quay.io/prometheus/prometheus:v2.43.0, name=ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-prometheus-a, maintainer=The Prometheus Authors ) 2024-03-30T14:16:00.481 INFO:journalctl@ceph.prometheus.a.smithi181.stdout:Mar 30 14:16:00 smithi181 bash[180025]: ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-prometheus-a 2024-03-30T14:16:00.657 DEBUG:teuthology.orchestra.run.smithi181:> sudo pkill -f 'journalctl -f -n 0 -u ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4@prometheus.a.service' 2024-03-30T14:16:00.694 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-03-30T14:16:00.694 INFO:tasks.cephadm.prometheus.a:Stopped prometheus.a 2024-03-30T14:16:00.695 DEBUG:teuthology.orchestra.run.smithi099:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 98ebaeb8-ee99-11ee-b647-cb9ed24678a4 --force --keep-logs 2024-03-30T14:16:02.788 INFO:journalctl@ceph.node-exporter.a.smithi099.stdout:Mar 30 14:16:02 smithi099 systemd[1]: Stopping Ceph node-exporter.a for 98ebaeb8-ee99-11ee-b647-cb9ed24678a4... 2024-03-30T14:16:02.788 INFO:journalctl@ceph.node-exporter.a.smithi099.stdout:Mar 30 14:16:02 smithi099 podman[211261]: 2024-03-30 14:16:02.598880015 +0000 UTC m=+0.105710493 container died 4a3f1f6e7068e330460dfee02fb2791a8be551162e2674687cbe2be492d36880 (image=quay.io/prometheus/node-exporter:v1.5.0, name=ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-node-exporter-a, maintainer=The Prometheus Authors ) 2024-03-30T14:16:03.077 INFO:journalctl@ceph.node-exporter.a.smithi099.stdout:Mar 30 14:16:02 smithi099 podman[211261]: 2024-03-30 14:16:02.955005881 +0000 UTC m=+0.461836355 container cleanup 4a3f1f6e7068e330460dfee02fb2791a8be551162e2674687cbe2be492d36880 (image=quay.io/prometheus/node-exporter:v1.5.0, name=ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-node-exporter-a, maintainer=The Prometheus Authors ) 2024-03-30T14:16:03.077 INFO:journalctl@ceph.node-exporter.a.smithi099.stdout:Mar 30 14:16:02 smithi099 bash[211261]: ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-node-exporter-a 2024-03-30T14:16:03.577 INFO:journalctl@ceph.node-exporter.a.smithi099.stdout:Mar 30 14:16:03 smithi099 podman[211275]: 2024-03-30 14:16:03.239773651 +0000 UTC m=+0.645311834 container remove 4a3f1f6e7068e330460dfee02fb2791a8be551162e2674687cbe2be492d36880 (image=quay.io/prometheus/node-exporter:v1.5.0, name=ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-node-exporter-a, maintainer=The Prometheus Authors ) 2024-03-30T14:16:03.577 INFO:journalctl@ceph.node-exporter.a.smithi099.stdout:Mar 30 14:16:03 smithi099 systemd[1]: ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4@node-exporter.a.service: Main process exited, code=exited, status=143/n/a 2024-03-30T14:16:03.577 INFO:journalctl@ceph.node-exporter.a.smithi099.stdout:Mar 30 14:16:03 smithi099 systemd[1]: ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4@node-exporter.a.service: Failed with result 'exit-code'. 2024-03-30T14:16:03.577 INFO:journalctl@ceph.node-exporter.a.smithi099.stdout:Mar 30 14:16:03 smithi099 systemd[1]: Stopped Ceph node-exporter.a for 98ebaeb8-ee99-11ee-b647-cb9ed24678a4. 2024-03-30T14:16:03.577 INFO:journalctl@ceph.node-exporter.a.smithi099.stdout:Mar 30 14:16:03 smithi099 systemd[1]: ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4@node-exporter.a.service: Consumed 2.303s CPU time. 2024-03-30T14:16:03.850 INFO:journalctl@ceph.alertmanager.a.smithi099.stdout:Mar 30 14:16:03 smithi099 systemd[1]: Stopping Ceph alertmanager.a for 98ebaeb8-ee99-11ee-b647-cb9ed24678a4... 2024-03-30T14:16:04.160 INFO:journalctl@ceph.alertmanager.a.smithi099.stdout:Mar 30 14:16:03 smithi099 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-alertmanager-a[117844]: ts=2024-03-30T14:16:03.859Z caller=main.go:583 level=info msg="Received SIGTERM, exiting gracefully..." 2024-03-30T14:16:04.160 INFO:journalctl@ceph.alertmanager.a.smithi099.stdout:Mar 30 14:16:03 smithi099 podman[211383]: 2024-03-30 14:16:03.910337293 +0000 UTC m=+0.164718998 container died 08735152b67d8c179c8f934bdfc04f3c8e756f4a5ecbd48b8119498096b56537 (image=quay.io/prometheus/alertmanager:v0.25.0, name=ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-alertmanager-a, maintainer=The Prometheus Authors ) 2024-03-30T14:16:04.509 INFO:journalctl@ceph.alertmanager.a.smithi099.stdout:Mar 30 14:16:04 smithi099 podman[211383]: 2024-03-30 14:16:04.259634959 +0000 UTC m=+0.514016673 container cleanup 08735152b67d8c179c8f934bdfc04f3c8e756f4a5ecbd48b8119498096b56537 (image=quay.io/prometheus/alertmanager:v0.25.0, name=ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-alertmanager-a, maintainer=The Prometheus Authors ) 2024-03-30T14:16:04.509 INFO:journalctl@ceph.alertmanager.a.smithi099.stdout:Mar 30 14:16:04 smithi099 bash[211383]: ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-alertmanager-a 2024-03-30T14:16:04.827 INFO:journalctl@ceph.alertmanager.a.smithi099.stdout:Mar 30 14:16:04 smithi099 podman[211404]: 2024-03-30 14:16:04.518924777 +0000 UTC m=+0.609742677 container remove 08735152b67d8c179c8f934bdfc04f3c8e756f4a5ecbd48b8119498096b56537 (image=quay.io/prometheus/alertmanager:v0.25.0, name=ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-alertmanager-a, maintainer=The Prometheus Authors ) 2024-03-30T14:16:04.827 INFO:journalctl@ceph.alertmanager.a.smithi099.stdout:Mar 30 14:16:04 smithi099 podman[211404]: 2024-03-30 14:16:04.611474918 +0000 UTC m=+0.702292818 volume remove 87ec3bce5a02f3338eec00111b2129e153c99a6928f17f509ba0c94f68e963c5 2024-03-30T14:16:04.827 INFO:journalctl@ceph.alertmanager.a.smithi099.stdout:Mar 30 14:16:04 smithi099 systemd[1]: ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4@alertmanager.a.service: Deactivated successfully. 2024-03-30T14:16:04.827 INFO:journalctl@ceph.alertmanager.a.smithi099.stdout:Mar 30 14:16:04 smithi099 systemd[1]: Stopped Ceph alertmanager.a for 98ebaeb8-ee99-11ee-b647-cb9ed24678a4. 2024-03-30T14:16:04.827 INFO:journalctl@ceph.alertmanager.a.smithi099.stdout:Mar 30 14:16:04 smithi099 systemd[1]: ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4@alertmanager.a.service: Consumed 1.648s CPU time. 2024-03-30T14:16:27.790 DEBUG:teuthology.orchestra.run.smithi181:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 98ebaeb8-ee99-11ee-b647-cb9ed24678a4 --force --keep-logs 2024-03-30T14:16:30.994 INFO:journalctl@ceph.node-exporter.b.smithi181.stdout:Mar 30 14:16:30 smithi181 systemd[1]: Stopping Ceph node-exporter.b for 98ebaeb8-ee99-11ee-b647-cb9ed24678a4... 2024-03-30T14:16:30.994 INFO:journalctl@ceph.node-exporter.b.smithi181.stdout:Mar 30 14:16:30 smithi181 podman[181414]: 2024-03-30 14:16:30.813284194 +0000 UTC m=+0.107153086 container died acea317b5f5d87f24c33a73b4753355b7547428a29c5998b0cd57c93e6802e1f (image=quay.io/prometheus/node-exporter:v1.5.0, name=ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-node-exporter-b, maintainer=The Prometheus Authors ) 2024-03-30T14:16:31.245 INFO:journalctl@ceph.node-exporter.b.smithi181.stdout:Mar 30 14:16:31 smithi181 podman[181414]: 2024-03-30 14:16:31.094058846 +0000 UTC m=+0.387927751 container cleanup acea317b5f5d87f24c33a73b4753355b7547428a29c5998b0cd57c93e6802e1f (image=quay.io/prometheus/node-exporter:v1.5.0, name=ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-node-exporter-b, maintainer=The Prometheus Authors ) 2024-03-30T14:16:31.246 INFO:journalctl@ceph.node-exporter.b.smithi181.stdout:Mar 30 14:16:31 smithi181 bash[181414]: ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-node-exporter-b 2024-03-30T14:16:31.626 INFO:journalctl@ceph.node-exporter.b.smithi181.stdout:Mar 30 14:16:31 smithi181 podman[181428]: 2024-03-30 14:16:31.353720674 +0000 UTC m=+0.541754169 container remove acea317b5f5d87f24c33a73b4753355b7547428a29c5998b0cd57c93e6802e1f (image=quay.io/prometheus/node-exporter:v1.5.0, name=ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-node-exporter-b, maintainer=The Prometheus Authors ) 2024-03-30T14:16:31.627 INFO:journalctl@ceph.node-exporter.b.smithi181.stdout:Mar 30 14:16:31 smithi181 systemd[1]: ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4@node-exporter.b.service: Main process exited, code=exited, status=143/n/a 2024-03-30T14:16:31.627 INFO:journalctl@ceph.node-exporter.b.smithi181.stdout:Mar 30 14:16:31 smithi181 systemd[1]: ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4@node-exporter.b.service: Failed with result 'exit-code'. 2024-03-30T14:16:31.627 INFO:journalctl@ceph.node-exporter.b.smithi181.stdout:Mar 30 14:16:31 smithi181 systemd[1]: Stopped Ceph node-exporter.b for 98ebaeb8-ee99-11ee-b647-cb9ed24678a4. 2024-03-30T14:16:31.627 INFO:journalctl@ceph.node-exporter.b.smithi181.stdout:Mar 30 14:16:31 smithi181 systemd[1]: ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4@node-exporter.b.service: Consumed 2.258s CPU time. 2024-03-30T14:16:31.996 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 14:16:31 smithi181 systemd[1]: Stopping Ceph grafana.a for 98ebaeb8-ee99-11ee-b647-cb9ed24678a4... 2024-03-30T14:16:31.996 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 14:16:31 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a[112419]: logger=server t=2024-03-30T14:16:31.873417264Z level=info msg="Shutdown started" reason="System signal: terminated" 2024-03-30T14:16:31.996 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 14:16:31 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a[112419]: logger=tracing t=2024-03-30T14:16:31.873750288Z level=info msg="Closing tracing" 2024-03-30T14:16:31.996 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 14:16:31 smithi181 ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a[112419]: logger=ticker t=2024-03-30T14:16:31.873753583Z level=info msg=stopped last_tick=2024-03-30T14:16:30Z 2024-03-30T14:16:31.996 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 14:16:31 smithi181 podman[181534]: 2024-03-30 14:16:31.883887586 +0000 UTC m=+0.114214114 container died d599aa7730d6227db19936ee8df095983f72f801c1ba54984dfd4bf6c82f3037 (image=quay.io/ceph/grafana:9.4.12, name=ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a, maintainer=Grafana Labs ) 2024-03-30T14:16:32.495 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 14:16:32 smithi181 podman[181534]: 2024-03-30 14:16:32.23125429 +0000 UTC m=+0.461580806 container cleanup d599aa7730d6227db19936ee8df095983f72f801c1ba54984dfd4bf6c82f3037 (image=quay.io/ceph/grafana:9.4.12, name=ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a, maintainer=Grafana Labs ) 2024-03-30T14:16:32.496 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 14:16:32 smithi181 bash[181534]: ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a 2024-03-30T14:16:32.769 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 14:16:32 smithi181 podman[181548]: 2024-03-30 14:16:32.507582834 +0000 UTC m=+0.622904541 container remove d599aa7730d6227db19936ee8df095983f72f801c1ba54984dfd4bf6c82f3037 (image=quay.io/ceph/grafana:9.4.12, name=ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4-grafana-a, maintainer=Grafana Labs ) 2024-03-30T14:16:32.769 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 14:16:32 smithi181 systemd[1]: ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4@grafana.a.service: Deactivated successfully. 2024-03-30T14:16:32.769 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 14:16:32 smithi181 systemd[1]: Stopped Ceph grafana.a for 98ebaeb8-ee99-11ee-b647-cb9ed24678a4. 2024-03-30T14:16:32.769 INFO:journalctl@ceph.grafana.a.smithi181.stdout:Mar 30 14:16:32 smithi181 systemd[1]: ceph-98ebaeb8-ee99-11ee-b647-cb9ed24678a4@grafana.a.service: Consumed 12.194s CPU time. 2024-03-30T14:16:44.299 DEBUG:teuthology.orchestra.run.smithi099:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-03-30T14:16:44.336 DEBUG:teuthology.orchestra.run.smithi181:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-03-30T14:16:44.368 INFO:tasks.cephadm:Archiving crash dumps... 2024-03-30T14:16:44.370 DEBUG:teuthology.misc:Transferring archived files from smithi099:/var/lib/ceph/98ebaeb8-ee99-11ee-b647-cb9ed24678a4/crash to /home/teuthworker/archive/teuthology-2024-03-29_21:08:02-orch-squid-distro-default-smithi/7630107/remote/smithi099/crash 2024-03-30T14:16:44.371 DEBUG:teuthology.orchestra.run.smithi099:> sudo tar c -f - -C /var/lib/ceph/98ebaeb8-ee99-11ee-b647-cb9ed24678a4/crash -- . 2024-03-30T14:16:44.455 INFO:teuthology.orchestra.run.smithi099.stderr:tar: /var/lib/ceph/98ebaeb8-ee99-11ee-b647-cb9ed24678a4/crash: Cannot open: No such file or directory 2024-03-30T14:16:44.455 INFO:teuthology.orchestra.run.smithi099.stderr:tar: Error is not recoverable: exiting now 2024-03-30T14:16:44.457 DEBUG:teuthology.misc:Transferring archived files from smithi181:/var/lib/ceph/98ebaeb8-ee99-11ee-b647-cb9ed24678a4/crash to /home/teuthworker/archive/teuthology-2024-03-29_21:08:02-orch-squid-distro-default-smithi/7630107/remote/smithi181/crash 2024-03-30T14:16:44.458 DEBUG:teuthology.orchestra.run.smithi181:> sudo tar c -f - -C /var/lib/ceph/98ebaeb8-ee99-11ee-b647-cb9ed24678a4/crash -- . 2024-03-30T14:16:44.497 INFO:teuthology.orchestra.run.smithi181.stderr:tar: /var/lib/ceph/98ebaeb8-ee99-11ee-b647-cb9ed24678a4/crash: Cannot open: No such file or directory 2024-03-30T14:16:44.497 INFO:teuthology.orchestra.run.smithi181.stderr:tar: Error is not recoverable: exiting now 2024-03-30T14:16:44.498 INFO:tasks.cephadm:Checking cluster log for badness... 2024-03-30T14:16:44.498 DEBUG:teuthology.orchestra.run.smithi099:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/98ebaeb8-ee99-11ee-b647-cb9ed24678a4/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | head -n 1 2024-03-30T14:16:44.530 INFO:teuthology.orchestra.run.smithi099.stdout:2024-03-30T13:32:17.671317+0000 mon.a (mon.0) 199 : cluster [WRN] Health check failed: 1/3 mons down, quorum a,c (MON_DOWN) 2024-03-30T14:16:44.531 WARNING:tasks.cephadm:Found errors (ERR|WRN|SEC) in cluster log 2024-03-30T14:16:44.531 DEBUG:teuthology.orchestra.run.smithi099:> sudo egrep '\[SEC\]' /var/log/ceph/98ebaeb8-ee99-11ee-b647-cb9ed24678a4/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | head -n 1 2024-03-30T14:16:44.603 DEBUG:teuthology.orchestra.run.smithi099:> sudo egrep '\[ERR\]' /var/log/ceph/98ebaeb8-ee99-11ee-b647-cb9ed24678a4/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | head -n 1 2024-03-30T14:16:44.674 DEBUG:teuthology.orchestra.run.smithi099:> sudo egrep '\[WRN\]' /var/log/ceph/98ebaeb8-ee99-11ee-b647-cb9ed24678a4/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | head -n 1 2024-03-30T14:16:44.743 INFO:teuthology.orchestra.run.smithi099.stdout:2024-03-30T13:32:17.671317+0000 mon.a (mon.0) 199 : cluster [WRN] Health check failed: 1/3 mons down, quorum a,c (MON_DOWN) 2024-03-30T14:16:44.743 INFO:tasks.cephadm:Compressing logs... 2024-03-30T14:16:44.743 DEBUG:teuthology.orchestra.run.smithi099:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-03-30T14:16:44.785 DEBUG:teuthology.orchestra.run.smithi181:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-03-30T14:16:44.811 INFO:teuthology.orchestra.run.smithi099.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-03-30T14:16:44.812 INFO:teuthology.orchestra.run.smithi099.stderr:: No such file or directory 2024-03-30T14:16:44.812 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/98ebaeb8-ee99-11ee-b647-cb9ed24678a4/ceph-mon.a.log 2024-03-30T14:16:44.812 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/98ebaeb8-ee99-11ee-b647-cb9ed24678a4/ceph.audit.log 2024-03-30T14:16:44.812 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/cephadm.log: gzip -5 --verbose -- /var/log/ceph/98ebaeb8-ee99-11ee-b647-cb9ed24678a4/ceph-osd.1.log 2024-03-30T14:16:44.812 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/98ebaeb8-ee99-11ee-b647-cb9ed24678a4/ceph-mon.a.log: /var/log/ceph/98ebaeb8-ee99-11ee-b647-cb9ed24678a4/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/98ebaeb8-ee99-11ee-b647-cb9ed24678a4/ceph-osd.3.log 2024-03-30T14:16:44.812 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/98ebaeb8-ee99-11ee-b647-cb9ed24678a4/ceph-mgr.y.log 2024-03-30T14:16:44.812 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/98ebaeb8-ee99-11ee-b647-cb9ed24678a4/ceph-osd.1.log: /var/log/ceph/98ebaeb8-ee99-11ee-b647-cb9ed24678a4/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/98ebaeb8-ee99-11ee-b647-cb9ed24678a4/tcmu-runner.log 2024-03-30T14:16:44.812 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/98ebaeb8-ee99-11ee-b647-cb9ed24678a4/ceph-mgr.y.log: gzip -5 --verbose -- /var/log/ceph/98ebaeb8-ee99-11ee-b647-cb9ed24678a4/ceph-osd.0.log 2024-03-30T14:16:44.813 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/98ebaeb8-ee99-11ee-b647-cb9ed24678a4/tcmu-runner.log: 88.0% -- replaced with /var/log/ceph/98ebaeb8-ee99-11ee-b647-cb9ed24678a4/tcmu-runner.log.gz 2024-03-30T14:16:44.813 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/98ebaeb8-ee99-11ee-b647-cb9ed24678a4/ceph.cephadm.log 2024-03-30T14:16:44.815 INFO:teuthology.orchestra.run.smithi181.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose -- /var/log/ceph/cephadm.log: No such file or directory 2024-03-30T14:16:44.815 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-03-30T14:16:44.818 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/98ebaeb8-ee99-11ee-b647-cb9ed24678a4/ceph-osd.6.log 2024-03-30T14:16:44.818 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/cephadm.log: gzip -5 --verbose -- /var/log/ceph/98ebaeb8-ee99-11ee-b647-cb9ed24678a4/ceph.audit.log 2024-03-30T14:16:44.818 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/98ebaeb8-ee99-11ee-b647-cb9ed24678a4/ceph-osd.6.log: gzip -5 --verbose -- /var/log/ceph/98ebaeb8-ee99-11ee-b647-cb9ed24678a4/ceph-osd.4.log 2024-03-30T14:16:44.818 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/98ebaeb8-ee99-11ee-b647-cb9ed24678a4/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/98ebaeb8-ee99-11ee-b647-cb9ed24678a4/ceph-osd.7.log 2024-03-30T14:16:44.818 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/98ebaeb8-ee99-11ee-b647-cb9ed24678a4/ceph-osd.5.log 2024-03-30T14:16:44.825 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/98ebaeb8-ee99-11ee-b647-cb9ed24678a4/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/98ebaeb8-ee99-11ee-b647-cb9ed24678a4/ceph.log 2024-03-30T14:16:44.830 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/98ebaeb8-ee99-11ee-b647-cb9ed24678a4/ceph-osd.7.log: /var/log/ceph/98ebaeb8-ee99-11ee-b647-cb9ed24678a4/ceph-osd.4.log: gzip -5 --verbose -- /var/log/ceph/98ebaeb8-ee99-11ee-b647-cb9ed24678a4/ceph-mgr.x.log 2024-03-30T14:16:44.837 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/98ebaeb8-ee99-11ee-b647-cb9ed24678a4/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/98ebaeb8-ee99-11ee-b647-cb9ed24678a4/ceph.cephadm.log 2024-03-30T14:16:44.841 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/98ebaeb8-ee99-11ee-b647-cb9ed24678a4/ceph-mgr.x.log: 92.6% -- replaced with /var/log/ceph/98ebaeb8-ee99-11ee-b647-cb9ed24678a4/ceph.audit.log.gz 2024-03-30T14:16:44.841 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/98ebaeb8-ee99-11ee-b647-cb9ed24678a4/ceph.log 2024-03-30T14:16:44.843 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/98ebaeb8-ee99-11ee-b647-cb9ed24678a4/ceph.cephadm.log: 94.7% -- replaced with /var/log/ceph/98ebaeb8-ee99-11ee-b647-cb9ed24678a4/ceph.cephadm.log.gz 2024-03-30T14:16:44.844 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/98ebaeb8-ee99-11ee-b647-cb9ed24678a4/ceph-osd.2.log 2024-03-30T14:16:44.845 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/98ebaeb8-ee99-11ee-b647-cb9ed24678a4/ceph.cephadm.log: 91.3% -- replaced with /var/log/ceph/98ebaeb8-ee99-11ee-b647-cb9ed24678a4/ceph.cephadm.log.gz 2024-03-30T14:16:44.846 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/98ebaeb8-ee99-11ee-b647-cb9ed24678a4/ceph-volume.log 2024-03-30T14:16:44.851 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/98ebaeb8-ee99-11ee-b647-cb9ed24678a4/ceph.log: gzip -5 --verbose -- /var/log/ceph/98ebaeb8-ee99-11ee-b647-cb9ed24678a4/ceph-mon.b.log 2024-03-30T14:16:44.853 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/98ebaeb8-ee99-11ee-b647-cb9ed24678a4/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/98ebaeb8-ee99-11ee-b647-cb9ed24678a4/ceph-client.rgw.foo.smithi181.wfqwti.log 2024-03-30T14:16:44.853 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/98ebaeb8-ee99-11ee-b647-cb9ed24678a4/ceph-mon.b.log: 90.3% -- replaced with /var/log/ceph/98ebaeb8-ee99-11ee-b647-cb9ed24678a4/ceph.log.gz 2024-03-30T14:16:44.854 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/98ebaeb8-ee99-11ee-b647-cb9ed24678a4/ceph-client.rgw.foo.smithi181.wfqwti.log: 76.8% -- replaced with /var/log/ceph/98ebaeb8-ee99-11ee-b647-cb9ed24678a4/ceph-client.rgw.foo.smithi181.wfqwti.log.gz 2024-03-30T14:16:44.857 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/98ebaeb8-ee99-11ee-b647-cb9ed24678a4/ceph.log: gzip -5 --verbose -- /var/log/ceph/98ebaeb8-ee99-11ee-b647-cb9ed24678a4/ceph-client.rgw.foo.smithi099.fxjbmp.log 2024-03-30T14:16:44.858 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/98ebaeb8-ee99-11ee-b647-cb9ed24678a4/ceph-osd.2.log: 91.0% -- replaced with /var/log/ceph/cephadm.log.gz 2024-03-30T14:16:44.859 INFO:teuthology.orchestra.run.smithi099.stderr: 95.2% -- replaced with /var/log/ceph/98ebaeb8-ee99-11ee-b647-cb9ed24678a4/ceph.audit.log.gz 2024-03-30T14:16:44.859 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/98ebaeb8-ee99-11ee-b647-cb9ed24678a4/ceph-volume.log 2024-03-30T14:16:44.860 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/98ebaeb8-ee99-11ee-b647-cb9ed24678a4/ceph-client.rgw.foo.smithi099.fxjbmp.log: 94.4% -- replaced with /var/log/ceph/98ebaeb8-ee99-11ee-b647-cb9ed24678a4/ceph.log.gz 2024-03-30T14:16:44.861 INFO:teuthology.orchestra.run.smithi099.stderr: 82.9% -- replaced with /var/log/ceph/98ebaeb8-ee99-11ee-b647-cb9ed24678a4/ceph-client.rgw.foo.smithi099.fxjbmp.log.gz 2024-03-30T14:16:44.861 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/98ebaeb8-ee99-11ee-b647-cb9ed24678a4/ceph-mon.c.log 2024-03-30T14:16:44.877 INFO:teuthology.orchestra.run.smithi181.stderr: 91.0% -- replaced with /var/log/ceph/cephadm.log.gz 2024-03-30T14:16:44.944 INFO:teuthology.orchestra.run.smithi181.stderr: 92.7% -- replaced with /var/log/ceph/98ebaeb8-ee99-11ee-b647-cb9ed24678a4/ceph-volume.log.gz 2024-03-30T14:16:45.017 INFO:teuthology.orchestra.run.smithi181.stderr: 88.4% -- replaced with /var/log/ceph/98ebaeb8-ee99-11ee-b647-cb9ed24678a4/ceph-mgr.x.log.gz 2024-03-30T14:16:45.073 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/98ebaeb8-ee99-11ee-b647-cb9ed24678a4/ceph-volume.log: /var/log/ceph/98ebaeb8-ee99-11ee-b647-cb9ed24678a4/ceph-mon.c.log: 92.7% -- replaced with /var/log/ceph/98ebaeb8-ee99-11ee-b647-cb9ed24678a4/ceph-volume.log.gz 2024-03-30T14:16:46.458 INFO:teuthology.orchestra.run.smithi181.stderr: 93.1% -- replaced with /var/log/ceph/98ebaeb8-ee99-11ee-b647-cb9ed24678a4/ceph-osd.6.log.gz 2024-03-30T14:16:46.632 INFO:teuthology.orchestra.run.smithi181.stderr: 92.7% -- replaced with /var/log/ceph/98ebaeb8-ee99-11ee-b647-cb9ed24678a4/ceph-mon.b.log.gz 2024-03-30T14:16:46.682 INFO:teuthology.orchestra.run.smithi099.stderr: 93.3% -- replaced with /var/log/ceph/98ebaeb8-ee99-11ee-b647-cb9ed24678a4/ceph-osd.2.log.gz 2024-03-30T14:16:46.684 INFO:teuthology.orchestra.run.smithi099.stderr: 92.8% -- replaced with /var/log/ceph/98ebaeb8-ee99-11ee-b647-cb9ed24678a4/ceph-mon.c.log.gz 2024-03-30T14:16:46.796 INFO:teuthology.orchestra.run.smithi099.stderr: 88.4% -- replaced with /var/log/ceph/98ebaeb8-ee99-11ee-b647-cb9ed24678a4/ceph-mgr.y.log.gz 2024-03-30T14:16:46.887 INFO:teuthology.orchestra.run.smithi181.stderr: 93.7% -- replaced with /var/log/ceph/98ebaeb8-ee99-11ee-b647-cb9ed24678a4/ceph-osd.7.log.gz 2024-03-30T14:16:46.893 INFO:teuthology.orchestra.run.smithi181.stderr: 93.3% -- replaced with /var/log/ceph/98ebaeb8-ee99-11ee-b647-cb9ed24678a4/ceph-osd.5.log.gz 2024-03-30T14:16:47.281 INFO:teuthology.orchestra.run.smithi099.stderr: 93.5% -- replaced with /var/log/ceph/98ebaeb8-ee99-11ee-b647-cb9ed24678a4/ceph-osd.0.log.gz 2024-03-30T14:16:47.442 INFO:teuthology.orchestra.run.smithi099.stderr: 93.5% -- replaced with /var/log/ceph/98ebaeb8-ee99-11ee-b647-cb9ed24678a4/ceph-osd.1.log.gz 2024-03-30T14:16:47.561 INFO:teuthology.orchestra.run.smithi181.stderr: 93.5% -- replaced with /var/log/ceph/98ebaeb8-ee99-11ee-b647-cb9ed24678a4/ceph-osd.4.log.gz 2024-03-30T14:16:47.563 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-03-30T14:16:47.563 INFO:teuthology.orchestra.run.smithi181.stderr:real 0m2.763s 2024-03-30T14:16:47.563 INFO:teuthology.orchestra.run.smithi181.stderr:user 0m10.242s 2024-03-30T14:16:47.563 INFO:teuthology.orchestra.run.smithi181.stderr:sys 0m0.387s 2024-03-30T14:16:47.836 INFO:teuthology.orchestra.run.smithi099.stderr: 93.3% -- replaced with /var/log/ceph/98ebaeb8-ee99-11ee-b647-cb9ed24678a4/ceph-osd.3.log.gz 2024-03-30T14:16:48.225 INFO:teuthology.orchestra.run.smithi099.stderr: 91.8% -- replaced with /var/log/ceph/98ebaeb8-ee99-11ee-b647-cb9ed24678a4/ceph-mon.a.log.gz 2024-03-30T14:16:48.227 INFO:teuthology.orchestra.run.smithi099.stderr: 2024-03-30T14:16:48.227 INFO:teuthology.orchestra.run.smithi099.stderr:real 0m3.430s 2024-03-30T14:16:48.227 INFO:teuthology.orchestra.run.smithi099.stderr:user 0m16.640s 2024-03-30T14:16:48.227 INFO:teuthology.orchestra.run.smithi099.stderr:sys 0m0.618s 2024-03-30T14:16:48.229 INFO:tasks.cephadm:Archiving logs... 2024-03-30T14:16:48.229 DEBUG:teuthology.misc:Transferring archived files from smithi099:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-03-29_21:08:02-orch-squid-distro-default-smithi/7630107/remote/smithi099/log 2024-03-30T14:16:48.230 DEBUG:teuthology.orchestra.run.smithi099:> sudo tar c -f - -C /var/log/ceph -- . 2024-03-30T14:16:50.356 DEBUG:teuthology.misc:Transferring archived files from smithi181:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-03-29_21:08:02-orch-squid-distro-default-smithi/7630107/remote/smithi181/log 2024-03-30T14:16:50.357 DEBUG:teuthology.orchestra.run.smithi181:> sudo tar c -f - -C /var/log/ceph -- . 2024-03-30T14:16:51.728 INFO:tasks.cephadm:Removing cluster... 2024-03-30T14:16:51.728 DEBUG:teuthology.orchestra.run.smithi099:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 98ebaeb8-ee99-11ee-b647-cb9ed24678a4 --force 2024-03-30T14:16:52.024 DEBUG:teuthology.orchestra.run.smithi181:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 98ebaeb8-ee99-11ee-b647-cb9ed24678a4 --force 2024-03-30T14:16:52.328 INFO:tasks.cephadm:Removing cephadm ... 2024-03-30T14:16:52.328 DEBUG:teuthology.orchestra.run.smithi099:> rm -rf /home/ubuntu/cephtest/cephadm 2024-03-30T14:16:52.345 DEBUG:teuthology.orchestra.run.smithi181:> rm -rf /home/ubuntu/cephtest/cephadm 2024-03-30T14:16:52.359 INFO:tasks.cephadm:Teardown complete 2024-03-30T14:16:52.360 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-03-30T14:16:52.369 INFO:teuthology.task.clock:Checking final clock skew... 2024-03-30T14:16:52.369 DEBUG:teuthology.orchestra.run.smithi099:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-03-30T14:16:52.387 DEBUG:teuthology.orchestra.run.smithi181:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-03-30T14:16:52.398 INFO:teuthology.orchestra.run.smithi099.stderr:bash: line 1: ntpq: command not found 2024-03-30T14:16:52.403 INFO:teuthology.orchestra.run.smithi099.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-03-30T14:16:52.403 INFO:teuthology.orchestra.run.smithi099.stdout:=============================================================================== 2024-03-30T14:16:52.403 INFO:teuthology.orchestra.run.smithi099.stdout:^+ hv01.front.sepia.ceph.com 2 7 377 93 +97us[ +97us] +/- 81ms 2024-03-30T14:16:52.403 INFO:teuthology.orchestra.run.smithi099.stdout:^* hv02.front.sepia.ceph.com 3 6 377 33 -275us[ -275us] +/- 62ms 2024-03-30T14:16:52.403 INFO:teuthology.orchestra.run.smithi099.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 28 +280us[ +280us] +/- 72ms 2024-03-30T14:16:52.404 INFO:teuthology.orchestra.run.smithi099.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-03-30T14:16:52.413 INFO:teuthology.orchestra.run.smithi181.stderr:bash: line 1: ntpq: command not found 2024-03-30T14:16:52.417 INFO:teuthology.orchestra.run.smithi181.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-03-30T14:16:52.417 INFO:teuthology.orchestra.run.smithi181.stdout:=============================================================================== 2024-03-30T14:16:52.417 INFO:teuthology.orchestra.run.smithi181.stdout:^+ hv01.front.sepia.ceph.com 2 7 377 88 +92us[ +95us] +/- 81ms 2024-03-30T14:16:52.417 INFO:teuthology.orchestra.run.smithi181.stdout:^* hv02.front.sepia.ceph.com 3 6 377 31 -263us[ -260us] +/- 62ms 2024-03-30T14:16:52.417 INFO:teuthology.orchestra.run.smithi181.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 32 +304us[ +306us] +/- 72ms 2024-03-30T14:16:52.417 INFO:teuthology.orchestra.run.smithi181.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-03-30T14:16:52.418 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-03-30T14:16:52.427 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-03-30T14:16:52.428 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-03-30T14:16:52.437 DEBUG:teuthology.orchestra.run.smithi099:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-03-30T14:16:52.491 DEBUG:teuthology.orchestra.run.smithi181:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-03-30T14:16:52.610 DEBUG:teuthology.orchestra.run.smithi099:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2024-03-30T14:16:52.638 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-30T14:16:52.638 DEBUG:teuthology.orchestra.run.smithi181:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2024-03-30T14:16:52.671 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-30T14:16:52.671 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-03-30T14:16:52.683 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-03-30T14:16:52.695 INFO:teuthology.task.internal:Duration was 3088.318683 seconds 2024-03-30T14:16:52.695 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-03-30T14:16:52.704 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-03-30T14:16:52.704 DEBUG:teuthology.orchestra.run.smithi099:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-03-30T14:16:52.706 DEBUG:teuthology.orchestra.run.smithi181:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-03-30T14:16:52.747 INFO:teuthology.orchestra.run.smithi099.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-03-30T14:16:52.755 INFO:teuthology.orchestra.run.smithi181.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-03-30T14:16:53.112 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-03-30T14:16:53.112 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi099.front.sepia.ceph.com 2024-03-30T14:16:53.113 DEBUG:teuthology.orchestra.run.smithi099:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-03-30T14:16:53.171 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi181.front.sepia.ceph.com 2024-03-30T14:16:53.171 DEBUG:teuthology.orchestra.run.smithi181:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-03-30T14:16:53.196 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-03-30T14:16:53.196 DEBUG:teuthology.orchestra.run.smithi099:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-03-30T14:16:53.213 DEBUG:teuthology.orchestra.run.smithi181:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-03-30T14:16:53.266 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-03-30T14:16:53.266 DEBUG:teuthology.orchestra.run.smithi099:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-03-30T14:16:53.281 DEBUG:teuthology.orchestra.run.smithi181:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-03-30T14:16:54.309 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-03-30T14:16:54.332 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-03-30T14:16:54.332 DEBUG:teuthology.orchestra.run.smithi099:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-03-30T14:16:54.359 DEBUG:teuthology.orchestra.run.smithi181:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-03-30T14:16:54.387 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-03-30T14:16:54.398 DEBUG:teuthology.orchestra.run.smithi099:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-03-30T14:16:54.401 DEBUG:teuthology.orchestra.run.smithi181:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-03-30T14:16:54.424 INFO:teuthology.orchestra.run.smithi099.stdout:kernel.core_pattern = core 2024-03-30T14:16:54.454 INFO:teuthology.orchestra.run.smithi181.stdout:kernel.core_pattern = core 2024-03-30T14:16:54.480 DEBUG:teuthology.orchestra.run.smithi099:> test -e /home/ubuntu/cephtest/archive/coredump 2024-03-30T14:16:54.533 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-30T14:16:54.534 DEBUG:teuthology.orchestra.run.smithi181:> test -e /home/ubuntu/cephtest/archive/coredump 2024-03-30T14:16:54.548 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-30T14:16:54.548 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-03-30T14:16:54.558 INFO:teuthology.task.internal:Transferring archived files... 2024-03-30T14:16:54.559 DEBUG:teuthology.misc:Transferring archived files from smithi099:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-03-29_21:08:02-orch-squid-distro-default-smithi/7630107/remote/smithi099 2024-03-30T14:16:54.559 DEBUG:teuthology.orchestra.run.smithi099:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-03-30T14:16:54.640 DEBUG:teuthology.misc:Transferring archived files from smithi181:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-03-29_21:08:02-orch-squid-distro-default-smithi/7630107/remote/smithi181 2024-03-30T14:16:54.640 DEBUG:teuthology.orchestra.run.smithi181:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-03-30T14:16:54.695 INFO:teuthology.task.internal:Removing archive directory... 2024-03-30T14:16:54.695 DEBUG:teuthology.orchestra.run.smithi099:> rm -rf -- /home/ubuntu/cephtest/archive 2024-03-30T14:16:54.697 DEBUG:teuthology.orchestra.run.smithi181:> rm -rf -- /home/ubuntu/cephtest/archive 2024-03-30T14:16:54.736 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-03-30T14:16:54.746 INFO:teuthology.task.internal:Not uploading archives. 2024-03-30T14:16:54.746 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-03-30T14:16:54.755 INFO:teuthology.task.internal:Tidying up after the test... 2024-03-30T14:16:54.756 DEBUG:teuthology.orchestra.run.smithi099:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-03-30T14:16:54.758 DEBUG:teuthology.orchestra.run.smithi181:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-03-30T14:16:54.770 INFO:teuthology.orchestra.run.smithi099.stdout: 262166 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 30 14:16 /home/ubuntu/cephtest 2024-03-30T14:16:54.791 INFO:teuthology.orchestra.run.smithi181.stdout: 262166 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 30 14:16 /home/ubuntu/cephtest 2024-03-30T14:16:54.792 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-03-30T14:16:54.802 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-03-30T14:16:54.821 INFO:teuthology.nuke:Checking targets against current locks 2024-03-30T14:16:54.848 DEBUG:teuthology.nuke:shortname: smithi099 2024-03-30T14:16:54.848 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-03-30T14:16:54.871 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi099.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-03-29_21:08:02-orch-squid-distro-default-smithi/7630107', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-03-30 13:15:57.098925', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBGMSyZlWQkKzFwF6TDPK9IJwRhWHLdLXz/3MOGu9qXM+iiLL9Zsol3h+ZFzTh/gRwERND6NY9esE6gILIl0JOMI='} 2024-03-30T14:16:54.875 DEBUG:teuthology.nuke:shortname: smithi181 2024-03-30T14:16:54.875 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-03-30T14:16:54.898 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi181.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-03-29_21:08:02-orch-squid-distro-default-smithi/7630107', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-03-30 13:15:57.097327', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBO6bbbhPuXSp7u5lkGVG9HPoFR2G95teBYWhOajCENkSpjvOr6/NIsbRfitGH5h/Pdx7ia8UDfz5Y5ByWbwjGqE='} 2024-03-30T14:16:54.918 INFO:teuthology.orchestra.console.smithi099:Power off 2024-03-30T14:16:54.919 DEBUG:teuthology.orchestra.console.smithi099:pexpect command: ipmitool -H smithi099.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-03-30T14:16:54.942 DEBUG:teuthology.orchestra.console.smithi099:power off output: Chassis Power Control: Down/Off 2024-03-30T14:16:54.942 DEBUG:teuthology.orchestra.console.smithi099:pexpect command: ipmitool -H smithi099.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-30T14:16:54.959 INFO:teuthology.orchestra.console.smithi181:Power off 2024-03-30T14:16:54.959 DEBUG:teuthology.orchestra.console.smithi181:pexpect command: ipmitool -H smithi181.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-03-30T14:16:54.968 DEBUG:teuthology.orchestra.console.smithi099:check power output: Chassis Power is on 2024-03-30T14:16:54.982 DEBUG:teuthology.orchestra.console.smithi181:power off output: Chassis Power Control: Down/Off 2024-03-30T14:16:54.982 DEBUG:teuthology.orchestra.console.smithi181:pexpect command: ipmitool -H smithi181.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-30T14:16:55.005 DEBUG:teuthology.orchestra.console.smithi181:check power output: Chassis Power is on 2024-03-30T14:16:58.969 DEBUG:teuthology.orchestra.console.smithi099:pexpect command: ipmitool -H smithi099.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-30T14:16:59.006 DEBUG:teuthology.orchestra.console.smithi181:pexpect command: ipmitool -H smithi181.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-30T14:16:59.079 DEBUG:teuthology.orchestra.console.smithi099:check power output: Chassis Power is on 2024-03-30T14:16:59.116 DEBUG:teuthology.orchestra.console.smithi181:check power output: Chassis Power is on 2024-03-30T14:17:03.084 DEBUG:teuthology.orchestra.console.smithi099:pexpect command: ipmitool -H smithi099.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-30T14:17:03.116 DEBUG:teuthology.orchestra.console.smithi181:pexpect command: ipmitool -H smithi181.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-30T14:17:03.194 DEBUG:teuthology.orchestra.console.smithi099:check power output: Chassis Power is off 2024-03-30T14:17:03.225 DEBUG:teuthology.orchestra.console.smithi181:check power output: Chassis Power is off 2024-03-30T14:17:03.296 INFO:teuthology.orchestra.console.smithi099:Power off completed 2024-03-30T14:17:03.326 INFO:teuthology.orchestra.console.smithi181:Power off completed 2024-03-30T14:17:03.430 INFO:teuthology.run:Summary data: description: orch/cephadm/upgrade/{1-start-distro/1-start-centos_9.stream 2-repo_digest/repo_digest 3-upgrade/staggered 4-wait 5-upgrade-ls agent/on mon_election/classic} duration: 3088.318683385849 failure_reason: '"2024-03-30T13:32:17.671317+0000 mon.a (mon.0) 199 : cluster [WRN] Health check failed: 1/3 mons down, quorum a,c (MON_DOWN)" in cluster log' owner: scheduled_teuthology@teuthology success: false 2024-03-30T14:17:03.430 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-30T14:17:03.512 INFO:teuthology.run:FAIL